ChatGPT のプログラミング能力に関する評価実験―Aizu Online Judge を用いて―

書誌事項

タイトル別名
  • Evaluation of ChatGPT's Programming Capabilities Using Aizu Online Judge
  • ChatGPT ノ プログラミング ノウリョク ニ カンスル ヒョウカ ジッケン : Aizu Online Judge オ モチイテ

この論文をさがす

説明

ChatGPT, developed by OpenAI, is said to possess programming capabilities. For university students in information technology, programming is naturally one of the compulsory subjects, and its importance is self-evident. This article aims to evaluate the programming abilities of ChatGPT. To ensure objectivity, we used 340 tasks from the introductory and advanced programming courses available on the Aizu Online Judge site. By providing the content of each task as input to ChatGPT and having it generate solutions, we measured its accuracy and success rates. As a result, we concluded that, in terms of problem-solving programming ability, ChatGPT ranks within the top half of information technology university students.

収録刊行物

詳細情報 詳細情報について

問題の指摘

ページトップへ