ICSE 2024 (series) / Artifact Evaluation /
Artifact for "Are Prompt Engineering and TODO Comments Friends or Foes? An Evaluation on GitHub Copilot"
TODO comment repayment is a difficult task, as it requires understanding the TODO comment’s symptoms and appropriately addressing them. In our paper “Are Prompt Engineering and TODO Comments Friends or Foes? An Evaluation on GitHub Copilot”, the authors generate three potential solutions to 380 different TODO comments mined from open-source repositories. In this artifact, users are guided on how to reproduce the tables in the paper which were created as a result of manual evaluation of these generated solutions.