ICSE 2024 (series) / Artifact Evaluation /
On the Helpfulness of Answering Developer Questions on Discord with Similar Conversations and Posts from the Past
This artifact is for the paper titled “On the Helpfulness of Answering Developer Questions on Discord with Similar Conversations and Posts from the Past”. It enables the user to understand how the empirical analysis was done and to reuse the labeled data, understand how the suggestions were generated using the word embeddings, and also generate these word embeddings on the used and new data. Further, the participant’s evaluations can be analyzed and use for training future models. Lastly, the questions used for the interviews and surveys are made available.
The artifact requires a python environment and basic use of the package manager pip
. For generating the word embeddings and suggestions, the availability of a GPU is recommended.