Dice Question Streamline Icon: https://streamlinehq.com

Feasibility of using ChatGPT to predict article retraction from Twitter mentions

Ascertain whether ChatGPT can be utilized to predict the retraction of scholarly articles based solely on the textual content of Twitter mentions referencing those articles.

Information Square Streamline Icon: https://streamlinehq.com

Background

LLMs like ChatGPT have demonstrated strong capabilities in natural language understanding and annotation tasks, suggesting potential applications in predictive tasks based on social media text. The question is whether ChatGPT can infer retraction risk from tweets about scholarly articles.

Resolving this problem would establish whether generative AI can assist in early detection of problematic publications by processing reader comments and discussions on social media, complementing human judgment and traditional computational methods.

References

Summing up the above, the potential of Twitter mentions to imply problems and the capabilities of ChatGPT in prediction have sparked our interest in an unresolved question: can ChatGPT be utilized to predict article retraction based on the texts of Twitter mentions?

Can tweets predict article retractions? A comparison between human and LLM labelling (2403.16851 - Zheng et al., 25 Mar 2024) in Section 1.3