Social media facilitates discussions on critical issues such as climate change, but it also contributes to the rapid dissemination of misinformation, which complicates efforts to maintain an informed public and create evidence-based policies. In this shared task, we emphasise the need to link public discourse to peer-reviewed scholarly articles by gathering English claims from social media about climate change as well as a corpus of about 400K abstracts of publications from the climate sciences domains. Participants will be asked to retrieve relevant abstracts for each claim (subtask I) and classify the relation between the claim and abstract as ‘supports’, ‘refutes’, or ‘not enough information’ (subtask II). A link to the competition webpage will be provided soon.

Subtask I: Abstracts Retrieval

• Task: given a claim from social media about climate change and a corpus of abstracts, retrieve the top K most relevant abstracts.
• Evaluation: MAP and B-Pref accounting for retrieving relevant abstracts and not penalising unjudged documents.

Subtask II: Claim Verification

• Task: given the claim-abstract pairs received from the previous subtask, classify their relation as ‘support’, ‘refutes’, or ‘not enough information’.
• Evaluation: F1 score based on judged documents from gold data; unjudged documents will not be included in computing the score.

Important Dates

• Training set release: April 1st, 2025
• Test set release: April 15th, 2025
• Systems submissions deadline: May 16th, 2025
• Paper submission deadline: May 23rd, 2025
• Notification of acceptance: June 13th, 2025
• Camera-ready paper due: June 20th, 2025
• Workshop dates: July 31st or August 1st, 2025 (TBA)

Organizers

Raia Abu Ahmad (DFKI)

Aida Usmanova (Leuphana University Lüneburg)

Georg Rehm (DFKI)

---