Score your run
Upload one or more formal-run submission files to receive official-style
evaluation reports (.eval.txt) against the organiser qrels.
No login required. You can select multiple files (up to 10) per upload.
Available now: LSAT and CSAT.
CAST-Seg and Recipe Generation scoring opened on September 7, 2026.
LSAT
Format: GROUP-ID,RUN-ID,TOPIC-ID,IMAGE-ID,SCORE
· topics AD* and/or KIS*
· .txt or .csv
· select multiple files if needed (up to 10)
CSAT (CASTLE)
Format: GROUP-ID,RUN-ID,TOPIC-ID,DAY,START-TIME,END-TIME,SOURCE,SCORE
· topics CSAT26001–CSAT26025
· match = same day+source and temporal IoU ≥ 0.5
· metrics: MAP, precision, recall, recall@k / Success@k / nDCG@k
· select multiple files if needed (up to 10)
CAST-Seg & Recipe Generation
Scoring for CAST-Seg and Recipe Generation opened on September 7, 2026.
Example lines
LSAT
CuriosAI,CuriosAILSAT01,AD26001,20190113_175441_000.jpg,0.106
CuriosAI,CuriosAILSAT01,KIS26001,20191005_084512_000.jpg,0.88CSAT
DCU,DCUCSAT01,CSAT26001,1,10:15:00,10:16:30,Kitchen,0.92
DCU,DCUCSAT01,CSAT26001,2,14:02:00,14:03:00,Allie,0.81See Submission for file naming rules and Evaluation for metric definitions.