NTCIR19-Lifelog Task

Lifelog Task Submissions

LSAT Submissions

A submitted run for the LSAT task is in the form of a single CSV file per run. Each group can submit up to 10 runs, each as an individual file.

Submission Method: Submission files should be sent (one email per group) to ntcirlifelog@gmail.com by the due date with the subject line 'NTCIR-Lifelog LSAT Submission'.

File Naming Convention: The submission file should be named as follows: GroupID-RunID-[Interactive or Automatic].txt, where:

• GroupID: The registration ID of your group at NTCIR
• RunID: The number of the run (e.g., DCULSAT01, DCULSAT02, etc.)
• Type: Label as either "Automatic" or "Interactive"

Submission Format: For every topic, every image considered relevant should have one line in the CSV file. For some topics there will be only one relevant item (one line in the submission), for others there will be many relevant items (many lines in the submission), up to 100. It is also possible that no relevant items are found for a topic, so then there should be no entry in the file for that topic.

CSV Format for Automatic Run:

GROUP-ID, RUN-ID, TOPIC-ID, IMAGE-ID, SCORE (in decreasing order of relevance)
DCU, DCULSAT01, 16001, u1_2016-08-15_112559, 1.0
DCU, DCULSAT01, 16001, u1_2016-08-15_120354, 1.0
...

Run Types:

• Automatic Runs: Runs in which the query is presented to the system and the results generated with no further user input.
• Interactive Runs: Runs in which a user is involved as an active participant in the result generation process.

CASTLE Task Submissions

CSAT Submissions

Submission guidelines for CSAT (CASTLE Semantic Access Task) will follow a similar format to LSAT. Detailed submission instructions will be provided closer to the submission deadline.

Submission Format: Participants should prepare CSV files containing retrieved instances for each topic, with relevance scores in decreasing order. The format will be similar to LSAT submissions, adapted for CASTLE multimodal data.

Submission Method: Submission files should be sent to ntcirlifelog@gmail.com with the subject line 'NTCIR-Lifelog CSAT Submission'.

File Naming: Files should be named as GroupID-RunID-[Interactive or Automatic].txt, following the same convention as LSAT submissions.

CAST-Seg Submissions

Submission guidelines for CAST-Seg (Conversation Segmentation) will specify the format for segment boundaries and segmentation results.

Submission Format: Participants will need to submit segmentation boundaries indicating where meaningful conversational units begin and end in collaborative sessions. Detailed format specifications will be provided in the topic release package.

Submission Method: Submission files should be sent to ntcirlifelog@gmail.com with the subject line 'NTCIR-Lifelog CAST-Seg Submission'.

Recipe Generation Submissions

Submission format for Recipe Generation will be specified in the topic release.

Submission Format: Participants will need to submit generated recipes or cooking procedures based on multimodal lifelog data. The exact format (text, structured data, etc.) will be detailed in the topic release package.

Submission Method: Submission files should be sent to ntcirlifelog@gmail.com with the subject line 'NTCIR-Lifelog Recipe Generation Submission'.