NTCIR-19

NTCIR19-Lifelog Task

Advancing Lifelog Analytics and Retrieval

Formal Run Topics

Formal run topics are the official test topics used for the final evaluation. These topics will be used to assess participant systems and determine the final rankings.

Lifelog Task Formal Run Topics

The Lifelog Semantic Access Task (LSAT) formal run topics are now available for download. These topics will be used for the final evaluation.

Status: Released (April 20, 2026)

Topics File: formal-run-topics.xml

The formal run includes 33 topics covering two types:

Ad-Hoc Queries (16 topics)

  • AD26001–AD26016: 16 Ad-Hoc topics

Known-Item Search (17 topics)

  • KIS26001–KIS26017: 17 Known-Item Search topics

Topic Format: Each topic in the XML file includes:

  • ID: Unique topic identifier (AD26xxx for Ad-Hoc, KIS26xxx for Known-Item)
  • Type: adhoc or knownitem
  • Title: Brief topic title
  • Description: Description of what to find
  • Narrative: Detailed explanation of relevance criteria

CASTLE Task Formal Run Topics

The CASTLE (CollAborative SeT of LifEloggers) project provides multimodal collaborative session data including audio, video, and chat transcripts. Formal run topics for CASTLE tasks are being released during the formal run phase. The CASTLE dataset is available on Hugging Face.

CSAT - CASTLE Semantic Access subTask

The CASTLE Semantic Access Task (CSAT) is a search-based task where participants retrieve key interactions or events from multimodal collaborative session data (audio, video, chat transcripts) based on a semantic query.

Status: Released (April 20, 2026)

Topics File: castle-semantic-topics-formal-run.xml

The CSAT formal run includes 25 topics (CSAT26001–CSAT26025) covering various semantic queries such as finding instances of playing guitar, taking down a christmas tree, people singing, playing board games, and more.

Topic Format: Each CSAT topic includes:

  • ID: Unique topic identifier (CSAT26001–CSAT26025)
  • Type: semantic
  • Title: Brief topic title
  • Description: Description of what to find
  • Narrative: Detailed explanation of relevance criteria

CAST-Seg - CASTLE Conversation Segmentation subTask

The CASTLE Conversation Segmentation subTask (CAST-Seg) requires participants to segment collaborative sessions into meaningful conversational units such as tasks, discussions, or decisions. This enables better analysis and retrieval of collaborative session data.

Status: Coming soon

Recipe Generation

The Recipe Generation subtask challenges participants to generate personal recipes or cooking procedures using multimodal collaborative session data from the CASTLE dataset. The dataset includes menu schedules showing meal assignments and a Castle Cookbook containing recipes for various dishes.

Status: Coming soon

Formal Run Phase

The formal run phase runs from April to August 2026. During this period:

  • LSAT and CSAT formal run topics have been released (April 20, 2026)
  • Participants submit their formal runs
  • All submissions must be received by the end of the formal run phase
  • Registration deadline is July 10, 2026

Important: Formal run submissions will be used for the final evaluation and ranking. Participants should ensure their systems are fully tested using dry run topics before submitting formal runs.

Downloads