Organizational details for CLEF-IP Lab

Registrations were managed by the CLEF conference organizers.

Note: The CLEF-IP Lab is not running anymore. The information below is retained for documentaiton purposes, only.

Submissions to the CLEF-IP Lab

DIRECT is the system used to submit retrieval experiments to our lab.

How do we choose team names?

Freely. Choose any name you wish, but it should easily identify your team/institution.

How many runs are we allowed to submit?

8 runs per task. The run files should be named using the following schema: participantID-runID-taskID.extension.
   participantID will identify your institution/group
   runID identifies the different runs you submit
   taskID should be PSG
   extension is either tgz, gz, zip or other extension used by compressing programs.

How many results per topic can we submit for the 'Claims to Passage Task'?

We accept a maximum of 100 document ids per topic. That is, if we remove the relevant xpaths in your submissions, the number of unique pairs <topic_id, doc_id> should be 100 per topic_id.

Shall we send our submissions to you?

We will very soon announce submission details, since the lab's tasks are currently set up in the DIRECt system. Worst case, yes, you can just send the results to me.

Are we supposed to submit a notebook paper, give presentation, poster?

Yes, all of the above, if you wish to. A notebook paper is generally required and expected. The same for a presentation. A poster is optional, but a good opportunity to show your work to conference participants that cannot attend the CLEF-IP sessions.


Timeline

The time line of the track in 2013 was:

  • Data release - you can get it from the download area
  • Topic release - 1st week of March 2013
  • Submission deadline - May 1st, 2013
  • Evaluation results release - June 1st, 2013
  • Hard deadline for workshop notes submissions - June 15, 2013
  • Workshop at CLEF - September 2013