Information Management and Preservation
Information and Software Engineering Group (IFS)Institute of Software Technology and Interactive Systems (ISIS)
Vienna University of Technology
CLEF-IP Lab
Latest Updates
Evaluation Results
June 1st, 2013
Today we will release the evaluation results.
Topics for Claims to Passages task available
April 19, 2013
FINALLY! The set of test topics is done. It has been non-trivial to extract the sets of claims.
Download here the set of test 50(EN)+50(DE)+49(FR) topics. You can find them on the task description page as well.
The submission deadline for this task only has moved to May 10th!
Topics for Flowchart Recognition available
April 10, 2013
We're working on the set of test topics for the 'Claims to Passages' task. Bear with us a few more days.
April 2, 2013
The topics for the Flowchart recognition task are now available online.
Training data for 'Claims to Passages' task, Registration
March 13, 2013
We have done some updates to these pages for the 'Claims to Passages' task. The training data is now available here. Please look at the added 'tfam-docs' content to the topics on the task's page
We are closer to having the test topics, but generating their qrels will be time-consuming. Anyone wishing to help drop us an e-mail!
To register to our Lab please fill in this form on the CLEF 2013 page.
Choosing topics
February, 2013
We're in the process of choosing topics and creating relevance assessments. Meanwhile we've updated the track's time line. Do note that, compared to the previous years, the deadlines are moved with months forward.
CLEF-IP 2013 Tasks
December 7th, 2012
The summary of the tasks in 2013 are now available.
News on CLEF-IP 2013
November, 2012
Our proposal for the next CLEF-IP 2013 lab has been accepted. There'll be three tasks organized, stay tuned for updates.
Where are the other news?
We've moved them here.
CLEF-IP
The CLEF-IP track was launched in 2009 to investigate IR techniques for patent retrieval and was part of the CLEF 2009 evaluation campaign. In 2010 and 2011, the track was organized as a benchmarking activity of the CLEF 2010 and 2011conferences.
The project is supported by the PROMISE Network of Excellence (co-funded by the 7th Framework Programme of the European Commission).
The image tasks are supported by the IMPEX project (funded by the Austrian Research Promotion Agency - FFG).
Tasks in 2013
-
Passage retrieval starting from claims (patentability or novelty search)
: The topics in this task will be based on the claims in patent application documents. Given a claim, the participants will be asked to retrieve relevant documents in the collection and mark out the relevant passages in these documents. This year, participants have access to patent documents that are members of the patent family of the application document. The family patent documents avaliable are those published prior to the patent application in which the topic claims occur.
-
Text to image/image to text
: Given a patent application document - as an XML file - and the set of images occurring in the application, extract the links between the image labels and the text pointing to the object of the image label.
-
Structure Recognition Task
: The topics in this third task are patent images representing flow-charts. Participants in this task will be asked to extract the information in these images and return it in a predefined textual format.
The task is similar to the one organized in 2012. This year we plan to add images with more challenging cases of flow-charts, and - as resources permit - images representing electrical block schemes.