Projects

CUBRIK

CUBRIK develops a multimedia search framework to advance the openness of the multimedia search technology to incorporate human and social computation and to enrich the semantics of multimedia content and query processing with the support of temporal and spatial entities. The framework allows to easily custom-design innovative search systems tailored to specific multimedia search scenarios. CUBRIK aims at realize an open search framework, based on three openness principles: Open Technology - a scalable distributed platform for content-intensive processes that supports the design and execution of pipelines integrated with open source and third-party components; Open Human Computation - CUBRIK search platform takes into account the full range of contributions that humans make to enrich the multimedia spaces they occupy. In particular regarding aspects for harvesting implicit annotations from user search behaviour and for developing an innovative networked human computation platform combining the conventionally segregated areas of crowdsourcing, social network and trust analysis and gaming with a purpose. Open Business - an ecosystem to promote the exploitation of a open search platform for tailor-made search solutions. The CUBRIK ecosystem brings together ICT developers, s/w integrators, social networks and service providers, together with content owners and SMEs offering customized search solutions. The Cubrik idea is to move forward from the simple value chain model to a more innovative Business Ecosystem approach where collaboration fosters the emergence of new business models for deploying multimedia search solutions in vertical markets.

MIRES music search (support action)

MIReS project aims to create a research roadmap of MIR field, by expanding its context and addressing challenges such as multimodal information, multiculturalism and multidisciplinarity. MIR has the potential for a major impact on the future economy, the arts and education, not merely through applications of technical components, but also by evolving to address questions of fundamental human understanding, with a view to building a digital economy founded on"uncopiable intangibles": personalisation, interpretation, embodiment, findability and community. Within this wider context we propose to refer to the field of MIR as Music Information ReSearch (MIReS) and thus widen its scope, ensuring its focus is centered on quality of experience with greater relevance to human networks and communities.

SMART

SMART will introduce a holistic open source web-scale multimedia search framework for multimedia data stemming from the physical world. To this end, SMART will develop a scalable search and retrieval architecture for multimedia data, along with intelligent techniques for real-time processing, search and retrieval of physical world multimedia. At the same time, SMART will be able to leverage Web2.0 social networks information in order to facilitate social queries on physical world multimedia.

Social Sensor

SocialSensor will develop a new framework for enabling real-time multimedia indexing and search in the Social Web. The project will move beyond conventional text-based indexing and retrieval models by mining and aggregating user inputs and content over multiple social networking sites. Social Indexing will incorporate information about the structure and activity of the users' social network directly into the multimedia analysis and search process. Furthermore, it will enhance the multimedia consumption experience by developing novel user-centric media visualization and browsing paradigms. The resulting multimedia search system will be showcased and evaluated in two use cases: (a) news, involving professional news editors, journalists and casual readers, benefiting from the improved capabilities of SocialSensor for discovering new interesting social content and integrating it in the news creation and delivery lifecycle, and (b) infotainment, providing new multimedia search tools and unique media consumption experiences to attendants of large events (e.g. festivals).

SeCo

Search computing focuses on building the answers to complex search queries like "Where can I attend an interesting conference in my field close to a sunny beach?" by interacting with a constellation of cooperating search services, using ranking and joining of results as the dominant factors for service composition. By leveraging the peculiar features of search services, the project devises query approaches, execution plans, plan optimization techniques, query configuration tools, and exploratory user interfaces.


WeKnowIt

The main objective of WeKnowIt is to develop novel techniques for exploiting multiple layers of intelligence from user-contributed content, which together constitute Collective Intelligence, a form of intelligence that emerges from the collaboration and competition among many individuals, and that seemingly has a mind of its own.

VirtualLife

VirtualLife project aims at developing a virtual world platform mainly focusing on security, democracy and collaborative aspects. Combining a virtual legal system with a strong security infrastructure and a peer-to-peer architecture, VirtualLife provides a digital 3d environment suitable for education, training, e-commerce, business and entertainment.

LivingKnowledge

LivingKnowledge goal is to bring a new quality into search and knowledge management technology for more concise, complete and contextualised search results.

I-Search

The I-SEARCH project aims to provide a novel unified framework for multimodal content indexing, sharing, search and retrieval. The I-SEARCH framework will be able to handle specific types of multimedia and multimodal content (text, 2D image, sketch, video, 3D objects and audio) alongside with real world information, which can be used as queries and retrieve any available relevant content of any of the aforementioned types.

Glocal

The first key intuition of GLOCAL is to use events as the primary means for organizing and indexing media, e.g., photos, videos, journal articles, and email exchanges. Instead of starting from media and seeing, a posteriori, how we can meaningfully understand their contents (e.g., by tagging them), we organize a priori our knowledge in terms of events and use media to populate them with memories, thus providing their experiential dimension.The second key intuition of GLOCAL is to exploit the local and global (GLOCAL) knowledge about events and related contents to locally index media and experiences and later to globally share them within networked communities, thus lessening the impact of the semantic gap.

Coast

COAST project aims to build a Future Content-Centric Network (FCN) overlay architecture able to intelligently and efficiently link billions of content sources to billions of content consumers, and offer fast content-aware retrieval, delivery and streaming, while meeting network-wide Service Level Agreements (SLAs) in content and services consumption.

Nem

The Network&Electronic Media (NEM) Technology platform is an industry-led initiative to promote and to accelerate the pace of innovation and provide ambitious inputs for the European Union 7th Framework Programme. The major focus of NEM is on innovative services and applications that constitute different media forms and that are delivered over a wide variety of complementary access networks (satellite, terrestrial, cable, twisted pairs, optical fibre, community installations, microwaves infrastructures, etc.) in a seamless and interactive way to a variety of end-user terminals and devices, including fixed and handheld terminals. NEM has identified Audiovisual search engines as a key challenge for its ambitions.

MUFIN Search

An online content-based similarity search demo in 50 million Flicker images.

MEDIAMILL

The MediaMill semantic video search engine is bridging the gap between research and applications. It integrates the state-of-the-art techniques developed at the Intelligent Systems Lab Amsterdam of the University of Amsterdam and applies it to realistic problems in video indexing.

VERGE Interactive Video Retrieval System

VERGE is a hybrid interactive video retrieval system, which is capable of searching into video content by integrating different search modules that employ visual and textual-based techniques. The following retrieval functionalities are supported:
- Visual similarity search by Query
- Text search
- High level visual concept retrieval search
Evaluation of VERGE search engine was performed with participation in video retrieval related conferences and showcases as TRECVID and VideOlympics.

GLADorSAD

From a collaboration between Sanoma Digital and Amsterdam University. You can have your own photo's analyzed by sophisticated emotion recognition software, and the mystery of emotions will be explained to you.

X-Media

This Integrated Project (IP) addresses the issue of knowledge management including image analysis and retrieval in complex distributed environments.

VIDI-Video

VIDI-Video - Interactive semantic video search with a large thesaurus of machine-learned audio-visual concepts.
VIDI-Video takes on the challenge of creating a substantially enhanced semantic access to video, implemented in a search engine. The project is to boost the performance of video search by a 1000 element thesaurus detecting instances of audio, visual or mixed-media content.

VICTORY Project

The VICTORY Project is an EC funded project. Its tool performs 3D content-based search and retrieval of (geometrically) similar 3D models. The search and retrieval of 3D content is based on low-level (geometric) features.

SEA (Seamless content delivery)

SEA is a FP7 collaborative project which aims at offering a new experience of personalised, seamless content delivery, maintaining the integrity and wherever applicable, enriching the perceived QoS (PQoS) of the media across the whole distribution chain. SEA is a project focused on seamless, personalised, trusted and PQoS-optimised multimedia content delivery, across broadband networks, varying from broadcasting to P2P topologies.

PLAYMANCER

PlayMancer (A European Serious Gaming 3D Environment) is a Collaborative Project, started on 1st of November 2007 and running for 36 months in total. 7 partners from 5 countries participate in the project.

PetaMedia (Peer-to-Peer Tagged Media)

The PETAMEDIA NoE aims at fostering international collaborative research in the areas of multimedia content analysis (MCA) and social and peer-to-peer (SP2P) networks by coordinating the research activities among partner countries, so as to establish a European network composed of national networks, while enabling as well the participation of specific additional interested partners. PETAMEDIA is so composed of four core partners known for their proven track record and coming from four different European states, complemented by four strong national networks and by the interested partners, cf. the figure below. The final purpose of the consortium is to establish a sustainable European virtual centre of excellence connecting thematically interested research groups throughout Europe.

P2P Next

The P2P-Next integrated project builds a next generation Peer-to-Peer (P2P) content delivery platform, to be designed, developed, and applied jointly by a consortium consisting of high-profile academic and industrial players with proven track records in innovation and commercial success.

My e-Director 2012

My-e-Director 2012, Real-Time Context-Aware and Personalized Media Streaming Environments for Large Scale Broadcasting Applications, is a R&D project that aims to provide a unique interactive broadcasting service enabling end-users to select focal actors and points of interest within real-time broadcasted scenes.
The project?s activity is executed by key personnel of institution representing Industry, Research Institutions and Universities, which are partially funded under the FP7 of the EC.

MILOS Photo Book

MILOS Multimedia Content Management System is a general purpose software component tailored to support design and effective implementation of digital library applications. MILOS supports the storage and content based retrieval of any multimedia documents whose descriptions are provided by using arbitrary metadata models represented in XML. MILOS is flexible in the management of documents containing different types of data and content descriptions; it is efficient and scalable in the storage and content based retrieval of these documents.
Try the MILOS Photo Book - Online photo sharing - to learn more...

Quaero

The QUAERO program is a French governmental initiative focussing the media content production and management chain with the objective to significantly facilitate access to and usage of multimedia content. Search is central to the programme, which will spend a significant effort into the development of very advanced and possibly disruptive technologies in the areas of audio, language, music, image and video processing as well as data coding, content protection, and high performance networks and storage organization. Total effort planned by the 17 current members is about 2000 Person-years (over 5 years). About the third of this effort concerns technology developments, and the remaining part of the budget is allocated mainly to the development of the applications.

iAD

This program (Information Access Disruptions) is lead by FAST and targets core research for next generation precision, analytics and scale in information access. Furthermore, iAd builds international networks to identify and execute on global disruption opportunities enabled by emerging services in the information age. iAd started up at the end of 2006 and run until 2014.

THESEUS

THESEUS is a research program initiated by the Federal Ministry of Economy and Technology (BMWi), with the goal of developing a new Internet-based infrastructure in order to better use and utilize the knowledge available on the Internet.