Vienna University of Technology
Institute of Software Technology and Interactive Systems Information & Software Engineering Group Music Information Retrieval |
||||
[Topics] [Projects] [Downloads] [People] [Publications] [Press] [Events] | ||||
The MediaSquareThe MediaSquare has been realized in a collaboration with EC3 (the e-Commerce Competence Center). Together, we developed a 3D Multimedia Environment where users are impersonated as avatars enabling them to browse and experience multimedia content by literally walking through it. Users may engage in conversations with other members of the community, exchange experiences or simply enjoy the featured content. |
||||
The MediaSquare processes a range of content to be published in the 3D Multimedia Environment: audio content (mp3 music files), images & videos, as well as scientific publications in the form of papers, paper abstract and (Powerpoint) presentations. The following three scenarios are available in The MediaSquare, represented by different areas (or rooms) in the 3D environment.
Music ShowroomA 3D Music Showroom that enables users to browse and listen to songs by literally walking through them. To this end, acoustic characteristics extracted from music tracks act as features for the training of a Self-Organizing Map. The resulting 2-dimensional map arranges similar music tracks in spatially adjacent regions. This 2-dimensional map defines the final position of each particular music track within the 3D Music Showroom.
Image/Video ShowroomA 3D Image/Video Showroom that enables users to browse and experience visual content such as images and videos. To this end, characteristic features are extracted from images/videos which are used for the training of a Self-Organizing Map. This 2-dimensional map defines the final position of each particular image/video within the 3D Image/Video Showroom. Scientific Results ShowroomThe 3D Scientific Results Showroom that enables users to explore the scientific results (i.e. documents such as Posters, paper abstracts, etc...) in an immersive 3D environment. In this case, characteristic text features are extracted from and are used for the training of a self-organizing map. The resulting 2-dimensional map arranges similar posters, papers, etc... in spatially adjacent regions and, in turn, defines the final position of each documents within the 3D Scientific Results Showroom. In the current demonstrational version of the MediaSquare, the Scientific Results Showroom contains scientific results of the research project MUSCLE. |
||||
The MediaSquare presents an impressive showcase for combining state-of-the-art multimedia feature extraction approaches and unsupervised neural networks assembled an immersive 3D multimedia content presentation environment. |
||||
|
||||
|