CODAC Project  

CODAC stands for Modeling, Querying, Delivering COntent Description and Quality Adaptation Capabilities of Audio-Visual Data and is funded by FWF (Project Number P14789), by KWF (Project Number 155596/8856/9387)
Long-running project: October 2001 - July 2005

Team Members:

Harald Kosch (Team Leader), Mario Döller, Andrea Kofler (together with Siemens AG, CT, IC 2), Mulugeta Libsie and László Böszörményi

Participating Master Students: 

Christian Hofbauer , Alexander Bachlechner , Bernhard Dörflinger , Margit Lang , Gisela Blaschke ,  Peter Moser , Peter Lederer , Walter Melchior and Reinhold Paulitsch

 
Abstract: 

The purpose of our project is the realization of a common framework for modeling content information and quality adaptation capabilities of audio-visual data and the implementation of the framework in a query, indexing, and retrieval database system. Descriptions which are indexed, i.e., stored in the meta-database, will be encoded as MPEG-7 and MPEG-21 descriptions. Such a model enables us to provide active components in a distributed multimedia systems with valuable information to govern or enhance their media scaling, buffering, and caching policies on the delivery path to the client (network routers and proxy caches).

In addition  we developed an  index system BeTrIS that allows filter mechanisms and random access to encoded MPEG-7 streams and which overcome the limitation of the network and the consuming terminal. Encoding is applied in order to reduce the data rate of the XML documents to be transmitted. The indexed parts of the encoded streams can be accessed without the need to deserialize the complete stream. The system will be part of the 2nd version of the MPEG-7 BiM codec. This work has been done in common with Jörg Heuer from Siemens AG München, Zentralabteilung Technik; CT, IC 2. Please consider also our  MPEG-21 and MPEG-7 page.

The MPEG-7 Multimedia Database (MPEG-7 MMDB) is the core component of the framework. It has been realized as an extension of the Oracle 10g database based on their data cartridge technology. It relies on a new MPEG-7 based multimedia database schema. It introduces a cost-based query optimizer that approximates  the selectivity of range searches and the costs in terms of page accesses of k- Nearest Neighbour searches. Finally, the Multimedia Indexing Framework (MIF) enables efficient access to the multimedia data for different search methods (exact and similairty search). On top of the MMDB resides serveral application libraries. At the moment, libraries for the following applications have been implemented: BlobworldLib for a content based image retrieval application, AudioLib for an audio recognition tool and ProxyLib for the QBIX proxy.

• Harald Kosch et al. :"The life-cyle of Multimedia Meta-Data", IEEE MultiMedia,12(1), January/March 2005.
• Andrea Kofler-Vogt, Harald Kosch and Jörg Heuer: "BeTrIS - an index system for MPEG-7 streams". EURASIP Journal on Applied Signal Processing. To appear in 3rd Quarter, 2005.
• Harald Kosch and Mario Döller: "Approximating the selectivity of multimedia range queries". In Proceedings of the IEEE International Conference on Multimedia & Expo, July 2005, Amsterdam (The Netherlands).
• Mulugeta Libsie and Harald Kosch: "Content-Aware Segment-Based Video Adaptation". Journal of Digital Information Management, 3(2): 88-94, June 2005.

• Harald Kosch: "Distributed Multimedia Database Technologies supported by MPEG-7 und MPEG-21". CRC Press. 248 pages. November 2003. ISBN: 0-849-31854-8.

• Harald Kosch and Mario Döller: "The MPEG-7 Multimedia Database System (MPEG-7-MMDB)", submitted to the Journal of Systems and Software, Elsevier Press.

• Andrea Kofler, Harald Kosch and Jörg Heuer: "Fast Random Access into MPEG-7 Streams". In the Proceedings of the 3rd International Workshop on Multimedia Data and Document Engineering at the VLDB 2003 Conference, Berlin (Germany), September 2003.

• László Böszörményi, Mario Döller, Hermann Hellwagner, Harald Kosch, Mulugeta Libsie and Peter Schojer: "Comprehensive Treatment of Adaptation in Distributed Multimedia Systems in the ADMITS Project". In Proceedings of the 10th ACM International Conference on Multimedia, Antibes, France, Nov. to Dec. 2002, ACM Press. 
• Mulugeta Libise and Harald Kosch: "Content Adaptation of Multimedia Delivery and Indexing using MPEG-7". In Proceedings of the 10th ACM International Conference on Multimedia, Antibes, France, Nov. to Dec. 2002, ACM Press. 
• László Böszörményi, Hermann Hellwagner, Harald Kosch, Mulugeta Libsie and Stefan Podlipnig: "Metadata Driven Adaptation in the ADMITS Project". EURASIP Signal Processing: Image Communication (Special Issue on Multimedia Adaptation), 18(8), September 2003.

Cross References:

1. MPEG-7 and MPEG-21 Standardization Efforts

2. MPEG-7 and Multimedia Database Systems. SIGMOD Records, 31(2), June 2002.

3. SMOOTH-Project