[377] | Michael Eberhard, Amit Kumar, Silvano Mignanti, Riccardo Petrocco, Mikko Uitto, A Framework for Distributing Scalable Content over Peer-to-Peer Networks, In International Journal on Advances in Internet Technology, IARIA, vol. 4, no. 1&2, N/A, pp. 1-13, 2011.
[bib] [pdf] [abstract]
Abstract: Peer-to-Peer systems are nowadays a very popular solution for multimedia distribution, as they provide significant cost benefits compared with traditional server-client distribution. Additionally, the distribution of scalable content enables the consumption of the content in a quality suited for the available bandwidth and the capabilities of the end-user devices. Thus, the distribution of scalable content over Peer-to-Peer network is a very actual research topic. This paper presents a framework for the distribution of scalable content in a fully distributed Peer-to-Peer network. The architectural description includes how the scalable layers of the content are mapped to the pieces distributed in the Peer-to-Peer system and detailed descriptions of the producer- and consumer-site architecture of the system. Additionally, an evaluation of the system’s performance in different scenarios is provided. The test series in the evaluation section assess the performance of our layered piece-picking core and provide a comparison of the performance of our system’s multi layer and single layer implementations. The presented system is to our knowledge the first open-source Peer-to-Peer network with full Scalable Video Coding support.
|
[376] | Manfred Del Fabro, Non-Sequential Decomposition, Composition and Presentation of Multimedia Content, PhD thesis, Klagenfurt University, pp. 168, 2011.
[bib] [abstract]
Abstract: This thesis discusses three major issues that arise in the context of non-sequential usage of multimedia content, i.e. a usage, where users only access content that is interesting for them. These issues are (1) semantically meaningful segmentation of videos, (2) composition of new video streams with content from different sources and (3) non-sequential presentation of multimedia content. A semantically meaningful segmentation of videos can be achieved by partitioning a video into scenes. This thesis gives a comprehensive survey of scene segmentation approaches, which were published in the last decade. The presented approaches are categorized based on the underlying mechanisms used for the segmentation. The characteristics that are common for each category as well as the strengths and weaknesses of the presented algorithms are stated. Additionally, an own scene segmentation approach for sports videos with special properties is introduced. Scenes are extracted based on recurring patterns in the motion information of a video stream. Furthermore, different approaches in the context of real-life events are presented for the composition of new video streams based on content from multiple sources. Community-contributed photos and videos are used to generate video summaries of social events. The evaluation shows that by using content provided by a crowd of people a new and richer view of an event can be created. This thesis introduces a new concept for this emerging view, which is called ``The Vision of Crowds''. The presentation of such newly, composed video streams is described with a simple but powerful formalism. It provides a great flexibility in defining the temporal and spatial arrangement of content. Additionally, a video browsing application for the hierarchical, non-sequential exploration of video content is introduced. It is able to interpret the formal description of compositions and can be adapted for different purposes with plug-ins.
|
[375] | Manfred Del Fabro, Laszlo Böszörmenyi, The Vision of Crowds: Social Event Summarization Based on User- Generated Multimedia Content, In ACM CHI 2011 Workshop – Data Collection By The People For The People (Christine Robson, Sean Kandel, Jeff Heer, Jeff Pierce, eds.), published on workshop homepage, http://databythepeople.com/ (May 2011), pp. 1-5, 2011.
[bib] [pdf] [abstract]
Abstract: In this position paper we introduce the idea of generating a superior view of a large social event, based on user-generated -- crowdsourced -- content. Instead of just collecting and making them available in a raw form (as social platforms like YouTube), we automatically generate semantically coherent summarizations of the entire event. The individual consuming user gets thus a compact view generated by a large number of producing users. We call this idea the "Vision of Crowds". A case study has been conducted at a social event where we used user-generated content to automatically generate live reports about that event. Furthermore, we have implemented a GUI that allows users to interactively compose personalized video summaries, based on the user-generated data collected at the case study.
|
[374] | Laszlo Böszörmenyi, Manfred del Fabro, Marian Kogler, Mathias Lux, Oge Marques, Anita Sobe, Innovative directions in self-organized distributed multimedia systems, In Multimedia Tools and Applications, Springer Verlag, vol. 51, Berlin, Heidelberg, New York, pp. 525-553, 2011, 10.1007/s11042-010-0622-z.
[bib] [doi] [abstract]
Abstract: The way by which multimedia contents are produced, delivered across networks, and consumed by intended users have shifted significantly during the past 10 years. In this paper we postulate that, in the near future, flexible and self-organizing facilities will play a dominating role in distributed multimedia systems. We discuss how such systems can be designed, using a three-layer (sensor, distribution, and user layer) architecture, SOMA (Self Organizing Multimedia Architecture), as an example. We also present innovative directions in three main aspects of self-organized multimedia systems: (i) the self-organizing aspects of multimedia user communities, e.g., the wisdom, intentions, and needs of users; (ii) a fresh look at video streams that treat them as a collection of units that can be composed taking user and network aspects into account; and (iii) new delivery paradigms and how self-organization and multimedia delivery can be combined.
|
[373] | Christian Beecks, Thomas Skopal, Klaus Schoeffmann, Thomas Seidl, Towards Large-Scale Multimedia Exploration, In Proceedings of the 5th International Workshop on Ranking in Databases (DBRank 2011) (Gautam Das, Vagelis Hsristidis, Ihab Ilyas, eds.), VLDB, Seattle, WA, USA, pp. 31-33, 2011.
[bib] [pdf] [abstract]
Abstract: With the advent of the information age and the increasing size and complexity of multimedia databases, the question of how to support users in getting access and insight into those large databases has become immensely important. While traditional content-based retrieval approaches provide query-driven access under the assumption that the users' information needs are clearly specified, modern content-based exploration approaches support users in browsing and navigating through multimedia databases in the case of imprecise or even unknown information needs. By means of interactive graphical user interfaces, exploration approaches offer a convenient and intuitive access to unknown multimedia databases which becomes even more important with the arrival of powerful mobile devices. In this paper, we formulate challenges of user-centric multimedia exploration with a particular focus on large-scale multimedia databases. We claim that adaptability and scalability should be researched on both conceptual as well as technical level in order to model multimedia exploration approaches which are able to cope with millions of multimedia objects in near-realtime.
|
[372] | Klaus Schoeffmann, Mario Taschwer, Laszlo Böszörmenyi, The video explorer: a tool for navigation and searching within a single video based on fast content analysis, In MMSys ’10: Proceedings of the first annual ACM SIGMM conference on Multimedia systems (Wu-chi Feng, Ketan Mayer-Patel, eds.), ACM, New York, NY, USA, pp. 247–258, 2010.
[bib] [doi] |
[371] | Klaus Schoeffmann, Laszlo Böszörmenyi, Enhancing Seeker-Bars of Video Players with Dominant Color Rivers, In Advances in Multimedia Modeling (Yi-Ping Phoebe Chen, Zili Zhang, Susanne Boll, Qi Tian, Lei Zhang, eds.), Springer, Chongqing, China, pp. –, 2010.
[bib] |
[370] | Klaus Schoeffmann, Facilitating Interactive Search and Navigation in Videos, In Proceedings of the ACM International Conference on Multimedia (Alberto Del Bimbo, Shih-Fu Chang, Arnold Smeulders, eds.), ACM Press, Firenze, Italy, pp. 1609-1612, 2010.
[bib] |
[369] | Hermann Hellwagner, Christian Timmerer, MPEG-21 Applications and Use Cases, Chapter in The Handbook of MPEG Applications: Standards in Practice (Marios C Angelides, Harry Agius, eds.), John Wiley & Sons, Hoboken, New Jersey, pp. 405-430, 2010.
[bib] [abstract]
Abstract: This book provides a comprehensive examination of the use of MPEG-2, MPEG-4, MPEG-7, MPEG-21, and MPEG-A standards, providing a detailed reference to their application. In this book, the authors address five leading MPEG standards, focusing not only on the standards themselves, but specifically upon their application (e.g. for broadcasting media, personalised advertising and news, multimedia collaboration, digital rights management, resource adaptation, digital home systems, and so on); including MPEG cross-breed applications. In the evolving digital multimedia landscape, this book provides comprehensive coverage of the key MPEG standards used for generation and storage, distribution and dissemination, and delivery of multimedia data to various platforms within a wide variety of application domains. It considers how these MPEG standards may be used, the context of their use, and how supporting and complementary technologies and the standards interact and add value to each other. Key Features: * Integrates the application of five popular MPEG standards (MPEG-2, MPEG-4, MPEG-7, MPEG-21, and MPEG-A) into one single volume, including MPEG cross-breed applications * Up-to-date coverage of the field based on the latest versions of the five MPEG standards * Opening chapter provides overviews of each of the five MPEG standards * Contributions from leading MPEG experts worldwide * Includes an accompanying website with supporting material (www.wiley.com/go/angelides_mpeg) This book provides an invaluable reference for researchers, practitioners, CTOs, design engineers, and developers. Postgraduate students taking MSc, MRes, MPhil and PhD courses in computer science and engineering, IT consultants, and system developers in the telecoms, broadcasting and publishing sectors will also find this book of interest.
|
[368] | Stefan Wieser, Laszlo Böszörmenyi, Flocks: Interest-Based Construction of Overlay Networks, In The Second International Conferences on Advances in Multimedia (MMEDIA 2010) (Huet Benoit, Smeaton Alan, Mayer-Patel Ketan, Avrithis Yannis, eds.), IEEE, Washington, USA, pp. 119-124, 2010.
[bib] [doi] [abstract]
Abstract: Self-organizing overlay networks have received a lot of attention in the recent years. However, despite the popularity of content-aware and topology-aware overlay networks, surprisingly little research has been done to combine both approaches. In this paper, we create robust and flexible overlay networks that we call “Flocks”, which can be content-aware, topology-aware, or a combination of both. We model affinity with interests and properties and show the resulting overlay networks work in a decentralized, self-organizing way, and stabilize quickly.
|
[367] | Markus Waltl, Die Umstellung des Mailservers am Institut für Informationstechnologie, Chapter in Werkstatt Universität (Ralph Grossmann, Evelin Brunner, eds.), Wieser Verlag, Klagenfurt/Celovec, Austria, pp. 125-150, 2010.
[bib] |
[366] | Markus Waltl, Christian Timmerer, Hermann Hellwagner, Increasing the User Experience of Multimedia Presentations with Sensory Effects, In Proceedings of the 11th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS'10) (Riccardo Leonardi, Pierangelo Migliorati, Andrea Cavallaro, eds.), IEEE, Los Alamitos, CA, USA, pp. 1-4, 2010.
[bib] [pdf] [abstract]
Abstract: The term Universal Multimedia Experience (UME) has gained momentum and is well recognized within the research community. As this approach puts the user into the center stage, additional complexity is added to the overall quality assessment problem which calls for a scientific framework to capture, measure, quantify, judge, and explain the user experience. In previous work we have proposed the annotation of multimedia content with sensory effect metadata that can be used to stimulate also other senses than vision or audition. In this paper we report first results obtained from subjective tests in the area of sensory effects attached to traditional multimedia presentations such as movies that shall lead to an enhanced, unique, and worthwhile user experience.
|
[365] | Markus Waltl, Enriching Multimedia with Sensory Effects, VDM Verlag Dr. Müller Aktiengesellschaft & Co. KG, Saarbrücken, Germany, pp. 100, 2010.
[bib] [abstract]
Abstract: Multimedia is now situated in everyday's life. One can get multimedia content via television, Internet, DVD, etc. One problem with this type of content is that there is only the audio/video content without any extra experience. This extra experience should be realized by using Sensory Effects like wind, light, etc. There are devices which were developed especially for enriching movies or computer games with such effects. MPEG Representation of Sensory Effects (RoSE) is a standardization process which offers a possibility to annotate the content of a video with sensory effects. The resulting description can be used to enrich the video experience. In this book an annotation tool and a simulator for MPEG RoSE are introduced due to the lack of an easy way to create MPEG RoSE compliant descriptions. The annotation tool provides a solution for creating sensory effect descriptions for movies. These descriptions can be simulated by the simulator or shipped with the movie for enriching the experience at one's home. Furthermore, the book gives an overview of Universal Multimedia Experience (UME) and MPEG RoSE. It also describes some companies and devices which already offer sensory effects.
|
[364] | Markus Waltl, Christian Timmerer, Hermann Hellwagner, Improving the Quality of Multimedia Experience through Sensory Effects, In Proceedings of the 2nd International Workshop on Quality of Multimedia Experience (QoMEX'10) (Andrew Perkis, Sebastian Möller, Peter Svensson, Amy Reibman, eds.), IEEE, Los Alamitos, CA, USA, pp. 124-129, 2010.
[bib][url] [doi] [pdf] [abstract]
Abstract: In previous and related work sensory effects are presented as a tool for increasing the user experience of multimedia presentations by stimulating also other senses than vision or audition. In this paper we primarily investigated the relationship of the Quality of Experience (QoE) due to various video bit-rates of multimedia contents annotated with sensory effects (e.g., wind, vibration, light). Therefore, we defined a subjective quality assessment methodology based on standardized methods. The paper describes the test environment, its setup, and conditions in detail. Furthermore, we experimented with a novel voting device that allows for continuous voting feedback during a sequence in addition to the overall quality voting at the end of each sequence. The results obtained from the subjective quality assessment are presented and discussed thoroughly. In anticipation of the results we can report an improvement of the quality of the multimedia experience thanks to the sensory effects.
|
[363] | Markus Waltl, Christian Raffelsberger, Christian Timmerer, Hermann Hellwagner, Metadata-based Content Management and Sharing System for Improved User Experience, In Proceedings CD of the 2nd International ICST Conference on User Centric Future Media Internet (Federico Alvarez, Cristina Costa, eds.), Springer Verlag GmbH, Berlin, Heidelberg, New York, pp. 1-9, 2010.
[bib] [pdf] [abstract]
Abstract: In the past years the amount of multimedia content on the Internet or in home networks has been drastically increasing. Instead of buying traditional media (such as CDs or DVDs) users tend to buy online media. This leads to the difficulty of managing the content (e.g., movies, images). A vast amount of tools for content management exists but they are mainly focusing on one type of content (e.g., only images). Furthermore, most of the available tools are not configurable to the user’s preferences and cannot be accessed by different devices (e.g., TV, computer, mobile phone) in the home network. In this paper we present a UPnP A/V-based system for managing and sharing audio/visual content in home environments which is configurable to the user’s preferences. Furthermore, the paper depicts how this system can be used to improve the user experience by using MPEG-V.
|
[362] | Roland Tusch, Armin Fuchs, Horst Gutmann, Marian Kogler, Julius Köpke, Laszlo Böszörmenyi, Manfred Harrer, Thomas Mariacher, A Multimedia-centric Quality Assurance System for Traffic Messages, In Proceedings of the Lakeside Conference 2010: Data and Mobility – Transforming Information into Intelligent Traffic and Transportation Services (Julia Düh, Hartwig Hufnagl, Erhard Juritsch, Reinhard Pfliegl, Helmut-Klaus Schimany, Hans Schönegger, eds.), Springer-Verlag, Villach, Austria, pp. 1-14, 2010.
[bib] |
[361] | Christian Timmerer, Markus Waltl, Hermann Hellwagner, Are Sensory Effects Ready for the World Wide Web?, In Proceedings of the Workshop on Interoperable Social Multimedia Applications (WISMA 2010) (Anna Carreras, Jaime Delgado, Xavier Maroñas, Víctor Rodríguez, eds.), CEUR Workshop Proceedings (CEUR-WS.org), Aachen, Germany, pp. 57-60, 2010.
[bib] [pdf] [abstract]
Abstract: The World Wide Web (WWW) is one of the main entry points to access and consume Internet content in various forms. In particular, the Web browser is used to access different types of media (i.e., text, image, audio, and video) and on some platforms is the only way to access the vast amount of information on the Web. Recently, it has been proposed to stimulate also other senses than vision or audition while consuming multimedia content through so- called sensory effects, with the aim to increase the user’s Quality of Experience (QoE). The effects are represented as Sensory Effects Metadata (SEM) which is associated to traditional multimedia content and is rendered (synchronized with the media) on sensory devices like fans, vibration chairs, lamps, etc. In this paper we provide a principal investigation of whether the sensory effects are ready for the WWW and, in anticipation of the result, we propose how to embed sensory effect metadata within Web content and the synchronized rendering thereof.
|
[360] | Christian Timmerer, Michael Eberhard, Michael Grafl, Keith Mitchell, Sam Dutton, Hermann Hellwagner, A Metadata Model for Peer-to-Peer Media Distribution, In Proceedings of the Workshop on Interoperable Social Multimedia Applications (WISMA 2010) (Anna Carreras, Jaime Delgado, Xavier Maroñas, Víctor Rodríguez, eds.), CEUR Workshop Proceedings (CEUR-WS.org), Aachen, Germany, pp. 8, 2010.
[bib][url] [pdf] [abstract]
Abstract: In this paper we describe a metadata solution for a Peer-to-Peer (P2P) content distribution system termed NextShare. We outline the key motivating factors for our approach, detail the overall generic architecture we have developed and present the workflow for delivering metadata through Peer-to-Peer based content distribution. The paper also presents the metadata model we have developed and we describe in detail how all the content can be packetized and distributed using NextShare. Finally, a description of the core and optional metadata attributes which may be utilized within the system is provided.
|
[359] | Christian Timmerer, Christopher Mueller, HTTP Streaming of MPEG Media, In Proceedings of STreaming Day 2010 (Riccardo Bernardini, Fabrizio Rovati, eds.), Rovati, Fabrizio, Agrate B.za, Italy, pp. 4, 2010.
[bib] [pdf] [abstract]
Abstract: MPEG has developed various technologies for multimedia transport, such as MPEG-2 Transport Stream (TS) and ISO Media Base File Format. These technologies have been widely accepted and heavily used by various industries and applications, such as digital broadcasting, audio and video transport over the Internet, mobile phones, etc. In recent years, the Internet has become an important channel for the delivery of multimedia. As HTTP is widely used on the Internet, it has recently been used extensively for the delivery of multimedia content. However, there is no standard for HTTP- based streaming of MPEG media. MPEG intends to standardize a solution that addresses this need. This paper provides an overview of the recent Call of Proposals (CfP) for HTTP Streaming of MPEG Media, a new work item within ISO/IEC MPEG. In particular, it will provide an overview of existing systems and the outcome of the evaluation of the aforementioned CfP which has been conducted during the 93rd MPEG meeting in July 2010.
|
[358] | Christian Timmerer, Filippo Chiariglione, Marius Preda, Victor Rodriguez Doncel, Accelerating Media Business Developments with the MPEG Extensible Middleware, Chapter in Towards the Future Internet - Emerging Trends from European Research (Georgios Tselentis, Alex Galis, Anastasius Gavras, Srdjan Krco, Volkmar Letz, Elena Simperl, Burkhard Stiller, Theodore Zahariadis, eds.), IOS Press, Amsterdam, Netherlands, pp. 217-226, 2010.
[bib] [pdf] [abstract]
Abstract: This document provides an overview of the MPEG Extensible Middleware (MXM), one of ISO/IEC MPEG’s latest achievements, defining an architecture and corresponding application programming interfaces (APIs) which enable accelerated media business developments. The paper describes the vision behind MXM, its architecture, and a high level overview of the API. Additionally, example MXM applications are given.
|
[357] | Christian Timmerer, Filippo Chiariglione, Marius Preda, Victor Rodriguez Doncel, Accelerating Media Business Developments with the MPEG Extensible Middleware, In IEEE Multimedia, IEEE, vol. 17, no. 3, Los Alamitos, CA, USA, pp. 74-78, 2010.
[bib][url] [doi] [pdf] [abstract]
Abstract: Editor’s Note: Media applications are becoming increasingly complex. They handle many data formats, run across multiple platforms, and support a wide range of functions. This article describes a standardized set of protocols and APIs that provides efficient access to individual system components, enables rapid deployment of new applications, and improves portability. —Anthony Vetro
|
[356] | Christian Timmerer, Michael Grafl, Hermann Hellwagner, Daniel Negru, Eugen Borcoci, Daniel Renzi, Anne-Lore Mevel, Alex Chernilov, Scalable Video Coding in Content-Aware Networks: Research Challenges and Open Issues, In Proceedings of the International Tyrrhenian Workshop on Digital Communications (ITWDC) (Nicola Blefari-Melazzi, ed.), Springer, New York, NY, USA, pp. 11, 2010.
[bib] [pdf] [abstract]
Abstract: The demand for access to advanced, distributed media resources is nowadays omnipresent due to the availability of Internet connectivity almost anywhere, anytime, and with a huge amount of different devices. This calls for rethinking of the current Internet architecture by making the network aware of which content is actually transported. This paper introduces Scalable Video Coding (SVC) as a tool for Content-Aware Networks (CANs) which is currently researched as part of the EU FP7 ALICANTE project. The architecture of ALICANTE with respect to SVC and CAN is reviewed, use cases are described, and, finally, research challenges and open issues are discussed.
|
[355] | Christian Timmerer, Hermann Hellwagner, MPEG-21 digital items in research and practice, In Proceedings of the 1st International Digital Preservation Interoperability Framework Symposium (Wo Chang, ed.), ACM, New York, NY, USA, pp. 8:1-8:8, 2010.
[bib] [doi] [pdf] [slides] [abstract]
Abstract: The aim of the MPEG‐21 standard, the so‐called Multimedia Framework, is to enable transparent and augmented use of multimedia resources across a wide range of networks, devices, user preferences, and communities, notably for trading (of bits). As such, it provides an important step in MPEG's standards evolution, i.e., the transaction of Digital Items among Users. This paper provides an overview of applications making use specifically of MPEG‐21 Digital Items and a more in‐depth presentation of a few selected applications in research and practice.
|
[354] | Christian Timmerer, Johannes Jaborning, Hermann Hellwagner, A Survey on Delivery Context Description Formats - A Comparison and Mapping Model, In Journal of Digital Information Management, Digital Information Research Foundation, vol. 8, no. 1, Chennai, India, pp. 16-27, 2010.
[bib] [pdf] [abstract]
Abstract: Nowadays, mobile devices have implemented several transmission technologies which enable access to the Internet and increase the bit rate for data exchange. Despite modern mobile processors and high-resolution displays, mobile devices will never reach the stage of a powerful notebook or desktop system (for example, due to the fact of battery powered CPUs or just concerning the small-sized displays). Due to these limitations, the deliverable content for these devices should be adapted based on their capabilities including a variety of aspects (e.g., from terminal to network characteristics). These capabilities should be described in an interoperable way. In practice, however, there are many standards available and a common mapping model between these standards is not in place. Therefore, in this paper we describe such a mapping model and its implementation aspects. In particular, we focus on the whole delivery context (i.e., terminal capabilities, net- work characteristics, user preferences, etc.) and investigated the two most prominent state-of-the-art description schemes, namely User Agent Profile (UAProf) and Usage Environment Description (UED).
|
[353] | Christian Timmerer, Karsten Müller, Immersive Future Media Technologies: From 3D Video to Sensory Experiences, In Proceedings of the International Conference on Multimedia (MM '10) (Alberto del Bimbo, Shih-Fu Chang, Arnold Smeulders, eds.), ACM, New York, NY, USA, pp. 1781-1782, 2010.
[bib][url] [doi] [pdf] [abstract]
Abstract: In this tutorial we present immersive future media technologies ranging from 3D video to sensory experiences. The former targets stereo and multi-view video technologies whereas the latter aims at stimulating other senses than vision or audition enabling an advanced user experiences through sensory effects.
|