[477] | Markus Waltl, Christian Raffelsberger, Christian Timmerer, Hermann Hellwagner, Metadata-Based Content Management and Sharing System for Improved User Experience, Chapter in User Centric Media (Federico Alvarez, Cristina Costa, eds.), Springer Verlag, vol. 60, Berlin, Heidelberg, New York, pp. 132-140, 2012.
[bib][url] [doi] |
[476] | Markus Waltl, Christian Timmerer, Benjamin Rainer, Hermann Hellwagner, Sensory Effect Dataset and Test Setups, In Proceedings of the 4th International Workshop on Quality of Multimedia Experience (QoMEX'12) (Ian Burnett, Henry Wu, eds.), IEEE, Yarra Valley, Australia, pp. 115-120, 2012.
[bib][url] [pdf] [abstract]
Abstract: Additional constituents for the representation of multimedia content gained more and more attention. For example, the amount of cinemas equipped with additional devices (e.g., ambient light, vibrating seats, wind generators, water sprayers, heater/coolers) that stimulate senses going beyond audition and vision increases. On the content side the MPEG-V standard specifies – among others – Sensory Effect Metadata (SEM) which provides means to describe sensory effects such as wind, vibration, light, etc. to be attached to audio-visual content and, thus, offering an enhanced and immersive experience for the user. However, there is a lack of a common set of test content allowing for various subjective user studies and verification across different test sites. In this paper we provide our dataset comprising a number of videos from different genres enriched with MPEG-V compliant Sensory Effect Metadata descriptions. Furthermore, we describe possible test setups using off-the-shelf hardware for conducting subjective quality assessments.
|
[475] | Markus Waltl, Christian Timmerer, Benjamin Rainer, Hermann Hellwagner, Sensory Effects for Ambient Experiences in the World Wide Web, In Multimedia Tools and Applications, Springer Verlag, vol. -, no. -, Berlin, Heidelberg, New York, pp. 1-20, 2012. (Online First)
[bib][url] [doi] [abstract]
Abstract: More and more content in various formats becomes available via the WorldWideWeb (WWW). Currently availableWeb browsers are able to access and interpret these contents (i.e., Web videos, text, image, and audio). These contents stimulate only senses like audition or vision. Recently, it has been proposed to stimulate also other senses while consuming multimedia content, through so-called sensory effects. These sensory effects aim to enhance the ambient experience by providing effects such as light, wind, vibration, etc. The effects are represented as Sensory Effect Metadata (SEM) description which is associated to multimedia content and is rendered on devices like fans, vibration chairs, or lamps. In this paper we present two subjective quality assessments which comprise sensory effects, such as light, in the area of the WWW and their results achieved. The first assessment evaluates the influence of light effects on the Quality of Experience (QoE). The second assessment measures the impact of different settings for the color calculation on the viewing experience. Furthermore, we describe a Web browser plug-in for Mozilla Firefox which is able to render such sensory effects that are provided via the WWW.
|
[474] | Markus Waltl, Benjamin Rainer, Christian Timmerer, Hermann Hellwagner, Enhancing the User Experience with the Sensory Effect Media Player and AmbientLib, In Advances in Multimedia Modeling (Klaus Schoeffmann, Bernard Merialdo, Alexander Hauptmann, Chong-Wah Ngo, Yiannis Andreopoulos, Christian Breiteneder, eds.), Springer, Berlin, Heidelberg, New York, pp. 624-626, 2012.
[bib] [pdf] [abstract]
Abstract: Multimedia content is increasingly used in every area of our life. Still, each type of content only stimulates the visual and/or the hearing system. Thus, the user experience depends only on those two stimuli. In this paper we introduce a standard which offers the possibility to add additional effects to multimedia content. Furthermore, we present a multimedia player and a Web browser plug-in which uses this standard to stimulate further senses by using additional sensory effects (i.e., wind, vibration, and light) to enhance the user experience resulting in a unique, worthwhile sensory experience.
|
[473] | Markus Waltl, Benjamin Rainer, Christian Timmerer, Hermann Hellwagner, A Toolset for the Authoring, Simulation, and Rendering of Sensory Experiences, In Proceedings of the 20th ACM Multimedia (MM'12) (Noboru Babaguchi, Kiyoharu Aizawa, John Smith, eds.), ACM, Nara, Japan, pp. 1469-1472, 2012.
[bib][url] [pdf] [abstract]
Abstract: This paper describes a toolset for the authoring, simulating, and rendering of multimedia content annotated with Sensory Effect Metadata (SEM) descriptions as specified in Part 3 of the MPEG V standard. This part of MPEG-V standardizes the description of sensory effects (e.g., light, wind) in order to be rendered on sensory devices (e.g., fans, vibration chairs) aiming at generating a sensory experience stimulating possibly all human senses. Our implementation comprises a toolset to author sensory effects associated with multimedia content and the simulation thereof. Furthermore, it includes a library, a standalone player, and a Web browser plug-in which enables the playback and rendering of sensory effects on off-the-shelf rendering devices and in various contexts. All software modules are available under the GNU General Public License (GPL) v3 and the GNU Lesser General Public License (LGPL) v3 respectively.
|
[472] | Christian Timmerer, MPEG column: 101st MPEG meeting, In ACM SIGMultimedia Records, ACM, vol. 4, no. 3, New York, NY, USA, pp. 9-11, 2012.
[bib][url] |
[471] | Christian Timmerer, MPEG column: 100th MPEG meeting, In ACM SIGMultimedia Records, ACM, vol. 4, no. 2, New York, NY, USA, pp. 2-3, 2012.
[bib][url] |
[470] | Christian Timmerer, MPEG column: 102nd MPEG meeting, In ACM SIGMultimedia Records, ACM, vol. 4, no. 4, New York, NY, CUSA, pp. 1-2, 2012.
[bib][url] |
[469] | Christian Timmerer, Carsten Griwodz, Dynamic adaptive streaming over HTTP: from content creation to consumption, In Proceedings of the 20th ACM international conference on Multimedia (Noboru Babaguchi, Kiyoharu Aizawa, John Smith, eds.), ACM, New York, NY, USA, pp. 1533-1534, 2012.
[bib][url] [doi] [pdf] [slides] [abstract]
Abstract: In this tutorial we present dynamic adaptive streaming over HTTP ranging from content creation to consumption. It particular, it provides an overview of the recently ratified MPEG-DASH standard, how to create content to be delivered using DASH, its consumption, and the evaluation thereof with respect to competing industry solutions. The tutorial can be roughly clustered into three parts. In part I we will provide an introduction to DASH, part II covers content creation, delivery, and consumption, and, finally, part III deals with the evaluation of existing (open source) MPEG-DASH implementations compared to state-of-art deployed industry solutions.
|
[468] | Christian Timmerer, Markus Waltl, Benjamin Rainer, Hermann Hellwagner, Assessing the quality of sensory experience for multimedia presentations, In Signal Processing: Image Communication, Elsevier, vol. 27, no. 8, Amsterdam, Netherlands, pp. 909-916, 2012.
[bib][url] [doi] [pdf] [abstract]
Abstract: This paper introduces the concept of sensory experience by utilizing sensory effects such as wind or lighting as another dimension which contributes to the quality of the user experience. In particular, we utilize a representation format for sensory effects that are attached to traditional multimedia resources such as audio, video, and image contents. Sensory effects (e.g., wind, lighting, explosion, heat, cold) are rendered on special devices (e.g., fans, ambient lights, motion chair, air condition) in synchronization with the traditional multimedia resources and shall stimulate other senses than audition and vision (e.g., mechanoreception, equilibrioception, thermoreception), with the intention to increase the users Quality of Experience (QoE). In particular, the paper provides a comprehensive introduction into the concept of sensory experience, its assessment in terms of the QoE, and related standardization and implementation efforts. Finally, we will highlight open issues and research challenges including future work.
|
[467] | Mario Taschwer, A Key-Frame-Oriented Video Browser, In Advances in Multimedia Modeling (Klaus Schoeffmann, Bernard Merialdo, Alexander Hauptmann, Chong-Wah Ngo, Yiannis Andreopoulos, Christian Breiteneder, eds.), Springer, vol. 7131, Berlin / Heidelberg, pp. 655-657, 2012.
[bib][url] [doi] [abstract]
Abstract: We propose a video browser facilitating known-item search in a single video. Key frames are presented as four images at a time and can be navigated quickly in both forward and backward directions using a slider. Alternatively, key frames can be displayed automatically at different frame rates. The user may choose between three mappings of key frames to the four key frame widgets based on video time stamps and color similarity.
|
[466] | Anita Sobe, Wilfried Elmenreich, Manfred Del Fabro, Self-organizing content sharing at social events, In European Meeting on Cybernetics and Systems Research Book of Abstracts (Robert Bichler, Stefan Blachfellner, Wolfgang Hofkirchner, eds.), EMCSR, Vienna, pp. 197-200, 2012.
[bib][url] |
[465] | Klaus Schoeffmann, David Ahlström, Using a Cylindrical Interface for Image Browsing to Improve Visual Search Performance, In Proceedings of The 13th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2012) (Noel O'Connor, Petros Daras, Fernando Pereira, eds.), IEEE, Los Alamitos, CA, USA, pp. 1-4, 2012.
[bib] [abstract]
Abstract: In this paper we evaluate a 3D cylindrical interface that arranges image thumbnails by visual similarity for the purpose of image browsing. Through a user study we compare the performance of this interface to the performance of a common scrollable 2D list of thumbnails in a grid arrangement. Our evaluation shows that the 3D Cylinder interface enables significantly faster visual search and is the preferred search interface for the majority of tested users.
|
[464] | Klaus Schoeffmann, Werner Bailer, Video Browser Showdown, In ACM SIGMultimedia Records, ACM, vol. 4, no. 2, N/A, pp. 2, 2012.
[bib] |
[463] | Klaus Schoeffmann, David Ahlström, Laszlo Böszörmenyi, Video Browsing with a 3D Thumbnail Ring Arranged by Color Similarity, In Advances in Multimedia Modeling (Klaus Schoeffmann, Bernard Merialdo, Alexander Hauptmann, Chong-Wah Ngo, Yiannis Andreopoulos, Christian Breiteneder, eds.), Springer, Berlin, Heidelberg, New York, pp. 660-662, 2012.
[bib] |
[462] | Klaus Schoeffmann, David Ahlström, An Evaluation of Color Sorting for Image Browsing, In International Journal of Multimedia Data Engineering and Management, IGI Publishing, vol. 3, no. 1, 701 E. Chocolate Ave., Hershey, PA 17033, USA, pp. 49-62, 2012.
[bib] |
[461] | Klaus Schoeffmann, Marco Andrea Hudelist, Gerald Schaefer, Manfred Del Fabro, Mobile Image Browsing on a 3D Globe, In Proceedings of the 2nd ACM International Conference on Multimedia Retrieval (H S Ip Horace, Yong Rui, eds.), ACM, New York, NY, USA, pp. 61:1-61:2, 2012.
[bib][url] [doi] [abstract]
Abstract: With users increasingly using their mobile devices such as smartphones as digital photo albums, effective methods for managing these collections are becoming increasingly important. Standard solutions provide only limited facilities for organising, browsing and searching image collections on mobile devices, making it challenging and time-consuming to locate images of interest. In this demo paper, we present an intuitive interface for organising and browsing image collections on mobile devices. Images are arranged on a 3D globe according to colour similarity. To avoid image overlap image thumbnails are placed on a regular grid structure while large image collections are organised using a hierarchical data structure. Through multi-touch user interaction image browsing can be performed in an intuitive and effective manner.
|
[460] | Klaus Schoeffmann, David Ahlström, Laszlo Böszörmenyi, 3D Storyboards for Interactive Visual Search, In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2012) (Jian Zhang, Dan Schonfeld, David Dagan Feng, Jianfei Cai Nanyang, Alan Hanjalic, Enrico Magli, Mark Pickering, Gerald Friedland, Xian-Sheng Hua, eds.), IEEE Computer Society, Los Alamitos, CA, USA, pp. 848-853, 2012.
[bib] [abstract]
Abstract: Interactive image and video search tools typically use a grid-like arrangement of thumbnails for preview purpose. Such a display, which is commonly known as storyboard, provides limited flexibility at interactive search and it does not optimally exploit the available screen estate. In this paper we design and evaluate alternatives to the common two-dimensional storyboard. We take advantage of 3D graphics in order to present image thumbnails in cylindrical arrangements. Through a user study we evaluate the performance of these interfaces in terms of visual search time and subjective performance.
|
[459] | René Reiners, Ragnhild Halvorsrud, Aslak Wegner Eide, Daniela Pohl, An Approach to Evolutionary Design Pattern Engineering, In Proceedings of the 19th Conference on Pattern Languages of Programs (PLoP) (Eduardo Guerra, ed.), ACM, New York, NY, USA, pp. 1-14, 2012.
[bib][url] [pdf] [abstract]
Abstract: The design of interactive systems, especially in distributed research projects, is a challenging process in which many concepts are developed with successful outcomes but also with dissatisfying results. In order to structure and relay knowledge about good or bad approaches, design patterns are a well-known instrument in research and development. Due to the condition that a design pattern must be easy to read, different stakeholders in the system engineering and design process are able to understand the described concepts without the need of specific expert knowledge . In distributed projects, application design knowledge may be scattered and documented in different manners. This means, before we can start formulating patterns, we need to discover and gather the available and partially concealed design knowledge. Since these fragments of knowledge may not always be accurately formulated for being used as design patterns, we seek for a collaborative method for collecting and formulating early findings together with established design knowledge. In this paper we present a concept of an evolutionary process for capturing, formulating, refining and validating design patterns. Our approach aims at involving as many stakeholders as possible in order to shape a pattern language over a project’s lifetime in a collaborative process allowing facile participation. We implement our approach in the scope of the EU research project BRIDGE that aims at supporting inter-agency collaboration during emergency response. We close with a discussion of the current state and envisioned next steps in order to foster our considerations.
|
[458] | Benjamin Rainer, Markus Waltl, Eva Cheng, Muawiyath Shujau, Christian Timmerer, Stephen Davis, Ian Burnett, Hermann Hellwagner, Investigating the Impact of Sensory Effects on the Quality of Experience and Emotional Response in Web Videos, In Proceedings of the 4th International Workshop on Quality of Multimedia Experience (QoMEX'12) (Ian Burnett, Henry Wu, eds.), IEEE, Yarra Valley, Australia, pp. 278-283, 2012.
[bib][url] [pdf] [abstract]
Abstract: Multimedia is ubiquitously available online with large amounts of video increasingly consumed through Web sites such as YouTube or Google Video. However, online multimedia typically limits users to visual/auditory stimulus, with onscreen visual media accompanied by audio. The recent introduction of MPEG-V proposed multi-sensory user experiences in multimedia environments, such as enriching video content with so-called sensory effects like wind, vibration, light, etc. In MPEG-V, these sensory effects are represented as Sensory Effect Metadata (SEM), which is additionally associated to the multimedia content. This paper presents three user studies that utilize the sensory effects framework of MPEG-V, investigating the emotional response of users and enhancement of Quality of Experience (QoE) of Web video sequences from a range of genres with and without sensory effects. In particular, the user studies were conducted in Austria and Australia to investigate whether geography and cultural differences affect users’ elicited emotional responses and QoE.
|
[457] | Benjamin Rainer, Stefan Lederer, Christopher Mueller, Christian Timmerer, A Seamless Web Integration of Adaptive HTTP streaming, In Proceedings of the 20th European Signal Processing Conference (EUSIPCO) (Béatrice Pesquet-Popescu, Corneliu Burileanu, eds.), European Signal Processing (EURASIP) Society, Bucharest, Romania, pp. 1519-1523, 2012.
[bib] [pdf] [abstract]
Abstract: Nowadays video is an important part of the Web and Web sites like YouTube, Hulu, etc. count millions of users consuming their content every day. However, these Web sites mainly use media players based on proprietary browser plug-ins (i.e., Adobe Flash) and do not leverage adaptive streaming systems. This paper presents a seamless integration of the recent MPEG standard on Dynamic Adaptive Streaming over HTTP (DASH) in the Web using the HTML5 video element. Therefore, we present DASHJS, a JavaScript-based MPEG-DASH client which adopts the Media Source API of Google’s Chrome browser to present a flexible and potentially browser independent DASH client. Furthermore, we present the integration of WebM based media segments in DASH giving a detailed description of the used container format structure and a corresponding Media Presentation Description (MPD). Our preliminary evaluation demonstrates the bandwidth adaption capabilities to show the effectiveness of the system.
|
[456] | Christian Raffelsberger, Hermann Hellwagner, Evaluation of MANET Routing Protocols in a Realistic Emergency Response Scenario, In Proceedings of the Tenth Workshop on Intelligent Solutions in Embedded Systems (WISES '12) (Markus Quaritsch, Istvan Fehervari, eds.), IEEE, Los Alamitos, CA, USA, pp. 88-92, 2012.
[bib] [pdf] [abstract]
Abstract: We evaluate the performance of several routing protocols for mobile ad-hoc networks (MANETs) in an emergency response scenario. The simulated scenario uses a disaster area mobility model and a wireless shadowing model to represent realistic first responder movements in a hybrid indoor/outdoor environment. The resulting scenario imposes some challenges on the MANET routing protocols such as intermittent connectivity and network partitions. The simulation results show that nodes have diverse connectivity characteristics which are challenging for state-of-the-art MANET routing protocols.
|
[455] | Roland Tusch, Felix Pletzer, Armin Kraetschmer, Laszlo Böszörmenyi, Bernhard Rinner, Thomas Mariacher, Manfred Harrer, Efficient Level of Service Classification for Traffic Monitoring in the Compressed Video Domain, In ICME '12 Proceedings of the 2012 IEEE International Conference on Multimedia and Expo Workshops (Jian Zhang, Dan Schonfeld, David Feng Deagan, eds.), IEEE, Piscataway (NJ), pp. 967-972, 2012.
[bib] [doi] [abstract]
Abstract: This paper presents a new method for estimating the level of service (LOS) on motorways in the compressed video domain. The method performs statistical computations on motion vectors of MPEG4 encoded video streams within a predefined region of interest to determine a set of four motion features describing the speed and density of the traffic stream. These features are fed into a Gaussian radial basis function network to classify the corresponding LOS. To improve the classification results, vectors of moving objects are clustered and outliers are eliminated. The proposed method is designed to be executed on a server system, where a large number of camera live streams can be analyzed in parallel in real-time. Evaluations with a comprehensive set of real-world training and test data from an Austrian motorway have shown an average accuracy of 86.7% on the test data set for classifying all four LOS levels. With a mean execution time of 48 microseconds per frame on a common server, hundreds of video streams can be analyzed in real-time.
|
[454] | Roland Tusch, Felix Pletzer, Vijay Mudunuri, Armin Kraetschmer, Karuna Sabbavarapu, Marian Kogler, Laszlo Böszörmenyi, Bernhard Rinner, Manfred Harrer, Thomas Mariacher, P Hrassnig, LOOK2 - A Video-based System for Real-time Notification of Relevant Traffic Events., In ICMEW '12 Proceedings of the 2012 IEEE International Conference on Multimedia and Expo Workshops (Jian Zhang, Dan Schonfeld, Deagan David Feng, eds.), IEEE, Piscataway (NJ), pp. 670, 2012.
[bib] [doi] [abstract]
Abstract: We demonstrate our novel video-based real-time traffic event notification and verification system LOOK2. It generates fast and reliable traffic information about relevant traffic state and road conditions changes on observed roads. It utilizes installed road-side sensors providing low-level traffic and environmental data, as well as video sensors which gain high-level traffic information from live video analysis. Spatio-temporal data fusion is applied on all available traffic and environmental data to gain reliable traffic information. This traffic information is published by a DATEXII compliant web service to a web-based traffic desk application. Road network and traffic channel operators receive real-time and relevant traffic event notifications by using this application. The system also enables a visual verification of the notified situations.
|
[453] | Felix Pletzer, Roland Tusch, Laszlo Böszörmenyi, Bernhard Rinner, Robust traffic state estimation on smart cameras., In Proceedings of the IEEE Conference on Advanced Vision and Signal-based Surveillance (Fatih Porikli, Liang Wang, Steve Maybank, eds.), IEEE, Piscataway (NJ), pp. 434-439, 2012.
[bib][url] [abstract]
Abstract: This paper presents a novel method for video-based traffic state detection on motorways performed on smart cameras. Camera calibration parameters are obtained from the known length of lane markings. Mean traffic speed is estimated from Kanade-Lucas-Tomasi (KLT) optical flow method using a robust outlier detection. Traffic density is estimated using a robust statistical counting method. Our method has been implemented on an embedded smart camera and evaluated under different road and illumination conditions. It achieves a detection rate of more than 95% for stationary traffic.
|