This paper provides an overview of our research conducted in the area of Sensory Experience including our implementations using MPEG-V Part 3 entitled ”Sensory Information”. MPEG-V Part 3 introduces Sensory Experience as a tool to increase the Quality of Experience by annotating traditional multimedia data with sensory effects. These sensory effects are rendered on special devices like fans, vibration chairs, ambient lights, scent disposers, water sprayers, or heating/cooling devices stimulating senses beyond the traditional ones. The paper's main focus is on the end-to-end aspects including the generation, transmission, and synchronized rendering of sensory effects with the traditional multimedia data taking movie clips as an example. Therefore, we present in this paper an open source tool chain that provides a complete end-to-end sensory effect generation and consumption framework. Furthermore, we summarize results from various subjective quality assessments conducted in this area. Finally, we point out research challenges that may encourage further research within this emerging domain.
Amsterdam, Netherlands
Waltl, Markus
Rainer, Benjamin
Timmerer, Christian
Hellwagner, Hermann
10.1016/j.image.2012.10.009
Signal Processing: Image Communication
Quality of Experience; Sensory Experience; Subjective Quality Assessment; Experimental Results; MPEG-V; Annotation Tool; Simulation Tool; Web Browser Plug-in; Sensory Information
EN
feb
2
136-150
Elsevier
An End-to-End tool chain for sensory experience based on MPEG-V
http://dx.doi.org/10.1016/j.image.2012.10.009
28
2013
This paper describes a toolset for the authoring, simulating, and rendering of multimedia content annotated with Sensory Effect Metadata (SEM) descriptions as specified in Part 3 of the MPEG V standard. This part of MPEG-V standardizes the description of sensory effects (e.g., light, wind) in order to be rendered on sensory devices (e.g., fans, vibration chairs) aiming at generating a sensory experience stimulating possibly all human senses. Our implementation comprises a toolset to author sensory effects associated with multimedia content and the simulation thereof. Furthermore, it includes a library, a standalone player, and a Web browser plug-in which enables the playback and rendering of sensory effects on off-the-shelf rendering devices and in various contexts. All software modules are available under the GNU General Public License (GPL) v3 and the GNU Lesser General Public License (LGPL) v3 respectively.
Nara, Japan
Waltl, Markus
Rainer, Benjamin
Timmerer, Christian
Hellwagner, Hermann
Proceedings of the 20th ACM Multimedia (MM'12)
Babaguchi, Noboru
Aizawa, Kiyoharu
Smith, John
-
MPEG-V, Annotation Tool, Simulator, Media Player, Web Browser Plug-in, Sensory Effects, Sensory Experience
EN
Nara, Japan
oct
1469-1472
https://www.itec.aau.at/bib/files/acmmm2012_ossc_mwbrcthh.pdf
ACM
2012.10.31
registered
A Toolset for the Authoring, Simulation, and Rendering of Sensory Experiences
http://www.acmm2012.org
2012