Routers in Content-Centric Networking (CCN) may locally cache frequently requested content in order to speed up delivery to end users. Thus, the issue of caching strategies arises, i.e., which content shall be stored and when it should be replaced. In this work, we employ, and study the feasibility of, novel techniques towards intelligent control of CCN routers that autonomously switch between existing caching strategies in response to changing content request patterns. In particular, we present a router architecture for CCN networks that is controlled by rule-based stream reasoning, following the recent formal framework LARS which extends Answer Set Programming for streams. The obtained possibility for flexible router configuration at runtime allows for versatile network control schemes and may help advance the further development of CCN. Moreover, the empirical evaluation of our feasibility study shows that the resulting caching agent may give significant performance gains.
Paris, France
Beck, Harald
Bierbaumer, Bruno
Dao-Tran, Minh
Eiter, Thomas
Hellwagner, Hermann
Schekotihin, Konstantin
Communications (ICC), 2017 IEEE International Conference on
10.1109/ICC.2017.7996762
Beylat, Jean Luc
Sari, Hikmet
978-1-4673-8999-0
1938-1883
Cognition, Internet, Switches, Next generation networking, Programming, Computer architecture, Robots
EN
Paris
may
6
IEEE
2017.05.23
registered
Stream Reasoning-Based Control of Caching Strategies in CCN Routers
2017
Today we can observe a plethora of adaptive video stream- ing services and media players which support interoperable formats like DASH and HLS. Most of the players and their rate adaptation algorithms work as a black box. We have de- veloped a system for easy and rapid testing of media players under various network scenarios. In this paper, we introduce AdViSE, the Adaptive Video Streaming Evaluation frame- work for the automated testing of adaptive media players. The presented framework is used for the comparison and testing of media players in the context of adaptive video streaming over HTTP in web/HTML5 environments. The demonstration showcases a series of experiments with different media players under given context conditions (e.g., network shaping, delivery format). We will also demonstrate the real-time capabilities of the framework and offline anal- ysis including several QoE metrics with respect to a newly introduced bandwidth index.
New York, NY, USA
Zabrovskiy, Anatoliy
Kuzmin, Evgeny
Petrov, Evgeny
Timmerer, Christian
Mueller, Christopher
Proceedings of the 8th ACM on Multimedia Systems Conference (MMSys'17)
10.1145/3083187.3083221
Chen, Kuan-Ta
978-1-4503-5002-0
EN
Taipei, Taiwan
jun
4
https://www.itec.aau.at/bib/files/Demo_Paper_Camera_Ready.pdf
ACM
2017.06.21
poster
AdViSE: Adaptive Video Streaming Evaluation Framework for the Automated Testing of Media Players
2017
In the past decade we observed the transition from push-based, fully managed media streaming to pull-based, unmanaged adaptive HTTP streaming thanks to enhancements in media compression, network capacity, and client capabilities. Adaptive media players, specifically their algorithms, have been subject to research for a long time and lead to various approaches documented in the literature. In the past years we witnessed more and more commercial deployments taking into account findings presented in scientific papers but a quantitative evaluation and assessments of its performance is missing. In this paper, we propose means for the automated performance evaluation of commercially deployed adaptive media players with respect to i) objective, well-known metrics, such as bitrate, stalls, startup delay and ii) derived/calculated metrics (instability, inefficiency, average bitrate) previously proposed in the literature. Additionally, we propose a new metric (Bandwidth index) to measure the effectiveness of bandwidth utilization and together with existing QoE models for adaptive HTTP streaming (focusing on stalls, startup delay) we demonstrate its usefulness in this domain.
N.N.
Timmerer, Christian
Zabrovskiy, Anatoliy
Kuzmin, Evgeny
Petrov, Evgeny
2017 21st Conference of Open Innovations Association (FRUCT)
10.23919/FRUCT.2017.8250200
Balandin, Sergey
ISSN 2305-7254
EN
Helsinki, Finland
nov
330-335
https://www.itec.aau.at/bib/files/08250200.pdf
N.N.
2017.11.10
registered
Quality of experience of commercially deployed adaptive media players
2017
Washington DC, USA
Timmerer, Christian
Graf, Mario
Mueller, Christopher
2018 NAB Broadcast Engineering and IT Conference (BEITC)
available, not
EN
apr
5
https://www.itec.aau.at/bib/files/TimmererC012317.pdf
National Association of Broadcasters (NAB)
none
Adaptive Streaming of VR/360-degree Immersive Media Services with high QoE
2017
Currently, we witness dramatically increasing interest in immersive media technologies like Virtual Reality (VR), particularly in omnidirectional video (OV) streaming. Omnidirectional (also called 360-degree) videos are panoramic spherical videos in which the user can look around during playback and which therefore can be understood as hybrids between traditional movie streaming and interactive VR worlds. Unfortunately, streaming this kind of content is extremely bandwidth intensive (compared to traditional 2D video) and therefore, Quality of Experience (QoE) tends to deteriorate significantly in absence of continuous optimal bandwidth conditions. In this paper, we present a first approach towards subjective QoE assessment for omnidirectional video (OV) streaming. We present the results of a lab study on the QoE impact of stalling in the context of OV streaming using head-mounted displays (HMDs). Our findings show that subjective testing for immersive media like OV is not trivial, with even simple cases like stalling leading to unexpected results. After a discussion of characteristic pitfalls and lessons learned, we provide a a set of recommendations for upcoming OV assessment studies.
New York, USA
Schatz, Raimund
Sackl, Andreas
Timmerer, Christian
Gardlo, Bruno
2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX)
10.1109/QoMEX.2017.7965657
Raake, Alexander
978-1-5386-4024-1
2472-7814
EN
Erfurt, Germany
jun
6
https://www.itec.aau.at/bib/files/QoMEX_2017_paper_44.pdf
IEEE
2017.06.01
registered
Towards Subjective Quality of Experience Assessment for Omnidirectional Video Streaming
2017
Conversational services (e.g., Internet telephony) exhibit hard Quality of Service (QoS) requirements, such as low delay and jitter. Current IP-based solutions for conversational services use push-based data transfer only, since pull-based communication as envisaged in Named Data Networking (NDN) suffers from the two-way delay. Unfortunately, IP's addressing scheme requires additional services for contacting communication partners. NDN provides an inherent solution for this issue by using a location-independent naming scheme. Nevertheless, it currently does not provide a mechanism for push-based data transfer. In this paper, we investigate Persistent Interests as a solution for push-based communication. We improve and implement the idea of Persistent Interests, and study their applicability for conversational services in NDN. This is done by comparing different push- and pull-based approaches for Internet telephony.
Hong Kong
Moll, Philipp
Posch, Daniel
Hellwagner, Hermann
Proceedings of the IEEE International Conference on Multimedia and Expo Workshops (ICMEW) 2017
10.1109/ICMEW.2017.8026212
Pesquet-Popescu, Beatrice
Ngo, Chong-Wah
978-1-5386-0560-8
EN
Hong Kong
jul
315-320
https://www.itec.aau.at/bib/files/MuSIC_2017.pdf
IEEE
2017.07.10
registered
Investigation of push-based traffic for conversational services in Named Data Networking
http://ieeexplore.ieee.org/document/8026212/
2017
Persistent Interests (PIs) are a promising approach to introduce push-type traffic in Named Data Networking (NDN), in particular for conversational services such as voice and video calls. Forwarding decisions for PIs are crucial in NDN because they establish a long-lived path for the data flowing back toward the PI issuer. In the course of studying the use of PIs in NDN, we investigate adaptive PI forwarding and present a strategy combining regular NDN forwarding information and results from probing potential alternative paths through the network. Simulation results indicate that our adaptive PI forwarding approach is superior to the PI-adapted Best Route strategy when network conditions change due to link failures.
New York, NY, USA
Moll, Philipp
Janda, Julian
Hellwagner, Hermann
Proceedings of the 4th ACM Conference on Information-Centric Networking
10.1145/3125719.3132091
Schmidt, Thomas C
Seedorf, Jan
978-1-4503-5122-5
EN
Berlin, Germany
sep
180-181
https://www.itec.aau.at/bib/files/ACM-ICN-2017_Poster.pdf
ACM
2017.09.27
registered
Adaptive Forwarding of Persistent Interests in Named Data Networking
http://dl.acm.org/citation.cfm?id=3132091
2017
Real-time entertainment services such as streaming audio- visual content deployed over the open, unmanaged Internet account now for more than 70% during peak periods. More and more such bandwidth hungry applications and services are proposed like immersive media services such as virtual reality and, specifically omnidirectional/360-degree videos. The adaptive streaming of omnidirectional video over HTTP imposes an important challenge on today’s video delivery infrastructures which calls for dedicated, thoroughly designed techniques for content generation, delivery, and consumption. This paper describes the usage of tiles — as specified within modern video codecs such HEVC/H.265 and VP9 — enabling bandwidth efficient adaptive streaming of omnidirectional video over HTTP and we define various streaming strategies. Therefore, the parameters and characteristics of a dataset for omnidirectional video are proposed and exemplary instanti- ated to evaluate various aspects of such an ecosystem, namely bitrate overhead, bandwidth requirements, and quality as- pects in terms of viewport PSNR. The results indicate bitrate savings from 40% (in a realistic scenario with recorded head movements from real users) up to 65% (in an ideal scenario with a centered/fixed viewport) and serve as a baseline and guidelines for advanced techniques including the outline of a research roadmap for the near future.
New York, NY, USA
Graf, Mario
Timmerer, Christian
Mueller, Christopher
Proceedings of the 8th ACM on Multimedia Systems Conference (MMSys'17)
Chen, Kuan-Ta
EN
Taipei, Taiwan
jun
11
https://www.itec.aau.at/bib/files/Special_Session_Camera_Ready.pdf
ACM
2016.06.20
registered
Towards Bandwidth Efficient Adaptive Streaming of Omnidirectional Video over HTTP: Design, Implementation, and Evaluation
2017
Recent research efforts have reported findings on user Quality of Experience (QoE) of immersive virtual reality (VR) experiences. Truly immersive multimedia experiences also include multisensory components such as factional, tactile etc., in addition to audiovisual stimuli. In this context, this paper reports the results of a user QoE study of an olfaction-enhanced immersive VR environment. The results presented compare the user QoE between two groups (VR vs VR + Olfaction) and consider how the addition of olfaction affected user QoE levels (considering sense of enjoyment, immersion and discomfort). Self-reported measures via post-test questionnaire (10 questions) only revealed one statistically significant difference between the groups; in terms of how users felt with respect to their senses being stimulated. The presence of olfaction in the VR environment did not have a statistically significant effect in terms of user levels of enjoyment, immersion and discomfort.
New York, NY, USA
Egan, Darragh
Keighrey, Conor
Barrett, John
Qiao, Yuansong
Brennan, Sean
Timmerer, Christian
Murray, Niall
Proceedings of the 2nd International Workshop on Multimedia Alternate Realities
10.1145/3132361.3132363
Chambel, Teresa
Kaiser, Rene
Niamur, Omar Aziz
Ooi, Wei Tsang
978-1-4503-5507-0
EN
oct
15-18
https://www.itec.aau.at/bib/files/p15-egan.pdf
ACM
AltMM '17
none
Subjective Evaluation of an Olfaction Enhanced Immersive Virtual Reality Environment
http://doi.acm.org/10.1145/3132361.3132363
2017
Washington DC, USA
Timmerer, Christian
Weinberger, Daniel
Smole, Martin
Grandl, Reinhard
Mueller, Christopher
Lederer, Stefan
2016 NAB Broadcast Engineering Conference Proceedings & CD
available, not
EN
Las Vegas, NV, USA
apr
4
https://www.itec.aau.at/bib/files/TimmererC012716.pdf
National Association of Broadcasters (NAB)
2016.04.20
registered
Live Transcoding and Streaming-as-a-Service with Low Delay and High QoE
2016
New York
Timmerer, Christian
Weinberger, Daniel
Smole, Martin
Grandl, Reinhard
Mueller, Christopher
Lederer, Stefan
Proceedings of the 7th International Conference on Multimedia Systems
Timmerer, Christian
Begen, Ali
EN
Klagenfurt, Austria
may
37:1-37:3
https://www.itec.aau.at/bib/files/MMSys2016-paper.pdf
ACM
2016.05.11
poster
Transcoding and Streaming-as-a-Service for improved Video Quality on the Web
2016
Today, the global share and increase of Internet traffic is largely caused by multimedia delivery, mainly encompassing video, audio and image sharing on social, news, and entertainment platforms. This fact is well known to the Internet research community, which tries to counteract by increasing the content delivery efficiency. So-called Information-Centric Networks (ICN) are of considerable interest, advertised as enablers for intelligent networks, where effective delivery is to be provided as an inherent network feature. Most research proposals in this area are evaluated in simulated environments, using simulation frameworks such as OMNeT++ or ns-3. However, simulations always have shortcomings and cannot substitute measurements in physical networks. In this demonstration, we show how to readily set up an ICN-based testbed using low-budget single-board computers to conduct comprehensive emulations. We choose the scenario of pull-based adaptive video delivery as a showcase and evaluate the performance of different client-based adaptation mechanisms at the application level and different content forwarding strategies at the network level. All of the presented tools and visualization features are provided as open source contributions to the community.
New York
Posch, Daniel
Rainer, Benjamin
Theuermann, Sebastian
Leibetseder, Andreas
Hellwagner, Hermann
Proceedings of the 7th International Conference on Multimedia Systems
10.1145/2910017.2910626
Timmerer, Christian
Begen, Ali
978-1-4503-4297-1
Named Data Networking, Information-Centric Networking, Network Emulation, Adaptive Multimedia Delivery, Testbed
EN
Klagenfurt, Austria
may
4
https://www.itec.aau.at/bib/files/pi-demo.pdf
ACM Digital Library
MMSys '16
2016.05.11
poster
Emulating NDN-based Multimedia Delivery
http://doi.acm.org/10.1145/2910017.2910626
2016
New York, NY, USA
Kreuzberger, Christian
Rainer, Benjamin
Hellwagner, Hermann
Toni, Laura
Frossard, Pascal
Proceedings of the 26th International Workshop on Network and Operating Systems Support for Digital Audio and Video
ACM
978-1-4503-4356-5
EN
Klagenfurt, Austria
may
4:1-4:6
ACM
2016.05.13
registered
A Comparative Study of DASH Representation Sets Using Real User Characteristics
2016
Lisboa, Portugal
Egan, Darragh
Brennan, Sean
Barret, John
Qiao, Yuansong
Timmerer, Christian
Murray, Niall
2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)
Pereira, Fernando
Diepold, Klaus
Queluz, Paula
Reiter, Ulrich
EN
Lisboa, Portugal
jun
1-6
https://www.itec.aau.at/bib/files/QoMEX2016-paper.pdf
IEEE Signal Processing Society
2016.06.07
poster
An evaluation of Heart Rate and ElectroDermal Activity as an objective QoE evaluation method for immersive virtual reality environments
2016
Brussels, Belgium
Xu, He
Pereira, Fernando
Timmerer, Christian
Ebrahimi, Touradj
Proceedings of 2015 European Conference on Networks and Communications (EUCNC)
Demassieux, Nicolas
Campolargo, Mario
EN
jun
627-628
https://www.itec.aau.at/bib/files/1570129963.pdf
IEEE
none
Towards Quality of Sensory Experience in Multimedia
2015
Multimedia content delivery and real-time streaming over the top of the existing infrastructure is nowadays part and parcel of every media ecosystem thanks to open standards and the adoption of the Hypertext Transfer Protocol (HTTP) as its primary mean for transportation. Hardware encoder manufacturers have adopted their product lines to support the dynamic adaptive streaming over HTTP but suffer from the inflexibility to provide scalability on demand, specifically for event-based live services that are only offered for a limited period of time. The cloud computing paradigm allows for this kind of flexibility and provide the necessary elasticity in order to easily scale with the demand required for such use case scenarios. In this paper we describe bitcodin, our transcoding and streaming-as-as-ervice platform based on open standards (i.e., MPEG-DASH) which is deployed on standard cloud and content delivery infrastructures to enable high-quality streaming to heterogeneous clients. It is currently deployed for video on demand, 24/7 live, and event-based live services using bitdash, our adaptive client framework.
Los Alamitos, CA
Timmerer, Christian
Weinberger, Daniel
Smole, Martin
Grandl, Reinhard
Mueller, Christopher
Lederer, Stefan
2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)
Magli, Enrico
Tubaro, Stefano
Vetro, Anthony
EN
Torino, Italy
jun
1-4
https://www.itec.aau.at/bib/files/icme2015-bitmovin_camera-ready.pdf
IEEE
2015.06.30
poster
Live Transcoding and Streaming-as-a-Service with MPEG-DASH
2015
Social networks have become ubiquitous and with these new possible ways for social communication and experiencing multimedia together the traditional TV scenario drifts more and more towards a distributed social experience. Asynchronism in the multimedia playback of the users may have a significant impact on the acceptability of systems providing the distributed multimedia experience. The synchronization needed in such systems is called Inter-Destination Multimedia Synchronization. In this paper we propose a demo that implements IDMS by the means of our self-organized and distributed approach assisted by pull-based streaming. We also provide a video of the planned demonstration and provide the mobile application as open source licensed under the GNU LGPL.
New York, U.S.A
Rainer, Benjamin
Petscharnig, Stefan
Timmerer, Christian
Proceedings of the 6th ACM International Conference on Multimedia Systems
not, available
EN
Portland, Oregon
mar
77-80
ACM International Conference on Multimedia Systems
2015.03.18
poster
Merge And Forward - Self-organized Inter-Destination Multimedia Synchronization
2015
Modern-age technology enables us to consume multimedia for enjoyment and as a social experience. The traditional way to consume multimedia together (e.g., with family or friends in the living room) is being superseded by a location-independent scenario where geographically distributed users consume the same content while having a real-time communication channel among each other. Inter-Destination Multimedia Synchronization (IDMS) is the tool of choice in order to enable users a high-quality multimedia experience. In this paper, we investigate the influence of asynchronism when consuming multimedia content together while being geographically distributed. In particular, we adopt the concept of human computation and developed a reaction game which we used to conduct a crowdsourced subjective quality assessment in order to evaluate a threshold for multimedia synchronization within an IDMS scenario. Our results show a significant decrease in overall Quality of Experience (QOE) at an asynchronism level of 750ms. At the same time, we were able to show that asynchronism at a level of 400ms does not have significant differences regarding the QoE when compared to the synchronous reference case.
Greece, Messinia
Rainer, Benjamin
Petscharnig, Stefan
Timmerer, Christian
Hellwagner, Hermann
Seventh International Workshop on Quality of Multimedia Experience (QoMEX 2015)
Skodras, Athanassios
EN
Greece, Messinia, Costa Navarino
may
1-6
https://www.itec.aau.at/bib/files/07148107.pdf
IEEE
2015.05.27
registered
Is One Second Enough? - Evaluating QoE for Inter-Destination Multimedia Synchronization using Human Computation and Crowdsourcing
2015
Multimedia delivery systems and protocols usually assume end-to-end connections and low delivery delays between multimedia sources and consumers. However, neither of these two properties can always be achieved in hastily formed networks for emergency response operations. In particular, disruptions may break end-to-end connections, which makes it impossible to deliver multimedia content instantly. This work presents a multimedia delivery system that can operate in disrupted networks and hence may help improve the situational awareness in emergency response operations. The multimedia delivery system is based on HTTP adaptive streaming (HAS) and uses a modified version of HTTP which is able to deliver data in partitioned networks. The multimedia delivery system is evaluated in a realistic emergency response scenario.
Los Alamitos, CA, USA
Raffelsberger, Christian
Hellwagner, Hermann
Proceedings of the 13th IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops '15)
10.1109/PERCOMW.2015.7134093
Hurson, Ali
Das, Sajal K
978-1-4799-8425-1
EN
Saint Louis, MO, USA
mar
530-536
https://www.itec.aau.at/bib/files/CR-PerNEM15.pdf
IEEE
2015.03.27
registered
A Multimedia Delivery System for Delay-/Disruption-Tolerant Networks
2015
Streaming multimedia over the Internet is omnipresent but still in its infancy, specifically when it comes to the adaptation based on bandwidth/throughput measurements, clients competing for limited/shared bandwidth, and the presence of a caching infrastructure. In this paper we present a buffer-based adaptation logic in combination with a toolset of client metrics to compensate for erroneous adaptation decisions. These erroneous adaptation decisions are due to insufficient network information available at the client and issues introduced when multiple clients compete for limited/shared bandwidth and/or when caches are deployed. Our metrics enable the detection of oscillations on the client - in contrast to server-based approaches - and provide an effective compensation mechanism. We evaluate the proposed adaptation logic, which incorporates the oscillation detection and compensation method, and compare it against a throughput-based adaptation logic for scenarios comprising competing clients with and without caching enabled. In anticipation of the results, we show how the presented metrics detect oscillation periods and how such undesirable situations can be compensated while increasing the effective media throughput of the clients.
Los Alamitos, CA
Mueller, Christopher
Lederer, Stefan
Grandl, Reinhard
Timmerer, Christian
Proceedings of 2015 IEEE International Conference on Multimedia and Expo (ICME)
10.1109/ICME.2015.7177435
Magli, Enrico
Tubaro, Stefano
Vetro, Anthony
EN
Torino, Italy
jul
1-6
https://www.itec.aau.at/bib/files/icme2015paper.pdf
IEEE
2015.07.02
registered
Oscillation Compensating Dynamic Adaptive Streaming over HTTP
2015
The Internet is nowadays mainly used for streaming of multimedia content, something it was not built for originally. To guarantee user satisfaction, one of the key concepts of the Internet as we know it is bandwidth sharing. While this concept is necessary to provide stability in the network, several issues can arise with adaptive multimedia streaming, e.g., efficiency and stability. Considering Information-Centric Networking (ICN) and its network-inherent caching, those issues tend to become worse. Many researchers have proposed to use traffic shaping on the server to enable fair bandwidth sharing and stabilize clients. However, existing research does not consider content popularity and in-network caching. The contribution of this paper is two-fold. First, we propose a cache-aware traffic shaping policy, in order to guarantee seamless playback of videos. Second, based on content popularity, we calculate an average video quality achieved by this traffic shaping policy for various cache sizes, to show the impact of popularity and caching for multimedia streaming in ICN.
Los Alamitos, CA, USA
Kreuzberger, Christian
Rainer, Benjamin
Hellwagner, Hermann
IEEE International Conference on Multimedia Expo Workshops
10.1109/ICMEW.2015.7169763
Matteo, Cesana
Content Popularity; Adaptive Multimedia Streaming; Information-Centric Networking; Traffic Shaping
EN
Torino, Italy
jul
1-6
https://www.itec.aau.at/bib/files/music_modelling_streaming_revision1_v3.pdf
IEEE
ICMEW '15
2015.07.03
registered
Modelling the Impact of Caching and Popularity on Concurrent Adaptive Multimedia Streams in Information-Centric Networks
2015
With video streaming becoming more and more popular, the number of devices that are capable of streaming videos over the Internet is growing. This leads to a heterogeneous device landscape with varying demands. Dynamic Adaptive Streaming over HTTP (DASH) offers an elegant solution to these demands. Smart adaptation logics are able to adjust the clients' streaming quality according to several (local) parameters. Recent research indicated benefits of blending Scalable Video Coding (SVC) with DASH, especially considering Future Internet architectures. However, except for a DASH dataset with a single SVC encoded video, no other datasets are publicly available. The contribution of this paper is two-fold. First, a DASH/SVC dataset, containing multiple videos at varying bitrates and spatial resolutions including 1080p, is presented. Second, a toolchain for multiplexing SVC encoded videos is provided, therefore making our results reproducible and allowing researchers to generate their own datasets.
New York, NY, USA
Kreuzberger, Christian
Posch, Daniel
Hellwagner, Hermann
Proceedings of the 6th ACM Multimedia Systems Conference
10.1145/2713168.2713193
Wei, Tsang Ooi
978-1-4503-3351-1
DASH; Dataset; Toolchain; Scalable Video Coding
EN
Portland, Oregon
mar
213-218
https://www.itec.aau.at/bib/files/dash_svc_dataset_v1.05.pdf
ACM
MMSys '15
2015.03.18
registered
A Scalable Video Coding Dataset and Toolchain for Dynamic Adaptive Streaming over HTTP
http://concert.itec.aau.at/SVCDataset/
2015
The core problem for any adaptive video streaming solution, particularly over wireless networks, is the detection (or even prediction) of congestion. IEEE 802.11 is especially vulnerable to fast movement and change of antenna orientation. When used in UAV networks (Unmanned Aerial Vehicles), the network throughput can vary widely and is almost impossible to predict. this paper evaluates an approach originally developed by Kofler for home networks, in a single-hop UAV wireless network setting: the delay between the sending of an IEEE 802.11 packet and the receipt of its corresponding acknowledgement is used as an early indicator of the link quality and as a trigger to adapt (reduce or increase) the video stream' s bitrate. Our real-world flight-tests indicate, that this avoids congestion and can frequently avoid the complete loss of video pictures which happens without adaptation.
New York, USA
Hellwagner, Hermann
Kacianka, Severin
MoVid '15 Proceedings of the 7th ACM International Workshop on Mobile Video
10.1145/2727040.2727043
Halvorsen, Pal
Dutt, Nikil
978-1-4503-3353-5
Video Streaming, Adaptive Streaming, UAVs, UAV Communication
EN
Portland, OR, USA
mar
25-30
ACM International Conference on Multimedia Systems
none
Adaptive Video Streaming for UAV Networks
2015
Software Defined Networking (SDN) and Named Data Networking (NDN) are two topics which have received lots of attention in the networking research community in recent years. While both have emerged independently from each other we believe that their core features can be well aligned to each other. Hence combining both may hold potential benefits for network operators. In this paper we investigate the advantage of having a central SDN controller which is aware of the complete topology of an underlying NDN network. In our approach we use the controller for routing Interests for names unknown to the forwarding elements and to find alternative routes in case of link congestion. Another advantage of SDN is the ability to analyze and control the network on an application-layer component which communicates with the controller. This allows the development of application-aware networks that support the specific needs of the applications that use them. As an example use case we assumed a network whose main purpose is to disseminate multimedia content with Zipf-distributed popularity among users. Having an application layer which knows about content popularity statistics we improve the dissemination of multimedia content by instructing dedicated nodes in the network to prefetch content which is expected to become popular in their geographical region or autonomous system (AS) in the near future. The aim of this approach is to reduce the distance to potential consumers and reduce the load of the core network.
Los Alamitos, CA, USA
Bacher, Florian
Rainer, Benjamin
Hellwagner, Hermann
Proceedings of IEEE International Conference on Multimedia and Expo Workshops
10.1109/ICMEW.2015.7169842
not, available
9781479970797
Information Centric Networking; Named Data Networking; Software Defined Networking; Routing; Forwarding; Caching
EN
Turino, Italy
jul
1-6
https://www.itec.aau.at/bib/files/07169842.pdf
IEEE
ICMEW '15
2015.07.03
registered
Towards Controller-aided Multimedia Dissemination in Named Data Networking
2015
In this tutorial we present state of the art and challenges ahead in over-the-top content delivery. It particular, the goal of this tutorial is to provide an overview of adaptive media delivery, specifically in the context of HTTP adaptive streaming (HAS) including the recently ratified MPEG-DASH standard. The main focus of the tutorial will be on the common problems in HAS deployments such as client design, QoE optimization, multi-screen and hybrid delivery scenarios, and synchronization issues. For each problem, we will examine proposed solutions along with their pros and cons. In the last part of the tutorial, we will look into the open issues and review the work-in-progress and future research directions.
New York, NY, USA
Timmerer, Christian
Begen, Ali Cengiz
Proceedings of the 2014 ACM Multimedia Conference
10.1145/2647868.2654849
Hua, Kien
Rui, Yong
Steinmetz, Ralf
Hanjalic, Alan
Natsev, Apostol
Zhu, Wenwu
978-1-4503-3063-3
adaptive media streaming, dynamic adaptive streaming over HTTP, MPEG-DASH, over-the-top video video
EN
Orlando, FL, USA
nov
1231-1232
https://www.itec.aau.at/bib/files/tut02-timmerer.pdf
ACM
https://www.itec.aau.at/bib/files/ACM_MM_Tutorial_11_2014.pdf
2014.11.03
registered
Over the Top Content Delivery: State of the Art and Challenges Ahead
2014
The emerging MPEG standard Dynamic Adaptive Streaming over HTTP (MPEG-DASH) is designed for media delivery over the top of existing infrastructures and enables smooth multimedia streaming towards heterogeneous devices including both wired and wireless environments. The MPEG-DASH standard was designed to work with HTTP-URLs but mandates neither the actual version nor which underlying protocols to be used. This paper will provide a detailed introduction into emerging protocols (HTTP/2.0 and beyond) to be used in the context of adaptive media streaming, specifically DASH.
Washington DC, USA
Timmerer, Christian
Mueller, Christopher
Lederer, Stefan
2014 NAB Broadcast Engineering Conference Proceedings & CD
available, not
EN
Las Vegas, NV, USA
apr
4
https://www.itec.aau.at/bib/files/TimmererC012314_revised.pdf
National Association of Broadcasters (NAB)
https://www.itec.aau.at/bib/files/NAB2014-BEC.pdf
2014.04.07
registered
Adaptive Media Streaming over Emerging Protocols
2014
R, I
Rass, Stefan
Rainer, Benjamin
Matthias, Vavti
Göllner, Johannes
Peer, Andreas
Schauer, Stefan
International Conference on Software-Defined and Virtualized Future Wireless Networks
n, A
Risk management; Network-level security and protection; Network communications; Privacy; Security
EN
Rome, Italy
oct
0-0
Springer
2014.10.28
registered
Secure Communication over Software-Defined Networks
2014
Synchronizing multimedia playback among geographically distributed clients is a challenging task and is referred to as Inter-Destination Media Synchronization (IDMS). In this paper we discuss the uses cases of IDMS as identified within the SocialSensor Project and based on these use cases we derive a novel Adaptive Media Playout (AMP) scheme which aims on carrying out the process of synchronizing the media playback at the clients to a given synchronization point. We propose how visual and acoustic features can be used to achieve a QoE-aware and context-aware AMP scheme.
Los Alamitos, CA, USA
Rainer, Benjamin
Timmerer, Christian
In Proceedings of the IEEE Network Operations and Management Symposium (IEEE NOMS 2014)
Lutfiyya, Hanan
Cholda, Piotr
-
Adaptive Media Playout, Inter-Destination Media Synchronization, Social TV
EN
Krakow, Poland
may
0-0
https://www.itec.aau.at/bib/files/qcman-final.pdf
IEEE
2014.05.09
registered
A Subjective Evaluation using Crowdsourcing of Adaptive Media Playout utilizing Audio-Visual Content Features
http://www.qomex2013.org
2014
Mobile peer-to-peer (P2P) computing with applications such as for video on demand, file sharing, and video conferencing is gaining momentum based on new standards and technologies such as IETF PPSP, WiFi-Direct and BitTorrent live streaming. In this paper, we describe the mobile system MyMedia, that allows users to search, share and experience videos and live recordings using P2P and at the best quality possible with respect to available network capacity. In particular, the MyMedia system features a high-precision semantic P2P search and dynamic network-adaptive P2P live streaming of MPEG videos over HTTP based on the ISO/IEC standard MPEG-DASH from mobile to mobile devices in unstructured wireless P2P networks. These features have been integrated in the mobile application TIFF EventLive of the 54th Thessaloniki international film festival. The evaluation of their performance and device energy consumption, and a first user evaluation at the festival showed that the MyMedia system is suitable and accepted by users for its purpose in practice. The MyMedia system is available as open-source software for the Android operating system.
New York, NY, USA
Klusch, Matthais
Kapahnke, Patrick
Cao, Xiaoqi
Rainer, Benjamin
Timmerer, Christian
Mangold, Stefan
Proceedings of the 11th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services
Youssef, Moustafa
-
EN
London, Great Britain
dec
10
https://www.itec.aau.at/bib/files/mobi_mymedia_paper.pdf
ACM
2014.12.05
registered
MyMedia: Mobile Semantic Peer-to-Peer Video Search and Live Streaming
http://mobiquitous.org/2014
2014
Social networks have become pervasive and have changed the way of social interaction. The traditional TV experience drifts from an event tied to a certain place with the family or friends to a location-independent and distributed social experience. Additionally, more and more video on-demand services adopt a pull-based streaming approach. In order to provide a synchronized and distributed TV experience we introduce a self-organized Inter-Destination Multimedia Synchronization (IDMS) framework for adaptive media streaming. In particular, we extend the principles of IDMS to adaptive media streaming over HTTP (i.e., MPEG-DASH) and enable a synchronized multimedia playback among geographically distributed clients. Therefore, we introduce session management to MPEG-DASH and for negotiating on a reference playback timestamp among the participating peers in an IDMS session we propose a distributed control scheme. We evaluate our proposed scheme with respect to scalability and time required for negotiating on the reference playback timestamp. Furthermore, we investigate how to compensate the identified asynchronism by using adaptive media playout with respect to the Quality of Experience (QoE). Therefore, we define a temporal distortion measure for audio and video which allows us to model the impact of playback rate variations on the QoE. This measure is evaluated by conducting a subjective quality assessment using crowdsourcing.
New York, NY, USA
Rainer, Benjamin
Timmerer, Christian
Proceedings of the 22st ACM International Conference on Multimedia
ACM
-
Inter-Destination Multimedia Synchronization, Adaptive Media Streaming, Self-Organization, Quality of Experience, Dynamic Adaptive Streaming over HTTP
EN
Orlando, Florida
nov
10
https://www.itec.aau.at/bib/files/acmm14.pdf
ACM
2014.11.03
registered
Self-Organized Inter-Destination Multimedia Synchronization For Adaptive Media Streaming
http://acmmm.org/2014/
2014
Australia, Sydney
Rainer, Benjamin
Timmerer, Christian
First International Workshop on VideoNext: Design, Quality and Deployment of Adaptive Video Streaming
N, N
Dynamic Adaptive Streaming over HTTP; Crowdsourcing; Subjective Quality Assessment; Quality of Experience; QoE; DASH; MPEG
EN
Singapore
dec
1-6
https://www.itec.aau.at/bib/files/videoNextDASH.pdf
ACM
2014.12.02
registered
Quality of Experience of Web-based Adaptive HTTP Streaming Clients in Real-World Environments using Crowdsourcing
2014
In the past decade Adaptive Media Playout (AMP) has been intensively studied with respect to the detection of when to increase or decrease the playback rate in order to maintain a certain buffer fill state. In this paper we subjectively assess the QoE of AMP with respect to non-periodically and randomly selected content sections of a video sequence by us- ing crowdsourcing. Furthermore, we introduce features that allow to quantify the distortion for audio and video that are caused by increasing or decreasing the playback rate. With these preliminaries we study the correlation between the introduced features and the subjectively assessed QoE. Therefore, we derive a utility model that allows to estimate the QoE with the introduced features. We instantiate and validate the model by the use of the data gathered by the conducted study.
Singapore, Singapore
Rainer, Benjamin
Timmerer, Christian
Sixth International Workshop on Quality of Multimedia Experience (QoMEX 2014)
Winkler, Stefan
Adaptive Media Playout; Inter-Destination Media Synchronization; Crowdsourcing; Subjective Quality Assessment; Quality of Experience
EN
Singapore
sep
1-4
https://www.itec.aau.at/bib/files/QoMEX-paper_Rainer.pdf
IEEE
2014.09.19
registered
A Quality of Experience Model for Adaptive Media Playout
2014
Berlin Heidelberg
Raffelsberger, Christian
Hellwagner, Hermann
Proceedings of the 13th International Conference on Ad-hoc, Mobile, and Wireless Networks (ADHOC-NOW '14)
Guo, Song
Manzoni, Pietro
Lloret, Jaime
Ruehrup, Stefan
978-3-319-07424-5
mobile ad-hoc networks; disruption-tolerant networks; routing; simulation
EN
Benidorm, Spain
jun
1-14
https://www.itec.aau.at/bib/files/cr-adhocnow-authorver2.pdf
Springer
Lecture Notes in Computer Science (LNCS 8487)
2014.06.24
registered
Combined Mobile Ad-Hoc and Delay/Disruption-Tolerant Routing
8487
2014
The consumption of audio-visual content is the most dominant traffic source in today's Internet. Novel architectural approaches, such as Information-Centric Networking (ICN), are developed to support efficient multimedia dissemination. As ICN and MPEG-DASH have several concepts in common, recent proposals consider a fusion of both technologies. However, MPEG-DASH relies on pure client-driven adaptation. This often rather selfish adaptation strategy inhibits benefits gained from ICN's inherent caching and multi-path transmission capabilities. In order to overcome this challenge, the contribution of this work is the integration of in-network adaptation (INA) in ICN. We illustrate that INA can be realized despite ICN's content-based security model. Our proposal rests on scalable content, which enables INA without management and transmission overhead.
New York, NY, USA
Posch, Daniel
Kreuzberger, Christian
Rainer, Benjamin
Hellwagner, Hermann
Proceedings of the 10th International Conference on Emerging Networking Experiments and Technologies, VideoNext Workshop
Dixon, Colin
Information-Centric Networking; In-Network Adaptation; Adaptive Streaming; Multimedia Dissemination
EN
Sydney, Australia
dec
1-6
https://www.itec.aau.at/bib/files/video01fp.pdf
ACM Digital Library
2014.12.02
registered
Using In-Network Adaptation to Tackle Inefficiencies Caused by DASH in Information-Centric Networks
2014
Information-centric Networking (ICN) as a potential Future Internet architecture has to efficiently support the consumption of multimedia content. Recent proposals consider the reuse of MPEG-DASH to provide adaptive streaming in ICN. Due to the fact that MPEG-DASH relies on pure client-driven adaptation, it encounters difficulties dealing with ICN's inherent caching and multi-path transmission. By conducting simulations using the concrete ICN approach Named Data Networking (NDN), we show that pure client-driven adaptation leads to shortcomings. Furthermore, we propose to use in-network adaptation based on scalable content for overcoming these shortcomings in NDN.
New York, NY, USA
Posch, Daniel
Kreuzberger, Christian
Rainer, Benjamin
Hellwagner, Hermann
Proceedings of the 1st ACM Conference on Information-Centric Networking
10.1145/2660129.2660162
Mendes, Paulo
Information-centric Networking; Adaptive Streaming
EN
Paris, Frankreich
sep
1-2
https://www.itec.aau.at/bib/files/icn14_final.pdf
ACM Digital Library
2014.09.26
poster
Client Starvation: A Shortcoming of Client-driven Adaptive Streaming in Named Data Networking
http://dx.doi.org/10.1145/2660129.2660162
2014
University Park, Pennsylvania, USA
Al-Akkad, Amro
Raffelsberger, Christian
Boden, Alexander
Ramirez, Leonardo
Zimmermann, Andreas
Proceedings of the 11th International Conference on Information Systems for Crisis Response and Management (ISCRAM '14)
Hiltz, Star Roxanne
Pfaff, Mark S
Plotnick, Linda
Shih, Patrick C
978-0-692-21194-6
EN
University Park, Pennsylvania, USA
may
657-666
https://www.itec.aau.at/bib/files/iscram2014-p35.pdf
The Pennsylvania State University, USA
2014.05.21
registered
Tweeting 'When Online is Off'? Opportunistically Creating Mobile Ad-hoc Networks in Response to Disrupted Infrastructure
2014
University Park, Pennsylvania, USA
Al-Akkad, Amro
Raffelsberger, Christian
Proceedings of the 11th International Conference on Information Systems for Crisis Response and Management (ISCRAM '14)
Hiltz, Star Roxanne
Pfaff, Mark S
Plotnick, Linda
Shih, Patrick C
978-0-692-21194-6
EN
University Park, Pennsylvania, USA
may
560-564
https://www.itec.aau.at/bib/files/iscram2014-p155.pdf
The Pennsylvania State University, USA
2014.05.21
registered
How do I get this App? A Discourse on Distributing Mobile Applications Despite Disrupted Infrastructure
2014
The popularity of the crowdsourcing for performing various tasks online increased significantly in the past few years. The low cost and flexibility of crowdsourcing, in particular, attracted researchers in the field of subjective multimedia evalua- tions and Quality of Experience (QoE). Since online assessment of multimedia content is challenging, several dedicated frameworks were created to aid in the designing of the tests, including the support of the testing methodologies like ACR, DCR, and PC, setting up the tasks, training sessions, screening of the subjects, and storage of the resulted data. In this paper, we focus on the web-based frameworks for multimedia quality assessments that support commonly used crowdsourcing platforms such as Amazon Mechanical Turk and Microworkers. We provide a detailed overview of the crowdsourcing frameworks and evaluate them to aid researchers in the field of QoE assessment in the selection of frameworks and crowdsourcing platforms that are adequate for their experiments.
Piscataway, N.J. 08854, U.S.A.
Hoßfeld, Tobias
Hirth, Matthias
Korshunov, Pavel
Hanhart, Philippe
Gardlo, Bruno
Keimel, Christian
Timmerer, Christian
2014 IEEE International Workshop on Multimedia Signal Processing (MMSP 2014)
Rahardja, Susanto
Zhang, Zhengyou
Pereira, Fernando
Loui, Alexander
EN
sep
6
https://www.itec.aau.at/bib/files/PDF_check_PID3271407.pdf
IEEE
none
Survey of Web-based Crowdsourcing Frameworks for Subjective Quality Assessment
2014
Lately, 3D is gaining momentum in cinemas and home environments. However, 2D and 3D video content only stimulates senses like hearing and seeing. In this paper we focus on a more enhanced level of entertainment by presenting a 4D multimedia player and a corresponding demonstration setup, which stimulates further senses such as haptics using the MPEG-V: Media Context and Control standard. The presented demonstration setup uses stereoscopic 3D and sensory devices, i.e., fans, vibration panels and lights. The combination of conventional 3D content with tailored sensory effects allows us to further enhance the viewing experience of the users.
Los Alamitos, CA, USA
Waltl, Markus
Rainer, Benjamin
Lederer, Stefan
Timmerer, Christian
Gassner, Katharina
Terlutter, Ralf
Proceedings of the 5th International Workshop on Quality of Multimedia Experience (QoMEX'13)
Timmerer, Christian
Le Callet, Patrick
Varela, Martin
Winkler, Stefan
Falk, Tiago H
-
3D, 4D, Sensory Effects, Sensory Experience, MPEG-V
EN
Klagenfurt am Wörthersee, Austria
jul
126-127
https://www.itec.aau.at/bib/files/QoMEX2013_4DPlayer.pdf
IEEE
2013.07.04
poster
A 4D Multimedia Player enabling Sensory Experience
http://www.qomex2013.org
2013
Enriching multimedia with additional effects such as olfaction, light, wind, or vibration is gaining more and more momentum in both research and industry. Hence, there is the need to determine the influence of individual effects on the Quality of Experience (QoE). In this paper, we present a subjective quality assessment using the MPEG-V standard to annotate video sequences with individual sensory effects (i.e., wind, light, and vibration) and all combinations thereof. Based on the results we derive a utility model for sensory experience that accounts for the assessed sensory effects. Finally, we provide an example instantiation of the utility model and validate it against current and past results of our subjective quality assessments conducted so far.
Los Alamitos, CA, USA
Timmerer, Christian
Rainer, Benjamin
Markus, Waltl
Proceedings of the 5th International Workshop on Quality of Multimedia Experience (QoMEX'13)
Timmerer, Christian
Le Callet, Patrick
Varela, Martin
Winkler, Stefan
Falk, Tiago H
-
Quality of Multimedia Experience, Sensory Effects, MPEG-V, Sensory Experience, Utility Model
EN
Klagenfurt am Wörthersee, Austria
jul
224-229
https://www.itec.aau.at/bib/files/QoMEX2013_UtilityModel.pdf
IEEE
2013.07.05
registered
A Utility Model for Sensory Experience
http://www.qomex2013.org
2013
The MPEG-DASH standard allows the client-centric access to different representations of video content via the HTTP protocol. The client can flexibly switch between different qualities, i.e., different bit rates and thus avoid waiting times during the video playback due to empty playback buffers. However, quality switches and the playback of lower qualities is perceived by the user which may reduce the Quality of Experience (QoE). Therefore, novel algorithms are required which manage the streaming behavior with respect to the user's requirements and which do not waste network resources. As indicated by recent studies, scalable video coding (SVC) may use the current network and content distribution infrastructure in a more efficient way than with single layer codecs. The contribution of this paper is the design and the implementation of a novel DASH/SVC streaming algorithm. By means of measurements in a test-bed, its performance and benefits are evaluated and compared to existing algorithms from an user-centric view point with objective performance metrics. Our findings show that the proposed algorithm outperforms other DASH mechanisms in terms of video quality, low switching frequency and usage of the available resources in a realistic mobile network scenario. This is a first step towards true QoE management of video streaming in the Internet with DASH and SVC.
New York, NY, USA
Sieber, Christian
Hoßfeld, Tobias
Zinner, Thomas
Tran-Gia, Phuoc
Timmerer, Christian
Integrated Network Management (IM 2013), 2013 IFIP/IEEE International Symposium on
De Turck, Filip
Diao, Yixin
Hong, Choong Seon
Medhi, Deep
Sadre, Ramin
978-1-4673-5229-1
quality of experience, mpeg-dash, scalable video coding, adaptive media streaming
EN
may
1318-1323
https://www.itec.aau.at/bib/files/06573184.pdf
IEEE Communications Society
none
Implementation and User-centric Comparison of a Novel Adaptation Logic for DASH with SVC
2013
Selecting and adopting the appropriate assessment method for conducting subjective quality assessments is a challenging task. The method decides whether the assessment is successful in delivering the correct answers to previously set up hypotheses. Therefore, in this paper we provide recommendations on test methods used in the domain of Sensory Experience. The proposed test methods comprise single stimulus and double stimulus methods. These test methods were used in previous studies and are presented in combination with the results of the subjective quality assessments with which they were used. Furthermore, we briefly outline our test setup, test design, and test content for assessing Sensory Experience which have been validated through conducted assessments.
Vienna, Austria
Rainer, Benjamin
Timmerer, Christian
Waltl, Markus
4th International Workshop on Perceptual Quality of Systems 2013 (PQS 2013)
Schatz, Raimund
Subjective Evaluation Methods; Sensory Experience; Recommendations
EN
Vienna, Austria
sep
1-6
IEEE
2013.09.03
registered
Recommendations for the Subjective Evaluation of Sensory Experience
2013
Synchronizing multimedia playback among geographically distributed clients is a challenging task and is referred to as Inter-Destination Media Synchronization (IDMS). In this paper we discuss the uses cases of IDMS as identified within the SocialSensor Project and based on these use cases we derive a novel Adaptive Media Playout (AMP) scheme which aims on carrying out the process of synchronizing the media playback at the clients to a given synchronization point. We propose how visual and acoustic features can be used to achieve a QoE-aware and context-aware AMP scheme.
Los Alamitos, CA, USA
Rainer, Benjamin
Timmerer, Christian
Proceedings of the 5th International Workshop on Quality of Multimedia Experience (QoMEX'13)
Timmerer, Christian
Le Callet, Patrick
Varela, Martin
Winkler, Stefan
Falk, Tiago H
-
Adaptive Media Playout, Inter-Destination Media Synchronization, Social TV
EN
Klagenfurt am Wörthersee, Austria
jul
44-45
https://www.itec.aau.at/bib/files/QoMEX2013_MediaPlayout.pdf
IEEE
2013.07.03
poster
Adaptive Media Playout for Inter-Destination Media Synchronization
http://www.qomex2013.org
2013
Preparing and conducting subjective quality assessments is a time consuming and expensive task. Therefore, we present a Web-based evaluation framework which aims on reducing the time needed for planning and designing a subjective quality assessment. The presented framework can be used for both crowdsourced and laboratory experiments. It should ease the task of designing a subjective quality assessment by providing a flexible framework. The framework has proven its applicability and flexibility to design and conduct assessments in the past and is available as open source.
Los Alamitos, CA, USA
Rainer, Benjamin
Waltl, Markus
Timmerer, Christian
Proceedings of the 5th International Workshop on Quality of Multimedia Experience (QoMEX'13)
Timmerer, Christian
Le Callet, Patrick
Varela, Martin
Winkler, Stefan
Falk, Tiago H
-
Evaluation Platform, Crowdsourced Quality Evaluation, Laboratory Quality Evaluation, Quality Assessment Framework
EN
Klagenfurt am Wörthersee, Austria
jul
24-25
https://www.itec.aau.at/bib/files/QoMEX2013_EvalPlatform.pdf
IEEE
2013.07.03
poster
A Web based Subjective Evaluation Platform
http://www.qomex2013.org
2013
Emergency response operations are a promising application area for mobile ad-hoc networks (MANETs). Most existing MANET routing protocols assume that an end-toend path between source and destination can be established. However, this assumption may not hold in a hastily formed network established during an emergency response. This paper evaluates a store-and-forward mechanism for proactive routing protocols to mitigate the effects of network disruptions. The mechanism is integrated into two routing protocols. The modified protocols are evaluated in an emergency response scenario that includes a disaster area mobility model and a wireless obstacle model. The scenario represents a realistic first responder operation after an incident in a chemical facility. The evaluation results show that networks for disaster responses benefit from the modified routing protocols.
Los Alamitos, CA, USA
Raffelsberger, Christian
Hellwagner, Hermann
Proceedings of the Eleventh IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops '13)
Indulska, Jadwiga
Bisdikian, Chatschik
EN
San Diego, CA, USA
mar
505-510
https://www.itec.aau.at/bib/files/PerNEM2013-cr.pdf
IEEE
2013.03.22
registered
A Hybrid MANET-DTN Routing Scheme For Emergency Response Scenarios
2013
Communication networks for emergency response operations have to operate in harsh environments. As fixed infrastructures may be unavailable (e.g., they are destroyed or overloaded), mobile ad-hoc networks (MANETs) are a promising solution to establish communication for emergency response operations. However, networks for emergency responses may provide diverse connectivity characteristics which imposes some challenges, especially on routing. Routing protocols need to take transmission errors, node failures and even the partitioning of the network into account. Thus, there is a need for routing algorithms that provide mechanisms from Delay or Disruption Tolerant Networking (DTN) in order to cope with network disruptions but at the same time are as efficient as MANET routing schemes in order to preserve network resources. This paper reviews several hybrid MANET-DTN routing schemes that can be found in the literature. Additionally, the paper evaluates a realistic emergency response scenario and shows that MANET-DTN routing schemes have the potential to improve network performance as the resulting network is diverse in terms of connectivity. In particular, the network provides well-connected regions whereas other parts are only intermittently connected.
Berlin, Germany
Raffelsberger, Christian
Hellwagner, Hermann
Proceedings of the Combined workshop on Self-organizing, Adaptive, and Context-Sensitive Distributed Systems and Self-organized Communication in Disaster Scenarios (SACS/SoCoDiS '13)
Zapf, Michael
Evers, Florian
1863-2122
EN
Stuttgart, Germany
mar
1 -12
https://www.itec.aau.at/bib/files/SoCoDis2013-cr.pdf
Electronic Communications of the EASST (ECEASST)
2013.03.15
registered
Overview of Hybrid MANET-DTN Networking and its Potential for Emergency Response Operations
2013
This paper proposes a framework for on-demand video streaming that enables secure and efficient delivery of data towards the end user. Our proposal requires the combined usage of three different technologies. The first one is a recent proposal by Jacobsen et al. called Content-Centric Networking (also known as Named Data Networking). It is a network architecture that introduces named data as the most valuable element in the network and divides it into so called content chunks, which are self-identifying and self-authenticating data units. The second concept we utilize derives from the approach of Dynamic Adaptive Streaming over HTTP, which allows clients to dynamically choose the quality of the received video stream according to their available resources. Finally, we adapt the concept of Broadcast Encryption to form a tool to control the access to provided content streams. The combination of these technologies enables us to design a framework that allows streaming providers to transport data to customers as dynamic adaptive encrypted content chunks, which is an efficient, flexible and scalable way of multimedia data transport.
Los Alamitos, CA, USA
Posch, Daniel
Hellwagner, Hermann
Schartner, Peter
Proceedings of the 8th International Workshop on Secure Network Protocols (NPSec' 13)
Li, Jun
Maennel, Olaf
Content-Centric Networking, CCN, Named Data Networking, NDN, Dynamic Adaptive Streaming, DASH, Broadcast Encryption, Video on Demand
EN
Germany, Göttingen
oct
6
https://www.itec.aau.at/bib/files/ICNP_NPSEC_Streaming.pdf
IEEE
2013.10.07
registered
On-Demand Video Streaming based on Dynamic Adaptive Encrypted Content Chunks
2013
Dynamic Adaptive Streaming over HTTP (DASH) is an ISO/IEC MPEG standard which enables the convenient and smooth transportation of multimedia data to heterogeneous end devices over networks with variable bandwidth conditions. This kind of streaming technology is mainly used with HTTP 1.0 and 1.1 respectively, which both have some drawbacks. Therefore, the IETF has started the development of HTTP 2.0, which is based on Google’s SPDY proposal and already supported by several major companies, e.g., Facebook, Twitter, Akamai, Mozilla and obviously Google. Furthermore, Content Centric Networking (CCN) is another novel approach for future networks that is considered as an revolutionary approach compared to HTTP 2.0. The CCN communication paradigm is completely different and does not rely on direct connections between hosts, it rather focuses on the content. This paper demonstrates DASH with HTTP 2.0/SPDY and CCN using our universal libdash library. Moreover, different mechanisms of DASH will be shown that can be used to provide on-demand and live content in an efficient and comfortable way.
San Jose, USA
Mueller, Christopher
Lederer, Stefan
Pöcher, Jörg
Timmerer, Christian
In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME) 2013
Servetti, Antonio
Aydin, Alatan
EN
San Jose, USA
jul
1-2
https://www.itec.aau.at/bib/files/libdash-demo.pdf
IEEE
2013.07.18
poster
libdash – An Open Source Software Library for the MPEG-DASH Standard
2013
MPEG Dynamic Adaptive Streaming over HTTP (DASH) is a new streaming standard that has been recently ratified as an international standard (IS). In comparison to other streaming systems, e.g., HTTP progressive download, DASH is able to handle varying bandwidth conditions providing smooth streaming. Furthermore, it enables NAT and Firewall traversal, flexible and scalable deployment as well as reduced infrastructure costs due to the reuse of existing Internet infrastructure components, e.g., proxies, caches, and Content Distribution Networks (CDN). Recently, the Hypertext Transfer Protocol Bis (httpbis) working group of the IETF has officially started the development of HTTP 2.0. Initially three major proposals have been submitted to the IETF i.e., Googles' SPDY, Microsofts' HTTP Speed+Mobility and Network-Friendly HTTP Upgrade, but SPDY has been chosen as working draft for HTTP 2.0. In this paper we implemented MPEG-DASH over HTTP 2.0 (i.e., SPDY), demonstrating its potential benefits and drawbacks. Moreover, several experimental evaluations have been performed that compare HTTP 2.0 with HTTP 1.1 and HTTP 1.0 in the context of DASH. In particular, the protocol overhead, the performance for different round trip times, and DASH with HTTP 2.0 in a lab test scenario has been evaluated in detail.
San Jose, USA
Mueller, Christopher
Lederer, Stefan
Timmerer, Christian
Hellwagner, Hermann
In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME) 2013
Li, Jin
EN
San Jose, USA
jul
1-6
https://www.itec.aau.at/bib/files/paper_330.pdf
IEEE
2013.07.17
registered
Dynamic Adaptive Streaming over HTTP/2.0
2013
This paper presents the usage of CCN, which is a candidate for the next-generation Internet, in combination with the new Dynamic Adaptive Streaming over HTTP (DASH) standard, which was recently ratified by ISO/IEC MPEG. In contrast to the Internet Protocol, which is mainly based on the host-to-host connection paradigm originated in the 1970s, Content Centric Networking (CCN) focuses on the content itself, instead of its location. Considering the dominance of multimedia traffic in todays' Internet, the streaming performance of DASH over CCN as well as the problems introduced by this combination is worth to be investigated in detail. Therefore, we evaluate the protocol overhead introduced by the usage of CCN compared to the HTTP versions 1.0 and 1.1. Furthermore, the performance of DASH over CCN under different network conditions is compared to the performance of HTTP 1.0/1.1. Our results showed that although CCN comes together with higher protocol overhead than HTTP 1.0/1.1 as well as a prototype implementation, it can definitely compete with HTTP 1.0 in media streaming. Based on the evaluation results, problems as well as improvement possibilities are identified, which are the basis for future work in this area.
San Jose, USA
Lederer, Stefan
Mueller, Christopher
Rainer, Benjamin
Timmerer, Christian
Hellwagner, Hermann
Proceedings of the IEEE International Conference on Multimedia and Expo (ICME) 2013
Wang, Haohong
EN
San Jose, USA
jul
1-6
https://www.itec.aau.at/bib/files/ICME_Overhead-Performance-DASHoverCCN.pdf
IEEE
2013.07.18
registered
An Experimental Analysis of Dynamic Adaptive Streaming over HTTP in Content Centric Networks
2013
Scalable Video Coding (SVC) in media streaming enables dynamic adaptation based on device capabilities and network conditions. In this paper, we investigate deployment options of SVC for Dynamic Adaptive Streaming over HTTP (DASH) with a special focus on scalability options, which are relevant for dynamic adaptation, especially in wireless and mobile environments. We evaluate the performance of SVC with respect to spatial and quality scalability options and compare it to non-scalable Advanced Video Coding (AVC). Performance evaluations are performed for various encoder implementations with high-definition (1080p) content. We show that a hybrid approach with multiple independent SVC bitstreams can have advantages in storage requirements at comparable rate-distortion performance.
Los Alamitos, CA, USA
Grafl, Michael
Timmerer, Christian
Hellwagner, Hermann
Cherif, Wael
Ksentini, Adlen
Proceedings of the 2nd IEEE WoWMoM Workshop on Video Everywhere (ViDEv 2013)
Todd, Terence D
Paterakis, Michael
scalable video coding; HTTP streaming; adaptation; high-definition; hybrid SVC-DASH
EN
Madrid, Spain
jun
7
https://www.itec.aau.at/bib/files/Hybrid_SVC-DASH.pdf
IEEE
2013.06.04
registered
Evaluation of Hybrid Scalable Video Coding for HTTP-based Adaptive Media Streaming with High-Definition Content
2013
When an adaptive media streaming system has to switch from one representation of the content to another, the switch causes viewer distraction. We introduce the concept of representation switch smoothing for alleviating the distraction and improving the overall quality of experience. As adaptive HTTP streaming systems typically deploy video buffers on the client side, the adaptation decision is known far enough ahead of playout time to perform a seamless transition between quality representations. We discuss implementation considerations for an adaptive HTTP streaming system with scalable video coding, present a subjective evaluation of the proposed approach, and identify factors that influence how smooth transitions are perceived.
Vienna, Austria
Grafl, Michael
Timmerer, Christian
Proceedings of the 4th International Workshop on Perceptual Quality of Systems (PQS 2013)
Schatz, Raimund
Hoßfeld, Tobias
adaptive streaming; representation switching; quality of experience
EN
Vienna, Austria
sep
178-183
https://www.itec.aau.at/bib/files/representation_switch_smoothing.pdf
FTW
2013.09.04
registered
Representation Switch Smoothing for Adaptive HTTP Streaming
2013
Scalability within media coding allows for content adaptation towards heterogeneous user contexts and enables in-network adaptation. However, there is no straightforward solution how to encode the content in a scalable way while maximizing rate-distortion performance. In this paper we provide encoding guidelines for scalable video coding based on a survey of media streaming industry solutions and a comprehensive performance evaluation using four state of the art scalable video codecs with a focus on high-definition content (1080p).
Los Alamitos, CA, USA
Grafl, Michael
Timmerer, Christian
Hellwagner, Hermann
Cherif, Wael
Negru, Daniel
Battista, Stefano
Proceedings of the 18th IEEE Symposium on Computers and Communication (ISCC 2013)
Douligeris, Christos
Gotovac, Sven
Vojnović, Milan
scalable video coding; adaptation; high-definition video; encoding; adaptive media streaming; content-aware networking
EN
Split, Coratia
jul
6
https://www.itec.aau.at/bib/files/SVC_guide_and_eval.pdf
IEEE
2013.07.10
registered
Scalable Video Coding Guidelines and Performance Evaluations for Adaptive Media Delivery of High Definition Content
2013
This paper shows how adaptive streaming and on-device caching can be used to provide an always available video service. A DASH client has been extended to deal with periods of zero network connectivity, and seamlessly works in conjunction with CCN to provide local storage that is intelligently updated to provide an improved quality of experience.
Palo Alto
Crabtree, Barry
Stevens, Tim
Allan, Brahin
Lederer, Stefan
Posch, Daniel
Mueller, Christopher
Timmerer, Christian
CCNxConn 2013
Mahadevan, Priya
EN
Palo Alto, CA, USA
sep
1-2
https://www.itec.aau.at/bib/files/Video adaptation in limited or zero network coverage-CCNxCon.pdf
PARC
2013.09.06
poster
Video Adaptation in Limited or Zero Network Coverage
http://www.ccnx.org/ccnxcon2013/ccnxcon-2013-official-agenda/
2013
Dynamic Adaptive Streaming over HTTP (DASH) is referred to as a multimedia streaming standard to deliver high quality multimedia content over the Internet using conventional HTTP Web servers. As a fundamental feature, it enables automatic switching of quality levels according to network conditions, user requirements, and expectations. Currently, the proposed adaptation schemes for HTTP streaming mostly rely on throughput measurements and/or buffer-related metrics, such as buffer exhaustion and levels. In this paper, we propose to enhance the DASH adaptation logic by feeding it with additional information from our evaluation of the users' perception approximating the user- perceived quality of video playback. The proposed model aims at conveniently combining TCP-, buffer-, and media content-related metrics as well as user requirements and expectations to be used as an input for the DASH adaptation logic. Experiments have demonstrated that the chosen model enhances the capability of the adaptation logic to select the optimal video quality level. Finally, we integrated all our findings into a real DASH system with QoE monitoring capabilities.
Los Alamitos, CA, USA
Alberti, Claudio
Renzi, Daniele
Timmerer, Christian
Mueller, Christopher
Lederer, Stefan
Battista, Stefano
Mattavelli, Marco
Proceedings of the 5th International Workshop on Quality of Multimedia Experience (QoMEX'13)
Timmerer, Christian
Le Callet, Patrick
Varela, Martin
Winkler, Stefan
Falk, Tiago
DASH, Quality of Experience, monitoring, content adaptation
EN
Klagenfurt am Wörthersee, Austria
jul
58-63
https://www.itec.aau.at/bib/files/p20-Alberti.pdf
IEEE
2013.07.03
registered
Automated QoE Evaluation of Dynamic Adaptive Streaming over HTTP
2013
Additional constituents for the representation of multimedia content gained more and more attention. For example, the amount of cinemas equipped with additional devices (e.g., ambient light, vibrating seats, wind generators, water sprayers, heater/coolers) that stimulate senses going beyond audition and vision increases. On the content side the MPEG-V standard specifies – among others – Sensory Effect Metadata (SEM) which provides means to describe sensory effects such as wind, vibration, light, etc. to be attached to audio-visual content and, thus, offering an enhanced and immersive experience for the user. However, there is a lack of a common set of test content allowing for various subjective user studies and verification across different test sites. In this paper we provide our dataset comprising a number of videos from different genres enriched with MPEG-V compliant Sensory Effect Metadata descriptions. Furthermore, we describe possible test setups using off-the-shelf hardware for conducting subjective quality assessments.
Yarra Valley, Australia
Waltl, Markus
Timmerer, Christian
Rainer, Benjamin
Hellwagner, Hermann
Proceedings of the 4th International Workshop on Quality of Multimedia Experience (QoMEX'12)
Burnett, Ian
Wu, Henry
-
Sensory Experience, Sensory Effects, MPEG-V, Dataset, Test Environment
EN
Yarra Valley, Australia
jul
115-120
https://www.itec.aau.at/bib/files/QoMEX2012_Dataset.pdf
IEEE
2012.07.05
registered
Sensory Effect Dataset and Test Setups
http://www.qomex2012.org
2012
Multimedia content is increasingly used in every area of our life. Still, each type of content only stimulates the visual and/or the hearing system. Thus, the user experience depends only on those two stimuli. In this paper we introduce a standard which offers the possibility to add additional effects to multimedia content. Furthermore, we present a multimedia player and a Web browser plug-in which uses this standard to stimulate further senses by using additional sensory effects (i.e., wind, vibration, and light) to enhance the user experience resulting in a unique, worthwhile sensory experience.
Berlin, Heidelberg, New York
Waltl, Markus
Rainer, Benjamin
Timmerer, Christian
Hellwagner, Hermann
Advances in Multimedia Modeling
Schoeffmann, Klaus
Merialdo, Bernard
Hauptmann, Alexander
Ngo, Chong-Wah
Andreopoulos, Yiannis
Breiteneder, Christian
MPEG-V, User Experience, Sensory Experience, Media Player, Ambient, World Wide Web
EN
Klagenfurt, Austria
jan
624-626
https://www.itec.aau.at/bib/files/mwbrcthh_mmm2012.pdf
Springer
LNCS 7131
2012.01.05
poster
Enhancing the User Experience with the Sensory Effect Media Player and AmbientLib
2012
This paper describes a toolset for the authoring, simulating, and rendering of multimedia content annotated with Sensory Effect Metadata (SEM) descriptions as specified in Part 3 of the MPEG V standard. This part of MPEG-V standardizes the description of sensory effects (e.g., light, wind) in order to be rendered on sensory devices (e.g., fans, vibration chairs) aiming at generating a sensory experience stimulating possibly all human senses. Our implementation comprises a toolset to author sensory effects associated with multimedia content and the simulation thereof. Furthermore, it includes a library, a standalone player, and a Web browser plug-in which enables the playback and rendering of sensory effects on off-the-shelf rendering devices and in various contexts. All software modules are available under the GNU General Public License (GPL) v3 and the GNU Lesser General Public License (LGPL) v3 respectively.
Nara, Japan
Waltl, Markus
Rainer, Benjamin
Timmerer, Christian
Hellwagner, Hermann
Proceedings of the 20th ACM Multimedia (MM'12)
Babaguchi, Noboru
Aizawa, Kiyoharu
Smith, John
-
MPEG-V, Annotation Tool, Simulator, Media Player, Web Browser Plug-in, Sensory Effects, Sensory Experience
EN
Nara, Japan
oct
1469-1472
https://www.itec.aau.at/bib/files/acmmm2012_ossc_mwbrcthh.pdf
ACM
2012.10.31
registered
A Toolset for the Authoring, Simulation, and Rendering of Sensory Experiences
http://www.acmm2012.org
2012
In this tutorial we present dynamic adaptive streaming over HTTP ranging from content creation to consumption. It particular, it provides an overview of the recently ratified MPEG-DASH standard, how to create content to be delivered using DASH, its consumption, and the evaluation thereof with respect to competing industry solutions. The tutorial can be roughly clustered into three parts. In part I we will provide an introduction to DASH, part II covers content creation, delivery, and consumption, and, finally, part III deals with the evaluation of existing (open source) MPEG-DASH implementations compared to state-of-art deployed industry solutions.
New York, NY, USA
Timmerer, Christian
Griwodz, Carsten
Proceedings of the 20th ACM international conference on Multimedia
10.1145/2393347.2396553
Babaguchi, Noboru
Aizawa, Kiyoharu
Smith, John
MPEG, adaptation, dash, dynamic adaptive http streaming, streaming
EN
Nara, Japan
oct
1533-1534
https://www.itec.aau.at/bib/files/mtu008-timmerer.pdf
ACM
MM '12
https://www.itec.aau.at/bib/files/mtu008-timmerer-slides.pdf
2012.10.29
registered
Dynamic adaptive streaming over HTTP: from content creation to consumption
http://doi.acm.org/10.1145/2393347.2396553
2012
The design of interactive systems, especially in distributed research projects, is a challenging process in which many concepts are developed with successful outcomes but also with dissatisfying results. In order to structure and relay knowledge about good or bad approaches, design patterns are a well-known instrument in research and development. Due to the condition that a design pattern must be easy to read, different stakeholders in the system engineering and design process are able to understand the described concepts without the need of specific expert knowledge . In distributed projects, application design knowledge may be scattered and documented in different manners. This means, before we can start formulating patterns, we need to discover and gather the available and partially concealed design knowledge. Since these fragments of knowledge may not always be accurately formulated for being used as design patterns, we seek for a collaborative method for collecting and formulating early findings together with established design knowledge. In this paper we present a concept of an evolutionary process for capturing, formulating, refining and validating design patterns. Our approach aims at involving as many stakeholders as possible in order to shape a pattern language over a project’s lifetime in a collaborative process allowing facile participation. We implement our approach in the scope of the EU research project BRIDGE that aims at supporting inter-agency collaboration during emergency response. We close with a discussion of the current state and envisioned next steps in order to foster our considerations.
New York, NY, USA
Reiners, René
Halvorsrud, Ragnhild
Eide, Aslak Wegner
Pohl, Daniela
Proceedings of the 19th Conference on Pattern Languages of Programs (PLoP)
Guerra, Eduardo
Design Patterns, Pattern Languages, Pattern Evolution Process, Collaboration
EN
Tucson, Arizona, USA
oct
1-14
https://www.itec.aau.at/bib/files/An Approach to Evolutionary Design Pattern Engineering.pdf
ACM
2012.10.20
registered
An Approach to Evolutionary Design Pattern Engineering
http://www.hillside.net/plop/2012/index.php
2012
Multimedia is ubiquitously available online with large amounts of video increasingly consumed through Web sites such as YouTube or Google Video. However, online multimedia typically limits users to visual/auditory stimulus, with onscreen visual media accompanied by audio. The recent introduction of MPEG-V proposed multi-sensory user experiences in multimedia environments, such as enriching video content with so-called sensory effects like wind, vibration, light, etc. In MPEG-V, these sensory effects are represented as Sensory Effect Metadata (SEM), which is additionally associated to the multimedia content. This paper presents three user studies that utilize the sensory effects framework of MPEG-V, investigating the emotional response of users and enhancement of Quality of Experience (QoE) of Web video sequences from a range of genres with and without sensory effects. In particular, the user studies were conducted in Austria and Australia to investigate whether geography and cultural differences affect users’ elicited emotional responses and QoE.
Yarra Valley, Australia
Rainer, Benjamin
Waltl, Markus
Cheng, Eva
Shujau, Muawiyath
Timmerer, Christian
Davis, Stephen
Burnett, Ian
Hellwagner, Hermann
Proceedings of the 4th International Workshop on Quality of Multimedia Experience (QoMEX'12)
Burnett, Ian
Wu, Henry
-
Quality of Multimedia Experience, Sensory Effects, MPEG-V, Subjective Quality Assessment, World Wide Web, Sensory Experience
EN
Yarra Valley, Australia
jul
278-283
https://www.itec.aau.at/bib/files/QoMEX2012_UserStudy.pdf
IEEE
2012.07.07
registered
Investigating the Impact of Sensory Effects on the Quality of Experience and Emotional Response in Web Videos
http://www.qomex2012.org
2012
Nowadays video is an important part of the Web and Web sites like YouTube, Hulu, etc. count millions of users consuming their content every day. However, these Web sites mainly use media players based on proprietary browser plug-ins (i.e., Adobe Flash) and do not leverage adaptive streaming systems. This paper presents a seamless integration of the recent MPEG standard on Dynamic Adaptive Streaming over HTTP (DASH) in the Web using the HTML5 video element. Therefore, we present DASHJS, a JavaScript-based MPEG-DASH client which adopts the Media Source API of Google’s Chrome browser to present a flexible and potentially browser independent DASH client. Furthermore, we present the integration of WebM based media segments in DASH giving a detailed description of the used container format structure and a corresponding Media Presentation Description (MPD). Our preliminary evaluation demonstrates the bandwidth adaption capabilities to show the effectiveness of the system.
Bucharest, Romania
Rainer, Benjamin
Lederer, Stefan
Mueller, Christopher
Timmerer, Christian
Proceedings of the 20th European Signal Processing Conference (EUSIPCO)
Pesquet-Popescu, Béatrice
Burileanu, Corneliu
EN
Bucharest, Romania
aug
1519-1523
https://www.itec.aau.at/bib/files/DASHJS-Eusipco.pdf
European Signal Processing (EURASIP) Society
2012.08.30
registered
A Seamless Web Integration of Adaptive HTTP streaming
2012
We evaluate the performance of several routing protocols for mobile ad-hoc networks (MANETs) in an emergency response scenario. The simulated scenario uses a disaster area mobility model and a wireless shadowing model to represent realistic first responder movements in a hybrid indoor/outdoor environment. The resulting scenario imposes some challenges on the MANET routing protocols such as intermittent connectivity and network partitions. The simulation results show that nodes have diverse connectivity characteristics which are challenging for state-of-the-art MANET routing protocols.
Los Alamitos, CA, USA
Raffelsberger, Christian
Hellwagner, Hermann
Proceedings of the Tenth Workshop on Intelligent Solutions in Embedded Systems (WISES '12)
Quaritsch, Markus
Fehervari, Istvan
EN
Klagenfurt, Austria
jul
88-92
https://www.itec.aau.at/bib/files/WISES2012-cr.pdf
IEEE
2012.07.05
poster
Evaluation of MANET Routing Protocols in a Realistic Emergency Response Scenario
2012
Social media are becoming an important instrument for supporting crisis management, due to their broad acceptance and the intensive usage of mobile devices for accessing them. Social platforms facilitate collaboration among the public during a crisis and also support after-the-fact analysis. Thus, social media are useful for the processes of understanding, learning, and decision making. In particular, having information from social networks in a suitable, ideally summarized, form can speed up such processes. The present study relies on Flickr and YouTube as social media and aims at automatically identifying individual sub-events within a crisis situation. The study applies a two-phase clustering approach to detect those sub-events. The first phase uses geo-referenced data to locate a sub-event, while the second phase uses the natural language descriptions of pictures and videos to further identify the ”what-about” of those sub-events. The results show high potential of this social media-based clustering approach for detecting crisis-related sub-events.
Los Alamitos, CA, USA
Pohl, Daniela
Bouchachia, Abdelhamid
Hellwagner, Hermann
11th International Conference on Machine Learning and Applications
Han, Jiawei
Khoshgoftaar, Taghi M
Zhu, Xingquan
Clustering, Sub-Event Detection, Crisis Management
EN
Boca Raton, Florida, USA
dec
333-338
https://www.itec.aau.at/bib/files/06406815.pdf
IEEE
2012.12.12
registered
Automatic Identification of Crisis-Related Sub-Events using Clustering
http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6406815
2012
Social networks give the opportunity to gather and share knowledge about a situation of relevance. This so called user-generated content is getting increasingly important during crisis management. It facilitates the collaboration with citizens or parties involved from the very beginning of the crisis. The information captured in form of images, text or videos is a valuable source of identifying sub-events of a crisis. In this study, we use metadata of images and videos collected from Flickr and YouTube to extract sub-events in crisis situations. We investigate the suitability of clustering techniques to detect sub-events. In particular two algorithms are evaluated on several data sets related to crisis situations. The results show the high potential of the approach proposed.
Toulouse, Fance
Pohl, Daniela
Bouchachia, Abdelhamid
Hellwagner, Hermann
IEEE 21st International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE)
10.1109/WETICE.2012.58
Diaz, Michel
Senac, Patrick
1524-4547
Crisis Management, Information Retrieval, Clustering, Sub-Event Detection
EN
Toulouse, Fance
jun
373 -378
IEEE
2012.06.26
registered
Supporting Crisis Management via Sub-Event Detection in Social Networks
2012
Emergency management is about assessing critical situations, followed by decision making as a key step. Clearly, information is crucial in this two-step process. The technology of social (multi)media turns out to be an interesting source for collecting information about an emergency situation. In particular, situational information can be captured in form of pictures, videos, or text messages. The present paper investigates the application of multimedia metadata to identify the set of sub-events related to an emergency situation. The used metadata is compiled from Flickr and YouTube during an emergency situation, where the identification of the events relies on clustering. Initial results presented in this paper show how social media data can be used to detect different sub-events in a critical situation.
New York, NY, USA
Pohl, Daniela
Bouchachia, Abdelhamid
Hellwagner, Hermann
Proceedings of the 21st International Conference Companion on World Wide Web
Mille, Alain
Gandon, Fabien
Misselis, Jacques
Emergency Management, Social Media, Clustering
EN
Lyon, France
apr
683-686
https://www.itec.aau.at/bib/files/p683.pdf
ACM
WWW '12 Companion
2012.04.17
registered
Automatic Sub-Event Detection in Emergency Management using Social Media
2012
Dynamic Adaptive Streaming over HTTP (DASH) is a convenient approach to transfer videos in an adaptive and dynamic way to the user. As a consequence, this system provides high bandwidth flexibility and is especially suitable for mobile use cases where the bandwidth variations are tremendous. In this paper we have integrated the Scalable Video Coding (SVC) extensions of the Advanced Video Coding (AVC) standard into the recently ratified MPEG-DASH standard. Furthermore, we have evaluated our solution under restricted conditions using bandwidth traces from mobile environments and compared it with an improved version of our MPEG-DASH implementation using AVC as well as major industry solutions.
Bucharest, Romania
Mueller, Christopher
Renzi, Daniele
Lederer, Stefan
Battista, Stefano
Timmerer, Christian
Proceedings of the 20th European Signal Processing Conference (EUSIPCO12)
Burileanu, Corneliu
Pesquet-Popescu, Béatrice
Dynamic Adaptive Streaming over HTTP, MPEG-DASH, Scalable Video Coding, Evaluation, Mobile Networks, Vehicular Mobility
EN
Bucharest, Romania
aug
2208-2212
https://www.itec.aau.at/bib/files/mueller_svc-dash.pdf
European Signal Processing (EURASIP) Society
2012.08.31
registered
Using Scalable Video Coding for Dynamic Adaptive Streaming over HTTP in Mobile Environments
2012
MPEGs' Dynamic Adaptive Streaming over HTTP (MPEG-DASH) is an emerging standard designed for media delivery over the top of existing infrastructures and able to handle varying bandwidth conditions during a streaming session. This requirement is very important, specifically within mobile environments and, thus, DASH could potentially become a major driver for mobile multimedia streaming. Hence, this paper provides a detailed evaluation of our implementation of MPEG DASH compared to the most popular propriety systems, i.e., Microsoft Smooth Steaming, Adobe HTTP Dynamic Streaming, and Apple HTTP Live Streaming. In particular, these systems will be evaluated under restricted conditions which are due to vehicular mobility. In anticipation of the results, our prototype implementation of MPEG-DASH can very well compete with state-of-the-art solutions and, thus, can be regarded as a mature standard ready for industry adaption.
New York, NY, USA
Mueller, Christopher
Lederer, Stefan
Timmerer, Christian
Proceedings of the Fourth Annual ACM SIGMM Workshop on Mobile Video (MoVid12)
Hefeeda, Mohamed
Hsu, Cheng-Hsin
Chatterjee, Mainak
Venkatasubramanian, Nalini
Ganguly, Samrat
Dynamic Adaptive Streaming over HTTP, MPEG-DASH, Microsoft Smooth Streaming, Adobe HTTP Dynamic Streaming, Evaluation, Apple HTTP Live Streaming, Mobile Networks, Vehicular Mobility
EN
Chapel Hill, North Carolina, USA
feb
37-42
https://www.itec.aau.at/bib/files/p37-mueller.pdf
ACM
2012.02.24
registered
An Evaluation of Dynamic Adaptive Streaming over HTTP in Vehicular Environments
2012
Multimedia streaming technologies based on the Hypertext Transfer Protocol (HTTP) are very popular and used by many content providers such as Netflix, Hulu, and Vudu. Recently, ISO/IEC MPEG has ratified Dynamic Adaptive Streaming over HTTP (DASH) which extends the traditional HTTP streaming with an adaptive component addressing the issue of varying bandwidth conditions that users are facing in networks based on the Internet Protocol (IP). Additionally, industry has already deployed several solutions based on such an approach which simplifies large scale deployment because the whole streaming logic is located at the client. However, these features may introduce drawbacks when multiple clients compete for a network bottleneck due to the fact that the clients are not aware of the network infrastructure such as proxies or other clients. This paper identifies these negative effects and the evaluation thereof using MPEG-DASH and Microsoft Smooth Streaming. Furthermore, we propose a novel adaptation algorithm introducing the concept of fairness regarding a cluster of clients. In anticipation of the results we can conclude that we achieve more efficient bottleneck bandwidth utilization and less quality switches.
San Diego, CA, USA
Mueller, Christopher
Lederer, Stefan
Timmerer, Christian
Proceedings of the IEEE Conference on Visual Communications and Image Processing Conference (VCIP 2012)
Aizawa, Kiyoharu
Kuo, Jay
Liu, Zicheng
EN
San Diego, USA
nov
6
https://www.itec.aau.at/bib/files/PID2500949.pdf
IEEE
2012.11.29
registered
A Proxy Effect Analysis and Fair Adaptation Algorithm for Multiple Competing Dynamic Adaptive Streaming over HTTP Clients
http://www.vcip2012.org
2012
Adaptive HTTP streaming got lot of attention in recent years and with dynamic adaptive streaming over HTTP (DASH) a standard is available. Many papers cover this topic and present their research results, but unfortunately all of them use their own private dataset which – in most cases – is not publicly available. Hence, it is difficult to compare, e.g., adaptation algorithms in an objective way due to the lack of a common dataset which shall be used as basis for such experiments. In this paper, we present our DASH dataset featuring our DASHEncoder, an open source DASH content generation tool. We also provide basic evaluations of the different segment lengths, the influence of HTTP server settings, and, in this context, we show some of the advantages as well as problems of shorter segment lengths.
New York, NY, USA
Lederer, Stefan
Mueller, Christopher
Timmerer, Christian
Proceedings of the Third Annual ACM SIGMM Conference on Multimedia Systems (MMSys12)
Claypool, Mark
Griwodz, Carsten
Mayer-Patel, Ketan
Dynamic Adaptive Streaming over HTTP, DASH, Dataset, Encoder, Content Generation Tool
EN
Chapel Hill, North Carolina, USA
feb
89-94
https://www.itec.aau.at/bib/files/p89-lederer.pdf
ACM
2012.02.22
registered
Dynamic Adaptive Streaming over HTTP Dataset
2012
Sophia Antipolis
Liu, Yaning
Geurts, Joost
Rainer, Benjamin
Lederer, Stefan
Mueller, Christopher
Timmerer, Christian
CCNx Community Meeting (CCNxConn 2012)
Carofiglio, Giovanna
CCN, DASH
EN
Sophia Antipolis, France
sep
1-1
https://www.itec.aau.at/bib/files/DashOverCCN.pdf
Parc
2012.09.12
registered
DASH over CCN: A CCN use-case for a Social Media based collaborative project
http://www.ccnx.org/ccnxcon2012/
2012
In this paper we demonstrate our MPEG-DASH evaluation suite, which comprises several components on the client side as well as on the server side. The major client components are the VLC DASH plugin, libDASH, and DASH-JS, a JavaScript-based DASH client. These tools enable performance tests on various platforms, e.g., Windows and Linux as well as mobile platforms such as Android. Moreover, due to their flexible structure it is possible to integrate adaptation logics and evaluate them under consistent conditions. On the server side we provide the content generation tool DASHEncoder, our MPEG-DASH datasets well as the MPEG-DASH conformance validator.
San Diego, CA, USA
Lederer, Stefan
Mueller, Christopher
Rainer, Benjamin
Waltl, Markus
Timmerer, Christian
Proceedings of the IEEE Conference on Visual Communications and Image Processing Conference (VCIP 2012)
Izquierdo, Ebroul
Wang, Xin
MPEG DASH, Open Source, Demo
EN
San Diego, USA
nov
1-1
https://www.itec.aau.at/bib/files/open-source_MPEG-DASH_evaluation_suite.pdf
IEEE
2012.11.29
registered
An open source MPEG DASH evaluation suite
http://www.vcip2012.org
2012
This paper presents our peer-assisted Dynamic Adaptive Streaming over HTTP (pDASH) proposal as well as an evaluation based on our DASH simulation environment in comparison to conventional approaches, i.e., non-peer-assisted DASH. Our approach maintains the standard conformance to MPEG-DASH enabling an easy and straightforward way of enhancing a streaming system with peer assistance to reduce the bandwidth and infrastructure requirements of the content/service provider. In anticipation of the results our system achieves a bandwidth reduction of Content Distribution Networks (CDN) and as a consequence the corresponding infrastructure costs of the content/service providers by up to 25% by leveraging the upstream capacity of neighboring peers. Furthermore, the cost savings have been evaluated using a cost model that is based on the current Amazon CloudFront pricing scheme. Furthermore, we have also evaluated the performance impact that various combinations of quality levels of the content could have in a peer-assisted streaming system as well as the client behavior in such an environment.
Munich, Germany
Lederer, Stefan
Mueller, Christopher
Timmerer, Christian
Proceedings of the 19th International Packet Video Workshop (PV 2012)
Guillemot, Christine
Chakareski, Jacob
Steinbach, Eckehard
Peer-Assisted Streaming, MPEG-DASH, Dynamic Adaptive Streaming over HTTP, CDN Bandwidth Reduction, Peer-to-Peer Streaming.
EN
Munich, Germany
may
1-6
https://www.itec.aau.at/bib/files/Paper53.pdf
IEEE
2012.05.10
registered
Towards Peer-Assisted Dynamic Adaptive Streaming over HTTP
2012
HTTP streaming has gained significant attraction in the last few years. Currently many commercial as well as standardized streaming systems are already offering adaptive streaming. In most cases, the adaptation is achieved by switching between separately encoded video streams in different qualities. In contrast to that, this paper focuses on the applicability of scalable video coding based on the H.264/SVC standard for adaptive HTTP streaming. Recent work has already highlighted the conceptual advantages like better cache utilization, fine-grained bit rate scalability, and lower storage requirements. This paper discusses the actual realization and design options for implementing priority streaming using the ISO Base Media File Format (BMFF). We propose three different strategies for organizing the scalable video bit stream that consider both the possibilities as well as limitations of the ISO BMFF. The proposed strategies are discussed and evaluated both conceptually and quantitatively. For that purpose, we provide a detailed analysis based on modeling both the overhead of the file format and the HTTP encapsulation. The results for all three priority streaming strategies show that the limitations of the ISO BMFF result in a high relative overhead in the case of low bit rate content. However, when applied to high quality content, priority streaming of H.264/SVC can be implemented at a very low cost. Depending on the number of layers and the offered scalability dimensions, different strategies should be chosen to minimize the overhead. Based on the analytical model and the discussion, this paper provides guidance for selecting the most efficient strategy.
Los Alamitos, CA, USA
Kofler, Ingo
Kuschnig, Robert
Hellwagner, Hermann
Proceedings of the 9th IEEE Consumer Communications and Networking Conference (CCNC)
Shirazi, Behrooz
EN
Las Vegas, NV, USA
jan
5
https://www.itec.aau.at/bib/files/Kofler_PriorityStreamingISOBMFF_preprint.pdf
IEEE
2012.01.14
registered
Implications of the ISO Base Media File Format on Adaptive HTTP Streaming of H.264/SVC
http://www.ieee-ccnc.org/2012/
2012
Existing and future media ecosystems need to cope with the ever-increasing heterogeneity of networks, devices, and user characteristics collectively referred to as (usage) context. The key to address this problem is media adaptation to various and dynamically changing contexts in order to provide a service quality that is regarded as satisfactory by the end user. The adaptation can be performed in many ways and at different locations, e.g., at the edge and within the network resulting in a substantial number of issues to be integrated within a media ecosystem. This paper describes research challenges, key innovations, target research outcomes, and achievements so far for edge and in-network media adaptation by introducing the concept of Scalable Video Coding (SVC) tunneling.
Los Alamitos, CA, USA
Grafl, Michael
Timmerer, Christian
Waltl, Markus
Xilouris, George
Zotos, Nikolaos
Renzi, Daniele
Battista, Stefano
Chernilov, Alex
Proceedings of the 2012 IEEE International Conference on Telecommunications and Multimedia (TEMU 2012)
http://dx.doi.org/10.1109/TEMU.2012.6294710
Pallis, Evangelos
Zacharopoulos, Vassilios
Kourtis, Anastasios
distributed adaptation decision-taking; SVC tunneling; research challenges; in-network adaptation; content-aware networking
EN
Heraklion, Greece
jul
6
https://www.itec.aau.at/bib/files/TEMU2012_mgrafl.pdf
IEEE
TEMU
2012.07.31
registered
Distributed Adaptation Decision-Taking Framework and Scalable Video Coding Tunneling for Edge and In-Network Media Adaptation
2012
The distribution of audio-visual content over the Internet has become very popular in recent years. However, due to the bandwidth requirements of videos in high definition, a costefficient distribution is desirable. In this paper we present a low-cost consumer electronics set-top box for streaming live video content using cost-efficient P2P networks. The main features of the set-top box include content discovery, highquality playback, easy user management, and social interaction.
Piscataway, NJ, USA
Yanmaz, Evsen
Kuschnig, Robert
Bettstetter, Christian
Proceedings of the GlobeCom 2010 (Wi-UAV Workshop)
How, Jonathan
Wietfeld, Christian
EN
dec
5
https://www.itec.aau.at/bib/files/WIUAV2011_Yanmaz.pdf
IEEE
none
Channel Measurements Over 802.11a-Based UAV-to-Ground Links
2011
The distribution of audio-visual content over the Internet has become very popular in recent years. However, due to the bandwidth requirements of videos in high definition, a costefficient distribution is desirable. In this paper we present a low-cost consumer electronics set-top box for streaming live video content using cost-efficient P2P networks. The main features of the set-top box include content discovery, highquality playback, easy user management, and social interaction.
Piscataway, NJ, USA
Yanmaz, Evsen
Kuschnig, Robert
Quaritsch, Markus
Bettstetter, Christian
Rinner, Bernhard
Proceedings of the IEEE Conference on Computer Communications Workshops, INFOCOM M2MCN, 2011
Ni, Lionel
Zhang, Wenjun
EN
Shanghai, China
apr
212-216
https://www.itec.aau.at/bib/files/p212-yanmaz.pdf
IEEE
2011.04.15
registered
On Path Planning Strategies for Networked Unmanned Aerial Vehicles
2011
This work presents a new dimension for Quality of Experience (QoE), i.e., sensory information. Sensory information enhances the user experience by providing additional so-called sensory effects (e.g., wind, light, vibration) which are rendered together with multimedia content. Furthermore, the work describes two subjective quality assessments conducted in this area including their results.
Los Alamitos, CA, USA
Waltl, Markus
Proceedings of the 12th IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM)
10.1109/WoWMoM.2011.5986375
Gerla, Mario
Mingozzi, Enzo
Chatterjee, Mainak
Passarella, Andrea
Sensory Information, MPEG-V, Subjective Quality Assessments, Quality of Experience
EN
Lucca, Italy
jun
3
https://www.itec.aau.at/bib/files/wowmom2011_mw.pdf
IEEE
2011.06.22
poster
The Next Dimension of Video Experience: Sensory Effects
2011
More and more multimedia content is becoming available via the World Wide Web (WWW). These contents stimulate only senses like hearing or vision. Recently, it has been proposed to stimulate also other senses while consuming multimedia content, through so-called sensory effects. These sensory effects aim at enhancing the user’s viewing experience by providing effects such as light, wind, vibration, etc. These effects are represented as Sensory Effect Metadata (SEM) which is associated to multimedia content and is rendered on devices like fans, lamps, or vibration chairs. In this paper, we present a plug-in for Web browsers which is able to render such sensory effects provided via Web content, and we describe a demonstrator that uses this plug-in to control an amBX system.
Los Alamitos, CA, USA
Waltl, Markus
Rainer, Benjamin
Timmerer, Christian
Hellwagner, Hermann
Proceedings of the Workshop on Multimedia on the Web (MMWeb) 2011
Böszörmenyi, Laszlo
Marques, Oge
Lux, Mathias
Klamma, Ralf
Quality of Experience, Sensory Experience, MPEG-V, Web Browser Plug-in, World Wide Web
EN
Graz, Austria
sep
1-3
https://www.itec.aau.at/bib/files/MMWeb2011_mwbrcthh.pdf
IEEE
2011.09.08
poster
Sensory Experience for Videos on the Web
2011
Kyoto, Japan
Szkaliczki, Tibor
Eberhard, Michael
Hellwagner, Hermann
Szobonya, Laszlo
7th Japanese-Hungarian Symposium on Discrete Mathematics and its Applications
Fukunaga, Takuro
Iwata, Satoru
Nagamochi, Hiroshi
Takazawa, Kenjiro
EN
Kyoto, Japan
may
419-426
https://www.itec.aau.at/bib/files/hj2011_sztibor_final.pdf
published on workshop homepage
2011.05.31
registered
Knapsack Problem and Piece Picking Algorithms for Layered Video Streaming
2011
The distribution of audio-visual content over the Internet has become very popular in recent years. However, due to the bandwidth requirements of videos in high definition, a costefficient distribution is desirable. In this paper we present a low-cost consumer electronics set-top box for streaming live video content using cost-efficient P2P networks. The main features of the set-top box include content discovery, highquality playback, easy user management, and social interaction.
Los Alamitos, CA, USA
Stuart, Mark
Buckham, Mike
Marsh, Richard
Eberhard, Michael
Ishmael, Johnathan
Needham, Chris
Timmerer, Christian
Proceedings of the 2011 IEEE International Conference on Multimedia and Expo (ICME 2011)
Cheng, Irene
Fernandez, Gabriel
Wang, Haohong
EN
Barcelona, Spain
jul
1
https://www.itec.aau.at/bib/files/icme_nextsharetv_demo.pdf
IEEE
2011.07.12
registered
NextShareTV: A Set-Top Box for Bittorrent-based Live Streaming
2011
Berlin, Heidelberg, New York
Quaritsch, Markus
Kuschnig, Robert
Hellwagner, Hermann
Rinner, Bernhard
Proceedings of the 8th International Conference on Information Systems for Crisis Response and Management (ISCRAM 2011)
Dugdale, Julie
Mendonça, David
EN
Lisbon, Portugal
may
5
https://www.itec.aau.at/bib/files/Quaritsch_ISCRAM2011.pdf
Springer
none
Fast Aerial Image Acquisition and Mosaicking for Emergency Response Operations by Collaborative UAVs
2011
Hall in Tyrol, Austria
Quaritsch, Markus
Kuschnig, Robert
Wischounig-Strucl, Daniel
Yahyanejad, Saeed
Mersheeva, Vera
Yanmaz, Evsen
Friedrich, Gerhard
Hellwagner, Hermann
Bettstetter, Christian
Rinner, Bernhard
Proceedings of the Austrian Robotics Workshop (ARW-11)
Hofbaur, Michael
Husty, Manfred
EN
Hall in Tyrol, Austria
may
3 3 3
https://www.itec.aau.at/bib/files/Quaritsch_ARW2011.pdf
UMIT
none
FAMUOS: A Multi-UAV System for Aerial Reconnaissance in Rescue Scenarios
2011
This paper describes the implementation of a VLC media player plugin enabling Dynamic Adaptive Streaming over HTTP (DASH). DASH is an emerging ISO/IEC MPEG and 3GPP standard for HTTP streaming. It aims to standardize formats enabling segmented progressive download by exploiting existing Internet infrastructure as such. Our implementation of these formats as described in this paper is based on the well-known VLC. Hence, it is fully integrated into the VLC structure and has been also submitted to the VLC development team for consideration in future releases of VLC. Therefore, it is licensed under the GNU Lesser General Public License (LGPL). The plugin provides a very flexible structure that could be easily extended with respect to different adaptation logics or profiles of the DASH standard. As a consequence, the plugin enables the integration of a variety of adaptation logics and comparison thereof, making it attractive for the research community.
New York, NY, USA
Mueller, Christopher
Timmerer, Christian
Proceedings of the 19th ACM international conference on Multimedia
10.1145/2072298.2072429
Candan, Kasim Selcuk
Panchanathan, Sethuraman
Prabhakaran, Balakrishnan
Sundaram, Hari
Feng, Wu-Chi
Sebe, Nicu
3GPP, DASH, HTTP streaming, MPEG, dynamic adaptive streaming over HTTP, video
EN
Scottsdale, Arizona, USA
nov
723-726
https://www.itec.aau.at/bib/files/p723-muller.pdf
ACM
MM
2011.11.29
registered
A VLC media player plugin enabling dynamic adaptive streaming over HTTP
2011
In this paper, we present a multimedia test-bed enabling session mobility in the context of the emerging ISO/IEC MPEG standard, Dynamic Adaptive Streaming over HTTP (DASH). In general, session mobility is defined as the transfer of a running streaming session from one device to another device where it may need to be consumed in an adaptive way. The two main challenges are: (1) taking into account the new context of the device (e.g., capabilities) to which the session is transferred and (2) performing the actual transfer in a seamless and interoperable way. Our system addresses both challenges supported by a prototype implementation integrated into VLC. In anticipation of the results we can conclude that interoperability is achieved adopting existing standards while the performance of the system does not depend on these standards. That is, the modules responsible for the performance are usually not defined within such standards and left out for competition. However, our system is designed in an extensible way and is able to accommodate this fact.
New York, NY, USA
Mueller, Christopher
Timmerer, Christian
Proceedings of the Second Annual ACM SIGMM Conference on Multimedia Systems (MMSys)
Mayer-Patel, Ketan
Begen, Ali
EN
San Jose, CA, USA
feb
271-276
https://www.itec.aau.at/bib/files/mueller_A_Test_Bed_for_DASH_featuring_Session_Mobility.pdf
ACM
2011.02.25
registered
A Test-Bed for the Dynamic Adaptive Streaming over HTTP featuring Session Mobility
2011
Adaptive video streaming based on TCP/HTTP is becoming popular because of its ability to adapt to changing network conditions. We present an in-depth experimental analysis of the use of HTTP-based request-response streams for video streaming. In this scheme, video fragments are fetched by a client from the server, in smaller units called chunks, potentially via multiple parallel HTT P requests (TCP connections). A model for the achievable throughput is formulated.The model is validated by a broad range of streaming experiments, including an evaluation of TCP-friendliness. Our findings include that request-response streams are able to scale with the available bandwidth by increasing the chunk size or the number of concurrent streams. Several combinations of system parameters exhibiting TCP-friendliness are presented. We also evaluate the video streaming performance in terms of video quality in the presence of packet loss. Multiple request-response streams are able to maintain satisfactory performance, while a single TCP connection deteriorates rapidly with increasing packet loss. The results provide experimental evidence that HTTP-based request-response streams are a good alternative to classical TCP streaming
New York, NY, USA
Kuschnig, Robert
Kofler, Ingo
Hellwagner, Hermann
Proceedings of the Second Annual ACM SIGMM Conference on Multimedia Systems (MMSys)
10.1145/1943552.1943585
Mayer-Patel, Ketan
Begen, Ali
EN
San Jose, CA, USA
feb
245-256
https://www.itec.aau.at/bib/files/mmsys11_kuschnig_preprint.pdf
ACM
2011.02.25
registered
Evaluation of HTTP-based request-response streams for internet video streaming
2011
Wireless router platforms based on the Linux operating system are becoming popular in consumers' home networks. The transmission of multimedia data or their use as media-aware network elements imposes high traffic and computational loads on these devices. Thus, it is interesting to evaluate the networking and processing capabilities of such home router platforms in order to assess their usefulness for improved multimedia services such as in-network H.264/SVC video stream adaptation. This paper presents a performance evaluation of three home router platforms representative for low-end, mid-range, and high-end devices. The scope of the evaluation is the performance of the Linux networking stack on these routers; results for both application-layer (TCP and UDP) transmission and kernel-level (UDP) traffic routing are given. The results show that both TCP and UDP throughputs are significantly below (less than half of) the outgoing (wired) links' nominal capacities and depend very much on the sizes of the transmitted data blocks. This clearly indicates that the networking performance is limited by the platforms' processing capabilities and the lack of mechanisms that offload networking tasks from the CPUs. This behaviour cannot be observed on today's PC systems and has to be considered when deploying multimedia services on these network devices. Furthermore, a detailed analysis of the Linux networking stack reveals that the performance is heavily impacted by the netfilter code, even when no packet filtering or network address translation is being performed. Considerable performance gains can be achieved when this netfilter code is bypassed.
Los Alamitos, CA, USA
Kofler, Ingo
Kuschnig, Robert
Hellwagner, Hermann
Proceedings of the 2011 IEEE International Conference on Multimedia and Expo (ICME 2011)
10.1109/ICME.2011.6012189
Cheng, Irene
Fernandez, Gabriel
Wang, Haohong
EN
Barcelona, Spain
jul
6
https://www.itec.aau.at/bib/files/platformeval_preprint.pdf
IEEE
ICME
2011.07.11
registered
Evaluating the Networking Performance of Home Router Platforms for Multimedia Services
2011
In this paper, we present an approach for in-network adaptation of H.264/SVC in the context of 802.11 wireless networks. It builds upon our previous work on an adaptive RTSP/RTP proxy which allows to adapt video streams on Linux-based home router platforms. The proposed approach tackles the throughput variations that occur as a consequence of the physical rate adaptation in 802.11 equipment caused by the mobility of clients. By combining monitoring information available exclusively on the wireless router with the ability to adapt scalable video streams on-the-fly, the proposed in-network adaptation approach allows to quickly adjust the video bit rate to the current link conditions. Instead of reacting on packet loss, our approach uses an increase in queueing delay at the router to detect phases of throughput degradation. This allows a higher responsiveness compared to traditional end-to-end approaches that rely solely on RTCP feedback. The behavior of our novel approach was evaluated in several mobility scenarios in an experimental test bed. The results obtained by streaming and adapting high-definition content clearly demonstrate the feasibility and benefits of this approach.
New York, NY, USA
Kofler, Ingo
Kuschnig, Robert
Hellwagner, Hermann
Proceedings of the 21st International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV 2011)
10.1145/1989240.1989245
Krasic, Charles
Li, Kang
EN
Vancouver, Canada
jun
9-14
https://www.itec.aau.at/bib/files/NOSSDAV2011_Preprint.pdf
ACM
NOSSDAV
2011.06.02
registered
In-Network Adaptation of H.264/SVC for HD Video Streaming Over 802.11g Networks
2011
Today's omnipresent demand for access to multimedia content via diverse devices places new challenges on efficient content delivery. This work introduces the concept of Scalable Video Coding (SVC) tunneling developed in the EU FP7 ALICANTE project and shows that the quality impact of the transcoding steps for a transcoding chain from MPEG-2 to SVC and back to MPEG-2 accumulates to a PSNR reduction of up to 2.1 dB for transcoding at fixed target bitrate points. We also discuss research challenges and open issues in SVC tunneling.
Los Alamitos, CA, USA
Grafl, Michael
Proceedings of the 12th IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM)
10.1109/WoWMoM.2011.5986152
Gerla, Mario
Mingozzi, Enzo
Chatterjee, Mainak
Passarella, Andrea
Content-aware networking; scalable video coding; SVC tunneling; transcoding; multimedia distribution
EN
Lucca, Italy
jun
3
https://www.itec.aau.at/bib/files/WoWMoM2011_mgrafl.pdf
IEEE
2011.06.22
poster
SVC Tunneling for Media-Aware Content Delivery: Impact on Video Quality
2011
Today's omnipresent demand for access to multimedia content via diverse devices places new challenges on efficient content delivery. While the Scalable Video Coding (SVC) extension of Advanced Video Coding (AVC) has proven to be a useful tool for the advanced delivery of video content, it has not yet found major adoption in practice. This paper introduces the concept of SVC tunneling developed in the EU FP7 ALICANTE project, which attempts to provide device-independent access to media resources at reduced network load. For SVC tunneling, video transcoding is performed at the ingress/egress points of the network, which may impact the video quality. We show that the quality impact of these transcoding steps for a transcoding chain from MPEG-2 to SVC and back to MPEG-2 accumulates to a PSNR reduction of up to 2.1 dB for transcoding at fixed target bitrates. We also discuss research challenges and open issues in SVC tunneling.
Los Alamitos, CA, USA
Grafl, Michael
Timmerer, Christian
Hellwagner, Hermann
Proceedings of the 2011 IEEE International Conference on Multimedia and Expo (ICME 2011)
10.1109/ICME.2011.6012239
Cheng, Irene
Fernandez, Gabriel
Wang, Haohong
Content-aware networking; scalable video coding; quality of service; SVC tunneling; transcoding; multimedia distribution
EN
Barcelona, Spain
jul
4
https://www.itec.aau.at/bib/files/WoMAN2011_paper_209.pdf
IEEE
ICME
2011.07.11
registered
Quality Impact of Scalable Video Coding Tunneling for Media-Aware Content Delivery
2011
Los Alamitos, CA, USA
Eberhard, Michael
Hellwagner, Hermann
Timmerer, Christian
Szkaliczki, Tibor
Szobonya, Laszlo
Proceedings of the 2011 IEEE International Conference on Multimedia and Expo (ICME 2011)
Cheng, Irene
Fernandez, Gabriel
Wang, Haohong
EN
Barcelona, Spain
jul
1-6
https://www.itec.aau.at/bib/files/icme2011_piece-picking.pdf
IEEE
ICME
2011.07.11
registered
An evaluation of piece-picking algorithms for layered content in Bittorrent-based peer-to-peer systems
2011
The term Universal Multimedia Experience (UME) has gained momentum and is well recognized within the research community. As this approach puts the user into the center stage, additional complexity is added to the overall quality assessment problem which calls for a scientific framework to capture, measure, quantify, judge, and explain the user experience. In previous work we have proposed the annotation of multimedia content with sensory effect metadata that can be used to stimulate also other senses than vision or audition. In this paper we report first results obtained from subjective tests in the area of sensory effects attached to traditional multimedia presentations such as movies that shall lead to an enhanced, unique, and worthwhile user experience.
Los Alamitos, CA, USA
Waltl, Markus
Timmerer, Christian
Hellwagner, Hermann
Proceedings of the 11th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS'10)
Leonardi, Riccardo
Migliorati, Pierangelo
Cavallaro, Andrea
9781424478484
Sensory Information, MPEG-V
EN
Desenzano del Garda, Italy
apr
1-4
https://www.itec.aau.at/bib/files/wiamis2010_mwcthh.pdf
IEEE
2010.04.13
poster
Increasing the User Experience of Multimedia Presentations with Sensory Effects
2010
In previous and related work sensory effects are presented as a tool for increasing the user experience of multimedia presentations by stimulating also other senses than vision or audition. In this paper we primarily investigated the relationship of the Quality of Experience (QoE) due to various video bit-rates of multimedia contents annotated with sensory effects (e.g., wind, vibration, light). Therefore, we defined a subjective quality assessment methodology based on standardized methods. The paper describes the test environment, its setup, and conditions in detail. Furthermore, we experimented with a novel voting device that allows for continuous voting feedback during a sequence in addition to the overall quality voting at the end of each sequence. The results obtained from the subjective quality assessment are presented and discussed thoroughly. In anticipation of the results we can report an improvement of the quality of the multimedia experience thanks to the sensory effects.
Los Alamitos, CA, USA
Waltl, Markus
Timmerer, Christian
Hellwagner, Hermann
Proceedings of the 2nd International Workshop on Quality of Multimedia Experience (QoMEX'10)
10.1109/QOMEX.2009.5246962
Perkis, Andrew
Möller, Sebastian
Svensson, Peter
Reibman, Amy
9781424469581
Sensory Information, MPEG-V
EN
Trondheim, Norway
jun
124-129
https://www.itec.aau.at/bib/files/qomex2010_mwcthh.pdf
IEEE
2010.06.21
poster
Improving the Quality of Multimedia Experience through Sensory Effects
http://www.qomex2010.org
2010
In the past years the amount of multimedia content on the Internet or in home networks has been drastically increasing. Instead of buying traditional media (such as CDs or DVDs) users tend to buy online media. This leads to the difficulty of managing the content (e.g., movies, images). A vast amount of tools for content management exists but they are mainly focusing on one type of content (e.g., only images). Furthermore, most of the available tools are not configurable to the user’s preferences and cannot be accessed by different devices (e.g., TV, computer, mobile phone) in the home network. In this paper we present a UPnP A/V-based system for managing and sharing audio/visual content in home environments which is configurable to the user’s preferences. Furthermore, the paper depicts how this system can be used to improve the user experience by using MPEG-V.
Berlin, Heidelberg, New York
Waltl, Markus
Raffelsberger, Christian
Timmerer, Christian
Hellwagner, Hermann
Proceedings CD of the 2nd International ICST Conference on User Centric Future Media Internet
Alvarez, Federico
Costa, Cristina
9789639995000
Sensory Information, MPEG-V
EN
Palma de Mallorca, Spain
sep
1-9
https://www.itec.aau.at/bib/files/ucmedia2010_mwcrcthh.pdf
Springer Verlag GmbH
2010.09.01
registered
Metadata-based Content Management and Sharing System for Improved User Experience
2010
The World Wide Web (WWW) is one of the main entry points to access and consume Internet content in various forms. In particular, the Web browser is used to access different types of media (i.e., text, image, audio, and video) and on some platforms is the only way to access the vast amount of information on the Web. Recently, it has been proposed to stimulate also other senses than vision or audition while consuming multimedia content through so- called sensory effects, with the aim to increase the user’s Quality of Experience (QoE). The effects are represented as Sensory Effects Metadata (SEM) which is associated to traditional multimedia content and is rendered (synchronized with the media) on sensory devices like fans, vibration chairs, lamps, etc. In this paper we provide a principal investigation of whether the sensory effects are ready for the WWW and, in anticipation of the result, we propose how to embed sensory effect metadata within Web content and the synchronized rendering thereof.
Aachen, Germany
Timmerer, Christian
Waltl, Markus
Hellwagner, Hermann
Proceedings of the Workshop on Interoperable Social Multimedia Applications (WISMA 2010)
Carreras, Anna
Delgado, Jaime
Maroñas, Xavier
Rodríguez, Víctor
MPEG-V
EN
Barcelona, Spain
may
57-60
https://www.itec.aau.at/bib/files/MPEG-V_v2.1.pdf
CEUR Workshop Proceedings (CEUR-WS.org)
2010.05.19
registered
Are Sensory Effects Ready for the World Wide Web?
2010
In this paper we describe a metadata solution for a Peer-to-Peer (P2P) content distribution system termed NextShare. We outline the key motivating factors for our approach, detail the overall generic architecture we have developed and present the workflow for delivering metadata through Peer-to-Peer based content distribution. The paper also presents the metadata model we have developed and we describe in detail how all the content can be packetized and distributed using NextShare. Finally, a description of the core and optional metadata attributes which may be utilized within the system is provided.
Aachen, Germany
Timmerer, Christian
Eberhard, Michael
Grafl, Michael
Mitchell, Keith
Dutton, Sam
Hellwagner, Hermann
Proceedings of the Workshop on Interoperable Social Multimedia Applications (WISMA 2010)
Carreras, Anna
Delgado, Jaime
Maroñas, Xavier
Rodríguez, Víctor
Metadata, peer-to-peer streaming, social networks, payment and cashing, advertisements, MPEG-21 Digital Item, API.
EN
Barcelona, Spain
may
8
https://www.itec.aau.at/bib/files/P2P-Metadata_v2.0.pdf
CEUR Workshop Proceedings (CEUR-WS.org)
2010.05.19
registered
A Metadata Model for Peer-to-Peer Media Distribution
http://www.multimedia-metadata.info/Members/ralf/callforpapers.2010-02-01.6353762208
2010
MPEG has developed various technologies for multimedia transport, such as MPEG-2 Transport Stream (TS) and ISO Media Base File Format. These technologies have been widely accepted and heavily used by various industries and applications, such as digital broadcasting, audio and video transport over the Internet, mobile phones, etc. In recent years, the Internet has become an important channel for the delivery of multimedia. As HTTP is widely used on the Internet, it has recently been used extensively for the delivery of multimedia content. However, there is no standard for HTTP- based streaming of MPEG media. MPEG intends to standardize a solution that addresses this need. This paper provides an overview of the recent Call of Proposals (CfP) for HTTP Streaming of MPEG Media, a new work item within ISO/IEC MPEG. In particular, it will provide an overview of existing systems and the outcome of the evaluation of the aforementioned CfP which has been conducted during the 93rd MPEG meeting in July 2010.
Agrate B.za, Italy
Timmerer, Christian
Mueller, Christopher
Proceedings of STreaming Day 2010
Bernardini, Riccardo
Rovati, Fabrizio
HTTP Streaming
EN
Udine, Italy
oct
4
https://www.itec.aau.at/bib/files/STDay-2010-v1.1.pdf
Rovati, Fabrizio
2010.09.17
registered
HTTP Streaming of MPEG Media
2010
The demand for access to advanced, distributed media resources is nowadays omnipresent due to the availability of Internet connectivity almost anywhere, anytime, and with a huge amount of different devices. This calls for rethinking of the current Internet architecture by making the network aware of which content is actually transported. This paper introduces Scalable Video Coding (SVC) as a tool for Content-Aware Networks (CANs) which is currently researched as part of the EU FP7 ALICANTE project. The architecture of ALICANTE with respect to SVC and CAN is reviewed, use cases are described, and, finally, research challenges and open issues are discussed.
New York, NY, USA
Timmerer, Christian
Grafl, Michael
Hellwagner, Hermann
Negru, Daniel
Borcoci, Eugen
Renzi, Daniel
Mevel, Anne-Lore
Chernilov, Alex
Proceedings of the International Tyrrhenian Workshop on Digital Communications (ITWDC)
Blefari-Melazzi, Nicola
EN
Island of Ponza, Italy
sep
11
https://www.itec.aau.at/bib/files/SVC4CAN_v1.0.pdf
Springer
2010.09.08
registered
Scalable Video Coding in Content-Aware Networks: Research Challenges and Open Issues
2010
The aim of the MPEG‐21 standard, the so‐called Multimedia Framework, is to enable transparent and augmented use of multimedia resources across a wide range of networks, devices, user preferences, and communities, notably for trading (of bits). As such, it provides an important step in MPEG's standards evolution, i.e., the transaction of Digital Items among Users. This paper provides an overview of applications making use specifically of MPEG‐21 Digital Items and a more in‐depth presentation of a few selected applications in research and practice.
New York, NY, USA
Timmerer, Christian
Hellwagner, Hermann
Proceedings of the 1st International Digital Preservation Interoperability Framework Symposium
10.1145/2039263.2039271
Chang, Wo
DANAE, ENTHRONE, MPEG-21, P2P-Next, UPnP, application, digital item, digital library, usage
EN
Dresden, Germany
apr
8:1-8:8
https://www.itec.aau.at/bib/files/a8-timmerer.pdf
ACM
INTL-DPIF
https://www.itec.aau.at/bib/files/DPIF2010_v1.0.pdf
2010.04.22
registered
MPEG-21 digital items in research and practice
2010
In this tutorial we present immersive future media technologies ranging from 3D video to sensory experiences. The former targets stereo and multi-view video technologies whereas the latter aims at stimulating other senses than vision or audition enabling an advanced user experiences through sensory effects.
New York, NY, USA
Timmerer, Christian
Müller, Karsten
Proceedings of the International Conference on Multimedia (MM '10)
10.1145/1873951.1874369
del Bimbo, Alberto
Chang, Shih-Fu
Smeulders, Arnold
Measurement, Experimentation, Human Factors, Standardization, Immersive Media, 3D Video, Stereo Video, Multi-view Video, Sensory Effects, MPEG-V, Quality of Experience
EN
Florence, Italy
oct
1781-1782
https://www.itec.aau.at/bib/files/tut08x-timmerer.pdf
ACM
2010.10.25
registered
Immersive Future Media Technologies: From 3D Video to Sensory Experiences
http://doi.acm.org/10.1145/1873951.1874369
2010
The Scalable Video Coding (SVC) extension of the H.264/AVC (AVC) video coding standard features spatial, quality and temporal scalability. Backwards compatibility with legacy decoding devices is maintained through an H.264/AVC compliant base layer, which represents the lowest quality of an SVC bit-stream. However, it is often desirable to also provide the higher quality layers to legacy H.264/AVC devices. This is achieved by a process commonly known as “bit-stream rewriting”, which allows for an efficient SVC to AVC conversion by exploiting the similarities of the two codecs. This paper introduces an improved version of the existing JSVM reference software rewriter (JSVM-rewriter). The improvements include a better run-time performance through parallel processing, as well as applicability in streaming scenarios. A detailed evaluation provides performance measurements for the improved rewriter and compares it to the existing JSVM-rewriter. The evaluation shows that notable performance improvements can be achieved using the presented approach. The paper concludes on how the rewriter could be further improved.
Los Alamitos, CA, USA
Sablatschan, Michael
Ransburg, Michael
Hellwagner, Hermann
Proceedings of the Second International Conferences on Advances in Multimedia (MMEDIA 2010)
10.1109/MMEDIA.2010.27
Böszörmenyi, Laszlo
Burdescu, Dumitru
Davis, Philip
Stanchev, Peter
EN
Athens, Greece
jun
18-21
https://www.itec.aau.at/bib/files/Towards_an_Improved_SVC2AVCRewriter_MMEDIA2010_Sablatschan.pdf
IEEE
2010.06.14
registered
Towards an Improved SVC-to-AVC Rewriter
http://www.iaria.org/conferences2010/MMEDIA10.html
2010
This paper compares handhelds based on the iPhone and Android operating systems in multimedia streaming scenarios. We simulate typical Internet network impairments, i.e. packet delay and packet loss, and evaluate their effects on the end devices. Additional evaluations include bandwidth overhead in icted by the different streaming approaches and traffic shape and fairness when both handhelds consume media simultaneously. Based on the quantitative evaluation, both approaches show weaknesses and strengths. A final qualitative discussion points out additional advantages for the streaming approach implemented in the iPhone operating system.
Heidelberg/Berlin, Germany
Ransburg, Michael
Jonke, Mario
Hellwagner, Hermann
Proceedings of the First Workshop on Mobile Multimedia Networking (IWMMN 2010)
10.1007/978-3-642-17758-3_31
Wang, Honggang
Xia, Jinchun
EN
Chicago, IL, USA
jun
14
https://www.itec.aau.at/bib/files/Ransburg_IWMMN10.pdf
Springer
2010.06.30
registered
An Evaluation of Mobile End Devices in Multimedia Streaming Scenarios
http://www.mobilware.org/2010/
2010
H.264/SVC enables runtime-efficient scalability in the spatial, temporal and fidelity dimension. Existing adaptation mechanisms facilitate this to automatically adapt the H.264/ SVC stream to the current usage environment without any user interaction. This paper argues that the Quality of Experience (QoE) of the end user can be enhanced by enabling him to manually adjust the adaptation if he wishes to do so. An approach which enables this is presented and evaluated. It is shown that by facilitating this approach an increased QoE is provided compared to automatic adaptation approaches. Finally, future work indicates the next steps in order to implement this approach.
Tampere, Finland
Ortiz Murillo, Jordi
Ransburg, Michael
Martínez Graciá, Eduardo
Sablatschan, Michael
Gómez Skarmeta, Antonio
Hellwagner, Hermann
Proceedings of the Workshop on Quality of Experience for Multimedia Content Sharing (QoEMCS 2010)
Buchinger, Shelley
Lopes, Rui Jorge
Jumisko-Pyykkö, Satu
Zepernick, Hans-Jürgen
EN
jun
4
https://www.itec.aau.at/bib/files/Towards User-driven Adaptation of H.264-SVC Streams.pdf
Tampere University of Technology
none
Towards User-driven Adaptation of H.264/SVC Streams
http://dcti.iscte.pt/events/qoemcs/
2010
Recent work in TCP video streaming indicates that multimedia streaming via TCP provides satisfactory performance when the achievable TCP throughput is approximately twice the media bit rate. However, these conditions may not be achievable on the Internet, e.g., when the delivery path offers insufficient bandwidth or becomes congested due to competing traffic. Therefore, adaptive streaming for videos over TCP is required and a number of rate-control algorithms for video streaming have been proposed and evaluated in the literature. In this paper, we evaluate and compare three existing rate-control algorithms for TCP streaming in terms of the (PSNR) quality of the delivered video and in terms of the timeliness of delivery. The contribution of the paper is that, to the best of our knowledge, this is the first evaluation of TCP-based streaming in an Internet-like setting making use of the scalability features of the H.264/SVC video codec. Two simple bandwidth estimation algorithms and a priority-/deadline-driven approach are described to adapt the bit rates of, and transmit, the H.264/SVC video in a rate-distortion optimal manner. The results indicate that the three algorithms perform robustly in terms of video quality and timely delivery, both on under-provisioned links and in case of competing TCP flows. The priority-/deadline-driven technique is even more stable in terms of packet delays and jitter; thus, client buffers can be dimensioned more easily.
New York, NY, USA
Kuschnig, Robert
Kofler, Ingo
Hellwagner, Hermann
Proceedings of the First Annual ACM SIGMM Conference on Multimedia Systems (MMSys)
10.1145/1730836.1730856
Feng, Wu-chi
Mayer-Patel, Ketan
EN
Scottsdale, AZ, USA
feb
157-168
https://www.itec.aau.at/bib/files/MMSYS10_Kuschnig_Evaluation_TCP_based_Rate_Control.pdf
ACM
2010.02.23
registered
An Evaluation of TCP-based Rate-control Algorithms for Adaptive Internet Streaming of H.264/SVC
http://www.mmsys.org
2010
TCP-based video streaming encounters difficulties in unreliable networks with unanticipated packet loss. In combination with high round trip times, the effective throughput deteriorates rapidly and TCP connection resets or stalls may occur. In this paper, we propose a client-driven video transmission scheme which utilizes multiple HTTP/TCP streams. The scheme is largely insensitive to unanticipated packet loss and thereby reduces throughput fluctuations. Since it is based on HTTP, the scheme can easily be deployed in existing network infrastructures. It fosters scalability on the server side by shifting complexity from the server to the clients. Certain features of request-response schemes allow maintaining fairness, despite of using multiple HTTP streams. Making use of TCP, the scheme inherently adapts to congested network links.
Los Alamitos, CA, USA
Kuschnig, Robert
Kofler, Ingo
Hellwagner, Hermann
Proceedings of the 7th IEEE Consumer Communications and Networking Conference (CCNC)
10.1145/1730836.1730856
Balandin, Sergey
Matuszewksi, Marcin
Ott, Jörg
EN
Las Vegas, NV, USA
jan
5
https://www.itec.aau.at/bib/files/CCNC10_Kuschnig_Request_Response_Streams.pdf
IEEE
2010.01.10
registered
Improving Internet Video Streaming Performance by Parallel TCP-Based Request-Response Streams
http://www.ieee-ccnc.org/2010
2010
The distribution of layered content over peer-to-peer networks becomes more important today as the users are consuming the content on terminals with various display capabilities and different network connections. For single-layer content distribution, the piece-picking algorithm only needs to ensure that content pieces are downloaded in time for display. When layered content is distributed over a peer-to-peer network, the piece-picking algorithm needs to be modified to ensure that the best possible quality is displayed while all desired pieces still have to be received before their deadline expires. In this paper, the piece-picking problem for layered content is analyzed and a number of piece-picking algorithms for layered content based on the solutions for the knapsack problem are presented. Furthermore, an evaluation of these algorithms is performed and possible applications are discussed.
New York, NY, USA
Eberhard, Michael
Szkaliczki, Tibor
Hellwagner, Hermann
Szobonya, László
Timmerer, Christian
Proceedings of the 2010 ACM Workshop on Advanced Video Streaming Techniques for Peer-to-Peer Networks and Social Networking
10.1145/1877891.1877908
Olmo, Gabriella
Timmerer, Christian
Frossard, Pascal
Mitchell, Keith
978-1-4503-0169-5
knapsack problem, layered/scalable content, piece utility calculation, piece-picking
EN
Firenze, Italy
oct
71-76
https://www.itec.aau.at/bib/files/avst1524-eberhard.pdf
ACM
AVSTP2P
2010.10.29
poster
Knapsack Problem-based Piece-Picking Algorithms for Layered Content in Peer-to-Peer Networks
http://www.p2pstreaming.eu
2010
Peer-to-Peer systems are nowadays a very popular solution for multimedia distribution, as they provide significant cost benefits compared with traditional server-client distribution. Additionally, the distribution of scalable content enables the consumption of the content in a quality suited for the available bandwidth and the capabilities of the end-user devices. Thus, the distribution of scalable content over Peer-to-Peer networks is a very actual research topic. This paper presents an architecture for the distribution of scalable content in a fully distributed Peer-to-Peer network. The architectural description includes how the scalable layers of the content are mapped to the pieces distributed in the Peer-to-Peer system and detailed descriptions of the producer- and consumer-site architecture of the system. The presented system is to our knowledge the first open-source Peer-to-Peer network with full Scalable Video Coding support.
Los Alamitos, CA, USA
Capovilla, Nicola
Eberhard, Michael
Mignanti, Silvano
Petrocco, Riccardo
Vehkaperä, Janne
Proceedings of the Second International Conferences on Advances in Multimedia (MMEDIA 2010)
10.1109/MMEDIA.2010.17
Böszörmenyi, Laszlo
Burdescu, Dumitru
Davis, Philip
Stanchev, Peter
P2P networks;consumer-site architecture;distributed peer-to-peer network;multimedia distribution;open-source peer-to-peer network;scalable video coding;server-client distribution;image coding;multimedia computing;peer-to-peer computing;
EN
Athens, Greece
jun
1-6
https://www.itec.aau.at/bib/files/MMEDIA'10_Eberhard.pdf
IEEE
2010.06.14
registered
An Architecture for Distributing Scalable Content over Peer-to-Peer Networks
http://www.iaria.org/conferences2010/MMEDIA10.html
2010
This paper proposes a novel virtual Content-Aware Network (CAN) layer as a part of a full layered architecture, focused, but not limited to, on multimedia distribution with Quality of Services (QoS) assurance. The overall system is based on a flexible cooperation between providers, operators and end-users, enabling users to access the offered multimedia services in various contexts and also to become private content providers. The paper introduces the main concepts and architecture for the main virtual network layer (i.e., CAN), exposing its role and interfaces among overall system layers. This work is a part of the starting effort inside of a new European FP7 ICT research project, ALICANTE.
Los Alamitos, CA, USA
Borcoci, Eugen
Negru, Daniel
Timmerer, Christian
Proceedings of the 3rd International Conference on Communication Theory, Reliability, and Quality of Service (CTRQ 2010)
10.1109/CTRQ.2010.35
Ata, Shingo
Borcoci, Eugen
Del Ser Lorente, Javier
Diaz, Michel
Pioro, Michal
Rodrigues, Joel
Segall, Zary
content-aware networking, network aware applications, quality of services, multimedia distribution, Future Internet
EN
jun
162-168
https://www.itec.aau.at/bib/files/05532769.pdf
IEEE
none
A Novel Architecture for Multimedia Distribution based on Content-Aware Networking
http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5532769&isnumber=5532402
2010
This paper introduces a prototype test-bed for triggering sensory effects like light, wind, or vibration when presenting audiovisual resources, e.g., a video, to users. The ISO/IEC MPEG is currently standardizing the Sensory Effect Description Language (SEDL) for describing such effects. This language is briefly described in the paper and the testbed that is destined to evaluate the quality of the multimedia experience of users is presented. It consists of a video annotation tool for sensory effects, a corresponding simulation tool, and a real test system. Initial experiments and results on determining the color of light effects from the video content are reported.
Los Alamitos, CA, USA
Waltl, Markus
Timmerer, Christian
Hellwagner, Hermann
Proceedings of the First International Workshop on Quality of Multimedia Experience (QoMEX 2009)
10.1109/QOMEX.2009.5246962
Ebrahim, Touradj
El-Maleh, Khaled
Dane, Gokce
Karam, Lina
978-1-4244-4370-3
978-1-4244-43
Sensory Information, MPEG-V
EN
San Diego, CA
jul
145-150
https://www.itec.aau.at/bib/files/qomex2009_mwcthh.pdf
IEEE
2009.07.31
registered
A Test-Bed for Quality of Multimedia Experience Evaluation of Sensory Effects
http://www.qomex2009.org
2009
Virtual worlds (often referred to as 3D3C for 3D visualization & navigation and the 3C’s of Community, Creation and Commerce) integrate existing and emerging (media) technologies (e.g. instant messaging, video, 3D, VR, AI, chat, voice, etc.) that allow for the support of existing and the development of new kinds of networked services. The emergence of virtual worlds as platforms for networked services is recognized by businesses as an important enabler as it offers the power to reshape the way companies interact with their environments (markets, customers, suppliers, creators, stakeholders, etc.) in a fashion comparable to the Internet and to allow for the development of new (breakthrough) business models, services, applications and devices. Each virtual world however has a different culture and audience making use of these specific worlds for a variety of reasons. These differences in existing Metaverses permit users to have unique experiences. In order to bridge these differences in existing and emerging Metaverses a standardized framework is required, i.e., MPEG-V Media Context and Control (ISO/IEC 23005), that will provide a lower entry level to (multiple) virtual worlds both for the provider of goods and services as well as the user. The aim of this paper is to provide an overview of MPEG-V and its intended standardization areas. Additionally, a review about MPEG-V’s most advanced part – Sensory Information – is given.
Heidelberg
Timmerer, Christian
Gelissen, Jean
Waltl, Markus
Hellwagner, Hermann
Proceedings of the 2009 NEM Summit
Hrasnica, Halid
9783000289538
MPEG-V
EN
sep
118-123
https://www.itec.aau.at/bib/files/nem2009_ctjgmwhh.pdf
Eurescom – the European Institute for Research and Strategic Studies in Telecommunications – GmbH
none
Interfacing with Virtual Worlds
http://www.nem-summit.eu
2009
Nowadays, mobile devices have implemented several transmission technologies which enable access to the Internet and increase the bit rate for data exchange. Despite modern mobile processors and high-resolution displays, mobile devices will never reach the stage of a powerful notebook or desktop system (for example, due to the fact of battery powered CPUs or just concerning the smallsized displays). Due to these limitations, the deliverable content for these devices should be adapted based on their capabilities including a variety of aspects (e.g., from terminal to network characteristics). These capabilities should be described in an interoperable way. In practice, however, there are many standards available and a common mapping model between these standards is not in place. Therefore, in this paper we describe such a mapping model and its implementation aspects. In particular, we focus on the whole delivery context (i.e., terminal capabilities, network characteristics, user preferences, etc.) and investigated the two most prominent state-of-the-art description schemes, namely User Agent Profile (UAProf) and Usage Environment Description (UED).
Aachen, Germany
Timmerer, Christian
Jaborning, Johannes
Hellwagner, Hermann
Proceedings of the 9th Workshop on Multimedia Metadata (WMM'09)
Klamma, Ralf
Grigoras, Romulus
Charvillat, Vincent
Kosch, Harald
EN
mar
18
https://www.itec.aau.at/bib/files/DC-paper-v.2.pdf
http://ceur-ws.org
none
A Comparison and Mapping Model
http://ceur-ws.org/Vol-441/pxx.pdf
2009
We describe an approach for viewing any large, detail-rich picture on a small display by generating a video from the image, as taken by a virtual camera moving across it at varying distance. Our main innovation is the ability to build the virtual camera's motion from a textual description of a picture, e.g., a museum caption, so that relevance and ordering of image regions are determined by co-analyzing image annotations and natural language text. Furthermore, our system arranges the resulting presentation such that it is synchronized with an audio track generated from the text by use of a text-to-speech system.
Berlin, Heidelberg, New York
Reiterer, Bernhard
Concolato, Cyril
Hellwagner, Hermann
Proceedings of 1st International ICST Conference on User Centric Media - UCMedia 2009
Daras, Patros
Chlamtac, Imrich
9789639799844
image adaptation - text analysis - image annotation - digital cultural heritage - computer animation
EN
dec
4 - CD
Springer
LNICST - Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering
none
Natural-Language-based Conversion of Images to Mobile Multimedia Experiences
http://www.usercentricmedia.org/index.shtml
2009
In this paper, we present an approach for presenting large, feature-rich pictures on small displays by generating an animation and subsequently a video from the image, as it could be taken by a virtual camera moving across the image. Our main innovation is the ability to build the virtual camera's motion upon a textual description of a picture, as from a museum caption, so that relevance and ordering of image regions is determined by co-analyzing image annotations and text. Furthermore, our system can arrange the resulting presentation in a way that it is synchronized with an audio track generated from the text by use of a text-to-speech system.
Geneva
Reiterer, Bernhard
Hellwagner, Hermann
Proceedings International InterMedia Summer School 2009
Nadia, Magnenat-Thalmann
Seunghyun, Han
Dimitris, Potopsaltou
image adaptation, text parsing, image annotation, digital cultural heritage, computer animation
EN
jun
24-32
MIRALab at University of Geneva
International InterMedia Summer School
none
Animated Picture Presentation Steered by Natural Language
http://intermediaschool.miralab.unige.ch/
2009
Currently, much research aims at coping with the shortcomings in multimedia consumption that may exist in a user's current context, e.g., due to the absence of appropriate devices at many locations, a lack of capabilities of mobile devices, restricted access to content, or non-personalized user interfaces. Recently, solutions to specific problems have been emerging, e.g., wireless access to multimedia repositories over standardized interfaces; however, due to usability restrictions the user has to spend much effort to or is even incapable of fulfilling his/her demands. The vision of user-centric multimedia places the user in the center of multimedia services to support his/her multimedia consumption intelligently, dealing with the aforementioned issues while minimizing required work. Essential features of such a vision are comprehensive context awareness, personalized user interfaces, and multimedia content adaptation. These aspects are addressed in this paper as major challenges toward a user-centric multimedia framework.
Boca Raton (Florida)
Reiterer, Bernhard
Lachner, Janine
Lorenz, Andreas
Zimmermann, Andreas
Hellwagner, Hermann
Advances in Semantic Media Adaptation and Personalization
10.1201/9781420076653-c2
2
Angelides, Marios C
Mylonas, Phivos
Wallace, Manolis
1420076647
978-1420076646
9781420076646
EN
mar
21-42
Auerbach Publications
none
Research Directions Toward User-centric Multimedia
http://www.crcpress.com/product/isbn/9781420076646
2009
This paper presents a novel approach that combines both in-network, application-layer adaptation and network-layer traffic control of scalable video streams based on the H.264/SVC standard. In the IPTV/VoD scenario considered, an intercepting RTSP/RTP proxy performs admission control of the requested video, based on the signaled scalability information, and decides whether the content can be streamed without changes or in an adapted version. The proxy configures the network layer appropriately in order to separate the video stream from besteffort traffic on the same link. Rather than performing fixed bandwidth allocation, our proxy approach uses the Hierarchical Token Bucket (HTB) queuing discipline to allow for borrowing bandwidth between traffic classes. In that setting, two different allocation policies are introduced. The Hard Reservation Policy (HRP) performs admission control and adaptation on the video streams and does not modify video bandwidth allocation after admission. In contrast, the Flexible Borrowing Policy (FBP) restricts the admission control to the base layer of the SVC stream. The packets carrying MGS enhancement layer data are marked with priorities by the proxy and are handled at the network layer by a priority-based queuing mechanism. Both a qualitative comparison and an experimental evaluation of the two policies are given.
Los Alamitos, CA, USA
Kofler, Ingo
Kuschnig, Robert
Hellwagner, Hermann
Proceedings of the IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)
10.1109/ISBMSB.2009.5133771
Angueira, Pablo
Reimers, Ulrich
9781424425907
EN
Bilbao, Spain
may
1-6
IEEE
BMSB
2009.05.14
registered
Improving IPTV Services by H.264/SVC Adaptation and Traffic Control
https://www.itec.aau.at/publications/mmc/BMSB09_Kofler_Improving_IPTV_Services_Preprint.pdf
2009
One of the most active research topics in the field of video signal processing is scalable video coding (SVC). The recently published extension of the H.264/AVC video coding standard introduces scalability features by employing a layered encoding of the video stream. In our work we investigated the usage of this scalable extension of H.264/AVC for in-network multimedia adaptation. We developed an RTSP/RTP-based proxy which exploits the layered encoding of the video and can perform real-time video adaptation on an inexpensive off-the-shelf WiFi router. This is achieved by applying a stateful, packet-based adaptation approach that keeps the computational costs at a minimum. With that approach it is possible to simultaneously adapt multiple video streams to varying network conditions or to the capabilities of the consumers' end-devices. In our demonstration we show the streaming of two scalable video streams from a server to a client and the in-network adaptation of the video at the WiFi router. The adaptation can be controlled interactively in the temporal, spatial and SNR domains.
Los Alamitos, CA, USA
Kofler, Ingo
Kuschnig, Robert
Hellwagner, Hermann
Proceedings of the 6th IEEE Consumer Communications and Networking Conference (CCNC)
10.1109/CCNC.2009.4785005
Gibbs, Simon
Messer, Alan
9781424423088
EN
Las Vegas, NV, USA
jan
2
https://www.itec.aau.at/bib/files/CCNC09_SVC_Adaptation_Router_preprint.pdf
IEEE
CCNC
2009.01.11
poster
In-Network Real-Time Adaptation of Scalable Video Content on a WiFi-ne Router
2009
Wien
Ferscha, Alois
Hellwagner, Hermann
Neuper, Christa
Pree, Wolfgang
Informatik macht Zukunft - Zukunft macht Informatik
Chroust, Gerhard
Moessenboeck, Hans-Peter
9783854032588
DE
dec
48-51
Oesterreichische Computer Gesellschaft
none
Zukunft der Informatik
2009
The streaming of multimedia content over Peer-to-Peer (P2P) networks is nowadays a well appreciated concept, as it helps distributing content to a great number of users and additionally reduces the server costs for providing the content. As the users of P2P networks often have different bandwidth connections and terminals, the same content is usually provided in different qualities. Although such a provision of the same content in different qualities helps to satisfy all users, it makes the sharing process less efficient. Users that are interested in the content in a specific quality can only exchange pieces with those users that are interested in the same content and the same quality. Thus, layered video coding, which provides different qualities within one bitstream, is especially well suited for P2P distribution. If the layered content is provided once in the best quality, all peers interested in this content can at least exchange the base layer, plus the enhancement layers they are interested in with those peers that have them available.
NA
Eberhard, Michael
Timmerer, Christian
Hellwagner, Hermann
STreaming Day ’09 Proceedings
Raggio, Marko
Rovati, Fabrizio
9781616236212
EN
Genova, Italy
sep
n.a.
NA
2009.09.21
registered
A Layered Piece-Picking Algorithm for Peer-to-Peer Networks
2009
End-to-end support for Quality of Service (QoS) has been broadly discussed in the literature. Many technologies have been proposed, each focusing on specific aspects for providing QoS guarantees to the end user. However, the integrated management of the end-to-end chain preserving QoS in heterogeneous environments is still a significant issue and insufficiently addressed to date. In this paper we propose an integrated management supervisor that takes into account the requirements from all stakeholders along the multimedia content delivery chain and provides an end-to-end management solution enabling QoS to the end user. This architecture and the subsystems that can be distributed along the end-to-end chain are detailed in this paper.
New York, NY, USA
Timmerer, Christian
Ransburg, Michael
Kofler, Ingo
Hellwagner, Hermann
Souto, Pedro
Andrade, Maria
Carvalho, Pedro
Castro, Helder
Sidibe, Mamadou
Mehaoua, Ahmed
Fang, Li
Lindsay, Adam
Mackay, Michael
Lugmayr, Artur
Feiten, Bernhard
Proceedings of the 2nd European Symposium on Mobile Media Delivery (EUMOB)
Frantti, Tapio
Huusko, Jyrki
EN
jul
6
https://www.itec.aau.at/bib/files/eumob2008enthrone.pdf
ACM
EUMOB
none
An Integrated Management Supervisor for End-to-End Management of Heterogeneous Contents, Networks, and Terminals enabling Quality of Service
2008
The MPEG-21 standard forms a comprehensive multimedia framework covering the entire multimedia distribution chain. In particular, it provides a flexible approach to represent, process, and transact complex multimedia objects which are referred to as Digital Items (DIs). DIs can be quite generic, independent of the application domain, and can encompass a diversity of media resources and metadata. This flexibility has an impact on the level of interoperability between systems and applications, since not all the functionality needs to be implemented. Furthermore, additional semantic rules may be implemented through the processing of the Digital Item which is possibly driven by proprietary metadata. This jeopardizes interoperability and consequently raises barriers to the successful achievement of augmented and transparent use of multimedia resources. In this context, we have investigated and evaluated the interoperability at the semantic level of Digital Items throughout the automated production, delivery and consumption of complex multimedia resources in heterogeneous environments. This paper describes the studies conducted, the experiments performed, and the conclusions reached towards that goal.
New York, USA
Timmerer, Christian
Andrade, Maria Teresa
Carvalho, Pedro
Rogai, Davide
Cordara, Giovanni
Proceedings of ACM Multimedia 2008 2nd International Workshop on the Many Faces of Multimedia Semantics
http://dx.doi.org/10.1145/1460676.1460681
Fotouhi, Farshad
Grosky, William I
Stanchev, Peter
978-1-60558-316-7
MPEG-21, Digital Items, Semantics, Evaluation, Metadata.
EN
oct
17-23
https://www.itec.aau.at/bib/files/ms41754-timmerer-pre.pdf
ACM
none
The Semantics of MPEG-21 Digital Items Revisited
2008
Scalable media contents, such as the new MPEG-4 Scalable Video Codec enable to easily retrieve different qualities of the media content by simply disregarding certain media segments. The MPEG-21-based codec-agnostic adaptation approach supports this concept by introducing an XMLbased Bitstream Syntax Description (BSD) which describes the different segments of a media content. Based on this BSD, an adaptation node can intelligently adapt any scalable media (i.e., remove specific media segments) without the need for codec-specific knowledge. The adaptation approach consists of 1) transforming this BSD and 2) adapting the media based on the transformed BSD. In this paper, we focus on the BSD transformation step and evaluate different mechanisms w.r.t. their transformation efficiency given several application scenarios. In particular, we compare the traditional stylesheet-based mechanisms with a novel mechanism based on regular expressions. We discuss both mechanisms in terms of their expressiveness, and propose how to actually employ regular expressions for codec-agnostic adaptation. Finally, we quantitatively evaluate these mechanisms in different adaptation scenarios, which vary in the size and number of required BSD units
Los Alamitos, CA, USA
Ransburg, Michael
Gressl, Hubert
Hellwagner, Hermann
2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services
Hellwagner, Hermann
Timmerer, Christian
9780769531304
EN
apr
143-146
https://www.itec.aau.at/bib/files/Efficient Transformation of MPEG-21 Metadata for Codec-agnostic Adaptation.pdf
IEEE
none
Efficient Transformation of MPEG-21 Metadata for Codec-agnostic Adaptation in Real-time Streaming Scenarios
http://www2.computer.org/portal/web/csdl/abs/proceedings/wiamis/2008/3130/00/3130toc.htm
2008
Today, there are many technologies in place to establish an infrastructure for the delivery and consumption of multimedia content. In practice, however, several elements of such an infrastructure are often stand-alone systems and a big picture of how these elements relate to each other or even fit together is not available. Therefore, MPEG-21 aims to provide an open framework for interoperable multimedia delivery and consumption. This requirement for interoperability results in a great diversity of XML-based metadata, which describes the media data on semantic or syntactic levels, in order to make it more accessible to the user. This metadata can be of considerable size, which leads to problems in streaming scenarios. Other than media data, XML metadata has no concept of samples, thus inhibiting streamed (and timed) processing, which is natural for media data. In order to address the challenges and requirements resulting from this situation, the concept of streaming instructions is introduced. These streaming instructions facilitate the fragmentation of content-related metadata, the association of media and metadata fragments with each other, and the synchronized streaming and processing of those fragments. Based on these capabilities, a dynamic and distributed multimedia content adaptation framework can be built.
Berlin, Heidelberg, New York
Ransburg, Michael
Timmerer, Christian
Hellwagner, Hermann
Multimedia Semantics: The role of Metadata
10.1007/978-3-540-77473-0_1
Lux, Mathias
Granitzer, Michael
Spaniol, Marc
3540774726
978-3540774723
EN
feb
3-24
Springer
none
Dynamic and Distributed Multimedia Content Adaptation based on the MPEG-21 Multimedia Framework
2008
Microdrones are small-scale unmanned aerial vehicles (UAVs) carrying payloads such as cameras and sensors. Such microdrones enable us to obtain a bird's eye view of the environment which is helpful in many applications such as environmental monitoring, surveillance or disaster management. This position paper reports on our recently launched project \collaborative microdrones" where we are developing a system for aerial imaging based on cooperating, wireless networked microdrones that can be used in disaster management applications. Several microdrones will y in formation over the area of interest and deliver sensor data which is fused, analyzed and delivered to the user in real-time. In this paper we brie y discuss applications for UAVs, present related projects, introduce our research focus and report on preliminary results.
New York, NY, USA
Quaritsch, Markus
Stojanovski, Emil
Bettstetter, Christian
Friedrich, Gerhard
Hellwagner, Hermann
Rinner, Bernhard
Hofbaur, Michael
Shah, Mubarak
Proceedings of the Second International Conference on Autonomic Computing and Communication Systems
ACM
microdrones, networked autonomous systems, mission planning, aerial imaging, formation flight
EN
jul
7
https://www.itec.aau.at/bib/files/Collaborative Microdrones.pdf
ACM Press
none
Collaborative Microdrones: Applications and Research Challenges
http://www.pervasive.uni-klu.ac.at/publications/pdf/Quaritsch_Autonomics2008.pdf
2008
The amount of audiovisual data available on the Internet and thus of multimedia communication over today's networks is increasing at a rapid pace. Despite the availability of specific media transport protocols like RTP, most content providers make use of the well-established and reliable TCP protocol to deliver audiovisual content over the Internet. The reason is that TCP-based data delivery in general is much less complicated for the clients to be served and over today's networks traversed (including proxies and firewalls), than making use of UDP-based RTP connections. However, in case of network bandwidth fluctuations and packet losses, TCP-based media delivery may lead to annoying jerky playback at the client side, due to retransmissions and late arrival of media data. This papers deals with TCP-based perceptual QoS improvement mechanisms for increasing the media experience for the consumer under unstable network conditions. Our approach is based on media content adaptation (transcoding) to fit the actual network bandwidth continuously monitored by the sender. The proposed mechanisms are applied at the application level at the server side, leaving the existing TCP implementation untouched and therefore enabling transparent use of existing media players. An evaluation of a realistic use case is presented which underlines the efficency of our approach.
Los Alamitos, CA, USA
Prangl, Martin
Kofler, Ingo
Hellwagner, Hermann
Proceedings of the 4th International Conference on Networking and Services (ICNS)
10.1109/ICNS.2008.10
Bi, Jun
Chin, Kim
Dini, Cosmin
Lehmann, Leo
Pheanis, David C
978-0-7695-3094-9
EN
Gosier, Guadaloupe
mar
188-193
https://www.itec.aau.at/bib/files/prangl-tQosTcpMediaDelivery.pdf
IEEE
ICNS
2008.03.19
registered
Towards QoS Improvements of TCP-based Media Delivery
2008
Supporting transparent delivery and convenient use of multimedia content across a wide range of networks and devices is still a challenging task within the multimedia research community; Universal Multimedia Access (UMA) is a vision that has been pursued for quite some time. In multimedia frameworks, content adaptation is the core concept to make progress toward this goal. Most media adaptation engines targeting UMA scale the content w.r.t. terminal capabilities and network resource constraints and do not sufficiently consider end user preferences or even the utility of the adapted content for the user. Based on our previous work and the support of the MPEG-21 framework, we present a transparent solution to provide a content utility-aware adaptation decision for such utility-unaware multimedia frameworks. The idea is to outsource the challenging utility-aware adaptation decision taking task, which takes many factors into consideration and leads to a complex optimization problem. A realistic use case is adopted to show how related external multimedia frameworks can easily integrate and use our proposed adaptation decision taking Web Service.
Brussels, Belgium
Prangl, Martin
Kofler, Ingo
Hellwagner, Hermann
Proceedings of the 1st International Conference on Ambient Media and Systems (Ambi-sys)
Whitaker, Roger M
Liang, Ben
978-963-9799-16-5
EN
Quebec, Canada
feb
8
https://www.itec.aau.at/bib/files/ADTService-final.pdf
ICST
Ambi-sys
2008.02.12
registered
An MPEG-21-driven Utility-based Multimedia Adaptation Decision Taking Web Service
2008
A key objective of the ENTHRONE II Project is the ability to optimise the delivery of multimedia content to a wide group of heterogeneous users. One example of this is in the cooperative deployment of adaptation and caching functionality in the edge network. This hybrid approach makes it possible not only to store content locally, thus minimising the cost incurred through subsequent requests, but also to better serve heterogeneous groups of users by dynamically adapting the content to suit a wide range of terminal devices. In this paper, we describe and evaluate how the cooperative deployment of MPEG-21-based adaptation and caching of MPEG-4 SVC can result in improvements both in the quality of the content received at the user terminal and the resources consumed during the delivery
Los Alamitos, CA, USA
Mackay, Michael
Hutchison, David
Ransburg, Michael
Hellwagner, Hermann
2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services
Hellwagner, Hermann
Timmerer, Christian
9780769531304
EN
apr
101-104
https://www.itec.aau.at/bib/files/Combined Adaptation and Caching of MPEG-4 SVC in Streaming Scenarios.pdf
IEEE
none
Combined Adaptation and Caching of MPEG-4 SVC in Streaming Scenarios
http://www2.computer.org/portal/web/csdl/abs/proceedings/wiamis/2008/3130/00/3130toc.htm
2008
This paper describes how a multimedia adaptation framework can automatically decide the sequence of operations to be executed in order to adapt an MPEG-21 Digital Item to the MPEG-21 description of the usage environment in which it will be consumed. The main innovation of this work with respect to previous multimedia adaptation decision models is that in the proposed approach decisions can be made without knowing the exact behaviour of the operations that are going to be executed.
Los Alamitos, CA, USA
López, Fernando
Jannach, Dietmar
Martínez, José M
Timmerer, Christian
Hellwagner, Hermann
García, Narciso
2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services
Hellwagner, Hermann
Timmerer, Christian
9780769531304
EN
apr
46-49
https://www.itec.aau.at/bib/files/Multimedia Adaptation Decisions Modelled as Non-Deterministic Operations.pdf
IEEE
none
Multimedia Adaptation Decisions Modelled as Non-deterministic Operations
http://www2.computer.org/portal/web/csdl/abs/proceedings/wiamis/2008/3130/00/3130toc.htm
2008
This discussion paper attempts to propose emergency response and disaster management as worthwhile areas of applied research for the informa-tion system community. The typical requirements, entities and activities in-volved in specifically mobile emergency response operations are summarized. Recent research contributions in this area are exemplarily reviewed in order to give a deeper insight into the role and use of mobile information and communi-cation systems. Finally, the major challenges and research needs regarding in-formation systems are summarized, with a view to draw the attention of infor-mation systems researchers to this interesting and important field.
Berlin, Heidelberg, New York
Lachner, Janine
Hellwagner, Hermann
Information Systems and e-Business Technologies (Proc. 2nd International United Information Systems Conference, UNISCON 2008
1
Kaschek, Roland
Kop, Christian
Steinberger, Claudia
Fliedl, Günther
3540789413
978-3540789413
Emergency response, disaster management, information systems, mobile information and communication technology
EN
apr
213-224
https://www.itec.aau.at/bib/files/Information and Communication Systems for Mobile Emergency Response.pdf
Springer
LNBIP 5
none
Information and Communication Systems for Mobile Emergency Response
2008
Recent advances in video coding technology like the scalable extension of the MPEG-4 AVC/H.264 video coding standard pave the way for computationally cheap adaptation of video content. In this paper we present our work on a lightweight RTSP/RTP proxy that enables in-network stream processing. Based on an off-the-shelf wireless router that runs a Linux-based firmware we demonstrate that the video adaptation can be performed on-the-fly directly on a network device. The paper covers design and implementation details of the proxy as well as a discussion about the actual adaptation of the SVC stream. Based on experimental evaluations we show that our approach can handle a reasonable number of concurrent sessions for a typical home deployment scenario. Furthermore, the paper covers possible applications in which adaptation on the network device can be beneficial.
New York, NY, USA
Kofler, Ingo
Prangl, Martin
Kuschnig, Robert
Hellwagner, Hermann
Proceedings of the 18th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV)
10.1145/1496046.1496061
Wolf, Lars
Griwodz, Carsten
Multimedia adaptation, in-network adaptation, RTSP, RTP, H.264, scalable video coding
EN
Braunschweig, Germany
may
63-68
https://www.itec.aau.at/bib/files/NOSSDAV08_AdaptationProxyRouter-preprint.pdf
ACM
NOSSDAV
2009.05.29
registered
An H.264/SVC-based Adaptation Proxy on a WiFi Router
2008
Setubal
Köpke, Julius
Tusch, Roland
Hellwagner, Hermann
Böszörmenyi, Laszlo
Proceedings of the International Conference on Signal Processing and Multimedia Applications
Assunção, Pedro
Faria, Sérgio
9789898111609
EN
jul
15-23
INSTICC Press
none
Context-aware hoarding of Multimedia Content in a large-scale Tour Guide Scenario
http://www.sigmap.org
2008
The multimedia community is pursuing, among others, the vision of Universal Multimedia Access (UMA). UMA denotes the concept that any multimedia content should be available anywhere, anytime, on any device, tailored to the user's needs and preferences, accessible for the user in a transparent and convenient way. Key to achieving this vision is to realize collaborative adaptive behavior of the involved distributed multi-media system components (server, media-aware net-work elements like proxies or gateways, and clients), based on intense metadata exchange and multimedia content negotiation, adaptation, or personalization. This paper outlines the key challenges and the state of the art in achieving such adaptive behavior. The major challenges have been tackled recently and many of the building blocks of UMA have become or are becoming available from standardization groups, which are instrumental in this area to ensure interop-erable use of the media and metadata items. However, making use of these standards in practical multimedia systems raises additional issues, both of conceptual nature and in terms of implementation. Based on years of contributions to ISO/IEC MPEG standardization efforts and of research work into adaptive multimedia systems, we will give an overview of these challenges, discuss the state of the art, and introduce an emerging principled solution for format-independent multimedia content adaptation.
Tecumseh
Hellwagner, Hermann
Advances in Multiagent Systems, Robotics and Cybernetics: Theory and Practice (Volume II)
Vol. II
Lasker, George E
Pfalzgraf, Jochen
9781897233610
EN
jul
15-19
https://www.itec.aau.at/bib/files/InterSymp_2007_HH_Adaptive_Behavior_DMS.pdf
The International Institute for Advanced Studies in Systems Research and Cybernetics
Proceedings of the Symposium on Multiagent Systems, Robotocs and Cybernetics Inter-Symp-2007
none
Challenges toward Adaptive Behavior of Distributed Multimedia Systems
2008
In this paper, an interoperable streaming framework for the adaptation and streaming of scalable multimedia content is presented. The streaming framework’s architecture for Video on Demand (VoD) as well as multicast streaming is presented. The VoD test-bed allows each client to set up a separate streaming session and receive the bitstreams in a quality tailored to the clients requirements, while the multicast test-bed provides a layered scalable multicast to all clients and every client needs to decide which layers to subscribe to. After the description of the architectures, a comparison in terms of performance of the MPEG-21 DIA metadata-based adaptation approach to an SVC-specific adaptation approach is presented. Furthermore, optimizations for both adaptation approaches are presented and the performance improvements due to the optimizations are discussed.
Parma
Eberhard, Michael
Celetto, Luca
Timmerer, Christian
Quacchio, Emanuele
Hellwagner, Hermann
STreaming Day'08 Proceedings
Fanucci, Luca
Rovati, Fabrizio
Timmerer, Christian
9781607029373
EN
Parma, Italy
sep
4
https://www.itec.aau.at/bib/files/Streaming Day'08_Eberhard_StreamingFramework_Paper.pdf
University of Parma
2008.09.02
registered
An Interoperable Streaming Framework for Scalable Video Coding based on MPEG-21
2008
This paper presents an interoperable framework for the streaming of scalable multimedia content such as Scalable Video Coding (SVC). In particular, the framework’s architecture for both, Video on Demand (VoD) and multicast streaming, is presented. The architecture includes a detailed description of the adaptation engine – conforming to MPEG-21 Digital Item Adaptation – as well as the integration of the adaptation engine into VideoLAN’s VLC media player, which provides the streaming server and client for the framework. Following the description of the architecture, a comparison in terms of performance of the generic MPEG-21 DIA-based adaptation approach, which is utilized by the described demo, versus an SVC-specific adaptation approach is presented and possible further improvements for both approaches are investigated.
London
Eberhard, Michael
Celetto, Luca
Timmerer, Christian
Quacchio, Emanuele
Hellwagner, Hermann
Rovati, Fabrizio S
Proceedings of the 5th IET Visual Information Engineering Conference Conference (VIE’08)
Izquierdo, Ebroul
Liu, Guizhong
978-0-86341-914-0
0537-9989
Adaptation, MPEG-21 Digital Item Adaptation, Multicasting, Scalable Video Coding, Video on Demand
EN
Xi'an, China
jul
723-728
https://www.itec.aau.at/bib/files/VIE08_Eberhard.pdf
IET
2008.07.29
registered
An Interoperable Streaming Framework for Scalable Video Coding based on MPEG-21
2008
In this paper we present an interoperable multimedia delivery framework for scalable video coding based on MPEG-21 Digital Item Adaptation (DIA). In can be used to transmit scalable video contents within heterogeneous usage environments where the properties of the usage environment (e.g., terminal/network capabilities) may change dynamically during the streaming session. The usage environment is signaled by interoperable description formats provided by the DIA standard. Additionally, the adaptation itself is done by exploiting the standard's generic adaptation approach, i.e., independent of the actual coding format. Thus, the overall framework is also applicable for other scalable coding formats.
Los Alamitos, CA, USA
Eberhard, Michael
Celetto, Luca
Timmerer, Christian
Quacchio, Emanuele
Hellwagner, Hermann
Rovati, Fabrizio S
Proceedings of the IEEE International Conference on Multimedia and Expo 2008 (ICME’08)
Ostermann, Jörn
Ebrahimi, Touradj
9781424425709
EN
Hannover, Germany
jun
1607-1608
https://www.itec.aau.at/bib/files/ICME08_Eberhard.pdf
IEEE
2008.06.25
poster
An Interoperable Multimedia Delivery Framework for Scalable Video Coding based on MPEG-21 Digital Item Adaptation
2008
This paper provides a performance analysis of adaptation approaches designed for scalable media resources. In particular, we investigate the streaming of media resources compliant to the Scalable Video Coding (SVC) extensions of Advanced Video Coding (AVC)within heterogeneous environments, i.e., terminals and networks with different capabilities. Therefore, we have developed a test-bed in order to analyze two different approaches for the adaptation of scalable media resources, namely a generic approach that is applicable independently of the actual scalable coding format used and a specific approach especially built for SVC.The results show that if adaptation is required the generic approach clearly outperforms the approach specifically built for SVC
Los Alamitos, CA, USA
Eberhard, Michael
Celetto, Luca
Timmerer, Christian
Quacchio, Emanuele
Hellwagner, Hermann
2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services
Hellwagner, Hermann
Timmerer, Christian
076953130X
978-0769531304
EN
Klagenfurt, Austria
may
43-50
https://www.itec.aau.at/bib/files/wiamis08_eberhard.pdf
IEEE
2008.05.09
registered
Performance Analysis of Scalable Video Adaptation: Generic versus Specific Approach
2008
Current trends in smart homes suggest that several multimedia services will soon converge towards common standards and platforms. However this rapid evolution gives rise to several issues related to the management of a large number of multimedia streams in the home communication infrastructure. An issue of particular relevance is how a context acquisition system can be used to support the management of such a large number of streams with respect to the Quality of Service (QoS), to their adaptation to the available bandwidth or to the capacity of the involved devices, and to their migration and adaptation driven by the users' needs that are implicitly or explicitly notified to the system. Under this scenario this paper describes the experience of the INTERMEDIA project in the exploitation of context information to support QoS, migration, and adaptation of multimedia streams.
Los Alamitos, CA, USA
Bolla, Raffaele
Repetto, Matteo
Chessa, Stefano
Furfari, Francecso
Zutter, Saar De
Walle, Rik Van de
Reiterer, Bernhard
Hellwagner, Hermann
Asbach, Mark
Wien, Mathias
13th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA08)
IEEE, Industrial Electronics Society
EN
sep
1354-1361
https://www.itec.aau.at/bib/files/04638575.pdf
IEEE
none
A Context-Aware Architecture for QoS and Transcoding Management of Multimedia Streams in Smart Homes
2008
Due to the increasing heterogeneity in the current multimedia landscape, the delivery of multimedia content has become an important issue today. This heterogeneity is not only reflected by a plethora of different usage environments, but also by the presence of multiple (scalable) coding formats. Therefore, format-independent adaptation engines have to be used within a multimedia delivery platform, which are able to adapt the multimedia content according to a certain usage environment, independent of the underlying coding format of the content. By relying on automatically created textual descriptions of the highlevel syntax of binary media resources, a format-independent adaptation engine can be build. MPEG-21 generic Bitstream Syntax Schema (gBS Schema) is a tool that is part of the MPEG-21 Multimedia Framework. It enables the use of generic Bitstream Syntax Descriptions (gBSDs), i.e., textual descriptions in XML, to steer the adaptation of a binary media resource, using format-independent adaptation logic. In this paper, we address the design and performance evaluation of a multimedia delivery platform that relies on gBS Schema-driven adaptation engines. This platform is called MuMiVA; it is a fully integrated, extensible platform for multimedia delivery in heterogeneous usage environments, using streaming technologies. To demonstrate the flexibility of our multimedia delivery platform, we discuss the functioning of two different applications (i.e., exploitation of temporal scalability and shot selection) applied to two different coding formats (i.e., MPEG-4 Visual and H.264/AVC). Keywords— Content adaptation, Content delivery, MPEG-21 gBS Schema, XML transformations.
Los Alamitos, CA, USA
Deursen, Davy Van
Bruyne, Sarah De
Lancker, Wim Van
Neve, Wesley De
Schrijver, Davy De
Hellwagner, Hermann
Walle, Rik Van de
IEEE International Symposium on Multimedia 2007 (ISM2007)
Bulterman, Dick
Mori, Kinji
Tsai, Jeffrey J P
0769530583
978-0769530581
0769530583
EN
dec
131-138
https://www.itec.aau.at/bib/files/MuMiVA.pdf
IEEE
none
MuMiVA: A Multimedia Delivery Platform using Format-agnostic, XML-driven Content Adaptation
http://www.ism2007.ncu.edu.tw/
2007
MPEG-21 Digital Item Adaptation (DIA) allows for a media codec agnostic multimedia adaptation approach which enables the implementation of generic adaptation engines. However, DIA is optimized for static, server-based adaptation. In this paper we introduce novel mechanisms to extend the DIA approach towards dynamic and distributed scenarios. This facilitates the placement of generic adaptation nodes which perform media codec agnostic and dynamic adaptation anywhere along the content delivery path. To validate our work we implemented such an adaptation node and evaluate its performance.
Los Alamitos, CA, USA
Ransburg, Michael
Timmerer, Christian
Hellwagner, Hermann
Devillers, Sylvain
WIAMIS 2007
Kompatsiaris, Yiannis
Avrithis, Yannis
0-7695-2818-X
EN
jun
4
https://www.itec.aau.at/bib/files/Design and Evaluation of a Metadata-Driven Adaptation Node.pdf
IEEE
none
Design and Evaluation of a Metadata-Driven Adaptation Node
http://www.computer.org/proceedings/
2007
Today’s increasing variety of media data results in a great diversity of XMLbased metadata, which describes the media data on semantic or syntactic levels, in order to make it more accessible to the user. This metadata can be of considerable size, which leads to problems in streaming scenarios. Other than media data, XML metadata has no concept of “samples”, thus inhibiting streamed (and timed) processing, which is natural for media data. In order to address the challenges and requirements resulting from this situation, the concept of streaming instructions is introduced. In particular, streaming instructions address the problem of fragmenting metadata, associating media segments and metadata fragments, and streaming and processing them in a synchronized manner. This is achieved by enriching the metadata with additional attributes to describe media and XML properties. Alternatively, a style sheet approach provides the opportunity to dynamically set such streaming properties without actually modifying the XML description.
Aachen
Ransburg, Michael
Devillers, Sylvain
Timmerer, Christian
Hellwagner, Hermann
Datenbanksysteme in Business, Technologie und Web (BTW 2007)
Jarke, Matthias
Seidl, Thomas
Quix, Christoph
Kensche, David
Conrad, St
Rahm, E
Klamma, Ralf
Kosch, Harald
Granitzer, Michael
Apel, S
Rosenmüller, M
Saake, Gunter
Spinczyk, Olaf
3861309297
EN
mar
117-138
https://www.itec.aau.at/bib/files/Processing and Delivery of Multimedia Metadata for Multimedia Content Streaming.pdf
Verlag Mainz
none
Processing and Delivery of Multimedia Metadata for Multimedia Content Streaming
2007
Enabling transparent and augmented use of multimedia content across a wide range of networks and devices is still a challenging task within the multimedia research community. Within multimedia frameworks, content adaptation is the core concept to overcome this issue. Most media adaptation engines targeting Universal Multimedia Access (UMA) scale the content w.r.t. terminal capabilities and network resource constraints and do not sufficiently consider user preferences. This paper focuses on a hybrid recommender technique for configuring a cross-modal utility model that guides adaptation of multimedia content. This approach additionally considers the user environment as well as demographic user data which leads to a personalized and increased multimedia experience. Based on a related adaptation decision technique we show how it is possible to offer a personalized adaptation for the individual user. We present a detailed evaluation of the approach based on results earned by subjective tests.
Los Alamitos, CA, USA
Prangl, Martin
Bachlechner, Roland
Hellwagner, Hermann
2007 IEEE International Conference on Multimedia and Expo (ICME 2007)
Zhuang, Xinhua
Gao, Wen
1-4244-1017-7
EN
jul
1707-1710
https://www.itec.aau.at/bib/files/A hybrid recommender strategy for personalized utility-based cross-modal multimedia adaptation.pdf
IEEE
none
A hybrid recommender strategy for personalized utility-based cross-modal multimedia adaptation
2007
Providing transparent and augmented use of multimedia content across a wide range of networks and devices is still a challenging task within the multimedia research community. Multimedia adaptation was figured out as a core concept to overcome this issue. Most multimedia adaptation engines for providing Universal Multimedia Access (UMA) scale the content under consideration of terminal capabilities and resource constraints but do not really consider individual user preferences. This paper introduces an adaptive multimedia framework which offers the user a personalized content variation for satisfying his/her individual utility preferences.
Los Alamitos, CA, USA
Prangl, Martin
Hellwagner, Hermann
World of Wireless, Mobile and Multimedia Networks, 2007. WoWMoM 2007
Fleury, Eric
Karl, Holger
EN
jan
1-3
https://www.itec.aau.at/bib/files/A framework for personalized utility-aware ip-based multimedia consumption.pdf
IEEE
none
A framework for personalized utility-aware IP-based multimedia consumption
http://www.tml.tkk.fi/IEEE-wowmom/index.html
2007
Currently, much research aims at coping with the shortcomings in multimedia consumption that may exist in a user's current context, e.g., due to the absence of appropriate devices at many locations, a lack of capabilities of mobile devices, restricted access to content, or non-personalized user interfaces. Recently, solutions to specific problems have been emerging, e.g., wireless access to multimedia repositories over standardized interfaces; however, due to usability restrictions the user has to spend much effort to or is even incapable of fulfilling his/her demands. The vision of user-centric multimedia places the user in the center of multimedia services to support his/her multimedia consumption intelligently, dealing with the aforementioned issues while minimizing required work. Essential features of such a vision are comprehensive context awareness, personalized user interfaces, and multimedia content adaptation. These aspects are addressed in this paper as major challenges toward a user-centric multimedia framework.
Los Alamitos, CA, USA
Lachner, Janine
Lorenz, Andreas
Reiterer, Bernhard
Zimmermann, Andreas
Hellwagner, Hermann
Second International Workshop on Semantic Media Adaptation and Personalization (SMAP 2007)
Mylonas, Phivos
Wallace, Manolis
Angelides, Marios C
0769430400
9780769530406
EN
sep
159-164
https://www.itec.aau.at/bib/files/Challenges toward User-centric Multimedia.pdf
IEEE
none
Challenges toward User-centric Multimedia
http://www.smap2007.org/
2007
This paper introduces aWeb-based guidance system which supports optimized presentations of sights or exhibited objects on different types of available stationary and mobile consumer devices, possibly running different operating systems. This is accomplished by adapting both the objects’ content, as well as their presentation to the current usage context. Content thereby may be encoded in different presentation formats like video, audio, image, and marked-up text. The usage context embraces a set of properties describing the current usage environment of the guide. This includes, for example, the consumer device’s capabilities, its current location, and the user’s preferences. Both, the content adaptation and presentation services are based on standardWeb technologies for increased interoperability. Finally, the guidance system is augmented with a Web-based content management and a statistics module, which enable for remote content administration and usage evaluations, respectively.
Setubal, Portugal
Kropfberger, Michael
Tusch, Roland
Jakab, Michael
Köpke, Julius
Ofner, Michael
Hellwagner, Hermann
Böszörmenyi, Laszlo
Proceedings of the 3rd International Conference on Web Information Systems and Technologies (WEBIST '07)
Filipe, Joaquim
Cordeiro, José
978-3-540-68257-8
Multimedia-based guide for stationary and mobile devices, context-awareness, content adaptation, presentation adaptation, content management.
EN
mar
83-90
https://www.itec.aau.at/bib/files/A multimedia-based guidance system for various consumer devices.pdf
INSTICC Press
none
A Multimedia-Based Guidance System for various Consumer Devices
http://www.webist.org/
2007
The adaptation of multimedia resources is a common method to enable the transport and consumption of audio-visual content in constrained environments. An important aspect in this field is adaptation decision-taking, which aims to find adaptation parameters that maximize the quality for the consumer while considering the constraints of the networks and terminals involved. In this paper we focus on improving the adaptation of audio-visual content by maximizing the perceived quality. This can be realized by using a multimedia quality model and content-related metadata. We present an approach to derive this content-related metadata from subjective tests and use it for adaptation decision-taking within the MPEG-21 multimedia framework.
Los Alamitos, CA, USA
Kofler, Ingo
Timmerer, Christian
Ahmed, Toufik
Hellwagner, Hermann
Proceedings of the Second International Workshop on Semantic Media Adaptation and Personalization (SMAP)
10.1109/SMAP.2007.34
Mylonas, Phivos
Wallace, Manolis
Angelides, Marios C
0769530400
978-0769530406
EN
London, United Kingdom
dec
3-8
https://www.itec.aau.at/bib/files/MPEG-21XL_SMAP2007.pdf
IEEE
SMAP
2009.05.29
registered
Towards MPEG-21-based Cross-layer Multimedia Content Adaptation
2007
The MPEG-21 standard defines a framework for the interoperable delivery and consumption of multimedia content. Within this framework the adaptation of content plays a vital role in order to support a variety of terminals and to overcome the limitations of the heterogeneous access networks. In most cases the multimedia content can be adapted by applying different adaptation operations that result in certain characteristics of the content. Therefore, an instance within the framework has to decide which adaptation operations have to be performed to achieve a satisfactory result. This process is known as adaptation decision-taking and makes extensive use of metadata describing the possible adaptation operations, the usage environment of the consumer, and constraints concerning the adaptation. Based on this metadata a mathematical optimization problem can be formulated and its solution yields the optimal parameters for the adaptation operations. However, the metadata is represented in XML resulting in a verbose and inefficient encoding. In this paper, an architecture for an Adaptation Decision-Taking Engine (ADTE) is introduced. The ADTE operates both on XML metadata and on metadata encoded with MPEG's Binary Format for Metadata (BiM) enabling an efficient metadata processing by separating the problem extraction from the actual optimization step. Furthermore, several optimization algorithms which are suitable for scalable multimedia formats are reviewed and extended where it was appropriate
Bellingham, Washington, USA
Kofler, Ingo
Timmerer, Christian
Hutter, Andreas
Sanahuja, Francesc
Proceedings of SPIE-IS&T Electronic Imaging Multimedia Computing and Networking Conference (MMCN)
Volume 6504
Zimmermann, Roger
Griwodz, Carsten
9780819466174
Adaptation Decision-Taking, MPEG-21, Digital Item Adaptation, Binary Format for Metadata (BiM)
EN
San Jose, CA, USA
jan
65040J-1-65040J-8
https://www.itec.aau.at/bib/files/MMCN2007EfficientMPEG21basedAdaptationDecisionTaking.pdf
SPIE
MMCN
2007.02.01
registered
Efficient MPEG-21-based Adaptation Decision-Taking for Scalable Multimedia Content
2007
Universal Plug and Play (UPnP) is a widely accepted standard for automatically detecting devices and services in a local area network as well as for describing and controlling them. In order to deal with multimedia devices and especially content, in 2002 the UPnP-AV standard definition was released. It defines device and service descriptions for Media Servers and Renderers. Thereby, the Media Server’s Content Directory Service allows an easy management and the exchange of metadata about the provided media data. Media content became browsable by semantic meta information about it. There are still two major drawbacks of UPnP-AV, which make its usage in real world multimedia communication scenarios very difficult. First, searching for similar content on distributed Media Servers with a huge number of media files is not economically possible. Second, the media content must be consumed by Renderers as provided by the Servers, independently of their terminal capabilities and network connections. In order to deal with these two drawbacks, this work proposes a novel approach of metadata integration and media transcoding in UPnP networks. First, the Media Server is extended by a Control Point which offers discovery of other Media Servers and fetches metadata from their Content Directories. Furthermore, it integrates the gathered information in its own Content Directory. Control Points are then able to query this Integrating Media Server for a desired content, and get a network-complete search result. Second, terminal and network capabilities of the Render-ers are taken into account in order to transcode and transmit the content in a suitable way for the consuming device. These two approaches of metadata integration and media data adaptation enable searchable logical views on tailored multimedia content in UPnP-AV networks.
Los Alamitos, CA, USA
Jakab, Michael
Kropfberger, Michael
Ofner, Michael
Tusch, Roland
Hellwagner, Hermann
Böszörmenyi, Laszlo
Proceedings of the 15th Euromicro Conference on Parallel, Distributed and Network-based Processing
D'Ambra, Pasqua
Guarracino, Mario R
1066-6192
EN
jan
363 - 369
https://www.itec.aau.at/bib/files/Universal-Plug-and-Play.pdf
IEEE
none
Metadata Integration and Media Transcoding in Universal-Plug-and-Play (UPnP) Enabled Networks
2007
In the area of multimedia computing and communication, one of the major objectives currently being pursued is Universal Multimedia Access (UMA), i.e., enabling users to transparently access any kind of content from anywhere, anytime, with any device. In the course of the MPEG-21 (Multimedia Framework) activities, the ISO/IEC MPEG standardization group has created essential building blocks toward this goal, mainly metadata standards. Two of them are worth noting here: (1) the Digital Item Adaptation (DIA) specification, including normative vocabulary and formats to describe the multimedia consumption context (device, network, natural environment characteristics, user preferences) and to steer media adaptation operations required for UMA; (2) the Rights Expression Language (REL) and Rights Data Dictionary (RDD) specifications, providing terms and a language to express permissions on the usage of the media (who, how, what, under which conditions). In this paper, we describe a recent MPEG-21 DIA Amendment in this area, specifying description formats for: (1) multimedia conversion capabilities, which tool or service providers may use to normatively specify the media adaptation (conversion) capabilities of their tools or services, respectively; (2) permissions and conditions for multimedia conversions, which can be utilized by content providers to determine which adaptations (changes) are permitted on their contents under what conditions. The latter description format embeds media adaptation descriptions into rights expressions, filling a gap between DIA and REL/RDD. In the paper, a use case illustrating a complex UMA scenario justifies the need for these descriptions. Exemplary conversions and permissions descriptions that apply to this use case as well as detailed explanations will be given in the main portion of the paper.
Düsseldorf
Timmerer, Christian
DeMartini, Thomas
Hellwagner, Hermann
D A CH Security 2006
Horster, Patrick
3-00-018166-0
EN
mar
225-235
https://www.itec.aau.at/bib/files/The MPEG-21 multimedia framework.pdf
IT Security & IT Management
none
The MPEG-21 Multimedia Framework: Conversions and Permissions
2006
An adaptive multimedia proxy is presented which provides (1) caching, (2) filtering, and (3) media gateway functionalities. The proxy can perform media adaptation on its own, either relying on layered coding or using transcoding and transrating in the decompressed domain. A cost model is presented which incorporates (1) user requirements, (2) terminal capabilities, and (3) video variations in one formula. Based on this model, the proxy acts as a general broker of different user requirements and of different video variations. This is a first step towards “What You Need is What You Get” (WYNIWYG) video services, which deliver videos to users in exactly that quality they need and are willing to pay for. The MPEG-7 and MPEG-21 standards enable this in an interoperable way. A detailed evaluation based on a series of simulation runs is provided. Based on the simulation results, the algorithms were integrated into our “Quality Based Intelligent Proxy”, the evaluation of which is in progress.
San Jose
Schojer, Peter
Böszörmenyi, Laszlo
Hellwagner, Hermann
Multimedia Computing and Networking 2006
Chandra, Surendar
Griwodz, Carsten
0-8194-6111-3
EN
jan
60710C-1 - 60710C-16
SPIE
none
QBIX-G- A Transcoding Multimedia Proxy
2006
- Location-Based Services - Ortserkennungstechnologien - Ortserkennungsmiddleware - Integration in mobile Anwendung - Automatisiertes Führungssystem.
Ottobrunn, München, Deutschland
Santner, Martin
Tusch, Roland
Kropfberger, Michael
Böszörmenyi, Laszlo
Hellwagner, Hermann
D•A•CH Mobility 2006
Horster, Patrick
3000196358
DE
oct
84-98
IT Security & IT Management
none
Ein Ortserkennungssystem für mobile Touristenführer
2006
The seamless access to rich multimedia content on any device and over any network, usually known as Universal Multimedia Access, requires interoperable description tools and adaptation techniques to be developed. To address this, MPEG-21 introduces an adaptation framework, which provides several mechanisms for making adaptation decisions according to usage environment and adapting multimedia contents in a coding format independent way. This paper gives an overview of the European FP6 project DANAE which not only implements and extends the existing MPEG-21 adaptation mechanisms but also kicked off several new standardization activities in the area of dynamic and distributed adaptation and resource conversion. MPEG-21 DIP enables static stream selection which is a first step in a series of adaptations. The existing BSD-based adaptation mechanisms enable the efficient implementation of generic adaptation engines, which can be used for existing and future coding formats. These mechanisms were extended to enable dynamic and distributed adaptation. Alternatively to the BSD-based adaptation, resource conversion was investigated which does not rely on scalable media and allows adaptations at the scene level.
Alghero, Italy
Ransburg, Michael
Cazoulat, Renaud
Pellan, Benoit
Concolato, Cyril
De Zutter, Saar
Poppe, Chris
Hutter, Andreas
Hellwagner, Hermann
Van de Walle, Rik
Proc. of the European Symposium on Mobile Media Delivery (EuMob 2006)
EuMob, 2006
EN
sep
1-5
https://www.itec.aau.at/bib/files/Dynamic and Distributed Adaptation of Scalable Multimedia Content in a Context-Aware Environment.pdf
--
none
Dynamic and Distributed Adaptation of Scalable Multimedia Content in a Context-Aware Environment
2006
In order to enable transparent and convenient use of multimedia content across a wide range of networks and devices, content adaptation is an important issue within multimedia frameworks. The so called Digital Item Adaptation (DIA) standard is one of the core concepts of the MPEG-21 framework that will support the adaptation of multimedia resources according to device capabilities, underlying network characteristics, and user preferences. Most multimedia adaptation engines for providing Universal Multimedia Access (UMA) scale the content with respect to terminal capabilities and resource constraints. This paper focuses on the cross-modal adaptation decision taking process considering the user environment and terminal capabilities as well as resource limitations on the server, network, and client side. This approach represents a step toward increased Universal Multimedia Experience (UME). Based on four different algorithms for solving this optimization process, we present an evaluation of results gained by running their implementations on different test networks.
Toronto, Canada
Prangl, Martin
Hellwagner, Hermann
Szkaliczki, Tibor
Proceedings oft the IEEE International Conference on Multimedia and Expo (ICME)
Ling, Guan
Hong-Jiang, Zhang
1-4244-0367-7
EN
jul
137-140
https://www.itec.aau.at/bib/files/Fast adaptation decision taking for cross-modal multimedia content adaptation.pdf
IEEE Press
none
Fast adaptation decision taking for cross-modal multimedia content adaptation
2006
In order to enable transparent and augmented use of multimedia content across a wide range of networks and devices, content adaptation is an important issue within multimedia frameworks. In this paper, we present a prototype application that receives Digital Video Broadcast (DVB) TV streams on a PC, transcodes the streams on the fly according to the individual User requirements and packs the adapted content together with available metadata into a standard compliant MPEG-21 Digital Item (DI). In this form, the framework enables the live Universal Multimedia Access (UMA) scenario where the DVB content can be transparently accessed by clients such as PCs and PDAs, anytime and anywhere.
Zadar
Prangl, Martin
Timmerer, Christian
Hellwagner, Hermann
Proceedings ELMAR 2006
Grgic, Mislav
Grgic, Sonja
13342630
DVB, MEPG-2, MPEG-4, MPEG-7, MPEG-21, Digital Items, metadata
EN
jun
297-300
https://www.itec.aau.at/bib/files/Real-time DVB-based MPEG-21 Digital Item Adaptation.pdf
Croatian Society Electronics in Marine - ELMAR, Zadar
none
Real-time DVB based MPEG-21 Digital Item Adaptation for live Universal Multimedia Access
2006
Content adaptation is an important issue of multimedia frameworks in order to achieve Universal Multimedia Access (UMA), that is, to enable consumption of individual multimedia content independently of the given resource limitations, terminal capabilities and user preferences. The Digital Item Adaptation (DIA) standard, one of the core specifications of the MPEG-21 framework, supports content adaptation considering a wide range of networks, devices and user preferences. Most adaptive multimedia frameworks enabling this UMA do not consider utility aspects in their adaptation decisions. This paper focuses on a generic multi-modal utility model for DIA, enabling increased multimedia experience to the client. Our proposed model is able to take the semantic and the perceptual features of the content as well as the clients individual utility aspects into consideration. Based on a detailed analysis of these constraints we will show how the model reacts on individual input data. Finally we will discuss results of the multi-modal decision taking process according to a few use case scenarios as well.
Incheon, Korea
Prangl, Martin
Hellwagner, Hermann
Szkaliczki, Tibor
Proceedings of the 7th International Workshop on Image Analysis for Multimedia Services (WIAMIS)
Ebroul, Izquierdo
Hyoung Joon, Kim
EN
apr
67-70
https://www.itec.aau.at/bib/files/A Semantic-based Multi-modal Utility Approach For Multimedia Adaptation.pdf
WIAMIS Eigenverlag
none
A Semantic-based Multi-modal Utility Approach For Multimedia Adaptation
2006
This paper focuses on an approach for real-time metal extraction of x-ray images taken from modernx-ray machines like C-arms. Such machines are used for vessel diagnostics, surgical interventions, as well as cardiology, neurology and orthopedic examinations. They are very fast in taking images from different angles. For this reason, manual adjustment of contrast is infeasible and automatic adjustment algorithms have been applied to try to select the optimal radiation dose for contrast adjustment. Problems occur when metallic objects, e.g., a prosthesis or a screw, are in the absorption area of interest. In this case, the automatic adjustment mostly fails because the dark, metallic objects lead the algorithm to overdose the x-ray tube. This outshining effect results in overexposed images and bad contrast. To overcome this limitation, metallic objects have to be detected and extracted from images that are taken as input for the adjustment algorithm.In this paper, we present a real-time solution for extracting metallic objects of x-ray images. We will explore the characteristic features of metallic objects in x-ray images and their distinction from bone fragments which form the basis to find a successful way for object segmentation and classification. Subsequently, we will present our edge based real-time approach for successful and fast automatic segmentation and classification of metallic objects. Finally, experimental results on the effectiveness and performance of our approach based on a vast amount of input image data sets will be presented.
San Diego
Prangl, Martin
Hellwagner, Hermann
Bischof, Horst
Szkaliczki, Tibor
Proceedings of the SPIE Symposium on Medical Imaging 2006
Reinhardt, Joseph M
Pluim, Josien P W
9780819464231
Pattern recognition, Segmentation, Medical imaging, X-Ray, Artefact-Segmentation
EN
mar
8
https://www.itec.aau.at/bib/files/Realtime automatic metal extraction of medical x-ray images for contrasst improvement.pdf
SPIE
Vol. 6144
none
Realtime automatic metal extraction of medical x-ray images for contrast improvement
2006
The adaptation of multimedia resources is a common method to enable the transport and consumption of audio-visual content in constrained environments. An important aspect in this field is adaptation decision-taking, which aims to find adaptation parameters that maximize the quality for the consumer while considering the constraints of the networks and terminals involved. In this paper we focus on improving the adaptation of audio-visual content by maximizing the perceived quality. This can be realized by using a multimedia quality model and content-related metadata. We present an approach to derive this content-related metadata from subjective tests and use it for adaptation decision-taking within the MPEG-21 multimedia framework.
Firenze, Italy
Kofler, Ingo
Hellwagner, Hermann
Proceedings of the 2nd International Conference on Automated Production of Cross Media Content for Multi-channel Distribution (AXMEDIS)
Kia, Ng
Badii, Atta
Bellini, Pierfrancesco
EN
Leeds, United Kingdom
dec
207-214
https://www.itec.aau.at/bib/files/AXMEDIS2006MPEG21CrossResourceAdaptationDecisionTaking.pdf
Firenze University Press
AXMEDIS
2006.12.13
registered
MPEG-21-based Cross-Resource Adaptation Decision-Taking
2006
The delivery and adaptation of multimedia content in dis tributed and heterogeneous environments requires flexible control and management mechanisms in terminals and in control entities inside the network. In the near future, it is important to reach interoperability between the IETF ap proaches on multimedia session establishment and control and the MPEG-21 efforts for multimedia streaming and adaptation to bring advanced multimedia service provi sioning and adaptation services towards the customer. MPEG-21 Digital Item Adaptation (DIA) provides norma tive descriptions for supporting adaptation of multimedia content, but does not define interactions with transport and control mechanisms. On the other hand, the IETF standardization efforts on multimedia session control pro vide the necessary transport (e.g. RTP) and control mechanisms (SDP/SDPng). We thus bridge the gap be tween those approaches by creating a converged XML model that enables the integration of session management and negotiation protocols (e.g. SIP or Megaco) inspired by the XML formats of MPEG-21 DIA and SDPng. We also present preliminary implementation results of the con verged model along with concepts and implementation of network-based content adaptation mechanisms through media gateways that enable flexible multimedia manage ment for heterogeneous consumer terminals.
Anaheim, CA, USA
Guenkova-Luy, Teodore
Schorr, Andreas
Hauck, Franz
Gómez, Miguel
Timmerer, Christian
Wolf, Ingo
Kassler, Andreas
Proceedings of IASTED International Conference onInternet and Multimedia Systems and Applications (EuroIMSA 2006)
Boucouvalas, Anthony Christos
0-88986-564-7
MPEG-21 DIA, SDP, SDPng, QoS, content adaptation, media gateways
EN
apr
130-135
https://www.itec.aau.at/bib/files/516-048.pdf
ACTA Press
none
Advanced Multimedia Management – Control Model and Content Adaptation
2006
Over the last decade, a wide spectrum of (multimedia) content has become available to an increasing number of users who desire to access it through various devices and over heterogeneous networks. Interoperability is the key for enabling transparent and augmented use of (multimedia) content across a wide range of networks and devices. Standardization efforts within the Moving Picture Experts Group (MPEG), in particular MPEG-7 and MPEG-21, aim to provide appropriate tools for achieving this goal of Universal Multimedia Access (UMA). This tutorial provides, in the first place, the concepts of UMA and corresponding MPEG-7 metadata tools built to support these concepts. Subsequently, the vision, an overview, and the state of the art of the emerging MPEG-21 Multimedia Framework are given. Finally, MPEG-21 Digital Item Adaptation (DIA) tools which implement the “Terminal and Networks Characteristics” key element within the whole framework are illustrated in detail. The goal of MPEG-21 DIA is to achieve interoperable transparent access to (distributed) advanced multimedia content by shielding users from network and terminal installation, configuration, management and implementation issues.
Florence, Italy
Timmerer, Christian
Hellwagner, Hermann
Proc. of the First International Conference on Automated Production of Cross Media Content for Multi-channel Distribution (AXMEDIS 2005)
Nesi, Paolo
Kia, Ng
Delgado, Jamie
88-8453-355-4
EN
dec
187-196
Firenze University Press
none
MPEG Standards enabling Universal Multimedia Access
2005
XML-based metadata is widely adopted across the different communities and plenty of commercial and open source tools for processing and transforming are available on the market. However, all of these tools have one thing in common: they operate on plain text encoded metadata which may become a burden in constrained and streaming environments, i.e., when metadata needs to be processed together with multimedia content on the fly. In this paper we present an efficient approach for transforming such kind of metadata which are encoded using MPEG's Binary Format for Metadata (BiM) without additional en-/decoding overheads, i.e., within the binary domain. Therefore, we have developed an event-based push parser for BiM encoded metadata which transforms the metadata by a limited set of processing instructions – based on traditional XML transformation techniques - operating on bit patterns instead of cost-intensive string comparisons.
Boston
Timmerer, Christian
Frank, Thomas
Hellwagner, Hermann
Heuer, Jörg
Hutter, Andreas
Proc. SPIE
Vetro, Anthony
Wen Chen, Chang
Kuo, C-C Jay
Zhang, Tong
Tian, Qi
Smith, John R
universal multimedia access, multimedia adaptation, compressed-domain metadata processing, bitstream adaptation in constrained and streaming environments, MPEG-21, Digital Item Adaptation, generic Bitstream Syntax Description
EN
oct
32-43
https://www.itec.aau.at/bib/files/Efficient Processing of MPEG-21 Metadata in the Binary Domain.pdf
Spie
Multimedia Systems and Applications VIII
none
Efficient Processing of MPEG-21 Metadata in the Binary Domain
2005
XML-based metadata is widely adopted across the different communities and plenty of commercial and open source tools for processing and transforming are available on the market. However, all of these tools have the same requirement: they operate on plain text encoded metadata which may become a burden especially in constrained and streaming environments, e.g., when metadata needs to be processed together with multimedia content which is available in a highly efficient, binary representation format. In this paper we present techniques for transforming such kind of metadata which is encoded using the well known MPEG-7 Systems Binary Format for Metadata (BiM) without additional en-/decoding overheads, i.e., within the binary domain. As such it enables us to process both the multimedia data as well as the metadata within its compressed domain, e.g., for metadata-driven adaptation purposes within intermediary network nodes which are becoming increasingly popular in the multimedia community as well as in the XML community.
Riga, Latvia
Timmerer, Christian
Lederer, Peter
Kosch, Harald
CBMI 2005 - Fourth International Workshop on Content-Based Multimedia Indexing
Moncef, Gabbouj
Jaakko, Astola
Ferran, Marques
952-15-1364-0
EN
jun
8
https://www.itec.aau.at/bib/files/TR_TransformingMPEG-21genericBitstreamSyntaxDescriptionsWithinTheBinaryDomain_Jun2005.pdf
CBMI
none
Transforming MPEG-21 generic Bitstream Syntax Descriptions within the Binary Domain
2005
XML-based metadata for digital media is becoming increasingly important, as a consequence also calling for efficient encoding and compression schemes for the storage and transport of this metadata. Moreover, support for streaming the XML metadata in conjunction with the media data is highly desirable. Such support is provided, for instance, by MPEG's Binary Format for Metadata (BiM) encoding approach, which facilitates fragmenting, delivering, and accessing the metadata in so- called Access Units (AUs). In this paper, we present a quantitative evaluation of existing XML metadata compression and encoding techniques, reaching from widely used state-of-the-art data compression algorithms to sophisticated XML-aware encoding schemes. The comparison is based on compressing MPEG-21 generic Bitstream Syntax Descriptions (gBSDs) which can grow to non-negligible sizes. The main conclusion from this investigation is that in terms of pure compression efficiency on XML files, the BiM approach (exemplified by the MPEG reference software as well as a commercial version thereof) is comparable – in terms of performance – with traditional data or specific XML compression tools. However, when XML metadata have to be fragmented, compressed, and streamed in such fragments, the results indicate that the BiM approach is superior to the other schemes.
Washington, DC, USA
Timmerer, Christian
Kofler, Ingo
Liegl, Johannes
Hellwagner, Hermann
Proceedings of the Seventh IEEE International Symposium on Multimedia (ISM)
10.1109/ISM.2005.31
Tsai, Jeffrey
Mühlhäuser, Max
Takizawa, Makoto
EN
Irvine, CA, USA
dec
534-539
https://www.itec.aau.at/bib/files/An Evaluation of Existing Metadata Compression and Encoding Technologies for MPEG-21 Applications.pdf
IEEE
ISM
2005.12.12
registered
An Evaluation of Existing Metadata Compression and Encoding Technologies for MPEG-21 Applications
2005
Universal Multimedia Access (UMA) has become a driving concept behind a significant amount of research activities. One of MPEG’s (Moving Pictures Experts Group) responses to UMA is MPEG-21 Digital Item Adaptation (DIA). In this paper we present how tools as specified within DIA (i.e., normative XML-based description formats) are applied in streaming and constrained environments enabling piece-wise multimedia content adaptation including the adaptation decision- taking process and the actual resource adaptation in a coding format-independent way. Additionally, we demonstrate how the metadata overhead imposed by DIA tools can be reduced by means of appropriate metadata encoding tools.
Montreux
Timmerer, Christian
Panis, Gabriel
Delfosse, Eric
Proceedings of the 6th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2005)
Dufaux, Frederic
Ebrahimi, Touradj
Strintzis, Michael
283990067X
EN
jan
4
https://www.itec.aau.at/bib/files/TR_Piece-wiseMultimediaContentAdaptationInStreamingAndConstrainedEnvironments_Apr2005.pdf
WIAMIS
none
Piece-wise Multimedia Content Adaptation in Streaming and Constrained Environments
2005
The information revolution of the last decade has resulted in a phenomenal increase in the quantity of multimedia content available to an increasing number of different users with different preferences who access it through a plethora of devices and over heterogeneous networks. In order to address the amount of different content types, MPEG-21 Digital Item Adaptation (DIA) introduces interoperable description tools which enable coding format independent adaptation. Bandwidthefficient transport of the content to terminals with different capabilities and through a variety of access networks with various characteristics requires adaptation facilities not only on the server but also within the network. In this paper we present transport mechanisms for MPEG-21-based metadata enabling generic adaptation within the network. Three different transport mechanisms for delivering this metadata in conjunction with the corresponding multimedia content are evaluated and a payload format for the transport of this metadata is presented. Furthermore, we performed measurements which demonstrate the bandwidth benefits of our distributed adaptation approach compared to server-centric adaptation in a multicast scenario. Finally, we applied various encoding formats for the metadata which further reduces the metadata overhead.
Orlando, USA
Ransburg, Michael
Timmerer, Christian
Hellwagner, Hermann
Proceedings of the First International Conference on Multimedia Services Access Networks (MSAN 2005)
10.1109/MSAN.2005.1489936
N, A
0-7803-9319-8
MPEG-21 Digital Item Adaptation; distributed multimedia adaptation; metadata transport
EN
jun
25-29
https://www.itec.aau.at/bib/files/Transport Mechanisms for Metadata-driven Distributed Multimedia Adaptation.pdf
IEEE CS Press
none
Transport mechanisms for metadata-driven distributed multimedia adaptation
2005
The growing demand for multimedia information by different types of users equipped with a large variety of devices and connecting through different kinds of networks results in an increasing amount of different multimedia formats. Research is currently concentrating on the adaptation of the contents in order to provide Universal Multimedia Access (UMA) for the content consumer. But this does not solve the problem of the content provider, who still has to signal this variety of different multimedia formats to the consumer. In this contribution, we show a way to stream any type of multimedia format based on generic hint information. This hint information is based on a generic bit stream syntax description (gBSD) which is used for format-independent content adaptation within the MPEG-21 Multimedia Framework. Ultimately, this can lead to a frame-work which allows generic streaming and generic adaptation anywhere in the network.
Grindelwald
Ransburg, Michael
Hellwagner, Hermann
Proceedings of IASTED International Conference on Internet and Multimedia Systems and Applications (EuroIMSA 2005)
Hamza, Mohamed H
Streaming, Metadata, Multimedia, MPEG-21, XML andDigital Item Adaptation.
EN
feb
324-330
ACTA Press
none
Generic Streaming of Multimedia Content
2005
In this paper, we present a prototype application that receives Digital Video Broadcast (DVB) TV streams on a PC, extracts semantic and syntactic metadata from the MPEG-2 Transport Stream (TS), maps them to MPEG-7 compliant descriptors, and packs these metadata and the associated multimedia content into standard compliant MPEG-21 Digital Items (DIs). In this form, i.e., as DIs, the DVB content can be searched and accessed by clients such as PCs and PDAs, and can be transported over IP networks. The DVB server can be used as a live source of multimedia content to demonstrate multimedia streaming (e.g., via RTP) and adaptation to diverse devices.
Zadar
Prangl, Martin
Timmerer, Christian
Leopold, Klaus
Hellwagner, Hermann
ELMAR, 2005. 47th International Symposium
Grgic, M
Grgic, S
Kos, T
DVB, metadata, MPEG-7, MPEG-21, Digital Items
EN
jun
135-138
https://www.itec.aau.at/bib/files/DVB-based MPEG-21 Digital Items for Adaptive Multimedia Streaming.pdf
IEEE Xplore
none
DVB-based MPEG-21 digital items for adaptive multimedia streaming
2005
Video streaming systems in best effort networks have to somehow cope with dynamically changing bandwidth. Various scalable video codecs allow intra-stream adaptation by use of temporal, spatial, or quality (SNR) scalability; optimizations for finer grained scalability are available as layered coding and FGS techniques. However, if there is no scalable video stream at hand, stream switching among pre-encoded stream versions of different bitrates and qualities allows at least coarse-grained adaptation. Those different approaches compete to be the most efficient solution for adaptive video streaming. However, this paper will show that the efficacy is significantly increased by combining those approaches. As will be discussed, the combination of coarse-grained stream switching and temporal intra-stream adaptation offers better visual results and more stable client buffer behavior than the denoted approaches used separately.
Shanghai
Kropfberger, Michael
Hellwagner, Hermann
Proc. of the IEEE International Workshop on Multimedia Signal Processing
10.1109/MMSP.2005.248654
Zhuang, Xinhua
Sorensen, J
Wu, Qiang
Qing, Shi Y
Ostermann, J
Man, H
Goldgof, D
0-7803-9288-4
EN
nov
373-376
https://www.itec.aau.at/bib/files/Combining stream switching with fine-grained intra-stream adaptation for adaptive video streaming.pdf
IEEE Computer Society
IEE
none
Combining Stream Switching with Fine-grained Intra-stream Adaptation for Adaptive Video Streaming
2005
The diversity of end-terminal and access network capabilities as well as the dynamic nature of wireless connections pose significant challenges to providers of multimedia streaming services. In this paper, we present a system based on MPEG-21 Digital Item Adaptation (DIA) technologies that automatically adapts scalable multimedia resources, like upcoming MPEG-21 Scalable Video Coding (SVC) streams, in a generic and transparent way to the user and session context. This context includes terminal and network capabilities as well as user characteristics. A server side adaptation engine reacts to context changes by dynamic decision taking and accordingly modified bitstream adaptation. Furthermore, novel concepts are presented that facilitate multimedia adaptation in a distributed fashion along the delivery path.
Genova, Italy
Hutter, Andreas
Amon, Peter
Panis, Gabriel
Delfosse, Eric
Ransburg, Michael
Hellwagner, Hermann
Image Processing, 2005. ICIP 2005. IEEE International Conference on
IEEE
EN
sep
716-719
https://www.itec.aau.at/bib/files/Automatic Adaptation of streaming multimedia content in a dynamic and distributed environment.pdf
IEEE Computer Society
none
Automatic Adaptation of Streaming Multimedia Content in a Dynamic and Distributed Environment
2005
In multimedia applications, XML is being increasingly used to represent metadata; examples are MPEG-7 multimedia description schemes and MPEG-21 usage environment descriptions. As with the media data, the size of, or the overhead induced by, the XML metadata is important, particularly when used on constrained mobile devices. Therefore, compression (binary encoding) of the XML data becomes relevant to reduce this overhead. Within the MPEG-7 standardization effort, a Binary Format for Metadata (BiM) was developed, ´providing good compression efficiency and facilitating random access into, and manipulation of, the binary encoded bit stream. However, using binary encoded XML should not introduce interoperability issues with existing applications, nor add additional complexity to new applications. In this paper we investigate a solution for this issue by handling the binary encoded XML data by the XML parser. As such, applications do not need to be aware of the type of encoding of the XML data. In this paper, we introduce such an XML parser and evaluate its usability in different scenarios. We measure the memory requirements and compare the processing speed of parsing binary encoded XML to plain text XML.
Zürich, Schweiz
De Sutter, Robbie
Timmerer, Christian
Hellwagner, Hermann
Van de Walle, Rik
Proceedings of IASTED International Conference on Internet and Multimedia Systems and Applications (EuroIMSA 2005)
Hamza, M H
14827905
Multimedia Information Systems, Multimedia Communication Systems, Multimedia Metadata, Binary Encoded XML, MPEG-7 BiM
EN
jan
343-348
https://www.itec.aau.at/bib/files/Multimedia Metadata Processing.pdf
ACTA Press
none
Multimedia Metadata Processing: A Format Independent Approach
2005
Digital Item Adaptation (DIA) ist der jüngste Standard im Rahmen des ISO/IEC MPEG-21 Multimedia Frameworks. Dieser Standard spezifiziert Deskriptoren und Konzepte (Tools) für die interoperable Kommunikation und ggf. Adaption von komplexen digitalen multimedialen Objekten, sog. Digital Items. Schwierigkeiten der Kommunikation und ggf. die Notwendigkeit der Adaption multimedialer Inhalte entstehen durch die Heterogenität und Beschränkungen der durchlaufenen Netzwerke (z.B. im heutigen Internet) und der benutzten Endgeräte sowie durch unterschiedliche Präferenzen und Profile der Nutzer. Dieser Artikel beschreibt eine endgeräte- und codierformat-unabhängige Komponente zur Adaption von Digital Items an verschiedene mobile Endgeräte und Netzcharakteristika.
Bonn
Timmerer, Christian
Hellwagner, Hermann
Informatik 2004 : Informatik verbindet; Band 2, Beiträge der 34. Jahrestagung der Gesellschaft für Informatik e.V. (GI), Ulm, 20.-24. September 2004
Dadam, Peter
Reichert, Manfred
3885793792
978-3885793793
3-88579-380-6
DE
jan
301-305
https://www.itec.aau.at/bib/files/Interoperable multimediale Kommunikation im Internet.pdf
Gesellschaft für Informatik
Lecture Notes in Informatics, Proceedings
none
Interoperable multimediale Kommunikation im Internet mittels MPEG-21 Digital Item Adaptation
2004
The rapid evolution in the hardware sector brought up various (mobile) end user devices like PDAs or cell phones on which online multimedia content can be consumed. Due to different capabilities of these devices as well as individual user preferences, the original multimedia resources have to be adapted in order to fit the specific devices’ constraints and to meet the users’ requirements. Given the high variety of possible adaptation operations both on the format as well as the content level, an intelligent multimedia server must be able to integrate multiple existing and specialized adaptation tools. In this paper, we demonstrate how the usage of modular software components and declarative descriptions of component behavior enables us to develop extensible multimedia adaptation systems. The precise semantics of the utilized functionality description mechanism as well as the defined vocabulary from existing and emerging multimedia standards also allows us to automatically assemble adaptation chains that are executed on a given resource involving multiple, externally provided software components.
Los Alamitos, USA
Leopold, Klaus
Jannach, Dietmar
Hellwagner, Hermann
Multimedia Software Engineering
Werner, Bob
0-7695-2217-3
EN
dec
1-8
https://www.itec.aau.at/bib/files/A Knowledge and Component Based Multimedia Adaptation Framework.pdf
IEEE Computer Society
none
A Knowledge and Component Based Multimedia Adaptation Framework
2004
This paper introduces the principal approach and describes the basic architecture and current implementation of the knowledge-based multimedia adaptation framework we are currently developing. The framework can be used in Universal Multimedia Access scenarios, where multimedia content has to be adapted to specific usage environment parameters (network and client device capabilities, user preferences). Using knowledge-based techniques (state-space planning), the framework automatically computes an adaptation plan, i.e., a sequence of media conversion operations, to transform the multimedia resources to meet the client's requirements or constraints. The system takes as input standards-compliant descriptions of the content (using MPEG-7 metadata) and of the target usage environment (using MPEG-21 Digital Item Adaptation metadata) to derive start and goal states for the planning process, respectively. Furthermore, declarative descriptions of the conversion operations (such as available via software library functions) enable existing adaptation algorithms to be invoked without requiring programming effort. A running example in the paper illustrates the descriptors and techniques employed by the knowledge-based media adaptation system.
Bellingham, WA
Leopold, Klaus
Jannach, Dietmar
Hellwagner, Hermann
Proceedings of SPIE, Internet Multimedia Mangement Systems V
10.1117/12.577420
Volume 5601
Smith, John R
Zhang, Tong
Panchanathan, Sethuraman
9780819455543
0277-786X
EN
oct
111-120
SPIE- The International Society for Optical Engineering
SPIE Proceedings Series
none
Knowledge-based media adaptation
2004
Modern video streaming servers should adapt, and switch quality levels of, the streamed data according to precise and timely feedback about the network conditions, and should also incorporate selective retransmissions of important reference frames (I- and P-VOPs). This paper evaluates two recent IETF Internet Drafts on RTP extensions for immediate feedback and retransmission and shows, in conjunction with temporal video adaptation, how a substantial visual quality gain can be achieved by using those extensions (up to 4.4 dB PSNR under lossy conditions).
kA
Kropfberger, Michael
Hellwagner, Hermann
Multimedia and Expo, 2004. ICME '04. 2004 IEEE International Conference on
10.1109/ICME.2004.1394593
Vol. 3
IEEE
0-7803-8603-5
0-7803-8604-3
EN
jun
1751-1754
https://www.itec.aau.at/bib/files/Evaluation of RTP immediate feedback and retransmission extensions.pdf
IEEE Xplore
none
Evaluation of RTP immediate feedback and retransmission extensions
http://www.icme2004.org
2004
If videos are streamed over heterogeneous networks like the Internet, severe bandwidth fluctuations can emerge which hamper seamless transmission to the end user. To overcome this issue, a video's quality and, as a consequence, its bandwidth requirements can be reduced. Quality reduction in the temporal domain (i.e., frame dropping) turned out to be a promising approach because it is fast and easy to perform. In this paper, we present different approaches for temporal video adaptation and we investigate their performance in terms of the achieved visual quality when applied on several videos. The results show that our QCTVA approach (quality controlled temporal video adaptation), based on PSNR evaluation of frames, yields superior quality.
kA
Kropfberger, Michael
Leopold, Klaus
Hellwagner, Hermann
Multimedia Signal Processing, 2004 IEEE 6th Workshop on
10.1109/MMSP.2004.1436384
IEEE
0-7803-8578-0
0-7803-8578-0
EN
jan
183-186
https://www.itec.aau.at/bib/files/Quality Variations of Different Priority-based Temporal Video Adaptation Algorithms.pdf
IEEE Xplore
none
Quality variations of different priority-based temporal video adaptation algorithms
2004
Abstract. Universal Multimedia Access (UMA), where users can consume any multimedia resource anywhere at any time, is the driving vision of ongoing ISO/IEC Moving Picture Experts Group (MPEG) standardization efforts. In that context, intelligent adaptation means that before resources are sent over the network, they are prepared according to the client’s device capabilities, the network conditions, or even the user’s content preferences. In this paper, we argue that Semantic Web Services can serve as a key enabling technology to achieve the goals of UMA. As the standards evolve, more and more specialized software tools will be available that provide specific functionalities for adapting the media in different dimensions. When the functionality of such tools is described declaratively with the means of Semantic Web Services technology, intelligent adaptation network nodes can be developed, capable of automatically composing multi-step adaptation sequences and dynamically integrating such services available on the Web. This paper describes the architecture and a prototypical implementation of an intelligent adaptation node that supports automatic, knowledge-based service composition which is made possible by the shared domain ontology defined in MPEG metadata standards.
Berlin, Heidelberg, New York
Jannach, Dietmar
Leopold, Klaus
Timmerer, Christian
Hellwagner, Hermann
Web Information Systems - WISE 2004
10.1007/978-3-540-30480-7_66
Zhou, Xiaofang
Su, Stanley
Papazoglou, Mike
Orlowska, Maria
Jeffery, Keith
0302-9743
EN
nov
641-652
Springer
LNCS
none
Toward Semantic Web Services for Multimedia Adaptation
2004
Multimedia content is becoming increasingly important in many areas not only for pure entertainment but also for commercial or educational purposes like, e.g., distance learning or online training. In parallel, the rapid evolution in the hardware sector brought up various new (mobile) end user devices like pocket PCs or mobile phones that are capable of displaying such content. Due to the different capabilities and usage environments of these devices, the basic multimedia content has to be adapted in order to fit the specific devices' capabilities and requirements, whereby such transformations typically include changes in the display size or quality adaptation. Based on the capabilities of the target device that can be expressed using recent multimedia standards like MPEG-21, these adaptation steps are typically carried out by the video server or a proxy node before the data is transferred to the client. In this paper, we present a software framework and implementation of such a multimedia server add-on that advances state-of-the-art technology in two ways. First, the framework supports the integration of various (already existing) multimedia transformation tools based on declarative interface and semantic capability descriptions in a way comparable to Semantic Web Services approaches. Second, by using the components' capability descriptions and the usage environment of the end user device, we employ a knowledge-based planning approach for dynamically constructing and executing the needed transformation program for a specific multi-media content request.
Berlin [u. a.]
Jannach, Dietmar
Leopold, Klaus
Hellwagner, Hermann
Proceedings of the 17th International Conference on Industrial & Engineering Applications of Artificial Intelligence & Expert Systems
Orchard, Robert
Yang, Chunsheng
Moonis, Ali
3-5402-2007-0
EN
may
144-153
Springer Verlag
LNCS
none
An extensible framework for knowledge-based multimedia adaptation
2004
In order to enable transparent and augmented use of multimedia resources across a wide range of networks and devices, the forthcoming MPEG-21 standard aims at integrating the various existing technologies for delivery and consumption of digital content in a common multimedia framework. Digital Item Adaptation is one of the core concepts of the framework that will support the adaptation of multimedia resources to device capabilities, underlying network characteristics, or the users preferences. The scope of the standardization, however, is limited to the definition of description tools and does not deal with the internals of the adaptation process itself. In this paper, we first discuss the requirements of the resource adaptation component of an adaptation engine. These requirements include, for instance, openness for the integration of external multimedia transforming tools as well as intelligent decision taking when determining the set of required adaptation steps. We also present a prototype of a simple video resource adaptation engine that completely relies on descriptions of the resource itself (MPEG-7), the usage environment of the resource (MPEG-21), as well as declarative descriptions of the transformation tools. The prototype employs a knowledge-based engine for finding and executing the needed adaptation sequences.
Lisboa, Portugal
Jannach, Dietmar
Leopold, Klaus
Hellwagner, Hermann
Timmerer, Christian
Proceedings of the 5th International Workshop on Image Analysis for Multimedia Interactive Services
Pereira, Fernando
Correia, Paulo Lobato
EN
apr
1-4
https://www.itec.aau.at/bib/files/A knowledge supported approach for multi-step media adaptation.pdf
Instituto Superior Téchnico
none
A Knowledge Based Approach for Multi-step Media Adaptation
2004
In multimedia applications, XML is being increasingly used to represent metadata; examples are MPEG-7 multimedia description schemes and MPEG-21 usage environment descriptions. As with the media data, the size of, or the overhead induced by, the XML metadata is important, particularly when used on constrained mobile devices. Therefore, compression (binary encoding) of the XML data becomes relevant to reduce this overhead. Within the MPEG-7 standardization effort, a Binary Format for Metadata (BiM) was developed, providing good compression efficiency and facilitating random access into, and manipulation of, the binary encoded bit stream. In order to support processing of metadata streams in the binary domain and making this task for client applications as simple as possible, we are developing a universal parser for handling both plain text and binary encoded XML-based metadata. The parser exposes a single interface making it transparent for the application whether a plain text or a binary XML document is being processed. As part of this effort, this paper provides a detailed study of five existing XML parser models and evaluates their applicability to serve as a model for parsing binary XML data, encoded using the BiM codec. Additionally, the parser models are investigated against important usage scenarios enabled by BiM, such as dynamic updates of XML data. From the five models, two are rejected and one is only applicable for domain specific applications. Of the remaining two, one model is proposed as preferred model because of different advantages over the other model.
Piscataway, USA
De Sutter, Robbie
Timmerer, Christian
Hellwagner, Hermann
Van de Walle, Rik
Proceedings of the International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS2004)
Ko, Sung Jea
0780386396
978-0780386396
EN
nov
1-6
https://www.itec.aau.at/bib/files/Evaluation of Models for Parsing Binary Encoded XML-based Metadata.pdf
IEEE
none
Evaluation of Models for Parsing Binary Encoded XML-based Metadata
2004
Adaptation is usually restricted to defensive, reactive media adaptation (often called stream-level adaptation). We argue that offensive, proactive, system-level adaptation deserves not less attention. If a distributed multimedia system cares for overall, end-to-end quality of service then it should provide a meaningful combination of both. We introduce an adaptive multimedia server (ADMS) and a supporting middleware which implement offensive adaptation based on a lean, flexible architecture. The measured costs and benefits of the offensive adaptation process are presented. We introduce an intelligent video proxy (QBIX), which implements defensive adaptation. The cost/benefit measurements of QBIX are presented elsewhere \citeSchojer03. We show the benefits of the integration of QBIX in ADMS. Offensive adaptation is used to find an optimal, user-friendly configuration dynamically for ADMS, and defensive adaptation is added to take usage environment (network and terminal) constraints into account.
Košice, Slovak Republic
Tusch, Roland
Böszörmenyi, Laszlo
Goldschmidt, Balázs
Hellwagner, Hermann
Schojer, Peter
Proceedings of ICETA 2003, 2nd International Conference on Emerging Telecommunications Technologies and Applications
Jakab, F
Cizmar, A
8089066674
80-89066-06-2
EN
sep
17-19
Elfa
none
Offensive and Defensive Adaptation in Distributed Multimedia Systems
2003
Due to the heterogeneity of the current terminal and network infrastructures, multimedia content needs to be adapted to specific capabilities of these terminals and network devices. Furthermore, user preferences and user environment characteristics must also be taken into consideration. The problem becomes even more complex by the diversity of multimedia content types and encoding formats. In order to meet this heterogeneity and to be applicable to different coding formats, the adaptation must be performed in a generic and interoperable way. As a response to this problem and in the context of MPEG-21, we present an approach which uses XML to describe the high-level structure of a multimedia resource in a generic way, i.e., how the multimedia content is organized, for instance in layers, frames, or scenes. For this purpose, a schema for XML-based bitstream syntax descriptions (generic Bitstream Syntax Descriptions or gBSDs) has been developed. A gBSD can describe the high-level structure of a multimedia resource in a coding format independent way. Adaptation of the resource is based on elementary transformation instructions formulated with respect to the gBSDs. These instructions have been separated from the gBSDs in order to use the same descriptions for different adaptations, e.g., temporal scaling, SNR scaling, or semantic adaptations. In the MPEG-21 framework, those adaptations can be steered for instance by the network characteristics and the user preferences. As a result, it becomes possible for coding format agnostic adaptation engines to transform media bitstreams and associated descriptions to meet the requirements imposed by the network conditions, device capabilities, and user preferences.
Orlando
Timmerer, Christian
Panis, Gabriel
Kosch, Harald
Heuer, Jörg
Hellwagner, Hermann
Hutter, Andreas
Proceedings of SPIE International Symposium ITCom 2003 on Internet Multimedia Managment Systems IV, Vol. 5242
N, A
0819451401
978-0819451408
Multimedia, Adaptation, Interoperability, XML, MPEG-21, Digital Item Adaptation
EN
jan
92-103
https://www.itec.aau.at/bib/files/Coding format independent multimedia content adaptation.pdf
SPIE Press
none
Coding format independent multimedia content adaptation using XML
2003
Due to the increasing availability and use of digital video data on the Web, video caching will be an important performance factor in the future WWW. We propose an architecture of a video proxy cache that integrates modern multimedia and communication standards. Especially we describe features of the MPEG-4 and MPEG-7 multimedia standards that can be helpful for a video proxy cache. QBIX supports real-time adaptation in the compressed and in the decompressed domain. It uses adaptation to improve the cache replacement strategies in the proxy, but also to realize media gateway functionality driven by the clients' terminal capabilities.
New York, USA
Schojer, Peter
Böszörmenyi, Laszlo
Hellwagner, Hermann
Penz, Bernhard
Podlipnig, Stefan
The Twelfth International World Wide Web Conference
Hencsey, Gusztáv
White, Bebo
1-58113-680-3
EN
jan
394-402
ACM
none
Architecture of a Quality Based Intelligent Proxy (QBIX) for MPEG-4 Videos
http://www.2003.org
2003
Multimedia streaming is becoming ever more popular. However, the Internet does not support streaming with its high bandwidth and low latency requirements very well. The problem is that QoS guarantees cannot be given. Hence, communication partners have to deal with rapidly changing connection parameters. This requires sophisticated streaming concepts that can handle these varying conditions using adaptation techniques. Adaptation methods can be dropping layers, dropping access units or transcoding the contents. But this places specific requirements on the underlying protocol. This paper identifies and discusses these requirements and analyzes how existing protocols can meet them. Unfortunately, none of the known protocols can meet all requirements. Hence, we propose a new adaptation-aware multimedia streaming protocol that can operate as required in the given Internet environment. Furthermore, we show how this protocol can be used to carry MPEG-4 audio-visual contents.
NA
Ohlenroth, Mathias
Hellwagner, Hermann
ICME 2003 Proceedings CD-Rom
Mercer, Billene
Cantu, St
Garza, Ch
Stewart, B
0-7803-7966-7
EN
jul
1-4
https://www.itec.aau.at/bib/files/A protocol for adaptation-aware multimedia streaming.pdf
NA
none
A Protocol for Adaptation-aware Multimedia Streaming
2003
Multimedia streaming is becoming more and more popular. Seamless video streaming in heterogeneous networks like the Internet turns out as almost impossible due to varying network conditions - streams must be adapted to the current network QoS. Temporal scalability is one of the most reasonable adaptation techniques because it is fast and easy to perform. Today's approaches simply drop frames out of a video without spending much effort on finding an intelligent dropping behavior. This usually leads to good adaptation results in terms of bandwidth consumption but also to suboptimal video quality within the given bounds. Our approach offers analysis of video streams to achieve the qualitatively best temporal scalability. For this reason, we introduce a data structure called modification lattice which represents all frame dropping combinations within a sequence of frames. On the basis of the modification lattice, qualityestimations on frame sequences can be performed. Moreover, a heuristic for fast and efficient quality computation in a modification lattice is presented. Experimental results illustrate that temporal video adaptation based on QCTVA information leads to a better video quality compared to "usual" frame dropping approaches. Furthermore, QCTVA offers frame priority lists for videos. Based on these priorities, numerous adaptation techniques can increase their overall performance when using QCTVA.
NA
Leopold, Klaus
Hellwagner, Hermann
Kropfberger, Michael
Proc. of SPIE
Vol. 5242
N, A
EN
sep
163-174
https://www.itec.aau.at/bib/files/QCTVA.pdf
NA
none
QCTVA - Quality Controlled Temporal Video Adaptation
2003
Multimedia is gaining ever more importance on the Internet. This increases the need for intelligent and efficient video caches. Typical Web proxies were not designed to efficiently support the caching of videos. A promising approach to improve caching efficiency is to adapt videos. With the availability of MPEG-4 it is possible to develop a standard compliant proxy that allows fast and efficient adaptation. We propose a modular design for an adaptive MPEG-4 video proxy that supports efficient full and partial video caching in combination with filtering options that are driven by the terminal capabilities of the client. We use the native scalability operations provided by MPEG-4 and use the emerging MPEG-7 standard to describe the scalability options for a video. The proxy parses the MPEG-7 description and decides, based on this description and the terminal capabilities of the client, which adaptation step to choose. Simple MPEG-4 audio-visual streams are supported by filter operations in the compressed domain that realize several temporal scaling algorithms and color reduction. In this paper, we will restrict ourselves to full video caching. The combination of adaptation with MPEG-4, MPEG-7 and client terminal capabilities is to the best of our knowledge unique and will increase the quality of service for end users.
Boston [u. a.]
Schojer, Peter
Böszörmenyi, Laszlo
Hellwagner, Hermann
Distributed and parallel systems: cluster and grid computing. Proceedings of International Conference on Distributed and Parallel Systems (DAPSYS 02), Linz, Austria.
Kascuk, Péter
Kranzlmüller, Dieter
Németh, Zsolt
Volkert, Jens
1-4020-7209-0
adaptation, MPEG-4, MPEG-7, adaptive proxy, caching
EN
aug
149-156
https://www.itec.aau.at/bib/files/An Adaptive MPEG-4 Proxy Cache.pdf
Kluwer Academic Publishers
The Kluwer international series in engineering and computer science
none
An Adaptive MPEG-4 Proxy Cache
2002
Multimedia streaming becomes ever more popular. The multimedia standard MPEG-4 has been designed to support scenes of different levels of complexity and applications with low bandwidth requirements up to very high bandwidth requirements. One protocol suitable to transfer this kind of data over IP networks is the real-time transport protocol (RTP). This report describes standardized and proposed payload formats that support the transport of MPEG-4 elementary streams over RTP connections. These RTP packetization formats are compared w.r.t. their suitability for the adaptation (scaling) of the media data within the network, i.e., by advanced routers or proxy caches. This adaptation process is governed by metadata that need to be transferred and inspected in conjunction with the media streams.
NA
Ohlenroth, Matthias
Hellwagner, Hermann
ICME Proceedings
IEEE
0-7803-7305-7
EN
mar
1-4
https://www.itec.aau.at/bib/files/RTP Packetization of MPEG-4 Elementary Streams.pdf
IEEE Xplore
none
RTP Packetization of MPEG-4 Elementary Streams
http://www.icme2002.org/
2002
In this paper we present the design, architecture and implementation of the A2QM3 System. It provides programmers re-usable QoS-aware Control Objects to enable building a complete middleware for adaptive applications over active networks. We introduce the programming model, the system architecture, and show the parts that make this system a full-featured middleware supporting QoS-aware reliable stream-oriented communication, communication using the request/reply-based CORBA model and real-time streaming for continuous multimedia contents.
Washington, DC, USA
Csizmazia, Balázs
Hellwagner, Hermann
Proceedings Fourth International Workshop on Active Middleware Services
N, A
0-7695-1721-8
EN
jan
19-27
https://www.itec.aau.at/bib/files/The design and implementation of the A2QM3 System.pdf
IEEE Computer Society
none
The design and implementation of the A2QM3 System
2002
Adaptation is becoming an increasingly important tool for resource and media management in distributed multimedia systems. Best-effort scheduling and worst-case reservation of resources are two extreme cases, none of them well suited to cope with large-scale, dynamic multimedia systems. The middle course can be met by a system which dynamically adapts its data, resource requirements, and processing components to achieve user satisfaction. Nevertheless, there is no agreement about the questions, where, when, what and who should adapt. A number of papers have been published in recent years, where adaptation is a central issue, however, in most different interpretations and generally in a somehow limited scope; e.g.,[1, 2, 8, 9, 10, 12]. A distributed multimedia system comprises several types of components, such as media servers, meta-databases, proxies, routers, clients. Also, a large number of adaptation possibilities exist, from simple frame dropping up to virtual server systems which dynamically allocate new resources on demand. The main question is, which kind of component can be best used for what kind of adaptation. In the ADMITS project (Adaptation in Distributed Multimedia IT Systems), we are seeking for answers to exactly this basic question, and to a number of related questions.
New York
Böszörmenyi, Laszlo
Döller, Mario
Hellwagner, Hermann
Kosch, Harald
Libsie, Mulugeta
Schojer, Peter
Proceedings of the tenth ACM international conference on Multimedia
Les Pins, Juan
1-58113-620-X
EN
jan
429-430
ACM
none
Comprehensive Treatment of Adaptation in Distributed Mulimedia Systems in the ADMITS Project
http://portal.acm.org/citation.cfm?doid=641007.641101
2002
Berlin [u. a.]
Kosch, Harald
Böszörmenyi, Laszlo
Hellwagner, Hermann
Proceedings of the 12th International Conference on Database and Expert Systems Application - DEXA 2001, Munich, Germany, September 3-5, 2001
Mayr, HC
Lazansky, J
Quichmayr, G
Vogel, P
0302-9743
EN
sep
744-753
Springer Verlag
LNCS
none
Modeling Quality Adaptation Capabilities of Audio-Visual Data
2001
This paper presents an inexpensive cluster-based QoS networking testbed that can be employed to \emulate" different networks for multimedia communication ex-periments. Such a network can be built using standard PC and Ethernet hardware and open-source software components, e.g., IP routing and traÆc control avail- able in recent Linux kernels as well as a Differentiated Services package built atop these building blocks. The testbed can exibly be configured to model various link bandwidths as well as IP routers capable of classifying, queuing (with various disciplines), forward-ing and/or dropping packets and shaping traÆc. The QoS components and facilities of the testbed are in-troduced and initial performance analysis experiments and results are reported. A simple video streaming application under QoS control is presented to show the usefulness of the testbed.
--
Hellwagner, Hermann
Kargl, Erich
SCI 2001 Proceedings of the 5th World Multi-Conference on Systemics, Cybernetics and Informatics, Volume XV, IEEE CS, July 2001
Callaos, N
Badawy, W
Bozinovski, S
980-07-7552-8
multimedia communications, quality of service, QoS, networking testbed, routing, Linux
EN
jul
362-367
https://www.itec.aau.at/bib/files/A Cluster-Based QoS Testbed for Multimedia Communications.pdf
IEEE
none
A Cluster-Based QoS Testbed for Multimedia Communications
2001
Höhenkirchen
Böszörmenyi, Laszlo
Hellwagner, Hermann
Kosch, Harald
Elektronische Geschäftsprozesse: Grundlagen, Sicherheitsaspekte, Realisierungen, Anwendungen. Tagungsband zur gemeinsamen Arbeitskonferenz GI/VOI/BITKOM/OCG/TeleTrusT
Horster, Patrick
3-936052-00-X
EN
jan
471-481
it Verlag
IT Security & IT Management
none
Multimedia Technologies for E-Buisness Systems and Process
2001
This paper describes an unconventional way to apply a performance analysis tool for parallel programs (Vampir) to understand and tune the performance of the real-time voice and data communication software running on top of Frequentis’ V4 switch. The execution schedule of the strictly time-triggered V4 switching software is computed off-line; analyzing the schedule to identify e.g. performance bottlenecks used to be a complex and time-consuming process. We present our approach to transform the V4 software schedule’s information into Vampir trace files and use this tool’s facilities to provide a visualization of the schedule. A case study illustrates the benefits of this approach.
Norwell, MA, USA
Hellwagner, Hermann
Leopold, Klaus
Schlatterbeck, Ralf
Weich, Carsten
Proceedings Distributed and Parallel Systems
Kascuk, Peter
Kotsis, Gabriele
This paper describes an unconventional way to apply a performance analysis tool for parallel programs (Vampir) to understand and tune the performance of the real-time voice and data communication software running on top of Frequentis’ V4 switch. The execution schedule of the strictly time-triggered V4 switching software is computed off-line; analyzing the schedule to identify e.g. performance bottlenecks used to be a complex and time-consuming process. We present our approach to transform the V4 software schedule’s information into Vampir trace files and use this tool’s facilities to provide a visualization of the schedule. A case study illustrates the benefits of this approach.
DE
sep
57-60
https://www.itec.aau.at/bib/files/2000-0084-HHKL.pdf
Kluwer Academic Publishers
none
Performance Tuning of Parallel Real-Time Voice Communication Software
2000
The Virtual Interface (VI) Architecture standard was developed to satisfy the need for a high-throughput, low-latency communication system required for cluster computing. This paper presents the results of a performance study of one VI Architecture hardware implementation, the Giganet cLAN (Cluster LAN). The focus of the study is to assess and compare the performance of different VI Architecture data transfer modes and specific features that are available to higher-level communication software like MPI, in order to aid the implementor to decide which VI Architecture options to employ for various communication scenarios. Examples of such options include the use of send/receive vs. RDMA data transfers, polling vs. blocking to check completion of communication operations, multiple VIs, completion queues, and scatter capabilities of VI Architecture.
[Athens, Ga.]
Hellwagner, Hermann
Lachowitz, Markus
Ohlenroth, Matthias
Proceedings International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA´2000), June 26, 2000, Las Vegas, Vol. 5
DOI:10.1016/S0167-739X(01)00060-7
Arabnia, Hamid R
1-892512-51-3
EN
jan
2615-2621
https://www.itec.aau.at/bib/files/2000-0079-HHML.pdf
CSREA Press
none
Exploring the Performance of VI Architecture Communication Features in the Giganet Cluster LAN
2000
N, A
Schulz, Martin
Hellwagner, Hermann
Proceedings of SCI-Europe ´98
N, A
EN
sep
59-67
N, A
none
Global Virtual Memory based on SCI-DSM
1998
Seattle, WA, USA
Schulz, Martin
Hellwagner, Hermann
Proceedings of 2nd USENIX Windows NT Symposium
N, A
1-8804-4695-2
EN
aug
-
USENIX Association
none
Extending NT Virtual Memory by SCI-based Hardware DSM
1998
N, A
Richter, Harald
Kleber, Richard
Hellwagner, Hermann
Proceedings of the High Performance Computing Symposium
N, A
Cluster Computing, Scalable Coherent Interface, Banyan Networks
EN
apr
-
https://www.itec.aau.at/bib/files/1998-0050-RiKH.pdf
N, A
none
Cost-Efficient SCI-based Banyan Networks
1998
This paper describes the design of a common message passing layer for implementing both MPI and PVM over the SCI interconnect in a workstation or PC cluster. The design is focused at obtaining low latency. The message layer encapsulates all necessary knowledge of the underlying interconnect and operating system. Yet, we claim that it can be used to implement such different message passing libraries as MPI and PVM without sacrificing efficiency. Initial results obtained from using the message layer in SCI clusters are presented.
NA
Eberl, Michael
Hellwagner, Hermann
Herland, Bjarne Geir
Proceedings of HPCN-Europe 98
Sloot, Peter
Bubak, Marian
Hertzberger, Bob
978-3-540-64443-9
EN
apr
576-587
Springer Verlag
LNCS
none
Common Messaging Layer for MPI and PVM over SCI
1998
München
Hellwagner, Hermann
Informatik-Handbuch
Rechenberg, Peter
Pomberger, Gustav
3-446-18691-3
DE
sep
239-255
Carl Hanser Verlag
none
Arbeitsspeicher- und Bussysteme
1997
Low latencies for small messages are an important factor of efficient fine-grained parallel computation. The Active Messages concept provides this minimal overhead by eliminating certain parts of the critical path of sending and receiving messages, that is the context switch into the operating system kernel when using user-mode I/O, and multiple buffering in the network layer. Hardware-supported distributed shared memory (DSM) architectures exhibit various properties that make them particularly useful for an implementation of the aforementioned messaging mechanisms. This paper thus describes the concept, implementation, and the performance of a DSM-based Active Messages layer.
Las Vegas, Nevada, USA
Hellwagner, Hermann
Karl, Wolfgang
Leberecht, Markus
Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, 1997: PDPTA
Arabnia, Hamid R
0-9648666-8-4
Distributed Shared Memory, Active Messages, User-Level Communication, Scalable Coherent Interface
EN
jan
8
https://www.itec.aau.at/bib/files/1997-0047-HeLe.pdf
CSREA Press
none
Fast Communication Mechanisms--Coupling Hardware Distributed Shared Memory and User-Level Messaging
1997
To enable the efficient utilization of clusters of workstations it is crucial to develop a stable and rich software infrastructure. The ESPRIT Project SISCI will provide two widely used message-passing interfaces, MPI and PVM, as well as a POSIX compliant, distributed thread package (Pthreads) on multiple SCI-based clusters. This paper features motivation and background on this projects as well as details of the two core components: the common messaging layer and the Pthreads package.
N, A
Eberl, Michael
Hellwagner, Hermann
Herland, Bjarne Geir
Schulz, Martin
Tagungsband zum 1. Workshop Cluster Computing
Rehm, Wolfgang
EN
nov
49-61
https://www.itec.aau.at/bib/files/10.1.1.39.9157.pdf
N, A
Chemnitzer-Informatik-Berichte
none
SISCI - Implementing a Standard Software Infrastructure on an SCI Cluster
1997
Active Messages haben sich als effizientes Kommunikationsverfahren insbesondere auf Kommunikationstechnologien durchgesetzt, die einen direkten Zugriff des Benutzers ohne Intervention des Betriebssystems zulassen. Als Nachteil der leichtgewichtigen Kommunikation erwiesen sich jedoch die nicht ausreichenden Schutzmechanismen, vor allem bei der Verwendung mehrerer Prozesse, die sich gleichzeitig einer Active-Message-Bibliothek bedienen. Die Spezifikation 2.0 der Berkeley-Active-Messages unternimmt nun den Versuch, f¨ur das bekannte und schnelle Kommunikationsverfahren Schutzabstraktionen vorzusehen. Im Rahmen dieser Arbeit wird die Implementation eines solchen Active-Message-Layers der Version 2.0 auf einem Cluster von SCI-gekoppelten Arbeitsplatzrechnern beschrieben. Wir k¨onnen zeigen, daß die zus¨atzlichen Schutzmechanismen nur wenig Einfluß auf die Leistung haben und somit der Vorteil der Active Messages, die leichtgewichtige, feingranulare Kommunikation, erhalten bleibt.
N, A
Eberl, Michael
Hellwagner, Hermann
Karl, Wolfgang
Leberecht, Markus
Architektur von Rechensystemen: Arbeitsteilige Systemarchitekturen - Konzepte, Lösungen, Anwendungen, Trends (ARCS´97)
Tavangarian, Djamshid
3-8007-2295-X
DE
sep
-
https://www.itec.aau.at/bib/files/1997-0043-EbHL.pdf
VDE Verlag
Vorträge der 14. ITG/GI Fachtagung ARCS
none
Sicherheit und Effizienz in einer Active-Message-Kommunikationsschicht
1997
N, A
Acher, Georg
Hellwagner, Hermann
Karl, Wolfgang
Leberecht, Markus
Arbeitsplatz-Rechensysteme: Anwendungen, Architekturen, Betriebssysteme und Netzwerke
N, A
3-9235-3261-X
DE
jan
-
N, A
none
Eine PCI-SCI-Adapterkarte für ein PC-Cluster mit verteiltem gemeinsamen Speicher
1997
N, A
Hellwagner, Hermann
Zoraja, Ivan
Sunderam, Vaidy
Proceedings PVM User Group Meeting
Bode, Arndt
Dongarra, Jack
Ludwig, Thomas
Sunderam, Vaidy
EN
feb
-
Springer
none
PVM Data Transfers on SCI Workstation Clusters
1996
N, A
Bode, Arndt
Gerndt, Michael
Hackenberg, R
Hellwagner, Hermann
Proceedings of IPPS '96, The 10th International Parallel Processing Symposium
N, A
0-8186-7255-2
EN
apr
-
IEEE Computer Society
none
High-Level Programming Models and Supportive Environments (HIPS´96)
1996
N, A
Böckle, Günter
Hellwagner, Hermann
Innovationen bei Rechen- und Kommunikationssystemen, Eine Herausforderung für die Informatik
Wolfinger, Bernd E
3-5405-8313-0
EN
aug
310-317
Springer Verlag
none
Systematic Assessment of Computer Systems Architectures
1994
Our work explores the practical relevance of Randomized Shared Memory (RSM), a theoretical concept that has been proven to enable an (asymptotically) optimally efficient implementation of scalable and universal shared memory in a distributed-memory parallel system. RSM (address hashing) pseudo-randomly distributes global memory addresses throughout the nodes' local memories. High memory access latencies are masked through massive parallelism. This paper introduces the basic principles and properties of RSM and analyzes its practical efficiency in terms of constant factors through simulation studies, assuming a state-of-the-art parallel architecture. Bottlenecks in the architecture are pointed out, and improvements are being made and their effects assessed quantitatively. The results show that RSM efficiency is encouragingly high, even in a non-optimized architecture. We propose architectural features to support RSM and conclude that RSM may indeed be a feasible shared-memory implementation in future massively parallel computers.
London, UK
Hellwagner, Hermann
Parallel Computer Architectures: Theory, Hardware, Software, Applications
Arndt, Bode
Dal Cin, Mario
3-540-57307-0
EN
jan
102-117
Springer Verlag
LNCS
none
Randomized Shared Memory - Concept and Efficiency of a Scalable Shared Memory Scheme
1993
This paper analyzes the efficiency of Randomized Shared Memory (RSM) in terms of constant factors. RSM or memory hashing, that is, pseudorandom distribution of global memory addresses throughout local memories in a distributed-memory parallel system, has been proven to enable an (asymptotically) optimally efficient implementation of scalable and universal shared memory. High memory access latencies are hidden through massive parallelism. Our work examines the practical relevance and feasibility of this potentially significant theoretical result. After an introduction of the background, principles, and desirable properties of RSM and an outline of the approach to determine RSM efficiency, the major results of our simulations are presented. The results show that RSM efficiency is encouragingly high (up to 20% efficiency of idealized shared memory), even in an architecture modelled on the basis of state-of-the-art technology. Performance-limiting factors are identified from the results and architectural features to increase efficiency are proposed, most notably extremely fast process switching and a combining network. Several novel machine designs document the increased interest in RSM and hardware support.
Berlin-Heidelberg
Hellwagner, Hermann
Parallel Processing: CONPAR 92 - VAPP V, Second Joint International Conference on Vector and Parallel Processing
Bougé, Luc
Cosnard, Michel
Robert, Yves
Trystram, Denis
3-540-55895-0
EN
sep
429-440
Springer
LNCS
none
On the Practical Efficiency of Randomized Shared Memory
1992