[3] | Anatoliy Zabrovskiy, Evgeny Kuzmin, Evgeny Petrov, Christian Timmerer, Christopher Mueller, AdViSE: Adaptive Video Streaming Evaluation Framework for the Automated Testing of Media Players, In Proceedings of the 8th ACM on Multimedia Systems Conference (MMSys'17) (Kuan-Ta Chen, ed.), ACM, New York, NY, USA, pp. 4, 2017.
[bib] [doi] [pdf] [abstract]
Abstract: Today we can observe a plethora of adaptive video stream- ing services and media players which support interoperable formats like DASH and HLS. Most of the players and their rate adaptation algorithms work as a black box. We have de- veloped a system for easy and rapid testing of media players under various network scenarios. In this paper, we introduce AdViSE, the Adaptive Video Streaming Evaluation frame- work for the automated testing of adaptive media players. The presented framework is used for the comparison and testing of media players in the context of adaptive video streaming over HTTP in web/HTML5 environments. The demonstration showcases a series of experiments with different media players under given context conditions (e.g., network shaping, delivery format). We will also demonstrate the real-time capabilities of the framework and offline anal- ysis including several QoE metrics with respect to a newly introduced bandwidth index.
|
[2] | Benjamin Rainer, Christian Timmerer, Markus Waltl, Recommendations for the Subjective Evaluation of Sensory Experience, In 4th International Workshop on Perceptual Quality of Systems 2013 (PQS 2013) (Raimund Schatz, ed.), IEEE, Vienna, Austria, pp. 1-6, 2013.
[bib] [abstract]
Abstract: Selecting and adopting the appropriate assessment method for conducting subjective quality assessments is a challenging task. The method decides whether the assessment is successful in delivering the correct answers to previously set up hypotheses. Therefore, in this paper we provide recommendations on test methods used in the domain of Sensory Experience. The proposed test methods comprise single stimulus and double stimulus methods. These test methods were used in previous studies and are presented in combination with the results of the subjective quality assessments with which they were used. Furthermore, we briefly outline our test setup, test design, and test content for assessing Sensory Experience which have been validated through conducted assessments.
|
[1] | Stefan Lederer, Christopher Mueller, Benjamin Rainer, Christian Timmerer, Hermann Hellwagner, Adaptive Streaming over Content Centric Networks in Mobile Networks using Multiple Links, In In Proceedings of the IEEE ICC'13 - Workshop on Immersive & Interactive Multimedia Communications over the Future Internet (Pedro Assuncao, Luigi Atzori, Tasos Dagiuklas, Ahmet Kondoz, eds.), IEEE, Budapest, pp. 687-691, 2013.
[bib][url] [pdf] [abstract]
Abstract: This paper presents the usage of Content Centric Networking (CCN) for adaptive multimedia streaming in mobile environments, leveraging the recent ISO/IEC MPEG Dynamic Adaptive Streaming over HTTP (DASH) standard. The performance of DASH over CCN is evaluated using real-world mobile bandwidth traces and compared to previous evaluations of different DASH-based as well as proprietary systems. As there are no client-server connections in CCN, it offers the possibility to transfer data from multiple sources as well as over multiple links in parallel, which is definitely an important feature, e.g., for mobile devices offering multiple network links. This functionality is used and evaluated in this paper in combination with DASH, making it possible to dynamically choose the best performing link for media streaming, which is a clear advantage over DASH using HTTP and the TCP/IP protocol stack. The evaluation therefore investigates DASH over CCN in two scenarios using synthetic and real-world mobile bandwidth traces respectively, showing a significantly better performance than conventional DASH using only one connection.
|