[827] | Jeroen van der Hooft, Maria Torres Vega, Tim Wauters, Hemanth Kumar Ravuri, C. Timmerer, Hermann Hellwagner, Filip De Turck, Towards 6DoF virtual reality video streaming: status and challenges, In IEEE COMSOC MMTC COMMUNICATIONS - FRONTIERS, vol. 14, no. 5, pp. 30-37, 2019.
[bib][url] [abstract]
Abstract: In the last few years, delivery of immersive video with six degrees of freedom (6DoF) has become an important topic for content providers. Recent technological advancements have resulted in affordable head-mounted displays, allowing a broad range of users to enjoy Virtual Reality (VR) content. Service providers such as Facebook1and YouTube2were among the first to provide 360°video, using the principle of HTTP Adaptive Streaming (HAS) to deliver the content to the enduser. In HAS, the content is encoded using several quality representations, temporally segmented into chunks of one to ten seconds and stored on one or multiple servers within a content delivery network. Based on the perceived network conditions, the device characteristics, and the user's preferences, the client can then decide on the quality of each of these segments[1]. Having the ability to adapt the video quality, this approach actively avoids buffer starvation, and therefore results in smoother playback of the requested content and a higher Quality of Experience (QoE) for the end user[2]. The introduction of 360° video provides the user with three degrees of freedom to move within an immersive world, allowing changes in the yaw, roll, and pitch.In the last few years, multiple solutions have been proposed to efficiently deliver VR content through HAS, focusing, for instance, on foveas-and tile-based encoding, improved viewport prediction (i.e., prediction of the user’s head movement in the near future in order to buffer useful high-quality content), and application layer optimizations [3]. In these works, however, the location of the user remains fixed to the position of the camera within the scene. Recently, significant research efforts have been made to realize 6DoF for streamed video content, i.e., the user may experience three additional degrees of freedom by being able to change the viewing position in a video scene. These efforts are promising, but significant research contributions will be required in order to realize its full potential. In this paper, an overview of existing 6DoF solutions is presented, and key challenges and opportunities are highlighted.
|
[826] | Cise Midoglu, Anatoliy Zabrovskiy, Ozgu Alay, Daniel Hoelbling-Inzko, Carsten Griwodz, Christian Timmerer, Docker-Based Evaluation Framework for Video Streaming QoE in Broadband Networks, In Proceedings of the 27th ACM International Conference on Multimedia, ACM New York, pp. 2288-2291, 2019.
[bib][url] [doi] |
[825] | Christian Timmerer, Anatoliy Zabrovskiy, Automating QoS and QoE Evaluation of HTTP Adaptive Streaming Systems, In ZTE COMMUNICATIONS, vol. 17, no. 1, pp. 18-24, 2019.
[bib][url] [doi] [abstract]
Abstract: Streaming audio and video content currently accounts for the majority of the In⁃ternet traffic and is typically deployed over the top of the existing infrastructure. We arefacing the challenge of a plethora of media players and adaptation algorithms showing dif⁃ferent behavior but lacking a common framework for both objective and subjective evalua⁃tion of such systems. This paper aims to close this gap byproposing such a framework,de⁃scribing its architecture,providing an example evaluation, anddiscussing open issues.
|
[824] | Wen Ji, Zhu Li, H. Vincent Poor, Christian Timmerer, Wenwu Zhu, Guest Editorial Multimedia Economics for Future Networks: Theory, Methods, and Applications, In IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, vol. 37, no. 7, pp. 1473-1477, 2019.
[bib][url] [doi] [abstract]
Abstract: With the growing integration of telecommunication networks, Internet of Things (IoT), and 5G networks, there is a tremendous demand for multimedia services over heterogeneous networks. According to recent survey reports, mobile video traffic accounted for 60 percent of total mobile data traffic in 2016, and it will reach up to 78 percent by the end of 2021. Users’ daily lives are inundated with multimedia services, such as online video streaming (e.g., YouTube and Netflix), social networks (e.g., Facebook, Instagram, and Twitter), IoT and machine generated video (e.g, surveillance cameras), and multimedia service providers (e.g., Over-the-Top (OTT) services). Multimedia data is thus becoming the dominant traffic in the near future for both wired and wireless networks.
|
[823] | Abdelhak Bentaleb, Christian Timmerer, Ali C. Begen, Roger Zimmermann, Bandwidth prediction on low-latency chunked streaming, In Proceedings of the 29th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, ACM New York, pp. 7-13, 2019.
[bib][url] [doi] |
[822] | Christian Timmerer, Ali C. Begen, A Journey Towards Fully Immersive Media Access, In Proceedings of the 27th ACM International Conference on Multimedia, ACM New York, pp. 2703-2705, 2019.
[bib][url] [doi] |
[821] | Jeroen van der Hooft, Tim Wauters, Filip De Turck, Christian Timmerer, Hermann Hellwagner, Towards 6dof http adaptive streaming through point cloud compression, In Proceedings of the 27th ACM International Conference on Multimedia, ACM New York, pp. 2405-2413, 2019.
[bib][url] [doi] |
[820] | Christian Timmerer, MPEG column: 124th MPEG meeting in Macau, China, In SIGMultimedia Records, ACM, vol. 10, no. 4, New York, NY, USA, pp. 8:8-8:8, 2019.
[bib][url] [doi] |
[819] | Natalia Sokolova, Klaus Schöffmann, Mario Taschwer, Doris Putzgruber-Adamitsch, Yosuf El-Shabrawi, Evaluating the Generalization Performance of Instrument Classification in Cataract Surgery Videos, In Proceedings of the 26th International Conference in MultiMedia Modeling (MMM 2020) (Part II) (Wen-Huang Cheng, Junmo Kim, Wei-Ta Chu, Peng Cui, Jung-Woo Choi, Min-Chun Hu, Wesley De Neve, eds.), Springer, vol. 11962, Berlin, pp. 626-636, 2019.
[bib][url] [doi] |
[818] | Klaus Schöffmann, Björn Þór Jónsson, Cathal Gurrin, Dataset Column: Report from the MMM 2019 Special Session on Multimedia Datasets for Repeatable Experimentation (MDRE 2019), In ACM SIGMM Records, vol. 11, no. 3, 2019.
[bib][url] [abstract]
Abstract: Information retrieval and multimedia content access have a long history of comparative evaluation, and many of the advances in the area over the past decade can be attributed to the availability of open datasets that support comparative and repeatable experimentation. Sharing data and code to allow other researchers to replicate research results is needed in the multimedia modeling field, as it helps to improve the performance of systems and the reproducibility of published papers.This report summarizes the special session on Multimedia Datasets for Repeatable Experimentation (MDRE 2019), which was organized at the 25th International Conference on MultiMedia Modeling (MMM 2019), which was held in January 2019 in Thessaloniki, Greece.The intent of these special sessions is to be a venue for releasing datasets to the multimedia community and discussing dataset related issues. The presentation mode in 2019 was to have short presentations (8 minutes) with some questions, and an additional panel discussion after all the presentations, which was moderated by Björn Þór Jónsson. In the following we summarize the special session, including its talks, questions, and discussions.
|
[817] | Cathal Gurrin, Hideo Joho, Liting Zhou, Duc-Tien Dang-Nguyen, Luca Piras, Jakub Lokoc, Klaus Schöffmann, Andreas Leibetseder, Aaron Duane, Michael Riegler, Minh-Triet Tran, Wolfgang Hürst, Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge (LSC2018), In ITE Transactions on Media Technology and Applications, vol. 7, no. 2, pp. 46-59, 2019.
[bib][url] [doi] [abstract]
Abstract: The Lifelog Search Challenge (LSC) is an international content retrieval competition that evaluates search for personal lifelog data. At the LSC, content-based search is performed over a multi-modal dataset, continuously recorded by a lifelogger over 27 days, consisting of multimedia content, biometric data, human activity data, and information activities data. In this work, we report on the first LSC that took place in Yokohama, Japan in 2018 as a special workshop at ACM International Conference on Multimedia Retrieval 2018 (ICMR 2018). We describe the general idea of this challenge, summarise the participating search systems as well as the evaluation procedure, and analyse the search performance of the teams in various aspects. We try to identify reasons why some systems performed better than others and provide an outlook as well as open issues for upcoming iterations of the challenge.
|
[816] | Luca Rossetto, Fabian Berns, Klaus Schöffmann, George M. Awad, Christian Beecks, The V3C1 Dataset: Advancing the State of the Art in Video Retrieval, In ACM SIGMM Records, vol. 11, no. 2, 2019.
[bib][url] [abstract]
Abstract: Standardized datasets are of vital importance in multimedia research, as they form the basis for reproducible experiments and evaluations. In the area of video retrieval, widely used datasets such as the IACC [5], which has formed the basis for the TRECVID Ad-Hoc Video Search Task and other retrieval-related challenges, have started to show their age. For example, IACC is no longer representative of video content as it is found in the wild [7]. This is illustrated by the figures below, showing the distribution of video age and duration across various datasets in comparison with a sample drawn from Vimeo and Youtube.
|
[815] | Jakub Lokoc, Klaus Schöffmann, Werner Bailer, Luca Rossetto, Cathal Gurrin, Interactive Video Retrieval in the Age of Deep Learning, In Proceedings of the ACM International Conference on Multimedia Retrieval, ACM - New York, New York, NY, pp. 2-4, 2019.
[bib][url] [doi] |
[814] | Fabian Berns, Luca Rossetto, Klaus Schöffmann, Christian Beecks, George M. Awad, V3C1 Dataset: An Evaluation of Content Characteristics, In Proceedings of the ACM International Conference on Multimedia Retrieval, ACM - New York, New York, NY, pp. 334-338, 2019.
[bib][url] [doi] |
[813] | Cheng Peng, Qing Xu, Yuejun Guo, Klaus Schöffmann, Eye Movement-Based Analysis on Methodologies and Efficiency in the Process of Image Noise Evaluation, In Proceedings of the 28th International Conference on Artificial Neural Networks, Springer, Berlin, pp. 29-40, 2019.
[bib][url] [doi] |
[812] | Pal Halvorsen, Michael Riegler, Klaus Schöffmann, Medical Multimedia Systems and Applications, In Proceedings of the 27th ACM International Conference on Multimedia, ACM New York, pp. 2711-2713, 2019.
[bib][url] [doi] |
[811] | Klaus Schöffmann, Video Browser Showdown 2012-2019: A Review, In Proceedings of the International Conference on Content-Based Multimedia Indexing (CBMI'19), IEEE, Piscataway (NJ), 2019.
[bib][url] [doi] |
[810] | Raimund Schatz, Anatoliy Zabrovskiy, Christian Timmerer, Tile-based Streaming of 8K Omnidirectional Video: Subjective and Objective QoE Evaluation, In 2019 Eleventh International Conference on Qualit of Multimedia Experience (QoMEX), IEEE, New York, USA, 2019.
[bib] [pdf] [abstract]
Abstract: Omnidirectional video (ODV) streaming applica- tions are becoming increasingly popular. They enable a highly immersive experience as the user can freely choose her/his field of view within the 360-degree environment. Current deployments are fairly simple but viewport-agnostic which inevitably results in high storage/bandwidth requirements and low Quality of Experience (QoE). A promising solution is referred to as tile- based streaming which allows to have higher quality within the user’s viewport while quality outside the user’s viewport could be lower. However, empirical QoE assessment studies in this domain are still rare. Thus, this paper investigates the impact of different tile-based streaming approaches and configurations on the QoE of ODV. We present the results of a lab-based subjective evaluation in which participants evaluated 8K omnidirectional video QoE as influenced by different (i) tile-based streaming approaches (full vs. partial delivery), (ii) content types (static vs. moving camera), and (iii) tile encoding quality levels determined by different quantization parameters. Our experimental setup is character- ized by high reproducibility since relevant media delivery aspects (including the user’s head movements and dynamic tile quality adaptation) are already rendered into the respective processed video sequences. Additionally, we performed a complementary objective evaluation of the different test sequences focusing on bandwidth efficiency and objective quality metrics. The results are presented in this paper and discussed in detail which confirm that tile-based streaming of ODV improves visual quality while reducing bandwidth requirements.
|
[809] | Nishant Saurabh, Julian Remmers, Dragi Kimovski, Radu Aurel Prodan, jorge G. Barbosa, Semantics-Aware Virtual Machine Image Management in IaaS Clouds, In Proceedings of the 33rd IEEE International Parallel and Distributed Processing Symposium (IPDPS) 2019, IEEE, Piscataway (NJ), pp. 418-427, 2019.
[bib][url] [doi] |
[808] | Ariel Oleksiak, Laurent Lefevre, Pedro Alonso, Georges Da Costa, Vincenzo De Maio, Neki Frasheri, Victor M. Garcia, Joel Guerrero, Sebastien Lafond, Alexey L. Lastovetsky, Ravi Reddy Manumachu, Benson Muite, Anne-Cecile Orgerie, Wojciech Piatek, Jean-Marc Pierson, Radu Aurel Prodan, Patricia Stolf, Enida Sheme, Sebastien Varrette, Energy aware ultrascale systems, In Ultrascale Computing Systems (Jesus Carretero, Emmanuel Jeannot, Albert Y. Zomaya, eds.), The Institution of Engineering and Technology (IET), Stevenage, pp. 127-188, 2019.
[bib][url] [doi] [abstract]
Abstract: Energy consumption is one of the main limiting factors for the design of ultrascale infrastructures. Multi-level hardware and software optimizations must be designed and explored in order to reduce energy consumption for these largescale equipment. This chapter addresses the issue of energy efficiency of ultrascale systems in front of other quality metrics. The goal of this chapter is to explore the design of metrics, analysis, frameworks and tools for putting energy awareness and energy efficiency at the next stage. Significant emphasis will be placed on the idea of “energy complexity,” reflecting the synergies between energy efficiency and quality of service, resilience and performance, by studying computation power, communication/data sharing power, data access power, algorithm energy consumption, etc.
|
[807] | Vipul Mudgill, Gagangeet Singh Aujla, Neeraj Kumar, Mohammad S. Obaidat, Radu Aurel Prodan, DLopC: Data Locality Independency-Aware VM Clustering in Cloud Computing, In Proceedings of the 2018 IEEE Globecom Workshops, IEEE, Piscataway (NJ), pp. 1-6, 2019.
[bib][url] [doi] |
[806] | Anish Jindal, Gagangeet Singh Aujla, Neeraj Kumar, Radu Aurel Prodan, Mohammad S. Obaidat, DRUMS: Demand Response Management in a Smart City Using Deep Learning and SVR, In Proceedings of the 2018 IEEE Global Communications Conference (GLOBECOM), IEEE, Piscataway (NJ), pp. 1-6, 2019.
[bib][url] [doi] |
[805] | Laura Ricci, Alexander Iosup, Radu Aurel Prodan, EDITORIAL Special Issue on Large Scale Cooperative Virtual Environments, In Journal of Grid Computing, vol. 17, pp. 1-2, 2019.
[bib][url] [doi] |
[804] | Muhammad Aleem, Radu Aurel Prodan, Muhammad Arshad Islam, Muhammad Azhar Iqbal, On the Parallel Programmability of JavaSymphony for Multi-cores and Clusters, In International Journal of Ad Hoc and Ubiquitous Computing, vol. 30, no. 4, pp. 247-264, 2019.
[bib][url] [doi] [abstract]
Abstract: This paper explains the programming aspects of a promising Java-based programming and execution framework called JavaSymphony. JavaSymphony provides unified high-level programming constructs for applications related to shared, distributed, hybrid memory parallel computers, and co-processors accelerators. JavaSymphony applications can be executed on a variety of multi-/many-core conventional and data-parallel architectures. JavaSymphony is based on the concept of dynamic virtual architectures, which allows programmers to define a hierarchical structure of the underlying computing resources and to control load-balancing and task-locality. In addition to GPU support, JavaSymphony provides a multi-core aware scheduling mechanism capable of mapping parallel applications on large multi-core machines and heterogeneous clusters. Several real applications and benchmarks (on modern multi-core computers, heterogeneous clusters, and machines consisting of a combination of different multi-core CPU and GPU devices) have been used to evaluate the performance. The results demonstrate that the JavaSymphony outperforms the Java implementations, as well as other modern alternative solutions.
|
[803] | Muhammad Aleem, Radu Aurel Prodan, Muhammad Arshad Islam, Muhammad Azhar Iqbal, On the paralell programmability of JavaSymphony for multi-cores and clusters, In International Journal of Ad Hoc and Ubiquitous Computing, vol. 30, no. 4, pp. 247-264, 2019.
[bib][url] [doi] [abstract]
Abstract: This paper explains the programming aspects of a promising Java-based programming and execution framework called JavaSymphony. JavaSymphony provides unified high-level programming constructs for applications related to shared, distributed, hybrid memory parallel computers, and co-processors accelerators. JavaSymphony applications can be executed on multi-/many-core conventional and data-parallel architectures. JavaSymphony is based on the concept of dynamic virtual architectures, which allows programmers to define a hierarchical structure of the underlying computing resources and to control load-balancing and task-locality. In addition to GPU support, JavaSymphony provides a multi-core aware scheduling mechanism capable of mapping parallel applications on large multi-core machines and heterogeneous clusters. Several real applications and benchmarks (on modern multi-core computers, heterogeneous clusters, and machines consisting of a combination of different multi-core CPU and GPU devices) have been used to evaluate the performance. The results demonstrate that the JavaSymphony outperforms the Java implementations, as well as other modern alternative solutions.
|