[155] | Christian Timmerer, Immersive Media Delivery: Overview of Ongoing Standardization Activities, In IEEE Communications Standards Magazine, IEEE Communications Society, vol. 1, no. 4, N.N., pp. 71-74, 2017.
[bib] [doi] [pdf] [abstract]
Abstract: More and more immersive media applications and services are emerging on the market, but lack international standards to enable interoperability. This article provides an overview about ongoing standardization efforts in this exciting domain and highlights open research and standardization issues.
|
[154] | Christian Timmerer, Ali Cengiz Begen, Advancing Multimedia Content Distribution, In Computing Now, IEEE Computer Society [online], Los Alamitos, CA, USA, pp. 1, 2017.
[bib][url] |
[153] | Christian Timmerer, MPEG Column: 116th MPEG Meeting, In SIGMultimedia Records, ACM, vol. 8, no. 4, New York, NY, USA, pp. N.N., 2017.
[bib][url] [doi] |
[152] | Christian Timmerer, MPEG Column: 117th MPEG Meeting, In SIGMultimedia Records, ACM, vol. 9, no. 1, New York, NY, USA, pp. N.N., 2017.
[bib][url] [doi] |
[151] | Christian Timmerer, MPEG Column: 118th MPEG Meeting, In SIGMultimedia Records, ACM, vol. 8, no. 4, New York, NY, USA, pp. N.N., 2017.
[bib][url] [doi] |
[150] | Christian Timmerer, MPEG Column: 119th MPEG Meeting in Turin, Italy, In SIGMultimedia Records, ACM, vol. 9, no. 2, New York, NY, USA, pp. N.N., 2017.
[bib][url] [doi] |
[149] | Christian Timmerer, Report from ACM MMSys 2017, In SIGMultimedia Records, ACM, vol. 9, no. 2, New York, NY, USA, pp. N.N., 2017.
[bib][url] [doi] |
[148] | Christian Timmerer, Ali Cengiz Begen, Best Papers of the 2016 ACM Multimedia Systems (MMSys) Conference and Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV) 2016, In ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), ACM Digital Library, vol. 13, no. 3s, New York, NY, USA, pp. 40:1-40:2, 2017.
[bib][url] [doi] [pdf] |
[147] | Klaus Schoeffmann, Heinrich Husslein, Sabrina Kletz, Stefan Petscharnig, Bernd Münzer, Christian Beecks, Video Retrieval in Laparoscopic Video Recordings with Dynamic Content Descriptors, In Multimedia Tools and Applications, Springer US, USA, pp. 18, 2017.
[bib] |
[146] | Benjamin Rainer, Stefan Petscharnig, Christian Timmerer, Hermann Hellwagner, Statistically Indifferent Quality Variation: An Approach for Reducing Multimedia Distribution Cost for Adaptive Video Streaming Services, In IEEE Transactions on Multimedia, IEEE, vol. 19, New York, USA, pp. 13, 2017.
[bib][url] [doi] [pdf] [abstract]
Abstract: Forecasts predict that Internet traffic will continue to grow in the near future. A huge share of this traffic is caused by multimedia streaming. The Quality of Experience (QoE) of such streaming services is an important aspect and in most cases the goal is to maximize the bit rate which -- in some cases -- conflicts with the requirements of both consumers and providers. For example, in mobile environments users may prefer a lower bit rate to come along with their data plan. Likewise, providers aim at minimizing bandwidth usage in order to reduce costs by transmitting less data to users while maintaining a high QoE. Today's adaptive video streaming services try to serve users with the highest bit rates which consequently results in high QoE. In practice, however, some of these high bit rate representations may not differ significantly in terms of perceived video quality compared to lower bit rate representations. In this paper, we present a novel approach to determine the statistically indifferent quality variation (SIQV) of adjacent video representations for adaptive video streaming services by adopting standard objective quality metrics and existing QoE models. In particular, whenever the quality variation between adjacent representations is imperceptible from a statistical point of view, the representation with higher bit rate can be substituted with a lower bit rate representation. As expected, this approach results in savings with respect to bandwidth consumption while still providing a high QoE for users. The approach is evaluated subjectively with a crowdsourcing study. Additionally, we highlight the benefits of our approach, by providing a case study that extrapolates possible savings for providers.
|
[145] | Daniel Posch, Benjamin Rainer, Hermann Hellwagner, SAF: Stochastic Adaptive Forwarding in Named Data Networking, In IEEE/ACM Transactions on Networking, IEEE, vol. 25, no. 2, New York, USA, pp. 14, 2017.
[bib][url] [doi] [pdf] [abstract]
Abstract: Forwarding decisions in classical IP-based networks are predetermined by routing. This is necessary to avoid loops, inhibiting opportunities to implement an adaptive and intelligent forwarding plane. Consequently, content distribution efficiency is reduced due to a lack of inherent multi-path transmission. In Named Data Networking (NDN) instead, routing shall hold a supporting role to forwarding, providing sufficient potential to enhance content dissemination at the forwarding plane. In this paper we design, implement, and evaluate a novel probability-based forwarding strategy, called Stochastic Adaptive Forwarding (SAF) for NDN. SAF imitates a self-adjusting water pipe system, intelligently guiding and distributing Interests through network crossings circumventing link failures and bottlenecks. Just as real pipe systems, SAF employs overpressure valves enabling congested nodes to lower pressure autonomously. Through an implicit feedback mechanism it is ensured that the fraction of the traffic forwarded via congested nodes decreases. By conducting simulations we show that our approach outperforms existing forwarding strategies in terms of the Interest satisfaction ratio in the majority of the evaluated scenarios. This is achieved by extensive utilization of NDN's multipath and content-lookup capabilities without relying on the routing plane. SAF explores the local environment by redirecting requests that are likely to be dropped anyway. This enables SAF to identify new paths to the content origin or to cached replicas, circumventing link failures and resource shortages without relying on routing updates.
|
[144] | Daniel Posch, Benjamin Rainer, Hermann Hellwagner, Towards a Context-Aware Forwarding Plane in Named Data Networking supporting QoS, In Computer Communication Review, ACM SIGCOMM, vol. 47, no. 1, New York, USA, pp. 9, 2017.
[bib][url] [doi] [pdf] [abstract]
Abstract: The emergence of Information-Centric Networking (ICN) provides considerable opportunities for context-aware data distribution in the network's forwarding plane. While packet forwarding in classical IP-based networks is basically predetermined by routing, ICN foresees an adaptive forwarding plane considering the requirements of network applications. As research in this area is still at an early stage, most of the work so far focused on providing the basic functionality, rather than on considering the available context information to improve Quality of Service (QoS). This article investigates to which extent existing forwarding strategies take account of the available context information and can therefore increase service quality. The article examines a typical scenario encompassing different user applications (Voice over IP, video streaming, and classical data transfer) with varying demands (context), and evaluates how well the applications' requirements are met by the existing strategies.
|
[143] | Antonio Pinheiro, Christian Timmerer, Standards Column: JPEG and MPEG, In SIGMultimedia Records, ACM, vol. 9, no. 1, New York, NY, USA, pp. N.N., 2017.
[bib][url] [doi] |
[142] | Stefan Petscharnig, Klaus Schoeffmann, Learning laparoscopic video shot classification for gynecological surgery, In Multimedia Tools and Applications, Springer, Berlin, Heidelberg, New York, pp. 1-19, 2017.
[bib][url] [doi] [abstract]
Abstract: Videos of endoscopic surgery are used for education of medical experts, analysis in medical research, and documentation for everyday clinical life. Hand-crafted image descriptors lack the capabilities of a semantic classification of surgical actions and video shots of anatomical structures. In this work, we investigate how well single-frame convolutional neural networks (CNN) for semantic shot classification in gynecologic surgery work. Together with medical experts, we manually annotate hours of raw endoscopic gynecologic surgery videos showing endometriosis treatment and myoma resection of over 100 patients. The cleaned ground truth dataset comprises 9 h of annotated video material (from 111 different recordings). We use the well-known CNN architectures AlexNet and GoogLeNet and train these architectures for both, surgical actions and anatomy, from scratch. Furthermore, we extract high-level features from AlexNet with weights from a pre-trained model from the Caffe model zoo and feed them to an SVM classifier. Our evaluation shows that we reach an average recall of .697 and .515 for classification of anatomical structures and surgical actions respectively using off-the-shelf CNN features. Using GoogLeNet, we achieve a mean recall of .782 and .617 for classification of anatomical structures and surgical actions respectively. With AlexNet the achieved recall is .615 for anatomical structures and .469 for surgical action classification respectively. The main conclusion of our work is that advances in general image classification methods transfer to the domain of endoscopic surgery videos in gynecology. This is relevant as this domain is different from natural images, e.g. it is distinguished by smoke, reflections, or a limited amount of colors.
|
[141] | Bernd Münzer, Klaus Schoeffmann, Laszlo Böszörmenyi, Content-based processing and analysis of endoscopic images and videos: A survey, In Multimedia Tools and Applications, Springer, Berlin, Heidelberg, New York, pp. 1-40, 2017.
[bib][url] [doi] [abstract]
Abstract: In recent years, digital endoscopy has established as key technology for medical screenings and minimally invasive surgery. Since then, various research communities with manifold backgrounds have picked up on the idea of processing and automatically analyzing the inherently available video signal that is produced by the endoscopic camera. Proposed works mainly include image processing techniques, pattern recognition, machine learning methods and Computer Vision algorithms. While most contributions deal with real-time assistance at procedure time, the post-procedural processing of recorded videos is still in its infancy. Many post-processing problems are based on typical Multimedia methods like indexing, retrieval, summarization and video interaction, but have only been sparsely addressed so far for this domain. The goals of this survey are (1) to introduce this research field to a broader audience in the Multimedia community to stimulate further research, (2) to describe domain-specific characteristics of endoscopic videos that need to be addressed in a pre-processing step, and (3) to systematically bring together the very diverse research results for the first time to provide a broader overview of related research that is currently not perceived as belonging together.
|
[140] | X Zhu, S Mao, M Hassan Hassan, Hermann Hellwagner, Guest Editorial: Video Over Future Networks, In IEEE Transactions on Multimedia, IEEE, vol. 19, no. 10, Piscataway, NJ, pp. 2133 - 2135, 2017.
[bib][url] [doi] [abstract]
Abstract: The papers in this special issue focus on the deployment of video over future networks. The past decade has seen how major improvements in broadband and mobile networks have led to widespread popularity of video streaming applications, and how the latter now becomes the major driving force behind exponentially growing Internet traffic. This special issue seeks to investigate these future Internet technologies through the prism of its most prevalent application, that of video communications. video.
|
[139] | Christian Timmerer, The Future of Multimedia on the Internet, In Computing Now, IEEE Computer Society [online], Los Alamitos, CA, USA, pp. 1, 2016.
[bib][url] |
[138] | Cedric Westphal, Tommaso Melodia, Wenww Zhu, Christian Timmerer, Guest Editorial Video Distribution Over Future Internet, In IEEE Journal on Selected Areas in Communications, IEEE Communications Society, vol. 34, no. 8, New York, pp. 2061-2062, 2016.
[bib] [pdf] |
[137] | Christian Timmerer, Matteo Maiero, Benjamin Rainer, Which Adaptation Logic? An Objective and Subjective Performance Evaluation of HTTP-based Adaptive Media Streaming Systems, In arXiv.org [cs.MM], N.N., vol. abs/1606.00341, N.N., pp. 11, 2016.
[bib][url] [pdf] |
[136] | Christian Timmerer, Alan Bertoni, Advanced Transport Options for the Dynamic Adaptive Streaming over HTTP, In arXiv.org [cs.MM], N.N., vol. abs/1606.00264, N.N., pp. 6, 2016.
[bib][url] [pdf] |
[135] | Mario Taschwer, Oge Marques, Automatic Separation of Compound Figures in Scientific Articles, In Multimedia Tools and Applications, Springer, New York, pp. 1-30, 2016.
[bib] [doi] [pdf] [abstract]
Abstract: Content-based analysis and retrieval of digital images found in scientific articles is often hindered by images consisting of multiple subfigures (compound figures). We address this problem by proposing a method (ComFig) to automatically classify and separate compound figures, which consists of two main steps: (i) a supervised compound figure classifier (ComFig classifier) discriminates between compound and non-compound figures using task-specific image features; and (ii) an image processing algorithm is applied to predicted compound images to perform compound figure separation (ComFig separation). The proposed ComFig classifier is shown to achieve state-of-the-art classification performance on a published dataset. Our ComFig separation algorithm shows superior separation accuracy on two different datasets compared to other known automatic approaches. Finally, we propose a method to evaluate the effectiveness of the ComFig chain combining classifier and separation algorithm, and use it to optimize the misclassification loss of the ComFig classifier for maximal effectiveness in the chain.
|
[134] | Klaus Schoeffmann, Lukas Burgstaller, A Convenient Interface for Video Navigation on Smartphones, In International Journal of Multimedia Data Engineering and Management, IGI Pub, vol. 7, no. 3, Hershey, PA, USA, pp. 1-16, 2016.
[bib] |
[133] | Benjamin Rainer, Daniel Posch, Andreas Leibetseder, Sebastian Theuermann, Hermann Hellwagner, A Low-Cost NDN Testbed on Banana Pi Routers, In Communications Magazine, IEEE, IEEE, vol. 54, no. 9, New York, USA, pp. 6, 2016. (IEEE COMMAG Network Testing and Analytics Series)
[bib] [pdf] [abstract]
Abstract: The computer communication research community shows significant interest in the paradigm of Information-Centric Networking (ICN). Continuously, new proposals for ICN-related challenges (caching, forwarding, etc.) are published. However, due to a lack of a readily available testbed, the majority of these proposals is evaluated either by theoretical analysis and/or by conducting network simulations potentially masking further challenges that are not observable in synthetic environments. Therefore, this article presents a framework for an ICN testbed using low-budget physical hardware with little deployment and maintenance effort for the individual researcher; specifically, Named Data Networking is considered. The employed hardware and software are powerful enough for most research projects, but extremely resource intensive tasks may push both components towards their limits. The testbed framework is based on well established open source software and provides the tools to readily investigate important ICN characteristics on physical hardware emulating arbitrary network topologies. The article discusses the testbed architecture and provides first results obtained from emulations that investigate the performance of various forwarding strategies. The results indicate that further challenges have to be overcome when heading towards a real-world deployment of ICN-based communication.
|
[132] | Benjamin Rainer, Daniel Posch, Hermann Hellwagner, Investigating the Performance of Pull-based Dynamic Adaptive Streaming in NDN, In Journal on Selected Areas in Communications, IEEE, vol. 34, no. 8, New York, USA, pp. 11, 2016. (IEEE JSAC Special Issue on Video Distribution over Future Internet)
[bib] [doi] [pdf] [abstract]
Abstract: Adaptive content delivery is the state-of-the-art in real-time multimedia streaming. Leading streaming approaches, e.g., MPEG-DASH and Apple HLS, have been developed for classical IP-based networks, providing effective streaming by means of pure client-based control and adaptation. However, the research activities of the Future Internet community adopt a new course that is different from today's host-based communication model. So-called Information-Centric Networks are of considerable interest and are advertised as enablers for intelligent networks, where effective content delivery is to be provided as an inherent network feature. This paper investigates the performance gap between pure client-driven adaptation and the theoretical optimum in the promising Future Internet architecture Named Data Networking (NDN). The theoretical optimum is derived by modeling multimedia streaming in NDN as a fractional Multi-Commodity Flow Problem and by extending it taking caching into account. We investigate the multimedia streaming performance under different forwarding strategies, exposing the interplay of forwarding strategies and adaptation mechanisms. Furthermore, we examine the influence of network inherent caching on the streaming performance by varying the caching polices and the cache sizes.
|
[131] | Björn Por Jonsson, Cathal Gurrin, Klaus Schoeffmann, Report from the MMM Special Session Perspectives on Multimedia Analytics, In ACM SIGMultimedia Records, ACM, vol. 2016, no. 2, New York, NY, USA, pp. 1-2, 2016.
[bib] [abstract]
Abstract: This report summarizes the presentations and discussions of the special session entitled “Perspectives on Multimedia Analytics” at MMM 2016, which was held in Miami, Florida on January 6, 2016. The special session consisted of four brief paper presentations, followed by a panel discussion with questions from the audience. The session was organized by Björn Þór Jónsson and Cathal Gurrin, and chaired and moderated by Klaus Schoeffmann. The goal of this report is to record the conclusions of the special session, in the hope that it may serve members of our community who are interested in Multimedia Analytics.
|