[53] | Konstantin Pogorelov, Michael Riegler, Pal Halvorsen, Carsten Griwodz, Thomas de Lange, Kristin Randel, Sigrun Eskeland, Duc-Tien Dang-Ngyuen, Olga Ostroukhova, Mathias Lux, Concetto Spampinato, A Comparison of Deep Learning with Global Features for Gastrointestinal Disease Detection, In Working Notes Proceedings of the MediaEval 2017 Workshop (Guillaume Gravier, Benjamin Bischke, Claire-Hélène Demarty, Maia Zaharieva, Michael Riegler, Emmanuel Dellandrea, Dmitry Bogdanov, Richard Sutcliffe, Gareth Jones, Martha Larson, eds.), CEUR Workshop Proceedings, Dublin, Ireland, pp. 3, 2017.
[bib][url] [abstract]
Abstract: This paper presents our approach for the 2017 Multimedia for Medicine Medico Task of the MediaEval 2017 Benchmark. We propose a system based on global features and deep neural networks, and preliminary results comparing the approaches are presented.
|
[52] | Michael Riegler, Konstantin Pogorelov, Pal Halvorsen, Kristin Randel, Sigrun Eskeland, Duc-Tien Dang-Nguyen, Mathias Lux, Carsten Griwodz, Concetto Spampinato, Thomas de Lange, Multimedia for Medicine: The Medico Task at MediaEval 2017, In Working Notes Proceedings of the MediaEval 2017 Workshop (Guillaume Gravier, Benjamin Bischke, Claire-Hélène Demarty, Maia Zaharieva, Michael Riegler, Emmanuel Dellandrea, Dmitry Bogdanov, Richard Sutcliffe, Gareth Jones, Martha Larson, eds.), CEUR Workshop Proceedings, Dublin, Ireland, pp. 3, 2017.
[bib] [abstract]
Abstract: The Multimedia for Medicine Medico Task, running for the first time as part of MediaEval 2017, focuses on detecting abnormalities, diseases and anatomical landmarks in images captured by medical devices in the gastrointestinal tract. The task characteristics are described, including the use case and its challenges, the dataset with ground truth, the required participant runs and the evaluation metrics.
|
[51] | Harald Beck, Bruno Bierbaumer, Minh Dao-Tran, Thomas Eiter, Hermann Hellwagner, Konstantin Schekotihin, Stream Reasoning-Based Control of Caching Strategies in CCN Routers, In Communications (ICC), 2017 IEEE International Conference on (Jean Luc Beylat, Hikmet Sari, eds.), IEEE, Paris, France, pp. 6, 2017.
[bib] [doi] [abstract]
Abstract: Routers in Content-Centric Networking (CCN) may locally cache frequently requested content in order to speed up delivery to end users. Thus, the issue of caching strategies arises, i.e., which content shall be stored and when it should be replaced. In this work, we employ, and study the feasibility of, novel techniques towards intelligent control of CCN routers that autonomously switch between existing caching strategies in response to changing content request patterns. In particular, we present a router architecture for CCN networks that is controlled by rule-based stream reasoning, following the recent formal framework LARS which extends Answer Set Programming for streams. The obtained possibility for flexible router configuration at runtime allows for versatile network control schemes and may help advance the further development of CCN. Moreover, the empirical evaluation of our feasibility study shows that the resulting caching agent may give significant performance gains.
|
[50] | Mathias Lux, Michael Riegler, Glenn Macstravic, LireSolr: A Visual Information Retrieval Server, In ICMR '17 Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval (Nicu Sebe, Bogdan Ionescu, eds.), ACM, New Yor New York, USA, pp. 3, 2017.
[bib][url] [doi] [abstract]
Abstract: In this paper, we present LireSolr, an open source image retrieval server, build on top of the LIRE library and the Apache Solr search server. With LireSolr, visual information retrieval can be run on a server, which allows better distribution of workloads and simplifies applications in several areas including mobile and web. Furthermore, we showcase several example scenarios how LireSolr can be used to point out the broad range of possibilities and applications. The system is easy to install and setup, and the large number of retrieval tools either provided by LIRE or by other Apache Solr is made easily available on the search server. Moreover, our tool demonstrates how predictions from CNNs can easily be used to extend the visual information retrieval functionality.
|
[49] | Anatoliy Zabrovskiy, Evgeny Petrov, Evgeny Kuzmin, Christian Timmerer, Evaluation of the Performance of Adaptive HTTP Streaming Systems, In arXiv.org [cs.MM], N.N., vol. abs/1710.02459, N.N., pp. 7, 2017.
[bib][url] [pdf] [abstract]
Abstract: Adaptive video streaming over HTTP is becoming omnipresent in our daily life. In the past, dozens of research papers have proposed novel approaches to address different aspects of adaptive streaming and a decent amount of player implementations (commercial and open source) are available. However, state of the art evaluations are sometimes superficial as many proposals only investigate a certain aspect of the problem or focus on a specific platform – player implementations used in actual services are rarely considered. HTML5 is now available on many platforms and foster the deployment of adaptive media streaming applications. We propose a common evaluation framework for adaptive HTML5 players and demonstrate its applicability by evaluating eight different players which are actually deployed in real-world services.
|
[48] | Anatoliy Zabrovskiy, Evgeny Kuzmin, Evgeny Petrov, Christian Timmerer, Christopher Mueller, AdViSE: Adaptive Video Streaming Evaluation Framework for the Automated Testing of Media Players, In Proceedings of the 8th ACM on Multimedia Systems Conference (MMSys'17) (Kuan-Ta Chen, ed.), ACM, New York, NY, USA, pp. 4, 2017.
[bib] [doi] [pdf] [abstract]
Abstract: Today we can observe a plethora of adaptive video stream- ing services and media players which support interoperable formats like DASH and HLS. Most of the players and their rate adaptation algorithms work as a black box. We have de- veloped a system for easy and rapid testing of media players under various network scenarios. In this paper, we introduce AdViSE, the Adaptive Video Streaming Evaluation frame- work for the automated testing of adaptive media players. The presented framework is used for the comparison and testing of media players in the context of adaptive video streaming over HTTP in web/HTML5 environments. The demonstration showcases a series of experiments with different media players under given context conditions (e.g., network shaping, delivery format). We will also demonstrate the real-time capabilities of the framework and offline anal- ysis including several QoE metrics with respect to a newly introduced bandwidth index.
|
[47] | Christian Timmerer, Immersive Media Delivery: Overview of Ongoing Standardization Activities, In IEEE Communications Standards Magazine, IEEE Communications Society, vol. 1, no. 4, N.N., pp. 71-74, 2017.
[bib] [doi] [pdf] [abstract]
Abstract: More and more immersive media applications and services are emerging on the market, but lack international standards to enable interoperability. This article provides an overview about ongoing standardization efforts in this exciting domain and highlights open research and standardization issues.
|
[46] | Christian Timmerer, Ali Cengiz Begen, Advancing Multimedia Content Distribution, In Computing Now, IEEE Computer Society [online], Los Alamitos, CA, USA, pp. 1, 2017.
[bib][url] |
[45] | Christian Timmerer, MPEG Column: 116th MPEG Meeting, In SIGMultimedia Records, ACM, vol. 8, no. 4, New York, NY, USA, pp. N.N., 2017.
[bib][url] [doi] |
[44] | Christian Timmerer, MPEG Column: 117th MPEG Meeting, In SIGMultimedia Records, ACM, vol. 9, no. 1, New York, NY, USA, pp. N.N., 2017.
[bib][url] [doi] |
[43] | Christian Timmerer, MPEG Column: 118th MPEG Meeting, In SIGMultimedia Records, ACM, vol. 8, no. 4, New York, NY, USA, pp. N.N., 2017.
[bib][url] [doi] |
[42] | Christian Timmerer, MPEG Column: 119th MPEG Meeting in Turin, Italy, In SIGMultimedia Records, ACM, vol. 9, no. 2, New York, NY, USA, pp. N.N., 2017.
[bib][url] [doi] |
[41] | Christian Timmerer, Report from ACM MMSys 2017, In SIGMultimedia Records, ACM, vol. 9, no. 2, New York, NY, USA, pp. N.N., 2017.
[bib][url] [doi] |
[40] | Christian Timmerer, Anatoliy Zabrovskiy, Evgeny Kuzmin, Evgeny Petrov, Quality of experience of commercially deployed adaptive media players, In 2017 21st Conference of Open Innovations Association (FRUCT) (Sergey Balandin, ed.), N.N., N.N., pp. 330-335, 2017.
[bib] [doi] [pdf] [abstract]
Abstract: In the past decade we observed the transition from push-based, fully managed media streaming to pull-based, unmanaged adaptive HTTP streaming thanks to enhancements in media compression, network capacity, and client capabilities. Adaptive media players, specifically their algorithms, have been subject to research for a long time and lead to various approaches documented in the literature. In the past years we witnessed more and more commercial deployments taking into account findings presented in scientific papers but a quantitative evaluation and assessments of its performance is missing. In this paper, we propose means for the automated performance evaluation of commercially deployed adaptive media players with respect to i) objective, well-known metrics, such as bitrate, stalls, startup delay and ii) derived/calculated metrics (instability, inefficiency, average bitrate) previously proposed in the literature. Additionally, we propose a new metric (Bandwidth index) to measure the effectiveness of bandwidth utilization and together with existing QoE models for adaptive HTTP streaming (focusing on stalls, startup delay) we demonstrate its usefulness in this domain.
|
[39] | Christian Timmerer, Ali Cengiz Begen, Best Papers of the 2016 ACM Multimedia Systems (MMSys) Conference and Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV) 2016, In ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), ACM Digital Library, vol. 13, no. 3s, New York, NY, USA, pp. 40:1-40:2, 2017.
[bib][url] [doi] [pdf] |
[38] | Christian Timmerer, Mario Graf, Christopher Mueller, Adaptive Streaming of VR/360-degree Immersive Media Services with high QoE, In 2018 NAB Broadcast Engineering and IT Conference (BEITC) (not available, ed.), National Association of Broadcasters (NAB), Washington DC, USA, pp. 5, 2017.
[bib] [pdf] |
[37] | Mario Taschwer, Concept-Based and Multimodal Methods for Medical Case Retrieval, PhD thesis, Alpen-Adria-Universität Klagenfurt, Austria, pp. 200, 2017.
[bib] [pdf] [abstract]
Abstract: Medical case retrieval (MCR) is defined as a multimedia retrieval problem, where the document collection consists of medical case descriptions that pertain to particular diseases, patients' histories, or other entities of biomedical knowledge. Case descriptions are multimedia documents containing textual and visual modalities (images). A query may consist of a textual description of patient's symptoms and related diagnostic images. This thesis proposes and evaluates methods that aim at improving MCR effectiveness over the baseline of fulltext retrieval. We hypothesize that this objective can be achieved by utilizing controlled vocabularies of biomedical concepts for query expansion and concept-based retrieval. The latter represents case descriptions and queries as vectors of biomedical concepts, which may be generated automatically from textual and/or visual modalities by concept mapping algorithms. We propose a multimodal retrieval framework for MCR by late fusion of text-based retrieval (including query expansion) and concept-based retrieval and show that retrieval effectiveness can be improved by 49% using linear fusion of practical component retrieval systems. The potential of further improvement is experimentally estimated as a 166% increase of effectiveness over fulltext retrieval using query-adaptive fusion of ideal component retrieval systems. Additional contributions of this thesis include the proposal and comparative evaluation of methods for concept mapping, query and document expansion, and automatic classification and separation of compound figures found in case descriptions.
|
[36] | Klaus Schoeffmann, Bernd Münzer, Michael Riegler, Paal Halvorsen, Medical Multimedia Information Systems (MMIS), In MM ’17 Proceedings of the 2017 ACM on Multimedia Conference (Qiong Liu, Rainer Lienhart, Haohong Wang, eds.), ACM, New York, NY, USA, pp. 1957-1958, 2017.
[bib][url] [doi] [abstract]
Abstract: In hospitals all around the world, medical multimedia information systems have gained high importance over the last few years. One of the reasons is that an increasing number of interventions are performed in a minimally invasive way. These endoscopic inspections and surgeries are performed with a tiny camera -- the endoscope -- which produces a video signal that is used to control the intervention. Apart from the viewing purpose, the video signal is also used for automatic content analysis during the intervention as well as for post-surgical usage, such as communicating operation techniques, planning future interventions, and medical forensics. Another reason is video documentation, which is even enforced by law in some countries. The problem, however, is the sheer amount of unstructured medical videos that are added to the multimedia archive on a daily basis. Without proper management and a multimedia information system, the medical videos cannot be used efficiently for post-surgical scenarios. It is therefore already foreseeable that medical multimedia information systems will gain even more attraction in the next few years. In this tutorial we will introduce the audience to this challenging new field, describe the domain-specific characteristics and challenges of medical multimedia data, introduce related use cases, and talk about existing works -- contributed by the medical imaging and robotics community, but also already partly from the multimedia community -- as well as the many open issues and challenges that bear high research potential.
|
[35] | Klaus Schoeffmann, Heinrich Husslein, Sabrina Kletz, Stefan Petscharnig, Bernd Münzer, Christian Beecks, Video Retrieval in Laparoscopic Video Recordings with Dynamic Content Descriptors, In Multimedia Tools and Applications, Springer US, USA, pp. 18, 2017.
[bib] |
[34] | Klaus Schoeffmann, Manfred Jürgen Primus, Bernd Muenzer, Stefan Petscharnig, Christoph Karisch, Qing Xu, Wolfgang Huerst, Collaborative Feature Maps for Interactive Video Search, In MultiMedia Modeling: 23rd International Conference, MMM 2017, Reykjavik, Iceland, January 4-6, 2017, Proceedings, Part II (Laurent Amsaleg, Gylfi Þór Guðmundsson, Cathal Gurrin, Björn Þór Jónsson, Shin’ichi Satoh, eds.), Springer International Publishing, Cham, pp. 457-462, 2017.
[bib][url] [doi] [abstract]
Abstract: This extended demo paper summarizes our interface used for the Video Browser Showdown (VBS) 2017 competition, where visual and textual known-item search (KIS) tasks, as well as ad-hoc video search (AVS) tasks in a 600-h video archive need to be solved interactively. To this end, we propose a very flexible distributed video search system that combines many ideas of related work in a novel and collaborative way, such that several users can work together and explore the video archive in a complementary manner. The main interface is a perspective Feature Map, which shows keyframes of shots arranged according to a selected content similarity feature (e.g., color, motion, semantic concepts, etc.). This Feature Map is accompanied by additional views, which allow users to search and filter according to a particular content feature. For collaboration of several users we provide a cooperative heatmap that shows a synchronized view of inspection actions of all users. Moreover, we use collaborative re-ranking of shots (in specific views) based on retrieved results of other users.
|
[33] | Frank Hopfgartner, Klaus Schoeffmann, Interactive Search in Video & Lifelogging Repositories, In Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval (CHIIR'17) (ragnar Nordlie, Nils Pharo, eds.), ACM, New York, NY, USA, pp. 421-423, 2017.
[bib][url] [doi] [abstract]
Abstract: Due to increasing possibilities to create digital video, we are facing the emergence of large video archives that are made accessible either online or offline. Though a lot of research has been spent on video retrieval tools and methods, which allow for automatic search in videos, still the performance of automatic video retrieval is far from optimal. At the same time, the organization of personal data is receiving increasing research attention due to the challenges that are faced in gathering, enriching, searching and visualizing this data. Given the increasing quantities of personal data being gathered by individuals, the concept of a heterogeneous personal digital libraries of rich multimedia and sensory content for every individual is becoming a reality. Despite the differences between video archives and personal lifelogging libraries, we are facing very similar challenges when accessing these multimedia repositories. For example, users will struggle to find the information they are looking for in either collection if they are not able to formulate their search needs through a query. In this tutorial we discussed (i) proposed solutions for improved video & lifelog content navigation, (ii) typical interaction of content-based querying features, and (iii) advanced content visualization methods. Moreover, we discussed and demonstrate interactive video & lifelog search systems and ways to evaluate their performance.
|
[32] | Raimund Schatz, Andreas Sackl, Christian Timmerer, Bruno Gardlo, Towards Subjective Quality of Experience Assessment for Omnidirectional Video Streaming, In 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX) (Alexander Raake, ed.), IEEE, New York, USA, pp. 6, 2017.
[bib] [doi] [pdf] [abstract]
Abstract: Currently, we witness dramatically increasing interest in immersive media technologies like Virtual Reality (VR), particularly in omnidirectional video (OV) streaming. Omnidirectional (also called 360-degree) videos are panoramic spherical videos in which the user can look around during playback and which therefore can be understood as hybrids between traditional movie streaming and interactive VR worlds. Unfortunately, streaming this kind of content is extremely bandwidth intensive (compared to traditional 2D video) and therefore, Quality of Experience (QoE) tends to deteriorate significantly in absence of continuous optimal bandwidth conditions. In this paper, we present a first approach towards subjective QoE assessment for omnidirectional video (OV) streaming. We present the results of a lab study on the QoE impact of stalling in the context of OV streaming using head-mounted displays (HMDs). Our findings show that subjective testing for immersive media like OV is not trivial, with even simple cases like stalling leading to unexpected results. After a discussion of characteristic pitfalls and lessons learned, we provide a a set of recommendations for upcoming OV assessment studies.
|
[31] | Benjamin Rainer, Stefan Petscharnig, Christian Timmerer, Hermann Hellwagner, Statistically Indifferent Quality Variation: An Approach for Reducing Multimedia Distribution Cost for Adaptive Video Streaming Services, In IEEE Transactions on Multimedia, IEEE, vol. 19, New York, USA, pp. 13, 2017.
[bib][url] [doi] [pdf] [abstract]
Abstract: Forecasts predict that Internet traffic will continue to grow in the near future. A huge share of this traffic is caused by multimedia streaming. The Quality of Experience (QoE) of such streaming services is an important aspect and in most cases the goal is to maximize the bit rate which -- in some cases -- conflicts with the requirements of both consumers and providers. For example, in mobile environments users may prefer a lower bit rate to come along with their data plan. Likewise, providers aim at minimizing bandwidth usage in order to reduce costs by transmitting less data to users while maintaining a high QoE. Today's adaptive video streaming services try to serve users with the highest bit rates which consequently results in high QoE. In practice, however, some of these high bit rate representations may not differ significantly in terms of perceived video quality compared to lower bit rate representations. In this paper, we present a novel approach to determine the statistically indifferent quality variation (SIQV) of adjacent video representations for adaptive video streaming services by adopting standard objective quality metrics and existing QoE models. In particular, whenever the quality variation between adjacent representations is imperceptible from a statistical point of view, the representation with higher bit rate can be substituted with a lower bit rate representation. As expected, this approach results in savings with respect to bandwidth consumption while still providing a high QoE for users. The approach is evaluated subjectively with a crowdsourcing study. Additionally, we highlight the benefits of our approach, by providing a case study that extrapolates possible savings for providers.
|
[30] | Manfred Jürgen Primus, Bernd Münzer, Klaus Schoeffmann, ITEC-UNIKLU Ad-Hoc Video Search Submission 2017, In Proceedings of TRECVID 2017 (George Awad, Asad Butt, Jonathan Fiscus, David Joy, Andrew Delgado, Martial Michel, Alan Smeaton, Yvette Graham, Wessel Kraaij, Georges Quénot, Maria Eskevich, Roeland Ordelman, Gareth Jones, Benoit Huet, eds.), NIST, USA, NIST, Gaithersburg, MD, USA, pp. 10, 2017.
[bib] [abstract]
Abstract: This paper describes our approach used for the fully automatic and manually assisted Ad-hoc Video Search (AVS) task for TRECVID 2017. We focus on the combination of different convolutional neural network models and query optimization. Each of this model focus on a specific query part, which could be, e.g., location, objects, or the wide-ranging ImageNet classes. All classification results are collected in different combinations in Lucene indixes. For the manually assisted run we use a junk filter and different query optimization methods.
|
[29] | Daniel Posch, Benjamin Rainer, Hermann Hellwagner, SAF: Stochastic Adaptive Forwarding in Named Data Networking, In IEEE/ACM Transactions on Networking, IEEE, vol. 25, no. 2, New York, USA, pp. 14, 2017.
[bib][url] [doi] [pdf] [abstract]
Abstract: Forwarding decisions in classical IP-based networks are predetermined by routing. This is necessary to avoid loops, inhibiting opportunities to implement an adaptive and intelligent forwarding plane. Consequently, content distribution efficiency is reduced due to a lack of inherent multi-path transmission. In Named Data Networking (NDN) instead, routing shall hold a supporting role to forwarding, providing sufficient potential to enhance content dissemination at the forwarding plane. In this paper we design, implement, and evaluate a novel probability-based forwarding strategy, called Stochastic Adaptive Forwarding (SAF) for NDN. SAF imitates a self-adjusting water pipe system, intelligently guiding and distributing Interests through network crossings circumventing link failures and bottlenecks. Just as real pipe systems, SAF employs overpressure valves enabling congested nodes to lower pressure autonomously. Through an implicit feedback mechanism it is ensured that the fraction of the traffic forwarded via congested nodes decreases. By conducting simulations we show that our approach outperforms existing forwarding strategies in terms of the Interest satisfaction ratio in the majority of the evaluated scenarios. This is achieved by extensive utilization of NDN's multipath and content-lookup capabilities without relying on the routing plane. SAF explores the local environment by redirecting requests that are likely to be dropped anyway. This enables SAF to identify new paths to the content origin or to cached replicas, circumventing link failures and resource shortages without relying on routing updates.
|