Adaptive Streaming: A subjective catalog to assess the performance of objective QoE metrics

Alberto Álvarez, Laura Pozueco, Sergio Cabrero, Xabiel García Pañeda, Roberto García, David Melendi, Gabriel Díaz Orueta

Abstract


Scalable streaming has emerged as a feasible solution to resolve users' heterogeneity problems. SVC is the technology that has served as the definitive impulse for the growth of streaming adaptive systems. Systems seek to improve layer switching efficiency from the network point of view but, with increasing importance, without jeopardizing user perceived video quality, i.e., QoE. We have performed extensive subjective experiments to corroborate the preference towards adaptive systems when compared to traditional non-adaptive systems. The resulting subjective scores are correlated with most relevant Full Reference (FR) objective metrics. We obtain an exponential relationship between human decisions and the same decisions expressed as a difference of objective metrics. A strong correlation with subjective scores validates objective metrics to be used as aid in the adaptive decision taking algorithms to improve overall systems performance. Results show that, among the evaluated objective metrics, PSNR is the metric that provide worse results in terms of reproducing the human decisions.

Keywords


Adaptive streaming; Scalable Video Coding (SVC); objective video quality metrics; subjective quality assessment

Full Text:

PDF


DOI: http://dx.doi.org/10.5296/npa.v6i2.5461

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.

To make sure that you can receive messages from us, please add the 'macrothink.org' domain to your e-mail 'safe list'. If you do not receive e-mail in your 'inbox', check your 'bulk mail' or 'junk mail' folders.

Copyright © Macrothink Institute ISSN 1943-3581