Video Aware Wireless Networks (VAWN) Research Program

University of Texas at Austin

The next generation of wireless networks will become the dominant means for video content delivery, leveraging rapidly expanding cellular and local area network infrastructure. Unfortunately, the application-agnostic paradigm of current data networks is not well-suited to meet projected growth in video traffic volume, nor is it capable of leveraging unique characteristics of real-time and stored video to make more efficient use of existing capacity. As a consequence, wireless networks are not able to leverage the spatio-temporal bursty nature of video. Further, they are not able to make rate-reliability-delay tradeoffs nor are they able to adapt based on the ultimate receiver of video information: the human eye-brain system. We believe that video networks at every time-scale and layer should operate and adapt with respect to perceptual distortions in the video stream.

In our opinion the key research questions are:

  • What are the right models for perceptual visual quality for 2-D and 3-D video?
  • How can video quality awareness across a network be used to improve network efficiency over short, medium, and long time-scales?
  • How can networks deliver adaptively high perceptual visual quality?

Our proposed research vectors are summarized as follows. Our first vector, Video Quality Metrics for Adaptation (VQA), focuses on advances in video quality assessment and corresponding rate distortion models that can be used for adaptation. Video quality assessment for 2-D is only now being understood while 3-D is still largely a topic of research. Video quality metrics are needed to define operational rate-distortion curves that can be implemented to make scheduling and adaptation decisions in the network. Our second vector, Spatio-Temporal Interference Management (STIM) in Heterogeneous Networks, exploits the characteristics of both real-time and streamed video to achieve efficient delivery in cellular systems. In one case, we will use the persistence of video streams to devise low overhead interference management for heterogeneous networks. In another case, we will exploit the buffering of streamed video at the receiver to opportunistically schedule transmissions when conditions are favorable, e.g., mobile users are close to the access infrastructure. Our third vector, Learning for Video Network Adaptation (LV), proposes a data-driven learning framework to adapt wireless network operation. We will use learning to develop link adaptation algorithms for perceptually efficient video transmission. Learning agents collect perceptual video quality distortion statistics and use this information to configure cross-layer transport and interference management algorithms. At the application layer, we propose using learning to predict user demand, which can be exploited to predicatively cache video and smooth traffic over the wireless link.

Journal Articles

[J-1] A. K. Moorthy, L. K. Choi, A. C. Bovik and G. de Veciana, "Video Quality Assessment on Mobile Devices: Subjective, Behavioral, and Objective Studies," IEEE Journal of Selected Topics in Signal Processing, Special Issue on New Subjective and Objective Methodologies for Audio and Visual Signal Processing.

[J-2] A. Abdel Khalek, C. Caramanis, and R. W. Heath Jr., "Loss Visibility Optimized Real-time Video Transmission over MIMO Systems," to be submitted to IEEE Transactions on Circuits and Systems for Video Technology.

[J-3] M. A. Saad and A. C. Bovik, "Spatio-Temporal Scene Statistics Model for Blink Video Quality Evaluation," to be submitted to IEEE Transactions on Image Processing.

[J-4] A. K. Moorthy, A. Mittal, and A. C. Bovik, "Perceptually Optimized Blind Repair of Natural Images," submitted to IEEE Transactions on Image Processing.

[J-5] A. Mittal, A. K. Moorthy, and A. C. Bovik, "No-Reference Image Quality Assessment in the Spatial Domain," submitted to IEEE Transactions on Image Processing.

[J-6] V. Joseph and G. de Veciana, "Variability Aware Network Utility Maximization", available on Arxiv, November 2011.

[J-7] A. Abdel Khalek, C. Caramanis, and R. W. Heath, Jr., "A Cross-layer Design for Perceptual Optimization of H.264/SVC with Unequal Error Protection," Off Site Icon IEEE Journal On Selected Areas in Communications, Special Issue on QoE-Aware Wireless Multimedia Systems, vol. 30, no. 7, pp. 1157--1171, August 2012.

[J-8] S. Singh, J. G. Andrews and G. de Veciana, "Interference Shaping for Improved Quality of Experience for Real-Time Video Streaming" Off Site Icon IEEE Journal On Selected Areas in Communications, Special Issue on QoE-Aware Wireless Multimedia Systems, vol 30., no. 7, pp. 1259--1269, August 2012.

[J-9] M. A. Saad and A. C. Bovik, "Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain, " Off Site Icon IEEE Transactions on Image Processing, vol. 21, no. 8, pp. 3339--3352, August 2012.

[J-10] R. Soundararajan and A. C. Bovik, "RRED Indices: Reduced Reference Entropic Differencing for Image Quality Assessment," Off Site Icon IEEE Transactions on Image Processing, vol. 21, no. 2, pp. 517--526, Feburary 2012.

[J-11] A. K. Moorthy and A. C. Bovik, "Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality," Off Site Icon IEEE Transactions on Image Processing, vol. 20, no. 12, pp. 3350--3364, December 2011.

[J-12] Y. Liu, A. C. Bovik and L. K. Cormack, "Statistical Modeling of 3D Natural Scenes with Application to Bayesian Stereopsis," Off Site Icon IEEE Transactions on Image Processing, vol. 20, no. 9, pp 2515--2530, September 2011.

[J-13] C. Yim and A. C. Bovik, "Quality Assessment of De-blocked Images," Off Site Icon IEEE Transactions on Image Processing, vol. 20, no. 1, pp. 88-98, January 2011.

[J-14] A. Mittal, G. S. Muralidhar, A. C. Bovik, and J. Ghosh, "Blind Image Quality Assessment Without Human Training Using Latent Quality Factors", Off Site Icon IEEE Signal Processing Letters, vol. 19, no. 2, pp. 75--78, February 2012.

[J-15] L. Duan, C. Wu, J. Miao, and A. C. Bovik, "Visual Conspicuity Index: Spatial Dissimilarity, Distance and Central Bias," Off Site Icon IEEE Signal Processing Letters, vol. 18, no. 11, pp. 690--693, November 2011.

[J-16] Z. Wang and A. C. Bovik, "Reduced- and No-reference Visual Quality Assessment - The Natural Scene Statistic Model Approach," Off Site Icon IEEE Signal Processing Magazine, Special Issue on Multimedia Quality Assessment, vol. 28, no. 6, pp. 29--40, November 2011.

[J-17] A. K. Moorthy, C.-C. Su, A. Mittal, A. C. Bovik and L. K. Cormack, "Subjective Evaluation of Stereoscopic Visual Quality," EURASIP Signal Processing: Image Communication, submitted.

[J-18] C. Yim and A. C. Bovik, "Evaluation of Temporal Variation of Video Quality in Packet Loss Networks," EURASIP Signal Processing: Image Communication, vol. 26, no. 1, pp. 24--38, January 2011.

[J-19] R. Soundararajan and A. C. Bovik, "Video Quality Assessment by Reduced Reference Spatio-temporal Entropic Differencing," submitted to IEEE Transactions on Circuits and Systems for Video Technology, December 2011.

[J-20] M.-J. Chen and A. C. Bovik, "Fast Structural Similarity Index Algorithm," Journal of Real-Time Image Processing, vol. 6, no. 4, pp. 281--287, December 2011.

Conference Papers

[C-1] M. A. Saad and A. C. Bovik, "Spatio-Temporal Video Statistics: Blind Video Quality Assessment", submitted to Proc. Southwest Symposium on Image Analysis and Interpretation (SSIAI'12).

[C-2] M. A. Saad, A. Mittal, A.C. Bovik, and L.K. Cormack, "Three-Dimentional Natural Scene Statistics: Dependencies between Luminance and Range Contrasts", Proc. Twelfth Annual Meeting of the Vision Sciences Society (VSS'12), Naples, FL, USA, May 2012.

[C-3] L. K. Choi, A. C. Bovik, and L. K. Cormack, "A Flicker Detector Model of the Motion Silencing Illusion", Proc. Twelfth Annual Meeting of the Vision Sciences Society (VSS'12). Naples, FL, USA, May 2012.

[C-4] A. K. Moorthy, L. K. Choi, G. de Veciana, and A. C. Bovik, "Subjective Analysis of Video Quality on Mobile Devices", Proc. Sixth International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM'12) Scottsdale, AZ, USA, January 2012.

[C-5] Anish Mittal, Anush K. Moorthy and A.C. Bovik, "Making Blind Image Quality Robust", submitted to ICIP 2012.

[C-6] Anish Mittal, Rajiv Soundararajan, Gautam S. Muralidhar, Alan C. Bovik, and Joydeep Ghosh, "Completely Blind Approaches to Image Quality Assessment", submitted to ICIP 2012.

[C-7] R. Soundararajan and A. C. Bovik, "Video Quality Assessment using Spatio-temporal Entropic Differences," submitted to IEEE International Conference on Image Processing (ICIP 2012). September 2012.

[C-8] A. Abdel Khalek, C. Caramanis, and R. W. Heath, Jr., "Video-aware MIMO Precoding with Packet Prioritization and Unequal Modulation" Off Site Icon, Proc. European Signal Processing Conference (EUSIPCO'12), Bucharest, Romania, August 2012.

[C-9] S. Singh, O. Oyman, A. Papathanassiou, D. Chatterjee, and J. G. Andrews, "Video Capacity and QoE Enhancements over LTE", Proc. IEEE International Conference on Communications Workshop on Realizing Advanced Video Optimized Wireless Networks (ICC ViOpt'12), Ottawa, Canada, June 2012.

[C-10] A. K. Moorthy, L. K. Choi, A. C. Bovik, and G. de Veciana, "Mobile Video Quality Assessment Database", Proc. IEEE International Conference on Communications Workshop on Realizing Advanced Video Optimized Wireless Networks (ICC ViOpt'12), Ottawa, Canada, June 2012.

[C-11] V. Joseph and G. de Veciana, "Jointly Optimizing Multi-user Rate Adaptation for Video Transport over Wireless Systems: Mean-Fairness-Variability Tradeoffs" Off Site Icon, Proc. IEEE INFOCOM, pp. 567--575, Orlando, FL, USA, March 2012.

[C-12] A. A. Khalek, C. Caramanis, and R. W. Heath Jr., "Joint Source-Channel Adaptation for Perceptually Optimized Scalable Video Transmission," Off Site Icon Proc. IEEE GLOBECOM, Houston, TX, USA, December 2011.

[C-13] A. Mittal, A. K. Moorthy and A. C. Bovik, "Blind/Referenceless Image Spatial Quality Evaluator," Off Site Icon Forty-Fifth Annual Asilomar Conference on Signals, Systems, and Computers, Monterey, CA, USA, November 2011.

[C-14] Z. Lu and G. de Veciana, "Opportunistic Transport for Stored Video Delivery over Wireless Networks: Optimal Anticipative and Causal Approximations" Off Site Icon, Invited paper at the 49th Allerton Conference on Communication, Control and Computing, Chicago, IL, October 2011.

[C-15] M. A. Saad, C. Charrier and A. C. Bovik, "DCT Statistics Model-based Blind Image Quality Assessment," Off Site Icon IEEE International Conference on Image Processing (ICIP'11), Brussels, Belgium, September 11-14, 2011.

[C-16] C. Chen, R. W. Heath Jr., A. C. Bovik and G. de Veciana, "Adaptive Policies for Real-Time Video Transmission: a Markov Decision Process Framework" Off Site Icon, IEEE International Conference on Image Processing (ICIP'11), September 11-14, 2011, Brussels, Belgium.

[C-17] R. Soundararajan and A.C. Bovik, "RRED Indices: Reduced Reference Entropic Differencing Framework for Image Quality Assessment," Off Site Icon IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'11), Prague, Czech Republic, May 2011.

[C-18] K. Seshadrinathan and A. C. Bovik, "Temporal Hysteresis Model of Time-Varying Subjective Video Quality," Off Site Icon IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'11), Prague, Czech Republic, May 2011.