No-Reference Video Quality Assessment Using Voxel-Wise fMRI Models of the Visual Cortex

Mahankali, Naga Sailaja and Raghavan, Mohan and Channappayya, Sumohana (2022) No-Reference Video Quality Assessment Using Voxel-Wise fMRI Models of the Visual Cortex. IEEE Signal Processing Letters, 29. pp. 319-323. ISSN 1070-9908

[img] Text
IEEE_Signal_Processing.pdf - Published Version
Restricted to Registered users only

Download (828kB) | Request a copy

Abstract

The performance of the human visual system is very efficient in many visual tasks such as identifying visual scenes, anticipating future actions based on the past observations, assessing the quality of visual stimuli, etc. A significant amount of effort has been directed towards finding quality aware representations of natural videos to solve the quality prediction task. In this work we present a novel no reference video quality assessment (NR-VQA) algorithm based on the functional Magnetic Resonance Imaging (fMRI) Blood Oxygen Level Dependent (BOLD) signal prediction with voxel-wise encoding models of the human brain. The voxel encoding models are learnt using deep features extracted from the AlexNet model to predict the fMRI response to natural video stimuli. We show that the curvature in the predicted voxel response time series provides good quality discriminability, and forms an important feature for quality prediction. Further, we show that the proposed curvature features in combination with the spatial index, temporal index and NIQE features deliver acceptable performance on the Video Quality Assessment (VQA) task on both synthetic and authentic distortion data-sets. © 2021 IEEE.

[error in script]
IITH Creators:
IITH CreatorsORCiD
Raghavan, Mohanhttps://orcid.org/0000-0002-9196-8193
Channappayya, Sumohanahttps://orcid.org/0000-0002-5880-4023
Item Type: Article
Uncontrolled Keywords: Brain modeling; Encoding; Functional magnetic resonance imaging; Prediction algorithms; Predictive models; Quality assessment; Visualization
Subjects: Electrical Engineering
Biomedical Engineering
Divisions: Department of Biomedical Engineering
Department of Electrical Engineering
Depositing User: . LibTrainee 2021
Date Deposited: 27 Jul 2022 11:46
Last Modified: 27 Jul 2022 11:46
URI: http://raiith.iith.ac.in/id/eprint/9970
Publisher URL: http://doi.org/10.1109/LSP.2021.3136487
OA policy: https://v2.sherpa.ac.uk/id/publication/3572
Related URLs:

Actions (login required)

View Item View Item
Statistics for RAIITH ePrint 9970 Statistics for this ePrint Item