Beyond MOS: Subjective Image Quality Score Preprocessing Method Based on Perceptual Similarity (2404.19666v1)
Abstract: Image quality assessment often relies on raw opinion scores provided by subjects in subjective experiments, which can be noisy and unreliable. To address this issue, postprocessing procedures such as ITU-R BT.500, ITU-T P.910, and ITU-T P.913 have been standardized to clean up the original opinion scores. These methods use annotator-based statistical priors, but they do not take into account extensive information about the image itself, which limits their performance in less annotated scenarios. Generally speaking, image quality datasets usually contain similar scenes or distortions, and it is inevitable for subjects to compare images to score a reasonable score when scoring. Therefore, In this paper, we proposed Subjective Image Quality Score Preprocessing Method perceptual similarity Subjective Preprocessing (PSP), which exploit the perceptual similarity between images to alleviate subjective bias in less annotated scenarios. Specifically, we model subjective scoring as a conditional probability model based on perceptual similarity with previously scored images, called subconscious reference scoring. The reference images are stored by a neighbor dictionary, which is obtained by a normalized vector dot-product based nearest neighbor search of the images' perceptual depth features. Then the preprocessed score is updated by the exponential moving average (EMA) of the subconscious reference scoring, called similarity regularized EMA. Our experiments on multiple datasets (LIVE, TID2013, CID2013) show that this method can effectively remove the bias of the subjective scores. Additionally, Experiments prove that the Preprocesed dataset can improve the performance of downstream IQA tasks very well.
- “End-to-end blind image quality assessment using deep neural networks,” IEEE Transactions on Image Processing, vol. 27, no. 3, pp. 1202–1213, 2017.
- “Deep neural networks for no-reference and full-reference image quality assessment,” IEEE Transactions on image processing, vol. 27, no. 1, pp. 206–219, 2017.
- “Blind image quality assessment using a deep bilinear convolutional neural network,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 30, no. 1, pp. 36–47, 2018.
- “Kadid-10k: A large-scale artificially distorted iqa database,” in 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX). IEEE, 2019, pp. 1–3.
- “Large-scale crowdsourced study for tone-mapped hdr pictures,” IEEE Transactions on Image Processing, vol. 26, no. 10, pp. 4725–4740, 2017.
- “Cid2013: A database for evaluating no-reference image quality assessment algorithms,” IEEE Transactions on Image Processing, vol. 24, no. 1, pp. 390–402, 2014.
- “Vcl@ fer image quality assessment database,” in Proceedings ELMAR-2011. IEEE, 2011, pp. 105–110.
- “Itu-tp. 910,” Subjective video quality assessment methods for multimedia applications, Recommendation ITU-T, p. 910.
- IT Union, “Methods for the subjective assessment of video quality audio quality and audiovisual quality of internet video and distribution quality television in any environment,” SERIES P: TERMINALS AND SUBJECTIVE AND OBJECTIVE ASSESSMENT METHODS, 2016.
- I BT, “Methodologies for the subjective assessment of the quality of television images, document recommendation itu-r bt. 500-14 (10/2019),” ITU, Geneva, Switzerland, 2020.
- “Blind image quality assessment with active inference,” IEEE Transactions on Image Processing, vol. 30, pp. 3650–3663, 2021.
- “Blind tone-mapped image quality assessment and enhancement via disentangled representation learning,” in 2020 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC). IEEE, 2020, pp. 1096–1102.
- “Transformer for image quality assessment,” in 2021 IEEE International Conference on Image Processing (ICIP). IEEE, 2021, pp. 1389–1393.
- “Perceptual quality assessment of omnidirectional images,” in 2018 IEEE international symposium on circuits and systems (ISCAS). IEEE, 2018, pp. 1–5.
- “Mc360iqa: A multi-channel cnn for blind 360-degree image quality assessment,” IEEE Journal of Selected Topics in Signal Processing, vol. 14, no. 1, pp. 64–77, 2019.
- “Towards a quality metric for dense light fields,” in Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2017.
- “Objective quality evaluation of dehazed images,” IEEE Transactions on Intelligent Transportation Systems, vol. 20, no. 8, pp. 2879–2892, 2018.
- “Quality evaluation of image dehazing methods using synthetic hazy images,” IEEE Transactions on Multimedia, vol. 21, no. 9, pp. 2319–2333, 2019.
- “A closer look at memorization in deep networks,” in International conference on machine learning. PMLR, 2017, pp. 233–242.
- “Robust loss functions under label noise for deep neural networks,” in Proceedings of the AAAI conference on artificial intelligence, 2017, vol. 31.
- “Joint optimization framework for learning with noisy labels,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 5552–5560.
- “Training deep neural-networks using a noise adaptation layer,” 2016.
- “Sample selection with uncertainty of losses for learning with noisy labels,” arXiv preprint arXiv:2106.00445, 2021.
- “Understanding deep learning (still) requires rethinking generalization,” Communications of the ACM, vol. 64, no. 3, pp. 107–115, 2021.
- “Generalized cross entropy loss for training deep neural networks with noisy labels,” Advances in neural information processing systems, vol. 31, 2018.
- “Learning with noisy labels via sparse regularization,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 72–81.
- “Self-knowledge distillation in natural language processing,” in Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019), 2019, pp. 423–430.
- “A closer look at deep learning heuristics: Learning rate restarts, warmup and distillation,” in International Conference on Learning Representations, 2019.
- “Symmetric cross entropy for robust learning with noisy labels,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 322–330.
- “Leveraging in-batch annotation bias for crowdsourced active learning,” in Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, 2015, pp. 243–252.
- “Understanding and mitigating worker biases in the crowdsourced collection of subjective judgments,” in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019, pp. 1–12.
- “Crowdsourced data management: A survey,” IEEE Transactions on Knowledge and Data Engineering, vol. 28, no. 9, pp. 2296–2319, 2016.
- “The unreasonable effectiveness of deep features as a perceptual metric,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 586–595.
- “Mean opinion score (mos) revisited: methods and applications, limitations and alternatives,” Multimedia Systems, vol. 22, no. 2, pp. 213–227, 2016.
- “A simple model for subject behavior in subjective experiments,” Electronic Imaging, vol. 2020, no. 11, pp. 131–1, 2020.
- “A statistical evaluation of recent full reference image quality assessment algorithms,” IEEE Transactions on image processing, vol. 15, no. 11, pp. 3440–3451, 2006.
- “Image database tid2013: Peculiarities, results and perspectives,” Signal processing: Image communication, vol. 30, pp. 57–77, 2015.
- “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778.
- Lei Wang (975 papers)
- Desen Yuan (5 papers)