Stochasticity-aware No-Reference Point Cloud Quality Assessment (2401.08926v2)
Abstract: The evolution of point cloud processing algorithms necessitates an accurate assessment for their quality. Previous works consistently regard point cloud quality assessment (PCQA) as a MOS regression problem and devise a deterministic mapping, ignoring the stochasticity in generating MOS from subjective tests. This work presents the first probabilistic architecture for no-reference PCQA, motivated by the labeling process of existing datasets. The proposed method can model the quality judging stochasticity of subjects through a tailored conditional variational autoencoder (CVAE) and produces multiple intermediate quality ratings. These intermediate ratings simulate the judgments from different subjects and are then integrated into an accurate quality prediction, mimicking the generation process of a ground truth MOS. Specifically, our method incorporates a Prior Module, a Posterior Module, and a Quality Rating Generator, where the former two modules are introduced to model the judging stochasticity in subjective tests, while the latter is developed to generate diverse quality ratings. Extensive experiments indicate that our approach outperforms previous cutting-edge methods by a large margin and exhibits gratifying cross-dataset robustness. Codes are available at https://git.openi.org.cn/OpenPointCloud/nrpcqa.
- Point cloud quality assessment metric based on angular similarity. In IEEE International Conference on Multimedia and Expo, pages 1–6. IEEE, 2018.
- Towards a point cloud structural similarity metric. In IEEE International Conference on Multimedia & Expo Workshops, pages 1–6. IEEE, 2020.
- Final report from the video quality experts group on the validation of objective models of video quality assessment march 2000. Final report from the video quality experts group on the validation of objective models of video quality assessment march 2000, 2000.
- Phiseg: Capturing uncertainty in medical image segmentation. In Medical Image Computing and Computer Assisted Intervention. Springer, 2019.
- Deep learning-based quality assessment of 3d point clouds without reference. In IEEE International Conference on Multimedia & Expo Workshops, pages 1–6. IEEE, 2021.
- A variational u-net for conditional appearance and shape generation. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8857–8866, 2018.
- Screen-based 3d subjective experiment software. In ACM International Conference on Multimedia, pages 9672–9675, 2023.
- A no-reference quality assessment metric for point cloud based on captured video sequences. In IEEE International Workshop on Multimedia Signal Processing, pages 1–5. IEEE, 2022.
- Res2net: A new multi-scale backbone architecture. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019.
- A thorough benchmark and a new model for light field saliency detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023.
- Deep residual learning for image recognition. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 770–778, 2016.
- A generalized hausdorff distance based quality metric for point cloud geometry. In International Conference on Quality of Multimedia Experience, pages 1–6. IEEE, 2020.
- Point cloud rendering after coding: Impacts on subjective and objective quality. IEEE Transactions on Multimedia, 23:4049–4064, 2020.
- Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114, 2013.
- Hallucinated-iqa: No-reference image quality assessment via adversarial learning. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 732–741, 2018.
- Reduced reference perceptual quality model with application to rate control for video-based point cloud compression. IEEE Transactions on Image Processing, 30:6623–6636, 2021.
- Pqa-net: Deep no reference point cloud quality assessment via multi-view projection. IEEE Transactions on Circuits and Systems for Video Technology, 31(12):4645–4660, 2021.
- Variational autoencoder for reference based image super-resolution. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 516–525, 2021.
- Perceptual quality assessment of colored 3d point clouds. IEEE Transactions on Visualization and Computer Graphics, 2022.
- Reduced reference quality assessment for point cloud compression. In IEEE International Conference on Visual Communications and Image Processing, pages 1–5. IEEE, 2022.
- Point cloud quality assessment: Dataset construction and learning-based no-reference metric. ACM Transactions on Multimedia Computing, Communications and Applications, 19(2s):1–26, 2023.
- Active inference of gan for no-reference image quality assessment. In IEEE International Conference on Multimedia and Expo, pages 1–6. IEEE, 2020.
- Evaluation criteria for point cloud compression. ISO/IEC MPEG, 2016.
- Pc-msdm: A quality metric for 3d point clouds. In International Conference on Quality of Multimedia Experience, pages 1–3. IEEE, 2019.
- Pcqm: A full-reference quality metric for colored 3d point clouds. In International Conference on Quality of Multimedia Experience, pages 1–6. IEEE, 2020.
- No-reference image quality assessment in the spatial domain. IEEE Transactions on Image Processing, 21(12):4695–4708, 2012.
- Making a “completely blind” image quality analyzer. IEEE Signal Processing Letters, 20(3):209–212, 2012.
- Ran4iqa: Restorative adversarial nets for no-reference image quality assessment. In AAAI Conference on Artificial Intelligence, volume 32, 2018.
- Learning structured output representation using deep conditional generative models. Advances in Neural Information Processing Systems, 28, 2015.
- Ladder variational autoencoders. Advances in Neural Information Processing Systems, 29, 2016.
- Geometric distortion metrics for point cloud compression. In IEEE International Conference on Image Processing, pages 3460–3464. IEEE, 2017.
- A novel methodology for quality assessment of voxelized point clouds. In Applications of Digital Image Processing XLI, volume 10752, pages 174–190. SPIE, 2018.
- Applying collaborative adversarial learning to blind point cloud quality measurement. IEEE Transactions on Instrumentation and Measurement, 2023.
- Subjective quality database and objective study of compressed point clouds with 6dof head-mounted display. IEEE Transactions on Circuits and Systems for Video Technology, 31(12):4630–4644, 2021.
- Predicting the perceptual quality of point cloud: A 3d-to-2d projection-based exploration. IEEE Transactions on Multimedia, 23:3877–3891, 2020.
- Inferring point cloud quality via graph similarity. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(6):3015–3029, 2020.
- Ttl-iqa: Transitive transfer learning based no-reference image quality assessment. IEEE Transactions on Multimedia, 23:4326–4340, 2020.
- Point cloud distortion quantification based on potential energy for human and machine perception. arXiv e-prints, pages arXiv–2103, 2021.
- No-reference point cloud quality assessment via domain adaptation. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 21179–21188, 2022.
- A feature-enriched completely blind image quality evaluator. IEEE Transactions on Image Processing, 24(8):2579–2591, 2015.
- Uncertainty inspired rgb-d saliency detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(9):5761–5779, 2021.
- No-reference quality assessment for 3d colored point cloud and mesh models. IEEE Transactions on Circuits and Systems for Video Technology, 32(11):7618–7631, 2022.
- Mm-pcqa: Multi-modal learning for no-reference point cloud quality assessment. International Joint Conference on Artificial Intelligence, 2023.
- Reduced-reference quality assessment of point clouds via content-oriented saliency projection. arXiv preprint arXiv:2301.07681, 2023.
- Recycling discriminator: Towards opinion-unaware image quality assessment using wasserstein gan. In ACM International Conference on Multimedia, pages 116–125, 2021.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.