Papers
Topics
Authors
Recent
2000 character limit reached

Feature Noise Resilient for QoS Prediction with Probabilistic Deep Supervision (2308.02580v3)

Published 3 Aug 2023 in cs.SE, cs.DC, cs.IR, and cs.LG

Abstract: Accurate Quality of Service (QoS) prediction is essential for enhancing user satisfaction in web recommendation systems, yet existing prediction models often overlook feature noise, focusing predominantly on label noise. In this paper, we present the Probabilistic Deep Supervision Network (PDS-Net), a robust framework designed to effectively identify and mitigate feature noise, thereby improving QoS prediction accuracy. PDS-Net operates with a dual-branch architecture: the main branch utilizes a decoder network to learn a Gaussian-based prior distribution from known features, while the second branch derives a posterior distribution based on true labels. A key innovation of PDS-Net is its condition-based noise recognition loss function, which enables precise identification of noisy features in objects (users or services). Once noisy features are identified, PDS-Net refines the feature's prior distribution, aligning it with the posterior distribution, and propagates this adjusted distribution to intermediate layers, effectively reducing noise interference. Extensive experiments conducted on two real-world QoS datasets demonstrate that PDS-Net consistently outperforms existing models, achieving an average improvement of 8.91% in MAE on Dataset D1 and 8.32% on Dataset D2 compared to the ate-of-the-art. These results highlight PDS-Net's ability to accurately capture complex user-service relationships and handle feature noise, underscoring its robustness and versatility across diverse QoS prediction environments.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (50)
  1. JohnS Breese DavidHeckerman CarlKadie. 1998. Empirical analysis of predictive algorithms for collaborative filtering. Microsoft Research Microsoft Corporation One Microsoft Way Redmond, WA 98052 (1998).
  2. Regionknn: A scalable hybrid collaborative filtering algorithm for personalized web service recommendation. In IEEE international conference on web services. IEEE, 9–16.
  3. Your neighbors alleviate cold-start: On geographical neighborhood influence to collaborative web service QoS prediction. Knowledge-Based Systems 138 (2017), 188–201.
  4. Cahphf: context-aware hierarchical QoS prediction with hybrid filtering. IEEE Transactions on Services Computing 15, 4 (2020), 2232–2247.
  5. A survey on web service QoS prediction methods. IEEE Transactions on Services Computing 15, 4 (2020), 2439–2454.
  6. Neural collaborative filtering. In Proceedings of the 26th international conference on world wide web. 173–182.
  7. Probabilistic matrix factorization with non-random missing data. In International Conference on Machine Learning. 1512–1520.
  8. Deep networks with stochastic depth. In European conference on computer vision. Springer, 646–661.
  9. A new QoS prediction model using hybrid IOWA-ANFIS with fuzzy C-means, subtractive clustering and grid partitioning. Information Sciences 584 (2022), 280–300.
  10. Denoising criterion for variational auto-encoding framework. In AAAI conference on artificial intelligence, Vol. 31.
  11. Grouplens: Applying collaborative filtering to usenet news. Commun. ACM 40, 3 (1997), 77–87.
  12. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30–37.
  13. Deeply-supervised nets. In Artificial intelligence and statistics. PMLR, 562–570.
  14. Location-based web service QoS prediction via preference propagation for improving cold start problem. In IEEE International Conference on Web Services. IEEE, 177–184.
  15. Duo Li and Qifeng Chen. 2020. Dynamic hierarchical mimicking towards consistent optimization objectives. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 7642–7651.
  16. Topology-aware neural model for highly accurate QoS prediction. IEEE Transactions on Parallel and Distributed Systems 33, 7 (2021), 1538–1552.
  17. Recurrent neural network based collaborative filtering for QoS prediction in IoV. IEEE Transactions on Intelligent Transportation Systems 23, 3 (2021), 2400–2410.
  18. Context-aware and adaptive QoS prediction for mobile edge computing services. IEEE Transactions on Services Computing 15, 1 (2019), 400–413.
  19. A nonnegative latent factor model for large-scale sparse matrices in recommender systems via alternating direction method. IEEE transactions on neural networks and learning systems 27, 3 (2015), 579–592.
  20. Latent Ability Model: A Generative Probabilistic Learning Framework for Workforce Analytics. IEEE Transactions on Knowledge and Data Engineering 31, 5 (2018), 923–937.
  21. Effective missing data prediction for collaborative filtering. In Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval. 39–46.
  22. Daniel A Menascé. 2002. QoS issues in web services. IEEE internet computing 6, 6 (2002), 72–75.
  23. Probabilistic neural networks: a brief overview of theory, implementation, and application. Handbook of Probabilistic Models (2020), 347–367.
  24. Varsha R Mouli and KP Jevitha. 2016. Web services attacks and security-a systematic literature review. Procedia Computer Science 93 (2016), 870–877.
  25. S-RAP: relevance-aware QoS prediction in web-services and user contexts. Knowledge and Information Systems 64, 7 (2022), 1997–2022.
  26. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th international conference on World Wide Web. 285–295.
  27. Collaborative filtering beyond the user-item matrix: A survey of the state of the art and future challenges. ACM Computing Surveys (CSUR) 47, 1 (2014), 1–45.
  28. Zhenhua Tan and Liangliang He. 2017. An efficient similarity measure for user-based collaborative filtering recommender systems inspired by the physical resonance principle. IEEE Access 5 (2017), 27211–27228.
  29. Location-aware collaborative filtering for QoS-based service recommendation. In IEEE 19th international conference on web services. IEEE, 202–209.
  30. Online reliability prediction via motifs-based dynamic Bayesian networks for service-oriented systems. IEEE Transactions on Software Engineering 43, 6 (2016), 556–579.
  31. Training deeper convolutional networks with deep supervision. arXiv ([n. d.]).
  32. QoS prediction for service recommendations in mobile edge computing. J. Parallel and Distrib. Comput. 127 (2019), 134–144.
  33. HSA-Net: Hidden-State-Aware Networks for High-Precision QoS Prediction. IEEE Transactions on Parallel and Distributed Systems 33, 6 (2021), 1421–1435.
  34. A data-characteristic-aware latent factor model for web services QoS prediction. IEEE Transactions on Knowledge and Data Engineering 34, 6 (2020), 2525–2538.
  35. A double-space and double-norm ensembled latent factor model for highly accurate web service QoS prediction. IEEE Transactions on Services Computing 16, 2 (2022), 802–814.
  36. Joint deep networks based multi-source feature learning for QoS Prediction. IEEE Transactions on Services Computing 15, 4 (2021), 2314–2327.
  37. Deep hybrid collaborative filtering for web service recommendation. Expert systems with Applications 110 (2018), 191–205.
  38. Outlier-Resilient Web Service QoS Prediction. In Proceedings of the Web Conference 2021. 3099–3110.
  39. QoS prediction for service recommendation with deep feature learning in edge computing environment. Mobile Networks and Applications (2019), 1–11.
  40. Contrastive deep supervision. In European Conference on Computer Vision. Springer, 1–19.
  41. Task-oriented feature distillation. Advances in Neural Information Processing Systems 33 (2020), 14759–14771.
  42. Scan: A scalable neural networks framework towards compact and efficient models. Advances in Neural Information Processing Systems 32 (2019).
  43. Yishuo Zhang and Albert Chung. 2018. Deep supervision with additional labels for retinal vessel segmentation task. In International conference on medical image computing and computer-assisted intervention. Springer, 83–91.
  44. Location-aware deep collaborative filtering for service recommendation. IEEE Transactions on Systems, Man, and Cybernetics: Systems (2019).
  45. WSPred: A time-aware personalized QoS prediction framework for Web services. In IEEE International Symposium on Software Reliability Engineering. IEEE, 210–219.
  46. Web service QoS prediction via collaborative filtering: A survey. IEEE Transactions on Services Computing 15, 4 (2020), 2455–2472.
  47. Zibin Zheng and Michael R Lyu. 2008. Ws-dream: A distributed reliability assessment mechanism for web services. In International Conference on Dependable Systems and Networks With FTCS and DCC (DSN). IEEE, 392–397.
  48. Qos-aware web service recommendation by collaborative filtering. IEEE Transactions on services computing 4, 2 (2010), 140–152.
  49. Spatio-temporal context-aware collaborative QoS prediction. Future Generation Computer Systems 100 (2019), 46–57.
  50. NCRL: Neighborhood-Based Collaborative Residual Learning for Adaptive QoS Prediction. IEEE Transactions on Services Computing (2022).

Summary

We haven't generated a summary for this paper yet.

Whiteboard

Paper to Video (Beta)

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.