Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Eternal Sunshine of the Mechanical Mind: The Irreconcilability of Machine Learning and the Right to be Forgotten (2403.05592v1)

Published 6 Mar 2024 in cs.GL and cs.AI

Abstract: As we keep rapidly advancing toward an era where artificial intelligence is a constant and normative experience for most of us, we must also be aware of what this vision and this progress entail. By first approximating neural connections and activities in computer circuits and then creating more and more sophisticated versions of this crude approximation, we are now facing an age to come where modern deep learning-based artificial intelligence systems can rightly be called thinking machines, and they are sometimes even lauded for their emergent behavior and black-box approaches. But as we create more powerful electronic brains, with billions of neural connections and parameters, can we guarantee that these mammoths built of artificial neurons will be able to forget the data that we store in them? If they are at some level like a brain, can the right to be forgotten still be protected while dealing with these AIs? The essential gap between machine learning and the RTBF is explored in this article, with a premonition of far-reaching conclusions if the gap is not bridged or reconciled any time soon. The core argument is that deep learning models, due to their structure and size, cannot be expected to forget or delete a data as it would be expected from a tabular database, and they should be treated more like a mechanical brain, albeit still in development.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (38)
  1. Withington, P. T. The lisp machine: Noble experiment or fabulous failure? \JournalTitleProceedings of the 40th Anniversary of Lisp – Lisp In The Mainstream – Conference (1998).
  2. Strategic computing: DARPA and the quest for machine intelligence, 1983-1993 (MIT Press, 2002).
  3. Harmon, P. The expert systems business: How it grew and died. \JournalTitleIEEE Annals of the History of Computing 44, 31–43 (2022). DOI 10.1109/MAHC.2022.3149465.
  4. Advanced user assistance systems. \JournalTitleBus. Inf. Syst. Eng. 58, 367–370 (2016).
  5. Deng, J. et al. Imagenet: A large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition, 248–255 (2009). DOI 10.1109/CVPR.2009.5206848.
  6. Imagenet classification with deep convolutional neural networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1, NIPS’12, 1097–1105 (2012). DOI 10.5555/2999134.2999257.
  7. Learning representations by back-propagating errors. \JournalTitleNature 323, 533–536 (1986). DOI https://doi.org/10.1038/323533a0.
  8. Schmidhuber, J. Annotated History of Modern AI and Deep Learning. \JournalTitlearXiv preprint arXiv:2212.11279 (2022). DOI 10.48550/arXiv.2212.11279.
  9. Witt, S. How Jensen Huang’s Nvidia is powering the A.I. revolution. https://www.newyorker.com/magazine/2023/12/04/how-jensen-huangs-nvidia-is-powering-the-ai-revolution/ (2023). Accessed: 2024-2-14.
  10. Chetlur, S. et al. cudnn: Efficient primitives for deep learning. \JournalTitlearXiv preprint arXiv:1410.0759 (2014). DOI 10.48550/arXiv.1410.0759.
  11. European Parliament & Council of the European Union. Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation). URL https://data.europa.eu/eli/reg/2016/679/oj.
  12. Case C-131/12 Google Spain SL and Google Inc. v Agencia Española de Protección de Datos (AEPD) and Mario Costeja González ECLI:EU:C:2014:317. URL https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A62012CJ0131.
  13. Humans forget, machines remember: Artificial intelligence and the right to be forgotten. \JournalTitleComputer Law & Security Review 34, 304–313 (2018). DOI 10.1016/j.clsr.2017.08.007.
  14. Koubaa, A. GPT-4 vs. GPT-3.5: A concise showdown. \JournalTitlePreprints (2023). DOI 10.20944/preprints202303.0422.v1.
  15. Kalyan, K. S. A survey of GPT-3 family large language models including ChatGPT and GPT-4. \JournalTitleNatural Language Processing Journal 6, 100048 (2024). DOI 10.1016/j.nlp.2023.100048.
  16. Patel, S. et al. Colour image encryption based on customized neural network and DNA encoding. \JournalTitleNeural Comput. Appl. 33, 14533–14550 (2021). DOI 10.1007/s00521-021-06096-2.
  17. Zero-shot learning - the good, the bad and the ugly. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017). DOI 10.1109/CVPR.2017.328.
  18. Generalizing from a few examples: A survey on few-shot learning. \JournalTitleACM Comput. Surv. 53 (2020). DOI 10.1145/3386252.
  19. Machine unlearning: Solutions and challenges. \JournalTitlearXiv preprint arXiv:2308.07061 (2023). DOI 10.48550/arXiv.2308.07061.
  20. Savage, N. Breaking into the black box of artificial intelligence. \JournalTitleNature (2022). DOI 10.1038/d41586-022-00858-1.
  21. Castelvecchi, D. Can we open the black box of AI? \JournalTitleNature 538, 20–23 (2016). DOI 10.1038/538020a.
  22. Machine unlearning: A survey. \JournalTitleACM Comput. Surv. 56 (2023). DOI 10.1145/3603620.
  23. Bates, S. The prostitute, the prodigy, and the private past. \JournalTitleCommunication Law and Policy 17, 175–233 (2012).
  24. Cognitive mirage: A review of hallucinations in large language models. \JournalTitlearXiv preprint arXiv:2309.06794 (2023). DOI 10.48550/arXiv.2309.06794.
  25. Zhang, Y. et al. Siren’s song in the AI ocean: A survey on hallucination in large language models. \JournalTitlearXiv preprint arXiv:2309.01219 (2023). DOI 10.48550/arXiv.2309.01219.
  26. Zero-shot machine unlearning. \JournalTitleIEEE Transactions on Information Forensics and Security (2023). DOI 10.1109/TIFS.2023.3265506.
  27. Lai, C. AI is harming our planet: addressing AI’s staggering energy cost (2023 update) (2023). URL https://www.numenta.com/blog/2023/08/10/ai-is-harming-our-planet-2023/. Accessed: 2024-2-14.
  28. Generative AI does not run on thin air! URL https://www.ri.se/en/news/blog/generative-ai-does-not-run-on-thin-air. Accessed: 2024-2-26.
  29. Remember what you want to forget: Algorithms for machine unlearning. \JournalTitleAdvances in Neural Information Processing Systems 34, 18075–18086 (2021). DOI 10.48550/arXiv.2103.03279.
  30. Touvron, H. et al. Llama: Open and efficient foundation language models. \JournalTitlearXiv preprint arXiv:2302.13971 (2023). DOI 10.48550/arXiv.2302.13971.
  31. Improving the speed of neural networks on cpus. In Deep Learning and Unsupervised Feature Learning Workshop, NIPS 2011 (2011).
  32. Madiega, T. Artificial intelligence act. \JournalTitleEuropean Parliament: European Parliamentary Research Service (2021).
  33. Weissinger, L. Ai, complexity, and regulation. \JournalTitleOUP Handbook on AI Governance, Forthcoming (2021). DOI https://doi.org/10.1093/oxfordhb/9780197579329.013.66.
  34. On the necessity of auditable algorithmic definitions for machine unlearning. In 31st USENIX Security Symposium (USENIX Security 22), 4007–4022 (2022).
  35. Floridi, L. Machine unlearning: its nature, scope, and importance for a “delete culture”. \JournalTitlePhilosophy & Technology 36, 42 (2023). DOI 10.1007/s13347-023-00644-5.
  36. Hinton, G. The forward-forward algorithm: Some preliminary investigations. \JournalTitlearXiv preprint arXiv:2212.13345 (2022). DOI 10.48550/arXiv.2212.13345.
  37. Eternal sunshine of the spotless mind (Universal Universal City, 2004).
  38. Crane, T. The mechanical mind: A philosophical introduction to minds, machines and mental representation (Routledge, 2015).
Citations (1)

Summary

We haven't generated a summary for this paper yet.