Papers
Topics
Authors
Recent
Search
2000 character limit reached

The Universal Law of Generalization Holds for Naturalistic Stimuli

Published 14 Jun 2023 in q-bio.NC, cs.AI, and stat.AP | (2306.08564v1)

Abstract: Shepard's universal law of generalization is a remarkable hypothesis about how intelligent organisms should perceive similarity. In its broadest form, the universal law states that the level of perceived similarity between a pair of stimuli should decay as a concave function of their distance when embedded in an appropriate psychological space. While extensively studied, evidence in support of the universal law has relied on low-dimensional stimuli and small stimulus sets that are very different from their real-world counterparts. This is largely because pairwise comparisons -- as required for similarity judgments -- scale quadratically in the number of stimuli. We provide direct evidence for the universal law in a naturalistic high-dimensional regime by analyzing an existing dataset of 214,200 human similarity judgments and a newly collected dataset of 390,819 human generalization judgments (N=2406 US participants) across three sets of natural images.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (35)
  1. “The moral machine experiment” In Nature 563.7729 Nature Publishing Group, 2018, pp. 59–64
  2. Ruairidh M Battleday, Joshua C Peterson and Thomas L Griffiths “Capturing human categorization of natural images by combining deep networks and cognitive models” In Nature Communications 11.1 Nature Publishing Group, 2020, pp. 1–14
  3. “Over-reliance on English hinders cognitive science” In Trends in Cognitive Sciences 26.12, 2022, pp. 1153–1170
  4. Nick Chater and Paul MB Vitányi “The generalized universal law of generalization” In Journal of Mathematical Psychology 47.3 Elsevier, 2003, pp. 346–369
  5. Ken Cheng “Shepard’s universal law supported by honeybees in spatial generalization” In Psychological Science 11.5 SAGE Publications Sage CA: Los Angeles, CA, 2000, pp. 403–408
  6. “Audio set: An ontology and human-labeled dataset for audio events” In 2017 IEEE international conference on acoustics, speech and signal processing (ICASSP), 2017, pp. 776–780 IEEE
  7. “A century of generalization” In Animal Behaviour 66.1, 2003, pp. 15–36
  8. “Gibbs Sampling with People” In Advances in Neural Information Processing Systems 33 Curran Associates, Inc., 2020, pp. 10659–10671
  9. “The elements of statistical learning: data mining, inference, and prediction” Springer, 2009
  10. “Revealing the multidimensional mental representations of natural objects underlying human similarity judgements” In Nature Human Behaviour 4.11 Nature Publishing Group UK London, 2020, pp. 1173–1185
  11. Aditi Jha, Joshua C Peterson and Thomas L Griffiths “Extracting low-dimensional psychological representations from convolutional neural networks” In Cognitive Science 47.1 Wiley Online Library, 2023, pp. e13226
  12. Charles Kemp and Joshua B Tenenbaum “Structured statistical models of inductive reasoning.” In Psychological Review 116.1 American Psychological Association, 2009, pp. 20
  13. Joseph B Kruskal “Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis” In Psychometrika 29.1 Springer, 1964, pp. 1–27
  14. “Reshaping musical consonance with timbral manipulations and massive online experiments” In bioRxiv Cold Spring Harbor Laboratory, 2022, pp. 2022–06
  15. “Words are all you need? Language as an approximation for human similarity judgments” In The Eleventh International Conference on Learning Representations, 2023
  16. In Jae Myung and Roger N Shepard “Maximum entropy inference and stimulus generalization” In Journal of Mathematical Psychology 40.4, 1996, pp. 342–347
  17. “Category-based induction.” In Psychological Review 97.2 American Psychological Association, 1990, pp. 185
  18. “Scikit-learn: Machine Learning in Python” In Journal of Machine Learning Research 12, 2011, pp. 2825–2830
  19. “Structuring knowledge with cognitive maps and cognitive graphs” In Trends in cognitive sciences 25.1 Elsevier, 2021, pp. 37–54
  20. Joshua C. Peterson, Joshua T. Abbott and Thomas L. Griffiths “Evaluating (and Improving) the Correspondence Between Deep Neural Networks and Human Representations” In Cognitive Science 42.8, 2018, pp. 2648–2669
  21. “Using large-scale experiments and machine learning to discover theories of human decision-making” In Science 372.6547 American Association for the Advancement of Science, 2021, pp. 1209–1214
  22. Joshua C Peterson and Thomas L Griffiths “Evidence for the size principle in semantic and perceptual domains” In arXiv preprint arXiv:1705.03260, 2017
  23. Maurice Bertram Priestley “Spectral analysis and time series: probability and mathematical statistics” Academic Press, 1981
  24. Brett D Roads and Bradley C Love “Enriching imagenet with human similarity judgments and psychological embeddings” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 3547–3557
  25. Craig A Sanders and Robert M Nosofsky “Training deep networks to construct a psychological feature space for a natural-object category domain” In Computational Brain & Behavior 3, 2020, pp. 229–251
  26. “pygam: Generalized additive models in python” In Zenodo. doi 10, 2018
  27. Roger N Shepard “The analysis of proximities: multidimensional scaling with an unknown distance function. I.” In Psychometrika 27.2, 1962, pp. 125–140
  28. Roger N. Shepard “Multidimensional scaling, tree-fitting, and clustering” In Science 210.4468 American Association for the Advancement of Science, 1980, pp. 390–398
  29. Roger N Shepard “Toward a universal law of generalization for psychological science” In Science 237.4820 American Association for the Advancement of Science, 1987, pp. 1317–1323
  30. Chris R. Sims “Efficient coding explains the universal law of generalization in human perception” In Science 360.6389, 2018, pp. 652–656
  31. Mark Steyvers “Multidimensional scaling” In Encyclopedia of cognitive science 1, 2002
  32. Joshua B. Tenenbaum and Thomas L. Griffiths “Generalization, similarity, and Bayesian inference” In Behavioral and Brain Sciences 24.4 Cambridge University Press, 2001, pp. 629–640
  33. Amos Tversky “Features of similarity.” In Psychological Review 84.4, 1977, pp. 327
  34. “Nearest neighbor analysis of psychological spaces.” In Psychological review 93.1 American Psychological Association, 1986, pp. 3
  35. Note: See Table 1 for definitions of the various evaluation metrics.

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.