The Universal Law of Generalization Holds for Naturalistic Stimuli
Abstract: Shepard's universal law of generalization is a remarkable hypothesis about how intelligent organisms should perceive similarity. In its broadest form, the universal law states that the level of perceived similarity between a pair of stimuli should decay as a concave function of their distance when embedded in an appropriate psychological space. While extensively studied, evidence in support of the universal law has relied on low-dimensional stimuli and small stimulus sets that are very different from their real-world counterparts. This is largely because pairwise comparisons -- as required for similarity judgments -- scale quadratically in the number of stimuli. We provide direct evidence for the universal law in a naturalistic high-dimensional regime by analyzing an existing dataset of 214,200 human similarity judgments and a newly collected dataset of 390,819 human generalization judgments (N=2406 US participants) across three sets of natural images.
- “The moral machine experiment” In Nature 563.7729 Nature Publishing Group, 2018, pp. 59–64
- Ruairidh M Battleday, Joshua C Peterson and Thomas L Griffiths “Capturing human categorization of natural images by combining deep networks and cognitive models” In Nature Communications 11.1 Nature Publishing Group, 2020, pp. 1–14
- “Over-reliance on English hinders cognitive science” In Trends in Cognitive Sciences 26.12, 2022, pp. 1153–1170
- Nick Chater and Paul MB Vitányi “The generalized universal law of generalization” In Journal of Mathematical Psychology 47.3 Elsevier, 2003, pp. 346–369
- Ken Cheng “Shepard’s universal law supported by honeybees in spatial generalization” In Psychological Science 11.5 SAGE Publications Sage CA: Los Angeles, CA, 2000, pp. 403–408
- “Audio set: An ontology and human-labeled dataset for audio events” In 2017 IEEE international conference on acoustics, speech and signal processing (ICASSP), 2017, pp. 776–780 IEEE
- “A century of generalization” In Animal Behaviour 66.1, 2003, pp. 15–36
- “Gibbs Sampling with People” In Advances in Neural Information Processing Systems 33 Curran Associates, Inc., 2020, pp. 10659–10671
- “The elements of statistical learning: data mining, inference, and prediction” Springer, 2009
- “Revealing the multidimensional mental representations of natural objects underlying human similarity judgements” In Nature Human Behaviour 4.11 Nature Publishing Group UK London, 2020, pp. 1173–1185
- Aditi Jha, Joshua C Peterson and Thomas L Griffiths “Extracting low-dimensional psychological representations from convolutional neural networks” In Cognitive Science 47.1 Wiley Online Library, 2023, pp. e13226
- Charles Kemp and Joshua B Tenenbaum “Structured statistical models of inductive reasoning.” In Psychological Review 116.1 American Psychological Association, 2009, pp. 20
- Joseph B Kruskal “Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis” In Psychometrika 29.1 Springer, 1964, pp. 1–27
- “Reshaping musical consonance with timbral manipulations and massive online experiments” In bioRxiv Cold Spring Harbor Laboratory, 2022, pp. 2022–06
- “Words are all you need? Language as an approximation for human similarity judgments” In The Eleventh International Conference on Learning Representations, 2023
- In Jae Myung and Roger N Shepard “Maximum entropy inference and stimulus generalization” In Journal of Mathematical Psychology 40.4, 1996, pp. 342–347
- “Category-based induction.” In Psychological Review 97.2 American Psychological Association, 1990, pp. 185
- “Scikit-learn: Machine Learning in Python” In Journal of Machine Learning Research 12, 2011, pp. 2825–2830
- “Structuring knowledge with cognitive maps and cognitive graphs” In Trends in cognitive sciences 25.1 Elsevier, 2021, pp. 37–54
- Joshua C. Peterson, Joshua T. Abbott and Thomas L. Griffiths “Evaluating (and Improving) the Correspondence Between Deep Neural Networks and Human Representations” In Cognitive Science 42.8, 2018, pp. 2648–2669
- “Using large-scale experiments and machine learning to discover theories of human decision-making” In Science 372.6547 American Association for the Advancement of Science, 2021, pp. 1209–1214
- Joshua C Peterson and Thomas L Griffiths “Evidence for the size principle in semantic and perceptual domains” In arXiv preprint arXiv:1705.03260, 2017
- Maurice Bertram Priestley “Spectral analysis and time series: probability and mathematical statistics” Academic Press, 1981
- Brett D Roads and Bradley C Love “Enriching imagenet with human similarity judgments and psychological embeddings” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 3547–3557
- Craig A Sanders and Robert M Nosofsky “Training deep networks to construct a psychological feature space for a natural-object category domain” In Computational Brain & Behavior 3, 2020, pp. 229–251
- “pygam: Generalized additive models in python” In Zenodo. doi 10, 2018
- Roger N Shepard “The analysis of proximities: multidimensional scaling with an unknown distance function. I.” In Psychometrika 27.2, 1962, pp. 125–140
- Roger N. Shepard “Multidimensional scaling, tree-fitting, and clustering” In Science 210.4468 American Association for the Advancement of Science, 1980, pp. 390–398
- Roger N Shepard “Toward a universal law of generalization for psychological science” In Science 237.4820 American Association for the Advancement of Science, 1987, pp. 1317–1323
- Chris R. Sims “Efficient coding explains the universal law of generalization in human perception” In Science 360.6389, 2018, pp. 652–656
- Mark Steyvers “Multidimensional scaling” In Encyclopedia of cognitive science 1, 2002
- Joshua B. Tenenbaum and Thomas L. Griffiths “Generalization, similarity, and Bayesian inference” In Behavioral and Brain Sciences 24.4 Cambridge University Press, 2001, pp. 629–640
- Amos Tversky “Features of similarity.” In Psychological Review 84.4, 1977, pp. 327
- “Nearest neighbor analysis of psychological spaces.” In Psychological review 93.1 American Psychological Association, 1986, pp. 3
- Note: See Table 1 for definitions of the various evaluation metrics.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.