Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Perceptual Scales Predicted by Fisher Information Metrics (2310.11759v2)

Published 18 Oct 2023 in q-bio.NC, cs.CV, cs.IT, and math.IT

Abstract: Perception is often viewed as a process that transforms physical variables, external to an observer, into internal psychological variables. Such a process can be modeled by a function coined perceptual scale. The perceptual scale can be deduced from psychophysical measurements that consist in comparing the relative differences between stimuli (i.e. difference scaling experiments). However, this approach is often overlooked by the modeling and experimentation communities. Here, we demonstrate the value of measuring the perceptual scale of classical (spatial frequency, orientation) and less classical physical variables (interpolation between textures) by embedding it in recent probabilistic modeling of perception. First, we show that the assumption that an observer has an internal representation of univariate parameters such as spatial frequency or orientation while stimuli are high-dimensional does not lead to contradictory predictions when following the theoretical framework. Second, we show that the measured perceptual scale corresponds to the transduction function hypothesized in this framework. In particular, we demonstrate that it is related to the Fisher information of the generative model that underlies perception and we test the predictions given by the generative model of different stimuli in a set a of difference scaling experiments. Our main conclusion is that the perceptual scale is mostly driven by the stimulus power spectrum. Finally, we propose that this measure of perceptual scale is a way to push further the notion of perceptual distances by estimating the perceptual geometry of images i.e. the path between images instead of simply the distance between those.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. Toward reliable measurements of perceptual scales in multiple contexts. Journal of Vision, 20(4):19–19, 2020.
  2. Comparing sensitivity estimates from mlds and forced-choice methods in a slant-from-texture experiment. Journal of Vision, 17(1):37–37, 2017.
  3. Understanding and simplifying perceptual distances. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.  12226–12235, 2021.
  4. Fred Attneave. Some informational aspects of visual perception. Psychological review, 61(3):183, 1954.
  5. Horace B Barlow et al. Possible principles underlying the transformation of sensory messages. Sensory communication, 1(01):217–233, 1961.
  6. Neural population control via deep image synthesis. Science, 364(6439):eaav9436, 2019.
  7. Reassessing optimal neural population codes with neurometric functions. Proceedings of the National Academy of Sciences, 108(11):4423–4428, 2011.
  8. Optimal short-term population coding: When fisher information fails. Neural computation, 14(10):2317–2351, 2002.
  9. Mutual information, fisher information, and population coding. Neural computation, 10(7):1731–1757, 1998.
  10. PL Chebyshev. On mean values.[o srednikh velichinakh]. Matem. Sbornik, pp.  1–9, 1867.
  11. Optimal transport for gaussian mixture models. IEEE Access, 7:6269–6278, 2018.
  12. A common signal detection model accounts for both perception and discrimination of the watercolor effect. Journal of Vision, 12(3):19–19, 2012.
  13. Measuring perceived differences in surface texture due to changes in higher order statistics. JOSA A, 27(5):1232–1244, 2010.
  14. Bruno Galerne. Stochastic image models and texture synthesis. PhD thesis, École normale supérieure de Cachan-ENS Cachan, 2010.
  15. Texture synthesis using convolutional neural networks. Advances in neural information processing systems, 28, 2015.
  16. Cardinal rules: visual orientation perception reflects knowledge of environmental statistics. Nature neuroscience, 14(7):926–932, 2011.
  17. On the relation between statistical learning and perceptual distances. In 10th International Conference on Learning Representations, ICLR 2022, 2022.
  18. Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems, 30, 2017.
  19. Origin of information-limiting noise correlations. Proceedings of the National Academy of Sciences, 112(50):E6973–E6982, 2015.
  20. A perceptual metric for photo retouching. Proceedings of the National Academy of Sciences, 108(50):19907–19912, 2011.
  21. Perception as Bayesian inference. Cambridge University Press, 1996.
  22. Mlds: Maximum likelihood difference scaling in r. Journal of Statistical Software, 25:1–26, 2008.
  23. Andrey Kolmogoroff. Grundbegriffe der wahrscheinlichkeitsrechnung. Springer-Verlag Berlin Heidelberg, 1933.
  24. The role of imagenet classes in fréchet inception distance. In The Eleventh International Conference on Learning Representations, 2023.
  25. Jan R Magnus. The moments of products of quadratic forms in normal variables. Statistica Neerlandica, 32(4):201–210, 1978. URL https://www.janmagnus.nl/papers/JRM003.pdf.
  26. Maximum likelihood difference scaling. Journal of Vision, 3(8):5–5, 2003.
  27. A general framework for inferring bayesian ideal observer models from psychophysical data. eneuro, 10(1), 2023.
  28. Neuronal correlates of a perceptual decision. Nature, 341(6237):52–54, 1989.
  29. Image statistics underlying natural texture selectivity of neurons in macaque v4. Proceedings of the National Academy of Sciences, 112(4):E351–E360, 2015.
  30. How close are we to understanding v1? Neural computation, 17(8):1665–1699, 2005.
  31. The matrix cookbook. Technical University of Denmark, 7(15):510, 2008.
  32. A parametric texture model based on joint statistics of complex wavelet coefficients. International journal of computer vision, 40:49–70, 2000.
  33. Improved techniques for training gans. Advances in neural information processing systems, 29, 2016.
  34. Noise characteristics and prior expectations in human visual speed perception. Nature neuroscience, 9(4):578–585, 2006.
  35. Louis L Thurstone. A law of comparative judgment. Psychological review, 34(4):273, 1927.
  36. The Portilla-Simoncelli Texture Model: towards Understanding the Early Visual Cortex. Image Processing On Line, 11:170–211, 2021. https://doi.org/10.5201/ipol.2021.324.
  37. Bayesian modeling of motion perception using dynamical stochastic textures. Neural computation, 30(12):3355–3392, 2018.
  38. Texture interpolation for probing visual perception. Advances in neural information processing systems, 33:22146–22157, 2020.
  39. Textures as probes of visual processing. Annual review of vision science, 3:275–296, 2017.
  40. Martin J Wainwright. Visual adaptation as optimal information transmission. Vision research, 39(23):3960–3974, 1999.
  41. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13(4):600–612, 2004.
  42. Mutual information, fisher information, and efficient coding. Neural computation, 28(2):305–326, 2016.
  43. Lawful relation between perceptual bias and discriminability. Proceedings of the National Academy of Sciences, 114(38):10244–10249, 2017.
  44. Peter Whittle. The analysis of multiple stationary time series. Journal of the Royal Statistical Society: Series B (Methodological), 15(1):125–139, 1953.
  45. Fisher and shannon information in finite neural populations. Neural computation, 24(7):1740–1780, 2012.
  46. The bounded rationality of probability distortion. Proceedings of the National Academy of Sciences, 117(36):22024–22034, 2020.
  47. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.  586–595, 2018.

Summary

We haven't generated a summary for this paper yet.