On the Computational Modeling of Meaning: Embodied Cognition Intertwined with Emotion (2307.04518v2)
Abstract: This document chronicles this author's attempt to explore how words come to mean what they do, with a particular focus on child language acquisition and what that means for models of language understanding.\footnote{I say \emph{historical} because I synthesize the ideas based on when I discovered them and how those ideas influenced my later thinking.} I explain the setting for child language learning, how embodiment -- being able to perceive and enact in the world, including knowledge of concrete and abstract concepts -- is crucial, and how emotion and cognition relate to each other and the language learning process. I end with what I think are some of the requirements for a language-learning agent that learns language in a setting similar to that of children. This paper can act as a potential guide for ongoing and future work in modeling language.
- The Development of the Person: The Minnesota Study of Risk and Adaptation from Birth to Adulthood. Guilford Press, Feb. 2009.
- G. Baggio. Meaning in the Brain. MIT Press, July 2018.
- L. F. Barrett. How emotions are made: The secret life of the brain. Houghton Mifflin Harcourt, 2017.
- E. M. Bender and A. Koller. Climbing towards NLU: On meaning, form, and understanding in the age of data. In Association for Computational Linguistics, pages 5185–5198, 2020.
- Experience grounds language. arXiv, 2020.
- P. Bloom. How children learn the meanings of words. The MIT Press, 2000.
- R. A. Brooks. Flesh and Machines: How Robots Will Change Us. Vintage Books, 2003.
- J. Bruner. Child’s Talk: Learning to Use Language. W. W. Norton & Company, 1983.
- A. Cangelosi and M. Schlesinger. Developmental robotics: From babies to robots. MIT press, 2015.
- E. V. Clark. First language acquisition. Cambridge University Press, 2013.
- H. H. Clark. Using Language. Cambridge University Press, 1996.
- Abstract and concrete concepts have structurally different representational frameworks. Brain, (128):615–627, 2005.
- K. Dahlgren. Referential semantics. PhD thesis, University of California, Los Angeles, 1976.
- BERT: Pre-training of deep bidirectional transformers for language understanding. Oct. 2018.
- Linguistic bodies: The continuity between life and language. Mit Press, 2018.
- F. R. Dreyer and F. Pulvermüller. Abstract semantics in the motor system? – an event-related fMRI study on passive reading of semantic word categories carrying abstract emotional and mental meaning. Cortex, 100:52–70, 2018.
- On infant speech perception and the acquisition of language. In S. Harnad, editor, Categorical perception: The groundwork of cognition , (pp, volume 599, pages 161–195. Cambridge University Press, x, New York, NY, US, 1987.
- J. L. Elman. Rethinking innateness: A connectionist perspective on development, volume 10. MIT press, 1998.
- C. Fields and C. Kennington. Vision language transformers: A survey. July 2023.
- J. R. Firth. A synopsis of linguistic theory 1930-1955. Studies in Linguistic Analysis, 1957.
- H. P. Grice. Presupposition and conversational implicature. Radical Pragmatics, 183:183–198, 1981.
- S. Harnad. The symbol grounding problem. Physica D, 42(1-3):335–346, 1990.
- Child psychology: A contemporary viewpoint, 5th ed. 5:663, 1999.
- Breaking the language barrier: An emergentist coalition model for the origins of language learning. Monogr. Soc. Res. Child Dev., 65(3), 2000.
- Rhythms of dialogue in infancy: coordinated timing in development. Monogr. Soc. Res. Child Dev., 66(2):i–viii, 1–132, 2001.
- M. Johnson. The meaning of the body: Aesthetics of human understanding. University of Chicago Press, 2008.
- C. Kennington and O. Natouf. The symbol grounding problem re-framed as concreteness-abstractness learned through spoken interaction. In Proceedings of the 26th Workshop on the Semantics and Pragmatics of Dialogue - Full Papers, Aug. 2022.
- G. Lakoff and M. Johnson. Metaphors We Live By. University of Chicago Press, Dec. 2008.
- R. D. Lane and L. Nadel. Cognitive Neuroscience of Emotion. Oxford University Press, 2002.
- M. H. Lee. How to Grow a Robot: Developing Human-Friendly, Social AI. MIT Press, May 2020.
- J. L. Locke. The Child’s Path to Spoken Language. Harvard University Press, 1995.
- L.T.F. Gamut. Logic, Language, and Meaning, vol. 2: Intensional logic and logical grammar, volume 2. Chicago University Press, Chicago, 1991.
- G. F. Marcus. The Birth of the Mind: How a Tiny Number of Genes Creates the Complexities of Human Thought. Basic Books, 2004.
- L. McCune. How Children Learn to Learn Language. Oxford University Press, 2008.
- I. McGilchrist. The Master and His Emissary: The Divided Brain and the Making of the Western World. Yale University Press, Feb. 2019.
- D. McNeill and C. Kennington. Predicting human interpretations of affect and valence in a social robot. In Proceedings of Robotics: Science and Systems, FreiburgimBreisgau, Germany, June 2019.
- The spatial foundations of language and cognition. Oxford University Press, 2010.
- A role for the motor system in binding abstract emotional meaning. Cereb. Cortex, pages 1634–1647, July 2012.
- Predicting perceived age: Both language ability and appearance are important. In Proceedings of SigDial, 2018.
- Acquisition of abstract concepts is influenced by emotional valence. Dev. Sci., 21(2), Mar. 2018.
- Understanding brain functional architecture through robotics. Sci Robot, 8(78):eadg6014, May 2023.
- D. Schlangen. What a situated Language-Using agent must be able to do: A Top-Down analysis. Feb. 2023.
- C. Snow and C. Ferguson. Talking to children: language input and acquisition. Cambridge University Press, 1977.
- M. Tomasello. Constructing a Language. Harvard University Press, June 2009.
- Attention is all you need. Adv. Neural Inf. Process. Syst., 30, 2017.
- The neural representation of abstract words: The role of emotion. Cereb. Cortex, 2014.
- The latent structure of dictionaries. Top. Cogn. Sci., 8(3):625–659, July 2016.
- G. Westermann and N. Mani. Early Word Learning. Routledge, Nov. 2017.
- L. Wittgenstein. Philosophische untersuchungen. In Sprachwissenschaft, pages 105–111. De Gruyter, June 2010.