2000 character limit reached
Design of the Artificial: lessons from the biological roots of general intelligence (1703.02245v3)
Published 7 Mar 2017 in cs.AI, cs.NE, nlin.AO, and q-bio.NC
Abstract: Our fascination with intelligent machines goes back to ancient times with the mythical automaton Talos, Aristotle's mode of mechanical thought (syllogism) and Heron of Alexandria's mechanical machines. However, the quest for AGI has been troubled with repeated failures. Recently, there has been a shift towards bio-inspired software and hardware, but their singular design focus makes them inefficient in achieving AGI. Which set of requirements have to be met in the design of AGI? What are the limits in the design of the artificial? A careful examination of computation in biological systems suggests that evolutionary tinkering of contextual processing of information enabled by a hierarchical architecture is key to building AGI.
- William Ross. Ashby. Design for a brain: the origin of adaptive behaviour. Chapman &\&& Hall Ltd., 1954.
- William Ross Ashby. Requisite Variety and Its Implications for the Control of Complex Systems. Cybernetica, 1(2):83–99, 1958.
- Philip Ball. The problems of biological information. Philosophical Transactions of the Royal Society A, 374(2063):20150072, feb 2016.
- Experimental verification of Landauer’s principle linking information and thermodynamics. Nature, 483(7388):187–189, mar 2012.
- Vannevar Bush. As we may think. Atlantic Monthly, 1945.
- When will a large complex system be stable? Journal of Theoretical Biology, 113(1):153–156, mar 1985.
- Neural Networks and Neuroscience-Inspired Computer Vision. Current Biology, 24(18):R921–R929, sep 2014.
- Quantifying collectivity. Current Opinion in Neurobiology, 37:106–113, apr 2016.
- Steve Furber. Large-scale neuromorphic computing systems. Journal of Neural Engineering, 13(5):051001, aug 2016.
- Connectance of Large Dynamic (Cybernetic) Systems: Critical Values for Stability. Nature, 228(5273):784–784, nov 1970.
- William Grey Walter. An Imitation of Life. Scientific American, 182(5):42–45, may 1950.
- Quantifying causal emergence shows that macro can beat micro. Proceedings of the National Academy of Sciences, 110(49):19790–19795, nov 2013.
- John J. Hopfield. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences, 79(8):2554–2558, apr 1982.
- John J. Hopfield. Physics Computation, and Why Biology Looks so Different. Journal of Theoretical Biology, 171(1):53–60, jul 1994.
- Francois Jacob. Evolution and tinkering. Science, 196(4295):1161–1166, jun 1977.
- Rolf Landauer. Irreversibility and Heat Generation in the Computing Process. IBM Journal of Research and Development, 5(3):183–191, jul 1961.
- Rolf Landauer. Information is Physical. Physics Today, 44(5):23–29, may 1991.
- Deep learning. Nature, 521(7553):436–444, may 2015.
- Why does deep and cheap learning work so well? Journal of Statistical Physics, 168(6):1223–1247, Sep 2017.
- Controlled Flight of a Biologically Inspired Insect-Scale Robot. Science, 340(6132):603–607, may 2013.
- Robert M. May. Will a Large Complex System be Stable? Nature, 238(5364):413–414, aug 1972.
- John Maynard Smith. The Concept of Information in Biology. Philosophy of Science, 67(2):177–194, jun 2000.
- John McCarthy. Generality in Artificial Intelligence. Communications of the ACM, 30(12):1030–1035, dec 1987.
- A million spiking-neuron integrated circuit with a scalable communication network and interface. Science, 345(6197):668–673, aug 2014.
- Computer Simulation of Human Thinking: A theory of problem solving expressed as a computer program permits simulation of thinking processes. Science, 134(3495):2011–2017, dec 1961.
- see Popper’s discussions on the logic of scientific discovery.
- Phototactic guidance of a tissue-engineered soft-robotic ray. Science, 353(6295):158–162, jul 2016.
- Thermodynamics of information. Nature Physics, 11(2):131–139, feb 2015.
- Judea Pearl. Heuristics: Intelligent search strategies for computer problem solving. Addison-Wesley Pub. Co., Inc.,Reading, MA, Jan 1984.
- Top-down models in biology: explanation and control of complex living systems above the molecular level. Journal of The Royal Society Interface, 13(124):20160555, nov 2016.
- New Robotics: Design Principles for Intelligent Systems. Artificial Life, 11(1-2):99–120, jan 2005.
- Karl R. Popper. The logic of scientific discovery. Routledge, London/New York, 1959.
- Evolutionary Epistemology Rationality, and the Sociology of Knowledge. 1989.
- Behavior Purpose and Teleology. Philosophy of Science, 10(1):18–24, jan 1943.
- Claude E. Shannon. A Mathematical Theory of Communication. Bell System Technical Journal, 27(3):379–423, jul 1948.
- Herbert A. Simon. The Architecture of Complexity. Proceedings of the American Philosophical Society, 106(6):467–482, 1962.
- Herbert A. Simon. The Sciences of the Artificial, chapter The Architecture of Complexity. M.I.T. Press, 1969.
- Trial and error search in solving difficult problems: Evidence from the game of chess. Behavioral Science, 7(4):425–429, jan 1962.
- Luc Steels. The Artificial Life Roots of Artificial Intelligence. Artificial Life, 1(1_2):75–110, oct 1993.
- How to Grow a Mind: Statistics Structure, and Abstraction. Science, 331(6022):1279–1285, mar 2011.
- Experimental demonstration of information-to-energy conversion and validation of the generalized Jarzynski equality. Nature Physics, 6(12):988–992, nov 2010.
- Sarah I. Walker and Paul C. W. Davies. The algorithmic origins of life. Journal of The Royal Society Interface, 10(79):20120869–20120869, dec 2012.