Digital Twin Studies for Reverse Engineering the Origins of Visual Intelligence

Annu Rev Vis Sci. 2024 Sep;10(1):145-170. doi: 10.1146/annurev-vision-101322-103628.

Abstract

What are the core learning algorithms in brains? Nativists propose that intelligence emerges from innate domain-specific knowledge systems, whereas empiricists propose that intelligence emerges from domain-general systems that learn domain-specific knowledge from experience. We address this debate by reviewing digital twin studies designed to reverse engineer the learning algorithms in newborn brains. In digital twin studies, newborn animals and artificial agents are raised in the same environments and tested with the same tasks, permitting direct comparison of their learning abilities. Supporting empiricism, digital twin studies show that domain-general algorithms learn animal-like object perception when trained on the first-person visual experiences of newborn animals. Supporting nativism, digital twin studies show that domain-general algorithms produce innate domain-specific knowledge when trained on prenatal experiences (retinal waves). We argue that learning across humans, animals, and machines can be explained by a universal principle, which we call space-time fitting. Space-time fitting explains both empiricist and nativist phenomena, providing a unified framework for understanding the origins of intelligence.

Keywords: artificial intelligence; controlled rearing; digital twin; empiricism; nativism; newborn.

Publication types

  • Review

MeSH terms

  • Algorithms
  • Animals
  • Animals, Newborn
  • Brain / physiology
  • Humans
  • Intelligence* / physiology
  • Learning* / physiology
  • Twin Studies as Topic
  • Visual Perception / physiology