Generative AI and the Art of Crafting New Experiences

Advancements in generative AI can offer insights into how memories play a crucial role in learning, reliving past experiences, and crafting new scenarios for both imagination and planning, as per a study published in Nature Human Behaviour (1^✔ ✔Trusted Source
A generative model of memory construction and consolidation

Go to source). The study uses an AI computational model -- known as a generative neural network -- to simulate how neural networks in the brain learn from and remember a series of events (each one represented by a simple scene). The model featured networks representing the hippocampus and neocortex, to investigate how they interact. Both parts of the brain are known to work together during memory, imagination, and planning.

"Recent advances in the generative networks used in AI show how information can be extracted from experience so that we can both recollect a specific experience and also flexibly imagine what new experiences might be like," said lead author Eleanor Spens, a doctoral student at University College London’s (UCL) Institute of Cognitive Neuroscience.

"We think of remembering as imagining the past based on concepts, combining some stored details with our expectations about what might have happened,” Spens said.

Humans need to make predictions to survive (e.g. to avoid danger or to find food), and the AI networks suggest how, and when we replay memories while resting, it helps our brains pick up on patterns from past experiences that can be used to make these predictions.

Generative AI’s Insight into the Mysteries of Memory

Researchers played 10,000 images of simple scenes to the model. The hippocampal network rapidly encoded each scene as it was experienced.

It then replayed the scenes over and over again to train the generative neural network in the neocortex.

The neocortical network learned to pass the activity of the thousands of input neurons (neurons that receive visual information) representing each scene through smaller intermediate layers of neurons (the smallest containing only 20 neurons), to recreate the scenes as patterns of activity in its thousands of output neurons (neurons that predict the visual information).

Advertisement

This caused the neocortical network to learn highly efficient "conceptual" representations of the scenes that capture their meaning (e.g. the arrangements of walls and objects) - allowing both the recreation of old scenes and the generation of completely new ones.

Consequently, the hippocampus was able to encode the meaning of new scenes presented to it, rather than having to encode every single detail, enabling it to focus resources on encoding unique features that the neocortex couldn’t reproduce – such as new types of objects.

Advertisement

The model explains how the neocortex slowly acquires conceptual knowledge and how, together with the hippocampus, this allows us to “re-experience” events by reconstructing them in our minds.

The model also explains /b> how new events can be generated during imagination and planning for the future, and why existing memories often contain “gist-like” distortions - in which unique features are generalized and remembered as more like the features in previous events.

Reference:

1. A generative model of memory construction and consolidation - (https://www.nature.com/articles/s41562-023-01799-z)

Source-IANS