Scientists can now reconstruct movie clips from brain activity
Researchers have managed to reconstruct actual movie clips just by reading brain activity from mice.
Using advanced imaging, they tracked about 8,000 neurons per mouse and used a special model that factored in not just what the mice saw, but also things like their running speed and pupil size.
How the researchers figured out what the mice were watching
To figure out what the mice were watching, scientists started with blank videos and tweaked them until they matched the brain patterns recorded.
Combining results from multiple model instances (ensembling) made the reconstructions even better, though it required more computing power.
This method let researchers see what was going on in a mouse's mind: something you obviously can't just ask them about.
The technique could help us understand how humans experience the world
This approach more than doubled accuracy (2.4x increase in pixel-level correlation, from 0.24 to 0.57) compared with previous single-trial static-image reconstructions.
It's a big step for neuroscience, showing how animal brains process real-life scenes.
In the future, these techniques could help us understand how mammals—including humans—actually experience the world around them.