Do humans really learn from “little” data?

Link post

How much data does it take to pretrain a (human) brain? I conducted a (fairer) Fermi estimate.

The post goes through the following questions:

  • How long does it take to grow a human brain?

    • How many waking seconds do we have in our life?

    • How many “tokens” or “data points” does a human brain process in a second?

      • Can we simply count the spikes?

  • How many bits (spikes and non-spikes) does it take for the brain to process 1 sensory “piece of information”?

  • How do those numbers stack up against LLMs?

To get to this conclusion table: