Discussion about this post

User's avatar
David Perlmutter's avatar

Know what else certain people at that time thought was controlled by the Devil? Television animation! Having studied its history I know how absurd that proposition is. But that's the way Christians roll: anything they don't approve of is logically the Devil's work.

Expand full comment
Daniel Nest's avatar

"This can lead to unintentional cherry-picking whenever we’re trying to decide whether something is a good idea."

But you haven't addressed a key scenario here: What if the thing I'm trying to decide on is whether I should pick a particular cherry? In that case, wouldn't cherry-picking be the very thing I'd want? Would my attempt to cherry-pick the right set of assumptions about cherry-picking to decide which cherry to pick create a circular logic paradox that would paralyze me into inaction? The jury is out, but all signs point to: Yes!

As for the malleability of memory and the impossibility of storing all video/audio/etc input, I'd like to share a slightly edited comment I left on Suzi Travis's article about human memory a few days ago:

It struck me how much more similar our memory creation/retrieval process is to LLMs than to e.g. file storage software.

Creating new memories is a bit like pre-training an LLM - you're not loading every single piece of information into your brain and storing it in its entirety. Instead, you encode relationships between people, events, smells, etc., much like LLMs encode relationships between tokens.

And when you're retrieving a memory, you're not pulling it out of a file cabinet wholesale, but you're "generating" a plausible version of events based on the encoded connections, much like LLMs generate different but broadly similar responses to the same query.

The same goes for LLM hallucinations and our memory hallucinations, which explains why my wife and I have very different recollections of the events of the day of our first kiss. That, and she's objectively wrong....according to my memory, that is.

Expand full comment
16 more comments...

No posts