Tools

Explore

Videos Channels Figures

Atmrix

Tools

Explore

Videos Channels Figures

Atmrix

EB

Elan Barenholtz

06/12/25

@ Curt Jaimungal

The tip of the tongue phenomenon occurs because our brain is running an autogenerative process, making it feel like we can almost produce the word, but we can't complete the generation.

Video

The Theory That Shatters Language Itself

@ Curt Jaimungal

The Theory That Shatters Language Itself

06/12/25

Related Takeaways

Elan Barenholtz

06/12/25

@ Curt Jaimungal

The autoregressive process in language generation means that the brain is not just producing outputs but also generating the next input for itself.

Elan Barenholtz

06/12/25

@ Curt Jaimungal

I believe our brain doesn't actually retrieve information; instead, it fine-tunes and generates the next token autoregressively.

Elan Barenholtz

06/12/25

@ Curt Jaimungal

Language is a semi-autonomous, auto-generative system that doesn't fully grasp the meaning of what it communicates, unlike the sensory perceptual system.

Lex Fridman Cast

02/03/25

@ Lex Fridman

Chain of thought models can flip back and forth between languages, sometimes producing gibberish before arriving at the right answer, which can be both fascinating and concerning.

Bob McGrew

02/01/25

@ Y Combinator

The core idea behind GPT-1 was that using a transformer to predict the next word would provide enough signal to generate coherent text, a concept that seemed obvious in hindsight but was initially doubted.

Professor Elan Barenholtz

06/12/25

@ Curt Jaimungal

Large language models, like ChatGPT, demonstrate that language can self-generate based on its internal structure, indicating that the principles governing human language generation may be the same as those in these models.

Professor Elan Barenholtz

06/12/25

@ Curt Jaimungal

The realization that language operates as an autonomous system reveals that it can generate meaningful sequences without needing to reference external concepts or grounding.

Elan Barenholtz

06/12/25

@ Curt Jaimungal

Cognition doesn't work like a retrieval system; when we try to remember something, we're not searching a space but generating from our past experiences.

Elan Barenholtz

06/12/25

@ Curt Jaimungal

Language is an autoregressive model, and this autoregressive nature is fundamental to how we generate and understand language.