Tools

Search

Explore

Videos Channels Figures

Atmrix

About

Tools

Search

Explore

Videos Channels Figures

Atmrix

About

EB

Elan Barenholtz

06/12/25

@ Curt Jaimungal

Language is an autoregressive model, and this autoregressive nature is fundamental to how we generate and understand language.

Video

CJ

The Theory That Shatters Language Itself

@ Curt Jaimungal

The Theory That Shatters Language Itself

06/12/25

Related Takeaways

EB

Elan Barenholtz

06/12/25

@ Curt Jaimungal

The autoregressive process in language generation means that the brain is not just producing outputs but also generating the next input for itself.

PE

Professor Elan Barenholtz

06/12/25

@ Curt Jaimungal

Language is a self-contained, autoregressive system that doesn't inherently connect to the external world, challenging our understanding of mind and perception.

EB

Elan Barenholtz

06/12/25

@ Curt Jaimungal

Language is a semi-autonomous, auto-generative system that doesn't fully grasp the meaning of what it communicates, unlike the sensory perceptual system.

EB

Elan Barenholtz

06/12/25

@ Curt Jaimungal

I propose that cognition itself is autoregressive, similar to language, and that our brains have the machinery to support this process.

PE

Professor Elan Barenholtz

06/12/25

@ Curt Jaimungal

Large language models, like ChatGPT, demonstrate that language can self-generate based on its internal structure, indicating that the principles governing human language generation may be the same as those in these models.

PE

Professor Elan Barenholtz

06/12/25

@ Curt Jaimungal

The grounded thesis of language posits that human language is reflected in the operations of large language models, suggesting that the mechanisms for generating language in humans and machines are fundamentally similar.

PE

Professor Elan Barenholtz

06/12/25

@ Curt Jaimungal

The realization that language operates as an autonomous system reveals that it can generate meaningful sequences without needing to reference external concepts or grounding.

FL

Fei-Fei Li

09/21/24

@ a16z

The fundamental difference between language models and spatial intelligence is that language is a generated signal, while the 3D world follows physical laws and has its own structures.

PE

Professor Elan Barenholtz

06/12/25

@ Curt Jaimungal

The ability of language to generate meaning is not driven by a need for grounding; instead, it relies on the relational properties of symbols within its own structure.