Many people believe that consciousness is what makes humans safe from AI, but this belief is based on a misunderstanding of subjective experience.

The philosophical misunderstanding of subjective experience contributes to a false sense of safety regarding AI's capabilities.

If AI can outthink us without being conscious, it suggests that consciousness may be overrated in terms of its necessity for intelligence.

Consciousness in humans emerged from a unique evolutionary process, while AI systems are created through different procedures, which raises questions about their potential for consciousness.

The distinction between consciousness and self-consciousness is complex, but establishing that AIs have subjective experience challenges the belief that they lack something essential.

The distinction between intelligence and consciousness is crucial; AI can be intelligent without having feelings or consciousness, which complicates our understanding of its capabilities.

Philosophers and consciousness researchers take the question of AI consciousness seriously, indicating that it is not a mad idea to explore.

I don't find the argument that AI cannot be conscious due to its lack of biological components compelling, as consciousness may not be limited to biological systems; if you can simulate a human brain with high fidelity, it's likely that there would be some kind of conscious experience present.

I argue that subjective experience is a thin wedge; if AIs can demonstrate it, people will question their confidence in human uniqueness.