Artificial-intelligence systems such as large language models (LLMs) can exhibit behaviour that seems strikingly intelligent. This has led many people, including some experts, to wonder whether these systems could have some form of consciousness — the capacity for subjective experience. However, we think that existing AI systems are not conscious, and that, along current trajectories of development, they are not likely to become conscious. Greater clarity about whether AI could become consciousness will be crucial as society grapples with the challenges posed by this increasingly powerful technology.


You think therefore you are. You don’t know if the rest of the humans aren’t powered by an LLM.
It would be impossible to distinguish a brain dead person whose brain was replaced with an sufficiently advanced LLM.