Artificial-intelligence systems such as large language models (LLMs) can exhibit behaviour that seems strikingly intelligent. This has led many people, including some experts, to wonder whether these systems could have some form of consciousness — the capacity for subjective experience. However, we think that existing AI systems are not conscious, and that, along current trajectories of development, they are not likely to become conscious. Greater clarity about whether AI could become consciousness will be crucial as society grapples with the challenges posed by this increasingly powerful technology.
I don’t think consciousness necessarily has to be biological, but LLMs certainly aren’t. If a model says “Fuck Doom, I wanna play cyberpunk!” I’d be more inclined to believe it has some consciousness and agency.
I dunno tho, I read blindsight not so long ago and it got me thinking about the possibility of intelligence without consciousness.