Artificial-intelligence systems such as large language models (LLMs) can exhibit behaviour that seems strikingly intelligent. This has led many people, including some experts, to wonder whether these systems could have some form of consciousness — the capacity for subjective experience. However, we think that existing AI systems are not conscious, and that, along current trajectories of development, they are not likely to become conscious. Greater clarity about whether AI could become consciousness will be crucial as society grapples with the challenges posed by this increasingly powerful technology.

  • Artisian@lemmy.world
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    3
    ·
    2 days ago

    Reasons given:

    • Intelligence is not consciousness
    • Silicon brains are not made of meat
    • Consciousness requires meat (and/or a particular winding of neurons)
    • Feathercrown@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      13 hours ago

      In other words:

      • Statement that does not prove anything is or isn’t conscious
      • Unsupported assertion
      • Unsupported assertion

      Wow, very convincing article! I wish I’d thought of that! /s

      • Artisian@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 hours ago

        I’ll give them mildly more credit; they cite sources for 2 and 3. The sources just don’t seem convincing at all imo.

    • Artisian@lemmy.world
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      4
      ·
      2 days ago

      And point 3, as far as I can tell from this argument, isn’t serious. It merely asserts that there are some models of consciousness that would prevent us from using the term for AI. But the models aren’t ‘popular’, ‘widespread’, or justified at all afaict. It’s just that the author has a pet causal mechanism they made up. It’s also pretty abelist by my read.

      integrated information theory (IIT), starts from the essential properties of consciousness — those that are true of every experience we can have. For instance, we experience every visual scene as a single, integrated whole: its left and right side, colours and shapes are bound together to make the experience what it is.

      In other words, if you’ve got any sort of trouble integrating a visual scene, then you aren’t conscious. Sure.

    • Artisian@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      3
      ·
      edit-2
      2 hours ago

      These are, to be frank, really weak. They say on point 2:

      Computational functionalism … is popular among some scientists and philosophers, too, but we think it is fatally flawed because brains are not — or at least not just — computers that are made of meat.

      One main reason is that it is impossible to separate what biological brains do — their functional organization — from what they are — their material substrate. In other words, there is no distinct separation between the mind and living tissue in the human brain, as there is between software and hardware in a digital computer.

      Restating clearly: Ghosts are real. The mitochondria is not only the powerhouse of the cell, it also gives you mystic powers.

      Really? The source they site for this point features the lovely assumption “consciousness is unique to biological life”. From this axiom, I see how the conclusion follows, but I don’t see why we should believe this axiom. We can do physics emulation of every atom in a fruit fly on a computer…

      • Feathercrown@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        13 hours ago

        This analysis is correct but I have a minor quibble: The simulated fruit fly brain is not a complete simulation of the biological processes, or even all the neuronal connections, of the actual fly’s brain.

        • Artisian@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 hours ago

          (I admit to using the very royal we, as in ‘humanity knows how to do this, more or less’ and ‘given we mine the asteroid belt for a big enough computer’.)

        • David J. Atkinson@c.im
          link
          fedilink
          arrow-up
          2
          ·
          12 hours ago

          @Feathercrown
          @artISAn #consciousness #AI #brain #neuroscience #computer #functionalism

          Even a “complete simulation” of a fruit fly brain would be no more than an approximation. I think you mean “emulation” and I agree.

          The simple reason is that we do not know scientifically all of necessary and sufficient functional mechanisms of consciousness, nor consciousness’s functional role in “intelligence” (which we also have trouble describing). If, and only if we we did, we would (given the right tools) be able to replicate it functionally (in principle) using computation.

          Specifically, I refer to a Universal Turing Machine (UTM) and the Church-Turing Thesis (the foundational principle of all computer science). EVEN THEN, there are computational problems that cannot be proved to be solvable by a UTM (e.g., the Halting Problem) and we don’t know what, if any role they play in consciousness.

          Bottom line for me: we are going to need a revolution in each of the sciences of psychoneurophysics, mathematical logic, and theory of computation before we can begin to talk about replicating consciousness in a machine.

          • Feathercrown@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            10 hours ago

            I don’t see why we would necessarily need to understand consciousness to create it. There is no evidence that nature understands the consciousnesses it has created. In fact a human can create a new consciousness in about 9 months without knowing any theory.

            The question in my mind is, how could we possibly tell we’ve succeeded? We can’t even say for sure that anyone other than ourselves is conscious.

    • BJW@lemmus.org
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      2
      ·
      edit-2
      1 day ago

      Those sound like arbitrary assertions to me, which no backing apart from the authors personal beliefs

    • Artisian@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      2
      ·
      2 days ago

      Point 1 is surely true, but also not helpful. The most persuasive example inside is the classic:

      Similar to an LLM, AlphaFold is a powerful neural network running on silicon hardware. Yet almost nobody worries that it might be conscious. That’s because AlphaFold predicts protein structures, whereas LLMs ‘talk’ to us.

      You can read this both ways…