maegul (he/they)

More “Software brain” BS. Sure, many/most people are unthinkingly consumeristic. But it’s been a weird few decades for the tech industry where a lot of its ideas have been taken up as “the inevitable future”. There’s no guarantee that that relationship between the population and the industry holds, and the industry sure is full of people that have only lived in that bubble in time.

Cue the pirates of the Caribbean scene/ where captain Barbosa tells you you’re “in one”

You best start believing dystopian sci-fi stories, you’re in one

My hot take is that mainstream software technology hasn’t worked out how to be useful enough to be good in education and is now currupyrd by get rich quick start up mentalities, when really it needs the kind of open ended research that created the PC in the 60s & 70s.

Generally speaking, in a Bret Victor kind of way, enhancing human thinking behaviours and practices just feels like a purpose that has been left behind, probably since web and big data took over.

What do you think has changed in a year?

My take would be that many average office workers are pretty accepting of being told what to do, and are being told to use AI, and that the technology is more or less sticking the landing, at least enough to get used.

Interestingly, I don’t think I share this sentiment.

I’m no fan and personally don’t use AI (I barely touched it early ChatGPT days). But people use it to do things in successful fulfilment of their initial purpose.

I’ve seen it. Maybe I’ve seen the successes and not the failures in some cases. And I’ve certainly seen badly failed attempts to use it, but in those cases I’m happy to ascribe the failure substantially to a misapplication of the tool (which to be fair certainly invites gross misapplication).

My point though is that I don’t think an absolutist “AI is never useful” position is persuasive any more nor absolutely accurate.

Which, in my view, makes addressing the “rest of the situation” all the more fundamental. Indeed, I think everything g other than its efficacy was always the important part.

Part of the problem is that ethical arguments are difficult for people and many just switch off when it comes to the common good. Which is all of course part of the problem too.

But I think that’s gravity of the situation right now: our collective instincts may be misaligned for the moment. Our personal habits vulnerable from our prior corruptions. And our societal architectures already mutated, perhaps beyond repair, and therefore ill equipped for this.

Doomy, yes, but you’ve got to fight the fight you’re in, not the one you’d wish you’d won.

Another way I could put this counter, is that I feel like so much of what’s bad about AI was bad before AI, and that society from 2005-2020 badly mishandled technology. Whether AI “works” or not doesn’t matter. So long as it can fit into the same shape and meet the same urges that tech did 2005-2020, it will be adopted. But if the consequences of its adoption are graver than what came before, then the whole stack of that history needs to be addressed.

And with how this particular AI technology only works by consuming all of the internet’s and our libraries’ data … it’s not just a transfer, it’s pretty much theft.

And it also becomes recursive I think.

People want to be good parents. But in late stage capitalism, that means setting your children up to succeed in that environment. If people struggle to set themselves up as parents, they can’t have faith that they’ll be able to set their children up such that there’s just no point. Especially if you start thinking about the future and whether your grandkids could even be ok.

Yea … it’s the bit I don’t get why people don’t care about this more.

If we’re replaced, there’s nothing really left for us in the terms of the way we’ve conceived our whole world for centuries. Sure maybe we go native again or something, but let’s be real, that is a massively tough transition even if it’s viable.

I think they mean in parallel, as in the government steps in and regulates with guarantees etc, not that these reforms would come from the AI itself.