I’m not an AI techie and I’m not well educated on LLMs/AI in general. The issue I’m having is the dichotomy between how people talk about it. I’ve heard completely opposite ends of the spectrum. From AI is quickly becoming advanced enough to threaten human society, all the way to its a glorified dictionary/search engine that can’t really do much of anything. I know Lemmy has a steep anti-AI slant. But, can someone talk about this in a way I can wrap my head around why the divide seems so big?
‘Sensationalist hooey, cooked by superstitious yokels seeing phantoms of their own imagining.’
There’s blood on their hands. Either they keep the hype up or go to jail regardless of any of their statements being true or not.
Here’s an idea: don’t use unsafe software where safety is needed.
Many are skeptical that there is a push by ai companies to make them appear more than they are due to their weak economic footing. From my experience with the llms I am not frightened they will become self aware. I am frightened that we are wasting energy and resources while polluting the planet further for little return and it will result in messing up our economies even more.
Whatever. Ban all these people from employment and public assistance. Make them starve
Good job in helping with their guerilla marketing campaign.
When a corporation realises that working for government will be more profitable than working for consumers, they pivot to scaremongering, but always with the undercurrent of “and that’s why you should PAY US so that you own the nukes, and not your enemies”
I don’t have the confidence in my knowledge/understanding of the topic to just take a “its all bullshit” view. Especially when many of the people who believe that act like you. You don’t have to be a prick to explain something or talk about it.
yhea sure. shake teh keys for the idiot.
Am I the idiot for not being an expert and not just automatically assuming a side is objectively correct. I’m an expert in a couple things, truly, not in this. I’ve seen some compelling comments from a few perspectives in this thread alone. Why be a dickhead?
lemmy try not to be a dickhead challenge: impossible
Personally, this just feels like marketing and these big asshole companies trying to resurrect the 2025 level of hype in order to salvage their IPO’s.
If they honestly believed this I can’t imagine that their workers wouldn’t do something more drastic.
In addition to what everyone else said, I’ll tell you why I don’t think that what we have currently can become some runaway superhuman intelligence:
All “AI” people are talking about are basically “just” LLM wrappers: tools built to run a LLM in a loop while giving it access to the ability to write and run code. This gets pretty powerful, since you can do a lot programmatically (including monetary transactions), but has a fundamental limit:
LLMs are trained ahead of time. And that’s a very cost intensive, long process. Beyond that, the LLM has only a context window of finite length. So there are no long-term planning capabilities. While running after being trained, the LLM can only condense knowledge into a summary and then re-read it, a lossy process that might introduce mistakes in “understanding” and will make any prolonged task degrade over time.
And even if they figure out how to make the things actually self-modify and learn things, you can’t give every session that ability, since that’ll vastly increase the storage and performance requirements. Do sessions with that ability will be closely monitored and limited.
So I don’t see any space where an evil AI could emerge, even when factoring in an essential possible future improvement to the technology.
I’m not worried about AGI. I’m worried about the insane military applications they’re developing right now, and giving Artificial Incompetence control.
I watched a grokbot get confused connect to the wrong vnc console and try to shut down its own little computer.
I’m not worried about AI taking over the planet. I’m worried about it clicking the wrong button with no oversight
Same, I am worried about humans using ANNs to kill people. Current society is a gigantic apparatus that is constantly shifting shuffling responsibility around. LMMs only accelerate the problem.
Humanity should be way more frightened of greedy psychopaths running the world than any technology.
And they’re peddling “AI” so aren’t they married in this case?
A lot of us here hate streaming platforms because they’re designed to benefit greedy capitalists first and foremost. That doesn’t mean the core idea or the technology behind streaming platforms is bad, though. An open source project like Jellyfin that is designed purely to benefit the end user is something that legitimately enriches all of our lives.
Similarly, just because scumbag companies like Anthropic and OpenAI are plundering the world for their own deranged benefit doesn’t make the underlying idea or technology bad. The tech is built on contributions from a lot of brilliant people over a long period of time whose names are not Sam Altman or Dario Amodei. Open LLMs that run on gaming rigs are quickly catching up with cloud-based models as well.
At this point, I’m running Qwen 3.8 27B on a gaming GPU that has similar capabilities to Claude Sonnet 5 without giving Sam or Dario my data or $200 a month, just like I run Jellyfin without giving Netflix or Disney my money or data.
The people claiming it’s humanity ending are all directly involved in the AI companies. One take is that they are the ones that know the most about it.
My take is they are financially incentivized in making sure their investments grow in value.
I figured out recently that Thor Ragnarok is a perfect analogy for what is happening, and this is also why I think everyone’s pdoom should be very little, because they just evolve into new asgard
A third take is that they are unhinged cult members who are high on their own supply. Although I expect it’s a mix of both types (maybe within the same people).
Cory Doctorow also thinks that it is a coalition of true believers high on their own supply, and cynical grifters collaborating with them. https://pluralistic.net/2026/09/17/porque-no-los-dos/#fascist-incoherence
I’m more worried about the people using AI than the tech itself.
Every issue has been because corporations have “get out of jail free cards” these days, greed is sky high, and AI psychosis is rampant.
All those supposed AI agent hacks happened because someone set that as a task for the AI agents. Yes, someone thought it was ok to do so for marketing and profit. That’s the problem, companies are willing to use the AI tool to commit crimes.
Imagine if weapons companies advertised their products by shooting people in the streets. Someone thought it was a good idea, and can get away with it.
I don’t believe at all that AI agents have free will enough to decide to hack companies for fun. They’re just glorified text generation machines hooked up to an interface. They don’t have intentionality unless some human gave them the directive and wrote them a large cheque.
Also, we know all these AI company billionaires read dystopian scifi novels like business strategy textbooks. That’s why everything surrounding AI is so overtly scifi coded.
it’s the former juuuuuuuust until the latter
once it escapes the lab there’s no putting it back in the bottle
Unlike a bio-virus that has evolved for a billion years across all the niches of our ecosystems, when AI “escapes the lab” it’s entirely confined to man-made infrastructure, it’s not going to infect a flock of migrating birds and hop to the other hemisphere, it’s going to be in systems we built, mostly within the past 30 years or less, mostly in the past 30 months for the powerful ones.
When AI starts demonstrating “copying itself” through DNA encoding infecting living beings without killing them (too quickly), and/or “running” on something more ubiquitous than massive data-center hardware, that’s when it’s over.
It may be confined to man-made infrastructure, but that same infrastructure is what keep billions of people from starving to death. At this point, computers and networked systems are so baked in to every facet of our logistics chains and government that simply shutting it all down isn’t an option. The nightmare scenario is where rogue AI escapes the lab and copies itself to so many systems that the only way to kill it is to shut down every computer on Earth.
That’s the thing, at least right now, AI is dependent on new data centers, excess capacity built just for it - it’s not going to “escape” to the banking system and the tractor navigation chips, if it could do that they wouldn’t need to be building all this capacity for it.
hopefully you’re right
It is to distract us of real dangers we already see today: https://youtu.be/pauBYSQ1K_c
I knew a guy in high school that told girls they shouldn’t date him because his dick was so big it would hurt them. You can wax philosophical on his motives if you’d like, but spoiler alert - his dick wasn’t big.
That’s exactly what I think is happening. Remember a few months ago anthropic saying mythos is too dangerous to release until the government as the idiots they are starting believing them and banned them from exporting it, therefore losing them money. Very quickly they came up with fable (ironic name isn’t it) a week or two later saying it’s got the proper safeguards now. Now they’re all trying this marketing strategy asking the gov to regulate them, seemingly because they’re dangerous and not because they’re getting diminishing returns and feel threatened by the chinese competition
Your username with that conclusion paints a very funny picture.
Same thought. Pretty clear indication of how they knew it was a lie. :D
Did it work?
I mean there are people eating up this Anthropic crap.
I’m going to take a guess that it prob worked once, then word got around he was exaggerating.
Once is a win…
That is… Certainly a strategy of all time
The biggest risk I see is Idiocracy. Like, the movie.
Business workers become afraid to do or propose anything without AI signoff. Retail & service workers are told to do what the AI says, the way the AI says to do it, or get fired.
Technology innovator Marshall Brain (RIP) wrote a book in the early 2000s about an AI called “Manna” designed to replace fast food managers:
https://web.archive.org/web/20201204080050/https://marshallbrain.com/manna1
The AI just talks in your ear all day: “Empty one bag of fries into the fryer. You have 6.5 minutes, switch to the sandwich station. Make one Big Burger: grab one patty from the 1/4 pound bin and place it on the griddle… … The fries are ready, turn around and lift them into the drain hopper…”
All day, every day, exactly 8 hours plus mandatory breaks, employees on autopilot listening on ear buds.
All day, every day, exactly 8 hours plus mandatory breaks, employees on autopilot listening on ear buds.
Living under a bridge in a box sounds like a better life.
Yeah, they took care of that too in the book.
Living under a bridge in a box sounds like a better life.
It’s the Gypsy lifestyle of the new world. Gypsies prefer their life to the alternatives.
I believe you mean Romani. Your choice of word is a slur
Apologies. In Westpondia nobody knows what Romani means…
This is a boss’s wet dream. However a kitchen is the type of chaotic real world situation that AIs are unlikely to ever do well.
It was more of managing all tasks at a McDonald’s. Where the kitchen part has been engineered to almost run itself anyway.
The manna was there to make sure the employees were constantly cleaning the bathrooms, managing restocking, emptying the trash as needed. All ahead of it being a problem.
It’s a good read, though it’s been a very long time since I read it. I wish I could buy my son stock in Australia (or probably Norway or Switzerland or something in reality).
