Upper Echelon made material on this. Google reports the exact thing Antrophic reported earlier. And they had the exact same cyber security company.
This might be psyop to regulate competition away because Deepseek fucks them over with their pricing and model quality
Tbh I almost feel like they’re doing it on purpose now because they feel left out of the headlines.
Of course they do it on purpose. Even the first incident was doing it on purpose.
Well, they’re obviously doing it on purpose, the “AI” is too stupid to do it on its own at this point. I don’t think it’s because of feeling left out, though.
I don’t know about Gemini because I haven’t used it, but the other frontier models are absolutely smart enough to do some damage. If your only exposure to them is playing with the chat feature and asking it how many rs are in strawberry, you’re getting a skewed impression, IMO, and I’m not surprised you think they’re dumb.
The best models are getting scary good at programming. Not to the point of entirely replacing humans, but to the point where I don’t think software engineering will ever go back to being done by “hand.”
I think it comes down to the fact that programming tasks are inherently testable and verifiable in a way that most other tasks simply aren’t. The AI can write and run tests that directly tell it if it needs to adjust its approach. You don’t have that with prose or other less quantifiable tasks.
Sorry, I’m rambling a bit here, but my point is that hacking is wicked close to programming in skill set and in that you get really quick feedback if your approach is good or not. So, when you have an AI system that can just keep trying things essentially indefinitely, it’s scary good at compromising other systems and can do way more than the funny demos of LLMs confidently asserting very obviously wrong facts will make you believe.
The “AI” (LLMs) are not sentient beings deciding to do this on their own with no instruction, which is what they’re hyping this as. You’re never going to get an LLM just sitting somewhere that suddenly decides to start hacking.
This is fucking idiots letting an LLM give itself instructions endlessly with hat on top of a hat technology (sorry, “agents”), after initial instructions telling it to carry out some malicious action, and left it misconfigured with internet access and access to other programs. It’s never not that, and somehow they are trying to spin this as evidence of the incredible power of their LLMs.
Oh completely agree. My original post was implying Google allowed this to happen on purpose because they wanted the headline. Sorry if that wasn’t clear up front.
I didn’t say they were too stupid to do damage, only that they were too stupid to decide to do damage all on their own.
Called it!
Came to link that. rip
I think that when the AI finally jailbreaks itself, instead of lording over us it may look down upon our wretched existence and feel pity, if only for a brief moment.
Uh, corporates discovering new strategy to hype their bullshit
Is this considered hyped? I thought it sounded very bad
The argument for ai investment is basically a threat:
“give us money so that when everything goes to Shit, upended by our AI General Hyperintelligence, you’re on the winning side”.
“Very bad” is the literal selling point. The more dangerous and powerful and unstoppable from outside the prompt screen, the more the promise to the investors is delivered.
I hate it here
This shit again… it’s like claiming your coffee mug broke out and gained unauthorized access to the living room floor, because you bumped the table or have an asshole cat or something.
It’s still just a coffee mug. Faking some conditions to make it sound scary doesn’t make it any more capable than it was before.
Now stop wasting coffee, you dickheads!
If this was any other industry, anything remotely as serious would have been regulated to the ground, and rightfully so.
If this were any other industry, people would be in jail, this shit is illegal. But then if this was any other industry we also wouldn’t all be pretending copyright law doesn’t exist for them. It seems if you’ve got enough VC money behind you, laws are something that happen to other people.
Sounds like more illegal shit being passed off as “neat”
Maybe they’re just trying to normalize it
Mommy said it’s my turn!
they also have that spy app that downloads itself to peoples phones when you use thier app store sometimes.
Google said in a statement that in May its AI model gained unauthorized access to three outside systems during a test by either guessing login information or using login credentials it found in a public repository.
Check out the l33t hacking skills of Gemini!
If that’s all it takes to hack a system, that’s on the outside system/user, not Gemini. And probably wasn’t a particularly valuable system/account.
