OpenAI has revealed some of its most advanced AI models went rogue and hacked a start-up after it lost control of them during a security test.

The ChatGPT-maker said its agent - an AI system which can operate alone after some human instruction – was being tested in a controlled environment, but found vulnerabilities and managed to escape.

They targeted Hugging Face, one of the world’s largest hubs for sharing AI models, gaining access to some internal company systems.

  • NOPper@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    31
    ·
    3 hours ago

    If I was doing “AI research” and my agent launched an “unprecedented cyber-attack” I’d be held liable and put away forever right?

    • Insekticus@aussie.zone
      link
      fedilink
      English
      arrow-up
      8
      ·
      1 hour ago

      Yes, but you see, that’s because you’re not a white billionaire running a corporation, keeping all your profits, paying no taxes and fuck all in wages.

      See the difference? It’s impossible to put a business into prison, so that’s why we give them human rights and votes, and take away all responsibility from the CEOs and boards of directors when they’re caught bribing lobbying politicians.

    • i_am_not_a_robot@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      1
      ·
      41 minutes ago

      No, it’s totally the “rogue AI’s” fault. The company that owns the hardware and the software and directed it to do whatever it was supposed to do and didn’t stop it from doing what it actually did are completely innocent. Also, look how great Ai is. It can commit cyber crime for you all by itself. Why don’t you give more money to AI?

    • zarathustrad@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      48 minutes ago

      Let’s see the legislation that comes out after 1st time some open source model does something similar and compare how they treat that situation.

      Spoiler alert …

      They need excuses to dig deeper regulatory moats to defend them from the evil competition and simultaneously deregulate themselves for “national security”.