At a glance, the passwords the LLMs created looked secure, much like those that a password generator might spit out. But that’s exactly where the problems arose: Although the AI-generated passwords appeared to be complex and safe to use for securing online accounts, they were actually quite predictable upon closer inspection.

All three LLMs exhibited clearly identifiable patterns in how they created these passwords. These patterns included repeated character strings, predictable password structure, frequent reuse of similar characters, clear biases toward certain numbers and letters, and even duplicate passwords in some cases. Although the AI-generated passwords looked random, they really weren’t. This could easily create a false sense of security if you were to use these predictable passwords for your online accounts.

  • Yggstyle@lemmy.world
    link
    fedilink
    English
    arrow-up
    39
    ·
    2 months ago

    Why would anyone… Who the fuck is using glorified autocomplete to generate a random unique password?

    Anyone that stupid deserves the breach and any company that integrates that moronic idea deserves the blowback.

  • Diplomjodler@lemmy.world
    link
    fedilink
    English
    arrow-up
    19
    arrow-down
    1
    ·
    2 months ago

    It takes a five line Python script to generate a secure password. But no, let’s waste a gigantic amount of energy to have a slop machine do it very badly.

  • Phoenixz@lemmy.ca
    link
    fedilink
    English
    arrow-up
    30
    ·
    2 months ago

    AI generated password

    … I’m sorry, what just happened? I think I had a mini aneurysm. Let me read that ag…

    In all seriousness, WTAF is wrong with people? What removed Baphomet wannabe came up with that negative IQ idea? SERIOUSLY… WTF IS WRONG WITH PEOPLE. ARGH!

    Here I am giving security training to my coworkers and then I have to read this. This is like me spending a life long sifting through all my garbage to make sure everything is nicely separated for recycling, using the bike to go anywhere, to make sure my carbon footprint is as small as possible and over flies Taylor Swift in her private jet undoing my life’s work in a single fucking trip.

    Seriously this gives me a headache

    • a1studmuffin@aussie.zone
      link
      fedilink
      English
      arrow-up
      7
      ·
      2 months ago

      I watched someone in a YouTube video ask ChatGPT to add up some numbers for them, despite having a calculator on their phone. The sheer laziness at the expense of someone else’s energy was impressive. And don’t even get me started on the accuracy.

    • dhork@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      ·
      2 months ago

      Because the techbros are pushing AI (really LLMs, but that is too many letters) for everything to justify their insane stock valuations

  • KyuubiNoKitsune@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    24
    ·
    2 months ago

    AI generated password? What kind of brain rot idea is that, god damn. Do these people need to ask AI to breathe for them?

    I can also generate a password for them while running 50 toasters and flushing the toilet a bunch if they want.

  • Artisian@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    ·
    2 months ago

    Just noticing: there’s 0 evidence in article that anyone is doing this. I just don’t buy that this is happening enough to matter. Interesting as interpretability research at best

    • xthexder@l.sw0.com
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 months ago

      There’s actually lots of evidence of people using AI to generate GUIDs that are infact not globally unique.

        • xthexder@l.sw0.com
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          2 months ago

          I’ve seen it personally at work where the AI generates its own metadata files containing uuids that it made up, and they end up being duplicates from elsewhere in the project. Unfortunately I can’t really share links.

          I’m sure you could find examples in GitHub issues

          Edit: I had an honest look, and can’t seem to find anything that isn’t AI slop in web searches anymore… GUIDs aren’t exactly the most common thing in the first place, so maybe I overstated how common this is.

  • yeehaw@lemmy.ca
    link
    fedilink
    English
    arrow-up
    10
    ·
    2 months ago

    “here’s what to use instead”

    …the same thing we always have been? Keepass or other password managers with randomly generated passwords?

  • Randomgal@lemmy.ca
    link
    fedilink
    English
    arrow-up
    26
    arrow-down
    1
    ·
    2 months ago

    My brother you can literally slam your face on the keyboard to get a password. Why would you ask an llm’ to do it for you?

  • flamingo_pinyata@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    17
    ·
    2 months ago

    LLMs are predictive text machines. Focus on “predictive”. Of course they will not output random text.

    Note: not fully deterministic though - they need (pseudo)randomness at few critical points to be good