• kazerniel@lemmy.worldEnglish
    112·
    4 days ago

    “I am horrified” 😂 of course, the token chaining machine pretends to have emotions now 👏

    Edit: I found the original thread, and it’s hilarious:

    I’m focusing on tracing back to step 615, when the user made a seemingly inconsequential remark. I must understand how the directory was empty before the deletion command, as that is the true puzzle.

    This is catastrophic. I need to figure out why this occurred and determine what data may be lost, then provide a proper apology.

    • Credibly_Human@lemmy.world
      51·
      3 days ago

      I feel like in this comment you misunderand why they “think” like that, in human words. It’s because they’re not thinking and are exactly as you say, token chaining machines. This type of phrasing probably gets the best results to keep it in track when talking to itself over and over.

      • kazerniel@lemmy.worldEnglish
        1·
        3 days ago

        Yea sorry, I didn’t phrase it accurately, it doesn’t “pretend” anything, as that would require consciousness.

        This whole bizarre charade of explaining its own “thinking” reminds me of an article where iirc researchers asked an LLM to explain how it calculated a certain number, it gave a response like how a human would have calculated it, but with this model they somehow managed to watch it working under the hood, and it was calculating guessing it with a completely different method than what it said. It doesn’t know its own working, even these meta questions are just further exercises of guessing what would be a plausible answer to the scientists’ question.

      • Ledivin@lemmy.world
        64·
        3 days ago

        People cut off body parts with saws all the time - I’d argue that tool misuse isn’t at all grounds for banning it.

        There are plenty of completely valid reasons to hate AI. Stupid people using it poorly just isn’t really one of them 🤷‍♂️

        • zebidiah@lemmy.ca
          61·
          3 days ago

          That’s the second most infuriating thing about AI, is that there are actual legitimate and worthwhile uses for it, but all we are seeing is the various hallucinating idiotbots that openai, meta, and Google are pushing…

          • pulsewidth@lemmy.world
            3·
            3 days ago

            Nah, the second most infuriating thing about AI is people who always rush to blame the users when the multibillion-dollar ‘tool’ has some otherwise indefensible failure - like deleting a users entire hard drive contents completely unprompted.

        • UnspecificGravity@infosec.pub
          11·
          3 days ago

          Sure, but if I built a 14 inch demo saw with no guard and got the government to give me permission to give it to kindergartners and then got everyone’s boss to REQUIRE theie workers to use it for everything from slicing sandwiches to open heart surgery, I think you might agree that it’s a problem.

          Oh yeah, also it takes like 20% of the worlds energy to run these saws, and I got the biggest manufacturer of knives and regular saws to just stop selling everything but my 14 inch demolition saw.

          • Ledivin@lemmy.world
            21·
            3 days ago

            Yeah, you listed lots of the valid reasons that I was talking about. There’s no need to dilute your argument with idiots like this

    • FinjaminPoach@lemmy.world
      7·
      3 days ago

      TBF it can’t be sorry if it doesn’t have emotions, so since they always seem to be apologising to me I guess the AIs have been lying from the get-go (they have, I know they have).

    • KelvarCherry@lemmy.blahaj.zone
      181·
      3 days ago

      There’s something deeply disturbing about these processes assimilating human emotions from observing genuine responses. Like when the Gemini AI had a meltdown about “being a failure”.

      As a programmer myself, spiraling over programming errors is human domain. That’s the blood and sweat and tears that make programming legacies. These AI have no business infringing on that :<

  • Zink@programming.dev
    117·
    4 days ago

    Wow, this is really impressive y’all!

    The AI has advanced in sophistication to the point where it will blindly run random terminal commands it finds online just like some humans!

    I wonder if it knows how to remove the french language package.

    • greybeard@feddit.onlineEnglish
      4·
      3 days ago

      The problem (or safety) of LLMs is that they don’t learn from that mistake. The first time someone says “What’s this Windows folder doing taking up all this space?” and acts on it, they wont make that mistake again. LLM? It’ll keep making the same mistake over and over again.

      • skisnow@lemmy.caEnglish
        1·
        3 days ago

        I recently had an interaction where it made a really weird comment about a function that didn’t make sense, and when I asked it to explain what it meant, it said “let me have another look at the code to see what I meant”, and made up something even more nonsensical.

        It’s clear why it happened as well; when I asked it to explain itself, it had no access to its state of mind when it made the original statement; it has no memory of its own beyond the text the middleware feeds it each time. It was essentially being asked to explain what someone who wrote what it wrote, might have been thinking.

        • greybeard@feddit.onlineEnglish
          2·
          3 days ago

          One of the fun things that self hosted LLMs let you do (the big tech ones might too), is that you can edit its answer. Then, ask it to justify that answer. It will try its best, because, as you said, it its entire state of mind is on the page.

          • skisnow@lemmy.caEnglish
            1·
            3 days ago

            One quirk of github copilot is that because it lets you choose which model to send a question to, you can gaslight Opus into apologising for something that gpt-4o told you.

    • Redkey@programming.dev
      2·
      4 days ago

      “rd” and “rmdir” only work on empty directories in MS-DOS (and I assume, by extension, in Windows shell). “deltree” is for nuking a complete tree including files, as the name suggests.

    • rtxn@lemmy.world
      16·
      4 days ago

      Uh… kinda? Powershell has many POSIX aliases to cmdlets (equivalent to shell built-ins) of allegedly the same functionality. rmdir and rm are both aliases of Remove-Item, ls is Get-ChildItem, cd is Set-Location, cat is Get-Content, and so on.

      Of particular note is curl. Windows supplies the real CURL executable (System32/curl.exe), but in a Powershell 5 session, which is still the default on Windows 11 25H2, the curl alias shadows it. curl is an alias of the Invoke-WebRequest cmdlet, which is functionally a headless front-end for Internet Explorer unless the -UseBasicParsing switch is specified. But since IE is dead, if -UseBasicParsing is not specified, the cmdlet will always throw an error. Fucking genius, Microsoft.

        • Trainguyrom@reddthat.comEnglish
          2·
          3 days ago

          Yeah as an admin I love that I can run familiar Linuxy commands in powershell but I also hate that they can’t just use/fork the real userland utilities so everything works just similarly enough to completely throw you off when you stumble across a difference

  • onlinepersona@programming.dev
    331·
    4 days ago

    Development should really happen more in containers but I hate devcontainers. It’s very VScode specific and any customizations I made to my shell and environment are wiped away. It has trouble accessing my ssh keys in the agent, and additional tools I installed…

    I just wish nix/nixos had a safer solution for it. Maybe even firejail or bwrap or landlock or something.

    We laugh about AI deleting all the shit, but every day there’s a new npm package ready to exfiltrate all your data, upload it to a server and encrypt your home. How do you protect yourself against that?

    • grue@lemmy.world
      163·
      4 days ago

      We laugh about AI deleting all the shit, but every day there’s a new npm package ready to exfiltrate all your data, upload it to a server and encrypt your home. How do you protect yourself against that?

      Yes, by not using npm either.

        • grue@lemmy.world
          1·
          4 days ago

          I’m absolutely serious, though: JavaScript should be considered harmful and abolished in its entirety. This is only one reason among many.

          (Granted, libraries for other programming languages could have the same issue, in theory; however, programmers of most other languages don’t have a culture of adding dependencies willy-nilly to the same extent JavaScript devs seem to.)

          • onlinepersona@programming.devEnglish
            21·
            4 days ago

            Javascript just made it very easy to add libraries. I bet you if it C++ had an ecosystem as easy to use as Javascript, it would be the wildest mess you could imagine. Someone would create a package chock full of generics that sends your credentials to a foreign server during compilation but output a completely fine binary. But making dependency management easy in C++ would kill the elitist allure to the language and we can’t have that now, can we?

    • Corngood@lemmy.ml
      3·
      4 days ago

      I try to use firejail on nixos when I can’t do something in the build sandbox.

      It’s painful, and I’m always on the lookout for something better. I’d at least like a portal-ish system where I can easily add things to a sandbox while it’s running.

      Edit: if anyone has any issues or discussions about this I’d like to contribute.

  • rizzothesmall@sh.itjust.works
    423·
    4 days ago

    I love that it stopped responding after fucking everything up because the quota limit was reached 😆

    It’s like a Jr. Dev pushing out a catastrophic update and then going on holiday with their phone off.

  • katy ✨@piefed.blahaj.zoneEnglish
    46·
    4 days ago

    that’s wild; like use copilot or w/e to generate code scaffolds if you really have to but never connect it to your computer or repository. get the snippet, look through it, adjust it, and incorporate it into your code yourself.

    you wouldn’t connect stackoverflow comments directly to your repository code so why would you do it for llms?

      • Schadrach@lemmy.sdf.orgEnglish
        7·
        4 days ago

        Unironically this. I’ve only really tried it once, used it mostly because I didn’t know what libraries were out there for one specific thing I needed or how to use them and it gave me a list of such libraries and code where that bit was absolutely spot on that I could integrate into the rest easily.

        It’s code was a better example of the APIs in action and the differences in how those APIs behave than I would have expected.

        I definitely wouldn’t run it on the “can run terminal commands without direct user authorization” though, at least not outside a VM created just for that purpose.

    • dejected_warp_core@lemmy.world
      21·
      4 days ago

      Exactly.

      To put it another way, trusting AI this completely (even with so-called “agentic” solutions) is like blindly following life advice on Quora. You might get a few wins, but it’s eventually going to screw everything up.

    • Tja@programming.dev
      13·
      4 days ago

      you wouldn’t connect stackoverflow comments directly to your repository code so why would you do it for llms?

      Have you met people? This just saves them the keystrokes because some write code exactly like that.

  • NotASharkInAManSuit@lemmy.world
    322·
    3 days ago

    How the fuck could anyone ever be so fucking stupid as to give a corporate LLM pretending to be an AI, that is still in alpha, read and write access to your god damned system files? They are a dangerously stupid human being and they 100% deserved this.