EDIT: TBC, here’s the current message seen when refreshing a PF stream:


“Piefed.social is having a denial of service attack. They are being kept at bay for now but could return with a more effective method. Download your community subscriptions so if you need to move to another server it’ll be painless - with a few clicks you’ll be seeing all the same content as before. See list of alternate servers at here or here.”


Possible causes?

  • Fellow instance that got PO’d somehow? (seems like a major stretch)
  • Just random hackers havin’ fun?
  • Reddit or similar, targeting one of the top growing instance softwares in ActivityPub / FV? EDIT2 : the timing certainly seems to fit for the recent influx of users coming from Reddit. (see comments)
  • Some right-wing entity, not happy about the general rational / left bias to the instance?
  • Other…?

In any case, much thanks to our instance runner and dev for fending off the first wave(!) Hope everything is backed up and possible to be restored if the worst happens.

(seriously, what a shitty way to be repaid for doing a great, ongoing job for the community and FOSS)

    • JohnnyEnzyme@piefed.socialOP
      link
      fedilink
      English
      arrow-up
      6
      ·
      2 days ago

      Top of the PF.S stream:


      Piefed.social is having a denial of service attack. They are being kept at bay for now but could return with a more effective method. Download your community subscriptions so if you need to move to another server it’ll be painless - with a few clicks you’ll be seeing all the same content as before. See list of alternate servers at here or here.


      Sounds a bit concerning to me.

    • Æ@piefed.social
      link
      fedilink
      English
      arrow-up
      5
      ·
      2 days ago

      very intermittent for me. I think swell of new users like me + corporate interference to a new competitor

      • JohnnyEnzyme@piefed.socialOP
        link
        fedilink
        English
        arrow-up
        9
        ·
        2 days ago

        DDOS is a very specific kind of attack, as I understand it, involving overwhelming a server with rubbish packets.

        • Æ@piefed.social
          link
          fedilink
          English
          arrow-up
          7
          arrow-down
          1
          ·
          2 days ago

          Its a type of attack. Use malware infected computers (botnet) to flood servers woth fake requests. Its a networking traffic jam, where each car has been mind controlled into blocking the route by a nefarious actor. Could be a company paying someone, could be a lone hacker, could be north korea, russia, a wayward child genius, some MIT students making a point. Who knows? Not me. But ddos doesnt just happen randomly, someone has to hit the button. So could be a ddos or just loads of new users creating the jam or ai scrapers. I dont know. I wouldnt be surprised if a few unscrupulous companies want to nip this decentralised threat to their business model in the bud. But then I wouldnt be surprised if a relatively small “site” is just suffering because its user base has doubled in 3 days.

  • fubarx@lemmy.world
    link
    fedilink
    arrow-up
    6
    arrow-down
    1
    ·
    2 days ago

    Is putting a Web Application Firewall (WAF) in front of it not an option? Cloudflare offers it for free for static sites: https://www.cloudflare.com/lp/dg/product/ddos/

    There are other hosting providers that offer it as a basic service. This way, the flooding packets are filtered before they even reach the server.

    KrebsOnSecurity has been hit a few times with massive DDOS attacks: https://krebsonsecurity.com/2025/05/krebsonsecurity-hit-with-near-record-6-3-tbps-ddos/

  • arrrse@piefed.social
    link
    fedilink
    suomi
    arrow-up
    3
    ·
    2 days ago

    Well that explains the

    503 Service Temporarily Unavailable

    Its leon, hes mad that he has only bots in twitter

  • wjs018@piefed.wjs018.xyz
    link
    fedilink
    English
    arrow-up
    45
    ·
    2 days ago

    Just an update on this front, server load is stable right now as I type this after rimu did some stuff on the server to help. It’s pretty clear this was a DDOS and not a rogue AI scraper because it was hitting the same url many times a second instead of crawling tons of urls like a scraper bot would.

    We’ll keep an eye on things. Thanks for your patience.

    • snowe@programming.dev
      link
      fedilink
      arrow-up
      8
      ·
      2 days ago

      AI bots will sometimes get stuck requesting the same URL over and over again for no reason. Make sure you check the user agent of the requests.

        • Skavau@piefed.social
          link
          fedilink
          English
          arrow-up
          12
          ·
          2 days ago

          In television@piefed.social

          I was discussing/debating with a user. Suddenly he thought i blocked him as he couldn’t reply (I assume) and he reported me to myself and started changing all of his comments to "skavau is a clown, despite me telling him I had not blocked him

          He was a local account so I yeeted him, shortly after Piefed goes down

    • wjs018@piefed.social
      link
      fedilink
      English
      arrow-up
      23
      ·
      2 days ago

      I realized that I replied from the wrong browser tab. I can confirm that this is not some impersonator wjs018 🕵️

      • wjs018@piefed.social
        link
        fedilink
        English
        arrow-up
        7
        ·
        2 days ago

        It’s a good question…for rimu. I have ssh access to do things like restart the server or roll out a critical bugfix or something like that, but my sysadmin skills are not the best.

        • Tuuktuuk@anarchist.nexus
          link
          fedilink
          English
          arrow-up
          3
          ·
          2 days ago

          All you need is to have the IP addresses. If you can extract them, then the rest can be done by saying whois ip.ad.re.ss (where you put some numbers between 0 and 255 instead of ip, ad, re and ss.)

          • hendrik@palaver.p3x.de
            link
            fedilink
            English
            arrow-up
            3
            ·
            edit-2
            2 days ago

            A whois will likely not do much. It’ll turn out to be some large ISP, which rents out virtual servers and all kind of stuff to private people, companies and VPN providers. And that’s regularly how far you’ll get, a name if a large company. And you can then decide if it’s worth to take someone to court, somewhere abroad… (But sometimes an email to their abuse contact helps a bit. Judging by my experience they won’t ever answer. But sometimes it’ll miraculously stop. And most of the time nobody cares about a single complaint.)

              • hendrik@palaver.p3x.de
                link
                fedilink
                English
                arrow-up
                1
                ·
                edit-2
                1 day ago

                Well, I guess if they’re still online and do silly stuff, like not use a VPN, not have a Firewall installed on their computer… Or they re-use the VPS which also has their personal blog on it… There would be ways to do something. But that’s all very unlikely.

                I mean the whois is a good idea. Admins will usually want to know what they’re dealing with, and where it’s coming from. But the rest of the steps really depend on how bored an admin is. The best course of action regularly is to block it and move on. There’s so much bad stuff hammering the average webserver anyway. Launching a counterattack is a bit illegal, so that might not be an option. And if some admin has a few hours to pass until it’s 5pm and time to head home, or do it as a hobby and have time to spare they might investigate. I’ve found some hacked servers that way, wrote a few emails. But in practice, 99% of the time there isn’t anything to accomplish.

  • onlinepersona@programming.dev
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 days ago

    Is it really a DDOS or piefied just unable to handle an influx of users? Does piefed scale horizontally? Is it async? Does it spawn a thread per request or does it work from a thread/process pool?

    Without having looked at the code, my suspicion would be rather that it can’t handle thousands of users concurrently and just 20k users trying to use it at the same time looks like DDOS. Piefed is probably nowhere near v1 or has never been tested for performance.

    I’d much rather see some evidence for a DDOS e.g a graph showing number of connections to the server, a graph of response time, number of database connections, of something. Just saying “DDOS” when it might just be the software struggling to keep up with legitimate users seems questionable.

    P.S this isn’t a slight at the piefed devs - performance is usually the last thing on someone’s mind who just wants to ship things quickly. Especially with such a demanding and uneducated public that doesn’t understand these are unpaid individuals contributing, not paid workers working on the code 9-5, 5 days a week, 50 weeks a year.

  • MinnesotaGoddam@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    edit-2
    2 days ago

    I’m unstable but i’m not that unstable. If I get pissed off I just write bad music you don’t gotta worry about me. Think of me like Taylor Swift with the 7 Assholes

    wait hold on i’m gonna use that as an album

    • mesa@piefed.social
      link
      fedilink
      English
      arrow-up
      6
      ·
      2 days ago

      It its all one url from many different ips that dont really go anywhere, then its probably just regular old DDOS. If your successful, at some point you get them.

      I hate to say it but cloudflare has “fixed” this issue a while back and is one of the better solutions. Which of course sucks because it becomes another layer on top of infa that has gone down in the past.

      All the fun of being a sys admin :)

    • JohnnyEnzyme@piefed.socialOP
      link
      fedilink
      English
      arrow-up
      3
      ·
      edit-2
      2 days ago

      Wouldn’t that tend to show up to the host as such, or as temporarily increased general activity?

      DDOS is a very specific kind of attack, as I understand it, involving overwhelming a server with rubbish packets.

      • artyom@piefed.social
        link
        fedilink
        English
        arrow-up
        6
        ·
        2 days ago

        DDOS attacks and AI scraper bots are technically indistinguishable. Both are just crippling the server by making an absurd number of requests.

        • JohnnyEnzyme@piefed.socialOP
          link
          fedilink
          English
          arrow-up
          3
          ·
          edit-2
          2 days ago

          Okay, that’s interesting. Note however that the instance runner specifically ID’d this as a DDOS attack. See copy of their message in side-comment here.

          • artyom@piefed.social
            link
            fedilink
            English
            arrow-up
            2
            ·
            2 days ago

            I don’t see anything except an absolutely massive image of some sort of warning symbol. What is a “side-comment”?

            • JohnnyEnzyme@piefed.socialOP
              link
              fedilink
              English
              arrow-up
              2
              ·
              edit-2
              2 days ago

              Sorry, I wish I hadn’t uploaded that. The silly image is relatively tiny, but got blown up. Anyway, so you can’t see the other comments in this thread? Are you hitting it from an app?

              EDIT: I’ve copy-pasted it in to the main post.