haley.io
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
Pro@programming.dev to Technology@programming.devEnglish ·
edit-2
7 个月前

Codeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.

i.imgur.com

message-square
99
fedilink
  • cross-posted to:
  • technology@lemmy.world
665

Codeberg: army of AI crawlers are extremely slowing us; AI crawlers learned how to solve the Anubis challenges.

i.imgur.com

Pro@programming.dev to Technology@programming.devEnglish ·
edit-2
7 个月前
message-square
99
fedilink
  • cross-posted to:
  • technology@lemmy.world

Source.

Comments
  • Lemmy;
  • Hackernews.
  • JPAKx4@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    2    ·
    9 个月前

    I mean if it’s cms site there may not be an api, this would be the only solution in that case

Technology@programming.dev

Technology@programming.dev

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !Technology@programming.dev

Share interesting Technology news and links.

Rules:

  1. No paywalled sites at all.
  2. News articles has to be recent, not older than 2 weeks (14 days).
  3. No external video links, only native(.mp4,…etc) links under 5 mins.
  4. Post only direct links.

To encourage more original sources and keep this space commercial free as much as I could, the following websites are Blacklisted:

  • Al Jazeera;
  • NBC;
  • CNBC;
  • Substack;
  • Tom’s Hardware;
  • ZDNet;
  • TechSpot;
  • Ars Technica;
  • Vox Media outlets(including Axios, due to new changes related to trackers on their website);
  • Engadget;
  • TechCrunch;
  • Gizmodo;
  • Futurism;
  • PCWorld;
  • ComputerWorld;
  • Mashable;
  • Hackaday;
  • WCCFTECH;
  • Neowin;
  • Jacobin;
  • Yahoo;
  • Freethink;
  • Big Think;
  • Newsweek.

More sites will be added to the blacklist as needed.

Encouraged:

  • Archive links in the body of the post.
  • Linking to the direct source, instead of linking to an article talking about the source.

Misc:

Relevant Lemmy Communities:

  • Beehaw Technology discussion.
  • Hard Tech news.
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 1 user / day
  • 1 user / week
  • 5 users / month
  • 1.38K users / 6 months
  • 1 local subscriber
  • 889 subscribers
  • 1.92K Posts
  • 4.46K Comments
  • Modlog
  • mods:
  • irelephant [he/him]@programming.dev
  • BE: 0.19.5
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org