cm0002@lemmy.world to Opensource@programming.dev · 5 days agoAnubis - Weighs the soul of incoming HTTP requests to stop AI crawlersgithub.comexternal-linkmessage-square8fedilinkarrow-up169arrow-down12cross-posted to: lobsters
arrow-up167arrow-down1external-linkAnubis - Weighs the soul of incoming HTTP requests to stop AI crawlersgithub.comcm0002@lemmy.world to Opensource@programming.dev · 5 days agomessage-square8fedilinkcross-posted to: lobsters
minus-squareisolatedscotch@discuss.tchncs.delinkfedilinkarrow-up3·4 days agoai scrapers send thousands of requests per second, they’ll just deem a small website using it “not worthy”
ai scrapers send thousands of requests per second, they’ll just deem a small website using it “not worthy”