Anubis: A Website's Anti-Scraping Defense Against AI
To combat server downtime caused by large-scale data scraping by AI companies, this website has implemented an anti-scraping mechanism called Anubis. Anubis uses a Proof-of-Work (PoW) scheme similar to Hashcash, adding negligible overhead for individual users but significantly increasing the cost for mass scraping. This is a temporary solution; future improvements will focus on fingerprinting and headless browser detection to improve accuracy and reduce disruption to legitimate users. Note: Anubis requires modern JavaScript features; please disable plugins like JShelter that might disable JavaScript.
Read more