Fending off scrapers with Tigris and DuckDB
Anubis is a Web AI Firewall Utility that helps administrators keep their sites up in the wake of abusive scrapers. In order to make Anubis filter things better, you need data. Here's how Xe got that data to improve Anubis' filtering powers.
14 min read