Wed 22 November 2017 Linux Alan Orth Rate Limiting Baiduspider Using nginx Using nginx maps and limit request zones to rate limit Baiduspider for its disregard of robots.txt, sitemaps, and server resource usage.