Main Tutorials

Nginx : Block User Agent

In Nginx, you can block certain user agents (normally it is crawler) like this :

/etc/nginx/sites-enabled/default

server {
  listen          80;
  server_name     mysite.com;
  root            /etc/tomcat7/webapps/mysite;

  if ($http_user_agent ~* (ahrefs|wget|crawler|majestic) ) {
    return 403;
  }

  location / {
        <!-- xxx -->
  }
}

In above example, for “user agent” that contains one of this pattern : ahrefs|wget|crawler|majestic, HTTP 403 will be returned.

About Author

author image
Founder of Mkyong.com, love Java and open source stuff. Follow him on Twitter. If you like my tutorials, consider make a donation to these charities.

Comments

Subscribe
Notify of
0 Comments
Inline Feedbacks
View all comments