Block Google from Dev Server

An article by medialam    No Comments

I was having a problem where Google was indexing sites on my development server, I wanted to just lock down the entire server from Google and other bots without having to change the robots.txt file of each site, as when I push them to live I would have had to change it back and undoubtly one day would have forgotten.

To do this I placed the following in my httpd.conf file:

<Directory />
RewriteEngine on
RewriteCond %{HTTP_USER_AGENT} google|googlebot|bing|slurp [NC]
RewriteRule .? - [G]
</Directory>