Blocking Special Files in Robots.txt

Digital Marketing

Post Tags


In the latest episode of Ask Google Webmasters, Google’s John Mueller goes over whether or not it’s okay to block special files in robots.txt.

Google SEO 101: Blocking Special Files in Robots.txt

Google’s John Mueller answers a question about using robots.txt to block special files, including .css and .htacess.

This topic was discussed in some detail in the latest edition of the Ask Google Webmasters video series on YouTube.

Here is the question that was submitted:

“Regarding robots.txt, should I ‘disallow: /*.css$’, ‘disallow: /php.ini’, or even ‘disallow: /.htaccess’?”

Mueller’s response is below:



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *