You Don’t Need Robots.txt On Root Domain, Says Google

Google’s Gary Illyes shares an unconventional but valid method for centralizing robots.txt rules on CDNs.

Robots.txt files can be centralized on CDNs, not just root domains.

Websites can redirect robots.txt from main domain to CDN.

This unorthodox approach complies with updated standards.

Source link

How useful was this post?

Click on a star to rate it!

Average rating / 5. Vote count:

No votes so far! Be the first to rate this post.

As you found this post useful...

Follow us on social media!

Stay up to date
Register now to get updates on promotions and coupons

Shopping cart

×