Steps to solve robots.txt throw “too many redirects” error with Cloudflare

If you had encounter error’s “ERR_TOO_MANY_REDIRECTS” when accessing robots.txt file while your site is integrated with Cloudflare, then this article can solve this nightmare.

As you know, robots.txt file important for search engines to choose what to fetch on your site, if there is misconfiguration of it then sometime can cause drop of traffic.

This problem is common for those websites that are integrated with Cloudflare, if you don’t solve it at right time there might be a highly changes on site’s traffic.

This method is only work if there is no misconfiguration of SSL certificates on server, that means the problem is only persist on only robots.txt and not otherwise.

Here we go, this problem is exist if your SSL configuration is set by “flexible” which is default, to get rid off then you have to set it into either “full” or “full strict”.

Last, Clear cache on Cloudflare, done.

Leave a comment