Debug comments in robots.txt

[MartinBucko]

Google scan .htaccess with debug comments:

<!-- using predis as a backup -->
<!-- displaying page without cache -->

User-agent: *
Disallow: /
<!-- Cache system by Benjamin Adams. Page generated in 0.13297 seconds. -->
<!-- Site was cached  = 1 -->
<!-- wp-redis-cache-seconds  = 43200 -->
<!-- wp-redis-cache-secret  = changeme-->
<!-- wp-redis-cache-ip  = 127.0.0.1-->
<!-- wp-redis-cache-debug  = 1-->

Website was in reconstruction mode, but it can make problem to search engines parsing robots.txt.

[ruebenramirez]

+1

[lfbn]

This is strange :| When opening robots.txt? That call don't pass through this plugin "custom index.php"...