What is the “best” setup for robots.txt? I’m using the following permalink structure /%category%/%postname%/. My robots.txt currently looks like this (copied from somewhere a long time ago): User-agent: *...
While this is a question, it is as well a serious warning to publishers that separate their posts using <!--nextpage-->. Bare with me. I run a highly trafficked multiple...