Remove dlang.org/library/ from search results?

Jakob Ovrum via Digitalmars-d digitalmars-d at puremagic.com
Thu Sep 18 21:50:44 PDT 2014


On Friday, 19 September 2014 at 04:37:22 UTC, Vladimir Panteleev 
wrote:
> Yes, listing them in robots.txt, which was what I suggested. 
> I'm not saying we should actually remove them from the website 
> :)
>
> We already have /phobos-prerelease/ and /library-prerelease/ in 
> robots.txt:
> http://dlang.org/robots.txt

I think we should do it, but robots.txt is tracked by the git 
repository, so might as well continue this in a PR?


More information about the Digitalmars-d mailing list