Remove dlang.org/library/ from search results?

[Jakob Ovrum via Digitalmars-d]

On Friday, 19 September 2014 at 04:37:22 UTC, Vladimir Panteleev 
wrote:
> Yes, listing them in robots.txt, which was what I suggested. 
> I'm not saying we should actually remove them from the website 
> :)
>
> We already have /phobos-prerelease/ and /library-prerelease/ in 
> robots.txt:
> http://dlang.org/robots.txt

I think we should do it, but robots.txt is tracked by the git 
repository, so might as well continue this in a PR?