help design a query interface for DStress' "bad apple" database

[Kirk McDonald]

Thomas Kuehne wrote:
> The problem are misbehaving crawling bots repeatedly downloading some
> parts of the site if the files have a common mime type like text/plain
> instead of a uncommon on like text/x-dsrc and thereby sucking GBs.
> I'm currently preparing to move to a hoster with more fine grained controls.
> Let's wait and see if the bots can be kept below a certain limit, if
> so I'll enable the "plain view" feature.
> 

No robots.txt? Or is that what you meant by "misbehaving"?
http://en.wikipedia.org/wiki/Robots.txt

-- 
Kirk McDonald
Pyd: Wrapping Python with D
http://pyd.dsource.org