code.dlang.org is down

[kdevel]

I would like to ask you if you thought about some of the following
measures (not necessarily in their order of appearance):

On Friday, 11 April 2025 at 09:06:01 UTC, Sönke Ludwig wrote:
> [...]
> I'm not sure what exactly causes it, but the process is in a 
> state where it's mostly busy with garbage collection. It seems 
> like there is maybe a self-reinforcing effect, where incoming 
> connections that time out lead to higher GC pressure.

- Turn off the GC.

- Run vibe.d under hard memory/cpu limit (which terminate
   the process if exceeded).

- Deploy a monitoring process which checks if vibe.d responds
   in say 20 ms. If not kill vibe.d with SIGKILL.

- flock with LOCK_EX on an open fd fopend on the vibe.d binary
   right before vibe.d issues the bind call.

- Have a second vibe.d process running blocking on it's flock call
   (= auto restart).

> The other thing is that there appear to be some very aggressive 
> crawlers that go through the whole site at maximum speed with 
> what looks like 8 parallel requests.

To me it seems that code.dlang.org is mostly not a web app but
a web site with static content. Have you been thinking of serving
that static content with apache/nginx using rate limiting
(mod_throttle etc.)? Or putting this content directly to CF who is
also a web hoster?