Benchmarking suite

[qznc via Digitalmars-d]

On Tuesday, 8 September 2015 at 08:24:43 UTC, Robert burner 
Schadek wrote:
> Why not go really big. aka:
>
> http://forum.dlang.org/post/vzcvwrbqpeamtnopmtoa@forum.dlang.org

You suggest to create a benchmark suite from all the unittests in 
Phobos?

I don't think this is a good idea. Most programs don't make good 
performance tests. Even the Benchmarks Game / Shootout benchmarks 
are partially stupid. For example, threadring measures context 
switching. The best strategy is "use pthreads and pthread mutex 
and restrict to one core". It only shows how good your language 
can access the pthread API. The context switching is done by 
Linux. The pidigits programs basically measures libGMP 
performance.

I'm all for adding more programs into the benchmark suite, but 
they should be carefully selected to measure different aspects. I 
don't understand all the programs enough to know what is lacking. 
Probably some memory management aspects. Maybe some concurrency 
stuff.