Parameterized unit testing and benchmarking of phobos

[Jacob Carlborg via Digitalmars-d]

On 08/10/14 23:37, Robert burner Schadek wrote:
> Lately, I find myself wondering, if I should add parameterized unit
> tests to std.string, because the last few bugs I fixed where not caught
> by tests, as the test-data was not good enough. I know random data is
> not perfect either, but it would be good addition IMO.
>
> Additionally, I thought these unit tests could be used to benchmark the
> performance of the functions and the compilers. Thus allowing continues
> monitoring of performance changes.
>
> I'm thinking of something like:
>
> version(unittest_benchmark) {
> unittest {
>      auto ben = Benchmark("bench_result_file", numberOfRuns);
>      auto values = ValueGen!(StringGen(0, 12), IntGen(2, 24))(ben);
>
>      foreach(string rStr, int rInt; values) {
>          auto rslt = functionToTest(rStr, rInt);
>          // some asserts
>      }
> }
> }
>
> The bench_result_file would be a csv with e.g. date,runtime,...
>
> ideas, suggestions?

I think you should use a UDA's instead. The a unit test framework can, 
hopefully, handle this automatically.

-- 
/Jacob Carlborg