New UTF-8 stride function

[Juan Manuel Cabo]

On Sunday, 26 May 2013 at 20:49:36 UTC, Dmitry Olshansky wrote:
> [..]
> Thus I encourage curious folks to measure/analyze it and report 
> back (don't forget to include your processor model).
> [..]

Ok, I just tested on my old trusty linux 64bit (Ubuntu 12.04).

I had to download those *wiki* files from this url:

    
https://github.com/blackwhale/gsoc-bench-2012/archive/master.zip

because github gave an error trying to download the ones that are 
more than 10Mb.

I ran the tests multiple times before copying them here.

And here are the results:

$ uname -a
Linux lolita 3.2.0-43-generic #68-Ubuntu SMP Wed May 15 03:33:33 
UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

$ grep 'model.name\|cpu.MHz' /proc/cpuinfo
model name      : AMD Athlon(tm) 64 X2 Dual Core Processor 4000+
cpu MHz         : 2109.518
model name      : AMD Athlon(tm) 64 X2 Dual Core Processor 4000+
cpu MHz         : 2109.518

$ grep MemTotal /proc/meminfo
MemTotal:        4049780 kB

$ dmd -O -inline -release -noboundscheck fast_stride.d
$ for a in *wiki*; do echo; echo $a: ; ./fast_stride $a; done

arwiki-latest-all-titles-in-ns0:
stride 67681
myStride 55908
myStride 66026
stride 66328

dewiki-latest-all-titles-in-ns0:
stride 155071
myStride 195449
myStride 196586
stride 154627

enwiki-latest-all-titles-in-ns0:
stride 688482
myStride 879950
myStride 879451
stride 689087

ruwiki-latest-all-titles-in-ns0:
stride 449133
myStride 364808
myStride 512485
stride 448841


--jm