Need a Faster Compressor

[ZombineDev via Digitalmars-d]

On Monday, 23 May 2016 at 01:46:40 UTC, Era Scarecrow wrote:
> On Sunday, 22 May 2016 at 19:44:08 UTC, Era Scarecrow wrote:
>> ...
>
> Well here's the rundown of some numbers. min_compress uses a 
> tiny window, big_compress was my original algorithmn but 
> modified to use 16k total for a window. reduced_id_compress is 
> the original except reduced to a 220 window and 2 byte constant 
> output. Along with the compressed outputs of each.
>
> min_compress:           [TickDuration(46410084)]  0.779836
> big_compress:           [TickDuration(47998202)]  0.806545
> orig_id_compress:       [TickDuration(59519257)]  baseline
> reduced_id_compress:    [TickDuration(44033192)]  0.739894
> 1001 (original size)
>
> 72 
> testexpansion.s!(æεó▌æ╗int).så°Resulà≡Ñ╪¢╨╘ÿ¼É ↑─↑╜►╘fñv├ÿ╜ ↑│↑Ä .foo()
> 73 
> testexpansion.s!(ÅæεÅó▌Åæ╗int).sÅå°ResulÅà≡ÅÑ╪Å¢╨Å╘ÿżÉ₧├ÿÄ╜É╝▓ÿëåâ.foo()
> 67 
> tes╤xpansion.s!(ÇææÇóóÇææint)∙⌡ResulÇàÅÇѺǢ»Ç╘τǼ∩ë├τü╜∩¢▓τ².foo()
> 78 
> testexpansion.s!(æ2óCæ2int).så(Resulà0ÑH¢P╘ê¼É╘íñÖ├ê┤ÿσ║ñ¬├ê¼É╘íñÖ├êÉ1å).foo()
>
> min_compress:           [TickDuration(29210832)]  0.82391
> big_compress:           [TickDuration(31058664)]  0.87601
> orig_id_compress:       [TickDuration(35466130)]  baseline
> reduced_id_compress:    [TickDuration(25032532)]  0.705977
> 629  (original size)
>
> 52 E.s!(à·è⌡àδint).så°Resulà≡ÖΣÅ▄╝╝ö┤ líd _Ög læ◄.foo()
> 61 E.s!(Åà·Åè⌡Åàδint).sÅå°ResulÅà≡ÅÖΣÅÅ▄Å╝╝Åö┤₧ç∞ÄÖΣ¡ó╠ïå╗.foo()
> 52 E.s!(ΣÇèèΣint)∙⌡ResulÇàÅÇÖ¢ÇÅúÇ╝├Çö╦ëçôüÖ¢Æó│².foo()
> 52 E.s!(à&è+à&int).så(Resulà0Ö<ÅD╝döl ┤í╝ ┴Ö╣ ┤æ9.foo()

If you want, you can give the test case for issue 16039 a try. It 
produces 300-400MB binary, so it should be a nice test case :P