Speed of csvReader
data pulverizer via Digitalmars-d-learn
digitalmars-d-learn at puremagic.com
Thu Jan 21 02:48:15 PST 2016
On Thursday, 21 January 2016 at 10:40:39 UTC, data pulverizer
wrote:
> On Thursday, 21 January 2016 at 10:20:12 UTC, Rikki Cattermole
> wrote:
>
>> Okay without registering not gonna get that data.
>>
>> So usual things to think about, did you turn on release mode?
>> What about inlining?
>>
>> Lastly how about disabling the GC?
>>
>> import core.memory : GC;
>> GC.disable();
>>
>> dmd -release -inline code.d
>
> That helped a lot, I disable GC and inlined as you suggested
> and the time is now:
>
> Time (s): 8.754
>
> However, with R's data.table package gives us:
>
> system.time(x <- fread("Acquisition_2009Q2.txt", sep = "|",
> colClasses = rep("character", 22)))
> user system elapsed
> 0.852 0.021 0.872
>
> I should probably have begun with this timing. Its not my
> intention to turn this into a speed-only competition, however
> the ingest of files and speed of calculation is very important
> to me.
I should probably add compiler version info:
~$ dmd --version
DMD64 D Compiler v2.069.2
Copyright (c) 1999-2015 by Digital Mars written by Walter Bright
Running Ubuntu 14.04 LTS
More information about the Digitalmars-d-learn
mailing list