Speed of csvReader
data pulverizer via Digitalmars-d-learn
digitalmars-d-learn at puremagic.com
Thu Jan 21 02:40:39 PST 2016
On Thursday, 21 January 2016 at 10:20:12 UTC, Rikki Cattermole
wrote:
> Okay without registering not gonna get that data.
>
> So usual things to think about, did you turn on release mode?
> What about inlining?
>
> Lastly how about disabling the GC?
>
> import core.memory : GC;
> GC.disable();
>
> dmd -release -inline code.d
That helped a lot, I disable GC and inlined as you suggested and
the time is now:
Time (s): 8.754
However, with R's data.table package gives us:
system.time(x <- fread("Acquisition_2009Q2.txt", sep = "|",
colClasses = rep("character", 22)))
user system elapsed
0.852 0.021 0.872
I should probably have begun with this timing. Its not my
intention to turn this into a speed-only competition, however the
ingest of files and speed of calculation is very important to me.
More information about the Digitalmars-d-learn
mailing list