Speed of csvReader

data pulverizer via Digitalmars-d-learn digitalmars-d-learn at puremagic.com
Thu Jan 21 02:48:15 PST 2016


On Thursday, 21 January 2016 at 10:40:39 UTC, data pulverizer 
wrote:
> On Thursday, 21 January 2016 at 10:20:12 UTC, Rikki Cattermole 
> wrote:
>
>> Okay without registering not gonna get that data.
>>
>> So usual things to think about, did you turn on release mode?
>> What about inlining?
>>
>> Lastly how about disabling the GC?
>>
>> import core.memory : GC;
>> GC.disable();
>>
>> dmd -release -inline code.d
>
> That helped a lot, I disable GC and inlined as you suggested 
> and the time is now:
>
> Time (s): 8.754
>
> However, with R's data.table package gives us:
>
> system.time(x <- fread("Acquisition_2009Q2.txt", sep = "|", 
> colClasses = rep("character", 22)))
>    user  system elapsed
>   0.852   0.021   0.872
>
> I should probably have begun with this timing. Its not my 
> intention to turn this into a speed-only competition, however 
> the ingest of files and speed of calculation is very important 
> to me.

I should probably add compiler version info:

~$ dmd --version
DMD64 D Compiler v2.069.2
Copyright (c) 1999-2015 by Digital Mars written by Walter Bright

Running Ubuntu 14.04 LTS



More information about the Digitalmars-d-learn mailing list