Speed of csvReader

[Gerald Jansen via Digitalmars-d-learn]

On Tuesday, 26 January 2016 at 20:54:34 UTC, Chris Wright wrote:
> On Tue, 26 Jan 2016 18:16:28 +0000, Gerald Jansen wrote:
>> On Thursday, 21 January 2016 at 21:24:49 UTC, H. S. Teoh wrote:
>>>
>>> While this is no fancy range-based code, and one might say 
>>> it's more hackish and C-like than idiomatic D, the problem is 
>>> that current D compilers can't quite optimize range-based 
>>> code to this extent yet. Perhaps in the future optimizers 
>>> will improve so that more idiomiatic, range-based code will 
>>> have comparable performance with fastcsv.
>> 
>> ... data crunching ... I'm wondering how general your 
>> statement above might be at this time w.r.t. this and possibly 
>> other domains.
>
> You can get fewer large allocations by reading the whole file 
> at once manually and using slices into that large allocation.

Sure, that part is clear. Presumably the quoted comment referred 
to more than just that technique.