Help optimizing UnCompress for gzipped files

Steven Schveighoffer schveiguy at yahoo.com
Wed Jan 3 14:42:47 UTC 2018


On 1/3/18 2:47 AM, Christian Köstlin wrote:
> On 02.01.18 21:13, Steven Schveighoffer wrote:
>> Well, you don't need to use appender for that (and doing so is copying a
>> lot of the data an extra time). All you need is to extend the pipe until
>> there isn't any more new data, and it will all be in the buffer.
>>
>> // almost the same line from your current version
>> auto mypipe = openDev("../out/nist/2011.json.gz")
>>                    .bufd.unzip(CompressionFormat.gzip);
>>
>> // This line here will work with the current release (0.0.2):
>> while(mypipe.extend(0) != 0) {}
> Thanks for this input, I updated the program to make use of this method
> and compare it to the appender thing as well.
> 

Hm.. the numbers are worse! I would have expected to be at least 
comparable. I'll have to look into it. Thanks for posting this.

-Steve


More information about the Digitalmars-d-learn mailing list