Using iopipe to stream a gzipped file

[Andrew]

On Thursday, 4 January 2018 at 15:48:21 UTC, Steven Schveighoffer 
wrote:
>
> It's now been updated, see version 0.0.3.
>
> Note, the performance isn't something I focused on. I'll note 
> that gzcat | wc -l is 2x faster than your simple example on 
> that file.
>
> I can think of a couple reasons for this:
>
> 1. gzcat may use mmap to increase read speed
> 2. gzcat may read larger chunks at once (this can be tuned 
> using iopipe as well, just set the optimizedReadSize).
> 3. gzcat file.gz | iopipe_byline -nooutput is about 20% faster 
> than using wc -l, so it's definitely not the line parsing.
>
> Let me know if this works correctly for your other test cases! 
> If not, file an issue: 
> https://github.com/schveiguy/iopipe/issues
>
> -Steve

That works perfectly, thank you very much!