eBay's TSV Utilities status update
James Blachly
james.blachly at gmail.com
Fri May 3 03:54:14 UTC 2019
On 4/29/19 11:23 AM, Jon Degenhardt wrote:
> An update on changes to this tool-set over the last year.
...
> The other main update is improved I/O read performance in many of the
> tools. This is from developing a buffered version of byLine. It is
> especially effective for skinny files (short lines). Most of the tools
> saw performance gains of 10-40%.
>
> One of the earlier performance improvements came from buffering output
> lines. Combined, the line-by-line read-write performance is quite a bit
> faster than what is available in Phobos. The iopipe / std.io packages
> (Steve Schveighoff, Martin Nowak) are faster still, these are the place
> to go for really high performance. (See the links below for a benchmark
> report.)
>
> Links:
> * tsv-utils repo: https://github.com/eBay/tsv-utils
> * tsv-sample user docs:
> https://github.com/eBay/tsv-utils/blob/master/docs/ToolReference.md#tsv-sample-reference
>
> * tsv-sample code docs:
> https://tsv-utils.dpldocs.info/tsv_utils.tsv_sample.html
> * Performance benchmarks on line-oriented I/O facilities:
> https://github.com/jondegenhardt/dcat-perf/issues/1
Jon:
Thank you for this, and thanks for your blog post of a couple of years
ago, which I referred to many times while learning D and writing
fast(er) CLI tools.
Looking forward to trying Steve's iopipe as well as your
bufferedByLineReader.
James
More information about the Digitalmars-d-announce
mailing list