How to read fastly files ( I/O operation)
FG
home at fgda.pl
Mon Feb 4 09:02:38 PST 2013
On 2013-02-04 15:04, bioinfornatics wrote:
> I am looking to parse efficiently huge file but i think D lacking for this purpose.
> To parse 12 Go i need 11 minutes wheras fastxtoolkit (written in c++ ) need 2 min.
>
> My code is maybe not easy as is not easy to parse a fastq file and is more
> harder when using memory mapped file.
Why are you using mmap? Don't you just go through the file sequentially?
In that case it should be faster to read in chunks:
foreach (ubyte[] buffer; file.byChunk(chunkSize)) { ... }
More information about the Digitalmars-d-learn
mailing list