[OT] Efficient file structure for very large lookup tables?
Ola Fosheim Grøstad" <ola.fosheim.grostad+dlang at gmail.com>
Ola Fosheim Grøstad" <ola.fosheim.grostad+dlang at gmail.com>
Tue Dec 17 12:02:41 PST 2013
On Tuesday, 17 December 2013 at 19:09:49 UTC, H. S. Teoh wrote:
> What's a good, efficient file structure for storing extremely
> large
> lookup tables? (Extremely large as in > 10 million entries,
> with keys
> and values roughly about 100 bytes each.) The structure must
> support
> efficient adding and lookup of entries, as these two operations
> will be
> very frequent.
But 200*10million = 2GB. Can't you use an existing KD-tree and
tweak it to fit memory pages and rely on paging for a start?
More information about the Digitalmars-d
mailing list