Silvermirror to mirror websites
Chris Wright via Digitalmars-d-announce
digitalmars-d-announce at puremagic.com
Sat Jan 14 18:28:34 PST 2017
Github: https://github.com/dhasenan/silvermirror
Silvermirror is a tool to mirror websites -- download them locally and
serve copies of them.
Compared to wget, which is the standard tool, its advantages are:
* Resumability
* Reduced memory usage (at least 20x in my tests)
* Consistent URL mapping
* Correctness (fewer assumptions about URL/file mapping)
* Human-readable output
* A simple builtin template engine
* An index of pages available
Future directions:
* Integrated fulltext search
* Better templates
* Better excludes
More information about the Digitalmars-d-announce
mailing list