Silvermirror to mirror websites

Chris Wright via Digitalmars-d-announce digitalmars-d-announce at puremagic.com
Sat Jan 14 18:28:34 PST 2017


Github: https://github.com/dhasenan/silvermirror

Silvermirror is a tool to mirror websites -- download them locally and 
serve copies of them.

Compared to wget, which is the standard tool, its advantages are:

* Resumability
* Reduced memory usage (at least 20x in my tests)
* Consistent URL mapping
* Correctness (fewer assumptions about URL/file mapping)
* Human-readable output
* A simple builtin template engine
* An index of pages available

Future directions:

* Integrated fulltext search
* Better templates
* Better excludes


More information about the Digitalmars-d-announce mailing list