Github: https://github.com/dhasenan/silvermirror
Silvermirror is a tool to mirror websites -- download them locally and serve copies of them. Compared to wget, which is the standard tool, its advantages are: * Resumability * Reduced memory usage (at least 20x in my tests) * Consistent URL mapping * Correctness (fewer assumptions about URL/file mapping) * Human-readable output * A simple builtin template engine * An index of pages available Future directions: * Integrated fulltext search * Better templates * Better excludes
