[htdig] Using htdig to just collect/gather the pages

[Mark Friedman]

Is there a way to configure htdig to be used to just spider and collect pages and documents without doing any of the index/search related stuff?

 

Thanks in advance.

 

-Mark