Hi, I just discovered that Test--spider-r.py fails here (parallel-wget branch).
The reason is 'robots=off' in ~./wgetrc. But that leads the the question, how can we prevent any user (and global /etc/wgetrc) settings dropping in, possibly making the tests fail. An option like --no-config could solve this issue with just a few lines of code. What do you think ? Tim
