Re: [Bug-wget] --page-requisites and robot exclusion issue

2011-12-05 Thread Paul Wratt
if it does not obey - server admins will ban it the work around: 1) get single html file first - edit out meta tag - re-get with --no-clobber (usually only in landing pages) 2) empty robots.txt (or allow all - search net) possible solutions: A) command line option B) ./configure

[Bug-wget] error message

2011-12-05 Thread david painter
Help. after installing and trying get my DVD and Cd drives to work I now have a error message stating E:Type '2011-12-04' is not known on line 1 in Source list/etc/apt/source.list.d/medibuntu.list Regards David

Re: [Bug-wget] --page-requisites and robot exclusion issue

2011-12-05 Thread markk
Hi, Paul Wratt wrote: if it does not obey - server admins will ban it the work around: 1) get single html file first - edit out meta tag - re-get with --no-clobber (usually only in landing pages) 2) empty robots.txt (or allow all - search net) possible solutions: A) command line option

Re: [Bug-wget] --page-requisites and robot exclusion issue

2011-12-05 Thread Giuseppe Scrivano
Paul Wratt paul.wr...@gmail.com writes: if it does not obey - server admins will ban it the work around: 1) get single html file first - edit out meta tag - re-get with --no-clobber (usually only in landing pages) 2) empty robots.txt (or allow all - search net) possible solutions: A)

Re: [Bug-wget] Disable progress display when log output to file?

2011-12-05 Thread Paul Wratt
this works but no size in output: wget -nv --output-file=wget.txt _url_ I found a reference to a 2007 post asking for: 3) add support for turning off the progress bar with --progress=none 4) perhaps disable the progress bar if -O - is specified