Re: Some test results with current svn version
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Jochen Roderburg wrote: > I have tried out again the current wget version from svn to see the progress > on > various discussed problems. > >>> Someone recently reported an inability to specify the prefix for libssl. > > Hmm, yes, I reported this a year ago ;-) > > That works now again as expected. When I specify > --with-libssl-prefix=/usr/local > I get the correct libs in the Makefile(s): This has just recently been fixed; it had to do with the fact that we were using sh "if" where we should have been using autoconf "AS_IF". This has unfortunate interactions with autoconf's mechanisms for automated dependency resolution. Sorry I didn't reply to my previous message to say so, but I wasn't sure anyone had paid attention to it ;) > I see, however, no difference yet regarding Content-Disposition, despite the > explanations in ChangeLogs and recent mails that there is now an option for it > which is off as default. Mauro has just finished some code related to this, so you can try it out when that has gone into the trunk. :) - -- Micah J. Cowan Programmer, musician, typesetting enthusiast, gamer... http://micah.cowan.name/ -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGv8f37M8hyUobTrERCE9xAKCO/yyzWIvXz2PgMwDZe2iwQoqrUACeNzqf HFZ67p0MLnbMhP7DEbVTiZk= =YBqp -END PGP SIGNATURE-
Re: trouble with -p
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Brian Keck wrote: > Hello, > > Sometimes -p doesn't work. For instance: > > wget -p http://en.wikipedia.org/wiki/Herbig-Haro_object Hi, The --debug flag will often provide useful information about why wget doesn't download something you expect it to. In this case, it appears that you've bumped into the fact that wget, by default, will refuse to cross hostname boundaries to download things, unless you tell it otherwise. You want the -H option. - -- Micah J. Cowan Programmer, musician, typesetting enthusiast, gamer... http://micah.cowan.name/ -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGv8WT7M8hyUobTrERCCtHAJ0Vm0cpIIHr70p51xDCBv4M1ZHDbwCfdYvT RHW6aeYgpXEChRuOiEJkwhQ= =5X/Z -END PGP SIGNATURE-
Some test results with current svn version
I have tried out again the current wget version from svn to see the progress on various discussed problems. >> Someone recently reported an inability to specify the prefix for libssl. Hmm, yes, I reported this a year ago ;-) That works now again as expected. When I specify --with-libssl-prefix=/usr/local I get the correct libs in the Makefile(s): LIBS = -lintl -ldl -lrt /usr/local/lib/libssl.so /usr/local/lib/libcrypto.so -Wl,-rpath -Wl,/usr/local/lib I understand that the HEAD/GET issues are still in discussion and testing, the current state that I see now is: no timestamping, no local file no HEAD no timestamping,local file no HEAD timestamping, no local file HEAD timestamping,local file HEAD (and the file-transfer as such works again). I see, however, no difference yet regarding Content-Disposition, despite the explanations in ChangeLogs and recent mails that there is now an option for it which is off as default. Best Regards, Jochen Roderburg ZAIK/RRZK University of Cologne Robert-Koch-Str. 10Tel.: +49-221/478-7024 D-50931 Koeln E-Mail: [EMAIL PROTECTED] Germany
trouble with -p
Hello, Sometimes -p doesn't work. For instance: wget -p http://en.wikipedia.org/wiki/Herbig-Haro_object This fetches several images from en.wikipedia.org, but none of the several images from upload.wikimedia.org. Is this normal behaviour? There's some javascript, but it looks harmless. The source in the neighbourhood of one of the omitted images (tidied up a bit) is ... http://en.wikipedia.org/wiki/Image:HH_object_diagram.svg"; class="internal" title="Schematic diagram of how HH objects arise"> http://upload.wikimedia.org/wikipedia/commons/thumb/6/6a/HH_object_diagram.svg/150px-HH_object_diagram.svg.png"; width="150" height="300" /> I'm using wget 1.10.2 on debian unstable. Thanks for any help, Brian Keck
[Fwd: using wget for building web connectivity graph]
Hi Roldan, I'm forwarding this question to the wget mailing list, so you can potentially reap the benefit of multiple, wget-experienced minds. -Micah Original Message Subject: using wget for building web connectivity graph Date: Sun, 12 Aug 2007 01:31:29 -0400 From: Roldan Pozo <[EMAIL PROTECTED]> To: [EMAIL PROTECTED] Micah, My name is Roldan Pozo, and I am a computer scientist at the National Institute of Standards and Technology (NIST) just outside Washington DC. I am working on a complex systems project to study the connectivity topology of various web neighborhoods. (That is, starting at a given page, construct a graph were two nodes are connected if one references the other via an href.) I have experimented with several web crawlers without success, and am wondering if wget could (with the proper options) produce a list of outgoing links, recursviely. Can wget be used for this? I couldn't find an obvious flag combination for this. If not, can someone point me to relevant areas of the source code to look at for possible modification? Thanks, Roldan
