Re: Wget and Yahoo login?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Rick Nakroshis wrote: Micah, If you will excuse a quick question about Wget, I'm trying to find out if I can use it to download a page from Yahoo that requires me to be logged in using my Yahoo profile name and password. It's a display of a CSV file, and the only wrinkle is trying to get past the Yahoo login. Try as I may, I just can't seem to find anything about Wget and Yahoo. Any suggestions or pointers? Hi Rick, In the future, it's better if you post questions to the mailing list at wget@sunsite.dk; I don't always have time to respond. The easiest way to do what you want may be to log in using your browser, and then tell Wget to use the cookies from your browser, using - --load-cookies=path-to-browser's-cookies. Of course, this only works if your browser saves its cookies in the standard text format (Firefox prior to version 3 will do this), or can export to that format (note that someone contributed a patch to allow Wget to work with Firefox 3 cookies; it's linked from http://wget.addictivecode.org/, it's unoffocial so I can't vouch for its quality). Otherwise, you can perform the login using Wget, saving the cookies to a file of your choice, using --post-data=..., --save-cookies=cookies.txt, and probably --keep-session-cookies. This will require that you know what data to place in --post-data, which generally requires that you dig around in the HTML to find the right form field names, and where to post them. For instance, if you find a form like the following within the page containing the log-in form: form action=/doLogin.php method=POST input type=text name=s-login input type=password name=s-pass /form then you need to do something like: $ wget --post-data='s-login=USERNAMEs-pass=PASSWORD' \ --save-cookies=my-cookies.txt --keep-session-cookies \ http://HOSTNAME/doLogin.php (Note that you _don't_ necessarily send the information to the page that had the login page: you send it to the spot mentioned in the action attribute of the password form.) Once this is done, you _should_ be able to perform further operations with Wget as if you're logged in, by using $ wget --load-cookies=my-cookies.txt --save-cookies=my-cookies.txt \ --keep-session-cookies ... (I'm going to put this up on the Wgiki Faq now, at http://wget.addictivecode.org/FrequentlyAskedQuestions) - -- Micah J. Cowan Programmer, musician, typesetting enthusiast, gamer. GNU Maintainer: wget, screen, teseq http://micah.cowan.name/ -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIn09A7M8hyUobTrERAu04AJ9EgRoBBhvNCDwOt87f91p+HpWktACdFgMM KEfliBtfrPBbh/XdvusEPiw= =qlGZ -END PGP SIGNATURE-
Miklos Santa is out of the office.
I will be out of the office starting 2008.08.01 and will not return until 2008.08.27. I am on vacation. If the matter is urgent, please call Diana Roka on +36 1 451 8126 or contact with her by following e-mail address: [EMAIL PROTECTED] Miklos -- The information contained in this communication is intended solely for the use of the individual or entity to whom it is addressed and others authorized to receive it. It may contain confidential or legally privileged information. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by responding to this email and then delete it from your system. Ernst Young is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt.
AW: AW: AW: Problem mirroring a site using ftp over proxy
Well, here is the index.html (I'm not sure wheter is also accessible in the maillist as I send it as attachement?) -Ursprüngliche Nachricht- Von: Micah Cowan [mailto:[EMAIL PROTECTED] Gesendet: Freitag, 8. August 2008 21:11 An: Juon, Stefan Cc: wget@sunsite.dk Betreff: Re: AW: AW: Problem mirroring a site using ftp over proxy -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Juon, Stefan wrote: The point is that wget sends rather a http request than a pure ftp command (GET ftp://ftpde.nai.com/CommonUpdater/ HTTP/1.0) which causes the proxy to send back a index.html. Do u agree? Well of course it does: it's using an HTTP proxy. How do you send FTP commands over HTTP? The problem isn't that the result is an HTML file; the problem is that the proxy sends an HTML file that Wget apparently can't parse. Perhaps the proxy's not really sending an HTML file at all, which would be unusual (but I'm not sure there are standards governing how FTP gets proxied across HTTP), in which case Wget would need to be modified to check whether the proxied results are a listing file. But until you show us what index.html file Wget is getting, I don't see how we can help. - -- Micah J. Cowan Programmer, musician, typesetting enthusiast, gamer. GNU Maintainer: wget, screen, teseq http://micah.cowan.name/ -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.7 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFInJpC7M8hyUobTrERAhGtAJ9/cY3nJk8xf1oWb+KCH8mQ54nXNACgg/is xD3eHrajIfnUDaRhnFI+X+s= =g1QP -END PGP SIGNATURE- Title: Directory of /CommonUpdater/ Current directory is /CommonUpdater/ ..53425343.upd 488132Fri Aug 8 06:20:00 2008 53425343avv.gem 249132Fri Aug 8 06:20:00 2008 53435344.upd 1007181Fri Aug 8 06:20:00 2008 53435344avv.gem 719148Fri Aug 8 06:20:00 2008 53445345.upd 647667Fri Aug 8 06:20:00 2008 53445345avv.gem 395556Fri Aug 8 06:20:00 2008 53455346.upd 435721Fri Aug 8 06:20:00 2008 53455346avv.gem 205412Fri Aug 8 06:20:00 2008 53465347.upd 416621Fri Aug 8 06:20:00 2008 53465347avv.gem 190396Fri Aug 8 06:20:00 2008 53475348.upd 379599Fri Aug 8 06:20:00 2008 53475348avv.gem 145164Fri Aug 8 06:20:00 2008 53485349.upd 591065Fri Aug 8 06:20:00 2008 53485349avv.gem 346116Fri Aug 8 06:20:00 2008 53495350.upd 529113Fri Aug 8 06:20:00 2008 53495350avv.gem 291500Fri Aug 8 06:20:00 2008 53505351.upd 573233Fri Aug 8 06:20:00 2008 53505351avv.gem 341996Fri Aug 8 06:20:00 2008 53515352.upd 492563Fri Aug 8 06:20:00 2008 53515352avv.gem 276548Fri Aug 8 06:20:00 2008 53525353.upd 786499Fri Aug 8 06:20:00 2008 53525353avv.gem 1005388Fri Aug 8 06:20:00 2008 53535354.upd 516762Fri Aug 8 06:20:00 2008 53535354avv.gem 327140Fri Aug 8 06:20:00 2008 53545355.upd 340941Fri Aug 8 06:20:00 2008 53545355avv.gem 146724Fri Aug 8 06:20:00 2008 53555356.upd 284106Fri Aug 8 06:20:00 2008 53555356avv.gem 97148Fri Aug 8 06:20:00 2008 53565357.upd 231339Fri Aug 8 06:20:00 2008 53565357avv.gem 70244Fri Aug 8 06:20:00 2008 avvdat-5357.zip 29893719Fri Aug 8 06:20:00 2008 catalog.z 3052Fri Aug 8 06:23:00 2008 ceu.ini 54Fri Aug 8 06:21:00 2008 Current Tue Jul 1 11:29:00 2008 dat-5357.zip 36336239Fri Aug 8 06:20:00 2008 DATInstall.mcs 49772Fri Aug 8 06:20:00 2008 delta.ini 1342Fri Aug 8 06:21:00 2008 gdeltaavv.ini 1062Fri Aug 8 06:21:00 2008 oem.ini 1031Fri Aug 8 07:14:00 2008 Replica.log 4142Fri Aug 8 06:23:00 2008 SiteStat.xml 118Fri Aug 8 06:23:00 2008 update.ini 1286Fri Aug 8 06:21:00 2008 V2datdet.mcs 80500Fri Aug 8 06:21:00 2008 V2datInstall.mcs 83700Fri Aug 8 06:21:00 2008
