And you'll probably have to do this again- I bet
yahoo expires the session cookies!
On Tue, Sep 9, 2008 at 2:18 PM, Donald Allen [EMAIL PROTECTED] wrote:
After surprisingly little struggle, I got Plan B working -- logged into
yahoo with wget, saved the cookies, including session cookies, and then
proceeded to fetch pages using the saved cookies. Those pages came back
logged in as me, with my customizations. Thanks to Tony, Daniel, and Micah
-- you all provided critical advice in solving this problem.
/Don
On Tue, Sep 9, 2008 at 2:21 PM, Donald Allen [EMAIL PROTECTED] wrote:
On Tue, Sep 9, 2008 at 1:51 PM, Micah Cowan [EMAIL PROTECTED] wrote:
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
Donald Allen wrote:
On Tue, Sep 9, 2008 at 1:41 PM, Micah Cowan [EMAIL PROTECTED]
mailto:[EMAIL PROTECTED] wrote:
Donald Allen wrote:
I am doing the yahoo session login with firefox, not with wget,
so I'm
using the first and easier of your two suggested methods. I'm
guessing
you are thinking that I'm trying to login to the yahoo session with
wget, and thus --keep-session-cookies and
--save-cookies=foo.txt would
make perfect sense to me, but that's not what I'm doing (yet --
if I'm
right about what's happening here, I'm going to have to resort to
this).
But using firefox to initiate the session, it looks to me like wget
never gets to see the session cookies because I don't think firefox
writes them to its cookie file (which actually makes sense -- if they
only need to live as long as the session, why write them out?).
Yes, and I understood this; the thing is, that if session cookies are
involved (i.e., cookies that are marked for immediate expiration and
are
not meant to be saved to the cookies file), then I don't see how you
have much choice other than to use the harder method, or else to fake
the session cookies by manually inserting them to your cookies file or
whatnot (not sure how well that may be expected to work). Or, yeah, add
an explicit --header 'Cookie: ...'.
Ah, the misunderstanding was that the stuff you thought I missed was
intended to push me in the direction of Plan B -- log in to yahoo with
wget.
Yes; and that's entirely my fault, as I didn't explicitly say that.
No problem.
I understand now. I'll look at trying to make this work. Thanks
for all the help, though I can't guarantee that you are done yet :-)
But, hopefully, this exchange will benefit others.
I was actually surprised you kept going after I pointed out that it
required the Accept-Encoding header that results in gzipped content.
That didn't faze me because the pages I'm after will be processed by a
python program, so having to gunzip would not require a manual step.
This behavior is a little surprising to me from Yahoo!. It's not
surprising in _general_, but for a site that really wants to be as
accessible as possible (I would think?), insisting on the latest
browsers seems ill-advised.
Ah, well. At least the days are _mostly_ gone when I'd fire up Netscape,
visit a site, and get a server-generated page that's empty other than
the phrase You're not using Internet Explorer. :p
And taking it one step further, I'm greatly enjoying watching Microsoft
thrash around, trying to save themselves, which I don't think they will.
Perhaps they'll re-invent themselves, as IBM did, but their cash cow is not
going to produce milk too much longer. I've just installed the Chrome beta
on the Windows side of one of my machines (I grudgingly give it 10 Gb on
each machine; Linux gets the rest), and it looks very, very nice. They've
still got work to do, but they appear to be heading in a very good
direction. These are smart people at Google. All signs seem to be pointing
towards more and more computing happening on the server side in the coming
years.
/Don
- --
Micah J. Cowan
Programmer, musician, typesetting enthusiast, gamer.
GNU Maintainer: wget, screen, teseq
http://micah.cowan.name/
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.7 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iD8DBQFIxreZ7M8hyUobTrERAslyAJwKfirhzth9ACgdunxp/rfQlR86mQCcClik
3HbbATyqnrm0hAJXqNTqpl4=
=3XD/
-END PGP SIGNATURE-
--
Best Regards.
Please keep in touch.
This is unedited.
P-)
