Re: AW: AW: Problem mirroring a site using ftp over proxy

2008-08-12 Thread Hrvoje Niksic
"Juon, Stefan" <[EMAIL PROTECTED]> writes:

> I just noticed these debug messages:
>
> **
> DEBUG output created by Wget 1.10.2 on cygwin.

You are of course aware that this is not the latest Wget (1.11.4)?
As mentioned before, recursive download over FTP proxy was broken
prior to Wget 1.11.

> The point is that wget sends rather a http request than a pure ftp
> command

That's how proxying FTP normally works.


Re: AW: AW: AW: Problem mirroring a site using ftp over proxy

2008-08-12 Thread Micah Cowan
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Juon, Stefan wrote:
> Well, here is the index.html (I'm not sure wheter is also accessible in the 
> maillist as I send it as attachement?) 

Sorry, I somehow failed to notice this post. :\

The index.html file that the proxy generated is invalid. Apparently it
wants to tack on ^M (carriage return, \r) after every filename, as a
literal part of the link. It looks like Wget doesn't even acknowledge
links like that; but even if it did, it'd send a request to the proxy like:

  GET /CommonUpdater/avvdat-.zip%0D

rather than

  GET /CommonUpdater/avvdat-.zip

so it would still most likely fail to get a real file (though it _might_
work, if the proxy and/or the FTP server are a little sloppy).

One likely explanation for this, seems to me, is that the proxy gets
back the LIST response like:

  foo CR LF
  bar CR LF

and removes the LFs while leaving in the CR, and spitting them out as
part of the link. That's really poor behavior, considering that FTP
servers _ought_ to send CR LF (and not bare LF), as it's supposed to use
"telnet conventions".

- --
Micah J. Cowan
Programmer, musician, typesetting enthusiast, gamer.
GNU Maintainer: wget, screen, teseq
http://micah.cowan.name/
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.7 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFIohiL7M8hyUobTrERApkmAJ9Ia9yvahBPtp0aJDZehKciEMc3vQCgjXSC
T9DYFPDUxtBEx6HvOnwBzos=
=MAXZ
-END PGP SIGNATURE-