Website Port problem...
Hi, I have a problem on using wget, as follows: I want to download a bunch of files in, say, www.server.com/dir/files, and I found out that wget is contacting www.server.com:80, and the files it get is not what I'm looking for. I typed www.server.com:80/dir/files in netscape and found out that the result I get is different from www.server.com/dir/files! So how can I get the files? Thx! DrDave - Sign up for ICQmail at http://www.icq.com/icqmail/signup.html
Re: wget1.7.1: Compilation Error (please Cc'ed to me :-)
On Wed, 28 Nov 2001, Ian Abbott wrote: However, the Linux man page for bcopy(3) do not say the strings can overlap and in fact suggest that it be replaced with memcpy in new programs! Linux has memmove so that does not matter, but perhaps rolling our own memmove as Daniel suggested would be the safest option. Another difference between bcopy() and memmove() is that bcopy() returns void whereas memmove returns a pointer, but in the one place in the Wget source where memmove() is called, the return value is not used. Presumably the man page is incorrect or at least unclear as Linux even in the pre-glibc-2.0 days always used a glibc derivative and here is what glibc's info page on bcopy states: - Function: void bcopy (const void *FROM, void *TO, size_t SIZE) This is a partially obsolete alternative for `memmove', derived from BSD. Note that it is not quite equivalent to `memmove', because the arguments are not in the same order and there is no return value. The best way to verify is to look at the libc 4/5 implementation. -- + Maciej W. Rozycki, Technical University of Gdansk, Poland + +--+ +e-mail: [EMAIL PROTECTED], PGP key available+
RE: progress bar, dot style
giga is not yet documented :-) Heiko -- -- PREVINET S.p.A.[EMAIL PROTECTED] -- Via Ferretto, 1ph x39-041-5907073 -- I-31021 Mogliano V.to (TV) fax x39-041-5907087 -- ITALY -Original Message- From: Hrvoje Niksic [mailto:[EMAIL PROTECTED]] Sent: Wednesday, November 28, 2001 6:18 PM To: Wget List Subject: Re: progress bar, dot style Herold Heiko [EMAIL PROTECTED] writes: There seems (looking at the docs) no way to say use bar; in case of fallback to dot, use style X - it will fallback to 1K dots always. This should work now. This is how it should work now, assuming no additional wgetrc customization: $ wget URL ... download URL, use progress bar ... $ wget -o log URL ... download URL, use 1k dots ... $ wget -o log URL --dot-style=giga ... download URL, use 1M dots ... but: $ wget URL --dot-style=giga ... download using the progress bar, because dot-style no longer affects the choice of progress indicator ...
windows patch and problem
The enclosed patch makes wget compile and work for windows. Changelog: * various missing files added in windows Makefiles; * config.h.ms, mswindows.h: defined HAVE_ISATTY, use _isatty for MS VC; somebody with Borland compiler please check and provide patch if possible; * cmpt.c: provided usleep somewhat-emulation Update: the above statement was true for the cvs sources of two (three?) days ago; with the current ones I consistently get something like this: D:\Wip\Wget\wget.wip\src\t..\wget -d -v -l1 http://www.cnn.com DEBUG output created by Wget 1.8-dev on Windows. --12:27:22-- http://www.cnn.com/ = `www.cnn.com/index.html' Resolving www.cnn.com... done. Caching www.cnn.com = 207.25.71.5 207.25.71.20 207.25.71.25 207.25.71.27 207.25.71.28 207.25.71.29 Releasing 008D01B0 (new refcount 1). Retrying. --12:27:24-- http://www.cnn.com/ (try: 2) = `www.cnn.com/index.html' Found www.cnn.com in host_name_addresses_map (008D01B0) Releasing 008D01B0 (new refcount 1). Retrying. --12:27:26-- http://www.cnn.com/ (try: 3) = `www.cnn.com/index.html' Found www.cnn.com in host_name_addresses_map (008D01B0) Releasing 008D01B0 (new refcount 1). Retrying. (ecc.) Same with other hosts Could somebody please confirm if this is a problem with my build ? Heiko -- -- PREVINET S.p.A.[EMAIL PROTECTED] -- Via Ferretto, 1ph x39-041-5907073 -- I-31021 Mogliano V.to (TV) fax x39-041-5907087 -- ITALY 20011129-2.diff Description: Binary data
Re: wget1.7.1: Compilation Error (please Cc'ed to me :-)
On Thu, 29 Nov 2001, Maciej W. Rozycki wrote: On Wed, 28 Nov 2001, Ian Abbott wrote: However, the Linux man page for bcopy(3) do not say the strings can overlap Presumably the man page is incorrect Well, can we actually guarantee that bcopy() will work on all platforms where memmove() is not present? I wouldn't be so bold to say that. I'd vote for a separate implemenation. But that's just me. -- Daniel Stenberg - http://daniel.haxx.se - +46-705-44 31 77 ech`echo xiun|tr nu oc|sed 'sx\([sx]\)\([xoi]\)xo un\2\1 is xg'`ol
Re: windows patch and problem
On 29 Nov 2001 at 12:48, Herold Heiko wrote: --12:27:26-- http://www.cnn.com/ (try: 3) = `www.cnn.com/index.html' Found www.cnn.com in host_name_addresses_map (008D01B0) Releasing 008D01B0 (new refcount 1). Retrying. (ecc.) Same with other hosts Could somebody please confirm if this is a problem with my build ? No, it happens on my Linux build too. Something broke.
Re: wget1.7.1: Compilation Error (please Cc'ed to me :-)
On 29 Nov 2001 at 13:14, Daniel Stenberg wrote: On Thu, 29 Nov 2001, Maciej W. Rozycki wrote: On Wed, 28 Nov 2001, Ian Abbott wrote: However, the Linux man page for bcopy(3) do not say the strings can overlap Presumably the man page is incorrect Yes, I think so. Well, can we actually guarantee that bcopy() will work on all platforms where memmove() is not present? HAVE_BCOPY? I wouldn't be so bold to say that. I'd vote for a separate implemenation. But that's just me. That's the easiest thing to do. It's only used at the moment for removing duplicate outgoing cookies. I don't know how often you get duplicate cookies, and the current mechanism for removing them isn't all that efficient when there are multiple duplicates to be removed anyway!
Re: wget1.7.1: Compilation Error (please Cc'ed to me :-)
Ian Abbott [EMAIL PROTECTED] writes: Thanks for the suggestion and the code example. Two points, though: * Isn't it weird that the undefined symbol is _memmove, not memmove? It looks as if a header file is translating the symbol, thinking that _memmove exists. Not really. UNIX C compilers of old prefix C external symbols with '_'. GCC doesn't do that unless targetted for a system that uses the prefix in its standard system library symbols. Thanks for the info. Obviously, it's been some time since I worked on a real Unix, other than Solaris. #ifndef HAVE_MEMMOVE # define memmove(to, from, len) bcopy(from, to, len) #endif That ought to work as the SunOS and BSD man pages say that the strings can overlap. Ok, that's the info I needed.
Re: wget1.7.1: Compilation Error (please Cc'ed to me :-)
On Thu, 29 Nov 2001, Daniel Stenberg wrote: Well, can we actually guarantee that bcopy() will work on all platforms where memmove() is not present? We can't guarantee but we can test it. I wouldn't be so bold to say that. I'd vote for a separate implemenation. But that's just me. That might be a fallback. A library's bcopy() may be significantly faster due to low-level tricks. -- + Maciej W. Rozycki, Technical University of Gdansk, Poland + +--+ +e-mail: [EMAIL PROTECTED], PGP key available+
Re: wget1.7.1: Compilation Error (please Cc'ed to me :-)
Daniel Stenberg [EMAIL PROTECTED] writes: On Thu, 29 Nov 2001, Maciej W. Rozycki wrote: On Wed, 28 Nov 2001, Ian Abbott wrote: However, the Linux man page for bcopy(3) do not say the strings can overlap Presumably the man page is incorrect Well, can we actually guarantee that bcopy() will work on all platforms where memmove() is not present? The question is, do we need such a guarantee? bcopy() doesn't come out of nowhere, it's a BSD thing. If the original BSD man pages claimed it to be overlapping-block-safe, that's good enough for me. Ian, can you clarify what you meant by BSD man pages? Which BSD?
Re: Website Port problem...
David [EMAIL PROTECTED] writes: I have a problem on using wget, as follows: What version of Wget are you using? I want to download a bunch of files in, say, www.server.com/dir/files, and I found out that wget is contacting www.server.com:80, and the files it get is not what I'm looking for. I believe this has been fixed in later versions of Wget.
Re: suggestion
Jerome Lapous [EMAIL PROTECTED] writes: One option that can be interesting is to print the donwload result on standard output instead of a file. It would avoid rights problem when the same shell is used by multiple users. Have you tried `-q -O -'?
Re: progress bar, dot style
Herold Heiko [EMAIL PROTECTED] writes: giga is not yet documented :-) It never was. Maybe it should use 10M dots?
RE: windows patch and problem
Ok, fine. But, in order to avoid misunderstanding, wouldn't it be better to have a wrapper function (msleep ?) and use that where really millisecond granularity is desired ? Otherwise sooner or later somebody could use usleep where really microsecond granularity is desired, with undesiderabile results on some platforms wher only millisecond granularity is available (currently windows only, ok, but still... from a clean code point of view...) The --limit-rate seems to work correctly on windows with this patch, except obviously when the general sleep approach is too far from optimal, for example a fast connection and a very low rate. What I mean is, while testing that I found (like expected) with a ~ 30kb/sec connection to the server and a --limit-rate=100 wget would read a whole buffer, sleep for several seconds, read another full buffer and so on; Mean bandwidth used was correctly around 100 bytes/sec, but a bandwidth monitor showed lots of high spikes separated by pauses. It would be interesting experimenting with something like that while on the same pipe some or several other high bandwidth transfers are occuring. Wasn't there some time ago a bandwidth patch floating around which played with window sizes instead of pausing ? Probably more correct but less portable :( Heiko -- -- PREVINET S.p.A.[EMAIL PROTECTED] -- Via Ferretto, 1ph x39-041-5907073 -- I-31021 Mogliano V.to (TV) fax x39-041-5907087 -- ITALY -Original Message- From: Hrvoje Niksic [mailto:[EMAIL PROTECTED]] Sent: Thursday, November 29, 2001 3:09 PM To: Wget List Subject: Re: windows patch and problem Herold Heiko [EMAIL PROTECTED] writes: * cmpt.c: provided usleep somewhat-emulation Note that your emulation is perfectly fine not only because usleep() is currently called with multiples of thousand, but also because Wget doesn't *really* depend on microsecond granularity of usleep, because it's not there. A good test for your usleep() is to see whether --limit-rate works. Thanks for the patch; I'm about to apply it.
Re: windows patch and problem
Herold Heiko [EMAIL PROTECTED] writes: Ok, fine. But, in order to avoid misunderstanding, wouldn't it be better to have a wrapper function (msleep ?) and use that where really millisecond granularity is desired ? Otherwise sooner or later somebody could use usleep where really microsecond granularity is desired, IMO anyone who calls usleep() and expects perfect microsecond granularity deserves what he gets. Wget is certainly not, so using usleep is fine. I agre that msleep would make more sense with how Wget is using it, but usleep() was already there, so I used that. There's also a nanosleep, but I really hate filling out a structure just to sleep. The other thing is, I really dislike having application-specific wrappers for *all* OS functionality. I know most big applications take that route, but it doesn't mean it's necessarily a good thing. What I mean is, while testing that I found (like expected) with a ~ 30kb/sec connection to the server and a --limit-rate=100 wget would read a whole buffer, sleep for several seconds, read another full buffer and so on Yes; that's supposed to happen. I don't think we can do much about it in a portable fashion. Besides, is it ever useful to limit the bandwidth to 100 bytes/s? Even people with 56kbps modems limit to 2 or 3 k. Wasn't there some time ago a bandwidth patch floating around which played with window sizes instead of pausing ? I don't think so. There was a time when I examined the bandwidth-limiting patches, and I couldn't find any that did that. They were just sleeping, and most of them incorrectly.
The Latest Web Technologies 29301
I noticed your email address on a list serve related to technology and web development. With your permission, we would like to send you information regarding new web tools and utilities based on your interests. Please click the following link and opt-in to our product updates and e-newsletter, click here Cordially, Victor Black
RE: windows patch and problem
It does. Heiko -- -- PREVINET S.p.A.[EMAIL PROTECTED] -- Via Ferretto, 1ph x39-041-5907073 -- I-31021 Mogliano V.to (TV) fax x39-041-5907087 -- ITALY -Original Message- From: Hrvoje Niksic [mailto:[EMAIL PROTECTED]] Sent: Thursday, November 29, 2001 3:06 PM To: Wget List Subject: Re: windows patch and problem Ian Abbott [EMAIL PROTECTED] writes: On 29 Nov 2001 at 12:48, Herold Heiko wrote: --12:27:26-- http://www.cnn.com/ (try: 3) = `www.cnn.com/index.html' Found www.cnn.com in host_name_addresses_map (008D01B0) Releasing 008D01B0 (new refcount 1). Retrying. (ecc.) Same with other hosts Could somebody please confirm if this is a problem with my build ? No, it happens on my Linux build too. Something broke. I discovered a bug. Does this patch help: 2001-11-29 Hrvoje Niksic [EMAIL PROTECTED] * host.c (address_list_new): Initialize al-faulty. Index: host.c === RCS file: /pack/anoncvs/wget/src/host.c,v retrieving revision 1.21 diff -u -r1.21 host.c --- host.c 2001/11/27 14:55:40 1.21 +++ host.c 2001/11/29 14:05:07 @@ -141,6 +141,7 @@ ++count; assert (count 0); al-count= count; + al-faulty = 0; al-buffer = xmalloc (count * IP4_ADDRESS_LENGTH); al-refcount = 1;
The Latest Web Technologies 30372
I noticed your email address on a list serve related to technology and web development. With your permission, we would like to send you information regarding new web tools and utilities based on your interests. Please click the following link and opt-in to our product updates and e-newsletter, click here Cordially, Victor Black
Re: wget1.7.1: Compilation Error (please Cc'ed to me :-)
On 29 Nov 2001 at 14:40, Hrvoje Niksic wrote: Ian, can you clarify what you meant by BSD man pages? Which BSD? NetBSD: http://www.tac.eu.org/cgi-bin/man-cgi?bcopy+3 OpenBSD: http://www.openbsd.org/cgi-bin/man.cgi?query=bcopysektion=3 FreeBSD: http://www.freebsd.org/cgi/man.cgi?query=bcopysektion=3 Those are all pretty much identical and say that the strings can overlap and that a bcopy function appeared in BSD4.2. SunOS 4.1.3: http://www.freebsd.org/cgi/man.cgi?query=bcopysektion=3manpath=SunOS+4.1.3 That one aliases SunOS 4.1.3's bstring(3) man page which describes a group of related functions (including bcopy). It also says the strings can overlap.
Windows binary, ssl problem
New windows binary and almost-current cvs sources up at http://space.tin.it/computer/hherold . On the other hand I just discovered the current cvs sources won't compile with ssl anymore, cl /I. /DWINDOWS /D_CONSOLE /DHAVE_CONFIG_H /DSYSTEM_WGETRC=\wgetrc\ /DHAVE_SSL /nologo /MT /W0 /O2 /c gen_sslfunc.c gen_sslfunc.c gen_sslfunc.c(53) : error C2065: 'pid_t' : undeclared identifier gen_sslfunc.c(53) : error C2146: syntax error : missing ';' before identifier 'pid' gen_sslfunc.c(53) : error C2065: 'pid' : undeclared identifier gen_sslfunc.c(54) : error C2143: syntax error : missing ';' before 'type' gen_sslfunc.c(69) : error C2065: 'seed' : undeclared identifier gen_sslfunc.c(75) : error C2065: 'l' : undeclared identifier NMAKE : fatal error U1077: 'cl' : return code '0x2' Stop. NMAKE : fatal error U1077: 'E:\Programmi\Microsoft Visual Studio\VC98\Bin\NMAKE.EXE' : return code '0x2' Grr Grr Grr. No more time for now, any help is welcome. Bye Heiko -- -- PREVINET S.p.A.[EMAIL PROTECTED] -- Via Ferretto, 1ph x39-041-5907073 -- I-31021 Mogliano V.to (TV) fax x39-041-5907087 -- ITALY
egd Support(untestet) and fix for windows ssl error
Hi! Well, here is the promised egd support(we'll probably have to exchange the whole PRNG initializationwith something more pretty later on(I would like to implement another switch for supplying an own random-data file...). I can't test it since I don't have access to machines withboth openssl and egd. The windows compile problem was easy to fix (windows doesn't know about pid_t). Regards Christian
egd support (attachment)
well, i forgot the attachment *doh* egd-win.diff Description: Binary data
ÀÚ·áÀÔ´Ï´Ù
¾È³çÇϼ¼¿ä ¸ÕÀú Çã¶ô¾øÀÌ ¸ÞÀϵå·Á Á˼ÛÇÕ´Ï´Ù.. ºÒÇÊ¿äÇϽźеéÀº »èÁ¦Çϼ¼¿ä ÃÖ½ÅCDÀ» Àú·ÅÇÑ°¡°Ý¿¡ ÆǸÅÇÕ´Ï´Ù ÃֽŰÔÀÓ.À¯Æ¿ÇÁ·Î±×·¥.±×·¡ÇÈ.¸ÖƼ¹Ìµð¾î.ijµå.±³À°¿ë. VCD.µî ¿©·¯ºÐµéÀÌ ÇÊ¿ä·ÎÇϽô ½ÃµðÀ» ´Ù·®º¸À¯ÇÏ°í ÀÖ½À´Ï´Ù ½Å¿ëÀº ¹°·Ð 100ÇÁ·Î ¹ÏÀ¸¼Åµµ µË´Ï´Ù ÷ºÎµÈ ÈÀÏ(cd list. zip)À» ´Ù¿î¹ÞÀ¸½ÅÈÄ¿¡ µð½ºÅ©¿¡ ÀúÀåÇϽÅÈÄ ¾ÐÃàÀ»Ç®°í »ìÆ캸½Ê½Ã¿ä. ¹Ï°í °Å·¡ÇÏ½Ã¸é ¸¸Á·ÇϽǰ̴ϴ٠== º¸³Ê½ºCDµµ µå¸³´Ï´Ù = Âü°í·Î ÀÌ ¸ÞÀÏÀ» º¸³½ ¾ÆÀ̵ð·Î´Â ¿¬¶ôÀÌ µÇÁö ¾Ê½À´Ï´Ù.[÷ºÎÈÀϾȿ¡¿¬¶ôóÀÖ½À´Ï´Ù] ´Ù½ÃÇѹø ¸ÞÀϵ帰°Å »ç°úµå¸®¸ç ¿©·¯ºÐÀÇ ¾ÆÀ̵ð´Â ¹«ÀÛÀ§·Î ÂøÃâÇÑ°ÍÀÌ°í ¸ÞÀÏ ¹ß¼ÛÇÁ·Î±×·¥ÀÌ ¹«ÀÛÀ§·Î ¹ß¼ÛÀ» ÇÏ´Ùº¸´Ï º»ÀÇ¾Æ´Ï°Ô 2-3Â÷·Ê ¹ß¼ÛµÇ´Â °æ¿ì°¡ ÀÖ½À´Ï´Ù. ÀÌÇØÇÏ½Ã°í ±×³É »èÁ¦ÇØÁÖ½Ã¸é °¨»çÇÏ°Ú½À´Ï´Ù Next Entertainment, LYCOS === Áñ°ÌÁö ¾ÊÀ¸¸é ÀÎÅͳÝÀÌ ¾Æ´Õ´Ï´Ù!! http://www.lycos.co.kr 1:1 ÀüÈ»ó´ã! 060-703-3384 - ¶óÀÌÄÚ½º ¿î¼¼»ó´ã(http://arsluck.lycos.co.kr) ÀºÇà,Ä«µå,Áõ±Ç...ÅëÇÕ°ü¸®! - ¶óÀÌÄÚ½º ±ÝÀ¶¼¾ÅÍ(http://finance.lycos.co.kr) cd list.zip Description: Binary data
Re: Website Port problem...
The version I'm using is 1.7.1 On Thu, 29 November 2001, Hrvoje Niksic wrote: David [EMAIL PROTECTED] writes: I have a problem on using wget, as follows: What version of Wget are you using? I want to download a bunch of files in, say, www.server.com/dir/files, and I found out that wget is contacting www.server.com:80, and the files it get is not what I'm looking for. I believe this has been fixed in later versions of Wget. - Sign up for ICQmail at http://www.icq.com/icqmail/signup.html
Re: The Latest Web Technologies 29301
I dont agree. Please stop your sendings !! On Thu, 29 Nov 2001 [EMAIL PROTECTED] wrote: I noticed your email address on a list serve related to technology and web development. With your permission, we would like to send you information regarding new web tools and utilities based on your interests. Please click the following link and opt-in to our product updates and e-newsletter, click here Cordially, Victor Black -- __ NAME: Andrei E. Chevel (Shevel) : EMAIL: [EMAIL PROTECTED]\ Computing Systems Department: http://www.pnpi.spb.ru/CSD| TEL : +7(81271)36040 | POST ADDRESS: Petersburg Nuclear Physics Instute | FAX : +7(81271)46256 | 188300, Gatchina, Leningrad district, Russia.| __+7(81271)46350_| /
Re: Website Port problem...
David [EMAIL PROTECTED] writes: The version I'm using is 1.7.1 That's strange, then. What would you want Wget to contact if not www.server.com:80 when you specify www.server.com? 80 is the default TCP port for HTTP transfers.
Re: egd support (attachment)
Christian Fraenkel [EMAIL PROTECTED] writes: well, i forgot the attachment *doh* But you still forgot the ChangeLog. :-) I used this: 2001-11-30 Christian Fraenkel [EMAIL PROTECTED] * init.c: New command `ssl_egd_sock'. * main.c (main): New option `--sslegdsock'. * gen_sslfunc.c (ssl_init_prng): Seed the RNG using EGD. Thanks for the patch; I've applied it to CVS.
