Re: [Bug-wget] how to connect to HTPPS site with WGET
From: Matt Andel mattan...@quadax.com Tom Mizutani gombei1970 at gmail.com writes: Does anyone know of a way to connect to the HTTPS site and download the files with WGET. You missed the version of Wget and the platform on which you run Wget. Information about SSL (or TLS) library is also needed. Installation of the latest binary or making your own binary from the latest source package may help you. Hello Tom, I have version 1.11.4. I have downloaded 1.14 in the .tar.gz version but that in the wrong version. Where can I get a Windows version already compiled or to you have instruction on how to compile a version? thanks matt This is thanx to Alex Bykov who posted this URL as a response to me. https://dl.dropbox.com/u/27457022/wget_1.14.zip -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] GNU wget 1.14 released
From: Giuseppe Scrivano gscriv...@gnu.org Hello, I am pleased to announce the new version of GNU wget. It is available for download here: Fantastic! If it is compiled for Win32, please update this thread with a URL. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] How to Use WGET in Windows
From: MIKE MCDANIEL mikemc...@yahoo.com I may have caused serious problems to my computer. I tried following the directions below, and under âVariable Valueâ I deleted everything and then typed ;c:\Progs    Now I just read somewhere that if you DELETE anything from the Path, you can cause serious problems to your computer! Should I now restore my computer to an earlier time? I specifically stated append. What happened is why I suggested dropping it in a folder that is already in the PATH vs. creating a folder and and adding the added folder to the PATH. Performing a System Restore to a previous break point may be your only option as there is no way we can know what was in your PATH. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] wget on Windows 64-bit
From: Fred Holmes f...@his.com At 10:53 AM 6/13/2012, David H. Lipman wrote: WGET/32 works just fine under Win/64. I suggest just using the latest Windows version. I'm using; GNU Wget 1.13.4 built on mingw32. I've been running wget 1.11.4 just fine. Windows binary. I downloaded wget 1.13.4 from: http://code.google.com/p/osspack32/downloads/detail?name=wget.execan=2q= which link I found on Google. It doesn't work. It seems to flash some error message too quickly to read and exits. I presume I need a newer version of the ssl libaries?? The 1.13.4 manual (html file) doesn't seem to mention them explicitly, nor does the download site cited above. Explicitly, what libraries do I need to run wget 1.13.4? I did not remove my working wget 1.11.4 wget.exe file. I named the new wget as wget1134.exe and ran it that way. That should work. System is Windows 2000. Does wget 1.13.4 require a later system? Many thanks, Fred Holmes It is possible that Win2K it is no longer supported. I suggest using a WGET version that is older, but doesn't perform SSL, like v1.8. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] wget on Windows 64-bit
From: Fred Holmes f...@his.com David, What libraries/versions are you using (DLL filename, date/other identifier) are you using with wget 1.13.4? Thanks, I am using the WGET.EXE 1.13.4 but using the DLLs from Wget v1.13.1. I can upload them to my server, if that is allowable, just this one time. Didn't we discuss this, or something accross these lines, back in Sept. 2011 ? -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] How to Use WGET in Windows
From: MIKE MCDANIEL mikemc...@yahoo.com There is an article posted on eHow which is very helpful for beginners like me. The title of the article is How to Use WGET in Windows. Although helpful, I need some clarification regarding the article's instructions listed below. I use Windows-7. Step #5 says, The path command should return a result similar to c:\Windows\system32;c:\Windows. Then, step #6 seems to indicate that I should use one or the other of them (not both)...is that correct? Also, the path-command returns a result for me that contains the exact forementioned results, but ALSO returns at least 15 additional results! So what do I use? 1. Download and extract the Wget for Windows software from gnuwin32.sourceforge.net. 2. Click on All Programs in the Windows Start menu. 3. Click the Accessories option. 4. Click on the Command Prompt option to open a command prompt window. 5. Type path (without quotes) at the command prompt to ascertain the directory in which you should place the Wget.exe file so it will run with a single command.The path command should return a result similar to c:\Windows\system32; c:\Windows. 6. Copy the extracted wget.exe file to the Windows\system32 or Windows directory. The destination folder must be on the path command from Step 5. 7. Type wget -h at the command prompt to make sure the application can be executed. 8. Type wget -r http://site-to-download.com; at the command prompt to download the entire contents of the designated website. Replace site-to-download.com with the URL of the website that you want to download. The objective is to have WGET and dependent DLL files in the path. I prefer %WINDIR\% [ c:\windows ] Thus if you write a script that uses WGET or open a command prompt and manually use it, it will implicitly be executed. I also suggest using a WGETRC file which holds executable defaults. I use C:\wgetrc.txt and use the environmental variable; wgetrc point to; C:\wgetrc.txt [ wgetrc=C:\wgetrc.txt ] I also suggest reading the WGET Help file so you can get acquanted with all the switch parameters, syntax and use of the WGETRC file. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] wget on Windows 64-bit
From: John jw72...@verizon.net Hello. I want to use wget on a couple of the Windows machines on my home network. I would need it to run on 64-bit Win7 and 64-bit Windows 2008 Server Standard. Is there any compatible version already available for these or would I have to build it myself? I have openSSL for Windows 64-bit installed, and I do want to use wget with https as well. If it has to be built, have others had success doing so? I know this program has been around for a long time, but it seems like there is also a lot of various ideas concerning its use. Thanks. WGET/32 works just fine under Win/64. I suggest just using the latest Windows version. I'm using; GNU Wget 1.13.4 built on mingw32. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] How to Use WGET in Windows
From: MIKE MCDANIEL mikemc...@yahoo.com Thanks so much for ALL the responses. I've taken Angel's advice created a new folder entitled Progs Yet, I don't know where to put it, as I have the following 3 folders in my C-drive: Progs My Web Sites and Program Files (x86) The first 2 of these 3 folders are empty, and the 3rd one contains my GnuWin32 file. (I very recently downloaded GnuWin32 sed 4.2.1 but have not yet successfuly used it.) I might also need some information as to HOW to put the folder where I need it. Assuming; c:\progs Drop WGET and all dependent DLLs in that folder. Right-Click on Computer and choose Properties Advanced System Settings -- Environment variables Under System variables Find Path and choose Edit Append the string; ;c:\progs to Variable value NOTE: each item in the PATH must be separated by the ; delimeter. That's why you append ;c:\progs not c:\progs -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] Wget proxy issue on windows
From: Steven Smith stevensmith@gmail.com Hi, I've been trying to use wget with the internet at my school, where everything must go through a proxy. I can wait until I get home to get this file, but I don't see any reason why this error would be occuring. C:\Users\Stevnset http_proxy=http://proxy.cite.wa.edu.au:8080 wget http://android-x86.googlecode.com/files/android-x86-4.0-RC1-eeepc.iso--proxy=on SYSTEM_WGETRC = c:/progra~1/wget/etc/wgetrc syswgetrc = C:\Users\stevn\Downloads\GetGnuWin32\gnuwin32/etc/wgetrc Error parsing proxy URL http://proxy.cite.wa.edu.au:8080 : Bad port number. C:\Users\Stevn Any thoughts? Thanks. Create a WEGETRC.TXT file and store it in a place like C:\ and in the file WEGETRC.TXT have the entries http_proxy=http://proxy.cite.wa.edu.au:8080 use_proxy = on Do not use the SET command. That is only good for the present shell. Righ-Click My Computer -- properties -- advanced -- environment variables -- system variables -- new Variable name: WGETRC Variable value: C:\wgetrc.txt now just invoke wget http://android-x86.googlecode.com/files/android-x86-4.0-RC1-eeepc.iso or invoke a full command line wget --execute=http_proxy=http://proxy.cite.wa.edu.au:8080 http://android-x86.googlecode.com/files/android-x86-4.0-RC1-eeepc.iso -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] DLL conflict between wget and curl
From: Jeremy Nicoll - ml wget users jn.ml.wgt...@wingsandbeaks.org.uk Win-32 XP Pro SP3 A few hours ago I downloaded cURL, unpacked its zip, and moved the exe and necessary DLLs to the folder where I keep CLI programs. That is: curl.exe 659 KBV7.25.0.0 libcurl.dll 529 KBV7.25.0.0 libeay32.dll 1516 KBno version number libssl32.dll 345 KBno version number Then I moved on to do the same for wget. But the dependencies zip comes with 4 DLLs: libeay32.dll 1150 KBV0.9.8.8 libiconv2.dll 985 KBV1.12.2872.39125 libintl3.dll 101 KBV0.14.4.1952 libssl32.dll 228 KBV0.9.8.8 Clearly I can't put the libeay32 libssl32 DLLs supplied with wget into the same folder as the two that came with curl. And because Windows Explorer shows no version number info for the ones that came with curl, I don't know which ones are the more recent versions. Even if I did know that, I don't know whether it's good practice to keep each exe with the specific versions of DLLs it was shipped with (though I suspect that IS the best method) or whether one should just install the most recent version of each lib.dll and hope. If the DLLs need kept separately then it follows that neither set should be in a folder on PATH, and I suppose that neither curl.exe nor wget.exe should be either. Is the solution to this problem to put each app in its own folder and alway specify the path to the exe when I want to use it? Here's what I see in the problem... When an EXE makes a call to a DLL if it is in the same folder as the executable then it loads it. If it doesn't exist in that folder then it will attempt to load the DLL from the PATH. If the DLL is not found in the PATH the program will error out. This behaviour can be modified by a Registry tweak. The problem occurs when an EXE loads DEPENDENT.DLL version X and is now loaded in memory. Then a second application loads that wants the same DLL but expects version Y. Since the DLL is loaded in memory the second application loads without error. However since version X is loaded not version Y when the second application makes a call to a DLL function it does not return what is expcted and then second application either does not work correctly or it generates an error message. If it is a case where an EXE loads DEPENDENT.DLL version X and then exits, the DEPENDENT.DLL is unloaded. If it is a case where an EXE loads DEPENDENT.DLL version X and stays resident, then you may have problems. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] --trust-server-names
From: Ángel González keis...@gmail.com On 14/04/12 02:17, David H. Lipman wrote: I eat PDF Exploit files for breakfast. And how about a server that calls its malware .bashrc? Since it is a non standard named file, I will open it in FileInsight and examine the binary. If I don't recognize its format, I'll run the TrID plug-in and detrrmine its format. I will treat the file accordingly. .bashrc is the name of a file executed automatically by bash(1) on startup if present in the home folder. As such, that can lead to code execution. Not on Windows. Unless you use eg. msys I was explaining the vulnerability. If you feel you're safe, you can go with the option. We assume you'll be careful enough not to shoot yourself in the foot. And I apreciate that fact - Thanx! -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] --trust-server-names
From: Ángel González keis...@gmail.com On 13/04/12 00:26, David H. Lipman wrote: From: Micah Cowan mi...@cowan.name On 04/12/2012 03:13 PM, David H. Lipman wrote: I am downloading deliberately malware such that a download won't be called ActiveX-Patch but will be called flv_codec_pack_112_full.exe as the server intended. But please, tell me the risks. And how about a server that calls its malware .bashrc? Since it is a non standard named file, I will open it in FileInsight and examine the binary. If I don't recognize its format, I'll run the TrID plug-in and detrrmine its format. I will treat the file accordingly. .bashrc is the name of a file executed automatically by bash(1) on startup if present in the home folder. As such, that can lead to code execution. Not on Windows. If you're downloading the files interactively, so you could detect any filename which would be automatically run by another program, you should be safe. Alternatively, not downloading into the home folder (which is common both for running commands and for those config files), usually avoids that, too. See the CVE entry for more details. PS: There might be additional sources from unexpected execution, such as a pdf vulnerability being run by the pdf thumbnail viewer on the GUI... I eat PDF Exploit files for breakfast. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
[Bug-wget] --trust-server-names
Is it possible to add; --trust-server-names To the WGETRC file ? -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] --trust-server-names
From: David H. Lipman dlip...@verizon.net Is it possible to add; --trust-server-names To the WGETRC file ? Nevermind. It wasn't in the version of my documentation but the following worked... trust-server-names = on -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] --trust-server-names
From: Micah Cowan mi...@cowan.name On 04/12/2012 03:13 PM, David H. Lipman wrote: From: Ángel González keis...@gmail.com On 12/04/12 18:23, David H. Lipman wrote: From: David H. Lipman dlip...@verizon.net Is it possible to add; --trust-server-names To the WGETRC file ? Nevermind. It wasn't in the version of my documentation but the following worked... trust-server-names = on You're aware of the risks of downloading files with names controlled by the server, right? I am downloading deliberately malware such that a download won't be called ActiveX-Patch but will be called flv_codec_pack_112_full.exe as the server intended. But please, tell me the risks. And how about a server that calls its malware .bashrc? Since it is a non standard named file, I will open it in FileInsight and examine the binary. If I don't recognize its format, I'll run the TrID plug-in and detrrmine its format. I will treat the file accordingly. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] Windows 7 makes wget less intuitive
From: Zachariah Yoder zach_yo...@wycliffe.org Dear developers of WGET, Thank you for a useful tool. The operation is intuitive and easy to use. With the advent of Windows 7, however, users who save wget.exe in their program files directory will be confused as to where the files are saved. Could you add a line in the wget help directing users either to: C:\Users\USERNAME\AppData\Local\VirtualStore\Program Files (x86)\wget or to a web page that explains the problem? Even if you don't find this contribution helpful, thank you very much for a useful app! WGET is Windows is *best* used when WGET and depencencies are in the %PATH% and the use run WGET exither from a script wich indicates the folder in which the retrieved files are dropped or open a Command Prompt and manually go to the location of where you want the files dropped. There is NO reason why a utility such as WGET should be in Program Files since it is not a formally installed application. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] Windows 7 makes wget less intuitive
From: Paul Wratt paul.wr...@gmail.com this may have something to do with working directory which when an exe is run from a shortcut, uses the exe folder as the default path. Some testing on win7 is needed to clarify this issue, as that Program Files path is used for 32bit apps on 64bit installation.. If the command is NOT in the PATH then you have to be in the directory where the command exists and when you run the command it will drop the downloaded files there. When the command and dependencies are in the PATH then all I have to do is open a Command Prompt, type Y: and run a FQ WGET command and the file(s) ovtained will be in the Y: drive. I dion't think the behaviour is any different for Win64 vs. Win32. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] Windows 7 makes wget less intuitive
From: Henrik Holst henrik.ho...@millistream.com
Ah, having tread the whole thread... I now see that this is when running
wget from a desktop shortcut?
One would not run it from a shorcut unless you created a script that called
WGET.
Windows doesn't have a default folder per se. It is up to the application. An
application may query the Registry for the user's document directory. However,
this is a
utility and not an application that is compiled for multiple OS' and therefore
is not OS
dependent.
Thus there is no assumption of where downloaded files will reside and and will
depend upon
the utility when it is eecuted and will often default to the location of where
the utility
resides. Thus when the utility is in the PATH the user can be in any drive and
any folder
and then use WGET and will download to that POV.
Take a Windows BAT or CMD file and you would have...
@echo off
d:
cd d:\my dir\my folder
wget { command line }
Or
You would have to use the command line switch as Micah pointed out.
-P, --directory-prefix=PREFIX save files to PREFIX/...
--
Dave
Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk
http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] WARC, new version
From: Giuseppe Scrivano gscriv...@gnu.org I have seen WARC mentioned but have not seen a definition. What is WARC ? What is WARC used for ? Windows or 'nix ? What are its benefits, etc ? -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] WARC, new version
From: Gijs van Tulder gvtul...@gmail.com Hi David, David H. Lipman wrote: I have seen WARC mentioned but have not seen a definition. WARC (Web ARChive, ISO 28500:2009) [1] is a file format for storing web resources. It is used for making archives of web sites. The Internet Archive, for example, uses it as the file format for their Wayback Machine and Heritrix crawler. The nice thing about WARC is that it lets you store all information about your web crawl: the files you download, of course, but also things like the HTTP request and response headers, information about redirects and error pages. WARC also provides a place to keep the related metadata. It is, in short, a way to store everything, in a standardized file format. Adding WARC to wget means that you'll be able to do things like wget --mirror http://www.gnu.org/s/wget/ --warc-file=gnu which will produce (next to the normal wget download) a file named 'gnu.warc.gz' that contains every HTTP request and every HTTP response that wget made. This is a 'archival grade' copy of the mirrored site. Once you have the WARC file, you could store it in your archive, extract files, run your own local Wayback Machine [2, 3]. wget is already a very useful tool to make a quick copy of a website, adding WARC support helps to make the copy is as complete as possible. Maybe that answers some of your questions? Regards, Gijs [1] http://www.digitalpreservation.gov/formats/fdd/fdd000236.shtml [2] http://archive-access.sourceforge.net/projects/wayback/ [3] http://netpreserve.org/software/downloads.php It answers all the question and now I understand. *Thank You Gijs !* -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] --version copyright year stale
From: Karl Berry k...@freefriends.org Hi Giuseppe, The copyright year in the wget --version output should be 2011, not 2009. As seen in 1.13.4. k It is also in v1.13.1 Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://www.gnu.org/licenses/gpl.html. It could be because that is the date of Copyright and not the date of compilation. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] GNU wget 1.13.4 released
From: Fred Holmes f...@his.com I'm not a programmer, but have enjoyed _using_ wget for many years. The latest Windows binary that I find posted is 1.11.4 of several years ago. Would someone please post a current one? (One of the links to Windows binaries yields a 404 error.) Alternatively, would someone please post [a link to, or put it in the documentation] a recipe (manual script) for a non-programmer to compile a Windows binary for himself using a readily-available, inexpensive (free?) compiler? I have done some Visual Basic and VBA programming and am familiar with the VB IDE and VBA used for Microsoft Office macros. Many thanks, Fred Holmes Ray Satiro posted this on 8/24. It isn't the latest but it works well. http://sourceforge.net/projects/getgnuwin32/files/getgnuwin32/test%20builds/wget-1.13.1.patched.zip/download I'm sure a Windows v1.13.4 will get posted in due time. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] GNU wget 1.13.4 released
From: Voytek voy...@sbt.net.au On Sun, September 18, 2011 10:20 am, David H. Lipman wrote: From: Fred Holmes f...@his.com Ray Satiro posted this on 8/24. It isn't the latest but it works well. http://sourceforge.net/projects/getgnuwin32/files/getgnuwin32/test%20buil ds/wget-1.13.1.patched.zip/download I'm sure a Windows v1.13.4 will get posted in due time. dumb question, what's the best or proper way to 'integrate' this into a windoze XP, so it's a path for execution and obeys any options in etc/wgetrc ? There is no best practice. I drope the EXE and required DLLs in %windir% (so it is in the PATH) and create a; C:\wgetrc.txt file and set the WGETRC environemntal variable to point to it. WGETRC=C:\wgetrc.txt -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] GNU wget 1.13.3 released
From: Jamal Mazrui jamal.maz...@fcc.gov If someone compiles a Windows binary of the new version, I hope that information is shared on the list. Thanks, Jamal +1 -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] Download files and preserve their data and time
From: Ray Satiro raysat...@yahoo.com From: David H. Lipman dlip...@verizon.net Subject: Re: [Bug-wget] Download files and preserve their data and time To: bug-wget@gnu.org Date: Tuesday, August 23, 2011, 4:38 PM From: Giuseppe Scrivano gscriv...@gnu.org WinXP/Vista -- Win32 Y:\wget --version GNU Wget 1.12-2504 built on mingw32. the change introduced by the revision gscriv...@gnu.org-20110419103346-cctazi0zxt2770wt could be the reason of the problem you have reported. Calling utime() works. You could also use SetFileTime(). 2489 changed utime to utimes but the CRT doesn't have utimes. I recompiled 1.13.1 and patched for the http.c fixes from 2544 and 2541, and patched utils using the touch() prior to 2489 for WINDOWS. This is a test build and I uploaded it here: http://sourceforge.net/projects/getgnuwin32/files/getgnuwin32/test%20builds/wget-1.13.1.patched.zip/download I tried Giuseppe's example: wget -q -d http://www.gnu.org/graphics/gnu-head-mini.png 21 | grep ^Last-Mo Last-Modified: Sun, 05 Dec 2010 20:58:51 GMT dir /tw gnu-head-mini.png [...] 12/05/2010 03:58 PM 423 gnu-head-mini.png Also I notice the changes in 2533 require static openssl libs for testing checking for EVP_MD_CTX_init in -leay32... yes checking for SSL_connect in -lssl32... yes configure: Enabling support for SSL via OpenSSL (shared) checking for libssl... no configure: error: --with-ssl=openssl was given, but SSL is not available. I think regardless of whether libssl is there if eay32 and ssl32 are there then it should link to the dlls and not need to test ssl and crypto. Thanks AWESOME - Thanx ! I tried it and it worked as expected. The file had its server date and not the download date and time. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] Download files and preserve their data and time
From: Giuseppe Scrivano gscriv...@gnu.org
David H. Lipman dlip...@verizon.net writes:
I don't know when it happened, probably when I upgraded WGET, but when I
download files
thedy inherit the date and time of the file of when they were downloaded.
It used to be that when the file was downloaded, it retained the date and
time of the
file it had on the server. Not when it was downloaded.
How can I force WGET to return to that condition ?
it has to work in the same way as it used to do. It seems to work well
here, using the last revision from the source repository:
$ LANG=C ./wget -q -d http://www.gnu.org/graphics/gnu-head-mini.png 21 |
grep
^Last-Modified
Last-Modified: Sun, 05 Dec 2010 20:58:51 GMT
$ LANG=C stat gnu-head-mini.png | grep ^Modify
Modify: 2010-12-05 21:58:51.0 +0100
Can you please provide more information? What version of wget (wget
--version)? What operating system? Do you get a different output using
that two commands?
This is also useful for debugging, do you see something different?
$ LANG=C strace -e utimensat ./wget -q
http://www.gnu.org/graphics/gnu-head-mini.png
utimensat(4, NULL, {{1313833704, 0}, {1291582731, 0}}, 0) = 0
Thanks,
Giuseppe
WinXP/Vista -- Win32
Y:\wget --version
GNU Wget 1.12-2504 built on mingw32.
+digest +https +ipv6 +iri -large-file +nls -ntlm +opie +ssl/openssl
Wgetrc:
C:\wgetrc.txt (env)
c:/wget/root/etc/wgetrc (system)
Locale: c:/wget/root/share/locale
Compile: gcc -DHAVE_CONFIG_H -DSYSTEM_WGETRC=/c/wget/root/etc/wgetrc
-DLOCALEDIR=/c/wget/root/share/locale -I. -I../lib -I../lib
-I/c/wget/root/include -I/c/wget/root/include -O2 -Wall
Link: gcc -O2 -Wall -L/c/wget/root/lib /c/wget/root/lib/libiconv.dll.a
/c/wget/root/lib/libintl.dll.a -L/mingw/lib
/c/wget/root/lib/libiconv.dll.a -lssl32 -leay32 -lz -lws2_32 -lidn
ftp-opie.o mswindows.o openssl.o ../lib/libgnu.a
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
http://www.gnu.org/licenses/gpl.html.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Originally written by Hrvoje Niksic hnik...@xemacs.org.
Please send bug reports and questions to bug-wget@gnu.org.
--
Dave
Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk
http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] Download files and preserve their data and time
From: Giuseppe Scrivano gscriv...@gnu.org David H. Lipman dlip...@verizon.net writes: WinXP/Vista -- Win32 Y:\wget --version GNU Wget 1.12-2504 built on mingw32. the change introduced by the revision gscriv...@gnu.org-20110419103346-cctazi0zxt2770wt could be the reason of the problem you have reported. If it is possible for you to compile wget, could you try to revert this patch? Does it solve the problem for you? If you have problems to re-build wget then I'll try to setup the environment here. Thank you but, not possible. I hung my hat on MASM and compiling loong ago. -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
[Bug-wget] Download files and preserve their data and time
I don't know when it happened, probably when I upgraded WGET, but when I download files thedy inherit the date and time of the file of when they were downloaded. It used to be that when the file was downloaded, it retained the date and time of the file it had on the server. Not when it was downloaded. How can I force WGET to return to that condition ? -- Dave Multi-AV Scanning Tool - http://multi-av.thespykiller.co.uk http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] wget without http
From: Erwin Panen erwin.pa...@imapmail.org Hi, I'm looking for a solution to create a mirror from a networked drive containing some course ware. We only have http access. We access using a browser like this: file:///G:/your%20education/coursedir/indexpage.htm As far as I know wget will only accept http://adres Is there any way to make it accept file:///G:/your%20education/coursedir/indexpage.htm or disguise this URL? Using parenthesis? Thanks for your help! Erwin If you are using Mapped Drives, there is NO NEED to use WGET as there are plenty of OS utilities from XXCOPY to RoboCopy. -- Dave Multi-AV Scanning Tool - http://www.pctipp.ch/downloads/dl/35905.asp
Re: [Bug-wget] wget to a folder
From: Giuseppe Scrivano gscriv...@gnu.org Michele Prendin mich...@micheleprendin.com writes: Thanks Giuseppe for the help, i fixed the issues upgrading wget (you udate wget( despite now i can save in the folder i want, i have another issue with the older wget when i was using wget www.google.com/popupfile.php the phpfile forwarded the file to be downloaded with the header (if the file forwarded was abc.gz, wget were able to store /abc.gz) with the new wget the download works, but instead of saving it with the name abc.gz he uses popupfile.php any solution to this? i couldnt find anything useful from the -help You should specify: --trust-server-names. You can find the reason why we have added it here: http://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2010-2252 Giuseppe It would be nice if I could FIND v1.12 compiled for Win32 :-( -- Dave Multi-AV Scanning Tool - http://www.pctipp.ch/downloads/dl/35905.asp
[Bug-wget] Re: Problem with WGET
From: James K Lewis ocnp...@hawaii.rr.com I have utilized wget for several years to ftp data to my computer to force ocean circulation models. I recently installed the CA Security software, replacing Norton 360. The software that executes the calls to wget has now started running somewhat unusually. I begin the software, it in turn begins making a number of calls to wget to download files via ftp. The strange part is that in some cases (not always), wget downloads and stores the files but doesn't stop executing (I can still see it in the Windows Task Manager, but using no CPU time). My software in which the calls to wget are imbedded then hangs. When I highlight wget in the Task Manager and click on End Process, the software then continues to execute. I have run tests in which I executed the software several times within 5 minutes, and the wget hang-ups DO NOT occur when ftp'ing the same files. It appears to hangup at random calls to wget. Is there a way from the inputs in the command line to wget to force itself to end? Something like waiting for 20 s and then forcing wget to end? CA Security software is most like Computer Associates' suite and thus comes with a FireWall application module and you need to do 1 or 2 things. Indicate WGET.EXE is safe and makes sure you allow FTP traffic. -- Dave Multi-AV Scanning Tool - http://www.pctipp.ch/downloads/dl/35905.asp
[Bug-wget] Re: Wget and Sharepoint
From: Noor Potrus noorpotrus1...@pointloma.edu | To whom this may concern, | My company has an internal sharepoint sever that we use for our intranet. I | am trying to use Wget to retrieve files from some sharepoint sites that we | have on our server, but I cannot figure out how to allow authorization. I | keep getting the 401 Unauthorized error. | I've tried using proxy-user= and proxy-password= | Doesn't seem to work... | Any suggestions or help? | Thanks so much for your time! Is there a reason why you have not returned to the thread you started ? -- Dave Multi-AV Scanning Tool - http://www.pctipp.ch/downloads/dl/35905.asp
[Bug-wget] Re: wget generates warning from McAfee
From: Andreas Moroder andreas.moro...@sb-brixen.it | Hello, | on our PCs we have this small scripts | c:\prog\bin\wget -Nnv ftp://svc-ftpticket/ticket/download/* | that downloads from a server to the PC the contents of a directory when | the content of the source is newer. | Sometimes on the client our McAfee antivirus systems generates a warning | telling us, that wget tries to connect to our server using the port 666x | ( where x i 6, 7 or 8 ). | Can anyone please tell why wget uses this ports and how I can stop this | ? Why does it happen only sometimes ? | Thanks | Andreas Sounds like McAfee is flagging the TCP data at port ~ 6668 as possible IRC communications. Many BOTS use IRC for C2. I think SubSeven uses a port in that range. -- Dave http://www.claymania.com/removal-trojan-adware.html Multi-AV - http://www.pctipp.ch/downloads/dl/35905.asp
[Bug-wget] Re: Issue with URL in Windows
From: Ben Smith benjamin_r_sm...@yahoo.com | That did seem to fix the URL problem; however, it appears that the username/password | isn't working right. I'm trying to download from my TiVo. Is it really an | authentication problem or is it something else? See pasted text below (I have deleted | the password [MAK] to comply with legal issues). I've inserted line feeds between lines | for reading purposes (and word wrap). | C:\Documents and Settings\smithben\My Documents\tivo_nontransferwget --user=tivo | --password=## --output-document=CFBL (Rec 08-Jun-09).tivo | http://192.168.0.51/download/College%20Football%20Live.TiVo?Container=%2FNowPlayingid= | 1650544Format=video/x-tivo-mpeg | SYSTEM_WGETRC = c:/progra~1/wget/etc/wgetrc | syswgetrc = C:\Program Files\GnuWin32/etc/wgetrc | --2009-06-09 15:37:50-- | http://192.168.0.51/download/College%20Football%20Live.TiVo?Container=%2FNowPlayingid= | 1650544Format=video/x-tivo-mpeg | Connecting to 192.168.0.51:80... connected. | HTTP request sent, awaiting response... 401 Authorization Required | Reusing existing connection to 192.168.0.51:80. | HTTP request sent, awaiting response... 400 Bad Request | 2009-06-09 15:37:50 ERROR 400: Bad Request. | Thanks, | Ben Do you have special characters in the password ? Example: % and @ -- Dave http://www.claymania.com/removal-trojan-adware.html Multi-AV - http://www.pctipp.ch/downloads/dl/35905.asp
[Bug-wget] Re: WGet Help
From: Joel not12lis...@gmail.com | I am trying to automate a file download, but the filename changes every time there is an update. I have attempted to use a wildcard * to make this easier, but I am getting an error. Below is the situation: current file name: http://download.avg.com/filedir/inst/avg_ipw_stf_all_85_339a1525.exe my download attempt: C:\wgetwget http://download.avg.com/filedir/inst/avg_ipw_stf_*.exe --15::55:30-- http://download.avg.com:80/filedir/inst/avg_ipw_stf_%2A.exe | = `avg_ipw_s...@.exe' Connecting to download.avg.com:80... connected! HTTP request sent, awaiting response... 404 Not Found 15::55:31 ERROR 404: Not Found. | Please let me know if I am doing something incorrectly. If not, would it be possible to look into this? Thanks! - Joel - You can't use wildcards with HTTP, only FTP I wish it could. It would make harvesting malware easier to collect. What you can do is what I do in my Multi AV Scanning Tool which uses the KiXtart scripting language and the WGET utility. Example 1: -- McAfee uses what is called the SuperDAT. This is an EXE file that contains the the McAfee command line scanner engine and signature files. A new EXE is posted daily and its version number is incremented either daily of if there is a new, hot virus. Today that file is; sdat5636.exe Tomorrow that file may be; sdat5637.exe What I do is parse a known file, UPDATE.INI, that will have the latest version number and extract that version number. From that I can get the URL and then pass the URL (FTP or HTTP) to WGET and download the file. Example 2: -- Trend Micro has the Sysclean utility and packages the signatures for Sysclean in a ZIP file. That ZIP file has a version number associated with it and the version number is incremented as new signatures are released. What I do is use WGET to download the web page; www.trendmicro.com/download/viruspattern.asp and save it in a text file. I then pase the text file for the version number. Actual snippet... shell c:\AV-CLS\wget http://www.trendmicro.com/download/viruspattern.asp; copy viruspattern.asp pattern.txt del viruspattern.asp $SearchString=the latest pattern file number IF Open(1,pattern.txt,2)=0 $x= cls $x=ReadLine(1) WHILE @ERROR=0 $x=ReadLine(1) if (INSTR($x,$SearchString))0 $PatternFile=$x $PatternFileNumber=SUBSTR($PatternFile,val(INSTR($x,$SearchString))+len($SearchString)+9,3) $PatternFile1=lpt+$PatternFileNumber+.zip endif LOOP Close(1) del pattern.txt The result will be the variable; $PatternFile1 will be the name of the file needed to be downloaded. I then call... shell c:\AV-CLS\wget http://www.trendmicro.com/ftp/products/pattern/+$PatternFile1 -- Dave http://www.claymania.com/removal-trojan-adware.html Multi-AV - http://www.pctipp.ch/downloads/dl/35905.asp
