Re: Meaning of --timeout

Hi, --timeout is explained in `man wget`. In short: it doesn't stop wget after N seconds - it's a shortcut for setting --dns-timeout + --connect-timeout + --read-timeout. For such tasks you can easily use the `timeout` command from GNU coreutils. Regards, Tim On 08.08.20 21:05, Peng Yu wrote:

Re: [PATCH] Support for tag

Hi YX Hao! Thanks for incorporating my fix. Just for safe, I attached my patch onto the other mail thread. Yes next time I will send a patch as an attachement ... my bad, I am not used to the ML yet. Thanks! Best Regards, Sho 2020年7月27日(月) 19:56 YX Hao : > > Hi Sho Amano, > > > > You’d better

Re: [PATCH] Support for tag

Hi Tim! Thanks for your reply. Yes sure, please find it attached. I created it against latest `master` branch so I hope it works now. Best Regards, Sho 2020年7月26日(日) 20:52 Tim Rühsen : > > Ah, sorry, just saw this email with your patch :-) > > Could you attach your patch as attachment. Git

Re: test wget_options_fuzzer seems never pass

Opps! It's definitely not the patch for the titled issue. I'm just replying Tim's words that planning v1.21 release ~ And the patch you concern only affects my newly added WinTLS wrapper (on my own branch), but not OpenSSL. @Gisle Vanem To make it clear, I have amended the commit title to

Re: test wget_options_fuzzer seems never pass

YX Hao wrote: 2 minor fixes for my previous commits: Optimize deduping expression for version info https://github.com/lifenjoiner/wget-for-windows/commit/8efc59dffc547345168239c0b9f70ba1ffcf6e0e How does this make 'wget -V' and 'link_flags' look different? I fail to see what that 'sed'

RE: test wget_options_fuzzer seems never pass

Glad to know. 2 minor fixes for my previous commits: Optimize deduping expression for version info https://github.com/lifenjoiner/wget-for-windows/commit/8efc59dffc547345168239c0b9f70ba1ffcf6e0e Remove '-lgdi32' from linking on Windows

Re: block digest on warc revisit records

Hi gang, I wrote: > it seems to me that the version of wget I have has a bug at the > point where it generates block digests for WARC revisit records. I did not see a reaction to this. Could a kind soul please briefly enlighten me about the status of the WARC support? -- Cheers,

Re: test wget_options_fuzzer seems never pass

Hi YX Hao ! I see all the work you into the Windows version of Wget - thanks, that's awesome ! Darshit's plan was to release wget 1.21 soon - let's get his opinion if we should integrate all those patches there or in the next version. I am cool with putting it into 1.21. @Darshit ? Regards,

Re: [PATCH] Support for tag

Ah, sorry, just saw this email with your patch :-) Could you attach your patch as attachment. Git can't am/apply your patch here. Regards, Tim On 15.07.20 12:55, Sho Amano wrote: > Hi! I've been using the first version of wget for a long time and first of > all, > I want to say thank you to

Re: [PATCH] Support for tag

Hi, we support the meta charset tag in Wget2. Best is when you build it from source. If you don't fell comfortable with that, some GNU/Linux distros have wget2 packaged (e.g. Debian). See here for a tarball build:

Re: How to send a POST request by wget same to a httpie request?

You can send POST requests, with --method=POST. Multipart bodies are not, and will probably never be, supported in wget. There is ongoing work to implementing them in wget2, however [0]. You might want to check it out. Having said this, in wget you can send the contents of a file as a body

Re: Download page with scripted table

Hi, This is the right place for Wget questions. The page in question is generated dynamically via a AJAX request and some Javascript. Wget does not support any Javascript parsing. You would need something a lot more heavyweight to do that. Something like Selenium that runs a full browser

Re: Download page with scripted table

Hi, Might anybody know if there is a better place to ask my question below or know where I can get consulting for wget? I did not see any replies. Morris On Monday, June 22, 2020, 12:13:05 AM EDT, Morris West wrote: Hi, Is it possible to for wget to save the page at the link

RE: Windows native hashes wrapper implemented

Plus this one: https://github.com/lifenjoiner/wget-for-windows/commit/b7169b74f10e9a9722d25f0d13c9248aa0f10dbe Subject: Windows native hashes wrapper implemented Hey guys, I have implemented the Windows native hashes wrapper targeting to reduce the executable size. And It saves at

Re: [PATCH] no_proxy domain matching

Thank you, Thomas, patches applied and pushed. Regards, Tim On 10.07.20 15:34, Tomas Hozza wrote: > > > On 27. 11. 2019 10:50, Tim Rühsen wrote: >> On 11/26/19 4:00 PM, Tomas Hozza wrote: >>> >>> >>> On 20. 11. 2019 18:47, Tim Rühsen wrote: On 20.11.19 12:41, Tomas Hozza wrote: > On 7.

Re: [PATCH] no_proxy domain matching

On 27. 11. 2019 10:50, Tim Rühsen wrote: > On 11/26/19 4:00 PM, Tomas Hozza wrote: >> >> >> On 20. 11. 2019 18:47, Tim Rühsen wrote: >>> On 20.11.19 12:41, Tomas Hozza wrote: On 7. 11. 2019 21:30, Tim Rühsen wrote: > On 07.11.19 15:21, Tomas Hozza wrote: >> Hi. >> >> In

Re: cant able to download data

Hi, not being a wget fundi - there are lots out here that are better with this - I have a different suspicion: if you have wget installed in what I suspect is c:\windows\system32\ and you run your command from that directory then wget will try to place the downloaded files in that directory

Re: ftp VERIFCERTERR causes SIGABRT

Thank you, pushed. Regards, Tim On 24.06.20 18:37, Artem Egorenkov wrote: > There is a bug that causes wget to exit with SIGABRT when trying to > receive files through FTP from a server with a certificate that failed > the verification. > > The bug is filed in RedHat Bugzilla for Fedora: >

Re: Wget2 fuzzer crash on ODROID XU4

On Tue, Jun 23, 2020 at 4:03 PM Tim Rühsen wrote: > > Hi Jeff, > > thank you, the backtrace made it clear. The issue was a free() on a > string literal. A fix has been pushed. > > Can you test with your setup from 17.06. ? Hopefully it was the same issue. Yes, master tested OK. Jeff

Re: Wget2 fuzzer crash on ODROID XU4

Hi Jeff, thank you, the backtrace made it clear. The issue was a free() on a string literal. A fix has been pushed. Can you test with your setup from 17.06. ? Hopefully it was the same issue. Regards, Tim On 22.06.20 20:52, Jeffrey Walton wrote: > On Mon, Jun 22, 2020 at 2:10 PM Jeffrey Walton

Re: Wget2 fuzzer crash on ODROID XU4

On Mon, Jun 22, 2020 at 2:10 PM Jeffrey Walton wrote: > > Hi Everyone/Tim, > > Here's another crash on the fuzzer. This came from an ODROID XU4. > > Here's the text from the log file in case I screw up the attachment again. > > FAIL: wget_options_fuzzer > = > > testing 7

Re:

Hi, the Refresh header is not processed by Wget. Regards, Tim On 22.06.20 00:39, Peng Yu wrote: > I see Refresh response header as described below. It seems that wget > does not support. Could anybody confirm whether this is the case? > Thanks. > >

Re: Wget2 and FAIL: wget_options_fuzzer

On Sun, Jun 21, 2020 at 5:16 AM Tim Rühsen wrote: > > Hi Jeff, > > you included a GMP config.log - possibly you can add config.log from > wget2 !? It includes mostly anything to reproduce your system > environment and CFLAGS. Damn, sorry about that. It sucks getting old. I miss my mind the most.

Re: Patch: Segmentation fault in pure IPv4 wget #12

Thanks, pushed. Regards, Tim On 13.06.20 19:59, Swapnil More wrote: > Hi Team, > Find the patch inline as well as in attachment for the fix of issue > mentioned in mail header > > index a2583898..353c1cc5 100644 > --- a/src/host.c > +++ b/src/host.c > @@ -857,8 +857,8 @@ lookup_host (const char

Re: Wget2 and FAIL: wget_options_fuzzer

Hi Jeff, you included a GMP config.log - possibly you can add config.log from wget2 !? It includes mostly anything to reproduce your system environment and CFLAGS. Regards, Tim On 17.06.20 06:51, Jeffrey Walton wrote: > Hi Everyone/Tim, > > I knocked the dust off the Wget2 script. I'm catching

Re: Is this a bug?

On Sun, Jun 14, 2020 at 04:02:49PM +, George R Goffe wrote: > I occasionally get a message from wget(?) that states "just got xxx of yyy > bytes". > > Is this a failure in wget? A server problem? I have the source for wget1 and > wget2 and don't see any strings "just got" in any of the code.

Re: SSL certificate issue

On Wed, Jun 03, 2020 at 12:35:06AM +0800, Fai Yip wrote: > hi, > I am a web developer, and I use wget for some of my routines. I am > getting a certificate error, and I have no idea how to solve this. I > already check my date, and ca-certificates. > Please help > > Thanks > Fai > > >

Re: Sectigo root CA expiry issue

Thanks for your report. This is fixed now in GnuTLS and likely goes into the release 3.6.14, scheduled for tomorrow. https://gitlab.com/gnutls/gnutls/-/issues/1008 https://gitlab.com/gnutls/gnutls/-/merge_requests/1271 Regards, Tim On 30.05.20 19:57, Tenboro wrote: > Hello, > > Today I started

Re: Sectigo root CA expiry issue

See also: https://gitlab.com/gnutls/gnutls/-/issues/1008#note_352370753 Regards, Tim On 31.05.20 00:18, dar...@gnu.org wrote: > For anyone interested, this topic is currently trending on Hacker News: > > https://news.ycombinator.com/item?id=23362759 > > On May 30, 2020 9:02:36 PM GMT+02:00,

Re: Sectigo root CA expiry issue

For anyone interested, this topic is currently trending on Hacker News: https://news.ycombinator.com/item?id=23362759 On May 30, 2020 9:02:36 PM GMT+02:00, Petr Pisar wrote: >On Sat, May 30, 2020 at 07:57:22PM +0200, Tenboro wrote: >> Today I started getting some errors with a maintenance

Re: Sectigo root CA expiry issue

On Sat, May 30, 2020 at 07:57:22PM +0200, Tenboro wrote: > Today I started getting some errors with a maintenance script that makes > use of wget, where it claims that a certificate has expired. > > DEBUG output created by Wget 1.19.5 on linux-gnu. > > Reading HSTS entries from /root/.wget-hsts

Re: Broken OpenSSL + Wget on Linux Mint

Hi, please leave away the --secure-protocol option. Wget + OpenSSL automatically choose the best available protocol that the server supports. SSLv2 and SSLv3 are no longer supported by modern SSL libraries due to security issues. This is what the error message expresses. Regards, Tim On

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

On 19.05.20 21:15, Stephen Kirby wrote: > Hi, > > One additional piece that may/may not be relevant: > > When I use secure protocol, i.e., https instead of http, it says: > > "Reading HSTS entries from .wget-hsts file in com.example.myapplication dir" > > Should I create a .wget-hsts file?  I

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

On 19.05.20 20:55, Stephen Kirby wrote: > Tim, > > Thanks for that.  I like the idea of rebuilding GnuTLS so I don't have > to add the --ca-directory flag, but will hold on that until I can > resolve the connecting problem. > > I added the --ca-directory=/system/etc/security/cacerts flag to the

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

Hi, One additional piece that may/may not be relevant: When I use secure protocol, i.e., https instead of http, it says: "Reading HSTS entries from .wget-hsts file in com.example.myapplication dir" Should I create a .wget-hsts file? I don't see one yet. If so, can someone please help me with

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

Tim, Thanks for that. I like the idea of rebuilding GnuTLS so I don't have to add the --ca-directory flag, but will hold on that until I can resolve the connecting problem. I added the --ca-directory=/system/etc/security/cacerts flag to the wget call and now see this (still not connecting and

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

Stephen, you should use the --ca-directory=directory options for this. That one loads all PEM files in that directory into the internal GnuTLS cert store. The file naming doesn't matter, only the content must be PEM. You wouldn't have that hassle if GnuTLS would have been built with the correct

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

Tim, Thanks for that clarification. You are correct -- I checked the x86-based Google Pixel emulator and there is no /etc/ssl/certs directory. Rather it appears this OS puts certificates in: /system/etc/security/cacerts. There the files are named (hash #'s).0. Do I need to tell wget to look

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

-1250 is a GnuTLS failure "GNUTLS_E_UNIMPLEMENTED_FEATURE" returned by gnutls_certificate_set_x509_system_trust(). Due to a bug, this is output instead of the real number of certs loaded. The fallback code tries to open /etc/ssl/certs to search for certificates. But it seems, this doesn't exist

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

Hi all, Tim let me know I only responded to him instead of the list. My bad and thanks for noticing! So here is what I sent Tim the other day -- Thanks all for you inputs! I just tried adding the --debug flag and get one more piece of info: certificates loaded: -1250 I am not seeing this

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

On 15.05.20 19:08, Stephen Kirby wrote: > Petr/Everyone, > > Thanks so much for your detailed recommendations on how to proceed. You > were spot on regarding gnutls_priority_set_direct. I looked at config.log > and noticed configure was failing due to a missing pthread lib. I inserted > that,

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

On Fri, May 15, 2020 at 1:09 PM Stephen Kirby wrote: > ... > on the emulated phone, I am trying: > > wget -O filename http://###.##.###.## (i.e., here I use the IP address > found via nslookup on the named URL) > > Then, I get: > HTTP request sent, awaiting response... 302 object moved >

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

Petr/Everyone, Thanks so much for your detailed recommendations on how to proceed. You were spot on regarding gnutls_priority_set_direct. I looked at config.log and noticed configure was failing due to a missing pthread lib. I inserted that, then had to fix some other missing symbols. Anyway,

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

On Tue, May 12, 2020 at 05:34:22PM -0600, Stephen Kirby wrote: > I'm using GnuTLS version 3.6.13. I believe it is the latest. If anyone > knows otherwise please let me know. > > Sorry for the delay in getting back to you Tim (was swamped this morning) > and thanks for your fast response! I

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

Hi Tim, I'm using GnuTLS version 3.6.13. I believe it is the latest. If anyone knows otherwise please let me know. Sorry for the delay in getting back to you Tim (was swamped this morning) and thanks for your fast response! I double-checked the versions of GnuTLS and wget I am using. Both

RE: [bug #58354] Wget doesn't parse URIs starting with http:/

I've got code for parsing broken URLs at http://mason.gmu.edu/~smetz3/source/unobfuscate.zip if that's of any use to you. -- Shmuel (Seymour J.) Metz http://mason.gmu.edu/~smetz3 From: Bug-wget [bug-wget-bounces+smetz3=gmu@gnu.org] on behalf of

Re: Wget for Windows unicode issue

This works here: wget.exe --local-encoding=utf-8 -i url-file.txt With a 'url-file.txt' containing: www.seoghør.no I used 'https://cafewebmaster.com/online_tools/utf8_encode' to UTF-8 encode '.seoghør.no' into the above. Wget downloaded a 300 kB index.html. Except I had to use

Re: [bug #58354] Wget doesn't parse URIs starting with http:/

On Tue, May 12, 2020 at 6:45 AM Luca Bernardi wrote: > > URL: > > > Summary: Wget doesn't parse URIs starting with http:/ > Project: GNU Wget > Submitted by: f0ff > Submitted on: Tue 12 May 2020

Re: how to capture "20 redirections exceeded." error?

You could parse the output from wget. It is extremely unlikely that we will change this message in the future. Regards, Tim On 11.05.20 23:11, Peng Yu wrote: > Hi, > > wget returns 8 when it sees "20 redirections exceeded.". But how to > capture such an error from the program calling wget?

Re: Undefined reference to gnutls_protocol_set_priority() when compiling latest wget version

Which version of GnuTLS are you using ? I saw this issue two or three weeks ago on OSS-Fuzz, which builds wget and it's dependencies from master. But the build failure is gone now - and i never cared much for it, so can't tell you anything but "try with latest GnuTLS". Regards, Tim On 12.05.20

Re: Wget for Windows unicode issue

Hi, the default charset encoding on Windows is likely not UTF-8 (maybe cp1252 !?), so UTF-8 character read from myfile.txt are not correctly converted. But you can possibly use --remote-encoding=utf-8. From the wget man page: --remote-encoding=encoding Force Wget to use

Re: Why wget doesn't download data when the HTTP status is 4xx?

Wget doesn't do that on default. Add --content-on-error to get the content even with 4xx errors. Tim On 11.05.20 00:09, Peng Yu wrote: > Hi, > > $ curl --verbose ... > ... > < HTTP/1.1 403 Forbidden > ... > < > { [359 bytes data] > 100 814980 814980 0 50214 0 --:--:-- 0:00:01

Re: The relation of HTTP status code and wget exit status code

An explicit mapping table does not exist. However, man wget will tell you what errors result in which error codes. You can extrapolate from there. If you do make such a table, I would love to add it to info wget On May 10, 2020 6:19:34 AM GMT+02:00, Peng Yu wrote: >It is not clear what the

Re: Wget2 Question

Hi Yaakow, Please use the public mailing lists for questions. It seems like you're looking for the --span-hosts option (-H). The --reject option takes a list of extensions, not a regex. For what you're trying, you want to use --reject-regex. On 5/5/20 7:08 PM, Yaakov Schwartzman wrote: Hi

Re: Bug or at least strange behaviour

Hi, -A / -R is applied before downloading a file and in http://www.cs.toronto.edu/maxsat-lib/maxsat-instances/master-set/index.html all the subdirectories are referred to as files, not as subdirectories (a trailing / would indicate a subdirectory). Indeed, wget should use a HEAD request before

Re: [PATCH] Fix strict aliasing violation

On 12.04.20 16:18, Andreas Schwab wrote: > On Apr 12 2020, Tim Rühsen wrote: > >> test-dl.c: In function 'test_fn_check': >> test-dl.c:186:9: warning: ISO C forbids conversion of object pointer to >> function pointer type [-Wpedantic] >> 186 | fn_p = (test_fn)fn; >> | ^ >> >>

Re: [PATCH] Fix strict aliasing violation

On Apr 12 2020, Tim Rühsen wrote: > test-dl.c: In function 'test_fn_check': > test-dl.c:186:9: warning: ISO C forbids conversion of object pointer to > function pointer type [-Wpedantic] > 186 | fn_p = (test_fn)fn; > | ^ > > Following the code, tt basically turns down to the

Re: [PATCH] Fix undefined behaviour in test_buffer_printf

On Apr 12 2020, Tim Rühsen wrote: > On 12.04.20 14:16, Andreas Schwab wrote: >> On Apr 12 2020, Tim Rühsen wrote: >> >>> Regarding the UB: what tool did you use to detect it or was it a manual >>> review ? >> >> It fails the testsuite. > > Do you have a OS, compiler version, CFLAGS for me to

Re: [PATCH] Fix undefined behaviour in test_buffer_printf

Thanks Andreas, pushed to master. On 11.04.20 22:05, Andreas Schwab wrote: > * unit-tests/test.c (test_buffer_printf): Cast argument to printf > function to correct type. > --- > unit-tests/test.c | 24 ++-- > 1 file changed, 22 insertions(+), 2 deletions(-) > > diff --git

Re: [PATCH] Fix undefined behaviour in test_buffer_printf

On 12.04.20 14:16, Andreas Schwab wrote: > On Apr 12 2020, Tim Rühsen wrote: > >> Regarding the UB: what tool did you use to detect it or was it a manual >> review ? > > It fails the testsuite. Do you have a OS, compiler version, CFLAGS for me to reproduce ? Regards, Tim signature.asc

Re: [PATCH] Fix strict aliasing violation

Hi Andreas, On 11.04.20 22:05, Andreas Schwab wrote: > * unit-tests/test-dl.c (test_fn_check): Avoid strict aliasing > violation. > --- > unit-tests/test-dl.c | 2 +- > 1 file changed, 1 insertion(+), 1 deletion(-) > > diff --git a/unit-tests/test-dl.c b/unit-tests/test-dl.c > index

Re: [PATCH] Fix undefined behaviour in test_buffer_printf

On Apr 12 2020, Tim Rühsen wrote: > Regarding the UB: what tool did you use to detect it or was it a manual > review ? It fails the testsuite. Andreas. -- Andreas Schwab, SUSE Labs, sch...@suse.de GPG Key fingerprint = 0196 BAD8 1CE9 1970 F4BE 1748 E4D4 88E3 0EEA B9D7 "And now for something

Re: [PATCH] Fix undefined behaviour in test_buffer_printf

Hi Andreas, thanks for your patches :-) I'll run them through our CI (see https://gitlab.com/gnuwget/wget2/-/merge_requests/469) now and review them later this evening. Regarding the UB: what tool did you use to detect it or was it a manual review ? As our continuous fuzzer (libFuzzer/afl on

Re: Wget2 and FAIL: wget_options_fuzzer

Sorry, cannot reproduce here. If you can reproduce in a docker image, just pass me the Dockerfile. I attach my currently used Dockerfile, if that is of any help. Regards, Tim On 03.04.20 00:01, Jeffrey Walton wrote: > Hi Everyone/Tim, > > I'm building Wget2 master on Fedora 31. The fuzzer

Re: Wget2, OS X 10.12 and two elf test issues

We run those tests with sanitizers and valgrind and don't see the issues (Debian Linux). Any chance to enable sanitizers and get symbolized backtrace ? ASAN_SYMBOLIZER_PATH=/usr/bin/llvm-symbolizer (or where the clang symbolizer might be) CFLAGS="-g -ggdb3 -Og" ./configure

Re: Wget2 and Error: 'gettext' version == 0.16.1 is too old

On 3/30/20 9:16 AM, Jeffrey Walton wrote: On Mon, Mar 30, 2020 at 3:02 AM Tim Rühsen wrote: Hi Jeff, On 3/30/20 8:37 AM, Jeffrey Walton wrote: ... Is it possible to relax the Autotools requirement: running: AUTOPOINT=true LIBTOOLIZE=true autoreconf --verbose --install --force -I m4

Re: Wget2 and Error: 'gettext' version == 0.16.1 is too old

On Mon, Mar 30, 2020 at 3:02 AM Tim Rühsen wrote: > > Hi Jeff, > > On 3/30/20 8:37 AM, Jeffrey Walton wrote: > > ... > > Is it possible to relax the Autotools requirement: > > > > running: AUTOPOINT=true LIBTOOLIZE=true autoreconf --verbose --install > > --force -I m4 --no-recursive > >

Re: Wget2 and Error: 'gettext' version == 0.16.1 is too old

Hi Jeff, On 3/30/20 8:37 AM, Jeffrey Walton wrote: On Mon, Mar 30, 2020 at 1:13 AM wrote: Hi Jeffrey, For fixing your issue with gettext, you want to set the PATH variable, not PKG_CONFIG_PATH. Try this: export PATH=$HOME/tmp/ok_to_delete:$PATH ./bootstrap You might need to set

Re: Wget2 and Error: 'gettext' version == 0.16.1 is too old

On Mon, Mar 30, 2020 at 1:13 AM wrote: > > Hi Jeffrey, > > For fixing your issue with gettext, you want to set the PATH variable, not > PKG_CONFIG_PATH. > > Try this: > > export PATH=$HOME/tmp/ok_to_delete:$PATH > ./bootstrap > > You might need to set PKG_CONFIG_PATH for libraries, but the

Re: Wget2 and Error: 'gettext' version == 0.16.1 is too old

Hi Jeffrey, For fixing your issue with gettext, you want to set the PATH variable, not PKG_CONFIG_PATH. Try this: export PATH=$HOME/tmp/ok_to_delete:$PATH ./bootstrap You might need to set PKG_CONFIG_PATH for libraries, but the gettext binary will be found via the PATH variable. For the

Re: [PATCH] Don't print message about loading crl or ca-cert files with --no-verbose

Hi Tim. On 24. 3. 2020 15:01, Tim Rühsen wrote: > Hi Tomas, > > On 24.03.20 14:24, Tomas Hozza wrote: >> Hi. >> >> I would like to get feedback on a subtle change of behavior in wget >> between version 1.14 and the current upstream version, which has >> been pointed out by our distribution

Re: [PATCH] Don't print message about loading crl or ca-cert files with --no-verbose

Hi Tomas, On 24.03.20 14:24, Tomas Hozza wrote: > Hi. > > I would like to get feedback on a subtle change of behavior in wget > between version 1.14 and the current upstream version, which has > been pointed out by our distribution users. > > Before change [1], wget didn't produce any output

Re: wget prints out information in unicode characters where ASCII could suffice

Hi, it's likely your locale as the apostrophes are part of localization. LC_ALL=en_US.utf8 wget ... ‘index.html.4’ LC_ALL=en_US.utf8 wget ... »index.html.5« LC_ALL=C wget ... 'index.html.3' So for scripts make sure that you use a defined locale when you are going to parse wget's output. This

Re: make install error

I got your logs via private email (ahem). You should rethink about your configure options, e.g. - do NOT use --enable-fuzzing when your aim isn't fuzzing (make install is really a bad idea with that). Some code will be removed with a fuzzing build. This is only for devs. - --with-openssl uses

Re: make install error

Attachment !? On 18.03.20 13:06, George R Goffe wrote: > Tim, > > I have built wget2 on a VM without any of "my" local tools. > > Here's a build log that shows EVERYTHING that happened during the build > including my build script which contains the config options I use. > > Wget2 has built on

Re: make install error

Tim, I have built wget2 on a VM without any of "my" local tools. Here's a build log that shows EVERYTHING that happened during the build including my build script which contains the config options I use. Wget2 has built on this platform several times and I haven't made any changes except for

Re: make install error

Hi George, it works here and on our CI runners (make distcheck is basically simulating installation). To me it looks like there is an issue with libz on your side. Did you try rebuilding or reinstallation of libz ? If you want us to reproduce, what system are you using ? Or possibly you have a

RE: [bug #57884] wget reveals my operating system to the server

: Monday, February 24, 2020 6:42 AM To: ge...@mweb.co.za; Tim Ruehsen Cc: bug-wget Subject: Re: [bug #57884] wget reveals my operating system to the server ge...@mweb.co.za wrote: > I wonder about the reason given: "To avoid compatibility issues." > That was - if I recall correc

Re: [bug #57884] wget reveals my operating system to the server

ge...@mweb.co.za wrote: > I wonder about the reason given: "To avoid compatibility issues." > That was - if I recall correctly - the reason for having the string > to start with: So that servers can format pages to suit the capabilities > of the browser and version used. That was how web

Re: [bug #57884] wget reveals my operating system to the server

On 2/24/20 11:58 AM, ge...@mweb.co.za wrote: > Interesting - forcing a user agent string could be in violation of GDPR since > it would definitely make the user environments more identifiable. The > "fingerprinting" discussion refers. On the other hand, if all browsers > henceforth were to send

Re: [bug #57884] wget reveals my operating system to the server

Interesting - forcing a user agent string could be in violation of GDPR since it would definitely make the user environments more identifiable. The "fingerprinting" discussion refers. On the other hand, if all browsers henceforth were to send the same string the opposite would be true. I

Re: Warning in http.c

Thanks, fixed and pushed. Regards, Tim On 22.02.20 00:04, Gisle Vanem wrote: > Hi list. > > Just built Wget (master) using clang-cl and noticed this important > warning: >   http.c(874,11): warning: >   ordered comparison between pointer and integer ('size_t' (aka > 'unsigned int') and 'char

Re: Codespell report for "Wget" (on fossies.org)

Hi Tim, The typos are fixed now, a script 'spell-checking' has been added and is used in the CI now. That seems to be a good idea. I hope the "pressure" wasn't too high and I'm happy that I could help a little bit on this not too important topic. And thanks for your friendly and motivating

Re: Report a bug url cut

ahh ok thanks! I offer my apologies. El jue., 20 feb. 2020 a las 10:40, Darshit Shah () escribió: > Hi Jorge, > > That is not a bug in Wget. The "&" character in your command is > interpreted by the shell you are using to mean 'background this command'. > > Wget doesn't get to see the whole URL

Re: Report a bug url cut

Hi Jorge, That is not a bug in Wget. The "&" character in your command is interpreted by the shell you are using to mean 'background this command'. Wget doesn't get to see the whole URL you typed. You need to double quote the entire URL so that the shell does not interpret any special

Re: Codespell report for "Wget" (on fossies.org)

The typos are fixed now, a script 'spell-checking' has been added and is used in the CI now. Regards, Tim On 2/20/20 4:01 PM, Tim Rühsen wrote: > Hi Jens, > > quite a nice service, thank you for all that work. It's awesome ! > > We are aware of codespell but so far only use it as a CI check

Re: Codespell report for "Wget" (on fossies.org)

Hi Jens, quite a nice service, thank you for all that work. It's awesome ! We are aware of codespell but so far only use it as a CI check for Wget2[1]. We didn't bother to backport the script yet to Wget 1.x. See [2] and [3]. Indeed we plan for a new release - so you put some pressure on us to

Re: wget man page should hit at existence of wget2

That's a good point. We were just discussing about making a new release for Wget. I'll add an entry to the man page before doing that On 20/02/2020 04:14, Dan Jacobson wrote: The wget man and Info pages should say "SEE ALSO wget2(1)" etc. else the user will never know.

Re: Mention how to only get error messages

On 2/17/20 5:39 PM, 積丹尼 Dan Jacobson wrote: > (info "(wget) Logging and Input File Options") says: > > ‘-nv’ > ‘--no-verbose’ > Turn off verbose without being completely quiet (use ‘-q’ for > that), which means that error messages and basic information still > get printed. > > >

Re: running "latest" version of wget2 gives a core file.

Hi, I can't reproduce here. Using your command line gives the expected Failed to resolve wget (Name or service not known) Failed to connect: General error ... Since 'wget' is not resolvable, the code path shown by gdb should not have been traversed. To track this down I need your help. - have

Re: Can wget work with google chrome cookie?

Whatever "problems" are. 'sameSite' applies certain restrictions when to deliver cookies. Without it, you might expose cookies to sites that don't need it (as I understand). So there might be a privacy concern. You have to read more about sameSite if this matters to you. Regards, Tim On

Re: Can multiple wget processes uses the same cookie file for --load-cookies cookie.txt --keep-session-cookies --save-cookies cookie.txt?

First of all: never let parallel wget instances work on the same directory. Regarding your question, wget1: No, wget2: Yes. To get this working with wget1, I suggest the following steps 1. --load-cookies=cookie.txt 2. --save-cookies= 3. use a bash script to merge the unique cookie files into one

Re: Can wget work with google chrome cookie?

Could the lack of sameSite cause some problems when using wget to access certain website? Thanks. On Sun, Feb 16, 2020 at 4:54 AM Tim Rühsen wrote: > A conversion tool would be nice, indeed. > > Most of the fields are the same. 'hostOnly' is represented in > wget/netscape cookies.txt by NOT

Re: Can wget work with google chrome cookie?

And for Firefox https://addons.mozilla.org/en-US/firefox/addon/cookies-txt/ On 16.02.20 11:56, Tim Rühsen wrote: > Oh, there is such a tool as a Chrome extension: > > https://chrome.google.com/webstore/detail/cookiestxt/njabckikapfpffapmjgojcnbfjonfjfg > > > On 16.02.20 11:54, Tim Rühsen

Re: Can wget work with google chrome cookie?

Oh, there is such a tool as a Chrome extension: https://chrome.google.com/webstore/detail/cookiestxt/njabckikapfpffapmjgojcnbfjonfjfg On 16.02.20 11:54, Tim Rühsen wrote: > A conversion tool would be nice, indeed. > > Most of the fields are the same. 'hostOnly' is represented in >

Re: Can wget work with google chrome cookie?

A conversion tool would be nice, indeed. Most of the fields are the same. 'hostOnly' is represented in wget/netscape cookies.txt by NOT having a leading dot for the domain. E.g. '.example.com' means NOT hostOnly (= cookie is valid also for all subdomains). Our cookie format does not have

Re: overrider or append entries in cookie file with --header "cookie: xxx"?

No, wget won't override a cookie from cookies.txt with -H. That's when shell scripting comes into play. E.g. pipe your cookies.txt through grep -v or sed to remove a certain line (or several lines) and save it temporarily in e.g. cookies2.txt. Then run wget with cookies2.txt. After that, either

Re: Are --load-cookies and --save-cookies effective at the same time?

I may have made a mistake on my end. Yes, both options can have the file without problems. On 2/14/20, Tim Rühsen wrote: > Definitely, just tested with wget 1.20.3: > > > $ wget --load-cookie=cookies.txt --save-cookies=cookies.txt google.com > $ sum cookies.txt > 50297 1 > > $ wget

Re: Are --load-cookies and --save-cookies effective at the same time?

Definitely, just tested with wget 1.20.3: $ wget --load-cookie=cookies.txt --save-cookies=cookies.txt google.com $ sum cookies.txt 50297 1 $ wget --load-cookie=cookies.txt --save-cookies=cookies.txt google.de $ sum cookies.txt 27483 1 What version of wget do you use ? Regards, Tim On

Re: Are --load-cookies and --save-cookies effective at the same time?

Can the options for --load-cookies and --save-cookies be the same? It seems that there are problems when they are the same. When I change them to be different, then it is OK. On 2/14/20, Tim Rühsen wrote: > Yes, you can combine the options as you assumed. > > Not sure why the cookies.txt isn't

<    1   2   3   4   5   6   7   8   9   10   >