Re: [Bug-wget] [FEATURE-REQUEST] Pinning SSL certificates / check SSL fingerprints

[Dagobert Michelsen]

Hi,

I have a tiny comment from a downstream packager standpoint: It would be nice 
if the
capath would be configurable during configure time instead of hardcoding it
to /etc/ssl/certs as it is now - we e.g. use /etc/opt/csw/ssl/certs and need
to perl-pi in the unpacked sources. Not a real problem, but also not the most
elegant solution.


Best regards

  -- Dago

-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896

Re: [Bug-wget] Configure freezes when checking C compiler.

[Dagobert Michelsen]

Hi,

Am 21.11.2012 um 13:26 schrieb Sullivan, George E. 
george.e.sulli...@saic.com:
 Tech stuff first:
 Compiling wget 1.12Solaris 5.8 Sparc sun4u
 (Let me know if you want other info)
 
 Early on in my run of configure the process stops at:
 
 checking for C compiler default output file name...
 
 Any ideas what might be causing this?  The last few lines of the config log 
 are:
 
 configure:3253: gcc --version  5
 Using builtin specs.
 gcc version 2.95.1 19990816 (release)

Wow, this is old.

 configure:3268 $? = 0
 configure:3275: gcc -V 5
 gcc argument to '-V' is missing
 configure:3279: $? = 1
 configure 3302: checking for compiler default output filename
 configure:3324 gcc -o a.out conftest.c  5
 
 That is where things stop.


This is usually the place where configure tries to look if your compiler
can actually generate binaries that run. There should be a more elaborate
message in config.log, please paste and additionally try that the compiler
actually works as the version is quite old.


Best regards

  -- Dago


-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896

Re: [Bug-wget] Welcome to the Bug-wget mailing list

[Dagobert Michelsen]

Hi,

Am 06.07.2013 um 02:39 schrieb Roman Czyborra czybo...@campus.tu-berlin.de:

 On Sat, Jul 6, 2013 at 1:56 AM, Roman Czyborra
 czybo...@campus.tu-berlin.de wrote:
 
 2: when I wget -r http://netpbm.sf.net/doc/ I get way more than what
 is chrooted to the netpbm/doc/
 
 meant to complain that wget seems to endlessly continue downloading
 the entire www

--no-parent ?

Best regards -- Dago

Re: [Bug-wget] [PATCH] New option: --rename-output: modify output filename with perl

[Dagobert Michelsen]

Hi Andrew,

Am 25.07.2013 um 16:31 schrieb Andrew Cady d...@jerkface.net:
 This patch adds an option that allows the user to modify wget's output
 filenames using a perl expression.  It works similarly to perl's
 rename script, in terms of how perl is used to modify the filename
 string.  That is, the original filename is stored in the perl variable
 $_, which the user-supplied code can modify; the value left in $_ is
 used instead of the original.
 
 Perl treats $_ as the default variable for regular expressions (among
 other operations), so the user can specify a regular expression without
 having to know any perl (other than perl-compatible regexes), and that
 will work fine.  But arbitrary perl code can be used, e.g., to perform
 character escapes.

I see a number of problems with this approach:
- It is not desirable to enable this on all platforms as there may be
  no perl in /usr/bin, so it should be possible to disable it during configure
- perl may be in another location

A solution with a generic program transformation similar to other GNU tools
(although during configure) like
  --program-transform-name=PROGRAM   run sed PROGRAM on installed program names
would IMHO be more flexible and wouldn't require hardcoding any pathes.
Just to be clear: I would expect this solution directly to wget to transform
output file names and pathes.


Best regards

  -- Dago


-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896

Re: [Bug-wget] [PATCH] New option: --rename-output: modify output filename with perl

[Dagobert Michelsen]

Hi Andrew,

Am 01.08.2013 um 21:22 schrieb Andrew Cady d...@jerkface.net:
 On Thu, Aug 01, 2013 at 10:36:00AM -0700, Micah Cowan wrote:
 On Wed, Jul 31, 2013 at 06:32:18PM -0400, Andrew Cady wrote:
 By that, I assume you mean to execute the option in the shell.  So the
 existing usage:
 
  --rename-output=s/x/y/
 
 would (almost) become:
 
  --rename-output='perl -lpe BEGIN{\$|++} -e s/x/y/'
 
 It COULD, sure, but why on earth would someone choose to use that
 instead of 'sed s/x/y/'?
 
 With sed, you still need -u, or else there is a deadlock.  This
 knowledge should be embedded into wget because most people don't have
 it.

You are talking about GNU sed, please keep in mind that wget is portable to
systems without or just a subset of the GNU userland.

  --name-filter=sed   --rename='sed code here'
  --name-filter=perl  --rename='perl code here'
  --name-filter=shell --rename='shell code here'
  --name-filter=pcre  --rename='regex here'
 
 All of the above seems like over-engineering to me, especially just
 to avoid the occasional backslash... don't forget, the more complexity
 you introduce, the more bugs as well (and wget already rather suffers
 from such a scenario).
 
 Well, I actually went ahead and implemented it already.  I even did
 pcre, although that's not done (/g does not work).
 
 It's not complex.  The only difference between sed, perl, and shell is
 the command line that is given to execvp.  There's a simple switch() to
 decide which argument list to use.  It's basically just a simple alias
 mechanism.  Here's the relevant code:
 
  pipe2_t init_pipe_filter()
  {
pipe2_t res;
char *code = opt.rename_output;
char *perl[] = { perl, perl, -0lpe, BEGIN{$|++}, -e, code, 0 };
char *sed[] = { sed, sed, -ue, code, 0 };
char *shprog = getshell();
char *shell[] = { shprog, shprog, -c, code, 0 };
 
char **cmd = 0;
switch (filter_type) {
  case perl_filter:
   cmd = perl, delim = 0;
   break;
  case sed_filter:
   cmd = sed, delim = '\n';
   break;
  case shell_filter:
   cmd = shell, delim = getdelimopt();
   break;
  default:
   error(1, 0, unpossible!);
}
 
int in = -1, out = -1; /* initialize to silence warning */
if (open2(cmd, in, out, res.pid)  0)
  error(1, errno, init_name_filter: open2);
if ((res.out = fdopen(out, w))  0)
  error(1, errno, init_name_filter: fdopen);
if ((res.in  = fdopen(in, r))  0)
  error(1, errno, init_name_filter: fdopen);
 
return res;
  }
 
 It's very simple, but a big win I think.

From a packagers perspective this is a nightmare because this feature
introduces weak dependencies to programs which need to be in PATH.
If PATH includes only tools shipped by the system it may be necessary
to explicitly set the path for each of the tools to have the switches
you use (for example /usr/bin/sed on Solaris does not have -u) or disable
them during configure time when the tools are not available. The exact
locations need to adjustable during configure for each of the tools you
use. PCRE support adds an additional library dependency to wget.

All this added complexity seems highly overengineered for a feature
that is not in the core functionality of the tool and that only a
fraction of the users use. Keep in mind: a good tool is one that does
a single job right.

  I can use perl without any
 hassle.  Other people can use sed without even knowing about '-u'.
 Anybody who wants anything else can call it through the shell.  And
 platforms without pipe() will eventually get pcre.
 
 Sh is already well-tested...
 
 Different systems have different shells.  When you have to try to escape
 for the system shell, you run into portability problems, and general
 confusion regarding double-escaping.  If you sit in freenode #openssh
 for a while, you can see these problems routinely, resulting from the
 fact that ssh remote commands are executed through the remote system
 shell.
 
 You cannot impose the need to double-escape on the user in the name of
 avoiding bugs.  That is not avoiding bugs.  That is just making the user
 write the bugs for you!

As a user I would suspect you know your local shell (as opposed to the
funky remote shell on a system far away you rarely use), so the usecases
are slightly different.


Best regards

  -- Dago

-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896

Re: [Bug-wget] Wget no output issue

[Dagobert Michelsen]

Hi,

Am 02.11.2013 um 15:03 schrieb sgtl...@sgtlion.com sgtl...@sgtlion.com:
 Whenever I try to use wget.exe on http://www.dandwiki.com/wiki/Con I
 get literally no output. Even with -d, just, nothing. It works fine
 for anything else, including http://www.dandwiki.com/wiki/Int which is
 almost exactly the same.

What version on what platform are you using? Works for me with 1.12 on Solaris:

 dam@shell [shell]:/home/dam  wget http://www.dandwiki.com/wiki/Con
 --2013-11-02 16:12:10--  http://www.dandwiki.com/wiki/Con
 Resolving www.dandwiki.com (www.dandwiki.com)... 108.162.196.95, 
 108.162.197.95, 2400:cb00:2048:1::6ca2:c45f, ...
 Connecting to www.dandwiki.com (www.dandwiki.com)|108.162.196.95|:80... 
 connected.
 HTTP request sent, awaiting response... 200 OK
 Length: unspecified [text/html]
 Saving to: `Con'
 
 [ = 
   
] 22,753  --.-K/s   in 0.004s  
 
 2013-11-02 16:12:11 (4.96 MB/s) - `Con' saved [22753]
 
 dam@shell [shell]:/home/dam  ls -l Con 
 -rw-r--r--   1 dam  bo 22753 Nov  2 12:18 Con


Best regards

  -- Dago

Re: [Bug-wget] request for help with wget (crawling search results of a website)

[Dagobert Michelsen]

Hi,

Am 03.11.2013 um 09:13 schrieb Altug Tekin altugteki...@gmail.com:
 I am trying to crawl the search results of a news website using *wget*.
 
 The name of the website is *www.voanews.com http://www.voanews.com*.
 
 After typing in my *search keyword* and clicking search on the website, it
 proceeds to the results. Then i can specify a *to and a from-date* and
 hit search again.
 
 After this the URL becomes:
 
 http://www.voanews.com/search/?st=articlek=mykeyworddf=10%2F01%2F2013dt=09%2F20%2F2013ob=dt#article
 
 and the actual content of the results is what i want to download.
 
 To achieve this I created the following wget-command:
 
 wget --reject=js,txt,gif,jpeg,jpg \
 --accept=html \
 --user-agent=My-Browser \
 --recursive --level=2 \
 
 www.voanews.com/search/?st=articlek=germanydf=08%2F21%2F2013dt=09%2F20%2F2013ob=dt#article
 
 Unfortunately, the crawler doesn't download the search results. It only
 gets into the upper link bar, which contains the Home,USA,Africa,Asia,...
 links and saves the articles they link to.
 
 *It seems like he crawler doesn't check the search result links at all*.
 
 *What am I doing wrong and how can I modify the wget command to download
 the results search list links (and of course the sites they link to) only ?*


You need to inspect the urls of the results and make sure to
only download these. Maybe a --no-parent is enough.


Best regards

  -- Dago


-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

Re: [Bug-wget] Strangest result from downloading 1 file with wget.

[Dagobert Michelsen]

Hi Michael,

Am 14.11.2013 um 23:49 schrieb Michel Rod mrodtel...@gmail.com:
 Could anybody shed some light:
 
 If I do:
 wget http://www.prismcasino.com/wp-includes/js/jquery/jquery.js;
 The file contents goes as expected a bunch of jquery code.
 
 If i do:
 wget http://www.prismcasino.com/wp-includes/js/jquery/jquery.js?ver=1.10.2;
 The file contents is completely corrupted looks like binary?
 
 The ?ver shouldnt change the content of a flat file.
 
 I tried downloading it by forcing utf-8 but my wget says does not have 
 support for IRIs.. iam not sure this has anything to do with it.
 
 Why such behaviour?

Try adding -S (show headers). This will give you
Content-Encoding: gzip

Just gunzip the contents and you get javascript again.


Best regards

  -- Dago

-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

Re: [Bug-wget] [PATCH] Make wget capable of starting download from a specified position.

[Dagobert Michelsen]

Hi,

Am 21.12.2013 um 10:24 schrieb Yousong Zhou yszhou4t...@gmail.com:
 In my situation, wget was trigger on the remote machine like the
 following:
 
wget -O - --start-pos $OFFSET $URL | nc -lp 7193
 
 Then on local machine, I would download with:
 
nc localhost 7193
 
 Before these, a local forwarding tunnel has been setup with ssh to make
 this possible.  So in this case, there was no local file on the machine
 where wget was triggerred and `--continue' will not work.  I am sure
 there are other cases `--start-pos' would be useful and that
 `--start-pos' would make wget more complete.


When I just look at your problem it seems to be easier to set up the tunnel
slightly different and pull with standard wget. If the URL looks like
  http://host:port/rest
and you set up the tunnel with
  ssh -L 7193:host:port machine-where-you-called-wget-previously
and then just
  wget http://localhost:7193/rest
the range requests would be sent by wget just fine to the initial server and
you could also safely use -c on further wget invocations (or with proper values
for -t / -T automatically).


Best regards

  -- Dago

-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

Re: [Bug-wget] GNU wget 1.15 released

[Dagobert Michelsen]

Hi folks,

Am 22.01.2014 um 18:50 schrieb Giuseppe Scrivano gscriv...@gnu.org:
 I am pleased to announce the new version of GNU wget.

Thanks for the heads up! Maybe you would be interested in doing some dry runs on
platform-test...@gnu.org first to catch glitches early?
  https://lists.gnu.org/mailman/listinfo/platform-testers


Best regards

  — Dago

-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

Re: [Bug-wget] libpsl design

[Dagobert Michelsen]

Hi Daniel,

Am 22.03.2014 um 22:41 schrieb Daniel Kahn Gillmor d...@fifthhorseman.net:
 On 03/22/2014 04:00 PM, Tim Rühsen wrote:
 I just added the creation of a second library (libpsl-inline) with a 
 slightly 
 different approach. A tool (psl2c) genrates C data structures from the PSL 
 ASCII file. This file will be included by psl-inline.c to build libpsl-
 inline.so.
 
 This sounds great, Tim.
 
 Would it be possible to make these the same library, with the generated
 libpsl-inline object just being a static, pre-generated psl_ctx_t ?
 
 then the library would export an additional variable:
 
  const psl_ctx_t* psl_builtin_ctx;
 
 Or, if you prefer to avoid exporting a variable from a shared object for
 whatever reason, a function:
 
  const psl_ctx_t* psl_get_builtin_ctx();
 
 The user of libpsl could either use the builtin one, or initialize their
 own, passing the const psl_ctx_t* of their choice to the same function
 calls.  This would simplify code and linking, i think.
 
 Also, is creating the library with every change to affected_tld_names.dat 
 reasonable ? How often does it change ?
 
 I think mozilla updates the PSL monthly at this point.  updating the C
 library on the same timeframe doesn't sound too horrible to me.  it's
 also possible to avoid shipping effective_tld_names.dat at all within
 libpsl, and expect the user to supply their own copy when linking.
 
 Within debian, this would just mean libpsl would:
 
 Build-Depend: publicsuffix
 
 I suppose it's possible that a user would want to know information about
 the builtin psl file.  maybe it'd also be worth exporting a const time_t
 psl_builtin_timestamp or a const char* psl_version_info for users who
 want some kind of diagnostics about their builtin PSL.

As a distro-builder I would prefer a solution where the library is pretty stable
and where users can pull updated description files via cron, similar to 
geolitedb
updates. Forcing users to update packages from unstable is not very nice.


Best regards

  — Dago

-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

[Bug-wget] Referer

[Dagobert Michelsen]

Hi,

I wanted to download a website which uses referer to verify the validity of the 
request.
It would have been possible with wget when the referer would be set correctly 
to the
URL requesting the resource. To be precise if the page 
http://mysite.com/abc.html
is downloaded and there are lots of pictures on the page the referer should be 
set
to http://mysite.com/abc.html and follow up on the following html pages.
At the moment the referer seems to be only set when manually adding the option.


Best regards

  — Dago

-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

Re: [Bug-wget] [Bug-Wget] Configure flag to disable assert

[Dagobert Michelsen]

Hi Darshit,

 Am 14.11.2014 um 20:01 schrieb Darshit Shah dar...@gmail.com:
 
 Assertions are good programming practice. However, as the recent assert I 
 added shows us, they should not exist on the client side installations of our 
 software. Assertions are meant for development use only.
 
 Hence, I've added a new configure option, --disable-assert which will 
 eliminate all assertions from the codebase before compilation.

Is this necessary? I mean if you add -DNDEBUG to CPPFLAGS asserts are already 
not
compiled in.


Best regards

  — Dago

-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

Re: [Bug-wget] wcat?

[Dagobert Michelsen]

Hi Tim,

 Am 17.11.2014 um 20:49 schrieb Tim Rühsen tim.rueh...@gmx.de:
 
 Am Montag, 17. November 2014, 09:05:52 schrieb Alfred M. Szmidt:
 It would be nice if wget also installed a wcat command which would
 default to something like,
 
  wget -o /dev/null -O - $@
 
 Would it be possible to add something like that?
 
 Something like
 
 $ alias wcat='wget -o /dev/null -O -'
 $ wcat www.example.com
 
 ?
 
 Put the alias into your ~/.bash_aliases or ~/.bashrc and that's it.
 
 What have I missed ;-) ?

I think Alfred wants to have a behaviour similar to to gzip/gzcat where
you could also have similar structure but nonetheless gzip ships gzcat,
gzgrep etc.


Best regards

  — Dago

-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

Re: [Bug-wget] wcat?

[Dagobert Michelsen]

Hi,

 Am 20.11.2014 um 08:55 schrieb Ángel González keis...@gmail.com:
 
 On 20/11/14 07:34, Darshit Shah wrote:
 And talking about legalities, I'm hoping you already have signed the 
 assignment papers because otherwise that's even more work, before we can add 
 this to the source. :-)
 Come on, that's not needed for trivial changes :)
 The given shell script is a perfect example of trivial patch.
 
 And regarding the required options, I would keep the
 parameter-checking cruft to a minimum.

I would consider this worse than not including it because if you don’t do it 
right
you get all sorts of problems. My main concern is the it should hardcode to
$(bindir)/wget as passed to configure or e.g. /opt/csw/bin/wcat with 
/opt/csw/bin
not in the path would result in invoking the wrong (or none at all) wget. This
requires substitution during configure and not being put in contrib.


Best regards

  — Dago



-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

Re: [Bug-wget] Final error on Solaris: libintl missing during make check

[Dagobert Michelsen]

Hi Tim,

 Am 22.01.2015 um 12:02 schrieb Tim Ruehsen tim.rueh...@gmx.de:
 
 Hi Dago,
 
 could you please send the output of
 
 $ egrep 'INTL|ICONV' config.log|grep LIB
 
 (after ./configure ...) ?

Sure:

 dam@unstable10s [unstable10s]:/home/dam/work/wget  egrep 'INTL|ICONV' 
 config.log|grep LIB
 | #define HAVE_LIBINTL_H 1
 ...
 | #define HAVE_LIBINTL_H 1
 GNULIB_ICONV='1'
 INTLLIBS='-lintl'
 INTL_MACOSX_LIBS=''
 LIBICONV='-liconv'
 LIBINTL='-lintl'
 LTLIBICONV='-liconv'
 LTLIBINTL='-lintl'
 #define HAVE_LIBINTL_H 1

It looks like the LIBS setting between src/Makefile and tests/Makefile is 
different and in tests/Makefile
the relevant libs are missing:

src/Makefile:LIBS = -liconv -lintl -L/opt/csw/lib -lpcre   -luuid -lnettle 
-L/opt/csw/lib -lgnutls   -L/opt/csw/lib -lz   -lsocket -lnsl -lrt  -lidn 
$(LIB_CLOCK_GETTIME)
tests/LIBS = -L/opt/csw/lib -lpcre   -luuid -lnettle -L/opt/csw/lib -lgnutls   
-L/opt/csw/lib -lz   -lsocket -lnsl -lrt  -lidn -lintl -liconv

This tiny patch fixes the issue:

 From 2e6f86b9af53a3f04a228305042da5984a0dc04a Mon Sep 17 00:00:00 2001
 From: Dagobert Michelsen d...@opencsw.org
 Date: Thu, 22 Jan 2015 13:01:29 +0100
 Subject: [PATCH] At least Solaris needs libintl and libiconv for testsuite
 
 ---
  tests/Makefile.am | 2 ++
  1 file changed, 2 insertions(+)
 
 diff --git a/tests/Makefile.am b/tests/Makefile.am
 index ae96f5b..9645743 100644
 --- a/tests/Makefile.am
 +++ b/tests/Makefile.am
 @@ -33,6 +33,8 @@
  # Version: @VERSION@
  #
  
 +LIBS = @LIBICONV@ @LIBINTL@ @LIBS@ $(LIB_CLOCK_GETTIME)
 +
  ../src/wget$(EXEEXT):
 cd ../src  $(MAKE) $(AM_MAKEFLAGS)
  
 -- 
 2.2.1

I have also set up continoue integration on Solaris 10 Sparc and Solaris 10 
i386:
  
https://buildfarm.opencsw.org/buildbot/waterfall?builder=wget-solaris10-i386builder=wget-solaris10-sparcreload=300

If useful I can set up notifications when the build breaks.


Best regards

  — Dago

-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

Re: [Bug-wget] Final error on Solaris: libintl missing during make check

[Dagobert Michelsen]

Hi Darshit,

 Am 23.01.2015 um 02:52 schrieb Darshit Shah dar...@gmail.com:
 
 I guess we should. Since Wget 1.16.1 we have seen a few configure and
 make bug fixes submitted, and also a couple of new features.
 
 @Giuseppe: maybe we can tag Wget 1.16.2 beta and allow the translators
 to translate all the new strings? This will remove the complaints
 about non-translated strings in v1.16* too.

There is no tag yet, can you please proceed? I would really like to push out
an updated package after the CVE.


Best regards

  — Dago


-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

Re: [Bug-wget] [PATCH] Fix for #43785 (ngettext with Solaris 10)

[Dagobert Michelsen]

Hi Kiyoshi,

 Am 05.02.2015 um 09:52 schrieb Tim Ruehsen tim.rueh...@gmx.de:
 I am very confident that we already fixed the problem.
 
 I sent you a tarball for testing on 12 Dec 2014, didn't you get it ?
 
 My text was
 I guess I know what the problem is... strcasestr is not in your (Solaris) 
 libc while it is in most other C standard libraries.
 
 Wget should provide this functionality via gnulib... it just has been 
 overseen 
 because we have no Solaris users testing wget (from git) before a release.
 
 Here is a tarball including strcasestr. Of course, there may be other 
 functions missing... we will see.

The normal building issues on Solaris will hopefully be caught in the future 
early
as the build is now tried on every commit:
  
https://buildfarm.opencsw.org/buildbot/waterfall?builder=wget-solaris10-i386builder=wget-solaris10-sparcreload=300

The current git head is clean on Solaris.


Best regards

  — Dago

-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

[Bug-wget] Final error on Solaris: libintl missing during make check

[Dagobert Michelsen]

Hi folks,

as the last released wget 1.16.1 does not work on Solaris I tried the version 
from GIT
and have one final issue when running the testsuite:

 gmake[4]: Leaving directory '/home/dam/work/wget/src'
 gcc  -I/opt/csw/include   -I/opt/csw/include -I/opt/csw/include/p11-kit-1   
 -DHAVE_LIBGNUTLS -I/opt/csw/include   -DNDEBUG-o unit-tests  
 ../src/libunittest.a ../lib/libgnu.a -L/opt/csw/lib -lpcre   -luuid -lnettle 
 -L/opt/csw/lib -lgnutls   -L/opt/csw/lib -lz   -lsocket -lnsl -lrt  -lidn 
 -lrt -L/opt/csw/lib -lpcre   -luuid -lnettle -L/opt/csw/lib -lgnutls   
 -L/opt/csw/lib -lz   -lsocket -lnsl -lrt  -lidn
 Undefined   first referenced
  symbol in file
 libintl_gettext 
 ../src/libunittest.a(libunittest_a-http.o)  (symbol belongs to implicit 
 dependency /opt/csw/lib/libintl.so.8)
 libintl_textdomain  
 ../src/libunittest.a(libunittest_a-test.o)  (symbol belongs to implicit 
 dependency /opt/csw/lib/libintl.so.8)
 libiconv_close  ../src/libunittest.a(libunittest_a-iri.o) 
  (symbol belongs to implicit dependency /opt/csw/lib/libiconv.so.2) 
 libiconv_open   ../src/libunittest.a(libunittest_a-iri.o) 
  (symbol belongs to implicit dependency /opt/csw/lib/libiconv.so.2) 
 libintl_bindtextdomain  
 ../src/libunittest.a(libunittest_a-test.o)  (symbol belongs to implicit 
 dependency /opt/csw/lib/libintl.so.8)
 libintl_ngettext
 ../src/libunittest.a(libunittest_a-spider.o)  (symbol belongs to implicit 
 dependency /opt/csw/lib/libintl.so.8)
 libiconv../src/libunittest.a(libunittest_a-iri.o) 
  (symbol belongs to implicit dependency /opt/csw/lib/libiconv.so.2)
 ld: fatal: symbol referencing errors. No output written to unit-tests 

It would be very cool if this could be fixed and a new release (1.16.2?) be made
as I have two requests from users for an updated package due to CVE-2014-4877.


Best regards

  — Dago


-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

Re: [Bug-wget] Final error on Solaris: libintl missing during make check

[Dagobert Michelsen]

Hi Tim,

 Am 22.01.2015 um 16:20 schrieb Tim Ruehsen tim.rueh...@gmx.de:
 
 Hi Dago,
 
 +LIBS = @LIBICONV@ @LIBINTL@ @LIBS@ $(LIB_CLOCK_GETTIME)
 
 I pushed a slightly amend version of your patch.
 (Already testet for Solaris 11 on your build farm.)

This looks good. Would it be possible to make an 1.16.2 release?


Best regards

  — Dago


-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

Re: [Bug-wget] bootstrap problem

[Dagobert Michelsen]

Hi,

Am 04.05.2015 um 22:30 schrieb Ángel González keis...@gmail.com:
 On 04/05/15 12:54, Mariusz Balewski wrote:
 it looks like something fishy with your shell.  Could you give us the
 output of ls -l /bin/sh ?
 
 Could you try to run instead bash ./bootstrap ?
 
 Problem already resolved. Bad shebang was the issue. As soon as I
 changed it to #!/bin/bash - everything went well.
 
 Glad you solved it. Which shell was it using?

This is a common problem and also happens e.g. with the Solaris /bin/sh.
I also had to use the bash-construct for the builds:
  https://buildfarm.opencsw.org/buildbot/waterfall?category=wget


Best regards

  — Dago

-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

Re: [Bug-wget] bootstrap problem

[Dagobert Michelsen]

Hi Darshit,

Am 05.05.2015 um 12:23 schrieb Darshit Shah dar...@gmail.com:
 So, is the issue because some platforms are shipping a non-compatible
 version of sh, or is the script incorrectly using bash while only
 claiming to use sh?

The problem is the evaluation with $( ):
  bootstrap: syntax error at line 88: `me_=$’ unexpected

The Solaris Bourne Shell is really one of the „very oldest“ non-POSIX-compatible
Bourne shells:
  http://mywiki.wooledge.org/BashFAQ/082

Last time I talked with Jim Meyering about the problem (unfortunately off-list)
he said that if you bootstrap stuff you are a developer which is expected to 
have
bash at hand. Here, bash is considered similar to autotools which you also need
only to bootstrap.


Best regards

  — Dago

-- 
You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process. - xkcd #896



smime.p7s
Description: S/MIME cryptographic signature

[Bug-wget] Latest versions in GIT failing on Solaris

[Dagobert Michelsen]

Hi,

the latest versions of wget in GIT fail on Solaris:
  https://buildfarm.opencsw.org/buildbot/waterfall?category=wget

This is the error:

 /opt/csw/bin/gcc -DHAVE_CONFIG_H -DSYSTEM_WGETRC=\/usr/local/etc/wgetrc\ 
 -DLOCALEDIR=\/usr/local/share/locale\ -I.  -I../lib -I../lib -D_REENTRANT  
 -I/opt/csw/include   -I/opt/csw/include -I/opt/csw/include   
 -I/opt/csw/include -I/opt/csw/include/p11-kit-1   -DHAVE_LIBGNUTLS 
 -I/opt/csw/include   -I/opt/csw/include   -DNDEBUG  -MT iri.o -MD -MP -MF 
 .deps/iri.Tpo -c -o iri.o iri.c
 
 iri.c: In function 'do_conversion':
 iri.c:149:22: warning: passing argument 2 of 'libiconv' from incompatible 
 pointer type
if (iconv (cd, in, inlen, out, outlen) != (size_t)(-1))
   ^
 In file included from iri.c:36:0:
 /opt/csw/include/iconv.h:83:15: note: expected 'const char **' but argument 
 is of type 'char **'
  extern size_t iconv (iconv_t cd, const char* * inbuf, size_t *inbytesleft, 
 char* * outbuf, size_t *outbytesleft);
^
 
 mv -f .deps/iri.Tpo .deps/iri.Po
 /opt/csw/bin/gcc -DHAVE_CONFIG_H -DSYSTEM_WGETRC=\/usr/local/etc/wgetrc\ 
 -DLOCALEDIR=\/usr/local/share/locale\ -I.  -I../lib -I../lib -D_REENTRANT  
 -I/opt/csw/include   -I/opt/csw/include -I/opt/csw/include   
 -I/opt/csw/include -I/opt/csw/include/p11-kit-1   -DHAVE_LIBGNUTLS 
 -I/opt/csw/include   -I/opt/csw/include   -DNDEBUG  -MT metalink.o -MD -MP 
 -MF .deps/metalink.Tpo -c -o metalink.o metalink.c
 
 metalink.c: In function 'retrieve_from_metalink':
 metalink.c:123:68: error: 'errno' undeclared (first use in this function)
  logprintf (LOG_NOTQUIET, unlink: %s\n, strerror (errno));
 ^
 metalink.c:123:68: note: each undeclared identifier is reported only once for 
 each function it appears in

Would it be useful to setup notifications on build breaks?


Best regards

  -- Dago

Re: [Bug-wget] Wget 1.17 doesn't compile on Windows (hsts.c)

[Dagobert Michelsen]

Hi,

Am 16.11.2015 um 14:53 schrieb Jernej Simončič :
> Looks like hsts.c tries to use flock with a parameter that doesn't
> work on Windows:
> 
> x86_64-w64-mingw32-gcc -DHAVE_CONFIG_H 
> -DSYSTEM_WGETRC=\"/win32dev/misc/wget/out64/etc/wgetrc\" 
> -DLOCALEDIR=\"/win32dev/misc/wget/out64/share/locale\" -I.  -I../lib -I../lib 
> -I/win32dev/misc/wget/out64/include  -I/win32dev/misc/wget/out64/include  
> -DHAVE_LIBSSL  -DNDEBUG  -MT hsts.o -MD -MP -MF .deps/hsts.Tpo -c -o hsts.o 
> hsts.c
> hsts.c: In function 'hsts_store_dump':
> hsts.c:329:20: warning: format '%lu' expects argument of type 'long unsigned 
> int', but argument 6 has type 'time_t' [-Wformat=]
>khi->created, khi->max_age) < 0)
>^
> hsts.c:329:20: warning: format '%lu' expects argument of type 'long unsigned 
> int', but argument 7 has type 'time_t' [-Wformat=]
> hsts.c: In function 'hsts_store_save':
> hsts.c:505:22: error: 'LOCK_EX' undeclared (first use in this function)
>   flock (fd, LOCK_EX);
>  ^
> hsts.c:505:22: note: each undeclared identifier is reported only once for 
> each function it appears in

Same here on Solaris 10 with Oracle Studio 12:

> /opt/csw/bin/gcc -DHAVE_CONFIG_H -DSYSTEM_WGETRC=\"/usr/local/etc/wgetrc\" 
> -DLOCALEDIR=\"/usr/local/share/locale\" -I.  -I../lib -I../lib -D_REENTRANT  
> -I/opt/csw/include   -I/opt/csw/include -I/opt/csw/include   
> -I/opt/csw/include -I/opt/csw/include/p11-kit-1   -DHAVE_LIBGNUTLS 
> -I/opt/csw/include   -I/opt/csw/include   -DNDEBUG  -MT hsts.o -MD -MP -MF 
> .deps/hsts.Tpo -c -o hsts.o hsts.c
> 
> hsts.c: In function 'hsts_store_save':
> hsts.c:505:22: error: 'LOCK_EX' undeclared (first use in this function)
>flock (fd, LOCK_EX);
>   ^
> hsts.c:505:22: note: each undeclared identifier is reported only once for 
> each function it appears in
> 
> Makefile:1573: recipe for target 'hsts.o' failed

Also the builds are failing for quite some time:
  https://buildfarm.opencsw.org/buildbot/waterfall?category=wget

Unfortunately I didn’t get any feedback at all when I mentioned compiling 
issues:
  http://lists.gnu.org/archive/html/bug-wget/2015-07/msg00068.html


Best regards

  — Dago

--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] Wget 1.17 doesn't compile on Windows (hsts.c)

[Dagobert Michelsen]

Hi Tim,

Am 17.11.2015 um 10:36 schrieb Tim Ruehsen <tim.rueh...@gmx.de>:
> On Monday 16 November 2015 22:34:53 Dagobert Michelsen wrote:
>> Same here on Solaris 10 with Oracle Studio 12:
>> 
>>> /opt/csw/bin/gcc -DHAVE_CONFIG_H -DSYSTEM_WGETRC=\"/usr/local/etc/wgetrc\"
>>> -DLOCALEDIR=\"/usr/local/share/locale\" -I.  -I../lib -I../lib
>>> -D_REENTRANT  -I/opt/csw/include   -I/opt/csw/include -I/opt/csw/include
>>> -I/opt/csw/include -I/opt/csw/include/p11-kit-1   -DHAVE_LIBGNUTLS
>>> -I/opt/csw/include   -I/opt/csw/include   -DNDEBUG  -MT hsts.o -MD -MP
>>> -MF .deps/hsts.Tpo -c -o hsts.o hsts.c
>>> 
>>> hsts.c: In function 'hsts_store_save':
>>> hsts.c:505:22: error: 'LOCK_EX' undeclared (first use in this function)
>>> 
>>>   flock (fd, LOCK_EX);
>>> 
>>>  ^
>>> 
>>> hsts.c:505:22: note: each undeclared identifier is reported only once for
>>> each function it appears in
>>> 
>>> Makefile:1573: recipe for target 'hsts.o' failed
>> 
>> Also the builds are failing for quite some time:
>>  https://buildfarm.opencsw.org/buildbot/waterfall?category=wget
>> 
>> Unfortunately I didn’t get any feedback at all when I mentioned compiling
>> issues: http://lists.gnu.org/archive/html/bug-wget/2015-07/msg00068.html
> 
> This is still open here as an issue (but with low priority).
> We are definitely not enough developers here…

Ok.

> These failures might be simple things like a missing include directive.
> It would would be very helpful if you could just tell us "hey, adding this
> line ... fixes it". Thats 10 minutes for you and 10 for us, and voila.

Unfortunately it is not that easy as Solaris does not have „flock“:
  http://www.perkin.org.uk/posts/solaris-portability-flock.html
The requested solution would be to use the POSIX-compliant fcntl(),
at least on Solaris.

I’d be happy to implement a fix, just let me know which version you prefer:
(1) check for flock and fcntl, prefer flock if available
(least invasive to current mode)
(2) Use #ifdef for LOCK_EX and use fcntl instead
(3) always use fcntl

I was worried my fix wouldn’t be good enough for direct inclusion...

> But if compilation fails within your build farm, couldn't you send a mail to
> bug-wget@gnu.org ? I know you already suggested something like this…

Sure, but I didn’t want to set this up without asking to not spam the list
with stuff nobody wants to read :-) To minimize noise I can send email
only when a build transitions from good to bad or vice versa.


Best regards

  — Dago

--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] Wget 1.17 doesn't compile on Windows (hsts.c)

[Dagobert Michelsen]

Hi Tim,

Am 17.11.2015 um 13:14 schrieb Tim Ruehsen :
> I guess, Darshit's patch also fixes this issue for Solaris.

It does, excellent!
  
https://buildfarm.opencsw.org/buildbot/builders/wget-solaris10-i386/builds/92/steps/shell_2/logs/stdio

> I was more referring to
>> issues: http://lists.gnu.org/archive/html/bug-wget/2015-07/msg00068.html
> 
> It seems that metalink.c has to include  instead .
> Maybe could could give it try or otherwise let us know how to fix it for
> Solaris.

Yes, using  instead of  fixes the issue. In fact,
all other sources also use  so this is a perfect solution.

Now only one test is failing:
> FAIL: unit-tests

How does think unit-test-thing work? I can’t find a log or some debug output.

>> Sure, but I didn’t want to set this up without asking to not spam the list
>> with stuff nobody wants to read :-) To minimize noise I can send email
>> only when a build transitions from good to bad or vice versa.
> 
> "Only on build transitions" sounds good to me.
> Please feel free to set notifications up that way.

I have added notification. Now let’s get it to green! :-)


Best regards

  — Dago

--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] Wget 1.17 doesn't compile on Windows (hsts.c)

[Dagobert Michelsen]

Hi Tim,

Am 17.11.2015 um 14:52 schrieb Tim Ruehsen :
> I just pushed the change.

Excellent, the build now runs cleanly.

>> Now only one test is failing:
>>> FAIL: unit-tests
>> 
>> How does think unit-test-thing work? I can’t find a log or some debug
>> output.
> 
> For every test you will have .log file in tests/ resp. testenv/.
> 
> Have a look into tests/unit-tests.log. You'll see what function/test fails.
> Post the output of the failing test here.

I added that to the buildbot-logs to be catched. However, I don’t see an error 
there:

> [DEBUG] Testing...
> 
> RUNNING TEST test_find_key_value...
> PASSED
> 
> RUNNING TEST test_find_key_values...
> PASSED
> 
> RUNNING TEST test_has_key...
> PASSED
> 
> RUNNING TEST test_parse_content_disposition...
> PASSED
> 
> RUNNING TEST test_parse_range_header...
> PASSED
> 
> RUNNING TEST test_subdir_p...
> PASSED
> 
> RUNNING TEST test_dir_matches_p...
> PASSED
> 
> RUNNING TEST test_commands_sorted...
> PASSED
> 
> RUNNING TEST test_cmd_spec_restrict_file_names...
> PASSED
> 
> RUNNING TEST test_path_simplify...
> PASSED
> 
> RUNNING TEST test_append_uri_pathel...
> PASSED
> 
> RUNNING TEST test_are_urls_equal...
> PASSED
> 
> RUNNING TEST test_is_robots_txt_url...
> PASSED
> 
> RUNNING TEST test_hsts_new_entry...
> PASSED
> 
> RUNNING TEST test_hsts_url_rewrite_superdomain...
> A new entry should've been created
> Tests run: 15
> FAIL unit-tests (exit status: 1)

So which test is failing? test_hsts_url_rewrite_superdomain ?
There is no *hsts* in tests/


Best regards

  — Dago

--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] Wget 1.17 doesn't compile on Windows (hsts.c)

[Dagobert Michelsen]

Hi Tim,

Am 17.11.2015 um 21:17 schrieb Tim Rühsen <tim.rueh...@gmx.de>:
> Am Dienstag, 17. November 2015, 15:09:05 schrieb Dagobert Michelsen:
>>> RUNNING TEST test_hsts_url_rewrite_superdomain...
>>> A new entry should've been created
>>> Tests run: 15
>>> FAIL unit-tests (exit status: 1)
>> 
>> So which test is failing? test_hsts_url_rewrite_superdomain ?
>> There is no *hsts* in tests/
>> 
> 
> Could you please change L689 of src/hsts.c from
>  created = hsts_store_entry (s, SCHEME_HTTPS, "www.foo.com", 443, time(NULL)
> + 1234, true);
> 
> to
>  created = hsts_store_entry (s, SCHEME_HTTPS, "www.foo.com", 443, 1234,
> true);
> 
> and give it a try ?

Sorry, still fails.


Best regards

  — Dago

--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] flock is not available on solaris 10 (at least sparc)

[Dagobert Michelsen]

Hi folks,

Am 16.12.2015 um 21:01 schrieb Tim Rühsen :
> Seems pretty clear - gcc 5 has C99 as default standard (and Solaris has gcc
> 5.2).
> But we explicitely define _XOPEN_SOURCE 500 in src/sysdep.h, which says we
> want 'X/Open 5, POSIX 1995' functions and nothing newer.
> Solaris headers just make some checks to ensure proper definitions here and
> they fail.
> 
> When I simply remove the define, everything compiles ok.
> The question is if we still want what the comment says: "/* Request the "Unix
> 98 compilation environment". */". I think, we should allow Wget to be compiled
> on newer environments as well.
> 
> WDYT ?

Just FYI: I updated GCC on the buildfarm recently from 4.9.2 to 5.2.0, so this 
issue
may be a side effect of the update.


Best regards

  — Dago


--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] flock is not available on solaris 10 (at least sparc)

[Dagobert Michelsen]

Hi Tim,

Am 16.12.2015 um 10:52 schrieb Tim Ruehsen :
> On Wednesday 16 December 2015 10:31:33 Giuseppe Scrivano wrote:
>> the gnulib documentation for flock says:
>> 
>>  Portability problems not fixed by Gnulib:
>> 
>>This function is missing on some platforms:
>>AIX 5.1, HP-UX 11.23, Solaris 11 2011-11, BeOS.
>> 
>> This can either be because nobody cared before, or because there is no
>> way to emulate it on these platforms.
>> 
>> Couldn't we replace the flock part with a write to a tmp file+atomic
>> rename?  In the remote case of two wget processes trying to write the
>> same file, at least we won't get garbage there.  What do you think?
> 
> There is no atomic rename for all OSes, AFAIK.
> 
> How about using fcntl() for locking ? The gnulib emulation might be better and
> it is a POSIX function.

This is the suggested workaround on Solaris and also more POSIX-compliant:
  http://www.perkin.org.uk/posts/solaris-portability-flock.html


Best regards

  — Dago

--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] Wget 1.17 doesn't compile on Windows (hsts.c)

[Dagobert Michelsen]

Hi Tim,

Am 18.11.2015 um 11:09 schrieb Tim Ruehsen :
> Hi Dagobert, hi Ander,
> 
> I could reproduce and fix the problem on a 32bit Debian wheezy VM.
> 
> @Dagobert Please check if the attached patch works on Solaris as well

Yes, this fixes the issue. The testsuite now completely passes. Feel free to
commit the patch.


Best regards

  — Dago

--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] Wget 1.17 doesn't compile on Windows (hsts.c)

[Dagobert Michelsen]

Hi Ander,

Am 19.11.2015 um 10:41 schrieb Ander Juaristi :
> On 11/18/2015 11:09 AM, Tim Ruehsen wrote:
>> Hi Dagobert, hi Ander,
>> 
>> I could reproduce and fix the problem on a 32bit Debian wheezy VM.
>> 
>> @Dagobert Please check if the attached patch works on Solaris as well
>> @Ander Please review that I did not get anything wrong
>> 
> 
> I moved the calls to xfree (kh->host) a few lines up because I couldn't pass 
> the unit tests after applying your patch (64-bit Linux Mint). The reason was 
> simply that kh->host had garbage, and thus free() complained.
> 
> And also:
> 
>PASS: Test--post-file.px
>*** Error in `../src/wget': free(): invalid pointer: 0x00d2c5f0 ***
>PASS: Test-proxied-https-auth.px
>*** Error in `../src/wget': free(): invalid pointer: 0x021cc5f0 ***
> 
> @Dagobert please check that it still passes all the tests in Solaris 32-bit. 
> For some reason I couldn't compile it on a 32-bit Debian, and had no time to 
> look into it further.

This works perfectly on a Solaris 10 i386 32 bit.


Best regards

  — Dago

--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] buildbot failure in OpenCSW Buildbot on wget-solaris10-i386

[Dagobert Michelsen]

Hi Tim,

Am 20.11.2015 um 11:20 schrieb Tim Ruehsen :
> please update to gettext 0.19.
> 
> #
> autopoint: *** The AM_GNU_GETTEXT_VERSION declaration in your configure.ac
>   file requires the infrastructure from gettext-0.19 but this
> version
>   is older. Please upgrade to gettext-0.19 or newer.
> autopoint: *** Stop.
> #

I already noticed, however, this is not that easy. Building gettext
is quite a project. Gladly the buildbot for gettext is in place for
quite some time now. I’ll keep you posted.


Best regards

  — Dago

--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] buildbot failure in OpenCSW Buildbot on wget-solaris10-i386

[Dagobert Michelsen]

Hi Tim,

Am 20.11.2015 um 11:56 schrieb Tim Ruehsen :
> we will likely change the gettext requirements to 0.18.1.

As we already have 0.18.1.1 this would be really convenient for the moment.
I’ll continue to work on 0.19.6, though. Laurent is still backporting
thread-fixes from the Solaris repo for libgpg-error.


Best regards

  — Dago


--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] Wget 1.17 doesn't compile on Windows (hsts.c)

[Dagobert Michelsen]

Hi Tim,

Am 19.11.2015 um 12:25 schrieb Tim Ruehsen :
> Thanks - good catch, Ander !

Now Solaris 10 i386 passes cleanly but Sparc dumps core. The core looks like 
this:

> buildbot@unstable10s [unstable10s]:~/slave/wget-solaris10-sparc/build/tests > 
> pstack core
> core 'core' of 28070:   ../src/wget --version
>  feccebc4 _lwp_kill (6, 0, 0, fecae06c, , 6) + 8
>  fec429b0 abort(ff0d35ec, 1, ff0ee3e0, ffb3c, fed45518, 0) + 110
>  ff0d35b8 get_lock_object (ff0eea64, ff0d2fa8, ff0d6e68, ff0d6c98, 1, 0) + 4
>  ff0d35f0 _gpgrt_lock_lock (ff0eea64, ffbfe594, 0, ff, 0, 1) + 4
>  ff0d6d60 _gpgrt_fflush (0, 0, ff0eea64, 0, 0, 0) + c8
>  ff0d6e68 do_deinit (1, 1cc4, fed47940, fed492c0, feb02a40, 1c00) + 10
>  fec43178 _exithandle (fed49540, fed47940, 1c00, a, 7fff, 6e752e) + 40
>  fec31138 exit (0, e51d0, 2805, 3d, 3d, 3d) + 4
>  0004fcbc print_version (93, ffbfe95c, e41a0, e2db0, ffbfe864, 3) + 574
>  00050334 main (2, ffbfe95c, ffbfe968, e5590, feb00180, 0) + 66c
>  000184e8 _start   (0, 0, 0, 0, 0, 0) + 5c
> buildbot@unstable10s [unstable10s]:~/slave/wget-solaris10-sparc/build/tests > 
> pldd core
> core 'core' of 28070:   ../src/wget --version
> /opt/csw/lib/libiconv.so.2.5.1
> /opt/csw/lib/libintl.so.8.1.1
> /opt/csw/lib/libpcre.so.1.2.5
> /opt/csw/lib/libuuid.so.1.0.0
> /opt/csw/lib/libgpgme.so.11.13.0
> /opt/csw/lib/libassuan.so.0.4.2
> /lib/libsocket.so.1
> /opt/csw/lib/libgpg-error.so.0.13.0
> /opt/csw/lib/libmetalink.so.3.1.0
> /opt/csw/lib/libnettle.so.6.1
> /opt/csw/lib/libgnutls.so.28.21.5
> /opt/csw/lib/libz.so.1.2.8
> /opt/csw/lib/libpsl.so.0.2.4
> /lib/libnsl.so.1
> /lib/librt.so.1
> /opt/csw/lib/libidn.so.11.6.9
> /lib/libc.so.1
> /lib/libaio.so.1
> /lib/libmd.so.1
> /opt/csw/lib/libgcc_s.so.1
> /opt/csw/lib/libp11-kit.so.0.0.0
> /lib/libm.so.1
> /lib/libdl.so.1
> /lib/libpthread.so.1
> /opt/csw/lib/libnettle.so.4.7
> /platform/sun4v/lib/libc_psr.so.1
> buildbot@unstable10s [unstable10s]:~/slave/wget-solaris10-sparc/build/tests > 
> ../src/wget
> wget: missing URL
> Usage: wget [OPTION]... [URL]...
> 
> Try `wget --help' for more options.
> Abort (core dumped)

The stacktrace does not ring a bell for me, maybe someone else has seen
this issue during exit callback handling?


Best regards

  — Dago


--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] Wget 1.19 released !

[Dagobert Michelsen]

Hi Tim,

Am 03.02.2017 um 13:38 schrieb Tim Ruehsen :
> we are pleased to announce the new version of GNU wget 1.19.

I just noticed a tiny issue: when there is a system-wide wgetrc which
reroutes requests a lot of tests fail. This should be deactivated when
running the testsuite.


Best regards

  — Dago

--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] buildbot failure in OpenCSW Buildbot on wget-solaris10-i386

[Dagobert Michelsen]

Hi Tim,

Am 17.08.2016 um 21:52 schrieb Tim Rühsen :
> Please update libpsl. Looks like you have a rather outdated version.

Sure, this lead to a pull request ragrding libicu setup :-)
New libpsl is pushed to OpenCSW unstable, same for new
public-suffix-list (I take
  https://publicsuffix.org/list/public_suffix_list.dat
instead of the one from Mozilla, is there a difference?)
The new package is installed on the buildfarm and the wget build
looks better.


Best regards

  — Dago

> On Mittwoch, 17. August 2016 21:20:45 CEST build...@opencsw.org wrote:
>> The Buildbot has detected a new failure on builder wget-solaris10-i386 while
>> building wget. Full details are available at:
>> https://buildfarm.opencsw.org/buildbot/builders/wget-solaris10-i386/builds/
>> 167
>> 
>> Buildbot URL: https://buildfarm.opencsw.org/buildbot/
>> 
>> Buildslave for this Build: unstable10x
>> 
>> Build Reason: scheduler
>> Build Source Stamp: [branch master] 262baeb11379a2765507455569d16abfa94947c0
>> Blamelist: Tim Rühsen 
>> 
>> BUILD FAILED: failed shell_2 shell_3
>> 
>> sincerely,
>> -The Buildbot
> 

--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: [Bug-wget] help

[Dagobert Michelsen]

Hi Daniel,

Am 15.03.2017 um 14:34 schrieb Zhou, Daniel K. (LARC-E303) 
:
> Hi, I did
> 
> Wget 
> https://n5eil01u.ecs.nsidc.org/DP4/SMAP/SPL4SMGP.002/2015.04.03/SMAP_L4_SM_gph_20150403T073000_Vv2030_001.h5
> 
> And the file “SMAP_L4_SM_gph_20150403T073000_Vv2030_001.h5” download is not a 
> h5 file but a small text file.  What did I do wrong?  Thanks so much.

You need to authenticate, this is the login page. It looks like you need OAUTH, 
try something like
  https://gist.github.com/fourdollars/6027400 



Best regards

  — Dago

--
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896



signature.asc
Description: Message signed with OpenPGP

Re: [Bug-wget] bug report of installing texlive 2018 windows

[Dagobert Michelsen]

Hi Fenghao,

Am 10.05.2018 um 07:43 schrieb Fenghao Xu :
> I met a problem when installing texlive 2018 windows. Can you help figure out 
> what went wrong? Below is a copy of code from install-tl-window.bat.

Your problem does not seem to be related with wget, but with the installation
of texlive itself. I suggest to ask on the texlive mailing list for help 
instead.


Best regards

  — Dago

-- 
"You don't become great by trying to be great, you become great by wanting to 
do something,
and then doing it so hard that you become great in the process." - xkcd #896