Re: [BUILD] downloading of resources during bootstrap

2012-10-17 Thread Andre Fischer

On 02.10.2012 17:53, Andrew Rist wrote:
The linux32 buildbot is not able to download all of the required 
resources during bootstrap:
http://ci.apache.org/builders/openoffice-linux32-nightly/builds/268/steps/compile_2/logs/stdio 



I just commited a change that replaces the use of the Perl module 
LWP::UserAgent with LWP::Simple.  LWP::Simple is used also when updating 
Perl modules from CPAN and hopefully is more robust.


It is intended as a temporary change to find out whether this fixes the 
buildbot problems of multiple and incompatible Perl versions.


The affected file is main/solenv/bin/download_external_dependencies.pl.  
SVN revision is 1399155.


Regards,
Andre


Linux32 buildbot (was Re: [BUILD] downloading of resources during bootstrap)

2012-10-16 Thread Herbert Duerr
For the last few weeks the linux32 buildbot failed to produces binaries 
due to failed downloads in the bootstrap step:

  perl: symbol lookup error: [...]
  Parser.so: undefined symbol: Perl_Istack_sp_ptr

On 02.10.2012 20:42, Andrew Rist wrote:

I'm mucking around with adding $agent-env_proxy; to download_ext_dep.pl
so that it punches through a proxy when present.  Hopefully this will go
part of the way toward fixing the issues.  (also - do agree that reload
of perl on linux32 may solve issues there)


Reloading perl might help indeed. Maybe even running
   perl -MCPAN -e upgrade HTML::Parser
is sufficient...

Can someone with karma on buildslave20 please do this?

Herbert


Re: Linux32 buildbot (was Re: [BUILD] downloading of resources during bootstrap)

2012-10-16 Thread Kay Schenk



On 10/16/2012 05:07 AM, Herbert Duerr wrote:

For the last few weeks the linux32 buildbot failed to produces binaries
due to failed downloads in the bootstrap step:
   perl: symbol lookup error: [...]
   Parser.so: undefined symbol: Perl_Istack_sp_ptr

On 02.10.2012 20:42, Andrew Rist wrote:

I'm mucking around with adding $agent-env_proxy; to download_ext_dep.pl
so that it punches through a proxy when present.  Hopefully this will go
part of the way toward fixing the issues.  (also - do agree that reload
of perl on linux32 may solve issues there)


Reloading perl might help indeed. Maybe even running
perl -MCPAN -e upgrade HTML::Parser
is sufficient...

Can someone with karma on buildslave20 please do this?

Herbert



If this is a backend thing (on the vm for the buildbot), a jira ticket 
to infra is probably needed.

--

MzK

Anyone who considers protocol unimportant has never
 dealt with a cat.
   -- Robert Heinlein


Re: Linux32 buildbot (was Re: [BUILD] downloading of resources during bootstrap)

2012-10-16 Thread Herbert Duerr

On 10/16/2012 09:13 PM, Kay Schenk wrote:

On 10/16/2012 05:07 AM, Herbert Duerr wrote:

Can someone with karma on buildslave20 please do this?
[...]

If this is a backend thing (on the vm for the buildbot), a jira ticket
to infra is probably needed.


According to the FAQ on contacting infra (Do ask in your project 
whether someone has the karma to implement the requested change before 
asking infra) and knowing that we have members with the karma I wanted 
to ask here first, as this could save a lot of time.


Herbert


Re: Linux32 buildbot (was Re: [BUILD] downloading of resources during bootstrap)

2012-10-16 Thread Kay Schenk



On 10/16/2012 02:45 PM, Herbert Duerr wrote:

On 10/16/2012 09:13 PM, Kay Schenk wrote:

On 10/16/2012 05:07 AM, Herbert Duerr wrote:

Can someone with karma on buildslave20 please do this?
[...]

If this is a backend thing (on the vm for the buildbot), a jira ticket
to infra is probably needed.


According to the FAQ on contacting infra (Do ask in your project
whether someone has the karma to implement the requested change before
asking infra) and knowing that we have members with the karma I wanted
to ask here first, as this could save a lot of time.

Herbert


ah, I see...OK.  I was not aware of this.

--

MzK

Anyone who considers protocol unimportant has never
 dealt with a cat.
   -- Robert Heinlein


[BUILD] downloading of resources during bootstrap

2012-10-02 Thread Andrew Rist
The linux32 buildbot is not able to download all of the required 
resources during bootstrap:

http://ci.apache.org/builders/openoffice-linux32-nightly/builds/268/steps/compile_2/logs/stdio

I have a similar problem on my local build with the resources for vigra, 
zlib, jpeg, boost (and dmake) not downloading successfully.
This changed when we moved the resources out of svn (???).  What has 
changed ? and what speciffically is used to download the resources now?
(on my local machine, I think part of the issue is the proxy combined 
with a redirect - not sure about the buildbot)


help??

A.


Re: [BUILD] downloading of resources during bootstrap

2012-10-02 Thread Andre Fischer

On 02.10.2012 17:53, Andrew Rist wrote:
The linux32 buildbot is not able to download all of the required 
resources during bootstrap:
http://ci.apache.org/builders/openoffice-linux32-nightly/builds/268/steps/compile_2/logs/stdio 





My guess is that the jpeg source can not be downloaded from its home 
server and that the Perl module that handles the HTTP error triggers the 
loading of a library that does not exist or exists in a wrong (old) version.

If that is true, then updating Perl might fix this.

-Andre


I have a similar problem on my local build with the resources for 
vigra, zlib, jpeg, boost (and dmake) not downloading successfully.
This changed when we moved the resources out of svn (???).  What has 
changed ? and what speciffically is used to download the resources now?
(on my local machine, I think part of the issue is the proxy combined 
with a redirect - not sure about the buildbot)


help??

A.




Re: [BUILD] downloading of resources during bootstrap

2012-10-02 Thread Pedro Giffuni
Hi Andrew;
 
We agreed to completely drop the Category- B tarballs from SVN before 
graduation. We
haven't really done it yet but additionaly removing the Category-A was planned 
in
order to comply with infra's policy.
 
When updating components I have, in general, stopped uploading the 
src tarballs to SVN
in favor of distributing them though ooo-extras @apache-extras: (not all are 
used)
http://code.google.com/a/apache-extras.org/p/ooo-extras/downloads/list
 
The build scripts are ready for it but it seems like the buildbot doesn't like 
fetching more
stuff (?). Can we have the buildbot cache those files?
 
Pedro.



 From: Andrew Rist andrew.r...@oracle.com
To: ooo-dev ooo-dev@incubator.apache.org 
Sent: Tuesday, October 2, 2012 10:53 AM
Subject: [BUILD] downloading of resources during bootstrap
  
The linux32 buildbot is not able to download all of the required resources 
during bootstrap:
http://ci.apache.org/builders/openoffice-linux32-nightly/builds/268/steps/compile_2/logs/stdio

I have a similar problem on my local build with the resources for vigra, zlib, 
jpeg, boost (and dmake) not downloading successfully.
This changed when we moved the resources out of svn (???).  What has changed ? 
and what speciffically is used to download the resources now?
(on my local machine, I think part of the issue is the proxy combined with a 
redirect - not sure about the buildbot)

help??

A.


   

Re: [BUILD] downloading of resources during bootstrap

2012-10-02 Thread Ariel Constenla-Haile
On Tue, Oct 02, 2012 at 10:18:40AM -0700, Pedro Giffuni wrote:
 Hi Andrew;
  
 We agreed to completely drop the Category- B tarballs from SVN before 
 graduation. We
 haven't really done it yet but additionaly removing the Category-A was 
 planned in
 order to comply with infra's policy.
  
 When updating components I have, in general, stopped uploading the 
 src tarballs to SVN
 in favor of distributing them though ooo-extras @apache-extras: (not all are 
 used)
 http://code.google.com/a/apache-extras.org/p/ooo-extras/downloads/list
  
 The build scripts are ready for it but it seems like the buildbot doesn't 
 like fetching more
 stuff (?). Can we have the buildbot cache those files?

There is a   

--with-external-tar=TARFILE PATH   Specify path to tarfiles manually

that could be used to cache the tar files and simplify the build bots
job (though once in a while they should fetch the files, to test that
fetching works)

I have no idea if that option still works, or got broken with the
changes.


Regards
-- 
Ariel Constenla-Haile
La Plata, Argentina


pgpqurmJSBUVc.pgp
Description: PGP signature