Re: [OpenDaylight Infrastructure] javadoc job failure since openjdk11 is enabled on verify jobs

[Lori Jakab]

Adding helpdesk.

I suppose SET_JDK_VERSION should not be an array.

-Lori

On Tue, Jan 15, 2019 at 3:08 PM Lori Jakab  wrote:
>
> Hi,
>
> Since we enabled openjdk on the lispflowmapping verify jobs, the
> javadoc jobs fail. Here's the relevant error:
>
> [...]
> 12:59:37 SET_JDK_VERSION=['openjdk8', 'openjdk11']
> 12:59:37 GIT_URL="git://devvexx.opendaylight.org/mirror"
> 12:59:37
> 12:59:37 [EnvInject] - Variables injected successfully.
> 12:59:37 [lispflowmapping-maven-javadoc-verify-neon] $ /bin/bash
> /tmp/jenkins5972233586480937100.sh
> 12:59:37 ---> Updating Java version
> 12:59:37 ---> RedHat type system detected
> 12:59:37 failed to read link /usr/bin/javac: No such file or directory
> 12:59:37 /tmp/jenkins5972233586480937100.sh: line 58: java: command not found
> 12:59:37 JAVA_HOME=/usr/lib/jvm/java-1.['8', '11'].0-openjdk
> [...]
> 12:59:37 The JAVA_HOME environment variable is not defined correctly
> 12:59:37 This environment variable is needed to run this program
> 12:59:37 NB: JAVA_HOME should point to a JDK not a JRE
> 12:59:37 Build step 'Execute shell' marked build as failure
>
> Full log: 
> https://jenkins.opendaylight.org/releng/job/lispflowmapping-maven-javadoc-verify-neon/63/console
>
> Hope someone can take a look a propose a fix (probably to jjb?)
>
> Thanks,
> -Lori
___
infrastructure mailing list
infrastructure@lists.opendaylight.org
https://lists.opendaylight.org/mailman/listinfo/infrastructure

Re: [OpenDaylight Infrastructure] [opendaylight.org #67157] Re: javadoc job failure since openjdk11 is enabled on verify jobs

[Lori Jakab]

On Thu, Jan 17, 2019 at 2:20 PM Anil Belur via RT
 wrote:
>
> On Thu Jan 17 01:13:50 2019, askb wrote:
> > On Wed Jan 16 13:31:24 2019, lorand.ja...@gmail.com wrote:
> > > Adding helpdesk.
> > >
> > > I suppose SET_JDK_VERSION should not be an array.
> > >
> > > -Lori
> >
> > Greetings Lori:
> >
> > This approach for passing multiple java-versions (openjdk8 and
> > openjdk11) seem
> > to work for the maven-verify jobs but not for the javadocs-verify
> > jobs. This is because JJB ${job-name} expansion is handling the
> > ${java-version} when the job name has a variable name included. When
> > the job name does not have the ${java-version} this is passed as a
> > list to the job.
> >
> > I think we may need to make the scripts a little intelligence to
> > handle these scenarios or simply fix this in the job which requires to
> > be changed in global-jjb. I've have noted this in Jira and will work
> > on fixing this in global-jjb to make sure this works properly for
> > other jobs too.
> >
> > https://jira.linuxfoundation.org/browse/RELENG-1648
> >
> > Thanks,
> > Anil
>
> Hello Lori:
>
> The below change in global-jjb should fix the issue with javadocs jobs.
>
> https://gerrit.linuxfoundation.org/infra/#/c/14233/
>
> I've tested extending the jobs name with java-version on sandbox which works 
> correctly.
>
> https://jenkins.opendaylight.org/sandbox/job/lispflowmapping-maven-javadoc-verify-neon-openjdk11
> https://jenkins.opendaylight.org/sandbox/job/lispflowmapping-maven-javadoc-verify-neon-openjdk8

Thanks for fixing the jobs!

But I feel that this may be a waste of the already scarce infra
resources, for this Javadoc job the default JDK that the use for the
merge job should suffice. Especially if more projects will start
adding openjdk11 verify jobs, this may be significant added load.

Best regards,
-Lori

>
> Thanks,
> Anil
___
infrastructure mailing list
infrastructure@lists.opendaylight.org
https://lists.opendaylight.org/mailman/listinfo/infrastructure

Re: [OpenDaylight Infrastructure] [release] ODL Nexus is down - auth failures.

[Lori Jakab]

Hi,

Are the below coala failures related or a different issue?

https://git.opendaylight.org/gerrit/#/c/79507/
https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/builder-tox-verify-master/3386/tox/coala/coala-5.log.gz

Thanks,
-Lori

On Mon, Jan 14, 2019 at 1:29 PM Anil Belur  wrote:
>
> Hello Everyone,
>
> Presently, we are having some issues with ODL Nexus system and noticing auth 
> failures. LF IT team is working on resolving the issue. If any jobs are 
> affected jobs please note these jobs will need to be restarted.
>
> Apologies for the inconveniences.
>
> Anil
>
>
> ___
> infrastructure mailing list
> infrastructure@lists.opendaylight.org
> https://lists.opendaylight.org/mailman/listinfo/infrastructure
___
infrastructure mailing list
infrastructure@lists.opendaylight.org
https://lists.opendaylight.org/mailman/listinfo/infrastructure

[OpenDaylight Infrastructure] LISPflowmapping performance CSIT failing

[Lori Jakab]

Hi,

For a while the lispflowmapping performance tests on Jenkins have been
failing, first intermittently, but now the Neon and Oxygen tests fail
almost always:

https://jenkins.opendaylight.org/releng/view/lispflowmapping/job/lispflowmapping-csit-1node-performance-only-neon/
https://jenkins.opendaylight.org/releng/view/lispflowmapping/job/lispflowmapping-csit-1node-performance-only-fluorine/
https://jenkins.opendaylight.org/releng/view/lispflowmapping/job/lispflowmapping-csit-1node-performance-only-oxygen/

This is the error message that I found most likely to be useful:
"Caused: java.io.IOException: Backing channel
'prd-centos7-robot-2c-8g-42785' is disconnected." see the bottom of
the full console log:

https://jenkins.opendaylight.org/releng/view/lispflowmapping/job/lispflowmapping-csit-1node-performance-only-neon/90/console

Performance jobs use two VMs for the tests, and it looks like during
the tests the connection from the main VM to the slave is broken. I
couldn't find any clues for the root of the problem in these logs.

Any ideas on how to fix this? Unless the problem is fixed, these tests
just waste infra resources, so the sensible thing to do would be to
disable them, which is not the outcome I would prefer. The only other
project that seems to still have performance tests is SXP, their tests
at least finish, but not without failures, so I don't know how much
they are affected by this issue. MDSAL used to have performance tests
too, but I cant find them anymore.

-Lori
___
infrastructure mailing list
infrastructure@lists.opendaylight.org
https://lists.opendaylight.org/mailman/listinfo/infrastructure

[OpenDaylight Infrastructure] CSIT jobs failing

[Lori Jakab]

Hi,

Some of our CSIT jobs, especially the 3-node jobs are failing since October
21. Examples in [0],[1],[2]...

The relevant log snippet:

*09:35:26* 3: Waiting for 10 minutes to create
releng-lispflowmapping-csit-3node-msmr-all-oxygen-23.*09:36:30* 1:
CREATE_IN_PROGRESS*09:36:30* Waiting to initialize
infrastructure.*09:37:34* 2: CREATE_IN_PROGRESS*09:37:34* Waiting to
initialize infrastructure.*09:38:38* 3: CREATE_IN_PROGRESS*09:38:38*
Waiting to initialize infrastructure.*09:39:43* 4:
CREATE_IN_PROGRESS*09:39:43* Waiting to initialize
infrastructure.*09:40:48* 5: CREATE_IN_PROGRESS*09:40:48* Waiting to
initialize infrastructure.*09:41:53* 6: CREATE_IN_PROGRESS*09:41:53*
Waiting to initialize infrastructure.*09:42:57* 7:
CREATE_IN_PROGRESS*09:42:57* Waiting to initialize
infrastructure.*09:44:02* 8: CREATE_IN_PROGRESS*09:44:02* Waiting to
initialize infrastructure.*09:45:07* 9: CREATE_IN_PROGRESS*09:45:07*
Waiting to initialize infrastructure.*09:46:10* 10:
CREATE_FAILED*09:46:10* ERROR: Failed to initialize infrastructure.
Deleting stack and possibly retrying to create...


Any ideas? Is there a known issue?


-Lori


[0] 
https://jenkins.opendaylight.org/releng/view/lispflowmapping/job/lispflowmapping-csit-3node-msmr-all-carbon/396/console

[1] 
https://jenkins.opendaylight.org/releng/view/lispflowmapping/job/lispflowmapping-csit-3node-msmr-all-nitrogen/199/console

[2] 
https://jenkins.opendaylight.org/releng/view/lispflowmapping/job/lispflowmapping-csit-3node-msmr-all-oxygen/26/console
___
infrastructure mailing list
infrastructure@lists.opendaylight.org
https://lists.opendaylight.org/mailman/listinfo/infrastructure

[OpenDaylight Infrastructure] NetAddr Python package missing in one of the CSIT images

[Lori Jakab]

Hi,

The lispflowmapping performance tests have been failing for (quite) a
while. Looking at the root cause, it looks like the netaddr Python package
is missing on the Robot image:

https://logs.opendaylight.org/releng/jenkins092/lispflowmapping-csit-1node-performance-only-carbon/617/archives/log.html.gz

Not sure why it was removed (accidentally?), but can someone please put it
back?

Thanks,
-Lori
___
infrastructure mailing list
infrastructure@lists.opendaylight.org
https://lists.opendaylight.org/mailman/listinfo/infrastructure

Re: [OpenDaylight Infrastructure] [release] [OpenDaylight Discuss] Certificate changes

[Lori Jakab]

On Thu, Mar 23, 2017 at 10:35 PM, Colin Dixon  wrote:

> (Dropping TSC.)
>
> Actually, I'm still working my way through this. I cannot seem to get my
> Mac to trust the new ODL nexus cert. Even following Anil's suggestions
> above and then trying it with -Djavax.net.ssl.
> trustStore=$JAVA_HOME/jre/lib/security/cacerts and I still get lots of
> errors like:
> [WARNING] Could not transfer metadata org.opendaylight.netconf:
> netconf-client:1.2.0-SNAPSHOT/maven-metadata.xml from/to
> opendaylight-snapshot (https://nexus.opendaylight.
> org/content/repositories/opendaylight.snapshot/): 
> sun.security.validator.ValidatorException:
> PKIX path building failed: 
> sun.security.provider.certpath.SunCertPathBuilderException:
> unable to find valid certification path to requested target
>

FWIW, I don't have issues building on a Mac using Oracle Java 1.8.0_121.

-Lori


>
> I'll keep shaving the Yak for a bit. I suspect moving to Linux and OpenJDK
> would fix it.
>
> --Colin
>
>
> On Thu, Mar 23, 2017 at 4:26 PM, Ed Warnicke  wrote:
>
>> Do we know what the root cause is of having to use that?
>>
>> Ed
>>
>> On Thu, Mar 23, 2017 at 1:24 PM, Colin Dixon 
>> wrote:
>>
>>> While the -Djavax.net.ssl.trustStore=$JAVA_HOME/jre/lib/security/cacerts
>>> option fixes the problem, it feels like the "wrong" answer. Is there a
>>> right answer?
>>>
>>> --Colin
>>>
>>>
>>> On Mon, Mar 20, 2017 at 8:05 AM, Vishal Thapar <
>>> vishal.tha...@ericsson.com> wrote:
>>>
 Thank you Ivan, this worked for me.



 *From:* Ivan Hraško [mailto:ivan.hra...@pantheon.tech]
 *Sent:* 20 March 2017 15:44
 *To:* Vishal Thapar ; Anil Belur <
 abe...@linuxfoundation.org>
 *Cc:* t...@lists.opendaylight.org; OpenDaylight Discuss <
 disc...@lists.opendaylight.org>; rele...@lists.opendaylight.org;
 OpenDaylight Infrastructure 
 *Subject:* Re: [release] [OpenDaylight Discuss] Certificate changes



 Hi



 you can try:



 mvn clean install -Djavax.net.ssl.trustStore=$JAVA_HOME
 /jre/lib/security/cacerts



 maybe it helps
 --

 *Od:* Vishal Thapar 
 *Odoslané:* 20. marca 2017 11:04
 *Komu:* Anil Belur
 *Kópia:* t...@lists.opendaylight.org; OpenDaylight Discuss;
 rele...@lists.opendaylight.org; OpenDaylight Infrastructure
 *Predmet:* Re: [release] [OpenDaylight Discuss] Certificate changes



 Hi Anil,



 I got the certificate downloaded and checked my cert store to confirm
 also, but still getting the same error.



 Regards,

 Vishal.



 *From:* Anil Belur [mailto:abe...@linuxfoundation.org
 ]
 *Sent:* 20 March 2017 14:48
 *To:* Vishal Thapar 
 *Cc:* Andrew Grimberg ; OpenDaylight
 Discuss ; OpenDaylight Infrastructure <
 infrastructure@lists.opendaylight.org>; rele...@lists.opendaylight.org;
 t...@lists.opendaylight.org
 *Subject:* Re: [OpenDaylight Discuss] [release] Certificate changes







 On Mon, Mar 20, 2017 at 5:41 PM, Vishal Thapar <
 vishal.tha...@ericsson.com> wrote:

 Hi Andrew,

 I am facing cert issues when trying to build locally. Does this require
 any specific version of Java? Do I need to manually update certificates?

 This is what I have:
 $ java -version
 java version "1.8.0_60"
 Java(TM) SE Runtime Environment (build 1.8.0_60-b27)
 Java HotSpot(TM) 64-Bit Server VM (build 25.60-b23, mixed mode)

 This is the error I am getting:

 Downloading: https://nexus.opendaylight.org
 /content/repositories/opendaylight.snapshot/org/opendaylight
 /neutron/model/0.8.0-SNAPSHOT/maven-metadata.xml
 [WARNING] Could not transfer metadata org.opendaylight.neutron:model
 :0.8.0-SNAPSHOT/maven-metadata.xml from/to opendaylight-snapshot (
 https://nexus.opendaylight.org/content/reposit
 ories/opendaylight.snapshot/
 ):
 sun.security.validator.ValidatorException: PKIX path building failed:
 sun.security.provider.certpath.SunCertPathBuilderException: unable to
 find vali
 d certification path to requested target



 Hello Vishal,



 This possibly looks like the cert chain may not be imported into your
 $JAVA_HOME key store. For fixing this, I would try downloading the cert
 file and using keytool to import the certificate{s}.



 --[cut]--

 openssl s_client -connect nexus.opendaylight.org:443 < /dev/null | sed
 -ne 

[OpenDaylight Infrastructure] [opendaylight.org #33382] [linuxfoundation.org #33382] Re: [opendaylight-dev] Jenkins queue at 500+ entries

[Lori Jakab via RT]

Well, we had a few jobs fail with "java.util.concurrent.ExecutionException:
org.jclouds.rest.AuthorizationException: {"forbidden": {"message": "Quota
exceeded for instances: Requested 1, but already used 250 of 250
instances", "code": 403}}". Not sure about lost jobs though...

On Mon, Nov 28, 2016 at 6:31 PM, Jamo Luhrsen <jluhr...@gmail.com> wrote:

> Lori,
>
> Somehow it seems to be better now.  I just looked for the first time today
> and the queue is only ~40
>
> I wonder if we lost a bunch of jobs somehow?
>
> JamO
>
> On 11/28/2016 02:41 AM, Lori Jakab wrote:
> > Hi,
> >
> > Just an FYI, the Jenkins queue is currently at over 500 entries, so jobs
> may take a while, can someone please take a look?
> >
> > Thanks,
> > -Lori
> >
> >
> > ___
> > dev mailing list
> > d...@lists.opendaylight.org
> > https://lists.opendaylight.org/mailman/listinfo/dev
> >
>

___
infrastructure mailing list
infrastructure@lists.opendaylight.org
https://lists.opendaylight.org/mailman/listinfo/infrastructure

Re: [OpenDaylight Infrastructure] [opendaylight-dev] Jenkins queue at 500+ entries

[Lori Jakab]

Well, we had a few jobs fail with "java.util.concurrent.ExecutionException:
org.jclouds.rest.AuthorizationException: {"forbidden": {"message": "Quota
exceeded for instances: Requested 1, but already used 250 of 250
instances", "code": 403}}". Not sure about lost jobs though...

On Mon, Nov 28, 2016 at 6:31 PM, Jamo Luhrsen <jluhr...@gmail.com> wrote:

> Lori,
>
> Somehow it seems to be better now.  I just looked for the first time today
> and the queue is only ~40
>
> I wonder if we lost a bunch of jobs somehow?
>
> JamO
>
> On 11/28/2016 02:41 AM, Lori Jakab wrote:
> > Hi,
> >
> > Just an FYI, the Jenkins queue is currently at over 500 entries, so jobs
> may take a while, can someone please take a look?
> >
> > Thanks,
> > -Lori
> >
> >
> > ___
> > dev mailing list
> > d...@lists.opendaylight.org
> > https://lists.opendaylight.org/mailman/listinfo/dev
> >
>
___
infrastructure mailing list
infrastructure@lists.opendaylight.org
https://lists.opendaylight.org/mailman/listinfo/infrastructure

[OpenDaylight Infrastructure] Jenkins queue at 500+ entries

[Lori Jakab]

Hi,

Just an FYI, the Jenkins queue is currently at over 500 entries, so jobs
may take a while, can someone please take a look?

Thanks,
-Lori
___
infrastructure mailing list
infrastructure@lists.opendaylight.org
https://lists.opendaylight.org/mailman/listinfo/infrastructure

Re: [OpenDaylight Infrastructure] Jenkins merge job result: XXXX (skipped)

[Lori Jakab]

Thanks Alexis!

-Lori

On Wed, Oct 19, 2016 at 3:18 PM, Alexis de Talhouët <adetalho...@inocybe.com
> wrote:

> Lori,
>
> This seems to be related to this patch: https://git.
> opendaylight.org/gerrit/#/c/47075/
> Explanation is on the commit message.
>
> Thanks,
> Alexis
>
> On Oct 19, 2016, at 2:08 AM, Lori Jakab <lorand.jakab+...@gmail.com>
> wrote:
>
> Hi,
>
> I observed that lately all merge jobs outcomes have "(skipped)" added, for
> example "SUCCESS (skipped)" or "UNSTABLE (skipped)". What exactly is
> skipped? Is this something that we have to worry about?
>
> Thanks,
> -Lori
> ___
> infrastructure mailing list
> infrastructure@lists.opendaylight.org
> https://lists.opendaylight.org/mailman/listinfo/infrastructure
>
>
>
___
infrastructure mailing list
infrastructure@lists.opendaylight.org
https://lists.opendaylight.org/mailman/listinfo/infrastructure