Hi all, Davor asked me to investigate this issue. It seems like Jenkins might see no code changes between the earlier build and the newer ones and thus just reuse old results? Amit, have you tried just changing something trivial in the PR, generating a new commit, and seeing if that kicks off a new Jenkins build?
Jason On Mon, Mar 14, 2016 at 10:05 AM, Jean-Baptiste Onofré <[email protected]> wrote: > Let's get in touch to see what's going on. > > Thanks, > Regards > JB > > > On 03/14/2016 06:01 PM, Davor Bonaci wrote: > >> We are investigating. >> >> On Sun, Mar 13, 2016 at 11:49 PM, Amit Sela <[email protected]> wrote: >> >> Thanks JB, >>> >>> I've tried to rebuild (#64) but it seems as if it ignores the PR code >>> although it states it's a rebuild of the original PR build (#61). >>> >>> Was anything else changed ? >>> >>> On Mon, Mar 14, 2016 at 2:48 AM Jean-Baptiste Onofré <[email protected]> >>> wrote: >>> >>> Hi Amit, >>>> >>>> I updated the two Beam jobs to use private Maven repository. Let me know >>>> if it helps (else I will revert the change). >>>> >>>> Regards >>>> JB >>>> >>>> On 03/13/2016 07:47 PM, Amit Sela wrote: >>>> >>>>> I don't think I have permissions... >>>>> @JB @davor any of you have permissions to configure Jenkins jobs ? >>>>> >>>>> On Sun, Mar 13, 2016 at 4:29 PM Andreas Veithen < >>>>> >>>> [email protected]> >>>> >>>>> wrote: >>>>> >>>>> You should probably enable the "Use private Maven repository" option >>>>>> >>>>> in >>> >>>> the >>>> >>>>> Jenkins build. >>>>>> >>>>>> Andreas >>>>>> >>>>>> On Sun, Mar 13, 2016 at 8:11 AM, Amit Sela <[email protected]> >>>>>> >>>>> wrote: >>>> >>>>> >>>>>> I don't see anything either, but I suspect it's some sort of a cache >>>>>>> >>>>>> in >>> >>>> Jenkins maven. >>>>>>> >>>>>>> When I tried to build the original spark-dataflow project (Cloudera) >>>>>>> against Beam instead of Dataflow, I removed all Cloudera repositories >>>>>>> >>>>>> from >>>>>> >>>>>>> the pom and even removed the Cloudera hadoop artifacts from my >>>>>>> .m2/repository but it kept downloading hadoop CDH... Only after I >>>>>>> >>>>>> deleted >>>> >>>>> my entire ~/.m2/repository it downloaded Apache Hadoop. >>>>>>> >>>>>>> I'm not suggesting we delete Jenkins' .m2/repository (yet...) but I >>>>>>> >>>>>> think >>>> >>>>> it's some sort of cache and I'm not sure how to resolve it. >>>>>>> >>>>>>> You gotta admit it's strange that it downloads MapR hadoop >>>>>>> >>>>>> artifacts.... >>>> >>>>> >>>>>>> On Sun, Mar 13, 2016 at 9:18 AM Davor Bonaci >>>>>>> >>>>>> <[email protected] >>> >>>> >>>>> wrote: >>>>>>> >>>>>>> I've added "help:effective-settings" goal to the pre-commit Jenkins >>>>>>>> project, and rebuilt your pull request in Jenkins #62. >>>>>>>> >>>>>>>> I didn't see anything suspicious; see console output with effective >>>>>>>> settings.xml here [1]. >>>>>>>> >>>>>>>> [1] https://builds.apache.org/job/beam_PreCommit/62/console >>>>>>>> >>>>>>>> On Sat, Mar 12, 2016 at 10:45 PM, Amit Sela <[email protected]> >>>>>>>> >>>>>>> wrote: >>>>>>> >>>>>>>> >>>>>>>> OS=looks. Sorry, phone autocorrect ;) >>>>>>>>> >>>>>>>>> On Sun, Mar 13, 2016, 08:39 Amit Sela <[email protected]> >>>>>>>>> >>>>>>>> wrote: >>> >>>> >>>>>>>>> Well, I can't run mvn dependency:tree but the downloading of MapR >>>>>>>>>> >>>>>>>>> Hadoop >>>>>>>> >>>>>>>>> dependencies OS suspicious... I remember I had this issue once >>>>>>>>>> >>>>>>>>> with >>> >>>> Cloudera distribution and I resolved it by deleting my entire >>>>>>>>>> >>>>>>>>> .m2/repository >>>>>>>>> >>>>>>>>>> >>>>>>>>>> And Travis runs the same tests successfully... >>>>>>>>>> >>>>>>>>>> On Sun, Mar 13, 2016, 08:35 Davor Bonaci <[email protected] >>>>>>>>>> >>>>>>>>> >>>>>>> wrote: >>>>>>>>> >>>>>>>>>> >>>>>>>>>> Jenkins jobs currently use "default Maven settings" and "default >>>>>>>>>>> >>>>>>>>>> Maven >>>>>>> >>>>>>>> global settings". We have some (limited) ability to view and >>>>>>>>>>> >>>>>>>>>> change >>>>>> >>>>>>> these >>>>>>>>> >>>>>>>>>> settings ourselves. >>>>>>>>>>> >>>>>>>>>>> Can we definitely confirm this is the root-cause? >>>>>>>>>>> >>>>>>>>>>> On Sat, Mar 12, 2016 at 8:49 AM, Amit Sela <[email protected] >>>>>>>>>>> >>>>>>>>>> >>>> wrote: >>>>>>>>> >>>>>>>>>> >>>>>>>>>>> I've issued PR https://github.com/apache/incubator-beam/pull/42 >>>>>>>>>>>> >>>>>>>>>>> and >>>>>>> >>>>>>>> while >>>>>>>>>>> >>>>>>>>>>>> Travis seems happy about it, Jenkis is not. >>>>>>>>>>>> >>>>>>>>>>>> Checking the build console >>>>>>>>>>>> https://builds.apache.org/job/beam_PreCommit/61/console I see >>>>>>>>>>>> >>>>>>>>>>> that >>>>>>> >>>>>>>> for >>>>>>>>> >>>>>>>>>> some >>>>>>>>>>>> reason it downloads MapR hadoop artifacts such as: >>>>>>>>>>>> >>>>>>>>>>>> [INFO] Downloading: >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>> >>> https://repository.jboss.org/nexus/content/repositories/releases/org/apache/hadoop/hadoop-client/2.7.0-mapr-1509/hadoop-client-2.7.0-mapr-1509.jar >>> >>>> >>>>>>>>>>>> instead of Apache Hadoop from Maven Central. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> It seems that the issues causing the tests to fail are related >>>>>>>>>>>> >>>>>>>>>>> to >>>>>> >>>>>>> the >>>>>>>> >>>>>>>>> MapR distribution.. >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Any reason for that ? How/Where does Jenkins configure it's >>>>>>>>>>>> >>>>>>>>>>> settings.xml ? >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Thanks, >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Amit >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>> >>>> -- >>>> Jean-Baptiste Onofré >>>> [email protected] >>>> http://blog.nanthrax.net >>>> Talend - http://www.talend.com >>>> >>>> >>> >> > -- > Jean-Baptiste Onofré > [email protected] > http://blog.nanthrax.net > Talend - http://www.talend.com > -- ------- Jason Kuster Cloud Dataflow/Apache Beam (incubating)
