Yes, let's revert the change to see if that helps. We will update the ptest slaves to use a newer version of maven ( https://issues.apache.org/jira/browse/HIVE-8441) but it's a bit of a pain since we have to create a new AMI. Thus reverting the change makes sense.
On Mon, Oct 13, 2014 at 8:55 AM, Alan Gates <ga...@hortonworks.com> wrote: > It doesn't appear to have fixed the issue, since the latest run still only > has 4372 tests run. Should we revert our repo switch since datanucleus > appears to be back now? > > Are we holding off on checkins until we get this resolved? > > Alan. > > Brock Noland <br...@cloudera.com> > October 12, 2014 at 19:05 > I think this was caused by our change in repos and > http://jira.codehaus.org/browse/MNG-5181 > > more details: > > > http://maven.40175.n5.nabble.com/Maven-3-maven-repositories-and-lastUpdated-td4927537.html > > I moved the maven directory which will, fix it, I think... > > > Brock Noland <br...@cloudera.com> > October 12, 2014 at 16:15 > The way this is supposed to work is that after applying the patch we run > mvn test on a dummy test to download all deps required for tests to the > maven directory. Then we rsync that maven repo directory to all the slaves. > This allows the mvn test commands to run in offline mode, which is faster. > > We do this here: > > > https://github.com/apache/hive/blob/trunk/testutils/ptest2/src/main/resources/source-prep.vm#L85 > > This has worked for a long time so it's a mystery to me while that dep > would not be available. I just looked at the run on HIVE-8394 which failed > an hour ago (~3PM PST). The pom it's looking for has been there since noon. > I am rsyncing the maven directory to give this a try locally. > > Brock > > [hiveptest@ip-10-113-154-189 ~]$ date > > Sun Oct 12 19:12:37 EDT 2014 > > [hiveptest@ip-10-113-154-189 ~]$ find > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/ > -ls > > 2230753 4 drwxr-xr-x 5 hiveptest hiveptest 4096 Oct 12 12:07 > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/ > > 2230754 4 drwxr-xr-x 2 hiveptest hiveptest 4096 Oct 12 12:04 > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/3 > > 2231658 4 -rw-r--r-- 1 hiveptest hiveptest 172 Oct 12 12:04 > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/3/_maven.repositories > > 2231659 4 -rw-r--r-- 1 hiveptest hiveptest 3351 Oct 12 12:04 > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/3/oss-parent-3.pom > > 2231660 4 -rw-r--r-- 1 hiveptest hiveptest 40 Oct 12 12:04 > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/3/oss-parent-3.pom.sha1 > > 2230756 4 drwxr-xr-x 2 hiveptest hiveptest 4096 Oct 12 19:11 > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/7 > > 2231666 8 -rw-r--r-- 1 hiveptest hiveptest 4824 Oct 12 12:03 > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/7/oss-parent-7.pom > > 2231667 4 -rw-r--r-- 1 hiveptest hiveptest 40 Oct 12 12:03 > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/7/oss-parent-7.pom.sha1 > > 2231665 4 -rw-r--r-- 1 hiveptest hiveptest 172 Oct 12 12:03 > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/7/_maven.repositories > > 2230755 4 drwxr-xr-x 2 hiveptest hiveptest 4096 Oct 12 12:07 > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/5 > > 2231663 4 -rw-r--r-- 1 hiveptest hiveptest 40 Oct 12 12:07 > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/5/oss-parent-5.pom.sha1 > > 2231661 4 -rw-r--r-- 1 hiveptest hiveptest 172 Oct 12 12:07 > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/5/_maven.repositories > > 2231662 4 -rw-r--r-- 1 hiveptest hiveptest 4082 Oct 12 12:07 > > /home/hiveptest//54.198.245.146-hiveptest-1/maven/org/sonatype/oss/oss-parent/5/oss-parent-5.pom > > > Szehon Ho <sze...@cloudera.com> > October 11, 2014 at 13:53 > I dug a little bit into the logs, and it seems some kind of build error so > these tests listed above are not running: > > [ERROR] Plugin org.antlr:antlr3-maven-plugin:3.4 or one of its > dependencies could not be resolved: Failed to read artifact descriptor > for org.antlr:antlr3-maven-plugin:jar:3.4: The repository system is > offline but the artifact org.sonatype.oss:oss-parent:pom:7 is not > available in the local repository. -> [Help 1] > > > See: > > http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1212/failed/ > > Wonder if somebody knows about this? > > Thanks > Szehon > > On Sat, Oct 11, 2014 at 12:42 PM, Thejas Nair <the...@hortonworks.com> > <the...@hortonworks.com> > > Thejas Nair <the...@hortonworks.com> > October 11, 2014 at 12:42 > The tests are also taking longer to complete - around 2 hr 50 mins, it > used by around 1hr 30 mins earlier. I wonder if the fewer test being > reported and longer duration are related (some kind of timeout ?) > > > David Schorow <dscho...@hortonworks.com> > October 10, 2014 at 13:05 > Build #1188 had 6765 tests, #1189 had 4354 tests. The following packages > were not run in 1189. I don't know why. > > Package > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/> > Total > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/> > org.apache.hadoop.hive.metastore.txn > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.metastore.txn/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.metastore.txn/> > 57 > org.apache.hadoop.hive.ql.exec > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec/> > 48 > org.apache.hadoop.hive.ql.exec.errors > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.errors/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.errors/> > 4 > org.apache.hadoop.hive.ql.exec.mapjoin > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.mapjoin/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.mapjoin/> > 1 > org.apache.hadoop.hive.ql.exec.persistence > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.persistence/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.persistence/> > 14 > org.apache.hadoop.hive.ql.exec.tez > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.tez/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.tez/> > 12 > org.apache.hadoop.hive.ql.exec.vector > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.vector/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.vector/> > 150 > org.apache.hadoop.hive.ql.exec.vector.expressions > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.vector.expressions/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.vector.expressions/> > 235 > org.apache.hadoop.hive.ql.exec.vector.expressions.gen > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.vector.expressions.gen/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.vector.expressions.gen/> > 1000 > org.apache.hadoop.hive.ql.exec.vector.udf > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.vector.udf/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.exec.vector.udf/> > 3 > org.apache.hadoop.hive.ql.io > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.io/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.io/> > 40 > org.apache.hadoop.hive.ql.io.orc > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.io.orc/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.io.orc/> > 267 > org.apache.hadoop.hive.ql.io.parquet > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.io.parquet/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.io.parquet/> > 17 > org.apache.hadoop.hive.ql.io.parquet.serde > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.io.parquet.serde/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.io.parquet.serde/> > 23 > org.apache.hadoop.hive.ql.io.parquet.serde.primitive > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.io.parquet.serde.primitive/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.io.parquet.serde.primitive/> > 12 > org.apache.hadoop.hive.ql.io.sarg > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.io.sarg/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.io.sarg/> > 16 > org.apache.hadoop.hive.ql.lockmgr > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.lockmgr/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.lockmgr/> > 17 > org.apache.hadoop.hive.ql.lockmgr.zookeeper > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.lockmgr.zookeeper/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.lockmgr.zookeeper/> > 4 > org.apache.hadoop.hive.ql.optimizer.listbucketingpruner > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.optimizer.listbucketingpruner/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.optimizer.listbucketingpruner/> > 12 > org.apache.hadoop.hive.ql.optimizer.physical > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.optimizer.physical/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.optimizer.physical/> > 4 > org.apache.hadoop.hive.ql.parse.authorization > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.parse.authorization/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.parse.authorization/> > 25 > org.apache.hadoop.hive.ql.parse.authorization.plugin.sqlstd > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.parse.authorization.plugin.sqlstd/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.parse.authorization.plugin.sqlstd/> > 1 > org.apache.hadoop.hive.ql.plan > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.plan/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.plan/> > 18 > org.apache.hadoop.hive.ql.processors > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.processors/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.processors/> > 3 > org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd/> > 4 > org.apache.hadoop.hive.ql.session > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.session/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.session/> > 10 > org.apache.hadoop.hive.ql.tool > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.tool/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.tool/> > 5 > org.apache.hadoop.hive.ql.udaf > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.udaf/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.udaf/> > 49 > org.apache.hadoop.hive.ql.udf > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.udf/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.udf/> > 33 > org.apache.hadoop.hive.ql.udf.generic > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.udf.generic/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.udf.generic/> > 138 > org.apache.hadoop.hive.ql.udf.xml > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.udf.xml/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.udf.xml/> > 5 > org.apache.hadoop.hive.ql.util > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.util/> > <http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1188/testReport/org.apache.hadoop.hive.ql.util/> > 3 > > > > > > > -- > Sent with Postbox <http://www.getpostbox.com> > > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity > to which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You. >
