I'm having some related issues locally... seems every time the Hudson
publishes a new build, my local build breaks with something like this:
todd@todd-w510:~/git/hadoop-common/hdfs$ ant clean test
Buildfile: /home/todd/git/hadoop-common/hdfs/build.xml
clean-contrib:
clean:
clean:
[echo] contrib: fuse-dfs
clean-fi:
clean-sign:
clean:
[delete] Deleting directory /home/todd/git/hadoop-common/hdfs/build
ivy-download:
[get] Getting:
http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.2.0-rc1/ivy-2.2.0-rc1.jar
[get] To: /home/todd/git/hadoop-common/hdfs/ivy/ivy-2.2.0-rc1.jar
[get] Not modified - so not downloaded
ivy-init-dirs:
[mkdir] Created dir: /home/todd/git/hadoop-common/hdfs/build/ivy
[mkdir] Created dir: /home/todd/git/hadoop-common/hdfs/build/ivy/lib
[mkdir] Created dir: /home/todd/git/hadoop-common/hdfs/build/ivy/report
[mkdir] Created dir: /home/todd/git/hadoop-common/hdfs/build/ivy/maven
ivy-probe-antlib:
ivy-init-antlib:
ivy-init:
[ivy:configure] :: Ivy 2.2.0-rc1 - 20100629224905 ::
http://ant.apache.org/ivy/ ::
[ivy:configure] :: loading settings :: file =
/home/todd/git/hadoop-common/hdfs/ivy/ivysettings.xml
ivy-resolve-common:
[ivy:resolve] downloading
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-annotations/0.23.0-SNAPSHOT/hadoop-annotations-0.23.0-20110808.090045-15.jar
...
[ivy:resolve] ... (14kB)
[ivy:resolve] .. (0kB)
[ivy:resolve] [SUCCESSFUL ]
org.apache.hadoop#hadoop-annotations;0.23.0-SNAPSHOT!hadoop-annotations.jar
(458ms)
[ivy:resolve] downloading
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.23.0-SNAPSHOT/hadoop-common-0.23.0-20110815.225725-267.jar
...
[ivy:resolve]
.....................................................................................................................
[ivy:resolve]
....................................................................................................
(1667kB)
[ivy:resolve] .. (0kB)
[ivy:resolve] [SUCCESSFUL ]
org.apache.hadoop#hadoop-common;0.23.0-SNAPSHOT!hadoop-common.jar
(2796ms)
ivy-retrieve-common:
[ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use
'ivy.settings.file' instead
[ivy:cachepath] :: loading settings :: file =
/home/todd/git/hadoop-common/hdfs/ivy/ivysettings.xml
ivy-resolve-hdfs:
[ivy:resolve] downloading
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-annotations/0.23.0-SNAPSHOT/hadoop-annotations-0.23.0-20110808.090045-15.jar
...
[ivy:resolve] ... (14kB)
[ivy:resolve] .. (0kB)
[ivy:resolve] [SUCCESSFUL ]
org.apache.hadoop#hadoop-annotations;0.23.0-SNAPSHOT!hadoop-annotations.jar
(193ms)
ivy-retrieve-hdfs:
ivy-resolve-test:
ivy-retrieve-test:
init:
[mkdir] Created dir: /home/todd/git/hadoop-common/hdfs/build/classes
[mkdir] Created dir: /home/todd/git/hadoop-common/hdfs/build/src
[mkdir] Created dir:
/home/todd/git/hadoop-common/hdfs/build/web/webapps/hdfs/WEB-INF
[mkdir] Created dir:
/home/todd/git/hadoop-common/hdfs/build/web/webapps/datanode/WEB-INF
[mkdir] Created dir:
/home/todd/git/hadoop-common/hdfs/build/web/webapps/secondary/WEB-INF
[mkdir] Created dir: /home/todd/git/hadoop-common/hdfs/build/ant
[mkdir] Created dir: /home/todd/git/hadoop-common/hdfs/build/c++
[mkdir] Created dir: /home/todd/git/hadoop-common/hdfs/build/test
[mkdir] Created dir:
/home/todd/git/hadoop-common/hdfs/build/test/hdfs/classes
[mkdir] Created dir: /home/todd/git/hadoop-common/hdfs/build/test/extraconf
[touch] Creating /tmp/null1539574669
[delete] Deleting: /tmp/null1539574669
[copy] Copying 6 files to
/home/todd/git/hadoop-common/hdfs/build/web/webapps
[copy] Copying 1 file to /home/todd/git/hadoop-common/hdfs/conf
[copy] Copying
/home/todd/git/hadoop-common/hdfs/conf/hdfs-site.xml.template to
/home/todd/git/hadoop-common/hdfs/conf/hdfs-site.xml
[mkdir] Created dir: /home/todd/git/hadoop-common/hdfs/build/test/conf
[copy] Copying 1 file to /home/todd/git/hadoop-common/hdfs/build/test/conf
[copy] Copying
/home/todd/git/hadoop-common/hdfs/conf/hdfs-site.xml.template to
/home/todd/git/hadoop-common/hdfs/build/test/conf/hdfs-site.xml
[copy] Copying 2 files to /home/todd/git/hadoop-common/hdfs/build/test/conf
[copy] Copying
/home/todd/git/hadoop-common/hdfs/conf/hadoop-metrics2.properties to
/home/todd/git/hadoop-common/hdfs/build/test/conf/hadoop-metrics2.properties
[copy] Copying
/home/todd/git/hadoop-common/hdfs/conf/log4j.properties to
/home/todd/git/hadoop-common/hdfs/build/test/conf/log4j.properties
check-libhdfs-makefile:
create-libhdfs-makefile:
compile-c++-libhdfs:
clover.setup:
clover.info:
[echo]
[echo] Clover not found. Code coverage reports disabled.
[echo]
clover:
compile-hdfs-classes:
[javac] /home/todd/git/hadoop-common/hdfs/build.xml:370: warning:
'includeantruntime' was not set, defaulting to
build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 282 source files to
/home/todd/git/hadoop-common/hdfs/build/classes
[javac]
/home/todd/git/hadoop-common/hdfs/src/java/org/apache/hadoop/fs/Hdfs.java:33:
package org.apache.hadoop.conf does not exist
[javac] import org.apache.hadoop.conf.Configuration;
... [lots more errors where o.a.h.* from common can't be found ...
and yet:
todd@todd-w510:~/git/hadoop-common/hdfs$ find . -name \*common\*23\*jar
./build/ivy/lib/hadoop-hdfs/common/hadoop-common-0.23.0-SNAPSHOT.jar
./build/ivy/lib/hadoop-hdfs/test/hadoop-common-0.23.0-SNAPSHOT-tests.jar
and then I run the exact build command again, I see:
ivy-resolve-common:
[ivy:resolve] downloading
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.23.0-SNAPSHOT/hadoop-common-0.23.0-20110815.225725-267.jar
...
[ivy:resolve]
...............................................................................................................................
[ivy:resolve]
.........................................................................................
(1667kB)
[ivy:resolve] .. (0kB)
[ivy:resolve] [SUCCESSFUL ]
org.apache.hadoop#hadoop-common;0.23.0-SNAPSHOT!hadoop-common.jar
(2661ms)
and it builds fine.
On Mon, Aug 15, 2011 at 4:08 PM, Giridharan Kesavan
<gkesa...@hortonworks.com> wrote:
> On Mon, Aug 15, 2011 at 3:52 PM, Eli Collins <e...@cloudera.com> wrote:
>> On Mon, Aug 15, 2011 at 3:45 PM, Giridharan Kesavan
>> <gkesa...@hortonworks.com> wrote:
>>> Hi Eli,
>>>
>>> your are right Im talking about the apache jenkins hdfs build failures;
>>>
>>> Im pretty sure hdfs is picking the latest hadoop common jars. I
>>> verified this with the apache repo as well.
>>
>> How are you building? The method that its claiming doesn't exist
>> definitely does.
>
> target doesn't exist in the build.xml; its part of the fault injection
> framework and is imported from "trunk/hdfs/src/test/aop/build/aop.xml"
>
> you can see this import in the build.xml file
> <import file="${test.src.dir}/aop/build/aop.xml"/>
>
>>
>> The following works on trunk so I think it's an issue with how
>> Jenkins is running it.
>>
>> hadoop-common $ mvn clean
>> hadoop-common $ mvn install -DskipTests
>> hadoop-common $ pushd ../hdfs
>> hdfs $ ant clean
>> hdfs $ ant -Dresolvers=internal jar
>> hdfs $ ant run-test-hdfs-fault-inject
>
> I think you should pass "-Dresolver=internal" to the
> run-test-hdfs-fault-inject target as well
>
> Thanks,
> giri
>
>>
>> Thanks,
>> Eli
>>
>>>
>>> https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/0.23.0-SNAPSHOT
>>>
>>> hadoop-common-0.23.0-20110815.215733-266-tests.jar
>>>
>>> hadoop-common-0.23.0-20110815.215733-266.jar
>>>
>>> https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Hdfs-trunk-Commit/837/console
>>>
>>> [ivy:resolve] .. (0kB)
>>>
>>> [ivy:resolve] [SUCCESSFUL ] org.apache.hadoop#avro;1.3.2!avro.jar (1011ms)
>>> [ivy:resolve] downloading
>>> https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.23.0-SNAPSHOT/hadoop-common-0.23.0-20110815.215733-266.jar
>>> ...
>>>
>>> [ivy:resolve]
>>> ........................................................................................................................................................................................................................
>>> (1667kB)
>>> [ivy:resolve] .. (0kB)
>>> [ivy:resolve] [SUCCESSFUL ]
>>> org.apache.hadoop#hadoop-common;0.23.0-SNAPSHOT!hadoop-common.jar
>>> (1549ms)
>>>
>>> ivy-retrieve-common:
>>> [ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use
>>> 'ivy.settings.file' instead
>>> [ivy:cachepath] :: loading settings :: file =
>>> /home/jenkins/jenkins-slave/workspace/Hadoop-Hdfs-trunk-Commit/trunk/ivy/ivysettings.xml
>>>
>>> ivy-resolve-hdfs:
>>>
>>> ivy-retrieve-hdfs:
>>>
>>> ivy-resolve-test:
>>>
>>> [ivy:resolve] downloading
>>> https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-common/0.23.0-SNAPSHOT/hadoop-common-0.23.0-20110815.215733-266-tests.jar
>>> ...
>>> [ivy:resolve]
>>> ........................................................................................................................
>>> (876kB)
>>>
>>> [ivy:resolve] .. (0kB)
>>> [ivy:resolve] [SUCCESSFUL ]
>>> org.apache.hadoop#hadoop-common;0.23.0-SNAPSHOT!hadoop-common.jar(tests)
>>> (875ms)
>>>
>>>
>>> On Mon, Aug 15, 2011 at 3:33 PM, Eli Collins <e...@cloudera.com> wrote:
>>>>
>>>> Hey Giri,
>>>>
>>>> This looks like a similar issue to what was hitting the main Jenkins
>>>> job, the Hdfs job isn't picking up the latest bits from common.
>>>>
>>>> Thanks,
>>>> Eli
>>>>
>>>> On Mon, Aug 15, 2011 at 3:27 PM, Giridharan Kesavan
>>>> <gkesa...@hortonworks.com> wrote:
>>>> > Todd,
>>>> >
>>>> > Could you please take a look at this ?
>>>> >
>>>> > https://issues.apache.org/jira/browse/HDFS-2261
>>>> >
>>>> >
>>>> > -Giri
>>>> > On Mon, Aug 15, 2011 at 3:24 PM, Todd Lipcon <t...@cloudera.com> wrote:
>>>> >
>>>> >> Seems like some of it is a build issue where it can't find ant.
>>>> >>
>>>> >> The other is the following:
>>>> >> https://issues.apache.org/jira/browse/HADOOP-7545
>>>> >> Please review.
>>>> >>
>>>> >> Thanks
>>>> >> -Todd
>>>> >>
>>>> >> On Mon, Aug 15, 2011 at 2:54 PM, Mahadev Konar <maha...@hortonworks.com>
>>>> >> wrote:
>>>> >> > Hi folks,
>>>> >> > Can anyone take a look at the hdfs builds? Seems to be failing:
>>>> >> >
>>>> >> > https://builds.apache.org/job/Hadoop-Hdfs-trunk/
>>>> >> >
>>>> >> > thanks
>>>> >> > mahadev
>>>> >> >
>>>> >>
>>>> >>
>>>> >>
>>>> >> --
>>>> >> Todd Lipcon
>>>> >> Software Engineer, Cloudera
>>>> >>
>>>> >
>>>
>>
>
--
Todd Lipcon
Software Engineer, Cloudera
