[ 
https://issues.apache.org/jira/browse/FALCON-106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suresh Srinivas updated FALCON-106:
-----------------------------------

    Attachment: falcon-build-2.x.v2.patch

New patch. A lot simpler than the previous one.

Splits hadoop.version to hadoop1.version and hadoop2.version. This avoid the 
issues we have seen where on hadoop-2 builds, some hadoop-1 related jars are 
not found and the build fails.


Following commands succeed:
{noformat}
mvn -DskipTests -DskipCheck=true clean install
mvn clean assembly:assembly -DskipTests
mvn -DskipTests -DskipCheck=true clean install -Pdistributed
mvn clean assembly:assembly -DskipTests -Pdistributed
mvn -DskipTests -DskipCheck=true clean install -Phadoop-1
mvn clean assembly:assembly -DskipTests -Phadoop-1
mvn -DskipTests -DskipCheck=true clean install -Pdistributed -Phadoop-1
mvn clean assembly:assembly -DskipTests -Pdistributed -Phadoop-1
mvn -DskipTests -DskipCheck=true clean install -Phadoop-2
mvn clean assembly:assembly -DskipTests -Phadoop-2
mvn -DskipTests -DskipCheck=true clean install -Pdistributed -Phadoop-2
mvn clean assembly:assembly -DskipTests -Pdistributed -Phadoop-2
mvn -DskipTests -DskipCheck=true clean install -Dhadoop.profile=2
mvn clean assembly:assembly -DskipTests -Dhadoop.profile=2
mvn -DskipTests -DskipCheck=true clean install -Pdistributed -Dhadoop.profile=2
mvn clean assembly:assembly -DskipTests -Pdistributed -Dhadoop.profile=2
mvn -DskipTests -DskipCheck=true clean install -Dhadoop.profile=1
mvn clean assembly:assembly -DskipTests -Dhadoop.profile=1
mvn -DskipTests -DskipCheck=true clean install -Pdistributed -Dhadoop.profile=1
mvn clean assembly:assembly -DskipTests -Pdistributed -Dhadoop.profile=1
{noformat}

The following tests fail (with or without this patch):
Failed tests: 
  FalconCLIIT.prepare:47 È Connect Call to localhost/127.0.0.1:41020 failed on 
c...
  LogProviderIT.setup:65 È Connect Call to localhost/127.0.0.1:41020 failed on 
c...
  ClusterEntityValidationIT.setup:49 È Connect Call to 
localhost/127.0.0.1:41020...
  EntityManagerJerseyIT.prepare:68 È Connect Call to localhost/127.0.0.1:41020 
f...
  PigProcessIT.prepare:44 È Connect Call to localhost/127.0.0.1:41020 failed on 
...


Looks like in EmbeddedCluster.java, MiniDFSCluster is never started. If I get 
some time, I will post a patch.
                
> Falcon compilation fails for hadoop-2 profile
> ---------------------------------------------
>
>                 Key: FALCON-106
>                 URL: https://issues.apache.org/jira/browse/FALCON-106
>             Project: Falcon
>          Issue Type: Bug
>          Components: build-tools
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>         Attachments: falcon-build-2.x.patch, falcon-build-2.x.v2.patch, 
> falcon-build-2.x.v2.patch
>
>
> Mainly due to hadoop-core and hadoop-test artifacts not being available in 
> hadoop 2.x.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to