[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597005#comment-17597005
]
Andras Salamon commented on OOZIE-2973:
---
[~dlmarion] I'm afraid the latest version still not work with hadoop3.
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Affects Versions: 4.3.0
>Reporter: Attila Sasvári
>Priority: Blocker
> Fix For: 5.3.0
>
> Attachments: OOZIE-2973.001.patch, OOZIE-2973.002.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584445#comment-17584445
]
Dave Marion commented on OOZIE-2973:
Curious if the latest (5.2.1) client will work with Hadoop 3.3.3. Any insight
into a workaround until this work is completed?
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Affects Versions: 4.3.0
>Reporter: Attila Sasvári
>Priority: Blocker
> Fix For: 5.3.0
>
> Attachments: OOZIE-2973.001.patch, OOZIE-2973.002.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258748#comment-17258748
]
Chengbing Liu commented on OOZIE-2973:
--
Let's not get blocked by temporarily dropping Pig and releasing new Oozie
version which supports Hadoop 3.x. Once Pig is ready to support Hadoop 3, we
can add it back.
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Affects Versions: 4.3.0
>Reporter: Attila Sasvári
>Priority: Blocker
> Fix For: 5.3.0
>
> Attachments: OOZIE-2973.001.patch, OOZIE-2973.002.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258739#comment-17258739
]
Andras Salamon commented on OOZIE-2973:
---
[~chengbing.liu] I opened a jira ( OOZIE-3514 ) about the future of pig in
oozie.
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Affects Versions: 4.3.0
>Reporter: Attila Sasvári
>Priority: Blocker
> Fix For: 5.3.0
>
> Attachments: OOZIE-2973.001.patch, OOZIE-2973.002.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258738#comment-17258738
]
Chengbing Liu commented on OOZIE-2973:
--
[~asalamon74] Last release of Apache Pig is in Jun 2017, I think we should
probably drop Pig support.
Apache Bigtop is considering dropping Oozie due to no Hadoop 3.x support:
https://issues.apache.org/jira/browse/BIGTOP-3471
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Affects Versions: 4.3.0
>Reporter: Attila Sasvári
>Priority: Blocker
> Fix For: 5.3.0
>
> Attachments: OOZIE-2973.001.patch, OOZIE-2973.002.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258720#comment-17258720
]
Andras Salamon commented on OOZIE-2973:
---
We have plans, but not much progress. And we are still blocked by PIG-5253.
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Affects Versions: 4.3.0
>Reporter: Attila Sasvári
>Priority: Blocker
> Fix For: 5.3.0
>
> Attachments: OOZIE-2973.001.patch, OOZIE-2973.002.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258632#comment-17258632
]
Chengbing Liu commented on OOZIE-2973:
--
Do we have a plan to support Hadoop 3.x?
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Affects Versions: 4.3.0
>Reporter: Attila Sasvári
>Priority: Blocker
> Fix For: 5.3.0
>
> Attachments: OOZIE-2973.001.patch, OOZIE-2973.002.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156518#comment-17156518
]
Andras Salamon commented on OOZIE-2973:
---
Might be some hadoop3 incompatibility introduced by OOZIE-3542.
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Affects Versions: 4.3.0
>Reporter: Attila Sasvári
>Priority: Blocker
> Fix For: 5.3.0
>
> Attachments: OOZIE-2973.001.patch, OOZIE-2973.002.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156489#comment-17156489
]
Vishal Donderia commented on OOZIE-2973:
Are we able to compiled oozie using hadoop-3. I am using below command
{code}
./bin/mkdistro.sh -DskipTests -Phadoop-3 -Dhadoop.version=3.0.0 -X
{code}
And getting below exception
{code}[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.7.0:testCompile
(default-testCompile) on project oozie-tools: Compilation failure
[ERROR]
/Users/vishal/Documents/Softwares/BigData/oozie-5.2.0/tools/src/test/java/org/apache/oozie/tools/TestECPolicyDisabler.java:[50,71]
getErasureCodingPolicy(org.apache.hadoop.fs.Path) in
org.apache.oozie.tools.TestECPolicyDisabler.MockDistributedFileSystem cannot
override getErasureCodingPolicy(org.apache.hadoop.fs.Path) in
org.apache.hadoop.hdfs.DistributedFileSystem
[ERROR] return type
org.apache.hadoop.hdfs.protocol.SystemErasureCodingPolicies.ReplicationPolicy
is not compatible with org.apache.hadoop.hdfs.protocol.ErasureCodingPolicy
[ERROR]
[ERROR] -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal
org.apache.maven.plugins:maven-compiler-plugin:3.7.0:testCompile
(default-testCompile) on project oozie-tools: Compilation failure
/Users/vishal/Documents/Softwares/BigData/oozie-5.2.0/tools/src/test/java/org/apache/oozie/tools/TestECPolicyDisabler.java:[50,71]
getErasureCodingPolicy(org.apache.hadoop.fs.Path) in
org.apache.oozie.tools.TestECPolicyDisabler.MockDistributedFileSystem cannot
override getErasureCodingPolicy(org.apache.hadoop.fs.Path) in
org.apache.hadoop.hdfs.DistributedFileSystem
return type
org.apache.hadoop.hdfs.protocol.SystemErasureCodingPolicies.ReplicationPolicy
is not compatible with org.apache.hadoop.hdfs.protocol.ErasureCodingPolicy
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:215)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:156)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:148)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:81)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build
(SingleThreadedBuilder.java:56)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute
(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:957)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:289)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:193)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced
(Launcher.java:282)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode
(Launcher.java:406)
at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: org.apache.maven.plugin.compiler.CompilationFailureException:
Compilation failure
/Users/vishal/Documents/Softwares/BigData/oozie-5.2.0/tools/src/test/java/org/apache/oozie/tools/TestECPolicyDisabler.java:[50,71]
getErasureCodingPolicy(org.apache.hadoop.fs.Path) in
org.apache.oozie.tools.TestECPolicyDisabler.MockDistributedFileSystem cannot
override getErasureCodingPolicy(org.apache.hadoop.fs.Path) in
org.apache.hadoop.hdfs.DistributedFileSystem
return type
org.apache.hadoop.hdfs.protocol.SystemErasureCodingPolicies.ReplicationPolicy
is not compatible with org.apache.hadoop.hdfs.protocol.ErasureCodingPolicy
at org.apache.maven.plugin.compiler.AbstractCompilerMojo.execute
(AbstractCompilerMojo.java:1161)
at org.apache.maven.plugin.compiler.TestCompilerMojo.execute
(TestCompilerMojo.java:176)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
(DefaultBuildPluginManager.java:137)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:210)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:156)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:148)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16591411#comment-16591411
]
Andras Piros commented on OOZIE-2973:
-
As Hive and Pig aren't yet supporting Hadoop 3, pushing this Jira out to
{{5.2.0}}.
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Affects Versions: 4.3.0
>Reporter: Attila Sasvari
>Assignee: Peter Cseh
>Priority: Blocker
> Fix For: 5.2.0
>
> Attachments: OOZIE-2973.001.patch, OOZIE-2973.002.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280158#comment-16280158
]
Andras Piros commented on OOZIE-2973:
-
[~gezapeti] I agree with pushing out this from 5.0.0b1 as the components you
mentioned and Oozie uses need more time to mature with Hadoop 3.
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Reporter: Attila Sasvari
>Assignee: Peter Cseh
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2973.001.patch, OOZIE-2973.002.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16271086#comment-16271086
]
Hadoop QA commented on OOZIE-2973:
--
Testing JIRA OOZIE-2973
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in
[hadooplibs/hadoop-utils-2].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [server].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 2074
.Tests rerun: 94
.Tests failed at first run:
org.apache.oozie.action.hadoop.TestJavaActionExecutor,org.apache.oozie.service.TestStatusTransitService,
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/PreCommit-OOZIE-Build/264/
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Reporter: Attila Sasvari
>Assignee: Peter Cseh
>Priority: Blocker
> Fix For: 5.0.0b1
>
> Attachments: OOZIE-2973.001.patch, OOZIE-2973.002.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253895#comment-16253895
]
Andras Piros commented on OOZIE-2973:
-
Following {{hadoop-common}} transitive dependencies are for
{{oozie-sharelib-pig}}:
{noformat}
org.apache.hadoop:hadoop-minicluster:jar:3.0.0-beta1:test
+- org.apache.hadoop:hadoop-common:test-jar:tests:3.0.0-beta1:test
| +- javax.servlet:javax.servlet-api:jar:3.1.0:test
| +- org.eclipse.jetty:jetty-server:jar:9.3.19.v20170502:test
| | +- org.eclipse.jetty:jetty-http:jar:9.3.19.v20170502:test
| | \- org.eclipse.jetty:jetty-io:jar:9.3.19.v20170502:test
| +- org.eclipse.jetty:jetty-util:jar:9.3.19.v20170502:test
| +- com.sun.jersey:jersey-core:jar:1.19:test
| | \- javax.ws.rs:jsr311-api:jar:1.1.1:test
| +- com.sun.jersey:jersey-json:jar:1.19:test
| | +- org.codehaus.jettison:jettison:jar:1.1:test
| | +- com.sun.xml.bind:jaxb-impl:jar:2.2.3-1:test
| | +- org.codehaus.jackson:jackson-jaxrs:jar:1.9.2:test
| | \- org.codehaus.jackson:jackson-xc:jar:1.9.2:test
| +- com.sun.jersey:jersey-server:jar:1.19:test
| +- org.slf4j:slf4j-log4j12:jar:1.6.6:test (version managed from 1.7.25)
| +- com.jcraft:jsch:jar:0.1.54:test
| \- org.apache.zookeeper:zookeeper:jar:3.4.9:test
| \- jline:jline:jar:0.9.94:test
+- org.apache.hadoop:hadoop-hdfs:test-jar:tests:3.0.0-beta1:test
| +- org.eclipse.jetty:jetty-util-ajax:jar:9.3.19.v20170502:test
| +- commons-daemon:commons-daemon:jar:1.0.13:test
| +- io.netty:netty:jar:3.10.5.Final:test
| +- io.netty:netty-all:jar:4.0.23.Final:test
| \- org.fusesource.leveldbjni:leveldbjni-all:jar:1.8:test
+- org.apache.hadoop:hadoop-yarn-server-tests:test-jar:tests:3.0.0-beta1:test
| +- org.apache.hadoop:hadoop-yarn-server-common:jar:3.0.0-beta1:test
| | +- org.apache.geronimo.specs:geronimo-jcache_1.0_spec:jar:1.0-alpha-1:test
| | +- org.ehcache:ehcache:jar:3.3.1:test
| | +- com.zaxxer:HikariCP-java7:jar:2.4.12:test
| | \- com.microsoft.sqlserver:mssql-jdbc:jar:6.2.1.jre7:test
| +- org.apache.hadoop:hadoop-yarn-server-nodemanager:jar:3.0.0-beta1:test
| | +- org.apache.hadoop:hadoop-yarn-registry:jar:3.0.0-beta1:test
| | +- com.codahale.metrics:metrics-core:jar:3.0.1:test
| | +- com.google.inject:guice:jar:3.0:test
| | | +- javax.inject:javax.inject:jar:1:test
| | | \- aopalliance:aopalliance:jar:1.0:test
| | \- com.sun.jersey.contribs:jersey-guice:jar:1.19:test
| +- org.apache.hadoop:hadoop-yarn-server-resourcemanager:jar:3.0.0-beta1:test
| | \-
org.apache.hadoop:hadoop-yarn-server-applicationhistoryservice:jar:3.0.0-beta1:test
| | \- de.ruedigermoeller:fst:jar:2.50:test
| |\- com.cedarsoftware:java-util:jar:1.9.0:test
| | \- com.cedarsoftware:json-io:jar:2.5.1:test
| \- org.apache.hadoop:hadoop-yarn-server-timelineservice:jar:3.0.0-beta1:test
| \- org.apache.commons:commons-csv:jar:1.0:test
+-
org.apache.hadoop:hadoop-mapreduce-client-jobclient:test-jar:tests:3.0.0-beta1:test
| \- com.google.inject.extensions:guice-servlet:jar:4.0:test
+- org.apache.hadoop:hadoop-hdfs:jar:3.0.0-beta1:test
+- org.apache.hadoop:hadoop-mapreduce-client-app:jar:3.0.0-beta1:test
| +- org.apache.hadoop:hadoop-yarn-server-web-proxy:jar:3.0.0-beta1:test
| \- org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:3.0.0-beta1:test
| \- org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:3.0.0-beta1:test
\- org.apache.hadoop:hadoop-mapreduce-client-hs:jar:3.0.0-beta1:test
{noformat}
But for {{oozie-core}} we have way less transitive dependencies on
{{hadoop-common}}:
{noformat}
org.apache.hadoop:hadoop-minicluster:jar:3.0.0-beta1:test
+- org.apache.hadoop:hadoop-common:test-jar:tests:3.0.0-beta1:test
+- org.apache.hadoop:hadoop-hdfs:test-jar:tests:3.0.0-beta1:test
+- org.apache.hadoop:hadoop-yarn-server-tests:test-jar:tests:3.0.0-beta1:test
| \- org.apache.hadoop:hadoop-yarn-server-nodemanager:jar:3.0.0-beta1:test
| +- org.apache.hadoop:hadoop-yarn-registry:jar:3.0.0-beta1:test
| \- com.codahale.metrics:metrics-core:jar:3.0.1:test
+-
org.apache.hadoop:hadoop-mapreduce-client-jobclient:test-jar:tests:3.0.0-beta1:test
+- org.apache.hadoop:hadoop-mapreduce-client-app:jar:3.0.0-beta1:test
| \- org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:3.0.0-beta1:test
\- org.apache.hadoop:hadoop-mapreduce-client-hs:jar:3.0.0-beta1:test
{noformat}
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Reporter: Attila Sasvari
>Assignee: Peter Cseh
>Priority: Blocker
> Fix For: 5.0.0b1
>
> Attachments: OOZIE-2973.001.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apach
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16251465#comment-16251465
]
Hadoop QA commented on OOZIE-2973:
--
Testing JIRA OOZIE-2973
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
.{color:red}WARNING{color}: the current HEAD has 77 Javadoc warning(s)
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:red}-1{color} patch does not compile
.{color:green}+1{color} the patch does not seem to introduce new javac
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color} - patch does not compile, cannot run testcases
{color:red}-1 DISTRO{color}
.{color:red}-1{color} distro tarball fails with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
{color:red}. There is at least one warning, please check{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/PreCommit-OOZIE-Build/217/
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Reporter: Attila Sasvari
>Assignee: Peter Cseh
>Priority: Blocker
> Fix For: 5.0.0b1
>
> Attachments: OOZIE-2973.001.patch
>
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (OOZIE-2973) Make sure Oozie works with Hadoop 3
[
https://issues.apache.org/jira/browse/OOZIE-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16209834#comment-16209834
]
Peter Cseh commented on OOZIE-2973:
---
I think we can't avoid introducing a hadoop-3 profile along with a
Hadooplibs-like mvn project so we can access Hadoop3 features as well.
> Make sure Oozie works with Hadoop 3
>
>
> Key: OOZIE-2973
> URL: https://issues.apache.org/jira/browse/OOZIE-2973
> Project: Oozie
> Issue Type: Bug
>Reporter: Attila Sasvari
>
> This JIRA is to track that Oozie works with Hadoop 3.
> - Build Oozie with latest hadoop 3 (e.g. assuming Apache Hadoop 3.0.0-alpha3
> pass {{-D-Dhadoop.version=3.0.0-alpha3}} to maven) and execute tests
> - It would be nice to create an Apache jenkins job that runs Oozie tests with
> hadoop 3 (also with other component)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
