ZEPPELIN-3119 is merged, which will be included in 0.8.0
Ruslan Dautkhanov <dautkha...@gmail.com>于2018年1月12日周五 上午12:35写道： > Thank you Jeff > > > -- > Ruslan Dautkhanov > > On Thu, Jan 11, 2018 at 1:57 AM, Jeff Zhang <zjf...@gmail.com> wrote: > >> >> ZEPPELIN-3119 will fix this. Will update this thread once it is done >> >> >> >> >> Ruslan Dautkhanov <dautkha...@gmail.com>于2017年12月29日周五 上午6:04写道： >> >>> The build failure messages all point to the zeppelin-zengine module in >>> the source code. In this commit: >>> https://github.com/apache/zeppelin/commit/30bfcae0c0c9650aff3ed1f8fe41eee9c4e93cb1#diff-98784f3ef76c2907324fa9e48e66cf47 >>> , a dependency change was made to add the org.apache.hadoop:hadoop-client >>> which points to both org.apache.hadoop:hadoop-common and >>> org.apache.hadoop:hadoop-hdfs. These two have dependencies upon different >>> versions (at least for the Cloudera version of them) of the >>> org.codehaus.jackson:jackson-mapper-asl library, 1.8.8 and 1.9.13 >>> respectively. >>> >>> Was anyone able to build zeppelin with cloudera repo after >>> ZEPPELIN-1515. Notebook: HDFS as a backend storage (Use hadoop client >>> jar) PR #2455 >>> was committed ? >>> >>> >>> On Mon, Dec 18, 2017 at 4:20 PM, Ruslan Dautkhanov <dautkha...@gmail.com >>> > wrote: >>> >>>> We're now looking at shading option. >>>> >>>> Talking to Cloudera Support even minor upgrades to jackson known have >>>> caused issues in the past. >>>> They also said they're planning to upgrade CDH6 to jackson 2.*7*.8 - >>>> but this will be released mid-next year. >>>> So we're not waiting for that to happen. >>>> >>>> Yes, we will contribute back to the project when we find solution. >>>> Thanks for the suggestion Felix. Is this known if Zeppelin can work >>>> fine with jasckson 2.*2*.3? >>>> (certain dependencies currently list jackson 2.*5*.3) >>>> >>>> >>>> >>>> -- >>>> Ruslan Dautkhanov >>>> >>>> On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung < >>>> felixcheun...@hotmail.com> wrote: >>>> >>>>> Instead of exclusion, would it be better to use the version in the >>>>> cloudera repo? >>>>> >>>>> Please do consider contributing these changes back to Zeppelin source. >>>>> Thanks! >>>>> >>>>> _____________________________ >>>>> From: Ruslan Dautkhanov <dautkha...@gmail.com> >>>>> Sent: Monday, December 11, 2017 3:42 PM >>>>> Subject: Re: zeppelin build fails with DependencyConvergence error >>>>> To: Zeppelin Users <us...@zeppelin.incubator.apache.org> >>>>> >>>>> >>>>> >>>>> Looks like master branch of Zeppelin still has compatibility issue >>>>> with Cloudera dependencies. >>>>> >>>>> When built using >>>>> >>>>> mvn clean package -DskipTests -Pspark-2.2 >>>>> -Dhadoop.version=2.6.0-cdh5.12.1 -Phadoop-2.6 -Pvendor-repo -pl '!...list >>>>> of excluded packages' -e >>>>> >>>>> maven fails on jackson convergence error - see below email for more >>>>> details. >>>>> Looks like there was a change in Zeppelin that upgraded Jackson's >>>>> version? >>>>> So now it conflicts with older jackson library as referenced by >>>>> cloudera repo. >>>>> >>>>> workaround: Zeppelin builds fine with pom change [1] - the question is >>>>> now >>>>> would somebody expect Zeppelin would still be functioning correctly >>>>> with these exclusions? >>>>> >>>>> >>>>> >>>>> [1] >>>>> >>>>> --- a/zeppelin-zengine/pom.xml >>>>>> +++ b/zeppelin-zengine/pom.xml >>>>>> @@ -364,6 +364,30 @@ >>>>>> <groupId>com.google.guava</groupId> >>>>>> <artifactId>guava</artifactId> >>>>>> </exclusion> >>>>>> + <exclusion> >>>>>> + <groupId>com.fasterxml.jackson.core</groupId> >>>>>> + <artifactId>jackson-core</artifactId> >>>>>> + </exclusion> >>>>>> + <exclusion> >>>>>> + <groupId>com.fasterxml.jackson.core</groupId> >>>>>> + <artifactId>jackson-annotations</artifactId> >>>>>> + </exclusion> >>>>>> + <exclusion> >>>>>> + <groupId>com.fasterxml.jackson.core</groupId> >>>>>> + <artifactId>jackson-databind</artifactId> >>>>>> + </exclusion> >>>>>> + <exclusion> >>>>>> + <groupId>org.codehaus.jackson</groupId> >>>>>> + <artifactId>jackson-mapper-asl</artifactId> >>>>>> + </exclusion> >>>>>> + <exclusion> >>>>>> + <groupId>org.codehaus.jackson</groupId> >>>>>> + <artifactId>jackson-core-asl</artifactId> >>>>>> + </exclusion> >>>>>> + <exclusion> >>>>>> + <groupId>org.apache.zookeeper</groupId> >>>>>> + <artifactId>zookeeper</artifactId> >>>>>> + </exclusion> >>>>>> </exclusions> >>>>>> </dependency> >>>>>> >>>>> >>>>> >>>>> >>>>> On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov < >>>>> dautkha...@gmail.com> wrote: >>>>> >>>>>> Building from a current Zeppelin snapshot fails with >>>>>> zeppelin build fails with >>>>>> org.apache.maven.plugins.enforcer.DependencyConvergence >>>>>> see details below. >>>>>> >>>>>> Build command >>>>>> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2 >>>>>> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo -Pscala-2.10 >>>>>> -Psparkr -pl '!*..excluded certain modules..*' -e >>>>>> >>>>>> maven 3.5.0 >>>>>>> jdk 1.8.0_141 >>>>>>> RHEL 7.3 >>>>>>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7 >>>>>>> nodejs.x86_64 1:6.11.1-1.el7 @epel >>>>>>> latest zeppelin snapshot >>>>>> >>>>>> >>>>>> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen >>>>>> this problem before. >>>>>> >>>>>> Thanks, >>>>>> Ruslan >>>>>> >>>>>> >>>>>> >>>>>> [INFO] Scanning for projects... >>>>>> [WARNING] >>>>>> [WARNING] Some problems were encountered while building the effective >>>>>> model for >>>>>> org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.8.0-SNAPSHOT >>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>>> but found duplicate declaration of plugin >>>>>> com.googlecode.maven-download-plugin:download-maven-plugin @ line 940, >>>>>> column 15 >>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>>> but found duplicate declaration of plugin >>>>>> com.googlecode.maven-download-plugin:download-maven-plugin @ line 997, >>>>>> column 15 >>>>>> [WARNING] >>>>>> [WARNING] Some problems were encountered while building the effective >>>>>> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT >>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>>> but found duplicate declaration of plugin >>>>>> org.scala-tools:maven-scala-plugin @ line 467, column 15 >>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>>> but found duplicate declaration of plugin >>>>>> org.apache.maven.plugins:maven-surefire-plugin @ line 475, column 15 >>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>>> but found duplicate declaration of plugin >>>>>> org.apache.maven.plugins:maven-compiler-plugin @ line 486, column 15 >>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>>> but found duplicate declaration of plugin >>>>>> org.scala-tools:maven-scala-plugin @ line 496, column 15 >>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>>> but found duplicate declaration of plugin >>>>>> org.apache.maven.plugins:maven-surefire-plugin @ line 504, column 15 >>>>>> [WARNING] >>>>>> [WARNING] It is highly recommended to fix these problems because they >>>>>> threaten the stability of your build. >>>>>> [WARNING] >>>>>> [WARNING] For this reason, future Maven versions might no longer >>>>>> support building such malformed projects. >>>>>> [WARNING] >>>>>> [WARNING] The project >>>>>> org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT uses prerequisites >>>>>> which is only intended for maven-plugin projects but not for non >>>>>> maven-plugin projects. For such purposes you should use the >>>>>> maven-enforcer-plugin. See >>>>>> https://maven.apache.org/enforcer/enforcer-rules/requireMavenVersion.html >>>>>> >>>>>> >>>>>> ... [skip] >>>>>> >>>>>> [INFO] >>>>>> ------------------------------------------------------------------------ >>>>>> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT >>>>>> [INFO] >>>>>> ------------------------------------------------------------------------ >>>>>> [INFO] >>>>>> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @ >>>>>> zeppelin-zengine --- >>>>>> [INFO] >>>>>> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @ >>>>>> zeppelin-zengine --- >>>>>> [INFO] >>>>>> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) >>>>>> @ zeppelin-zengine --- >>>>>> [INFO] >>>>>> [INFO] >>>>>> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) >>>>>> @ zeppelin-zengine --- >>>>>> [INFO] Using 'UTF-8' encoding to copy filtered resources. >>>>>> [INFO] Copying 17 resources >>>>>> [INFO] >>>>>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @ >>>>>> zeppelin-zengine --- >>>>>> [WARNING] >>>>>> Dependency convergence error for >>>>>> com.fasterxml.jackson.core:jackson-core:2.5.3 paths to dependency are: >>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>>>> +-com.amazonaws:aws-java-sdk-s3:1.10.62 >>>>>> +-com.amazonaws:aws-java-sdk-core:1.10.62 >>>>>> +-com.fasterxml.jackson.core:jackson-databind:2.5.3 >>>>>> +-com.fasterxml.jackson.core:jackson-core:2.5.3 >>>>>> and >>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >>>>>> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0 >>>>>> +-com.fasterxml.jackson.core:jackson-core:2.2.3 >>>>>> >>>>>> [WARNING] >>>>>> Dependency convergence error for >>>>>> org.codehaus.jackson:jackson-mapper-asl:1.9.13 paths to dependency are: >>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>>>> +-com.github.eirslett:frontend-maven-plugin:1.3 >>>>>> +-com.github.eirslett:frontend-plugin-core:1.3 >>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13 >>>>>> and >>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >>>>>> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0 >>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8 >>>>>> and >>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >>>>>> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0 >>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13 >>>>>> >>>>>> ... [skipped a number of other version convergence errors for >>>>>> dependencies] >>>>>> >>>>>> >>>>>> >>>>> >>>>> >>>>> >>>> >>> >
