Thank you Jeff
-- Ruslan Dautkhanov On Thu, Jan 11, 2018 at 1:57 AM, Jeff Zhang <zjf...@gmail.com> wrote: > > ZEPPELIN-3119 will fix this. Will update this thread once it is done > > > > > Ruslan Dautkhanov <dautkha...@gmail.com>于2017年12月29日周五 上午6:04写道： > >> The build failure messages all point to the zeppelin-zengine module in >> the source code. In this commit: https://github.com/apache/ >> zeppelin/commit/30bfcae0c0c9650aff3ed1f8fe41eee9c4e93cb1#diff- >> 98784f3ef76c2907324fa9e48e66cf47 , a dependency change was made to add >> the org.apache.hadoop:hadoop-client which points to both >> org.apache.hadoop:hadoop-common and org.apache.hadoop:hadoop-hdfs. >> These two have dependencies upon different versions (at least for the >> Cloudera version of them) of the org.codehaus.jackson:jackson-mapper-asl >> library, 1.8.8 and 1.9.13 respectively. >> >> Was anyone able to build zeppelin with cloudera repo after >> ZEPPELIN-1515. Notebook: HDFS as a backend storage (Use hadoop client >> jar) PR #2455 >> was committed ? >> >> >> On Mon, Dec 18, 2017 at 4:20 PM, Ruslan Dautkhanov <dautkha...@gmail.com> >> wrote: >> >>> We're now looking at shading option. >>> >>> Talking to Cloudera Support even minor upgrades to jackson known have >>> caused issues in the past. >>> They also said they're planning to upgrade CDH6 to jackson 2.*7*.8 - >>> but this will be released mid-next year. >>> So we're not waiting for that to happen. >>> >>> Yes, we will contribute back to the project when we find solution. >>> Thanks for the suggestion Felix. Is this known if Zeppelin can work fine >>> with jasckson 2.*2*.3? >>> (certain dependencies currently list jackson 2.*5*.3) >>> >>> >>> >>> -- >>> Ruslan Dautkhanov >>> >>> On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung <felixcheun...@hotmail.com >>> > wrote: >>> >>>> Instead of exclusion, would it be better to use the version in the >>>> cloudera repo? >>>> >>>> Please do consider contributing these changes back to Zeppelin source. >>>> Thanks! >>>> >>>> _____________________________ >>>> From: Ruslan Dautkhanov <dautkha...@gmail.com> >>>> Sent: Monday, December 11, 2017 3:42 PM >>>> Subject: Re: zeppelin build fails with DependencyConvergence error >>>> To: Zeppelin Users <us...@zeppelin.incubator.apache.org> >>>> >>>> >>>> >>>> Looks like master branch of Zeppelin still has compatibility issue with >>>> Cloudera dependencies. >>>> >>>> When built using >>>> >>>> mvn clean package -DskipTests -Pspark-2.2 -Dhadoop.version=2.6.0-cdh5.12.1 >>>> -Phadoop-2.6 -Pvendor-repo -pl '!...list of excluded packages' -e >>>> >>>> maven fails on jackson convergence error - see below email for more >>>> details. >>>> Looks like there was a change in Zeppelin that upgraded Jackson's >>>> version? >>>> So now it conflicts with older jackson library as referenced by >>>> cloudera repo. >>>> >>>> workaround: Zeppelin builds fine with pom change [1] - the question is >>>> now >>>> would somebody expect Zeppelin would still be functioning correctly >>>> with these exclusions? >>>> >>>> >>>> >>>> [1] >>>> >>>> --- a/zeppelin-zengine/pom.xml >>>>> +++ b/zeppelin-zengine/pom.xml >>>>> @@ -364,6 +364,30 @@ >>>>> <groupId>com.google.guava</groupId> >>>>> <artifactId>guava</artifactId> >>>>> </exclusion> >>>>> + <exclusion> >>>>> + <groupId>com.fasterxml.jackson.core</groupId> >>>>> + <artifactId>jackson-core</artifactId> >>>>> + </exclusion> >>>>> + <exclusion> >>>>> + <groupId>com.fasterxml.jackson.core</groupId> >>>>> + <artifactId>jackson-annotations</artifactId> >>>>> + </exclusion> >>>>> + <exclusion> >>>>> + <groupId>com.fasterxml.jackson.core</groupId> >>>>> + <artifactId>jackson-databind</artifactId> >>>>> + </exclusion> >>>>> + <exclusion> >>>>> + <groupId>org.codehaus.jackson</groupId> >>>>> + <artifactId>jackson-mapper-asl</artifactId> >>>>> + </exclusion> >>>>> + <exclusion> >>>>> + <groupId>org.codehaus.jackson</groupId> >>>>> + <artifactId>jackson-core-asl</artifactId> >>>>> + </exclusion> >>>>> + <exclusion> >>>>> + <groupId>org.apache.zookeeper</groupId> >>>>> + <artifactId>zookeeper</artifactId> >>>>> + </exclusion> >>>>> </exclusions> >>>>> </dependency> >>>>> >>>> >>>> >>>> >>>> On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov < >>>> dautkha...@gmail.com> wrote: >>>> >>>>> Building from a current Zeppelin snapshot fails with >>>>> zeppelin build fails with org.apache.maven.plugins. >>>>> enforcer.DependencyConvergence >>>>> see details below. >>>>> >>>>> Build command >>>>> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2 >>>>> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo >>>>> -Pscala-2.10 -Psparkr -pl '!*..excluded certain modules..*' -e >>>>> >>>>> maven 3.5.0 >>>>>> jdk 1.8.0_141 >>>>>> RHEL 7.3 >>>>>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7 >>>>>> nodejs.x86_64 1:6.11.1-1.el7 @epel >>>>>> latest zeppelin snapshot >>>>> >>>>> >>>>> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen >>>>> this problem before. >>>>> >>>>> Thanks, >>>>> Ruslan >>>>> >>>>> >>>>> >>>>> [INFO] Scanning for projects... >>>>> [WARNING] >>>>> [WARNING] Some problems were encountered while building the effective >>>>> model for org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0. >>>>> 8.0-SNAPSHOT >>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>> but found duplicate declaration of plugin >>>>> com.googlecode.maven-download-plugin:download-maven-plugin >>>>> @ line 940, column 15 >>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>> but found duplicate declaration of plugin >>>>> com.googlecode.maven-download-plugin:download-maven-plugin >>>>> @ line 997, column 15 >>>>> [WARNING] >>>>> [WARNING] Some problems were encountered while building the effective >>>>> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT >>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>> but found duplicate declaration of plugin >>>>> org.scala-tools:maven-scala-plugin >>>>> @ line 467, column 15 >>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>> but found duplicate declaration of plugin >>>>> org.apache.maven.plugins:maven-surefire-plugin >>>>> @ line 475, column 15 >>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>> but found duplicate declaration of plugin >>>>> org.apache.maven.plugins:maven-compiler-plugin >>>>> @ line 486, column 15 >>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>> but found duplicate declaration of plugin >>>>> org.scala-tools:maven-scala-plugin >>>>> @ line 496, column 15 >>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>>>> but found duplicate declaration of plugin >>>>> org.apache.maven.plugins:maven-surefire-plugin >>>>> @ line 504, column 15 >>>>> [WARNING] >>>>> [WARNING] It is highly recommended to fix these problems because they >>>>> threaten the stability of your build. >>>>> [WARNING] >>>>> [WARNING] For this reason, future Maven versions might no longer >>>>> support building such malformed projects. >>>>> [WARNING] >>>>> [WARNING] The project org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT >>>>> uses prerequisites which is only intended for maven-plugin projects but >>>>> not >>>>> for non maven-plugin projects. For such purposes you should use the >>>>> maven-enforcer-plugin. See https://maven.apache.org/ >>>>> enforcer/enforcer-rules/requireMavenVersion.html >>>>> >>>>> >>>>> ... [skip] >>>>> >>>>> [INFO] ------------------------------------------------------------ >>>>> ------------ >>>>> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT >>>>> [INFO] ------------------------------------------------------------ >>>>> ------------ >>>>> [INFO] >>>>> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @ >>>>> zeppelin-zengine --- >>>>> [INFO] >>>>> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @ >>>>> zeppelin-zengine --- >>>>> [INFO] >>>>> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) >>>>> @ zeppelin-zengine --- >>>>> [INFO] >>>>> [INFO] >>>>> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) >>>>> @ zeppelin-zengine --- >>>>> [INFO] Using 'UTF-8' encoding to copy filtered resources. >>>>> [INFO] Copying 17 resources >>>>> [INFO] >>>>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @ >>>>> zeppelin-zengine --- >>>>> [WARNING] >>>>> Dependency convergence error for >>>>> com.fasterxml.jackson.core:jackson-core:2.5.3 >>>>> paths to dependency are: >>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>>> +-com.amazonaws:aws-java-sdk-s3:1.10.62 >>>>> +-com.amazonaws:aws-java-sdk-core:1.10.62 >>>>> +-com.fasterxml.jackson.core:jackson-databind:2.5.3 >>>>> +-com.fasterxml.jackson.core:jackson-core:2.5.3 >>>>> and >>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >>>>> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0 >>>>> +-com.fasterxml.jackson.core:jackson-core:2.2.3 >>>>> >>>>> [WARNING] >>>>> Dependency convergence error for >>>>> org.codehaus.jackson:jackson-mapper-asl:1.9.13 >>>>> paths to dependency are: >>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>>> +-com.github.eirslett:frontend-maven-plugin:1.3 >>>>> +-com.github.eirslett:frontend-plugin-core:1.3 >>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13 >>>>> and >>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >>>>> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0 >>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8 >>>>> and >>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >>>>> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0 >>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13 >>>>> >>>>> ... [skipped a number of other version convergence errors for >>>>> dependencies] >>>>> >>>>> >>>>> >>>> >>>> >>>> >>> >>
