Hi all,
I am trying zeppelin with spark which is throwing me the
following error related to netty jar conflicts. I checked properly my class
path. There are only single versions of netty-3.8.0 and netty-all-4.0.29-Final
jar.
Other information :
Spark 2.0.0
Scala 2.11
Zeppelin .6.2 snapshot
Command to build:
mvn clean install -DskipTests -Drat.ignoreErrors=true
-Dcheckstyle.skip=true -Denforcer.skip=true -Pspark-2.0 -Dspark.version=2.0.0
-Pscala-2.11 -Phadoop-2.7 -Pyarn
Queries:
sc.version :- it works fine
sqlContext.sql("show tables").show :- throws error
Running on local mode.
I am attaching my spark log file[zeppelin-interpreter-spark-root.log] and mvn
dependency:tree result [dependencyTree.txt]
So I am not able to solve this problem.. :(
Thanks & Regards,
Vikash Kumar
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for
org.apache.zeppelin:zeppelin-zengine:jar:0.6.2-SNAPSHOT
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must
be unique: org.eclipse.jetty.websocket:websocket-client:jar -> duplicate
declaration of version ${jetty.version} @
org.apache.zeppelin:zeppelin-zengine:[unknown-version],
/usr/hdp/2.4.3.0-227/zeppelin/zeppelin/poc-reportingZeppelin/zeppelin-branch-0.6/zeppelin-zengine/pom.xml,
line 179, column 15
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must
be unique: junit:junit:jar -> duplicate declaration of version (?) @
org.apache.zeppelin:zeppelin-zengine:[unknown-version],
/usr/hdp/2.4.3.0-227/zeppelin/zeppelin/poc-reportingZeppelin/zeppelin-branch-0.6/zeppelin-zengine/pom.xml,
line 259, column 15
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten
the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support
building such malformed projects.
[WARNING]
[INFO]
[INFO] Reactor Build Order:
[INFO]
[INFO] Zeppelin
[INFO] Zeppelin: Interpreter
[INFO] Zeppelin: Zengine
[INFO] Zeppelin: Display system apis
[INFO] Zeppelin: Spark dependencies
[INFO] Zeppelin: Spark
[INFO] Zeppelin: JDBC interpreter
[INFO] Zeppelin: web Application
[INFO] Zeppelin: Server
[INFO] Zeppelin: Packaging distribution
[INFO]
[INFO]
[INFO] Building Zeppelin 0.6.2-SNAPSHOT
[INFO]
[INFO]
[INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @ zeppelin ---
[INFO] org.apache.zeppelin:zeppelin:pom:0.6.2-SNAPSHOT
[INFO]
[INFO]
[INFO] Building Zeppelin: Interpreter 0.6.2-SNAPSHOT
[INFO]
[INFO]
[INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @
zeppelin-interpreter ---
[INFO] org.apache.zeppelin:zeppelin-interpreter:jar:0.6.2-SNAPSHOT
[INFO] +- org.apache.thrift:libthrift:jar:0.9.2:compile
[INFO] | +- org.apache.httpcomponents:httpclient:jar:4.3.6:compile
[INFO] | | +- commons-logging:commons-logging:jar:1.1.1:compile
[INFO] | | \- commons-codec:commons-codec:jar:1.5:compile
[INFO] | \- org.apache.httpcomponents:httpcore:jar:4.3.3:compile
[INFO] +- com.google.code.gson:gson:jar:2.2:compile
[INFO] +- org.apache.commons:commons-exec:jar:1.3:compile
[INFO] +- org.apache.commons:commons-pool2:jar:2.3:compile
[INFO] +- commons-lang:commons-lang:jar:2.5:compile
[INFO] +- org.slf4j:slf4j-api:jar:1.7.10:compile
[INFO] +- org.slf4j:slf4j-log4j12:jar:1.7.10:compile
[INFO] | \- log4j:log4j:jar:1.2.17:compile
[INFO] +- junit:junit:jar:4.11:test
[INFO] | \- org.hamcrest:hamcrest-core:jar:1.3:test
[INFO] +- org.mockito:mockito-all:jar:1.9.0:test
[INFO] +- org.apache.commons:commons-lang3:jar:3.4:compile
[INFO] +- org.apache.maven:maven-plugin-api:jar:3.0:compile
[INFO] | \- org.apache.maven:maven-artifact:jar:3.0:compile
[INFO] +- org.sonatype.aether:aether-api:jar:1.12:compile
[INFO] +- org.sonatype.aether:aether-util:jar:1.12:compile
[INFO] +- org.sonatype.aether:aether-impl:jar:1.12:compile
[INFO] | \- org.sonatype.aether:aether-spi:jar:1.12:compile
[INFO] +- org.apache.maven:maven-aether-provider:jar:3.0.3:compile
[INFO] | +- org.apache.maven:maven-model:jar:3.0.3:compile
[INFO] | +- org.apache.maven:maven-model-builder:jar:3.0.3:compile
[INFO] | | \- org.codehaus.plexus:plexus-interpolation:jar:1.14:compile
[INFO] | +- org.apache.maven:maven-repository-metadata:jar:3.0.3:compile
[INFO] | \- org.codehaus.plexus:plexus-component-annotations:jar:1.5.5:compile
[INFO] +-
