The problem is that there's no beam-runners-flink 2.0.0 for scala 2.10

https://mvnrepository.com/artifact/org.apache.beam/beam-runners-flink

There's several approach for it .

1. exclude beam module when building.  Add -pl !beam
2. Use -Pscala-2.10 -Pspark-1.6
3. Upgrade beam version to 2.5.0 which support scala 2.11


And please create a ticket for it.


afancy <grou...@gmail.com> 于2019年8月28日周三 下午11:31写道:

> Dear all,
>
> I use the following command to compile the source code on Ubuntu 16.04,
> but got the following error. Could you help? thanks
> mvn -e clean package -DskipTests -Pspark-2.3 -Phadoop-2.6 -Pr -Pscala-2.11
> -Pr
>
> / afancy
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Zeppelin ........................................... SUCCESS [
> 16.782 s]
> [INFO] Zeppelin: Interpreter .............................. SUCCESS [
> 15.618 s]
> [INFO] Zeppelin: Interpreter API .......................... SUCCESS [
> 48.745 s]
> [INFO] Zeppelin: Interpreter Parent ....................... SUCCESS [
>  1.562 s]
> [INFO] Zeppelin: Zengine .................................. SUCCESS [
> 13.692 s]
> [INFO] Zeppelin: Display system apis ...................... SUCCESS [
> 13.278 s]
> [INFO] Zeppelin: Groovy interpreter ....................... SUCCESS [
>  3.623 s]
> [INFO] Zeppelin: Spark Parent ............................. SUCCESS [
>  3.073 s]
> [INFO] Zeppelin: Spark Shims .............................. SUCCESS [
>  2.808 s]
> [INFO] Zeppelin: Spark1 Shims ............................. SUCCESS [
> 10.583 s]
> [INFO] Zeppelin: Spark2 Shims ............................. SUCCESS [
>  9.562 s]
> [INFO] Zeppelin: Python interpreter ....................... SUCCESS [
>  8.850 s]
> [INFO] Zeppelin: Spark Interpreter ........................ SUCCESS [
> 27.756 s]
> [INFO] Zeppelin: Spark Scala Parent ....................... SUCCESS [
>  6.425 s]
> [INFO] Zeppelin: Spark Interpreter Scala_2.10 ............. SUCCESS [
> 10.443 s]
> [INFO] Zeppelin: Spark Interpreter Scala_2.11 ............. SUCCESS [
>  9.480 s]
> [INFO] Zeppelin: Spark Interpreter Scala_2.12 ............. SUCCESS [
> 10.540 s]
> [INFO] Zeppelin: Spark dependencies ....................... SUCCESS [
> 32.757 s]
> [INFO] Zeppelin: Shell interpreter ........................ SUCCESS [
>  7.767 s]
> [INFO] Zeppelin: Submarine interpreter .................... SUCCESS [
>  7.759 s]
> [INFO] Zeppelin: Markdown interpreter ..................... SUCCESS [
>  1.920 s]
> [INFO] Zeppelin: Angular interpreter ...................... SUCCESS [
>  1.130 s]
> [INFO] Zeppelin: Livy interpreter ......................... SUCCESS [
>  7.521 s]
> [INFO] Zeppelin: HBase interpreter ........................ SUCCESS [
> 11.602 s]
> [INFO] Zeppelin: Apache Pig Interpreter ................... SUCCESS [
> 20.028 s]
> [INFO] Zeppelin: JDBC interpreter ......................... SUCCESS [
>  2.921 s]
> [INFO] Zeppelin: File System Interpreters ................. SUCCESS [
>  2.375 s]
> [INFO] Zeppelin: Flink .................................... SUCCESS [
> 22.011 s]
> [INFO] Zeppelin: Apache Ignite interpreter ................ SUCCESS [
>  7.318 s]
> [INFO] Zeppelin: Kylin interpreter ........................ SUCCESS [
>  1.477 s]
> [INFO] Zeppelin: Lens interpreter ......................... SUCCESS [
>  8.949 s]
> [INFO] Zeppelin: Apache Cassandra interpreter ............. SUCCESS [
> 39.572 s]
> [INFO] Zeppelin: Elasticsearch interpreter ................ SUCCESS [
>  6.692 s]
> [INFO] Zeppelin: BigQuery interpreter ..................... SUCCESS [
>  2.479 s]
> [INFO] Zeppelin: Alluxio interpreter ...................... SUCCESS [
>  7.018 s]
> [INFO] Zeppelin: Scio ..................................... SUCCESS [
> 30.180 s]
> [INFO] Zeppelin: Neo4j interpreter ........................ SUCCESS [
>  8.619 s]
> [INFO] Zeppelin: Sap ...................................... SUCCESS [
>  1.423 s]
> [INFO] Zeppelin: Scalding interpreter ..................... SUCCESS [01:12
> min]
> [INFO] Zeppelin: Java interpreter ......................... SUCCESS [
>  1.267 s]
> [INFO] Zeppelin: Beam interpreter ......................... FAILURE [
>  9.666 s]
> [INFO] Zeppelin: Hazelcast Jet interpreter ................ SKIPPED
> [INFO] Zeppelin: Apache Geode interpreter ................. SKIPPED
> [INFO] Zeppelin: web Application .......................... SKIPPED
> [INFO] Zeppelin: Server ................................... SKIPPED
> [INFO] Zeppelin: Jupyter Support .......................... SKIPPED
> [INFO] Zeppelin: Plugins Parent ........................... SKIPPED
> [INFO] Zeppelin: Plugin S3NotebookRepo .................... SKIPPED
> [INFO] Zeppelin: Plugin GitHubNotebookRepo ................ SKIPPED
> [INFO] Zeppelin: Plugin AzureNotebookRepo ................. SKIPPED
> [INFO] Zeppelin: Plugin GCSNotebookRepo ................... SKIPPED
> [INFO] Zeppelin: Plugin ZeppelinHubRepo ................... SKIPPED
> [INFO] Zeppelin: Plugin FileSystemNotebookRepo ............ SKIPPED
> [INFO] Zeppelin: Plugin StandardLauncher .................. SKIPPED
> [INFO] Zeppelin: Plugin Kubernetes StandardLauncher ....... SKIPPED
> [INFO] Zeppelin: Plugin SparkInterpreterLauncher .......... SKIPPED
> [INFO] Zeppelin: Plugin Docker Launcher ................... SKIPPED
> [INFO] Zeppelin: Plugin Cluster Launcher .................. SKIPPED
> [INFO] Zeppelin: Packaging distribution ................... SKIPPED
> [INFO] Zeppelin: R Interpreter ............................ SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 08:51 min
> [INFO] Finished at: 2019-08-28T15:19:36+00:00
> [INFO] Final Memory: 374M/1653M
> [INFO]
> ------------------------------------------------------------------------
> [WARNING] The requested profile "hadoop-2.6" could not be activated
> because it does not exist.
> [ERROR] Failed to execute goal on project zeppelin-beam: Could not resolve
> dependencies for project
> org.apache.zeppelin:zeppelin-beam:jar:0.9.0-SNAPSHOT: Could not find
> artifact org.apache.beam:beam-runners-flink_2.11:jar:2.0.0 in central (
> https://repo.maven.apache.org/maven2) -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal on project zeppelin-beam: Could not resolve dependencies for project
> org.apache.zeppelin:zeppelin-beam:jar:0.9.0-SNAPSHOT: Could not find
> artifact org.apache.beam:beam-runners-flink_2.11:jar:2.0.0 in central (
> https://repo.maven.apache.org/maven2)
> at
> org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:221)
> at
> org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies(LifecycleDependencyResolver.java:127)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved(MojoExecutor.java:245)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:199)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
> Caused by: org.apache.maven.project.DependencyResolutionException: Could
> not resolve dependencies for project
> org.apache.zeppelin:zeppelin-beam:jar:0.9.0-SNAPSHOT: Could not find
> artifact org.apache.beam:beam-runners-flink_2.11:jar:2.0.0 in central (
> https://repo.maven.apache.org/maven2)
> at
> org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:211)
> at
> org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:195)
> ... 23 more
> Caused by: org.eclipse.aether.resolution.DependencyResolutionException:
> Could not find artifact org.apache.beam:beam-runners-flink_2.11:jar:2.0.0
> in central (https://repo.maven.apache.org/maven2)
> at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:384)
> at
> org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:205)
> ... 24 more
> Caused by: org.eclipse.aether.resolution.ArtifactResolutionException:
> Could not find artifact org.apache.beam:beam-runners-flink_2.11:jar:2.0.0
> in central (https://repo.maven.apache.org/maven2)
> at
> org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:444)
> at
> org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:246)
> at
> org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:367)
> ... 25 more
> Caused by: org.eclipse.aether.transfer.ArtifactNotFoundException: Could
> not find artifact org.apache.beam:beam-runners-flink_2.11:jar:2.0.0 in
> central (https://repo.maven.apache.org/maven2)
> at
> org.eclipse.aether.connector.basic.ArtifactTransportListener.transferFailed(ArtifactTransportListener.java:39)
> at
> org.eclipse.aether.connector.basic.BasicRepositoryConnector$TaskRunner.run(BasicRepositoryConnector.java:355)
> at
> org.eclipse.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:67)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> [ERROR]
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn <goals> -rf :zeppelin-beam
> The command '/bin/sh -c mvn -e clean package -DskipTests -Pspark-2.3
> -Phadoop-2.6 -Pr -Pscala-2.11 -Pr' returned a non-zero code: 1
> xiuli@man-sc02:~/docker-zeppelin$
>


-- 
Best Regards

Jeff Zhang

Reply via email to