Make sure that all dependencies are present in classpath during execution. In your case you need curator-framework:2.9.1 library. You should either add jars of these libraries to --jars option of spark-submit command, add needed dependencies to Spark configuration, or build an uber-jar that will contain all libraries that are required for execution and submit this jar. I'm not a Spark expert, so I can't tell, which way is commonly used.
Hope this helps. Denis чт, 21 сент. 2017 г. в 21:45, pradeepchanumolu <[email protected]>: > Thanks Denis for looking into the problem. > > Here are the dependencies from my build.sbt file > > lazy val Versions = new { > val igniteVersion = "2.2.0" > } > > libraryDependencies ++= Seq( > "org.apache.ignite" % "ignite-core" % Versions.igniteVersion, > "org.apache.ignite" % "ignite-spring" % Versions.igniteVersion, > "org.apache.ignite" % "ignite-zookeeper" % Versions.igniteVersion, > "org.apache.ignite" % "ignite-spark" % Versions.igniteVersion > exclude ("org.scalatest", "scalatest_2.10") > exclude ("com.twitter", "chill_2.10") > exclude ("org.apache.spark", "spark-unsafe_2.10") > exclude ("org.apache.spark", "spark-tags_2.10"), > "org.apache.ignite" % "ignite-clients" % Versions.igniteVersion > ) > > I am using spark-submit command to launch the job. > > command: > > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >
