Try removing libraryDependencies += "org.apache.kafka" %% "kafka" %
"1.6.0" compile.
I guess the internal dependencies are automatically pulled when you add
spark-streaming-kafka_2.10.
Also try changing the version to 1.6.1 or lower. Just to see if the links
are broken.
Regards,
Haroon Syed
On 7 April 2016 at 09:08, Sudhanshu Janghel <sudhanshu.jang...@cloudwick.com
> wrote:
> Hello,
>
> I am new to building kafka and wish to understand how to make fat jars in
> intellij.
> The sbt assembly seems confusing and I am unable to resolve the
> dependencies.
>
> here is my build.sbt
>
> name := "twitter"
>
> version := "1.0"
> scalaVersion := "2.10.4"
>
>
>
> //libraryDependencies += "org.slf4j" % "slf4j-api" % "1.7.7" % "provided"
> //libraryDependencies += "org.slf4j" % "slf4j-log4j12" % "1.7.7" % "provided"
> //libraryDependencies += "com.google.guava" % "guava" % "11.0.2"
> exclude("log4j", "log4j") exclude("org.slf4j","slf4j-log4j12")
> exclude("org.slf4j","slf4j-api")
> libraryDependencies += "org.apache.spark" % "spark-streaming_2.10" % "1.6.0"
> libraryDependencies += "org.apache.kafka" %% "kafka" % "1.6.0"
> libraryDependencies += "org.apache.spark" % "spark-streaming-kafka_2.10" %
> "1.6.0"
>
>
>
> adn here is my assembly.sbt
>
> addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.14.3")
>
>
> the error faced is
>
> Error:Error while importing SBT project:<br/>...<br/><pre>[info] Resolving
> org.scala-sbt#tracking;0.13.8 ...
> [info] Resolving org.scala-sbt#cache;0.13.8 ...
> [info] Resolving org.scala-sbt#testing;0.13.8 ...
> [info] Resolving org.scala-sbt#test-agent;0.13.8 ...
> [info] Resolving org.scala-sbt#test-interface;1.0 ...
> [info] Resolving org.scala-sbt#main-settings;0.13.8 ...
> [info] Resolving org.scala-sbt#apply-macro;0.13.8 ...
> [info] Resolving org.scala-sbt#command;0.13.8 ...
> [info] Resolving org.scala-sbt#logic;0.13.8 ...
> [info] Resolving org.scala-sbt#precompiled-2_8_2;0.13.8 ...
> [info] Resolving org.scala-sbt#precompiled-2_9_2;0.13.8 ...
> [info] Resolving org.scala-sbt#precompiled-2_9_3;0.13.8 ...
> [trace] Stack trace suppressed: run 'last *:update' for the full output.
> [trace] Stack trace suppressed: run 'last *:ssExtractDependencies' for the
> full output.
> [error] (*:update) sbt.ResolveException: unresolved dependency:
> com.eed3si9n#sbt-assembly;0.14.3: not found
> [error] unresolved dependency: org.apache.kafka#kafka_2.10;1.6.0: not found
> [error] (*:ssExtractDependencies) sbt.ResolveException: unresolved
> dependency: com.eed3si9n#sbt-assembly;0.14.3: not found
> [error] unresolved dependency: org.apache.kafka#kafka_2.10;1.6.0: not found
> [error] Total time: 18 s, completed Apr 7, 2016 5:05:06 PM
>
>
>
>
