Github user kennethmyers commented on the pull request:
https://github.com/apache/spark/pull/3715#issuecomment-71515443
Hello,
I made a fork of the main Spark repo and pulled this pull request into it.
I was able to build it successfully but I get the followng error when calling
KafkaUtils.createStream( ... )
The line:
```
kvs = KafkaUtils.createStream(streaming_context, ZOOKEEPER, GROUP, {TOPIC:
1})
```
...gives the following error message:
```
No kafka package, please put the assembly jar into classpath:
$ bin/submit --driver-class-path
external/kafka-assembly/target/scala-*/spark-streaming-kafka-assembly-*.jar
```
When I try to run that 'submit" command with the specified parameters, I
get:
```
$ bin/spark-submit --driver-class-path
external/kafka-assembly/target/scala-2.10/spark-streaming-kafka-assembly-1.3.0-SNAPSHOT.jar
Error: Must specify a primary resource (JAR or Python file)
Run with --help for usage help or --verbose for debug output
Using Spark's default log4j profile:
org/apache/spark/log4j-defaults.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/home/myerske/spark/external/kafka-assembly/target/scala-2.10/spark-streaming-kafka-assembly-1.3.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/myerske/spark/assembly/target/scala-2.10/spark-assembly-1.3.0-SNAPSHOT-hadoop1.0.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
```
I've verified that the JAR file is there.
Has anybody had the same issue or can offer any help?
Thanks
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
