HI all i am trying to run a sample spark code which reads streaming data from Kafka I Have followed instructions here
https://spark.apache.org/docs/latest/streaming-kafka-0-10-integration.html Here's my setup Spark: 2.0.1 Kafka:0.10.1.1 Scala Version: 2.11 Libraries used - spark-streaming-kafka-0.10_2.11-2.0.1 - kafka-_2.11-0.10.0.1.jar These are my imports import org.apache.spark.streaming.kafka010.KafkaUtils import org.apache.spark.streaming.kafka010.LocationStrategies.PreferConsistent import org.apache.spark.streaming.kafka010.ConsumerStrategies.Subscribe But Eclipse is giving me the following errors: Missing or invlaid dependency detected while loading class file KafkaUtils.class. Could not access term clients in value org.apache.kafka because it (or its dependencies) are missing. Missing or invalid dependency detected while loading class file KafkaUtils.class Could not access term kafka in package org.apache because it (or its dependencies are missing) missing or invalid dependencies detected while loading class file KafkaUtils.class: could not access type ConsumerRecord in value org.apache.consumer because it(or its dependencies are missing) So it seems i have some dependencies clashing. Has any one encountered a similar error? kr marco
