Michael Armbrust created SPARK-22929: ----------------------------------------
Summary: Short name for "kafka" doesn't work in pyspark with packages Key: SPARK-22929 URL: https://issues.apache.org/jira/browse/SPARK-22929 Project: Spark Issue Type: Bug Components: Structured Streaming Affects Versions: 2.2.0 Reporter: Michael Armbrust Priority: Critical When I start pyspark using the following command: {code} bin/pyspark --packages org.apache.spark:spark-sql-kafka-0-10_2.11:2.2.0 {code} The following throws an error: {code} spark.read.format("kakfa")... py4j.protocol.Py4JJavaError: An error occurred while calling o35.load. : java.lang.ClassNotFoundException: Failed to find data source: kakfa. Please find packages at http://spark.apache.org/third-party-projects.html {code} The following does work: {code} spark.read.format("org.apache.spark.sql.kafka010.KafkaSourceProvider")... {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org