[ https://issues.apache.org/jira/browse/SPARK-22929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-22929. ------------------------------- Resolution: Not A Problem Pardon if I misunderstood, and reopen it, but if it's just a typo I assume this isn't a bug. > Short name for "kafka" doesn't work in pyspark with packages > ------------------------------------------------------------ > > Key: SPARK-22929 > URL: https://issues.apache.org/jira/browse/SPARK-22929 > Project: Spark > Issue Type: Bug > Components: Structured Streaming > Affects Versions: 2.2.0 > Reporter: Michael Armbrust > Priority: Critical > > When I start pyspark using the following command: > {code} > bin/pyspark --packages org.apache.spark:spark-sql-kafka-0-10_2.11:2.2.0 > {code} > The following throws an error: > {code} > spark.read.format("kakfa")... > py4j.protocol.Py4JJavaError: An error occurred while calling o35.load. > : java.lang.ClassNotFoundException: Failed to find data source: kakfa. Please > find packages at http://spark.apache.org/third-party-projects.html > {code} > The following does work: > {code} > spark.read.format("org.apache.spark.sql.kafka010.KafkaSourceProvider")... > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org