[ https://issues.apache.org/jira/browse/SPARK-22929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16306943#comment-16306943 ]
Sean Owen commented on SPARK-22929: ----------------------------------- There's a typo in 'kakfa'; is that the issue or just a typo in the JIRA? > Short name for "kafka" doesn't work in pyspark with packages > ------------------------------------------------------------ > > Key: SPARK-22929 > URL: https://issues.apache.org/jira/browse/SPARK-22929 > Project: Spark > Issue Type: Bug > Components: Structured Streaming > Affects Versions: 2.2.0 > Reporter: Michael Armbrust > Priority: Critical > > When I start pyspark using the following command: > {code} > bin/pyspark --packages org.apache.spark:spark-sql-kafka-0-10_2.11:2.2.0 > {code} > The following throws an error: > {code} > spark.read.format("kakfa")... > py4j.protocol.Py4JJavaError: An error occurred while calling o35.load. > : java.lang.ClassNotFoundException: Failed to find data source: kakfa. Please > find packages at http://spark.apache.org/third-party-projects.html > {code} > The following does work: > {code} > spark.read.format("org.apache.spark.sql.kafka010.KafkaSourceProvider")... > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org