Re: Kafka Integration libraries put in the fat jar

2019-07-31 Thread Spico Florin
Hi! Thanks to Jacek Laskowski , I found the answer here https://stackoverflow.com/questions/51792203/how-to-get-spark-kafka-org-apache-sparkspark-sql-kafka-0-10-2-112-1-0-dependen Just add the maven shade plugin: org.apache.

Kafka Integration libraries put in the fat jar

2019-07-30 Thread Spico Florin
Hello! I would like to use the spark structured streaming integrated with Kafka the way is described here: https://spark.apache.org/docs/latest/structured-streaming-kafka-integration.html but I got the following issue: Caused by: org.apache.spark.sql.AnalysisException: Failed to find data sourc