Hi There,

Our use case is like this.

We have a nested(multiple) JSON message flowing through Kafka Queue.  Read
the message from Kafka using Spark Structured Streaming(SSS) and  explode
the data and flatten all data into single record using DataFrame joins and
land into a relational database table(DB2). 

But we are getting the following error when we write into db using JDBC.

“org.apache.spark.sql.AnalysisException: Inner join between two streaming
DataFrames/Datasets is not supported;”

Any help would be greatly appreciated.


Thanks,
Thomas Thomas
Mastermind Solutions LLC.



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Reply via email to