Re: How do I persist the data after I process the data with Structured streaming...

Has anyone written a custom sink to persist data to Cassandra from structured streaming. Please provide me any link or reference. Thanks On Tue, Nov 22, 2016 at 2:40 PM, Michael Armbrust wrote: > Forgot the link: https://spark.apache.org/docs/latest/structured- >

Re: How do I persist the data after I process the data with Structured streaming...

We are looking to add a native JDBC sink in Spark 2.2. Until then you can write your own connector using df.writeStream.foreach. On Tue, Nov 22, 2016 at 12:55 PM, shyla deshpande wrote: > Hi, > > Structured streaming works great with Kafka source but I need to persist

Re: How do I persist the data after I process the data with Structured streaming...

Forgot the link: https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#using-foreach On Tue, Nov 22, 2016 at 2:40 PM, Michael Armbrust wrote: > We are looking to add a native JDBC sink in Spark 2.2. Until then you can > write your own

How do I persist the data after I process the data with Structured streaming...

Hi, Structured streaming works great with Kafka source but I need to persist the data after processing in some database like Cassandra or at least Postgres. Any suggestions, help please. Thanks