Re: Does Spark Structured Streaming have a JDBC sink or Do I need to use ForEachWriter?

>From my experience so far, update mode in structured streaming is the most useful one out of the three available modes. But when it comes it RDBMS there isn't really an upsert so If I go with ForEachWriter I wouldn't quite know when to do an Insert or an update unless I really tie it with my

Re: Does Spark Structured Streaming have a JDBC sink or Do I need to use ForEachWriter?

Open source Spark Structured Streaming doesn’t have a JDBC sink. You can implement your own ForEachWriter, or you can use my sink from here https://github.com/GaalDornick/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/JdbcSink.scala

Re: Does Spark Structured Streaming have a JDBC sink or Do I need to use ForEachWriter?

Actually, we do not support jdbc sink yet. The blog post was just an example :) I agree it is misleading in hindsight. On Wed, Jun 20, 2018 at 6:09 PM, kant kodali wrote: > Hi All, > > Does Spark Structured Streaming have a JDBC sink or Do I need to use > ForEachWriter? I see the following code

Does Spark Structured Streaming have a JDBC sink or Do I need to use ForEachWriter?

Hi All, Does Spark Structured Streaming have a JDBC sink or Do I need to use ForEachWriter? I see the following code in this link and I can see that database name can be passed in the connection string, however, I