Grant Henke has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/12087 )
Change subject: KUDU-2640: Add Spark Structured Streaming Sink ...................................................................... KUDU-2640: Add Spark Structured Streaming Sink This patch adds a KuduSink and implements the Spark StreamSinkProvider interface to support structured streaming writes to Kudu. These writes behave the same as writes performed via the InsertableRelation interface. Note: The StreamSinkProvider interface is marked as experimental and unstable, but it has existed since Spark 2.0.0 and is used by the Kafka integration. Additionally, per SPARK-26415, there will be no more Spark 2.x minor releases and Spark would not break this API in a maintenance release. This means the interface is effectively stable for all of Spark 2. Change-Id: I731e35f82c8cca7d911e4d879aa6853112132b17 Reviewed-on: http://gerrit.cloudera.org:8080/12087 Tested-by: Kudu Jenkins Reviewed-by: Andrew Wong <[email protected]> --- M java/kudu-spark/src/main/scala/org/apache/kudu/spark/kudu/DefaultSource.scala M java/kudu-spark/src/test/scala/org/apache/kudu/spark/kudu/StreamingTest.scala 2 files changed, 70 insertions(+), 37 deletions(-) Approvals: Kudu Jenkins: Verified Andrew Wong: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/12087 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I731e35f82c8cca7d911e4d879aa6853112132b17 Gerrit-Change-Number: 12087 Gerrit-PatchSet: 6 Gerrit-Owner: Grant Henke <[email protected]> Gerrit-Reviewer: Andrew Wong <[email protected]> Gerrit-Reviewer: Grant Henke <[email protected]> Gerrit-Reviewer: Hao Hao <[email protected]> Gerrit-Reviewer: Kudu Jenkins (120) Gerrit-Reviewer: Mike Percy <[email protected]>
