Hello Mike Percy, Kudu Jenkins, Andrew Wong, Hao Hao,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/12087
to look at the new patch set (#3).
Change subject: KUDU-2640: Add Spark Structured Streaming Sink
......................................................................
KUDU-2640: Add Spark Structured Streaming Sink
This patch adds a KuduSink and implements the
Spark StreamSinkProvider interface to support
structured streaming writes to Kudu.
These writes behave the same as writes performed
via the InsertableRelation interface.
Note: The StreamSinkProvider interface is
marked as experimental and unstable, but it has existed
since Spark 2.0.0 and is used by the Kafka integration.
Additionally, per SPARK-26415, there will be no
more Spark 2.x minor releases and Spark would
not break this API in a maintenance release. This
means the interface is effectively stable for all
of Spark 2.
Change-Id: I731e35f82c8cca7d911e4d879aa6853112132b17
---
M java/kudu-spark/src/main/scala/org/apache/kudu/spark/kudu/DefaultSource.scala
M java/kudu-spark/src/test/scala/org/apache/kudu/spark/kudu/StreamingTest.scala
2 files changed, 72 insertions(+), 37 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/87/12087/3
--
To view, visit http://gerrit.cloudera.org:8080/12087
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I731e35f82c8cca7d911e4d879aa6853112132b17
Gerrit-Change-Number: 12087
Gerrit-PatchSet: 3
Gerrit-Owner: Grant Henke <granthe...@apache.org>
Gerrit-Reviewer: Andrew Wong <aw...@cloudera.com>
Gerrit-Reviewer: Grant Henke <granthe...@apache.org>
Gerrit-Reviewer: Hao Hao <hao....@cloudera.com>
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Mike Percy <mpe...@apache.org>
