GitHub user jose-torres opened a pull request:
https://github.com/apache/spark/pull/20906
[SPARK-23561][SS] Pull continuous processing out of WriteToDataSourceV2Exec.
## What changes were proposed in this pull request?
Pull continuous processing out of WriteToDataSourceV2Exec into its own plan
node ContinuousWriteExec.
This is part of the work required to let StreamWriter stop inheriting from
DataSourceWriter.
## How was this patch tested?
existing tests - refactoring only
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jose-torres/spark SPARK-23561
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20906.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20906
----
commit 0e8d80da1350b950fd690ff7c762d07d0767eafd
Author: Jose Torres <torres.joseph.f+github@...>
Date: 2018-03-21T22:05:31Z
partial
commit 270f8ffe062d76e44a726753afc07c78348c3cc6
Author: Jose Torres <torres.joseph.f+github@...>
Date: 2018-03-22T06:08:52Z
make ContinuousWriteExec work
commit 0cfeaeb6c0e6a3b500341852db8c53359120a753
Author: Jose Torres <torres.joseph.f+github@...>
Date: 2018-03-23T02:44:10Z
fix docs
commit 7c375339bac0704c99ba6d87ee671dc3b7c0f531
Author: Jose Torres <torres.joseph.f+github@...>
Date: 2018-03-26T16:47:16Z
remove old path
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
