GitHub user gengliangwang opened a pull request:
https://github.com/apache/spark/pull/20435
[SPARK-23268][SQL]Reorganize packages in data source V2
## What changes were proposed in this pull request?
1. create a new package for partitioning/distribution related classes.
As Spark will add new concrete implementations of `Distribution` in new
releases, it is good to
have a new package for partitioning/distribution related classes.
2. move streaming related class to package
`org.apache.spark.sql.sources.v2.reader/writer.streaming`, instead of
`org.apache.spark.sql.sources.v2.streaming.reader/writer`.
So that the there won't be package reader/writer inside package streaming,
which is quite confusing.
## How was this patch tested?
Unit test.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gengliangwang/spark new_pkg
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20435.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20435
----
commit da29b863970b8ca5039d547ae5240e5c34f9f11a
Author: Wang Gengliang <ltnwgl@...>
Date: 2018-01-30T08:31:10Z
create a new package for partitioning/distribution related classes
commit 3dc56226ed17637c808df9d8d03f60fcbbae9e55
Author: Wang Gengliang <ltnwgl@...>
Date: 2018-01-30T09:16:01Z
re-org streaming
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
