GitHub user jackylk opened a pull request:
https://github.com/apache/carbondata/pull/2415
[CARBONDATA-2659] Support partition table by DataFrame API
Currently only partition table is only supported by SQL, it should be
supported by Spark DataFrame API also.
This PR added an option to specify the partition columns when writing a
DataFrame to carbon table
For example:
```
df.write
.format("carbondata")
.option("tableName", "carbon_df_table")
.option("partitionColumns", "c1, c2") // a list of column names
.mode(SaveMode.Overwrite)
.save()
```
- [X] Any interfaces changed?
Added an option for DataFrame.write
- [X] Any backward compatibility impacted?
No
- [X] Document update required?
- [X] Testing done
Added one test case
- [X] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA.
NA
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jackylk/incubator-carbondata
dataframe-partition
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/2415.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2415
----
commit 16e6c110060811d2493d014a1f21b9bb0c54ea32
Author: Jacky Li <jacky.likun@...>
Date: 2018-06-26T12:27:37Z
add test
----
---
