GitHub user jackylk opened a pull request:
https://github.com/apache/carbondata/pull/1798
[CARBONDATA-1995][CARBONDATA-1996][WIP] Support file level input output
format
This PR add support for carbon file input output format. The datasource is
called "carbonfile" to differentiate with "carbondata". It uses standard spark
FileFormat interface and writes NO_SORT carbon files.
- [ ] Any interfaces changed?
- [ ] Any backward compatibility impacted?
- [ ] Document update required?
- [ ] Testing done
Please provide details on
- Whether new unit test cases have been added or why no new tests
are required?
- How it is tested? Please attach test report.
- Is it a performance related change? Please attach the performance
test report.
- Any additional information to help reviewers in testing this
change.
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jackylk/incubator-carbondata
filelevel_input_output_format
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/1798.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1798
----
commit a13fb16138bacc5521274227a5f097918ab12979
Author: Jacky Li <jacky.likun@...>
Date: 2018-01-06T12:28:44Z
remove partitionid
commit 2015fcd8980b6d7b206b608ab41493bb0a9b1467
Author: Jacky Li <jacky.likun@...>
Date: 2018-01-07T16:10:19Z
unify writer
commit 0eb4f1305070fe3a0fa16c929ce7e8786bfa9c2c
Author: Jacky Li <jacky.likun@...>
Date: 2018-01-14T13:24:39Z
support file level input output format
----
---
