GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2384
[CARBONDATA-2608] SDK Support JSON data loading directly (without AVRO
conversion)
What changes were proposed in this pull request?
Currently SDK Support JSON data loading only with AVRO support.
So, converting json to avro record and avro to carbon object is a two step
process. Hence there is a need for a new carbonWriter that works with Json
without AVRO.
This PR implents that.
Highlights:
Works with just the json data and carbon schema.
supports reading multiple json files in a folder.
supports single row json write.
How was this patch tested?
Manual testing, and UTs are added in another PR.
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:
- [ ] Any interfaces changed? NA
- [ ] Any backward compatibility impacted? NA
- [ ] Document update required? Yes, will be handled in separate PR
- [ ] Testing done
Yes, updated the UT.
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA. NA
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ajantha-bhat/carbondata issue_fix
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/2384.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2384
----
commit 0c99d11c68d681f15c051d8c8e3ded5ced8b1708
Author: ajantha-bhat <ajanthabhat@...>
Date: 2018-06-15T10:21:16Z
JsonCarbonWrtier
----
---
