GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2690
[HOTFIX] support long string columns with spark FileFormat
**problem:** Exception if we try long string column for Spark file format
**Solution:** For Varchar data type respective spark data type was
selected, hence the exception.
Spark don't have limit for string data type. so map varchar to string type.
Tested with more than 32K length string and added a UT
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:
- [ ] Any interfaces changed? NA
- [ ] Any backward compatibility impacted? NA
- [ ] Document update required? NA
- [ ] Testing done.
Added UT
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA. NA
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ajantha-bhat/carbondata master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/2690.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2690
----
commit 9a3c8045fdf6540d413601bdb9443f72141a8c87
Author: ajantha-bhat <ajanthabhat@...>
Date: 2018-09-04T08:07:09Z
support long string columns with spark FileFormat
----
---
