GitHub user xubo245 reopened a pull request:
https://github.com/apache/carbondata/pull/2691
[CARBONDATA-2912] Support CSV table load csv data with spark2.2
In branch-1.3, CSV table cann't load csv data with spark2.2 because: If
using low commons-lang version, the default for the timestampFormat is
yyyy-MM-dd'T'HH:mm:ss.SSSXXX which is an illegal argument and can not be
recognized after upgrade spark from 2.1 to 2.2. It needs to be set when you are
writing the dataframe out.
Carbon need upgrade commons-lang3 version
CSV table is "create table ... using csv options..."
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:
- [x] Any interfaces changed?
No
- [x] Any backward compatibility impacted?
No
- [x] Document update required?
No
- [x] Testing done
add some test case
- [x] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA.
No
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/xubo245/carbondata
CARBONDATA-2912_twoInsert1.3.2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/2691.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2691
----
commit 8445a94e0e3fcfe2a4abaa079cf02e38ff7e6c6e
Author: xubo245 <xubo29@...>
Date: 2018-09-04T08:37:37Z
[CARBONDATA-2912] Support CSV table load csv data with spark2.2
1.upgrade commons-lang3 version
2.add some test case
----
---
