GitHub user jatin9896 opened a pull request:
https://github.com/apache/carbondata/pull/1860
[CARBONDATA-2080] [S3-Implementation] Propagated hadoopConf from driver to
executor for s3 implementation in cluster mode.
Problem : hadoopconf was not getting propagated from driver to the executor
that's why load was failing to the distributed environment.
Solution: Setting the Hadoop conf in base class CarbonRDD
How to verify this PR :
Execute the load in the cluster mode It should be a success using location
s3.
Be sure to do all of the following checklists to help us incorporate
your contribution quickly and easily:
- [ ] Any interfaces changed? No
- [ ] Any backward compatibility impacted? No
- [ ] Document update required? No
- [ ] Testing done
Please provide details on
- Whether new unit test cases have been added or why no new tests
are required? No
- How it is tested? Please attach test report. Testing is done
Manually
- Is it a performance related change? Please attach the performance
test report. No
- Any additional information to help reviewers in testing this
change. No
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jatin9896/incubator-carbondata CARBONDATA-2080
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/1860.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1860
----
commit a310a9a5a6d230501bfd26d7c3605791638a1860
Author: Jatin <jatin.demla@...>
Date: 2018-01-25T11:23:00Z
Propagated hadoopConf from driver to executor for s3 implementation
----
---
