GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2273
[CARBONDATA-2442] Reading two sdk writer output with differnt schema should
prompt exception
[CARBONDATA-2442] Reading two sdk writer output with differnt schema should
prompt exception
**problem** : when two sdk writer output with differnt schema is placed in
same folder for reading, output is not as expected. It has many null
output.
**root cause:** when multiple carbondata and indexx files is placed in same
folder. table schema is inferred by first file.
comparing table schema with all other index file schema validation is
not present
**solution:** comapre table schema with all other index file schema, if
there is a mismatch throw exception
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:
- [ ] Any interfaces changed? NA
- [ ] Any backward compatibility impacted? NA
- [ ] Document update required? NA
- [ ] Testing done
added the test case in TestNonTransactionalCarbonTable.scala
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA. NA
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ajantha-bhat/carbondata schema_mismatch
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/2273.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2273
----
commit 03ab5f30909fe971e6221fdab83bdeb2f81e385c
Author: ajantha-bhat <ajanthabhat@...>
Date: 2018-05-05T11:29:44Z
[CARBONDATA-2442] Reading two sdk writer output with differnt schema should
prompt exception
problem : when two sdk writer output with differnt schema is placed in
same folder for reading, output is not as expected. It has many null
output.
root cause: when multiple carbondata and indexx files is placed in same
folder. table schema is inferred by first file.
comparing table schema with all other index file schema validation is
not present
solution: comapre table schema with all other index file schema, if
there is a mismatch throw exception
----
---
