Github user gvramana commented on the issue:
https://github.com/apache/incubator-carbondata/pull/802
Handle all the validation in driver and remove from executor.
parameters: csvheadercolumns, maxcolumns(default 2000), Threashold(20000).
1) User configures both csvheadercolumns, maxcolumns,
- if csvheadercolumns >= maxcolumns, give error " csvheadercolumns should
be less than max columns <value>"
- if maxcolumns > threashold, give error "max columns cannot be more than
threashold(20,000)"
2) User configures csvheadercolumns
- if csvheadercolumns >= maxcolumns(default)
maxcolumns = csvheadercolumns+1
- if csvheadercolumns >= threashold, give error " csvheadercolumns should
be less than max threashold(20,000)"
3) User configures nothing
- if csvheadercolumns >= maxcolumns(default)
maxcolumns = csvheadercolumns+1
- if csvheadercolumns >= threashold, give error " csvheadercolumns should
be less than max threashold(20,000)"
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
