Github user kumarvishal09 commented on a diff in the pull request:
https://github.com/apache/incubator-carbondata/pull/111#discussion_r76936492
--- Diff:
processing/src/main/java/org/apache/carbondata/processing/csvreaderstep/UnivocityCsvParser.java
---
@@ -41,6 +41,10 @@
public class UnivocityCsvParser {
/**
+ * Max number of columns that will be parsed for a row by univocity
parsing
+ */
+ private static final int MAX_NUMBER_OF_COLUMNS_FOR_PARSING = 2000;
--- End diff --
I think i will fail if csv file has more number of column than 2000 and
schema you have selected less columns. Better expose one property so user can
also configure max number of columns in csv file.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
