Github user gvramana commented on a diff in the pull request:
https://github.com/apache/incubator-carbondata/pull/111#discussion_r76946838
--- Diff:
processing/src/main/java/org/apache/carbondata/processing/csvreaderstep/UnivocityCsvParser.java
---
@@ -41,6 +41,10 @@
public class UnivocityCsvParser {
/**
+ * Max number of columns that will be parsed for a row by univocity
parsing
+ */
+ private static final int MAX_NUMBER_OF_COLUMNS_FOR_PARSING = 2000;
--- End diff --
If array creation is for every row, then we should surely control it.
If array creation is one time, then can give value of 2000 as default. and
can add DataLoad command option to control it, mainly useful for wide tables
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
