Re: [jira] [Created] (CARBONDATA-836) Error in load using dataframe - columns containing comma

Thanks Jacky. I have created a JIRA - https://issues.apache.org/jira/browse/CARBONDATA-909 for this. Thanks, Sanoj On Tue, Apr 11, 2017 at 5:42 PM, Jacky Li wrote: > Hi Sanoj, > > This is because in CarbonData loading flow, it needs to scan input data > twice (one for

Re: [jira] [Created] (CARBONDATA-836) Error in load using dataframe - columns containing comma

Hi Sanoj, This is because in CarbonData loading flow, it needs to scan input data twice (one for generating global dictionary, another for actual loading). If user is using Dataframe to write to CarbonData, and if the input dataframe compute is costly, it is better to save it as a temporary

Re: [jira] [Created] (CARBONDATA-836) Error in load using dataframe - columns containing comma

Hi All, In CarbonDataFrameWriter, there is an option to load using CSV file. if (options.tempCSV) { loadTempCSV(options) } else { loadDataFrame(options) } Why is this choice required? Is there any issue if we load it directly without using CSV? I have many dimension table with comma in

[jira] [Created] (CARBONDATA-836) Error in load using dataframe - columns containing comma

Sanoj MG created CARBONDATA-836: --- Summary: Error in load using dataframe - columns containing comma Key: CARBONDATA-836 URL: https://issues.apache.org/jira/browse/CARBONDATA-836 Project: CarbonData