Hi, Yes, it is a good suggestion we can plan to set the number of loading cores dynamically as per the available executor cores. Can you please raise jira for it.
Regards, Ravindra On 25 October 2017 at 12:08, xm_zzc <441586...@qq.com> wrote: > Hi: > If we are using carbondata + spark to load data, we can set > carbon.number.of.cores.while.loading to the number of executor cores. > > When set the number of executor cores to 6, it shows that there are at > least 6 cores per node for loading data, so we can set > carbon.number.of.cores.while.loading to 6 automatically. > > > > -- > Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556. > n5.nabble.com/ > -- Thanks & Regards, Ravi
