On Tue, Oct 11, 2016 at 2:32 AM, Ravindra Pesala <ravi.pes...@gmail.com> wrote: > Currently data is loading to carbon in 2 pass/jobs > 1. Generating global dictionary using spark job.
Do we have local dictionaries? If not, what if the column has many distinct values - will the big dictionary loaded into memory? Regards, Qingqing