intellij compiling issue

2016-09-27 Thread Qingqing Zhou
Hi, I follow the build instruction and get the lastest carbon built successfully: [INFO] Reactor Summary: [INFO] [INFO] Apache CarbonData :: Parent SUCCESS [ 0.846 s] [INFO] Apache CarbonData :: Common SUCCESS [ 1.539 s] [INFO] Apache CarbonData :

Re: intellij compiling issue

2016-09-29 Thread Qingqing Zhou
On Thu, Sep 29, 2016 at 3:38 PM, Aniket Adnaik wrote: > > > 2. After you import project as maven project in intellij >Go to "Build" tab and Click "*Make Project*" . >*Please note:* Do NOT use "Rebuild Project" , it will do a clean build, Perfect, this works for me! Thanks, Qingqing

Re: Abstracting CarbonData's Index Interface

2016-10-03 Thread Qingqing Zhou
On Fri, Sep 30, 2016 at 10:31 PM, Jacky Li wrote: > However, it also introduces memory consumption of the index tree and > impact first query time because the process of loading of index from > file footer into memory. On the other side, in a multi-tennant > environment, multiple applications may

Re: Abstracting CarbonData's Index Interface

2016-10-04 Thread Qingqing Zhou
On Mon, Oct 3, 2016 at 8:52 PM, Jacky Li wrote: > I think we can try to reuse anything except for Index storage, like > segment management, query logic processing after InputSplit is gathered > by calling index interface.I think index can be programmed in different > level, what I proposed here is

Re: Abstracting CarbonData's Index Interface

2016-10-04 Thread Qingqing Zhou
On Mon, Oct 3, 2016 at 9:14 PM, Jacky Li wrote: > If data is append only, I think read and load of index is enough. I > think you are right, we should have a clean Index API, currently I am > thinking of read and load API only: I am not super fan for external index at this stage. Comparing to "da

Re: Discussion(New feature) regarding single pass data loading solution.

2016-10-12 Thread Qingqing Zhou
On Tue, Oct 11, 2016 at 2:32 AM, Ravindra Pesala wrote: > Currently data is loading to carbon in 2 pass/jobs > 1. Generating global dictionary using spark job. Do we have local dictionaries? If not, what if the column has many distinct values - will the big dictionary loaded into memory? Regard

Re: [Discussion] Support String Trim For Table Level or Col Level

2016-10-19 Thread Qingqing Zhou
On Mon, Oct 17, 2016 at 1:59 AM, 向志强 wrote: > trim the data when data loading. > This looks like a query processor (e.g., Spark) 's functionality instead of Carbon's. User can even request some other transformations, like a complicate SELECTE statement, while loading the data. One way to do this

Re: [DISCUSSION] Should Carbon prohibit to use reserved words in database\table\col name

2016-10-31 Thread Qingqing Zhou
On Sun, Oct 30, 2016 at 6:51 PM, Lion.X wrote: > Ref: https://issues.apache.org/jira/browse/CARBONDATA-332I agree with > Harmeet's opinion that it is not a recommended and good approach for > using system reserved words in creating data structures like database, > tables or columns.In hive and Ora