[jira] [Created] (CARBONDATA-402) carbon should support CreateAsSelect

2016-11-09 Thread Jay (JIRA)
Jay created CARBONDATA-402: -- Summary: carbon should support CreateAsSelect Key: CARBONDATA-402 URL: https://issues.apache.org/jira/browse/CARBONDATA-402 Project: CarbonData Issue Type: Improvement

[GitHub] incubator-carbondata pull request #309: [WIP]support CreateAsSelect

2016-11-09 Thread Jay357089
GitHub user Jay357089 opened a pull request: https://github.com/apache/incubator-carbondata/pull/309 [WIP]support CreateAsSelect Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted lik

GC problem and performance refine problem

2016-11-09 Thread Anning Luo
Hi, We are using carbondata to build our table and running query in CarbonContext. We have some performance problem during refining the system. Background: cluster: 100 executor,5 task/executor, 10G memory/executor data:60+GB(per one replica)

Re: [VOTE] Apache CarbonData 0.2.0-incubating release

2016-11-09 Thread Aniket Adnaik
+1 Regards, Aniket On 9 Nov 2016 3:17 p.m., "Liang Chen" wrote: > Hi all, > > I submit the CarbonData 0.2.0-incubating to your vote. > > Release Notes: > https://issues.apache.org/jira/secure/ReleaseNote.jspa? > projectId=12320220&version=12337896 > > Staging Repository: > https://repository.ap

[jira] [Created] (CARBONDATA-401) Look forward to support reading csv file only once in data loading

2016-11-09 Thread Lionx (JIRA)
Lionx created CARBONDATA-401: Summary: Look forward to support reading csv file only once in data loading Key: CARBONDATA-401 URL: https://issues.apache.org/jira/browse/CARBONDATA-401 Project: CarbonData

Re: [VOTE] Apache CarbonData 0.2.0-incubating release

2016-11-09 Thread Vimal Das Kammath
+1 -Vimal On Nov 10, 2016 4:47 AM, "Liang Chen" wrote: > Hi all, > > I submit the CarbonData 0.2.0-incubating to your vote. > > Release Notes: > https://issues.apache.org/jira/secure/ReleaseNote.jspa? > projectId=12320220&version=12337896 > > Staging Repository: > https://repository.apache.org/c

Re: RE: [VOTE] Apache CarbonData 0.2.0-incubating release

2016-11-09 Thread Kumar Vishal
+1 -Regards Kumar Vishal On Nov 10, 2016 07:48, "Ravindra Pesala" wrote: > +1 > > On Thu, Nov 10, 2016, 7:07 AM Jay <2550062...@qq.com> wrote: > > > +1 > > > > > > Regards > > Jay > > > > > > -- 原始邮件 -- > > 发件人: "Jihong Ma";; > > 发送时间: 2016年11月10日(星期四) 上午7:58 > >

Re: RE: [VOTE] Apache CarbonData 0.2.0-incubating release

2016-11-09 Thread Ravindra Pesala
+1 On Thu, Nov 10, 2016, 7:07 AM Jay <2550062...@qq.com> wrote: > +1 > > > Regards > Jay > > > -- 原始邮件 -- > 发件人: "Jihong Ma";; > 发送时间: 2016年11月10日(星期四) 上午7:58 > 收件人: "dev@carbondata.incubator.apache.org"< > dev@carbondata.incubator.apache.org>; "chenliang...@apache

??????RE: [VOTE] Apache CarbonData 0.2.0-incubating release

2016-11-09 Thread Jay
+1 Regards Jay -- -- ??: "Jihong Ma";; : 2016??11??10??(??) 7:58 ??: "dev@carbondata.incubator.apache.org"; "chenliang...@apache.org"; : RE: [VOTE] Apache CarbonData 0.2.0-incubating release +1 binding. Jihong -Or

Re: As planed, we are ready to make Apache CarbonData 0.2.0 release:

2016-11-09 Thread foryou2030
+1 regards Gin 发自我的 iPhone > 在 2016年11月10日,上午3:25,Kumar Vishal 写道: > > +1 > -Redards > Kumar Vishal > >> On Nov 9, 2016 08:04, "Jacky Li" wrote: >> >> +1 >> >> Regards, >> Jacky >> >>> 在 2016年11月9日,上午9:05,Jay <2550062...@qq.com> 写道: >>> >>> +1 >>> regards >>> Jay >>> >>> >>> >>> >>> -

RE: [VOTE] Apache CarbonData 0.2.0-incubating release

2016-11-09 Thread Jihong Ma
+1 binding. Jihong -Original Message- From: Liang Chen [mailto:chenliang6...@gmail.com] Sent: Wednesday, November 09, 2016 3:18 PM To: dev@carbondata.incubator.apache.org Subject: [VOTE] Apache CarbonData 0.2.0-incubating release Hi all, I submit the CarbonData 0.2.0-incubating to your

[VOTE] Apache CarbonData 0.2.0-incubating release

2016-11-09 Thread Liang Chen
Hi all, I submit the CarbonData 0.2.0-incubating to your vote. Release Notes: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220&version=12337896 Staging Repository: https://repository.apache.org/content/repositories/orgapachecarbondata-1006 Git Tag: carbondata-0.2.0-incu

Re: As planed, we are ready to make Apache CarbonData 0.2.0 release:

2016-11-09 Thread Kumar Vishal
+1 -Redards Kumar Vishal On Nov 9, 2016 08:04, "Jacky Li" wrote: > +1 > > Regards, > Jacky > > > 在 2016年11月9日,上午9:05,Jay <2550062...@qq.com> 写道: > > > > +1 > > regards > > Jay > > > > > > > > > > -- 原始邮件 -- > > 发件人: "向志强";; > > 发送时间: 2016年11月9日(星期三) 上午8:59 > > 收件人

[DISCUSS] Improve Statistics and Profiling support

2016-11-09 Thread Venkata Gollamudi
Hi, In Carbondata currently LOG4J level "STATISTICS" is available to log. How ever information is incomplete to debug performance problems and it is not easy to see statistics and profiling information of one query at one place. So we need to relook and improve statistics and profiling. I have pu

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87218055 --- Diff: examples/src/main/scala/org/apache/carbondata/examples/CarbonExample1.scala --- @@ -0,0 +1,340 @@ +/* + * Licensed to the Apac

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87217857 --- Diff: conf/ss.txt --- @@ -0,0 +1,122 @@ + +Release Notes - CarbonData - Version 0.1.0-incubating --- End diff -- why thi

[jira] [Created] (CARBONDATA-400) [Bad Records] Load data is fail and displaying the string value in beeline as exception

2016-11-09 Thread MAKAMRAGHUVARDHAN (JIRA)
MAKAMRAGHUVARDHAN created CARBONDATA-400: Summary: [Bad Records] Load data is fail and displaying the string value in beeline as exception Key: CARBONDATA-400 URL: https://issues.apache.org/jira/browse/CAR

[jira] [Created] (CARBONDATA-399) [Bad Records] Data Load is not FAILED even bad_records_action="FAIL" .

2016-11-09 Thread Babulal (JIRA)
Babulal created CARBONDATA-399: -- Summary: [Bad Records] Data Load is not FAILED even bad_records_action="FAIL" . Key: CARBONDATA-399 URL: https://issues.apache.org/jira/browse/CARBONDATA-399 Project: Ca

[GitHub] incubator-carbondata pull request #308: [CARBONDATA-398] In DropCarbonTable ...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/308#discussion_r87191882 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchema.scala --- @@ -1284,14 +1284,18 @@ privat

[jira] [Created] (CARBONDATA-398) In DropCarbonTable flow, Metadata lock should be acquired only if table exist

2016-11-09 Thread Naresh P R (JIRA)
Naresh P R created CARBONDATA-398: - Summary: In DropCarbonTable flow, Metadata lock should be acquired only if table exist Key: CARBONDATA-398 URL: https://issues.apache.org/jira/browse/CARBONDATA-398

[GitHub] incubator-carbondata pull request #308: [WIP] In DropCarbonTable flow, Metad...

2016-11-09 Thread nareshpr
GitHub user nareshpr opened a pull request: https://github.com/apache/incubator-carbondata/pull/308 [WIP] In DropCarbonTable flow, Metadata lock should be acquired only if tab… Issue : In drop table flow, we acquiring metadata lock even if table not exist which is creating table

[GitHub] incubator-carbondata pull request #207: [CARBONDATA-283] VT enhancement for ...

2016-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/207 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[jira] [Created] (CARBONDATA-397) Use of ANTLR instead of CarbonSqlParser for parsing queries

2016-11-09 Thread Anurag Srivastava (JIRA)
Anurag Srivastava created CARBONDATA-397: Summary: Use of ANTLR instead of CarbonSqlParser for parsing queries Key: CARBONDATA-397 URL: https://issues.apache.org/jira/browse/CARBONDATA-397 Pro

[GitHub] incubator-carbondata pull request #307: [Carbondata-396] Implement test case...

2016-11-09 Thread harmeetsingh0013
GitHub user harmeetsingh0013 opened a pull request: https://github.com/apache/incubator-carbondata/pull/307 [Carbondata-396] Implement test cases for datastorage package Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87172561 --- Diff: integration/spark/src/main/java/org/apache/carbondata/spark/load/CarbonLoaderUtil.java --- @@ -215,6 +227,105 @@ public static voi

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87171862 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/RowConverterImpl.java --- @@ -43,35 +45,58 @@

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87171880 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/sort/impl/ParallelReadMergeSorterImpl.java --- @@ -102,21 +102,1

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87171144 --- Diff: processing/src/main/java/org/apache/carbondata/processing/sortandgroupby/sortdata/IntermediateFileMerger.java --- @@ -110,7 +116,1

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87171167 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/SortProcessorStepImpl.java --- @@ -50,6 +50,7 @@ public So

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87171187 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/DataConverterProcessorStepImpl.java --- @@ -47,20 +58,109

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170923 --- Diff: processing/src/main/java/org/apache/carbondata/processing/sortandgroupby/sortdata/SortParameters.java --- @@ -122,6 +116,11 @@

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170873 --- Diff: processing/src/main/java/org/apache/carbondata/processing/surrogatekeysgenerator/csvbased/BadRecordslogger.java --- @@ -81,13 +81,

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170942 --- Diff: processing/src/main/java/org/apache/carbondata/processing/sortandgroupby/sortdata/SortDataRows.java --- @@ -264,6 +277,72 @@ priva

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170892 --- Diff: processing/src/main/java/org/apache/carbondata/processing/sortandgroupby/sortdata/SortTempFileChunkHolder.java --- @@ -136,6 +136,

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170828 --- Diff: processing/src/main/java/org/apache/carbondata/processing/util/CarbonDataProcessorUtil.java --- @@ -396,4 +407,223 @@ private stat

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170805 --- Diff: processing/src/main/java/org/apache/carbondata/processing/util/CarbonDataProcessorUtil.java --- @@ -396,4 +407,223 @@ private stat

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170789 --- Diff: integration/spark/src/main/java/org/apache/carbondata/spark/load/CarbonLoaderUtil.java --- @@ -215,6 +227,105 @@ public static voi

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170848 --- Diff: processing/src/main/java/org/apache/carbondata/processing/surrogatekeysgenerator/csvbased/CarbonCSVBasedSeqGenStep.java --- @@ -95

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170688 --- Diff: integration/spark/src/main/java/org/apache/carbondata/spark/load/CarbonLoaderUtil.java --- @@ -215,6 +227,105 @@ public static voi

[GitHub] incubator-carbondata pull request #298: [CARBONDATA-383]Optimize hdfsStoreLo...

2016-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/298 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[jira] [Created] (CARBONDATA-396) Implement test cases for datastorage package

2016-11-09 Thread Anurag Srivastava (JIRA)
Anurag Srivastava created CARBONDATA-396: Summary: Implement test cases for datastorage package Key: CARBONDATA-396 URL: https://issues.apache.org/jira/browse/CARBONDATA-396 Project: CarbonData