[GitHub] incubator-carbondata pull request #313: [CARBONDATA-405]Fixed Data load fail...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/313#discussion_r8753 --- Diff: integration/spark/src/test/scala/org/apache/carbondata/spark/testsuite/dataframe/DataFrameTestCase.scala --- @@ -0,0 +1,57 @@

Re: GC problem and performance refine problem

2016-11-10 Thread An Lan
Hi Kumar Vishal, 1. Create table ddl: CREATE TABLE IF NOT EXISTS Table1 (* h Int, g Int, d String, f Int, e Int,* a Int, b Int, …(extra near 300 columns) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES( "NO_INVERTED_INDEX”=“a”, "NO_INVERTED_INDEX”=“b”, …(extra near 300 columns)

Re: [VOTE] Apache CarbonData 0.2.0-incubating release

2016-11-10 Thread Jean-Baptiste Onofré
+1 (binding) Regards JB On 11/10/2016 12:17 AM, Liang Chen wrote: Hi all, I submit the CarbonData 0.2.0-incubating to your vote. Release Notes: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220=12337896 Staging Repository:

[GitHub] incubator-carbondata pull request #305: [CARBONDATA-393] implement test case...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/305#discussion_r87540775 --- Diff: core/src/test/java/org/apache/carbondata/core/keygenerator/mdkey/NumberCompressorUnitTest.java --- @@ -0,0 +1,132 @@ +/*

[GitHub] incubator-carbondata pull request #262: [CARBONDATA-308] Use CarbonInputForm...

2016-11-10 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/262#discussion_r87540836 --- Diff: processing/src/main/java/org/apache/carbondata/lcm/status/SegmentStatusManager.java --- @@ -177,6 +178,13 @@ public

[GitHub] incubator-carbondata pull request #262: [CARBONDATA-308] Use CarbonInputForm...

2016-11-10 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/262#discussion_r87540816 --- Diff: processing/src/main/java/org/apache/carbondata/lcm/status/SegmentStatusManager.java --- @@ -177,6 +178,13 @@ public

[GitHub] incubator-carbondata pull request #305: [CARBONDATA-393] implement test case...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/305#discussion_r87540550 --- Diff: core/src/test/java/org/apache/carbondata/core/keygenerator/mdkey/BitsUnitTest.java --- @@ -0,0 +1,98 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #305: [CARBONDATA-393] implement test case...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/305#discussion_r87540505 --- Diff: core/src/test/java/org/apache/carbondata/core/keygenerator/mdkey/BitsUnitTest.java --- @@ -0,0 +1,98 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #305: [CARBONDATA-393] implement test case...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/305#discussion_r87540197 --- Diff: core/src/test/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthVariableSplitGeneratorUnitTest.java ---

[GitHub] incubator-carbondata pull request #303: [CARBONDATA-386] Unit test case for ...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/303#discussion_r87531522 --- Diff: core/src/test/java/org/apache/carbondata/core/util/CarbonMetadataUtilTest.java --- @@ -0,0 +1,60 @@ +/* + * Licensed to

[GitHub] incubator-carbondata pull request #295: [Carbondata-379] Scan package's unit...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/295#discussion_r87529444 --- Diff: core/src/test/java/org/apache/carbondata/scan/result/impl/NonFilterQueryScannedResultTest.java --- @@ -0,0 +1,53 @@ +/* +

Re: As planed, we are ready to make Apache CarbonData 0.2.0 release:

2016-11-10 Thread bill.zhou
+1 Regards bill.zhou Liang Chen wrote > Hi all > > In 0.2.0 version of CarbonData, there are major performance improvements > like blocklets distribution, support BZIP2 compressed files, and so on > added to enhance the CarbonData performance significantly. Along with > performance

Re: [VOTE] Apache CarbonData 0.2.0-incubating release

2016-11-10 Thread jarray
+1 binding On 11/11/2016 02:37, Venkata Gollamudi wrote: +1 Regards, Ramana On Thu, Nov 10, 2016, 10:03 PM Jacky Li wrote: > +1 binding > > Regards, > Jacky > > ---Original--- > From: "Aniket Adnaik" > Date: 2016/11/10 14:43:49 > To:

[GitHub] incubator-carbondata pull request #295: [Carbondata-379] Scan package's unit...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/295#discussion_r87527367 --- Diff: core/src/main/java/org/apache/carbondata/scan/complextypes/PrimitiveQueryType.java --- @@ -166,6 +166,7 @@ public

[GitHub] incubator-carbondata pull request #277: [CARBONDATA-357] Add unit test for V...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/277#discussion_r87527053 --- Diff: core/src/test/java/org/apache/carbondata/core/util/ValueCompressionUtilTest.java --- @@ -0,0 +1,546 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #277: [CARBONDATA-357] Add unit test for V...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/277#discussion_r87526104 --- Diff: core/src/test/java/org/apache/carbondata/core/util/ValueCompressionUtilTest.java --- @@ -0,0 +1,546 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #313: [CARBONDATA-405]Fixed Data load fail...

2016-11-10 Thread Jay357089
Github user Jay357089 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/313#discussion_r87524058 --- Diff: integration/spark/src/test/scala/org/apache/carbondata/spark/testsuite/dataframe/DataFrameTestCase.scala --- @@ -0,0 +1,57 @@

Re: [VOTE] Apache CarbonData 0.2.0-incubating release

2016-11-10 Thread 金铸
+1 bingding jinzhu 在 2016/11/11 0:33, Jacky Li 写道: +1 binding Regards, Jacky ---Original--- From: "Aniket Adnaik" Date: 2016/11/10 14:43:49 To: "dev";"chenliang613"; Subject: Re: [VOTE] Apache

Re: As planed, we are ready to make Apache CarbonData 0.2.0 release:

2016-11-10 Thread Venkata Gollamudi
+1 Regards, Ramana On Thu, Nov 10, 2016, 6:03 AM foryou2030 wrote: > +1 > regards > Gin > > 发自我的 iPhone > > > 在 2016年11月10日,上午3:25,Kumar Vishal 写道: > > > > +1 > > -Redards > > Kumar Vishal > > > >> On Nov 9, 2016 08:04, "Jacky Li"

[GitHub] incubator-carbondata pull request #270: [CARBONDATA-346] Add unit test for C...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/270#discussion_r87453971 --- Diff: core/src/test/java/org/apache/carbondata/core/util/CarbonUtilTest.java --- @@ -18,18 +18,746 @@ */ package

[GitHub] incubator-carbondata pull request #269: [CARBONDATA-345] improve code-covera...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/269#discussion_r87446559 --- Diff: processing/src/test/java/org/apache/carbondata/lcm/locks/ZooKeeperLockingTest.java --- @@ -41,103 +41,103 @@ */ public

[GitHub] incubator-carbondata pull request #269: [CARBONDATA-345] improve code-covera...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/269#discussion_r87446084 --- Diff: pom.xml --- @@ -6,9 +6,7 @@ The ASF licenses this file to You under the Apache License, Version 2.0 (the

[GitHub] incubator-carbondata pull request #269: [CARBONDATA-345] improve code-covera...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/269#discussion_r87444589 --- Diff: core/src/test/java/org/apache/carbondata/core/cache/dictionary/DictionaryByteArrayWrapperTest.java --- @@ -0,0 +1,58 @@ +/*

[GitHub] incubator-carbondata pull request #267: [CARBONDATA-340] implement test case...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/267#discussion_r87442533 --- Diff: core/src/main/java/org/apache/carbondata/core/load/LoadMetadataDetails.java --- @@ -150,7 +150,7 @@ public String

[GitHub] incubator-carbondata pull request #313: [CARBONDATA-405]Fixed Data load fail...

2016-11-10 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/313 [CARBONDATA-405]Fixed Data load fail if dataframe is created with LONG datatype column If the dataframe schema has long datatype then carbon table creation is failing because it

Re: [VOTE] Apache CarbonData 0.2.0-incubating release

2016-11-10 Thread Jacky Li
+1 binding Regards, Jacky ---Original--- From: "Aniket Adnaik" Date: 2016/11/10 14:43:49 To: "dev";"chenliang613"; Subject: Re: [VOTE] Apache CarbonData 0.2.0-incubating release +1 Regards, Aniket On 9

[GitHub] incubator-carbondata pull request #296: [CARBONDATA-382]Like Filter Query Op...

2016-11-10 Thread kumarvishal09
Github user kumarvishal09 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/296#discussion_r87425199 --- Diff: core/src/main/java/org/apache/carbondata/scan/filter/FilterExpressionProcessor.java --- @@ -286,6 +289,13 @@ private

[jira] [Created] (CARBONDATA-406) Empty Folder is created when data load from dataframe

2016-11-10 Thread Babulal (JIRA)
Babulal created CARBONDATA-406: -- Summary: Empty Folder is created when data load from dataframe Key: CARBONDATA-406 URL: https://issues.apache.org/jira/browse/CARBONDATA-406 Project: CarbonData

Re: GC problem and performance refine problem

2016-11-10 Thread Kumar Vishal
Hi Anning Luo, Can u please provide below details. 1.Create table ddl. 2.Number of node in you cluster setup. 3. Number of executors per node. 4. Query statistics. Please find my comments in bold. Problem: 1. GC problem. We suffer a 20%~30% GC time for some task in

[GitHub] incubator-carbondata pull request #312: [CARBONDATA-404] Fixing dataframe sa...

2016-11-10 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/312 [CARBONDATA-404] Fixing dataframe save when loading in cluster mode. Currently dataframe save writes temp csv in local folder so it fails in cluster mode. This PR changes the temp

[jira] [Created] (CARBONDATA-403) add example for data load without using kettle

2016-11-10 Thread Jacky Li (JIRA)
Jacky Li created CARBONDATA-403: --- Summary: add example for data load without using kettle Key: CARBONDATA-403 URL: https://issues.apache.org/jira/browse/CARBONDATA-403 Project: CarbonData

[GitHub] incubator-carbondata pull request #311: add example for data load without us...

2016-11-10 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/311 add example for data load without using kettle In this PR, example SQL and dataframe usage is added for loading data without kettle You can merge this pull request into a Git

[jira] [Created] (CARBONDATA-404) Data loading from DataFrame to carbon table is FAILED

2016-11-10 Thread Babulal (JIRA)
Babulal created CARBONDATA-404: -- Summary: Data loading from DataFrame to carbon table is FAILED Key: CARBONDATA-404 URL: https://issues.apache.org/jira/browse/CARBONDATA-404 Project: CarbonData

GC problem and performance refine problem

2016-11-10 Thread An Lan
Hi, We are using carbondata to build our table and running query in CarbonContext. We have some performance problem during refining the system. *Background*: *cluster*: 100 executor,5 task/executor, 10G memory/executor *data*: 60+GB(per one

join mail list

2016-11-10 Thread Anning Luo
As above

join mail list

2016-11-10 Thread Anning Luo

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/263 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-carbondata pull request #290: [CARBONDATA-371] Write unit test for...

2016-11-10 Thread harmeetsingh0013
Github user harmeetsingh0013 closed the pull request at: https://github.com/apache/incubator-carbondata/pull/290 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

Re: [VOTE] Apache CarbonData 0.2.0-incubating release

2016-11-10 Thread QiangCai
+1 -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/VOTE-Apache-CarbonData-0-2-0-incubating-release-tp2823p2836.html Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com.

[GitHub] incubator-carbondata pull request #310: [CARBONDATA-401][WIP] One Pass Load

2016-11-10 Thread lion-x
GitHub user lion-x opened a pull request: https://github.com/apache/incubator-carbondata/pull/310 [CARBONDATA-401][WIP] One Pass Load # Why raise this PR? # How to do? - [ ] Trans option useOnePass in Load Statement into CarbonCSVBasedSeqGenStep.java - [