[jira] [Created] (CARBONDATA-3003) Suppor read batch row in CSDK

2018-10-11 Thread xubo245 (JIRA) 
xubo245 created CARBONDATA-3003:
---

 Summary: Suppor read batch row in CSDK
 Key: CARBONDATA-3003
 URL: https://issues.apache.org/jira/browse/CARBONDATA-3003
 Project: CarbonData
  Issue Type: Sub-task
Affects Versions: 1.5.0
Reporter: xubo245
Assignee: xubo245
 Fix For: 1.5.0


Suppor read batch row in CSDK



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] carbondata pull request #2810: [WIP] Add CarbonSession Java Example

2018-10-11 Thread xuchuanyin 
Github user xuchuanyin commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/2810#discussion_r224658474
  
--- Diff: 
examples/spark2/src/main/java/org/apache/carbondata/examples/sql/CarbonSessionExample.java
 ---
@@ -0,0 +1,137 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ *http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.carbondata.examples.sql;
+
+import org.apache.carbondata.core.constants.CarbonCommonConstants;
+import org.apache.carbondata.core.util.CarbonProperties;
+import org.apache.carbondata.examples.util.ExampleUtils;
+import org.apache.log4j.PropertyConfigurator;
+import org.apache.spark.sql.SparkSession;
+
+import java.io.File;
+import java.io.IOException;
+
+public class CarbonSessionExample {
+
+  public static void main(String[] args) {
+File file = new 
File(CarbonSessionExample.class.getResource("/").getPath() + "../..");
+try {
+  String rootPath = file.getCanonicalPath();
+  System.setProperty("path.target", rootPath + 
"/examples/spark2/target");
+  PropertyConfigurator.configure(rootPath + 
"/examples/spark2/src/main/resources/log4j.properties");
+  
CarbonProperties.getInstance().addProperty(CarbonCommonConstants.ENABLE_QUERY_STATISTICS,
 "true");
+  SparkSession spark = 
ExampleUtils.createCarbonSession("JavaCarbonSessionExample", 1);
--- End diff --

I think you can change this variable name to 'carbon' to tell the user that 
it is not a raw SparkSession.

Besides, I think it's better to add an example for DataFrame  (write 
dataframe to carbon table).


---

[GitHub] carbondata issue #2730: [WIP] Performance improvements for Fileformat and Pr...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2730
  
Build Failed with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/979/



---

[GitHub] carbondata issue #2730: [WIP] Performance improvements for Fileformat and Pr...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2730
  
Build Failed  with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/carbondataprbuilder2.3/9047/



---

[GitHub] carbondata issue #2730: [WIP] Performance improvements for Fileformat and Pr...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2730
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/782/



---

[GitHub] carbondata issue #2811: [CARBONDATA-3002] Fix some spell error and remove th...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2811
  
Build Success with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/978/



---

[GitHub] carbondata issue #2811: [CARBONDATA-3002] Fix some spell error and remove th...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2811
  
Build Success with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/carbondataprbuilder2.3/9046/



---

[GitHub] carbondata issue #2810: [WIP] Add CarbonSession Java Example

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2810
  
Build Success with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/977/



---

[GitHub] carbondata issue #2811: [CARBONDATA-3002] Fix some spell error and remove th...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2811
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/781/



---

[GitHub] carbondata issue #2810: [WIP] Add CarbonSession Java Example

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2810
  
Build Success with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/carbondataprbuilder2.3/9045/



---

[GitHub] carbondata pull request #2811: [CARBONDATA-3002] Fix some spell error and re...

2018-10-11 Thread xubo245 
GitHub user xubo245 opened a pull request:

https://github.com/apache/carbondata/pull/2811

[CARBONDATA-3002] Fix some spell error and remove the data after test case 
finished running

[CARBONDATA-3002] Fix some spell error and remove the data after test case 
finished running

1. fix spell error:retrive to retrieve
2.remove the data after test case finished running, by delete table and 
database
3.change dummy table with UUID, avoid erri when there are multiple 
carbonreader

Be sure to do all of the following checklist to help us incorporate 
your contribution quickly and easily:

 - [ ] Any interfaces changed?
 No
 - [ ] Any backward compatibility impacted?
 No
 - [ ] Document update required?
No
 - [ ] Testing done
  no need 
 - [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA. 
No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/xubo245/carbondata 
CARBONDATA-3002_fixSpellError

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/2811.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2811


commit af9de068b3d3eb01ae3e65ec8f8e12fc62e7aabb
Author: xubo245 
Date:   2018-10-11T10:13:14Z

[CARBONDATA-3002] Fix some spell error and remove the data after test case 
finished running
1. fix spell error:retrive to retrieve
2.remove the data after test case finished running, by delete table and 
database
3.change dummy table with UUID, avoid erri when there are multiple 
carbonreader




---

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

2018-10-11 Thread xubo245 
Github user xubo245 commented on the issue:

https://github.com/apache/carbondata/pull/2792
  
@KanakaKumar @kunal642 @ajantha-bhat @jackylk please review it.


---

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2792
  
Build Success with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/976/



---

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2792
  
Build Success with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/carbondataprbuilder2.3/9044/



---

[jira] [Created] (CARBONDATA-3002) Fix some spell error and remove the data after test case finished running

2018-10-11 Thread xubo245 (JIRA) 
xubo245 created CARBONDATA-3002:
---

 Summary: Fix some spell error and remove the data after test case 
finished running
 Key: CARBONDATA-3002
 URL: https://issues.apache.org/jira/browse/CARBONDATA-3002
 Project: CarbonData
  Issue Type: Bug
Affects Versions: 1.5.0
Reporter: xubo245
Assignee: xubo245
 Fix For: 1.5.0


Fix some spell error and remove the data after test case finished running

retrive



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] carbondata issue #2810: [WIP] Add CarbonSession Java Example

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2810
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/780/



---

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2792
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/779/



---

[GitHub] carbondata issue #2802: [HOTFIX] Correct Create Table documentation contents

2018-10-11 Thread chenliang613 
Github user chenliang613 commented on the issue:

https://github.com/apache/carbondata/pull/2802
  
please rebase it.


---

[GitHub] carbondata issue #2810: [WIP] Add CarbonSession Java Example

2018-10-11 Thread chenliang613 
Github user chenliang613 commented on the issue:

https://github.com/apache/carbondata/pull/2810
  
add to whitelist


---

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

2018-10-11 Thread xubo245 
Github user xubo245 commented on the issue:

https://github.com/apache/carbondata/pull/2792
  
retest this please


---

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2792
  
Build Failed with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/975/



---

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2792
  
Build Success with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/carbondataprbuilder2.3/9043/



---

[GitHub] carbondata issue #2691: [CARBONDATA-2912] Support CSV table load csv data wi...

2018-10-11 Thread xubo245 
Github user xubo245 commented on the issue:

https://github.com/apache/carbondata/pull/2691
  
merged to branch-1.3


---

[GitHub] carbondata issue #2730: [WIP] Performance improvements for Fileformat and Pr...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2730
  
Build Failed with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/974/



---

[GitHub] carbondata issue #2730: [WIP] Performance improvements for Fileformat and Pr...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2730
  
Build Failed  with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/carbondataprbuilder2.3/9042/



---

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2792
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/778/



---

[GitHub] carbondata issue #2792: [CARBONDATA-2981] Support read primitive data type i...

2018-10-11 Thread xubo245 
Github user xubo245 commented on the issue:

https://github.com/apache/carbondata/pull/2792
  
retest this please


---

[jira] [Updated] (CARBONDATA-3001) Propose configurable page size in MB (via carbon property)

2018-10-11 Thread Ajantha Bhat (JIRA) 


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ajantha Bhat updated CARBONDATA-3001:
-
Attachment: Propose configurable page size in MB (via carbon property).pdf

> Propose configurable page size in MB (via carbon property)
> --
>
> Key: CARBONDATA-3001
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3001
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: Ajantha Bhat
>Assignee: Ajantha Bhat
>Priority: Minor
> Attachments: Propose configurable page size in MB (via carbon 
> property).pdf
>
>
> For better in-memory processing of carbondata pages, I am proposing 
> configurable page size in MB (via carbon property).
> please find the attachment for more details.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (CARBONDATA-3001) Propose configurable page size in MB (via carbon property)

2018-10-11 Thread Ajantha Bhat (JIRA) 
Ajantha Bhat created CARBONDATA-3001:


 Summary: Propose configurable page size in MB (via carbon property)
 Key: CARBONDATA-3001
 URL: https://issues.apache.org/jira/browse/CARBONDATA-3001
 Project: CarbonData
  Issue Type: Improvement
Reporter: Ajantha Bhat
Assignee: Ajantha Bhat


For better in-memory processing of carbondata pages, I am proposing 
configurable page size in MB (via carbon property).

please find the attachment for more details.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] carbondata issue #2730: [WIP] Performance improvements for Fileformat and Pr...

2018-10-11 Thread CarbonDataQA 
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2730
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/777/



---

[GitHub] carbondata issue #2810: [WIP] Add CarbonSession Java Example

2018-10-11 Thread lijiang2 
Github user lijiang2 commented on the issue:

https://github.com/apache/carbondata/pull/2810
  
@jackylk PTAL.


---