[GitHub] carbondata issue #1082: [CARBONDATA-1218] In case of data-load failure the B...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1082
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2822/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1112: [CARBONDATA-1244] Rewrite README.md of presto...

[HoneyQuery]

Github user HoneyQuery commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1112#discussion_r124961570
  
--- Diff: 
integration/presto/src/main/java/org/apache/carbondata/presto/impl/CarbonTableReader.java
 ---
@@ -520,7 +626,7 @@ private boolean isValidBlockBasedOnUpdateDetails(
   int blkIndex;
   for (
   bytesRemaining = length;
-  (double) bytesRemaining / (double) splitSize > 1.1D;
+  (double) bytesRemaining / (double) splitSize > 1.1D;// 
BHQ: when there are more than one splits left.
   bytesRemaining -= splitSize) {
--- End diff --

OK.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1096: [WIP] test_spark2.1.1

[QiangCai]

Github user QiangCai closed the pull request at:

https://github.com/apache/carbondata/pull/1096


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1017: [CARBONDATA-1105] support spark 2.1.1

[chenliang613]

Github user chenliang613 commented on the issue:

https://github.com/apache/carbondata/pull/1017
  
@cenyuhai  
1.Formally support spark 2.1.1 integration, need have a discussion and vote 
in dev mailing list.
2.For your PR, please first fix this issue:  currently in 
example/spark2/pom.xml, integration/spark2/pom.xml,  give the fixed spark 
version, this is issue, need remove it. spark version can be inherited from 
parent pom as per users' "mvn compile script"


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1120: [CARBONDATA-1251] Add test cases for IUD feature

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1120
  
Build Success with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/241/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1120: [CARBONDATA-1251] Add test cases for IUD feature

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1120
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1120: [CARBONDATA-1251] Add test cases for IUD feature

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1120
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Assigned] (CARBONDATA-1246) NullPointerException in Presto Integration

[Bhavya Aggarwal (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bhavya Aggarwal reassigned CARBONDATA-1246:
---

Assignee: Bhavya Aggarwal

> NullPointerException in Presto Integration
> --
>
> Key: CARBONDATA-1246
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1246
> Project: CarbonData
>  Issue Type: Bug
>  Components: presto-integration
>Affects Versions: 1.1.0
>Reporter: Jelly King
>Assignee: Bhavya Aggarwal
>  Labels: beginner
> Fix For: 1.2.0
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> In presto integration, _CarbonFile.listFiles()_ function will return null 
> when the specified _fileStatus_ is not a directory or is null. This will 
> incur a NullPointerException when called by 
> _CarbonTableReader.updateTableList()_ function.
> The _listFiles()_ function should return an empty array or throw a new 
> exception to indicate users, instead of returning a null value.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] carbondata issue #1117: [CARBONDATA-757] Big decimal optimization

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1117
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2820/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1111: Rectify Vector Buffer Overflow Calculation

[ravipesala]

Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/
  
Please assign jira to it


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1117: [CARBONDATA-757] Big decimal optimization

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1117
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2819/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1117: [CARBONDATA-757] Big decimal optimization

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1117
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/239/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1119: [CarbonData-1205] change default partition id from M...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1119
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/238/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1112: [CARBONDATA-1244] Rewrite README.md of presto...

[chenliang613]

Github user chenliang613 commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1112#discussion_r124933020
  
--- Diff: 
integration/presto/src/main/java/org/apache/carbondata/presto/impl/CarbonTableReader.java
 ---
@@ -520,7 +626,7 @@ private boolean isValidBlockBasedOnUpdateDetails(
   int blkIndex;
   for (
   bytesRemaining = length;
-  (double) bytesRemaining / (double) splitSize > 1.1D;
+  (double) bytesRemaining / (double) splitSize > 1.1D;// 
BHQ: when there are more than one splits left.
   bytesRemaining -= splitSize) {
--- End diff --

please remove BHQ


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1119: [CarbonData-1205] change default partition id from M...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1119
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2818/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1119: [CarbonData-1205] change default partition id from M...

[chenliang613]

Github user chenliang613 commented on the issue:

https://github.com/apache/carbondata/pull/1119
  
add to whitelist


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Assigned] (CARBONDATA-1244) Rewrite README.md of presto integration and add/rewrite some comments to presto integration.

[Haoqiong Bian (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-1244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Haoqiong Bian reassigned CARBONDATA-1244:
-

Assignee: Haoqiong Bian

> Rewrite README.md of presto integration and add/rewrite some comments to 
> presto integration.
> 
>
> Key: CARBONDATA-1244
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1244
> Project: CarbonData
>  Issue Type: Improvement
>  Components: presto-integration
>Reporter: Haoqiong Bian
>Assignee: Haoqiong Bian
> Fix For: 1.2.0
>
>  Time Spent: 4h 40m
>  Remaining Estimate: 0h
>
> Rewrite README.md of presto integration and add/rewrite some comments to 
> presto integration.
> Make the README easier for starters to play with. Write more comments for the 
> source code of  presto integration to make the code more readable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] carbondata issue #1112: [CARBONDATA-1244] Rewrite README.md of presto integr...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1112
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2817/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1112: [CARBONDATA-1244] Rewrite README.md of presto integr...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1112
  
Build Success with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/237/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1112: [CARBONDATA-1244] Rewrite README.md of presto...

[HoneyQuery]

Github user HoneyQuery commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1112#discussion_r124892937
  
--- Diff: 
integration/presto/src/main/java/org/apache/carbondata/presto/impl/CarbonLocalInputSplit.java
 ---
@@ -17,19 +17,22 @@
 
 package org.apache.carbondata.presto.impl;
 
-import java.util.List;
-
 import com.fasterxml.jackson.annotation.JsonCreator;
 import com.fasterxml.jackson.annotation.JsonProperty;
 
+import java.util.List;
+
+/**
+ * BHQ: CarbonLocalInputSplit represents a block, it contains a set of 
blocklet.
--- End diff --

OK. I will remove BHQ.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1112: [CARBONDATA-1244] Rewrite README.md of presto...

[HoneyQuery]

Github user HoneyQuery commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1112#discussion_r124892745
  
--- Diff: 
integration/presto/src/main/java/org/apache/carbondata/presto/impl/CarbonTableReader.java
 ---
@@ -133,30 +163,54 @@ public boolean updateCarbonFile() {
 return true;
   }
 
+  /**
+   * Return the schema names under a schema store path 
(this.carbonFileList).
+   * @return
+   */
   public List updateSchemaList() {
 updateCarbonFile();
 
 if (carbonFileList != null) {
-  List schemaList =
-  Stream.of(carbonFileList.listFiles()).map(a -> 
a.getName()).collect(Collectors.toList());
+  /*List schemaList =
+  Stream.of(carbonFileList.listFiles()).map(a -> 
a.getName()).collect(Collectors.toList());*/
+  List schemaList = new ArrayList<>();
+  for (CarbonFile file : carbonFileList.listFiles())
--- End diff --

OK. It is a mistake, I will recover it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1112: [CARBONDATA-1244] Rewrite README.md of presto...

[HoneyQuery]

Github user HoneyQuery commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1112#discussion_r124892557
  
--- Diff: integration/presto/README.md ---
@@ -59,28 +55,50 @@ Please follow the below steps to query carbondata in 
presto
   ```
 * config carbondata-connector for presto
   
-  First:compile carbondata-presto integration module
+  Firstly: Compile carbondata, including carbondata-presto integration 
module
   ```
   $ git clone https://github.com/apache/carbondata
-  $ cd carbondata/integration/presto
-  $ mvn clean package
+  $ cd carbondata
+  $ mvn -DskipTests -P{spark-version} 
-Dspark.version={spark-version-number} -Dhadoop.version={hadoop-version-number} 
clean package
+  ```
+  Replace the spark and hadoop version with the version used in your 
cluster.
+  For example, if you use Spark2.1.0 and Hadoop 2.7.3, you would like to 
compile using:
--- End diff --

OK.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1112: [CARBONDATA-1244] Rewrite README.md of presto...

[HoneyQuery]

Github user HoneyQuery commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1112#discussion_r124892155
  
--- Diff: integration/presto/README.md ---
@@ -20,14 +20,10 @@
 Please follow the below steps to query carbondata in presto
 
 ### Config presto server
-* Download presto server 0.166 : 
https://repo1.maven.org/maven2/com/facebook/presto/presto-server/
-* Finish configuration as per 
https://prestodb.io/docs/current/installation/deployment.html
-  for example:
+* Download presto server ( >= 0.166) : 
https://repo1.maven.org/maven2/com/facebook/presto/presto-server/
--- End diff --

I tried using presto 0.179 with carbondata 1.2.0, it looks fine. But I am 
going to change `>=` to `=`.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1109: [CARBONDATA-1241] Single_Pass either should be block...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1109
  
Build Success with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/236/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1109: [CARBONDATA-1241] Single_Pass either should be block...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1109
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2816/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1109: [CARBONDATA-1241] Single_Pass either should be block...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1109
  
Build Success with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/235/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1109: [CARBONDATA-1241] Single_Pass either should be block...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1109
  
Build Success with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/234/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1109: [CARBONDATA-1241] Single_Pass either should be block...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1109
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2815/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1064: [CARBONDATA-1173] Stream ingestion - write path fram...

[aniketadnaik]

Github user aniketadnaik commented on the issue:

https://github.com/apache/carbondata/pull/1064
  
Can someone please merge this PR to "streaming_ingest" branch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1109: [CARBONDATA-1241] Single_Pass either should be block...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1109
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2814/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1109: [CARBONDATA-1241] Single_Pass either should be block...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1109
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2813/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1082: [CARBONDATA-1218] In case of data-load failure the B...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1082
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2812/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2811/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1082: [CARBONDATA-1218] In case of data-load failure the B...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1082
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/232/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Success with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/231/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[mohammadshahidkhan]

Github user mohammadshahidkhan commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
retest this please


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1109: [CARBONDATA-1241] Single_Pass either should be block...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1109
  
Build Success with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/230/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1109: [CARBONDATA-1241] Single_Pass either should be block...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1109
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2810/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1119: [CarbonData-1205] change default partition id from M...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1119
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2809/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2808/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Success with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/229/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1119: [CarbonData-1205] change default partition id from M...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1119
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/228/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1119: [CarbonData-1205] change default partition id...

[lionelcao]

GitHub user lionelcao opened a pull request:

https://github.com/apache/carbondata/pull/1119

[CarbonData-1205] change default partition id from Max to 0

It's a preparation PR for later alter table partition PR.
1. change default partition id from Max to 0
2. remove some useless file
3. extract some common used function
4. fix some typo



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/lionelcao/carbondata carbon_910_6

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1119.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1119


commit d4f7faa30a40ce39878cf4f7dafa006a6e3ea5ae
Author: lionelcao 
Date:   2017-06-29T16:00:32Z

[CARBONDATA-1250] change default partition id from Max to 0

commit b5c3616319227602469251beef6663eb8d7342c8
Author: lionelcao 
Date:   2017-06-29T16:06:30Z

extract common function




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1119: [CarbonData-1205] change default partition id from M...

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1119
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1119: [CarbonData-1205] change default partition id from M...

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1119
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/226/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1110: [CARBONDATA-1238] Decouple the datatype convert in c...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1110
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2805/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1110: [CARBONDATA-1238] Decouple the datatype convert in c...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1110
  
Build Success with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/225/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/224/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Updated] (CARBONDATA-1250) 13. Change default partition id from Max to 0

[Cao, Lionel (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Cao, Lionel updated CARBONDATA-1250:

Summary: 13. Change default partition id from Max to 0  (was: Change 
default partition id from Max to 0)

> 13. Change default partition id from Max to 0
> -
>
> Key: CARBONDATA-1250
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1250
> Project: CarbonData
>  Issue Type: Sub-task
>  Components: data-load, sql
>Reporter: Cao, Lionel
>Assignee: Cao, Lionel
>
> Change default partition id from Max to 0



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (CARBONDATA-1250) Change default partition id from Max to 0

[Cao, Lionel (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Cao, Lionel updated CARBONDATA-1250:

Issue Type: Sub-task  (was: Improvement)
Parent: CARBONDATA-910

> Change default partition id from Max to 0
> -
>
> Key: CARBONDATA-1250
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1250
> Project: CarbonData
>  Issue Type: Sub-task
>  Components: data-load, sql
>Reporter: Cao, Lionel
>Assignee: Cao, Lionel
>
> Change default partition id from Max to 0



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (CARBONDATA-1250) Change default partition id from Max to 0

[Cao, Lionel (JIRA)]

Cao, Lionel created CARBONDATA-1250:
---

 Summary: Change default partition id from Max to 0
 Key: CARBONDATA-1250
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1250
 Project: CarbonData
  Issue Type: Improvement
  Components: data-load, sql
Reporter: Cao, Lionel
Assignee: Cao, Lionel


Change default partition id from Max to 0



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] carbondata issue #1112: [CARBONDATA-1244] Rewrite README.md of presto integr...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1112
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2803/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1112: [CARBONDATA-1244] Rewrite README.md of presto integr...

[chenliang613]

Github user chenliang613 commented on the issue:

https://github.com/apache/carbondata/pull/1112
  
@HoneyQuery  please squash all commits into one commit.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/222/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1102: [CARBONDATA-1098] Change page statistics use exact t...

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1102
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/carbondata-pr-spark-1.6/737/Failed Tests: 
27carbondata-pr-spark-1.6/org.apache.carbondata:carbondata-core:
 2org.apache.carbondata.core.util.CarbonMetadataUtilTest.org.apache.carbondata.core.util.CarbonMetadataUtilTestorg.apache.carbondata.core.writer.CarbonFooterWriterTest.testWriteFactMetadata name='carbondata-pr-spark-1.6/org.apache.carbondata:carbondata-processing' 
 >/>href='https://builds.apache.org/job/carbondata-pr-spark-1.6/737/org.apache.carbondata$carbondata-processing/testReport'>carbondata-pr-spark-1.6/org.apache.carbondata:carbondata-processing:
 > 3href='https://builds.apache.org/job/carbondata-pr-spark-1.6/737/org.apache.carbondata$carbondata-processing/testReport/org.apache.carbondata.carbon.datastore/BlockIndexStoreTest/testloadAndGetTaskIdToSegmentsMapForDifferentSegmentLoadedConcurrently/'>org.apache.carbondata.carbon.datastore.BlockIndexStoreTest.testloadAndGetTaskIdToSegmentsMapForDifferentSegmentLoadedConcurrently 
 >href='https://builds.apache.org/job/carbondata-pr-spark-1.6/737/org.apache.carbondata$carbondata-processing/testReport/org.apache.carbondata.
 
carbon.datastore/BlockIndexStoreTest/testLoadAndGetTaskIdToSegmentsMapForSingleSegment/'>org.apache.carbondata.carbon.datastore.BlockIndexStoreTest.testLoadAndGetTaskIdToSegmentsMapForSingleSegmentorg.apache.carbondata.carbon.datastore.BlockIndexStoreTest.testloadAndGetTaskIdToSegmentsMapForSameBlockLoadedConcurrentlycarbondata-pr-spark-1.6/org.apache.carbondata:carbondata-spark-common-test:
 22org.apache.carbondata.integration.spark.testsuite.dataload.TestLoadDataWithMaxMinInteger.test
 carbon table data loading when the int column contains min integer 
valueorg.apache.carbondata.integration.spark.testsuite.dataload.TestLoadDataWithMaxMinInteger.test
 carbon table data loading when the int column contains max integer 
valueorg.apache.carbondata.integration.spark.testsuite.dataload.TestLoadDataWithMaxMinInteger.test
 carbon table data loading when the int column contains min and max integer 
valueorg.apache.carbondata.spark.testsuite.aggquery.IntegerDataTypeTestCase.short
 int table boundary test, safe column pageorg.apache.carbondata.spark.testsuite.aggquery.IntegerDataTypeTestCase.short
 int table boundary test, unsafe column pageorg.apache.carbondata.spark.testsuite.allqueries.AllDataTypesTestCaseAggregate.select
  imei from Carbon_automation_test where contractNumber is NOT 
nullorg.apache.carbondata.spark.testsuite.allqueries.AllDataTypesTestCaseAggregate.select
  count(bomCode) from Carbon_automation_test where contractNumber is NOT 
nullorg.apache.carbondata.spark.testsuite.allqueries.AllDataTypesTestCaseAggregate.select
  channelsName from Carbon_automation_test where contractNumber is NOT 
nullorg.apache.ca
 rbondata.spark.testsuite.dataload.TestDataLoadWithFileName.Check the file_name 
in carbonindex with v1 formatorg.apache.carbondata.spark.testsuite.dataload.TestDataLoadWithFileName.Check
 the file_name in carbonindex with v2 formatorg.apache.carbondata.spark.testsuite.filterexpr.FilterProcessorTestCase.test
 FilterUnsupportedException when using big numbersorg.apache.carbondata.spark.testsuite.iud.HorizontalCompactionTestCase.test
 IUD Horizontal Compaction Check Column Cardinalityorg.apache.carbondata.spark.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_hash_bigintorg.apache.car
 
bondata.spark.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_hash_floatorg.apache.carbondata.spark.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_hash_doubleorg.apache.carbondata.spark.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_hash_decimalorg.apache.carbondata.spark.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_hash_timestamporg.apache.carbondata.spark.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_hash_dateorg.apache.carbondata.spark.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_list_doubleorg.apache.carbondata.spark.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_range_intorg.apache.carbondata.spark.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_range_bigintorg.apache.carbondata.spark
 
.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_range_double



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1112: [CARBONDATA-1244] Rewrite README.md of presto...

[chenliang613]

Github user chenliang613 commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1112#discussion_r124811689
  
--- Diff: integration/presto/README.md ---
@@ -20,14 +20,10 @@
 Please follow the below steps to query carbondata in presto
 
 ### Config presto server
-* Download presto server 0.166 : 
https://repo1.maven.org/maven2/com/facebook/presto/presto-server/
-* Finish configuration as per 
https://prestodb.io/docs/current/installation/deployment.html
-  for example:
+* Download presto server ( >= 0.166) : 
https://repo1.maven.org/maven2/com/facebook/presto/presto-server/
--- End diff --

Different presto version, need to do different integration , current 
version(carbondata 1.2.0), only support 0.166


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1112: [CARBONDATA-1244] Rewrite README.md of presto...

[chenliang613]

Github user chenliang613 commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1112#discussion_r124811082
  
--- Diff: 
integration/presto/src/main/java/org/apache/carbondata/presto/impl/CarbonLocalInputSplit.java
 ---
@@ -17,19 +17,22 @@
 
 package org.apache.carbondata.presto.impl;
 
-import java.util.List;
-
 import com.fasterxml.jackson.annotation.JsonCreator;
 import com.fasterxml.jackson.annotation.JsonProperty;
 
+import java.util.List;
+
+/**
+ * BHQ: CarbonLocalInputSplit represents a block, it contains a set of 
blocklet.
--- End diff --

can you explain what is the mean about BHQ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1102: [CARBONDATA-1098] Change page statistics use exact t...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1102
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2801/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1102: [CARBONDATA-1098] Change page statistics use exact t...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1102
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/221/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1104
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/carbondata-pr-spark-1.6/736/Failed Tests: 
15carbondata-pr-spark-1.6/org.apache.carbondata:carbondata-spark:
 1org.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerSharedDictionaryTest.dataload
 with bad record testcarbondata-pr-spark-1.6/org.apache.carbondata:carbondata-spark-common-test:
 14org.apache.carbondata.spark.testsuite.dataretention.DataRetentionConcurrencyTestCase.DataRetention_Concurrency_load_dateorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordEmptyDataTest.select
 count(*) from empty_timestamporg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordEmptyDataTest.select
 count(*) from empty_timestamp_falseorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from salesorg.apache.carbo
 ndata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select count(*) from 
serializable_valuesorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from serializable_values_falseorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from empty_timestamporg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from insufficientColumnorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from insufficientColumn_falseorg.apache.carbondata.spark.testsuite.badrecordloger.BadReco
 rdLoggerTest.select count(*) from emptyColumnValuesorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from emptyColumnValues_falseorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from empty_timestamp_falseorg.apache.carbondata.spark.testsuite.dataload.TestGlobalSortDataLoad.Test
 GLOBAL_SORT with BAD_RECORDS_ACTION = 'REDIRECT'org.apache.carbondata.spark.testsuite.dataload.TestGlobalSortDataLoad.Number
 of partitions should be greater than 0



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/220/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2800/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1118: [CARBONDATA-1236] Support absolute path without sche...

[kunal642]

Github user kunal642 commented on the issue:

https://github.com/apache/carbondata/pull/1118
  
LGTM



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1118: [CARBONDATA-1236] Support absolute path witho...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/carbondata/pull/1118


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1118: [CARBONDATA-1236] Support absolute path without sche...

[gvramana]

Github user gvramana commented on the issue:

https://github.com/apache/carbondata/pull/1118
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2799/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2798/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/218/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1118: [CARBONDATA-1236] Support absolute path without sche...

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1118
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/carbondata-pr-spark-1.6/733/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1118: [CARBONDATA-1236] Support absolute path without sche...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1118
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2797/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1118: [CARBONDATA-1236] Support absolute path without sche...

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1118
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/carbondata-pr-spark-1.6/732/Failed Tests: 
1carbondata-pr-spark-1.6/org.apache.carbondata:carbondata-spark-common-test:
 1org.apache.carbondata.spark.testsuite.dataretention.DataRetentionConcurrencyTestCase.DataRetention_Concurrency_load_date



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1118: [CARBONDATA-1236] Support absolute path without sche...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1118
  
Build Success with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/217/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1118: [CARBONDATA-1236] Support absolute path without sche...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1118
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2796/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1118: [CARBONDATA-1236] Support absolute path without sche...

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1118
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1117: [CARBONDATA-757] Big decimal optimization

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1117
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/carbondata-pr-spark-1.6/731/Failed Tests: 
4carbondata-pr-spark-1.6/org.apache.carbondata:carbondata-spark-common-test:
 4org.apache.carbondata.spark.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_hash_smallIntorg.apache.carbondata.spark.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_hash_varcharorg.apache.carbondata.spark.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_list_dateorg.apache.carbondata.spark.testsuite.partition.TestAllDataTypeForPartitionTable.allTypeTable_range_string



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1117: [CARBONDATA-757] Big decimal optimization

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1117
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/216/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1117: [CARBONDATA-757] Big decimal optimization

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1117
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2795/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #644: [CARBONDATA-757]Big decimal optimization

[ravipesala]

Github user ravipesala closed the pull request at:

https://github.com/apache/carbondata/pull/644


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #644: [CARBONDATA-757]Big decimal optimization

[ravipesala]

Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/644
  
Closing it as another PR https://github.com/apache/carbondata/pull/1117 
raised


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1117: [CARBONDATA-757] Big decimal optimization

[ravipesala]

GitHub user ravipesala opened a pull request:

https://github.com/apache/carbondata/pull/1117

[CARBONDATA-757] Big decimal optimization

Currently Decimal is converted to bytes and using LV (length + value) 
format to write to store. And while getting back read the bytes in LV format 
and convert back the bigdecimal.
We can do following operations to improve storage and processing.

1. if decimal precision is less than 9 then we can fit in int (4 bytes)
2. if decimal precision is less than 18 then we can fit in long (8 bytes)
3. if decimal precision is more than 18 then we can fit in fixed length 
bytes(the length bytes can vary depends on precision but it is always fixed 
length)

So in this approach we no need store bigdecimal in LV format, we can store 
in fixed format.It reduces the memory.
Carbondata format changes -> Added fixedLength in datachunk to know about 
the column length of big decimal. This attribute can be used in case of 
char(fixedlength) or varchar(fixedlength) datatypes as well.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ravipesala/incubator-carbondata 
big-decimal-optim

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1117.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1117


commit 061fc25f682645033f1769499de2655e405807f4
Author: ravipesala 
Date:   2017-06-28T10:33:03Z

Optimizing decimal datatype

commit 6f050e74d857773e6e4468e459320670a64c4188
Author: ravipesala 
Date:   2017-06-29T11:26:14Z

Optimized big decimal to use less space




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1104
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/carbondata-pr-spark-1.6/730/Failed Tests: 
16carbondata-pr-spark-1.6/org.apache.carbondata:carbondata-spark:
 1org.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerSharedDictionaryTest.dataload
 with bad record testcarbondata-pr-spark-1.6/org.apache.carbondata:carbondata-spark-common-test:
 15org.apache.carbondata.spark.testsuite.badrecordloger.BadRecordEmptyDataTest.select
 count(*) from empty_timestamporg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordEmptyDataTest.select
 count(*) from empty_timestamp_falseorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from salesorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from serializable_valuesorg.apache.carbondata.sp
 ark.testsuite.badrecordloger.BadRecordLoggerTest.select count(*) from 
serializable_values_falseorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from empty_timestamporg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from insufficientColumnorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from insufficientColumn_falseorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from emptyColumnValuesorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest
 .select count(*) from emptyColumnValues_falseorg.apache.carbondata.spark.testsuite.badrecordloger.BadRecordLoggerTest.select
 count(*) from empty_timestamp_falseorg.apache.carbondata.spark.testsuite.dataload.TestGlobalSortDataLoad.Make
 sure the result is right and sorted in global levelorg.apache.carbondata.spark.testsuite.dataload.TestGlobalSortDataLoad.Number
 of partitions should be greater than 0org.apache.carbondata.spark.testsuite.dataload.TestGlobalSortDataLoad.DDL
 > carbon.propertiesorg.apache.carbondata.spark.testsuite.dataload.TestGlobalSortDataLoad.Test
 GLOBAL_SORT with BAD_RECORDS_ACTION = 'REDI
 RECT'



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2794/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1104: [CARBONDATA-1239] Add validation for set command par...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1104
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/215/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1116: [CARBONDATA-1249] Wrong order of columns i n redirec...

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1116
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/carbondata-pr-spark-1.6/729/Failed Tests: 
2carbondata-pr-spark-1.6/org.apache.carbondata:carbondata-spark-common-test:
 2org.apache.carbondata.spark.testsuite.dataload.TestDataLoadWithColumnsMoreThanSchema.test
 for duplicate column name in the Fileheader options in load 
commandorg.apache.carbondata.spark.testsuite.dataload.TestGlobalSortDataLoad.Test
 GLOBAL_SORT with BAD_RECORDS_ACTION = 'REDIRECT'



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1109: [CARBONDATA-1241] Single_Pass either should b...

[gvramana]

Github user gvramana commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1109#discussion_r124769542
  
--- Diff: 
integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchema.scala
 ---
@@ -398,10 +398,11 @@ case class LoadTable(
   val partitionLocation = relation.tableMeta.storePath + "/partition/" 
+
   
relation.tableMeta.carbonTableIdentifier.getDatabaseName + "/" +
   
relation.tableMeta.carbonTableIdentifier.getTableName + "/"
-
-
   val columnar = sparkSession.conf.get("carbon.is.columnar.storage", 
"true").toBoolean
-
+  if (options.get("sort_scope").equals(Some("GLOBAL_SORT")) &&
--- End diff --

This verification is also required when these options come from SET.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1116: [CARBONDATA-1249] Wrong order of columns i n redirec...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1116
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2793/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1115: [CARBONDATA-1247]Block pruning not working for date ...

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1115
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/carbondata-pr-spark-1.6/728/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1116: [CARBONDATA-1249] Wrong order of columns i n redirec...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1116
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/214/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1115: [CARBONDATA-1247]Block pruning not working for date ...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1115
  
Build Success with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/213/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1116: [CARBONDATA-1249] Wrong order of columns i n redirec...

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1116
  
Can one of the admins verify this patch?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1109: [CARBONDATA-1241] Single_Pass either should be block...

[gvramana]

Github user gvramana commented on the issue:

https://github.com/apache/carbondata/pull/1109
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1116: [CARBONDATA-1249] Wrong order of columns i n ...

[mohammadshahidkhan]

GitHub user mohammadshahidkhan opened a pull request:

https://github.com/apache/carbondata/pull/1116

[CARBONDATA-1249] Wrong order of columns i n redirected csv for bad records



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mohammadshahidkhan/incubator-carbondata 
ordermissmatch

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1116.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1116


commit e9d00effe654b4cd98fffc1c33e8333699d33dc5
Author: mohammadshahidkhan 
Date:   2017-06-28T13:52:45Z

[CARBONDATA-1249] Wrong order of columns i n redirected csv for bad records




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1115: [CARBONDATA-1247]Block pruning not working for date ...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1115
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/2792/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1061: [CARBONDATA-1193] ViewFS Support - improvemen...

[gvramana]

Github user gvramana commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1061#discussion_r124258817
  
--- Diff: 
core/src/test/java/org/apache/carbondata/core/datastore/filesystem/ViewFsCarbonFileTest.java
 ---
@@ -229,7 +228,7 @@ public void testGetParentFIle() {
 new MockUp() {
--- End diff --

Avoid duplication of code across Viewfs and Hdfs.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1115: [CARBONDATA-1247]Block pruning not working fo...

[BJangir]

GitHub user BJangir opened a pull request:

https://github.com/apache/carbondata/pull/1115

[CARBONDATA-1247]Block pruning not working for date type data type column

Block pruning not working for filter on date type column .
Root Cause : In PushedFilters it goes in CastExpr as below 

PushedFilters: [IsNotNull(dob), CastExpr((cast(dob#230 as string) = 
2016-06-25))]

Fix:- CastExpressionOptimization need to have for Date type also like 
Timestamp data type to remove the CastExpr  and convert date value to long.



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/BJangir/incubator-carbondata datepruning

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1115.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1115


commit d403e23085b2f73faf037d90e0737bf470c3c72e
Author: BJangir 
Date:   2017-06-29T09:48:20Z

Block pruning not working for date type data type column




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (CARBONDATA-1249) Wrong order of columns i n redirected csv for bad records

[Mohammad Shahid Khan (JIRA)]

Mohammad Shahid Khan created CARBONDATA-1249:


 Summary: Wrong order of columns i n redirected csv for bad records
 Key: CARBONDATA-1249
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1249
 Project: CarbonData
  Issue Type: Bug
Reporter: Mohammad Shahid Khan
Assignee: Mohammad Shahid Khan
Priority: Critical






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] carbondata issue #1103: [WIP] Implement range interval partition

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1103
  
Build Failed with Spark 1.6, Please check CI 
http://144.76.159.231:8080/job/ApacheCarbonPRBuilder/212/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata issue #1103: [WIP] Implement range interval partition

[asfgit]

Github user asfgit commented on the issue:

https://github.com/apache/carbondata/pull/1103
  

Refer to this link for build results (access rights to CI server needed): 
https://builds.apache.org/job/carbondata-pr-spark-1.6/727/



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] carbondata pull request #1104: [CARBONDATA-1239] Add validation for set comm...

[gvramana]

Github user gvramana commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1104#discussion_r124764409
  
--- Diff: 
core/src/main/java/org/apache/carbondata/core/util/SessionParams.java ---
@@ -96,34 +96,37 @@ private boolean validateKeyValue(String key, String 
value) throws InvalidConfigu
   isValid = true;
 } catch (IllegalArgumentException iae) {
   throw new InvalidConfigurationException(
-  "The key " + key + " can have only either FORCE or IGNORE or 
REDIRECT.");
+  "The key " + key + " can have only either FORCE or IGNORE or 
REDIRECT or FAIL.");
 }
 break;
   case CARBON_OPTIONS_SORT_SCOPE:
 isValid = CarbonUtil.isValidSortOption(value);
 if (!isValid) {
   throw new InvalidConfigurationException("The sort scope " + key
-  + " can have only either BATCH_SORT or LOCAL_SORT or 
NO_SORT.");
+  + " can have only either BATCH_SORT or LOCAL_SORT or NO_SORT 
or GLOBAL_SORT.");
 }
 break;
   case CARBON_OPTIONS_BATCH_SORT_SIZE_INMB:
-  case CARBON_OPTIONS_GLOBAL_SORT_PARTITIONS:
 isValid = CarbonUtil.validateValidIntType(value);
 if (!isValid) {
   throw new InvalidConfigurationException(
   "The configured value for key " + key + " must be valid 
integer.");
 }
 break;
+  case CARBON_OPTIONS_GLOBAL_SORT_PARTITIONS:
--- End diff --

Handle calling same method from load validation


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---