[07/10] carbondata git commit: [CARBONDATA-2189] Add DataMapProvider developer interface

2018-02-25 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2117c077/hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonTableInputFormat.java -- diff --git

[09/10] carbondata git commit: [CARBONDATA-2189] Add DataMapProvider developer interface

2018-02-25 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2117c077/core/src/main/java/org/apache/carbondata/core/indexstore/blockletindex/BlockletDataMap.java -- diff --git

[01/10] carbondata git commit: [CARBONDATA-2091][DataLoad] Support specifying sort column bounds in data loading [Forced Update!]

2018-02-25 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/datamap 5a625f4ce -> 2117c077b (forced update) http://git-wip-us.apache.org/repos/asf/carbondata/blob/ab9b4cf8/processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/UnsafeParallelReadMergeSorterWithBucketingImpl.java

[04/10] carbondata git commit: [CARBONDATA-1543] Supported DataMap chooser and expression for supporting multiple datamaps in single query

2018-02-25 Thread jackylk
[CARBONDATA-1543] Supported DataMap chooser and expression for supporting multiple datamaps in single query This PR supports 3 features. 1.Load datamaps from the DataMapSchema which are created through DDL. 2.DataMap Chooser: It chooses the datamap out of available datamaps based on simple

[08/10] carbondata git commit: [CARBONDATA-2189] Add DataMapProvider developer interface

2018-02-25 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2117c077/core/src/main/java/org/apache/carbondata/core/indexstore/blockletindex/BlockletIndexDataMap.java -- diff --git

[10/10] carbondata git commit: [CARBONDATA-2189] Add DataMapProvider developer interface

2018-02-25 Thread jackylk
[CARBONDATA-2189] Add DataMapProvider developer interface Add developer interface for 2 types of DataMap: 1.IndexDataMap: DataMap that leveraging index to accelerate filter query 2.MVDataMap: DataMap that leveraging Materialized View to accelerate olap style query, like SPJG query (select,

[06/10] carbondata git commit: [CARBONDATA-2189] Add DataMapProvider developer interface

2018-02-25 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2117c077/integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/datamap/TestDataMapCommand.scala -- diff --git

carbondata git commit: [CARBONDATA-2201] NPE fixed while triggering the LoadTablePreExecutionEvent before Streaming

2018-02-25 Thread qiangcai
Repository: carbondata Updated Branches: refs/heads/master 7269c0627 -> e51810c0f [CARBONDATA-2201] NPE fixed while triggering the LoadTablePreExecutionEvent before Streaming While triggering the LoadTablePreExecutionEvent we require options provided by user and the finalOptions. In case of

Jenkins build became unstable: carbondata-master-spark-2.1 » Apache CarbonData :: Spark Common Test #2081

2018-02-25 Thread Apache Jenkins Server
See

Jenkins build became unstable: carbondata-master-spark-2.1 #2081

2018-02-25 Thread Apache Jenkins Server
See

[05/10] carbondata git commit: [CARBONDATA-2189] Add DataMapProvider developer interface

2018-02-25 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2117c077/integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/preaaggregate/PreAggregateTableHelper.scala -- diff --git

[02/10] carbondata git commit: [CARBONDATA-2091][DataLoad] Support specifying sort column bounds in data loading

2018-02-25 Thread jackylk
[CARBONDATA-2091][DataLoad] Support specifying sort column bounds in data loading Enhance data loading performance by specifying sort column bounds 1. Add row range number during convert-process-step 2. Dispatch rows to each sorter by range number 3. Sort/Write process step can be done

[03/10] carbondata git commit: [CARBONDATA-1543] Supported DataMap chooser and expression for supporting multiple datamaps in single query

2018-02-25 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/5733413e/integration/spark-common-cluster-test/src/test/scala/org/apache/carbondata/cluster/sdv/generated/MergeIndexTestCase.scala -- diff --git

Jenkins build became unstable: carbondata-master-spark-2.2 » Apache CarbonData :: Spark Common Test #116

2018-02-25 Thread Apache Jenkins Server
See

Jenkins build became unstable: carbondata-master-spark-2.2 #116

2018-02-25 Thread Apache Jenkins Server
See

Jenkins build became unstable: carbondata-master-spark-2.1 #2079

2018-02-25 Thread Apache Jenkins Server
See

Jenkins build is back to stable : carbondata-master-spark-2.1 » Apache CarbonData :: Spark2 #2078

2018-02-25 Thread Apache Jenkins Server
See

[2/2] carbondata git commit: [CARBONDATA-2091][DataLoad] Support specifying sort column bounds in data loading

2018-02-25 Thread jackylk
[CARBONDATA-2091][DataLoad] Support specifying sort column bounds in data loading Enhance data loading performance by specifying sort column bounds 1. Add row range number during convert-process-step 2. Dispatch rows to each sorter by range number 3. Sort/Write process step can be done

[1/2] carbondata git commit: [CARBONDATA-2091][DataLoad] Support specifying sort column bounds in data loading

2018-02-25 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/carbonstore 88c0527f5 -> ab9b4cf89 http://git-wip-us.apache.org/repos/asf/carbondata/blob/ab9b4cf8/processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/UnsafeParallelReadMergeSorterWithBucketingImpl.java

carbondata git commit: [CARBONDATA-2149]Fix complex type data displaying error when use DataFrame to write complex type data

2018-02-25 Thread chenliang613
Repository: carbondata Updated Branches: refs/heads/master 4dbd0e5e7 -> 088465f0c [CARBONDATA-2149]Fix complex type data displaying error when use DataFrame to write complex type data The default value of 'complex_delimiter_level_1' and 'complex_delimiter_level_2' is wrong, it must be '$'

Jenkins build is back to stable : carbondata-master-spark-2.1 #2078

2018-02-25 Thread Apache Jenkins Server
See

Jenkins build became unstable: carbondata-master-spark-2.1 » Apache CarbonData :: Spark Common Test #2079

2018-02-25 Thread Apache Jenkins Server
See

Jenkins build is back to stable : carbondata-master-spark-2.1 » Apache CarbonData :: Spark Common Test #2080

2018-02-25 Thread Apache Jenkins Server
See

Jenkins build is back to stable : carbondata-master-spark-2.1 #2080

2018-02-25 Thread Apache Jenkins Server
See

Jenkins build is back to stable : carbondata-master-spark-2.2 » Apache CarbonData :: Spark Common Test #117

2018-02-25 Thread Apache Jenkins Server
See

Jenkins build is back to stable : carbondata-master-spark-2.2 #117

2018-02-25 Thread Apache Jenkins Server
See

carbondata git commit: [CARBONDATA-2200] Fix bug of LIKE operation on streaming table

2018-02-25 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 088465f0c -> 7269c0627 [CARBONDATA-2200] Fix bug of LIKE operation on streaming table Fix bug of LIKE operation on streaming table, LIKE operation will be converted to StartsWith / EndsWith / Contains expression. Carbon will use