carbondata git commit: [HOTFIX] Upgrade pom version from 1.3.0 to 1.4.0 in processing/pom.xml

2018-02-28 Thread chenliang613
Repository: carbondata Updated Branches: refs/heads/master 3bcba4c4e -> 0c8024907 [HOTFIX] Upgrade pom version from 1.3.0 to 1.4.0 in processing/pom.xml update version number in processing/pom.xml This closes #1966 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2215][Documentation] Describe CarbonStreamParser in streaming-guide.md

2018-02-28 Thread qiangcai
Repository: carbondata Updated Branches: refs/heads/master 8da252c52 -> 3bcba4c4e [CARBONDATA-2215][Documentation] Describe CarbonStreamParser in streaming-guide.md This closes #2016 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: fix example

2018-02-28 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/carbonstore-rebase5 3759a2443 -> 8b94788a5 fix example Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/8b94788a Tree:

[49/49] carbondata git commit: [REBASE] Solve conflict after merging master

2018-02-28 Thread jackylk
[REBASE] Solve conflict after merging master Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/3759a244 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/3759a244 Diff:

[22/49] carbondata git commit: [CARBONDATA-2025] Unify all path construction through CarbonTablePath static method

2018-02-28 Thread jackylk
[CARBONDATA-2025] Unify all path construction through CarbonTablePath static method Refactory CarbonTablePath: 1.Remove CarbonStorePath and use CarbonTablePath only. 2.Make CarbonTablePath an utility without object creation, it can avoid creating object before using it, thus code is cleaner

[48/49] carbondata git commit: [CARBONDATA-2186] Add InterfaceAudience.Internal to annotate internal interface

2018-02-28 Thread jackylk
[CARBONDATA-2186] Add InterfaceAudience.Internal to annotate internal interface This closes #1986 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/a44a1f48 Tree:

[31/49] carbondata git commit: [CARBONDATA-1544][Datamap] Datamap FineGrain implementation

2018-02-28 Thread jackylk
[CARBONDATA-1544][Datamap] Datamap FineGrain implementation Implemented interfaces for FG datamap and integrated to filterscanner to use the pruned bitset from FG datamap. FG Query flow as follows. 1.The user can add FG datamap to any table and implement there interfaces. 2. Any filter query

[42/49] carbondata git commit: [CARBONDATA-2159] Remove carbon-spark dependency in store-sdk module

2018-02-28 Thread jackylk
[CARBONDATA-2159] Remove carbon-spark dependency in store-sdk module To make assembling JAR of store-sdk module, it should not depend on carbon-spark module This closes #1970 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[43/49] carbondata git commit: [CARBONDATA-2091][DataLoad] Support specifying sort column bounds in data loading

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2414fb0c/processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/UnsafeParallelReadMergeSorterWithBucketingImpl.java -- diff --git

[21/49] carbondata git commit: [CARBONDATA-2025] Unify all path construction through CarbonTablePath static method

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/eec8f18a/core/src/test/java/org/apache/carbondata/core/util/path/CarbonFormatDirectoryStructureTest.java -- diff --git

[30/49] carbondata git commit: [CARBONDATA-1544][Datamap] Datamap FineGrain implementation

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/37f58883/datamap/examples/src/minmaxdatamap/main/java/org/apache/carbondata/datamap/examples/MinMaxDataWriter.java -- diff --git

[35/49] carbondata git commit: [REBASE] resolve conflict after rebasing to master

2018-02-28 Thread jackylk
[REBASE] resolve conflict after rebasing to master Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/a889152c Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/a889152c Diff:

[26/49] carbondata git commit: [CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/743ccedb/processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/holder/UnsafeSortTempFileChunkHolder.java -- diff --git

[08/49] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/7e37843b/core/src/main/java/org/apache/carbondata/core/util/AbstractDataFileFooterConverter.java -- diff --git

[14/49] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/7e37843b/core/src/main/java/org/apache/carbondata/core/scan/executor/impl/AbstractQueryExecutor.java -- diff --git

[34/49] carbondata git commit: Revert "[CARBONDATA-2023][DataLoad] Add size base block allocation in data loading"

2018-02-28 Thread jackylk
Revert "[CARBONDATA-2023][DataLoad] Add size base block allocation in data loading" This reverts commit 6dd8b038fc898dbf48ad30adfc870c19eb38e3d0. Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/22287854 Tree:

[29/49] carbondata git commit: [HotFix][CheckStyle] Fix import related checkstyle

2018-02-28 Thread jackylk
[HotFix][CheckStyle] Fix import related checkstyle This closes #1952 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/965d7e40 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/965d7e40 Diff:

[41/49] carbondata git commit: [CARBONDATA-2159] Remove carbon-spark dependency in store-sdk module

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/66df989a/integration/spark-common/src/main/scala/org/apache/carbondata/spark/util/DataLoadingUtil.scala -- diff --git

[20/49] carbondata git commit: [CARBONDATA-2025] Unify all path construction through CarbonTablePath static method

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/eec8f18a/integration/spark2/src/main/scala/org/apache/carbondata/spark/rdd/AggregateDataMapCompactor.scala -- diff --git

[28/49] carbondata git commit: [CARBONDATA-1480]Min Max Index Example for DataMap

2018-02-28 Thread jackylk
[CARBONDATA-1480]Min Max Index Example for DataMap Datamap Example. Implementation of Min Max Index through Datamap. And Using the Index while prunning. This closes #1359 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[37/49] carbondata git commit: Revert "[CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row"

2018-02-28 Thread jackylk
Revert "[CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row" This reverts commit de92ea9a123b17d903f2d1d4662299315c792954. Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/78e9c53c Tree:

[18/49] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-28 Thread jackylk
[CARBONDATA-2099] Refactor query scan process to improve readability Unified concepts in scan process flow: 1.QueryModel contains all parameter for scan, it is created by API in CarbonTable. (In future, CarbonTable will be the entry point for various table operations) 2.Use term ColumnChunk to

[17/49] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/7e37843b/core/src/main/java/org/apache/carbondata/core/datastore/chunk/impl/FixedLengthDimensionDataChunk.java -- diff --git

[10/49] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/7e37843b/core/src/main/java/org/apache/carbondata/core/scan/processor/DataBlockIterator.java -- diff --git

[07/49] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/7e37843b/core/src/test/java/org/apache/carbondata/core/util/CarbonUtilTest.java -- diff --git a/core/src/test/java/org/apache/carbondata/core/util/CarbonUtilTest.java

[39/49] carbondata git commit: [CARBONDATA-1997] Add CarbonWriter SDK API

2018-02-28 Thread jackylk
[CARBONDATA-1997] Add CarbonWriter SDK API Added a new module called store-sdk, and added a CarbonWriter API, it can be used to write Carbondata files to a specified folder, without Spark and Hadoop dependency. User can use this API in any environment. This closes #1967 Project:

carbondata git commit: [CARBONDATA-2216][Test] Fix bugs in sdv tests

2018-02-28 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/datamap 47ae31bce -> 69eb26e68 [CARBONDATA-2216][Test] Fix bugs in sdv tests This closes #2012 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/69eb26e6 Tree:

[carbondata] Git Push Summary

2018-02-28 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/carbonstore-rebase4 [deleted] 4067d215f

[carbondata] Git Push Summary

2018-02-28 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/carbonstore-rebase [deleted] 3d055c187

[11/49] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/7e37843b/core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelRangeLessThanFiterExecuterImpl.java -- diff --git

[02/49] carbondata git commit: [CARBONDATA-1992] Remove partitionId in CarbonTablePath

2018-02-28 Thread jackylk
[CARBONDATA-1992] Remove partitionId in CarbonTablePath In CarbonTablePath, there is a deprecated partition id which is always 0, it should be removed to avoid confusion. This closes #1765 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[12/49] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/7e37843b/core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelFilterExecuterImpl.java -- diff --git

[15/49] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/7e37843b/core/src/main/java/org/apache/carbondata/core/metadata/blocklet/SegmentInfo.java -- diff --git

[25/49] carbondata git commit: [CARBONDATA-2023][DataLoad] Add size base block allocation in data loading

2018-02-28 Thread jackylk
[CARBONDATA-2023][DataLoad] Add size base block allocation in data loading Carbondata assign blocks to nodes at the beginning of data loading. Previous block allocation strategy is block number based and it will suffer skewed data problem if the size of input files differs a lot. We introduced a

[06/49] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/7e37843b/processing/src/main/java/org/apache/carbondata/processing/merger/CarbonCompactionExecutor.java -- diff --git

[03/49] carbondata git commit: [REBASE] Solve conflict after rebasing master

2018-02-28 Thread jackylk
[REBASE] Solve conflict after rebasing master Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/68a27db1 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/68a27db1 Diff:

[47/49] carbondata git commit: Support generating assembling JAR for store-sdk module

2018-02-28 Thread jackylk
Support generating assembling JAR for store-sdk module Support generating assembling JAR for store-sdk module and remove junit dependency This closes #1976 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/619f765f

[36/49] carbondata git commit: Revert "[CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row"

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/78e9c53c/processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/holder/UnsafeSortTempFileChunkHolder.java -- diff --git

[01/49] carbondata git commit: [CARBONDATA-1992] Remove partitionId in CarbonTablePath

2018-02-28 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/carbonstore-rebase5 [created] 3759a2443 http://git-wip-us.apache.org/repos/asf/carbondata/blob/ffb6b386/processing/src/main/java/org/apache/carbondata/processing/loading/steps/DataWriterProcessorStepImpl.java

[33/49] carbondata git commit: [CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row

2018-02-28 Thread jackylk
[CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row Pick up the no-sort fields in the row and pack them as bytes array and skip parsing them during merge sort to reduce CPU consumption This closes #1792 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo

[23/49] carbondata git commit: [CARBONDATA-2080] [S3-Implementation] Propagated hadoopConf from driver to executor for s3 implementation in cluster mode.

2018-02-28 Thread jackylk
[CARBONDATA-2080] [S3-Implementation] Propagated hadoopConf from driver to executor for s3 implementation in cluster mode. Problem : hadoopconf was not getting propagated from driver to the executor that's why load was failing to the distributed environment. Solution: Setting the Hadoop conf in

[46/49] carbondata git commit: [CARBONDATA-1114][Tests] Fix bugs in tests in windows env

2018-02-28 Thread jackylk
[CARBONDATA-1114][Tests] Fix bugs in tests in windows env Fix bugs in tests that will cause failure under windows env This closes #1994 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/58c17539 Tree:

[32/49] carbondata git commit: [CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/7a9861dd/processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/holder/UnsafeSortTempFileChunkHolder.java -- diff --git

[13/49] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/7e37843b/core/src/main/java/org/apache/carbondata/core/scan/filter/executer/ExcludeColGroupFilterExecuterImpl.java -- diff --git

[09/49] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-28 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/7e37843b/core/src/main/java/org/apache/carbondata/core/scan/result/iterator/PartitionSpliterRawResultIterator.java -- diff --git

[04/49] carbondata git commit: [CARBONDATA-1827] S3 Carbon Implementation

2018-02-28 Thread jackylk
[CARBONDATA-1827] S3 Carbon Implementation 1.Provide support for s3 in carbondata. 2.Added S3Example to create carbon table on s3. 3.Added S3CSVExample to load carbon table using csv from s3. This closes #1805 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[38/49] carbondata git commit: [CARBONDATA-2156] Add interface annotation

2018-02-28 Thread jackylk
[CARBONDATA-2156] Add interface annotation InterfaceAudience and InterfaceStability annotation should be added for user and developer 1.InetfaceAudience can be User and Developer 2.InterfaceStability can be Stable, Evolving, Unstable This closes #1968 Project:

[05/49] carbondata git commit: [CARBONDATA-1968] Add external table support

2018-02-28 Thread jackylk
[CARBONDATA-1968] Add external table support This PR adds support for creating external table with existing carbondata files, using Hive syntax. CREATE EXTERNAL TABLE tableName STORED BY 'carbondata' LOCATION 'path' This closes #1749 Project:

Jenkins build became unstable: carbondata-master-spark-2.1 ยป Apache CarbonData :: Spark2 #2092

2018-02-28 Thread Apache Jenkins Server
See

carbondata git commit: [CARBONDATA-2207] Fix testcases after using hive metastore

2018-02-28 Thread ravipesala
Repository: carbondata Updated Branches: refs/heads/branch-1.3 b51d8186a -> 7726b4f9b [CARBONDATA-2207] Fix testcases after using hive metastore CarbonTable was getting null in case of hivemetatore so, fetch the same from metastore instead of carbon. This closes #2005 Project:

carbondata git commit: [CARBONDATA-2207] Fix testcases after using hive metastore

2018-02-28 Thread ravipesala
Repository: carbondata Updated Branches: refs/heads/master 1afe47f88 -> 8da252c52 [CARBONDATA-2207] Fix testcases after using hive metastore CarbonTable was getting null in case of hivemetatore so, fetch the same from metastore instead of carbon. This closes #2005 Project:

carbondata git commit: [CARBONDATA-2214][Docs]Remove config 'spark.sql.hive.thriftServer.singleSession' from installation-guide.md

2018-02-28 Thread chenliang613
Repository: carbondata Updated Branches: refs/heads/master 5da6433db -> 1afe47f88 [CARBONDATA-2214][Docs]Remove config 'spark.sql.hive.thriftServer.singleSession' from installation-guide.md Remove config 'spark.sql.hive.thriftServer.singleSession' from installation-guide.md This closes