carbondata git commit: [CARBONDATA-2199] Fixed Dimension column after restructure getting wrong block datatype

2018-02-27 Thread ravipesala
Repository: carbondata Updated Branches: refs/heads/branch-1.3 1997ca235 -> b51d8186a [CARBONDATA-2199] Fixed Dimension column after restructure getting wrong block datatype Problem: Changing datatype of measure having sort_columns calls for restructure and after having restructure it

carbondata git commit: [CARBONDATA-2199] Fixed Dimension column after restructure getting wrong block datatype

2018-02-27 Thread ravipesala
Repository: carbondata Updated Branches: refs/heads/master 4ba51e229 -> 5da6433db [CARBONDATA-2199] Fixed Dimension column after restructure getting wrong block datatype Problem: Changing datatype of measure having sort_columns calls for restructure and after having restructure it changes

carbondata git commit: [CARBONDATA-2213][DataMap] Fixed wrong version for module datamap-example

2018-02-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/datamap b6880e148 -> 47ae31bce [CARBONDATA-2213][DataMap] Fixed wrong version for module datamap-example The version of Module ‘carbondata-datamap-example’ should be 1.4.0-snapshot instead of 1.3.0-snapshot, otherwise compilation will

Jenkins build is back to stable : carbondata-master-spark-2.1 #2087

2018-02-27 Thread Apache Jenkins Server
See

Jenkins build is back to stable : carbondata-master-spark-2.1 » Apache CarbonData :: Spark Common Test #2087

2018-02-27 Thread Apache Jenkins Server
See

carbondata git commit: [CARBONDATA-2208]Pre aggregate datamap creation is failing when count(*) present in query

2018-02-27 Thread chenliang613
Repository: carbondata Updated Branches: refs/heads/master 648c3d349 -> 4ba51e229 [CARBONDATA-2208]Pre aggregate datamap creation is failing when count(*) present in query create datamap agg on table maintable using 'preaggregate' as select name, count(*) from maintable group by name This

carbondata git commit: [CARBONDATA-2147][CARBONDATA-2148][Streaming] Add new row parser: RowStreamParserImpl

2018-02-27 Thread qiangcai
Repository: carbondata Updated Branches: refs/heads/master d0858b73e -> 648c3d349 [CARBONDATA-2147][CARBONDATA-2148][Streaming] Add new row parser: RowStreamParserImpl Currently the default value of 'carbon.stream.parser' is CSVStreamParserImp, it transforms InternalRow(0) to Array[Object],

carbondata git commit: [CARBONDATA-2206] Fixed lucene datamap evaluation issue in executor

2018-02-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/datamap 24ebfbbda -> b6880e148 [CARBONDATA-2206] Fixed lucene datamap evaluation issue in executor In case of MatchExpression it should return same bitset from RowLevelFilterExecuterImpl This closes #2010 Project:

Jenkins build became unstable: carbondata-master-spark-2.1 » Apache CarbonData :: Spark Common Test #2086

2018-02-27 Thread Apache Jenkins Server
See

Jenkins build became unstable: carbondata-master-spark-2.1 #2086

2018-02-27 Thread Apache Jenkins Server
See

[29/50] carbondata git commit: [CARBONDATA-1544][Datamap] Datamap FineGrain implementation

2018-02-27 Thread jackylk
[CARBONDATA-1544][Datamap] Datamap FineGrain implementation Implemented interfaces for FG datamap and integrated to filterscanner to use the pruned bitset from FG datamap. FG Query flow as follows. 1.The user can add FG datamap to any table and implement there interfaces. 2. Any filter query

[36/50] carbondata git commit: [CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/6e6b0611/processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/holder/UnsafeSortTempFileChunkHolder.java -- diff --git

[28/50] carbondata git commit: [CARBONDATA-1544][Datamap] Datamap FineGrain implementation

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/741db5fe/datamap/examples/src/minmaxdatamap/main/java/org/apache/carbondata/datamap/examples/MinMaxDataWriter.java -- diff --git

[18/50] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e3077c4/core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelFilterExecuterImpl.java -- diff --git

[11/50] carbondata git commit: [CARBONDATA-2025] Unify all path construction through CarbonTablePath static method

2018-02-27 Thread jackylk
[CARBONDATA-2025] Unify all path construction through CarbonTablePath static method Refactory CarbonTablePath: 1.Remove CarbonStorePath and use CarbonTablePath only. 2.Make CarbonTablePath an utility without object creation, it can avoid creating object before using it, thus code is cleaner

[31/50] carbondata git commit: [REBASE] resolve conflict after rebasing to master

2018-02-27 Thread jackylk
[REBASE] resolve conflict after rebasing to master Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/6f41f36b Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/6f41f36b Diff:

[32/50] carbondata git commit: [CARBONDATA-1997] Add CarbonWriter SDK API

2018-02-27 Thread jackylk
[CARBONDATA-1997] Add CarbonWriter SDK API Added a new module called store-sdk, and added a CarbonWriter API, it can be used to write Carbondata files to a specified folder, without Spark and Hadoop dependency. User can use this API in any environment. This closes #1967 Project:

[41/50] carbondata git commit: [CARBONDATA-2159] Remove carbon-spark dependency in store-sdk module

2018-02-27 Thread jackylk
[CARBONDATA-2159] Remove carbon-spark dependency in store-sdk module To make assembling JAR of store-sdk module, it should not depend on carbon-spark module This closes #1970 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[42/50] carbondata git commit: [CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/d3289b84/processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/holder/UnsafeSortTempFileChunkHolder.java -- diff --git

[47/50] carbondata git commit: [CARBONDATA-2091][DataLoad] Support specifying sort column bounds in data loading

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/e5e187fe/processing/src/main/java/org/apache/carbondata/processing/loading/sort/impl/UnsafeParallelReadMergeSorterWithBucketingImpl.java -- diff --git

[20/50] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e3077c4/core/src/main/java/org/apache/carbondata/core/scan/executor/impl/AbstractQueryExecutor.java -- diff --git

[44/50] carbondata git commit: Support generating assembling JAR for store-sdk module

2018-02-27 Thread jackylk
Support generating assembling JAR for store-sdk module Support generating assembling JAR for store-sdk module and remove junit dependency This closes #1976 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/00c3e9f6

carbondata git commit: [CARBONDATA-2184]Improve memory reuse for heap memory in `HeapMemoryAllocator`

2018-02-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 2f926c034 -> d0858b73e [CARBONDATA-2184]Improve memory reuse for heap memory in `HeapMemoryAllocator` The description in [SPARK-21860|https://issues.apache.org/jira/browse/SPARK-21860]: In `HeapMemoryAllocator`, when allocating

[24/50] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-27 Thread jackylk
[CARBONDATA-2099] Refactor query scan process to improve readability Unified concepts in scan process flow: 1.QueryModel contains all parameter for scan, it is created by API in CarbonTable. (In future, CarbonTable will be the entry point for various table operations) 2.Use term ColumnChunk to

[27/50] carbondata git commit: [REBASE] Solve conflict after rebasing master

2018-02-27 Thread jackylk
[REBASE] Solve conflict after rebasing master Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/3adb67d9 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/3adb67d9 Diff:

[23/50] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e3077c4/core/src/main/java/org/apache/carbondata/core/datastore/chunk/impl/FixedLengthDimensionDataChunk.java -- diff --git

[34/50] carbondata git commit: Revert "[CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row"

2018-02-27 Thread jackylk
Revert "[CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row" This reverts commit de92ea9a123b17d903f2d1d4662299315c792954. Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/0db9b81b Tree:

[15/50] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e3077c4/core/src/main/java/org/apache/carbondata/core/scan/result/iterator/PartitionSpliterRawResultIterator.java -- diff --git

[25/50] carbondata git commit: [REBASE] Solve conflict after rebasing master

2018-02-27 Thread jackylk
[REBASE] Solve conflict after rebasing master Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/e5acea97 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/e5acea97 Diff:

[45/50] carbondata git commit: [CARBONDATA-2023][DataLoad] Add size base block allocation in data loading

2018-02-27 Thread jackylk
[CARBONDATA-2023][DataLoad] Add size base block allocation in data loading Carbondata assign blocks to nodes at the beginning of data loading. Previous block allocation strategy is block number based and it will suffer skewed data problem if the size of input files differs a lot. We introduced a

[17/50] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e3077c4/core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelRangeLessThanFiterExecuterImpl.java -- diff --git

[26/50] carbondata git commit: [CARBONDATA-2023][DataLoad] Add size base block allocation in data loading

2018-02-27 Thread jackylk
[CARBONDATA-2023][DataLoad] Add size base block allocation in data loading Carbondata assign blocks to nodes at the beginning of data loading. Previous block allocation strategy is block number based and it will suffer skewed data problem if the size of input files differs a lot. We introduced a

[13/50] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e3077c4/core/src/test/java/org/apache/carbondata/core/util/CarbonUtilTest.java -- diff --git a/core/src/test/java/org/apache/carbondata/core/util/CarbonUtilTest.java

[19/50] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e3077c4/core/src/main/java/org/apache/carbondata/core/scan/filter/executer/ExcludeColGroupFilterExecuterImpl.java -- diff --git

[16/50] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e3077c4/core/src/main/java/org/apache/carbondata/core/scan/processor/DataBlockIterator.java -- diff --git

[22/50] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e3077c4/core/src/main/java/org/apache/carbondata/core/datastore/chunk/store/impl/unsafe/UnsafeFixedLengthDimensionDataChunkStore.java -- diff --git

[21/50] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e3077c4/core/src/main/java/org/apache/carbondata/core/metadata/blocklet/SegmentInfo.java -- diff --git

[carbondata] Git Push Summary

2018-02-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/carbonstore_backup [deleted] 71c2d8ca4

[08/50] carbondata git commit: [CARBONDATA-2025] Unify all path construction through CarbonTablePath static method

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e1f2b95/processing/src/main/java/org/apache/carbondata/processing/merger/CarbonCompactionUtil.java -- diff --git

[01/50] carbondata git commit: [HOTFIX] Check concurrent loading in compaction command [Forced Update!]

2018-02-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/carbonstore-rebase4 7466d6538 -> 4067d215f (forced update) [HOTFIX] Check concurrent loading in compaction command In compaction command, concurrent loading should be checked in processData method This closes #2002 Project:

[14/50] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e3077c4/core/src/main/java/org/apache/carbondata/core/util/AbstractDataFileFooterConverter.java -- diff --git

[carbondata] Git Push Summary

2018-02-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/fgdatamap [deleted] e972fd3d5

[06/50] carbondata git commit: [CARBONDATA-1827] S3 Carbon Implementation

2018-02-27 Thread jackylk
[CARBONDATA-1827] S3 Carbon Implementation 1.Provide support for s3 in carbondata. 2.Added S3Example to create carbon table on s3. 3.Added S3CSVExample to load carbon table using csv from s3. This closes #1805 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[43/50] carbondata git commit: [CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row

2018-02-27 Thread jackylk
[CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row Pick up the no-sort fields in the row and pack them as bytes array and skip parsing them during merge sort to reduce CPU consumption This closes #1792 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo

[02/50] carbondata git commit: [CARBONDATA-1968] Add external table support

2018-02-27 Thread jackylk
[CARBONDATA-1968] Add external table support This PR adds support for creating external table with existing carbondata files, using Hive syntax. CREATE EXTERNAL TABLE tableName STORED BY 'carbondata' LOCATION 'path' This closes #1749 Project:

[38/50] carbondata git commit: [HotFix][CheckStyle] Fix import related checkstyle

2018-02-27 Thread jackylk
[HotFix][CheckStyle] Fix import related checkstyle This closes #1952 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/aef478f9 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/aef478f9 Diff:

[35/50] carbondata git commit: [CARBONDATA-2156] Add interface annotation

2018-02-27 Thread jackylk
[CARBONDATA-2156] Add interface annotation InterfaceAudience and InterfaceStability annotation should be added for user and developer 1.InetfaceAudience can be User and Developer 2.InterfaceStability can be Stable, Evolving, Unstable This closes #1968 Project:

[49/50] carbondata git commit: [CARBONDATA-1114][Tests] Fix bugs in tests in windows env

2018-02-27 Thread jackylk
[CARBONDATA-1114][Tests] Fix bugs in tests in windows env Fix bugs in tests that will cause failure under windows env This closes #1994 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/c45a44d9 Tree:

[03/50] carbondata git commit: [CARBONDATA-1992] Remove partitionId in CarbonTablePath

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/574f014c/processing/src/main/java/org/apache/carbondata/processing/loading/steps/DataWriterProcessorStepImpl.java -- diff --git

[39/50] carbondata git commit: [CARBONDATA-2159] Remove carbon-spark dependency in store-sdk module

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/9ecdd7fa/processing/src/main/java/org/apache/carbondata/processing/loading/model/CarbonLoadModelBuilder.java -- diff --git

[04/50] carbondata git commit: [CARBONDATA-1992] Remove partitionId in CarbonTablePath

2018-02-27 Thread jackylk
[CARBONDATA-1992] Remove partitionId in CarbonTablePath In CarbonTablePath, there is a deprecated partition id which is always 0, it should be removed to avoid confusion. This closes #1765 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[05/50] carbondata git commit: [CARBONDATA-1480]Min Max Index Example for DataMap

2018-02-27 Thread jackylk
[CARBONDATA-1480]Min Max Index Example for DataMap Datamap Example. Implementation of Min Max Index through Datamap. And Using the Index while prunning. This closes #1359 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[37/50] carbondata git commit: [CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row

2018-02-27 Thread jackylk
[CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row Pick up the no-sort fields in the row and pack them as bytes array and skip parsing them during merge sort to reduce CPU consumption This closes #1792 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo

[40/50] carbondata git commit: [CARBONDATA-2159] Remove carbon-spark dependency in store-sdk module

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/9ecdd7fa/integration/spark-common/src/main/scala/org/apache/carbondata/spark/util/DataLoadingUtil.scala -- diff --git

[48/50] carbondata git commit: [CARBONDATA-2091][DataLoad] Support specifying sort column bounds in data loading

2018-02-27 Thread jackylk
[CARBONDATA-2091][DataLoad] Support specifying sort column bounds in data loading Enhance data loading performance by specifying sort column bounds 1. Add row range number during convert-process-step 2. Dispatch rows to each sorter by range number 3. Sort/Write process step can be done

[10/50] carbondata git commit: [CARBONDATA-2025] Unify all path construction through CarbonTablePath static method

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e1f2b95/core/src/test/java/org/apache/carbondata/core/util/path/CarbonFormatDirectoryStructureTest.java -- diff --git

[30/50] carbondata git commit: Revert "[CARBONDATA-2023][DataLoad] Add size base block allocation in data loading"

2018-02-27 Thread jackylk
Revert "[CARBONDATA-2023][DataLoad] Add size base block allocation in data loading" This reverts commit 6dd8b038fc898dbf48ad30adfc870c19eb38e3d0. Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/53c9ac7f Tree:

[12/50] carbondata git commit: [CARBONDATA-2099] Refactor query scan process to improve readability

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e3077c4/processing/src/main/java/org/apache/carbondata/processing/merger/CarbonCompactionExecutor.java -- diff --git

[46/50] carbondata git commit: [CARBONDATA-2186] Add InterfaceAudience.Internal to annotate internal interface

2018-02-27 Thread jackylk
[CARBONDATA-2186] Add InterfaceAudience.Internal to annotate internal interface This closes #1986 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/20e6bd89 Tree:

[09/50] carbondata git commit: [CARBONDATA-2025] Unify all path construction through CarbonTablePath static method

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2e1f2b95/integration/spark2/src/main/scala/org/apache/carbondata/spark/rdd/AggregateDataMapCompactor.scala -- diff --git

[33/50] carbondata git commit: Revert "[CARBONDATA-2018][DataLoad] Optimization in reading/writing for sort temp row"

2018-02-27 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/0db9b81b/processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/holder/UnsafeSortTempFileChunkHolder.java -- diff --git

[50/50] carbondata git commit: [REBASE] Solve conflict after merging master

2018-02-27 Thread jackylk
[REBASE] Solve conflict after merging master Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/4067d215 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/4067d215 Diff:

carbondata git commit: [HOTFIX] Fix timestamp format in testcase

2018-02-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/carbonstore 37080e9a3 -> c738afbc2 [HOTFIX] Fix timestamp format in testcase In UT testcases, there is random failure because of thread local variable in DataTypeUtil. This PR corrected it. This closes #2007 Project:

[2/2] carbondata git commit: [CARBONDATA-2206] support lucene index datamap

2018-02-27 Thread jackylk
[CARBONDATA-2206] support lucene index datamap This PR is an initial effort to integrate lucene as an index datamap into carbondata. A new module called carbondata-lucene is added to support lucene datamap: 1.Add LuceneFineGrainDataMap, implement FineGrainDataMap interface. 2.Add

[1/2] carbondata git commit: [CARBONDATA-2206] support lucene index datamap

2018-02-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/datamap 06c572dee -> 24ebfbbda http://git-wip-us.apache.org/repos/asf/carbondata/blob/24ebfbbd/processing/src/main/java/org/apache/carbondata/processing/store/writer/AbstractFactDataWriter.java

Jenkins build is back to stable : carbondata-master-spark-2.1 #2084

2018-02-27 Thread Apache Jenkins Server
See

Jenkins build is back to stable : carbondata-master-spark-2.1 » Apache CarbonData :: Spark Common Test #2084

2018-02-27 Thread Apache Jenkins Server
See

[05/16] carbondata git commit: [CARBONDATA-2200] Fix bug of LIKE operation on streaming table

2018-02-27 Thread gvramana
[CARBONDATA-2200] Fix bug of LIKE operation on streaming table Fix bug of LIKE operation on streaming table, LIKE operation will be converted to StartsWith / EndsWith / Contains expression. Carbon will use RowLevelFilterExecuterImpl to evaluate this expression. Streaming table also should

[09/16] carbondata git commit: [CARBONDATA-2168] Support global sort for standard hive partitioning

2018-02-27 Thread gvramana
[CARBONDATA-2168] Support global sort for standard hive partitioning This closes #1972 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/758d03e7 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/758d03e7

[06/16] carbondata git commit: [CARBONDATA-2201] NPE fixed while triggering the LoadTablePreExecutionEvent before Streaming

2018-02-27 Thread gvramana
[CARBONDATA-2201] NPE fixed while triggering the LoadTablePreExecutionEvent before Streaming While triggering the LoadTablePreExecutionEvent we require options provided by user and the finalOptions. In case of streaming both are same. If we pass null . It may cause NPE. This closes #1997

[15/16] carbondata git commit: [CARBONDATA-2187][PARTITION] Partition restructure for new folder structure and supporting partition location feature

2018-02-27 Thread gvramana
http://git-wip-us.apache.org/repos/asf/carbondata/blob/1997ca23/core/src/main/java/org/apache/carbondata/core/metadata/PartitionMapFileStore.java -- diff --git

[08/16] carbondata git commit: [CARBONDATA-2168] Support global sort for standard hive partitioning

2018-02-27 Thread gvramana
http://git-wip-us.apache.org/repos/asf/carbondata/blob/758d03e7/integration/spark-common/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDropPartitionRDD.scala -- diff --git

[13/16] carbondata git commit: [CARBONDATA-2187][PARTITION] Partition restructure for new folder structure and supporting partition location feature

2018-02-27 Thread gvramana
http://git-wip-us.apache.org/repos/asf/carbondata/blob/1997ca23/integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/standardpartition/StandardPartitionTableCleanTestCase.scala -- diff --git

[02/16] carbondata git commit: [CARBONDATA-2151][Streaming] Fix filter query issue on streaming table

2018-02-27 Thread gvramana
[CARBONDATA-2151][Streaming] Fix filter query issue on streaming table 1.Fix filter query issue for timestamp, date, decimal 2.Add more test case dataType: int, streaming, float, double, decimal, timestamp, date, complex operation: =, <>, >=, >, <, <=, in, like, between, is null, is not null

[14/16] carbondata git commit: [CARBONDATA-2187][PARTITION] Partition restructure for new folder structure and supporting partition location feature

2018-02-27 Thread gvramana
http://git-wip-us.apache.org/repos/asf/carbondata/blob/1997ca23/core/src/test/java/org/apache/carbondata/core/util/CarbonUtilTest.java -- diff --git a/core/src/test/java/org/apache/carbondata/core/util/CarbonUtilTest.java

[04/16] carbondata git commit: [CARBONDATA-2149]Fix complex type data displaying error when use DataFrame to write complex type data

2018-02-27 Thread gvramana
[CARBONDATA-2149]Fix complex type data displaying error when use DataFrame to write complex type data The default value of 'complex_delimiter_level_1' and 'complex_delimiter_level_2' is wrong, it must be '$' and ':', not be '$' and '\:'. Escape characters '\' need to be added only when using

[07/16] carbondata git commit: [MINOR]Remove dependency of Java 1.8

2018-02-27 Thread gvramana
[MINOR]Remove dependency of Java 1.8 This closes #1928 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/0f210c86 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/0f210c86 Diff:

[12/16] carbondata git commit: [CARBONDATA-2187][PARTITION] Partition restructure for new folder structure and supporting partition location feature

2018-02-27 Thread gvramana
http://git-wip-us.apache.org/repos/asf/carbondata/blob/1997ca23/integration/spark-common/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchemaCommon.scala -- diff --git

[10/16] carbondata git commit: [CARBONDATA-2187][PARTITION] Partition restructure for new folder structure and supporting partition location feature

2018-02-27 Thread gvramana
http://git-wip-us.apache.org/repos/asf/carbondata/blob/1997ca23/streaming/src/main/scala/org/apache/carbondata/streaming/StreamHandoffRDD.scala -- diff --git

[01/16] carbondata git commit: [CARBONDATA-2161] update mergeTo column for compacted segment of streaming table

2018-02-27 Thread gvramana
Repository: carbondata Updated Branches: refs/heads/branch-1.3 39ac94e46 -> 1997ca235 [CARBONDATA-2161] update mergeTo column for compacted segment of streaming table This closes #1971 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[03/16] carbondata git commit: [CARBONDATA-2185] Add InputMetrics for Streaming Reader

2018-02-27 Thread gvramana
[CARBONDATA-2185] Add InputMetrics for Streaming Reader This closes #1985 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/4bbbd4b1 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/4bbbd4b1 Diff:

[16/16] carbondata git commit: [CARBONDATA-2187][PARTITION] Partition restructure for new folder structure and supporting partition location feature

2018-02-27 Thread gvramana
[CARBONDATA-2187][PARTITION] Partition restructure for new folder structure and supporting partition location feature This closes #1984 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/1997ca23 Tree: