[33/50] [abbrv] carbondata git commit: [CARBONDATA-2610] Fix for datamap creation failed on table having loaded data with null value on string datatype

2018-06-21 Thread jackylk
[CARBONDATA-2610] Fix for datamap creation failed on table having loaded data with null value on string datatype Problem: Datamap creation having null values already loaded in string datatype of table fails. Solution: Check for null before converting data to the string. This closes #2376

[43/50] [abbrv] carbondata git commit: [HOTFIX] Added Performance Optimization for Presto by using MultiBlockSplit

2018-06-21 Thread jackylk
[HOTFIX] Added Performance Optimization for Presto by using MultiBlockSplit Added Performance Optimization for Presto by using MultiBlockSplit This closes #2265 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[46/50] [abbrv] carbondata git commit: [CARBONDATA-2504][STREAM] Support StreamSQL for streaming job

2018-06-21 Thread jackylk
[CARBONDATA-2504][STREAM] Support StreamSQL for streaming job Currently, user need to write Spark Streaming APP to use carbon streaming ingest feature, which is not so easy for some users. By providing StreamSQL, user can manage the streaming job more easily. This closes #2328 Project:

[27/50] [abbrv] carbondata git commit: [CARBONDATA-2593] Add an option 'carbon.insert.storage.level' to support configuring the storage level when insert into data with 'carbon.insert.persist.enable'=

2018-06-21 Thread jackylk
[CARBONDATA-2593] Add an option 'carbon.insert.storage.level' to support configuring the storage level when insert into data with 'carbon.insert.persist.enable'='true' When insert into data with 'carbon.insert.persist.enable'='true', the storage level of dataset is 'MEMORY_AND_DISK', it should

[41/50] [abbrv] carbondata git commit: [CARBONDATA-2420][32K] Support string longer than 32000 characters

2018-06-21 Thread jackylk
[CARBONDATA-2420][32K] Support string longer than 32000 characters Add a property in creating table 'long_string_columns' to support string columns that will contains more than 32000 characters. Inside carbondata, it use an integer instead of short to store the length of bytes content.

[38/50] [abbrv] carbondata git commit: [CARBONDATA-2611] Added Test Cases for Local Dictionary Support for Create Table comand

2018-06-21 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/c5a4ec07/integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/localdictionary/LocalDictionarySupportCreateTableTest.scala -- diff --git

[06/50] [abbrv] carbondata git commit: [CARBONDATA-2566] Optimize CarbonReaderExample

2018-06-21 Thread jackylk
[CARBONDATA-2566] Optimize CarbonReaderExample Optimize CarbonReaderExample 1.Add different data type, including date and timestamp 2. update the doc 3.invoke the Schema schema = CarbonSchemaReader .readSchemaInSchemaFile(dataFiles[0].getAbsolutePath()) .asOriginOrder(); This closes #2356

[01/50] [abbrv] carbondata git commit: [CARBONDATA-2521] Support create carbonReader without tableName

2018-06-21 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/carbonstore 638ed1fa7 -> b3f782062 [CARBONDATA-2521] Support create carbonReader without tableName Add new method for creating carbonReader without tableName 1.add new interface: public static CarbonReaderBuilder builder(String tablePath)

[19/50] [abbrv] carbondata git commit: [HOTFIX][CARBONDATA-2591] Fix SDK CarbonReader filter issue

2018-06-21 Thread jackylk
[HOTFIX][CARBONDATA-2591] Fix SDK CarbonReader filter issue There are some issue in SDK CarbonReader filter function, please check the lira. This closes #2363 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[29/50] [abbrv] carbondata git commit: [CARBONDATA-2428] Support flat folder for managed carbon table

2018-06-21 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/60dfdd38/integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/datacompaction/CarbonIndexFileMergeTestCase.scala -- diff --git

[23/50] [abbrv] carbondata git commit: [HOTFIX] fix java style errors

2018-06-21 Thread jackylk
[HOTFIX] fix java style errors This closes #2371 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/ff036459 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/ff036459 Diff:

[12/50] [abbrv] carbondata git commit: [CARBONDATA-2575] Add document to explain DataMap Management

2018-06-21 Thread jackylk
[CARBONDATA-2575] Add document to explain DataMap Management Add document to explain DataMap Management This closes #2360 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/d401e060 Tree:

[08/50] [abbrv] carbondata git commit: [CARONDATA-2559]task id set for each carbonReader in threadlocal

2018-06-21 Thread jackylk
[CARONDATA-2559]task id set for each carbonReader in threadlocal 1. Task Id set for CarbonReader because for each CarbonReader object it should be separate Thread Local variable . 2. If sort-Column is not given to CarbonWriter Describe formatted showing default sort_cols is fixed 3. Issue :

[20/50] [abbrv] carbondata git commit: [CARBONDATA-2578] fixed memory leak inside CarbonReader and handled failure case for creation of multi reader for non-transactional table

2018-06-21 Thread jackylk
[CARBONDATA-2578] fixed memory leak inside CarbonReader and handled failure case for creation of multi reader for non-transactional table Issue : CarbonIterator inside CarbonRecordReader was keeping reference of RowBatch and it is not being closed inside CarbonRecordReader. sort_column with

[31/50] [abbrv] carbondata git commit: [CARBONDATA-2614] Fix the error when using FG in search mode and the prune result is none

2018-06-21 Thread jackylk
[CARBONDATA-2614] Fix the error when using FG in search mode and the prune result is none the prune result is none, and can not set datamapWritePath, which will not generate bitSegGroup in

[21/50] [abbrv] carbondata git commit: [CARBONDATA-2603] Fix: error handling during reader build failure

2018-06-21 Thread jackylk
[CARBONDATA-2603] Fix: error handling during reader build failure problem : When the CarbonReaderBuilder.build() is failed due to some problems like invalid projection that leads to query model creation failure. Blocklet datamap is not cleared for that table.So, the next reader instance uses old

[04/50] [abbrv] carbondata git commit: [CARBONDATA-2529] Fixed S3 Issue for Hadoop 2.8.3

2018-06-21 Thread jackylk
[CARBONDATA-2529] Fixed S3 Issue for Hadoop 2.8.3 This issue fixes the issue while loading the data with S3 as backend This closes #2340 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/4d22ddc9 Tree:

[14/50] [abbrv] carbondata git commit: [CARBONDATA-2569] Change the strategy of Search mode throw exception and run sparkSQL

2018-06-21 Thread jackylk
[CARBONDATA-2569] Change the strategy of Search mode throw exception and run sparkSQL Search mode throw exception but test case pass, please check the jira. This closes #2357 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[17/50] [abbrv] carbondata git commit: [CARBONDATA-2573] integrate carbonstore mv branch

2018-06-21 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/0ef7e55c/datamap/mv/core/src/test/scala/org/apache/carbondata/mv/rewrite/matching/TestTPCDS_1_4_Batch.scala -- diff --git

[03/50] [abbrv] carbondata git commit: [Documentation] Editorial Review comment fixed

2018-06-21 Thread jackylk
[Documentation] Editorial Review comment fixed Editorial Review comment fixed This closes #2320 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/5ad70095 Tree:

[26/50] [abbrv] carbondata git commit: [CARBONDATA-2592][Integration] Getting NoSuchMethod error due to aws sdk multple version jar conflicts

2018-06-21 Thread jackylk
[CARBONDATA-2592][Integration] Getting NoSuchMethod error due to aws sdk multple version jar conflicts ## What changes were proposed in this pull request? Currently in Carbon Spark2 project multiple dependency for the aws-sdk jar has been defined,this will create issue when we build

[15/50] [abbrv] carbondata git commit: [CARBONDATA-2573] integrate carbonstore mv branch

2018-06-21 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/0ef7e55c/datamap/mv/plan/src/test/scala/org/apache/carbondata/mv/testutil/TestSQLBatch2.scala -- diff --git

[05/50] [abbrv] carbondata git commit: [CARBONDATA-2355] Support run SQL on carbondata files directly

2018-06-21 Thread jackylk
[CARBONDATA-2355] Support run SQL on carbondata files directly Support run SQL on carbondata files directly This closes #2181 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/9469e6bd Tree:

[09/50] [abbrv] carbondata git commit: [CARBONDATA-2571] Calculating the carbonindex and carbondata file size of a table is wrong

2018-06-21 Thread jackylk
[CARBONDATA-2571] Calculating the carbonindex and carbondata file size of a table is wrong Problem: While calculating the carbonindex files size, we are checking either index file or merge file. But in PR#2333, implementation is changed to fill both the file name and the merge file name. So, we

[02/50] [abbrv] carbondata git commit: [CARBONDATA-2508] Fix the exception that can't get executorService when start search mode twice

2018-06-21 Thread jackylk
[CARBONDATA-2508] Fix the exception that can't get executorService when start search mode twice This closes #2355 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/6aadfe70 Tree:

[28/50] [abbrv] carbondata git commit: [CARBONDATA-2428] Support flat folder for managed carbon table

2018-06-21 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/60dfdd38/processing/src/main/java/org/apache/carbondata/processing/store/writer/AbstractFactDataWriter.java -- diff --git

[07/50] [abbrv] carbondata git commit: [Hoxfix] Upgrade dev version to 1.5.0-SNAPSHOT and fix some small issues

2018-06-21 Thread jackylk
[Hoxfix] Upgrade dev version to 1.5.0-SNAPSHOT and fix some small issues 1.Upgrade dev version to 1.5.0-SNAPSHOT 2.Fix carbon-spark-sql issue 3.Remove hadoop 2.2 profile This closes #2359 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[34/50] [abbrv] carbondata git commit: [CARBONDATA-2418] [Presto] [S3] Fixed Presto Can't Query CarbonData When CarbonStore is at S3

2018-06-21 Thread jackylk
[CARBONDATA-2418] [Presto] [S3] Fixed Presto Can't Query CarbonData When CarbonStore is at S3 This closes #2287 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/dc4f87ba Tree:

[16/50] [abbrv] carbondata git commit: [CARBONDATA-2573] integrate carbonstore mv branch

2018-06-21 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/0ef7e55c/datamap/mv/plan/src/main/scala/org/apache/carbondata/mv/dsl/package.scala -- diff --git a/datamap/mv/plan/src/main/scala/org/apache/carbondata/mv/dsl/package.scala

[10/50] [abbrv] carbondata git commit: [CARBONDATA-2554] Added support for logical type

2018-06-21 Thread jackylk
[CARBONDATA-2554] Added support for logical type Added support for date and timestamp logical types in AvroCarbonWriter. This closes #2347 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/2f234869 Tree:

[35/50] [abbrv] carbondata git commit: [CARBONDATA-1787] Updated data-management-on-carbondata.md for GLOBAL_SORT_PARTITIONS

2018-06-21 Thread jackylk
[CARBONDATA-1787] Updated data-management-on-carbondata.md for GLOBAL_SORT_PARTITIONS This closes #1668 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/ca466d9f Tree:

[11/50] [abbrv] carbondata git commit: [CARBONDATA-2557] [CARBONDATA-2472] [CARBONDATA-2570] Improve Carbon Reader performance on S3 and fixed datamap clear issue in reader

2018-06-21 Thread jackylk
[CARBONDATA-2557] [CARBONDATA-2472] [CARBONDATA-2570] Improve Carbon Reader performance on S3 and fixed datamap clear issue in reader [CARBONDATA-2557] [CARBONDATA-2472] Problem : CarbonReaderBuilder.build() is slower in s3. It takes around 8 seconds to finish build() Solution: S3 is slow in

[44/50] [abbrv] carbondata git commit: [CARBONDATA-2616][BloomDataMap] Fix bugs in querying bloom datamap with two index columns

2018-06-21 Thread jackylk
[CARBONDATA-2616][BloomDataMap] Fix bugs in querying bloom datamap with two index columns During pruning in bloomfilter datamap, the same blocklets has been added to result more than once, thus causing explaining and querying returning incorrect result. This closes #2386 Project:

[42/50] [abbrv] carbondata git commit: [CARBONDATA-2617] Invalid tuple-id and block id getting formed for Non partition table

2018-06-21 Thread jackylk
[CARBONDATA-2617] Invalid tuple-id and block id getting formed for Non partition table Problem Invalid tuple and block id getting formed for non partition table Analysis While creating a partition table a segment file was written in the Metadata folder under table structure. This was

[22/50] [abbrv] carbondata git commit: [CARBONDATA-2309][DataLoad] Add strategy to generate bigger carbondata files in case of small amout of data

2018-06-21 Thread jackylk
[CARBONDATA-2309][DataLoad] Add strategy to generate bigger carbondata files in case of small amout of data This closes #2314 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/685087ed Tree:

[39/50] [abbrv] carbondata git commit: [CARBONDATA-2611] Added Test Cases for Local Dictionary Support for Create Table comand

2018-06-21 Thread jackylk
[CARBONDATA-2611] Added Test Cases for Local Dictionary Support for Create Table comand What changes were proposed in this pull request? In this PR, UTs and SDV test cases are added for local dictionary support for create table command and describe formatted command. changed the error message

carbondata git commit: [CARBONDATA-2616][BloomDataMap] Fix bugs in querying bloom datamap with two index columns

2018-06-20 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 01b48fc36 -> 6eb360e1f [CARBONDATA-2616][BloomDataMap] Fix bugs in querying bloom datamap with two index columns During pruning in bloomfilter datamap, the same blocklets has been added to result more than once, thus causing

carbondata git commit: [CARBONDATA-1787] Updated data-management-on-carbondata.md for GLOBAL_SORT_PARTITIONS

2018-06-18 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master dc4f87ba5 -> ca466d9f4 [CARBONDATA-1787] Updated data-management-on-carbondata.md for GLOBAL_SORT_PARTITIONS This closes #1668 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2418] [Presto] [S3] Fixed Presto Can't Query CarbonData When CarbonStore is at S3

2018-06-18 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master e7fed361b -> dc4f87ba5 [CARBONDATA-2418] [Presto] [S3] Fixed Presto Can't Query CarbonData When CarbonStore is at S3 This closes #2287 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2553] support ZSTD compression for sort temp file

2018-06-18 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 5593d1646 -> ece067293 [CARBONDATA-2553] support ZSTD compression for sort temp file This closes #2350 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2614] Fix the error when using FG in search mode and the prune result is none

2018-06-18 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 60dfdd385 -> 5593d1646 [CARBONDATA-2614] Fix the error when using FG in search mode and the prune result is none the prune result is none, and can not set datamapWritePath, which will not generate bitSegGroup in

[3/3] carbondata git commit: [CARBONDATA-2428] Support flat folder for managed carbon table

2018-06-15 Thread jackylk
[CARBONDATA-2428] Support flat folder for managed carbon table Currently carbondata writing happens in fixed path tablepath/Fact/Part0/Segment_NUM folder and it is not same as hive/parquet folder structure. This PR makes all files written will be inside tablepath, it does not maintain any

[1/3] carbondata git commit: [CARBONDATA-2428] Support flat folder for managed carbon table

2018-06-15 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 181f0ac9b -> 60dfdd385 http://git-wip-us.apache.org/repos/asf/carbondata/blob/60dfdd38/processing/src/main/java/org/apache/carbondata/processing/store/writer/AbstractFactDataWriter.java

[2/3] carbondata git commit: [CARBONDATA-2428] Support flat folder for managed carbon table

2018-06-15 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/60dfdd38/integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/datacompaction/CarbonIndexFileMergeTestCase.scala -- diff --git

carbondata git commit: [CARBONDATA-2593] Add an option 'carbon.insert.storage.level' to support configuring the storage level when insert into data with 'carbon.insert.persist.enable'='true'

2018-06-15 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master f0c88348a -> 181f0ac9b [CARBONDATA-2593] Add an option 'carbon.insert.storage.level' to support configuring the storage level when insert into data with 'carbon.insert.persist.enable'='true' When insert into data with

carbondata git commit: [CARBONDATA-2599] Use RowStreamParserImp as default value of config 'carbon.stream.parser'

2018-06-14 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master efad40d57 -> f1163524f [CARBONDATA-2599] Use RowStreamParserImp as default value of config 'carbon.stream.parser' Parser 'RowStreamParserImpl' is used more often for real scene, so use 'RowStreamParserImpl' as default value of

carbondata git commit: [HOTFIX] fix java style errors

2018-06-13 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 685087ed4 -> ff0364599 [HOTFIX] fix java style errors This closes #2371 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/ff036459 Tree:

carbondata git commit: [CARBONDATA-2309][DataLoad] Add strategy to generate bigger carbondata files in case of small amout of data

2018-06-12 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 9b88a0652 -> 685087ed4 [CARBONDATA-2309][DataLoad] Add strategy to generate bigger carbondata files in case of small amout of data This closes #2314 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[2/4] carbondata git commit: [CARBONDATA-2573] integrate carbonstore mv branch

2018-06-11 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/0ef7e55c/datamap/mv/plan/src/main/scala/org/apache/carbondata/mv/dsl/package.scala -- diff --git a/datamap/mv/plan/src/main/scala/org/apache/carbondata/mv/dsl/package.scala

[3/4] carbondata git commit: [CARBONDATA-2573] integrate carbonstore mv branch

2018-06-11 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/0ef7e55c/datamap/mv/core/src/test/scala/org/apache/carbondata/mv/rewrite/matching/TestTPCDS_1_4_Batch.scala -- diff --git

[4/4] carbondata git commit: [CARBONDATA-2573] integrate carbonstore mv branch

2018-06-11 Thread jackylk
[CARBONDATA-2573] integrate carbonstore mv branch Fixes bugs related to MV and added tests This closes #2335 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/0ef7e55c Tree:

[1/4] carbondata git commit: [CARBONDATA-2573] integrate carbonstore mv branch

2018-06-11 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 83ee2c45f -> 0ef7e55c4 http://git-wip-us.apache.org/repos/asf/carbondata/blob/0ef7e55c/datamap/mv/plan/src/test/scala/org/apache/carbondata/mv/testutil/TestSQLBatch2.scala

carbondata git commit: [CARBONDATA-2575] Add document to explain DataMap Management

2018-06-05 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 5f68a792f -> d401e060a [CARBONDATA-2575] Add document to explain DataMap Management Add document to explain DataMap Management This closes #2360 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2508] Fix the exception that can't get executorService when start search mode twice

2018-05-31 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 5b2b91304 -> 6aadfe70a [CARBONDATA-2508] Fix the exception that can't get executorService when start search mode twice This closes #2355 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2521] Support create carbonReader without tableName

2018-05-31 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master b33845936 -> 5b2b91304 [CARBONDATA-2521] Support create carbonReader without tableName Add new method for creating carbonReader without tableName 1.add new interface: public static CarbonReaderBuilder builder(String tablePath)

carbondata git commit: [CARBONDATA-2389] Search mode support FG datamap

2018-05-30 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 74770aa38 -> b33845936 [CARBONDATA-2389] Search mode support FG datamap Search mode support FG datamap This closes #2290 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2546] Fixed the ArrayIndexOutOfBoundsException when give same column twice in projection of CarbonReader

2018-05-29 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master e74018243 -> a7faef8a0 [CARBONDATA-2546] Fixed the ArrayIndexOutOfBoundsException when give same column twice in projection of CarbonReader This closes #2348 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2558] Optimize carbon schema reader interface of SDK

2018-05-29 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 2993034e8 -> e74018243 [CARBONDATA-2558] Optimize carbon schema reader interface of SDK Optimize carbon schema reader interface of SDK 1.create CarbonSchemaReader and move schema read interface from CarbonReader to

carbondata git commit: [CARBONDATA-2500] Add new API to read user's schema in SDK

2018-05-29 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 22d5035c8 -> 8896a6334 [CARBONDATA-2500] Add new API to read user's schema in SDK The field order in schema that SDK returns is different between write and read data type of schema in SDK This closes #2341 Project:

carbondata git commit: [CARBONDATA-2520] Clean and close datamap writers on any task failure during load

2018-05-28 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 1b6ce8cdc -> 7f4bd3d06 [CARBONDATA-2520] Clean and close datamap writers on any task failure during load Problem: The datamap writers registered to listener are closed or finished only in case of load success case and not in any

carbondata git commit: [CARBONDATA-2507] enable.offheap.sort not validate in CarbonData

2018-05-28 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 33b825d7f -> d8bafa34d [CARBONDATA-2507] enable.offheap.sort not validate in CarbonData In #2274, the value of enable.offheap.sort will transform to false when args[0] not equal to true, including false and other string, like f,any

carbondata git commit: [CARBONDATA-2545] Fix some spell error in CarbonData

2018-05-28 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master a7ac65648 -> 33b825d7f [CARBONDATA-2545] Fix some spell error in CarbonData Change Inerface to Interface This closes #2346 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2495][Doc][BloomDataMap] Add document for bloomfilter datamap

2018-05-22 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 604902b9a -> d9534c2c0 [CARBONDATA-2495][Doc][BloomDataMap] Add document for bloomfilter datamap add document for bloomfilter datamap This closes #2323 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2487] Block filters for lucene with more than one text_match udf

2018-05-21 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 0e011977e -> 7cba44b90 [CARBONDATA-2487] Block filters for lucene with more than one text_match udf This closes #2311 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2354] fixed streaming example

2018-05-18 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 784b22de8 -> b8d5abf2e [CARBONDATA-2354] fixed streaming example This closes #2182 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/b8d5abf2 Tree:

carbondata git commit: [HOTFIX] [CARBONDATA-2480] Search mode RuntimeException: Error while resolving filter expression

2018-05-18 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 3087323a9 -> 784b22de8 [HOTFIX] [CARBONDATA-2480] Search mode RuntimeException: Error while resolving filter expression Invoke chooseFGDataMap in Worker in search mode This closes #2309 Project:

[10/12] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-13 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark-common-test/src/test/resources/tpch/lineitem.csv -- diff --git a/integration/spark-common-test/src/test/resources/tpch/lineitem.csv

[12/12] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-13 Thread jackylk
[CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting Integrate MV DataMap to Carbon This closes #2302 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/2881c6bb

[07/12] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-13 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark-common-test/src/test/resources/tpch/region.csv -- diff --git a/integration/spark-common-test/src/test/resources/tpch/region.csv

[02/12] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-13 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/bf73e9fe/datamap/mv/core/src/test/scala/org/apache/carbondata/mv/rewrite/MVTpchTestCase.scala -- diff --git

[05/12] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-13 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark2/src/main/spark2.2/org/apache/spark/sql/hive/CarbonAnalyzer.scala -- diff --git

[11/12] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-13 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark-common-test/src/test/resources/tpch/customers.csv -- diff --git a/integration/spark-common-test/src/test/resources/tpch/customers.csv

[06/12] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-13 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark-common-test/src/test/resources/tpch/supplier.csv -- diff --git a/integration/spark-common-test/src/test/resources/tpch/supplier.csv

[03/12] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-13 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/bf73e9fe/datamap/mv/core/src/main/scala/org/apache/carbondata/mv/rewrite/Utils.scala -- diff --git

[09/12] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-13 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark-common-test/src/test/resources/tpch/nation.csv -- diff --git a/integration/spark-common-test/src/test/resources/tpch/nation.csv

[08/12] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-13 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark-common-test/src/test/resources/tpch/orders.csv -- diff --git a/integration/spark-common-test/src/test/resources/tpch/orders.csv

[04/12] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-13 Thread jackylk
[CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting Support Modular Core for Materialized View DataMap This closes #2302 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[01/12] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-13 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master d14c403f6 -> 2881c6bbc http://git-wip-us.apache.org/repos/asf/carbondata/blob/bf73e9fe/datamap/mv/core/src/test/scala/org/apache/carbondata/mv/rewrite/matching/TestTPCDS_1_4_Batch.scala

carbondata git commit: [CARBONDATA-2459][DataMap] Add cache for bloom filter datamap

2018-05-12 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master ffddba704 -> d14c403f6 [CARBONDATA-2459][DataMap] Add cache for bloom filter datamap Loading bloom filter from bloomindex file is slow. Adding cache for this procedure will surely improve the query performance This closes #2300

carbondata git commit: [CARBONDATA-2455]Fix _System Folder creation and lucene AND, OR, NOT Filter fix

2018-05-10 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 6b70b7e47 -> 61afa42da [CARBONDATA-2455]Fix _System Folder creation and lucene AND,OR,NOT Filter fix This closes #2281 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2464]Fixed OOM issue in case of Complex type

2018-05-10 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master cc0cbbac7 -> ceb7c8dd1 [CARBONDATA-2464]Fixed OOM issue in case of Complex type Problem: Query with Complex type is failing with OOM Root Cause: Complex type child column(No-dictionary) values are written in LV format, while reading

carbondata git commit: [CARBONDATA-2408] Fix search mode master SaslException issue in the first time

2018-05-08 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 452c42b99 -> fb1289747 [CARBONDATA-2408] Fix search mode master SaslException issue in the first time This closes #2239 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2441][Datamap] Implement distribute interface for bloom datamap

2018-05-08 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 6b949716b -> 452c42b99 [CARBONDATA-2441][Datamap] Implement distribute interface for bloom datamap Implement distribute interface for bloom datamap This closes #2272 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo

carbondata git commit: [CARBONDATA-2454][DataMap] Add fpp property for bloom datamap

2018-05-08 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 2c0fa1079 -> 6b949716b [CARBONDATA-2454][DataMap] Add fpp property for bloom datamap add fpp(false positive probability) property to configure bloom filter that used by bloom datamap. This closes #2279 Project:

carbondata git commit: [CARBONDATA-2458] Remove unnecessary TableProvider interface

2018-05-08 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master d5da9a194 -> 2c0fa1079 [CARBONDATA-2458] Remove unnecessary TableProvider interface Remove unused / unnecessary TableProvider Interface This closes #2280 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [HOTFIX] Fix lucene match limit code

2018-05-06 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 9db662a2d -> 5cad92f4f [HOTFIX] Fix lucene match limit code Problem Currently, Lucene match limit is set as Static in MatchExpression it cannot work in concurrent scenarios. Solution: Change to object variable and get the match max

carbondata git commit: [CARBONDATA-2439][Pom] upgrade guava version for bloom datamap

2018-05-05 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 7a697fd3c -> f2fb06806 [CARBONDATA-2439][Pom] upgrade guava version for bloom datamap upgrade guava version from 11.0.2(provided by hadoop) to 14.0.1(provided by spark) The dependency scope in carbon-bloom is compile, because

carbondata git commit: [CARBONDATA-2432][Build] Add bloomfilter datamap to carbondata assembly jar

2018-05-05 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 8e659b8dd -> 7a697fd3c [CARBONDATA-2432][Build] Add bloomfilter datamap to carbondata assembly jar Currently after build, the generated carbondata assembly jar does not contain bloomfilter datamap. This PR fix this. This closes

carbondata git commit: [CARBONDATA-2438][Assembly] Remove hadoop/spark/zookeeper related classes from assembly

2018-05-05 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master d1139330f -> 8e659b8dd [CARBONDATA-2438][Assembly] Remove hadoop/spark/zookeeper related classes from assembly It remove hadoop/spark/zookeeper/snappy/guava related classes from assembly jar. It reduces the size of carbon-assembly

carbondata git commit: [CARBONDATA-2392] Add close method for CarbonReader

2018-05-03 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 380473b40 -> f7c0670cd [CARBONDATA-2392] Add close method for CarbonReader This closes #2221 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/f7c0670c

carbondata git commit: [CarbonData-2427] Fix SearchMode Serialization Issue during Load

2018-05-02 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 46cee146d -> 1c84d69f2 [CarbonData-2427] Fix SearchMode Serialization Issue during Load This closes #2260 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2379] Support SearchModeExample run in cluster

2018-05-02 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 4b8dc0a58 -> 46cee146d [CARBONDATA-2379] Support SearchModeExample run in cluster 1.support SeachModeExample running in the cluster 2.change the worker hostname to hostAddress 3. support run ConcurrentQueryBenchmark with search mode

carbondata git commit: [CARBONDATA-2347][LUCENE]change datamap factory interface to check supported features

2018-05-01 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 161347155 -> 5229443bd [CARBONDATA-2347][LUCENE]change datamap factory interface to check supported features Added new method to interface which will decide where the table operation present in list of table operations is allowed on

carbondata git commit: [CARBONDATA-2356] Ignore SDV Load TestCases for Lucene

2018-04-28 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 61788353d -> cf8fa9540 [CARBONDATA-2356] Ignore SDV Load TestCases for Lucene This closes #2241 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[1/2] carbondata git commit: [CARBONDATA-2407]Removed All Unused Executor BTree code

2018-04-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 2f85381f8 -> 61788353d http://git-wip-us.apache.org/repos/asf/carbondata/blob/61788353/hadoop/src/main/java/org/apache/carbondata/hadoop/util/BlockLevelTraverser.java

[2/2] carbondata git commit: [CARBONDATA-2407]Removed All Unused Executor BTree code

2018-04-27 Thread jackylk
[CARBONDATA-2407]Removed All Unused Executor BTree code This closes #2234 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/61788353 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/61788353 Diff:

carbondata git commit: [CARBONDATA-2384] SDK support write/read data into/from S3

2018-04-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master fae457a35 -> 242c08be4 [CARBONDATA-2384] SDK support write/read data into/from S3 User can set his credential in SDK and use SDK to write data into S3 and read data from S3. This closes #2226 Project:

carbondata git commit: [CARBONDATA-2356] Added UT Scenarios for LuceneDataMap

2018-04-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master afb802e60 -> fae457a35 [CARBONDATA-2356] Added UT Scenarios for LuceneDataMap This closes #2180 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [HOTFIX] Fix JVM crash in search mode

2018-04-26 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 184935827 -> 9b45c5b30 [HOTFIX] Fix JVM crash in search mode This closes #2233 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/9b45c5b3 Tree:

[carbondata] Git Push Summary

2018-04-26 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/spark-2.3 [created] 3262230cb

<    1   2   3   4   5   6   7   8   9   10   >