[carbondata] branch master updated: [CARBONDATA-3594] Optimize getSplits() during compaction

2019-11-24 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 5b101ec [CARBONDATA-3594] Optimize

[carbondata] branch master updated: [CARBONDATA-3570] Change task number to jobid+taskid for FileFormat

2019-11-15 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 533ec04 [CARBONDATA-3570] Change task

[carbondata] branch master updated: [CARBONDATA-3583] Upgrade default JDK version 1.7 to 1.8

2019-11-15 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 61fb393 [CARBONDATA-3583] Upgrade default

[carbondata] branch master updated: [CARBONDATA-3561] Fix incorrect results after execute delete/update operation if there are null values

2019-11-14 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new fa61d20 [CARBONDATA-3561] Fix incorrect

[carbondata] branch master updated: [CARBONDATA-3577] Use Spark 2.3 as default version and upgrade Spark 2.3.2 to 2.3.4

2019-11-14 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 7d82feb [CARBONDATA-3577] Use Spark 2.3

[carbondata] branch master updated (46f2d29 -> 6be86e3)

2019-11-13 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git. from 46f2d29 [Dependabot] Bump lucene.version from 6.3.0 to 8.3.0 in /datamap/lucene new ab0b7bb Revert

[carbondata] 02/02: Revert "[Dependabot] Bump solr.version from 6.3.0 to 8.2.0 in /datamap/lucene"

2019-11-13 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git commit 6be86e35ff2bcdd973b37ab60575143325426400 Author: Jacky Li AuthorDate: Thu Nov 14 15:57:37 2019 +0800 Revert

[carbondata] 01/02: Revert "[Dependabot] Bump lucene.version from 6.3.0 to 8.3.0 in /datamap/lucene"

2019-11-13 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git commit ab0b7bb5645231e72af8f399c153aa8326377c91 Author: Jacky Li AuthorDate: Thu Nov 14 15:57:34 2019 +0800 Revert

[carbondata] branch master updated: [Dependabot] Bump lucene.version from 6.3.0 to 8.3.0 in /datamap/lucene

2019-11-13 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 46f2d29 [Dependabot] Bump lucene.version

[carbondata] branch master updated: [Dependabot] Bump solr.version from 6.3.0 to 8.2.0 in /datamap/lucene

2019-11-13 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new de6d6c7 [Dependabot] Bump solr.version

[carbondata] branch master updated: [CARBONDATA-3569] Remove some conflicting jars from assembly jar

2019-11-13 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new c9061c7 [CARBONDATA-3569] Remove some

[carbondata] branch master updated: [CARBONDATA-3572] optimize java code checkstyle for LeftCurly rule

2019-11-13 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new e4bed33 [CARBONDATA-3572] optimize java

[carbondata] branch master updated: [HOTFIX] Improve select query after Update/Delete operation.

2019-11-11 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 4d4826e [HOTFIX] Improve select query

[carbondata] branch master updated: [CARBONDATA-3564] optimize java code checkstyle for EmptyStatement rule

2019-11-04 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new a1b13e1 [CARBONDATA-3564] optimize java

[carbondata] branch master updated: [CARBONDATA-3563] optimize java code checkstyle for RedundantImport rule

2019-11-04 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 327c120 [CARBONDATA-3563] optimize java

[carbondata] branch master updated: [CARBONDATA-3558] Clean up codes for property "autoRefreshDataMap"

2019-10-31 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new af843b2 [CARBONDATA-3558] Clean up codes

[carbondata] branch master updated: [HOTFIX][TESTCASE] Testcase fix for replacing lambda function for Java-1.7

2019-10-25 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new cda4f6a [HOTFIX][TESTCASE] Testcase fix

[carbondata] branch master updated: [CARBONDATA-3518] Support create table like command

2019-10-24 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 9e423e9 [CARBONDATA-3518] Support create

[carbondata] branch master updated: [CARBONDATA-3552]Fix dataload failure for column added in 1.1 which is a sort column in latest version

2019-10-24 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 75417fe [CARBONDATA-3552]Fix dataload

[carbondata] branch master updated: [CARBONDATA-3516] Fixed compilation issue for mixed formats in Spark-2.1

2019-10-24 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 26755cd [CARBONDATA-3516] Fixed

[carbondata] branch master updated: [CARBONDATA-3516] Supporting mixed formats in carbon

2019-10-23 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 93e52ff [CARBONDATA-3516] Supporting

[carbondata] branch master updated: [CARBONDATA-3521] optimize read property file code

2019-10-23 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 9a20ac7 [CARBONDATA-3521] optimize read

[carbondata] branch master updated: [CARBONDATA-3553] Support SDK Writer using existing schema file

2019-10-23 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 49d6258 [CARBONDATA-3553] Support SDK

[carbondata] branch master updated: [CARBONDATA-3541]Select queries with Aggregation Functions such as variance, stddev, etc fails with MV datamap

2019-10-22 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new c474730 [CARBONDATA-3541]Select queries

[carbondata] branch master updated: [CARBONDATA-3544] cli support summary statistics for all columns

2019-10-11 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 2418317 [CARBONDATA-3544] cli support

[carbondata] branch master updated: [CARBONDATA-3524] Support global_sort compaction

2019-10-11 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 45ccdf0 [CARBONDATA-3524] Support

[carbondata] branch master updated: [CARBONDATA-3501] Fix update table with varchar column

2019-10-03 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 5b76062 [CARBONDATA-3501] Fix update

[carbondata] branch master updated: [CARBONDATA-3517] Add Segment with Path

2019-10-02 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 1084136 [CARBONDATA-3517] Add Segment

[carbondata] branch master updated: [CARBONDATA-3527] Fix 'String length cannot exceed 32000 characters' issue when load data with 'GLOBAL_SORT' from csv files which include big complex type data

2019-09-28 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new f64f3d7 [CARBONDATA-3527] Fix 'String

[carbondata] branch master updated: [CARBONDATA-3523] Store data file size into index file

2019-09-25 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 64a574e [CARBONDATA-3523] Store data file

[carbondata] branch master updated: [HOTFIX]Update Documentation for MV datamap

2019-09-25 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 5c755aa [HOTFIX]Update Documentation

[carbondata] branch master updated: [CARBONDATA-3473] Fix data size calcution of the last column in CarbonCli

2019-09-22 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new f068926 [CARBONDATA-3473] Fix data size

[carbondata] branch master updated: [HOTFIX] Fix wrong min/max index of measure

2019-09-22 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 5bab524 [HOTFIX] Fix wrong min/max index

[carbondata] branch master updated: [DOC] Update doc for alter sort_columns

2019-09-22 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 6b682eb [DOC] Update doc for alter

[carbondata] branch master updated: [HOTFIX] Remove hive-service from carbondata assembly jar

2019-09-04 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 20e4149 [HOTFIX] Remove hive-service from

[carbondata] branch branch-2.0 created (now 252c789)

2019-08-26 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a change to branch branch-2.0 in repository https://gitbox.apache.org/repos/asf/carbondata.git. at 252c789 [CARBONDATA-3491] Return updated/deleted rows count when execute update/delete sql No new

[carbondata] branch master updated: [CARBONDATA-3491] Return updated/deleted rows count when execute update/delete sql

2019-08-23 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 252c789 [CARBONDATA-3491] Return updated

[carbondata] branch master updated: [CARBONDATA-3466] Fix NPE for carboncli command

2019-08-22 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new a264b6f [CARBONDATA-3466] Fix NPE

[carbondata] branch master updated: [CARBONDATA-3488] Check the file size after move local file to carbon path

2019-08-10 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new d5db3f4 [CARBONDATA-3488] Check the file

[carbondata] branch master updated: [CARBONDATA-3485] Data loading is failed from S3 to hdfs table having ~2K carbonfiles

2019-08-03 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new e14c817 [CARBONDATA-3485] Data loading

[carbondata] branch master updated: [CARBONDATA-3483] don't require update.lock and compaction.lock again when execute 'IUD_UPDDEL_DELTA' compaction

2019-08-03 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new 35f1501 [CARBONDATA-3483] don't require

[carbondata] branch master updated: [CARBONDATA-3477] deal line break chars correctly after 'select' in 'update ... select columns' sql

2019-08-02 Thread jackylk
This is an automated email from the ASF dual-hosted git repository. jackylk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/carbondata.git The following commit(s) were added to refs/heads/master by this push: new f005fd4 [CARBONDATA-3477] deal line break

[2/2] carbondata git commit: [CARBONDATA-3194] Integrating Carbon with Presto using hive connector

2018-12-28 Thread jackylk
[CARBONDATA-3194] Integrating Carbon with Presto using hive connector This PR extend the CarbondataConnectorFactory with HiveConnectorFactory, so that all features of HIve presto connector will be inherited to carbon as well. It simplifies the integration so removed lot of old code. This closes

[1/2] carbondata git commit: [CARBONDATA-3194] Integrating Carbon with Presto using hive connector

2018-12-28 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 7c4e79fca -> e193df0a1 http://git-wip-us.apache.org/repos/asf/carbondata/blob/e193df0a/integration/presto/src/main/java/org/apache/carbondata/presto/PrestoFilterUtil.java

carbondata git commit: [CARBONDATA-2218] AlluxioCarbonFile while trying to force rename causes a FileSytem error and is not a DistributionFileSystem.(Adding Alluxio Support)

2018-12-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master d5a2c698c -> e8cf14a18 [CARBONDATA-2218] AlluxioCarbonFile while trying to force rename causes a FileSytem error and is not a DistributionFileSystem.(Adding Alluxio Support) Implement renameForce for Alluxio integration This closes

carbondata git commit: [HOTFIX] rename field thread_pool_size to match camel case

2018-12-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 56aecb6b6 -> d5a2c698c [HOTFIX] rename field thread_pool_size to match camel case This closes #3018 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-3165]Protection of Bloom Null Exception

2018-12-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 7fec2c5b1 -> 56aecb6b6 [CARBONDATA-3165]Protection of Bloom Null Exception When filteredShard is empty, return arraylist<>(), and protect null exception of other scenarios This closes #2984 Project:

carbondata git commit: [CARBONDATA-3188] Create carbon table as hive understandable metastore table needed by Presto and Hive

2018-12-27 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master ca32374a4 -> 7fec2c5b1 [CARBONDATA-3188] Create carbon table as hive understandable metastore table needed by Presto and Hive Problem: Current carbon table created in spark creates the hive table internally but it does not have much

carbondata git commit: [CARBONDATA-3142]Add timestamp with thread name which created by CarbonThreadFactory [Forced Update!]

2018-12-26 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 7d944be68 -> 04b52568d (forced update) [CARBONDATA-3142]Add timestamp with thread name which created by CarbonThreadFactory Add timestamp with thread name which created by CarbonThreadFactory Because the names of threads created by

carbondata git commit: [CARBONDATA-3142]Add timestamp with thread name which created by CarbonThreadFactory

2018-12-26 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 128a6c867 -> 7d944be68 [CARBONDATA-3142]Add timestamp with thread name which created by CarbonThreadFactory Add timestamp with thread name which created by CarbonThreadFactory Because the names of threads created by

carbondata git commit: [CARBONDATA-3127]Fix the HiveExample & TestCarbonSerde exception

2018-12-21 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 96b2ea364 -> bd752e9d5 [CARBONDATA-3127]Fix the HiveExample & TestCarbonSerde exception This pull request fix HiveExample and move it to example module This closes #3012 Project:

carbondata git commit: [CARBONDATA-3149]Support alter table column rename

2018-12-20 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 53dbb459d -> 34923db0e [CARBONDATA-3149]Support alter table column rename This PR is to support column rename feature in carbondata. Carbon already supports datatype change, alter table add column and drop column. This PR uses same

[carbondata] Git Push Summary

2018-12-20 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/online_segment [created] 53dbb459d

carbondata git commit: [CARBONDATA-3102] Fix NoClassDefFoundError when use thriftServer and beeline to read/write data from/to S3

2018-12-15 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 3ff61cacc -> 0e467eb06 [CARBONDATA-3102] Fix NoClassDefFoundError when use thriftServer and beeline to read/write data from/to S3 This PR fix NoClassDefFoundError when use thriftServer and beeline to use table on cloud storage This

carbondata git commit: [CARBONDATA-3157] Added lazy load and direct vector fill support to Presto

2018-12-11 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 1f4614a2c -> 6026cb57c [CARBONDATA-3157] Added lazy load and direct vector fill support to Presto To improve the scan performance, integrate lazy loading and direct fil vector features to Carbon Presto Integration. This PR also

carbondata git commit: [CARBONDATA-3116] Support set carbon.query.directQueryOnDataMap.enabled=true

2018-12-11 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master f599cb114 -> 1f4614a2c [CARBONDATA-3116] Support set carbon.query.directQueryOnDataMap.enabled=true This PR fix the error:User can query on dataMap after set carbon.query.directQueryOnDataMap.enabled=true. This closes #2940

carbondata git commit: [HOTFIX]Fix Describe Formatted Testcases

2018-11-21 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 32eb0a1c3 -> 2f69e4fb7 [HOTFIX]Fix Describe Formatted Testcases This closes #2932 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/2f69e4fb Tree:

carbondata git commit: [HOTFIX] Reduce blocklet minimum configurable size

2018-11-21 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master bed51ba77 -> 647bfbaea [HOTFIX] Reduce blocklet minimum configurable size This closes #2926 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/647bfbae

carbondata git commit: [HOTFIX]s3 lock file fix

2018-11-17 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 39e8e3da5 -> d4e8ba441 [HOTFIX]s3 lock file fix This closes #2922 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/d4e8ba44 Tree:

carbondata git commit: [CARBONDATA-2930] Support customize column compressor

2018-11-09 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 5344b781e -> 6707db689 [CARBONDATA-2930] Support customize column compressor Support customize column compressor so that user can add their own implementation of compressor. For customize compressor, user can directly use its full

carbondata git commit: [CARBONDATA-2996] CarbonSchemaReader support read schema from folder path

2018-11-06 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 7c1d68ed6 -> 6093a32d7 [CARBONDATA-2996] CarbonSchemaReader support read schema from folder path 1.Deprecated readSchemaInIndexFile and readSchemaInDataFile, unify them to readSchema in SDK 2.delete readSchemaInIndexFile and

[1/2] carbondata git commit: [CARBONDATA-3038] Refactor dynamic configuration

2018-11-06 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 35fb9409d -> 7c1d68ed6 http://git-wip-us.apache.org/repos/asf/carbondata/blob/7c1d68ed/core/src/main/java/org/apache/carbondata/core/util/path/HDFSLeaseUtils.java --

[2/2] carbondata git commit: [CARBONDATA-3038] Refactor dynamic configuration

2018-11-06 Thread jackylk
[CARBONDATA-3038] Refactor dynamic configuration This closes #2875 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/7c1d68ed Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/7c1d68ed Diff:

carbondata git commit: [CARBONDATA-3067] Add check for debug to avoid string concat

2018-11-06 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master b6ff4672b -> 35fb9409d [CARBONDATA-3067] Add check for debug to avoid string concat For bloomfilter datamap, it will log debug for each blocklet. If the data is huge, there maybe thousands of blocklet, so in this commit, we will try

carbondata git commit: [CARBONDATA-300] Suppor read batch row in CSDK

2018-11-05 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master c9fb4bc06 -> a3a83dcad [CARBONDATA-300] Suppor read batch row in CSDK 1. support read batch row in SDK 2. support read batch row in CSDK 3. improve CSDK read performance This closes #2816

carbondata git commit: [CARBONDATA-3060]Improve the command for cli and fixed other issues

2018-11-04 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 63a28a951 -> 789055e19 [CARBONDATA-3060]Improve the command for cli and fixed other issues improve the syntax for CLI DDL: CarbonCli for table options('-cmd summary/benchmark -a -s -v -c -m') This closes #2882 Project:

carbondata git commit: [CARBONDATA-3071] Add CarbonSession Java Example

2018-11-04 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 0798c0036 -> 5a0bc6e71 [CARBONDATA-3071] Add CarbonSession Java Example This closes #2810 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/5a0bc6e7

carbondata git commit: [CARBONDATA-3032] Remove carbon.blocklet.size from properties template

2018-11-04 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 4ef41a239 -> 0798c0036 [CARBONDATA-3032] Remove carbon.blocklet.size from properties template 1.Remove carbon.blocklet.size from properties template, because carbon.blocklet.size is in V2, V3 use carbon.blockletgroup.size.in.mb or

carbondata git commit: [CARBONDATA-3069][Compaction] Fix bugs in setting cores for compaction

2018-11-04 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 469c52f5d -> 4ef41a239 [CARBONDATA-3069][Compaction] Fix bugs in setting cores for compaction Current implementation for setting cores for compaction is wrong. It will set the cores first and then set the flow to compaction, which

carbondata git commit: [CARBONDATA-3053][Cli] Fix bugs for carbon-cli found in windows env

2018-11-01 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 82eec10cb -> 26d1cdd9c [CARBONDATA-3053][Cli] Fix bugs for carbon-cli found in windows env Tests run failed in windows env due to: 1.unclosed file stream causing failure in clearing files in windows 2.the line separator is not n in

carbondata git commit: [CARBONDATA-3052] Improve drop table performance by reducing the namenode RPC calls during physical deletion of files

2018-11-01 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 625844784 -> 82eec10cb [CARBONDATA-3052] Improve drop table performance by reducing the namenode RPC calls during physical deletion of files Problem Current drop table command takes more than 1 minute to delete 3000 files during

carbondata git commit: [CARBONDATA-3025]handle passing spark appname for partition table and file format

2018-10-31 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 94a4f8314 -> 625844784 [CARBONDATA-3025]handle passing spark appname for partition table and file format Changes in this PR 1.Dataload with partion table file format fails, as the appname is not in carbonproperties in executor.

carbondata git commit: [CARBONDATA-3051] Fix bugs in unclosed streams

2018-10-31 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 43ffe79f3 -> 0e39abf81 [CARBONDATA-3051] Fix bugs in unclosed streams Failed to run CarbonReaderTests in windows env. This is due to two problems in carbondata: Problem 1: While encountering problems, we should close all the streams

carbondata git commit: [CARBONDATA-3058] Fix some exception coding in data loading

2018-10-31 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 3e0693b9e -> 43ffe79f3 [CARBONDATA-3058] Fix some exception coding in data loading This closes #2879 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [HOTFIX] Remove unuse javax.servlet jar from cli module

2018-10-30 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 10b393808 -> d27f20523 [HOTFIX] Remove unuse javax.servlet jar from cli module Remove unuse javax.servlet-2.5 jar from cli module This closes #2881 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [HOTFIX] Enable Local dictionary by default

2018-10-29 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 9d468f0c7 -> db5da530e [HOTFIX] Enable Local dictionary by default Enable Local dictionary by default This closes #2862 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-3002] Fix some spell error

2018-10-29 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 46d7595f4 -> 9d468f0c7 [CARBONDATA-3002] Fix some spell error This closes #2865 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/9d468f0c Tree:

carbondata git commit: [CARBONDATA-3046][Doc] Remove useless configurations in template properties

2018-10-28 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 8e570360e -> 9de946673 [CARBONDATA-3046][Doc] Remove useless configurations in template properties some of the configurations is outdated, this PR removes them from the template properties file. This closes #2860 Project:

[2/2] carbondata git commit: [CARBONDATA-3034] Carding parameters, Organized by parameter category.

2018-10-24 Thread jackylk
[CARBONDATA-3034] Carding parameters,Organized by parameter category. This PR is mainly for combing parameters in CarbonCommonConstain.java, organized by parameter category. This closes #2843 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-3035] Optimize parameters for unsafe working and sort memory

2018-10-24 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master b21a6d49f -> c429cee16 [CARBONDATA-3035] Optimize parameters for unsafe working and sort memory Add memory type in log message to distinguish them and fix trival bugs for them This closes #2844 Project:

carbondata git commit: [CARBONDATA-3008] Optimize default value for multiple temp dir

2018-10-23 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 8af737204 -> b21a6d49f [CARBONDATA-3008] Optimize default value for multiple temp dir The feature of supporting multiple temp dirs for data loading is introduced about 1.5 year ago. This feature is to solve the single disk hot spot

carbondata git commit: [CARBONDATA-3030] Remove no use parameter in test case

2018-10-23 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master fa9a4eeeb -> 8af737204 [CARBONDATA-3030] Remove no use parameter in test case Remove no use parameter in test case This closes #2839 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-3029][Test] Fix errors in spark datasource tests in windows env

2018-10-22 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master d941a5dda -> c58ef59e7 [CARBONDATA-3029][Test] Fix errors in spark datasource tests in windows env In current SparkCarbonDataSourceTest, the path specified in creating table and writer in windows env looks like '\D:\xx\xx', this will

carbondata git commit: [CARBONDATA-3004][32k] Fix bugs in writing dataframe to carbon with longstring

2018-10-22 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 8c49e5b42 -> d941a5dda [CARBONDATA-3004][32k] Fix bugs in writing dataframe to carbon with longstring Currently while writing dataframe to carbon table, we need to parse the rows in dataframe. For string columns, we need to judge

carbondata git commit: [HOTFIX] Fix SDV test case failure after PR #2645

2018-10-22 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master a9e405f47 -> 8c49e5b42 [HOTFIX] Fix SDV test case failure after PR #2645 **Changes: 1. #2645 has blocked the schema for external table. But SDV test cases were not updated. Hence updated the test cases 2. table properties was not

carbondata git commit: [CARBONDATA-3026] clear expired property that may cause GC problem

2018-10-18 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 0e8588744 -> 1be990f66 [CARBONDATA-3026] clear expired property that may cause GC problem During data loading, we will write some temp files (sort temp files and temp fact data files) in some locations. In currently implementation, we

carbondata git commit: [CARBONDATA-3009] Move method for mergeIndex to correct the place

2018-10-18 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 4a090ce27 -> 0e8588744 [CARBONDATA-3009] Move method for mergeIndex to correct the place Currently the entry point of function for mergeIndex is in CommonUtil which is not proper. Here in this commit, we will move this to the right

carbondata git commit: [CARBONDATA-3007][Doc] Fix error in documents

2018-10-18 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 7dea46168 -> 4a090ce27 [CARBONDATA-3007][Doc] Fix error in documents This closes #2813 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/4a090ce2 Tree:

carbondata git commit: [CARBONDATA-3019] Add error log in catch block to avoid to abort the exception which is thrown from catch block when there is an exception thrown in finally block

2018-10-18 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 06adb5a03 -> 7dea46168 [CARBONDATA-3019] Add error log in catch block to avoid to abort the exception which is thrown from catch block when there is an exception thrown in finally block 1.Add error log in catch block to avoid to

carbondata git commit: [CARBONDATA-2912] Support CSV table load csv data with spark2.2

2018-10-08 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/branch-1.3 9d8648ef8 -> 948ce2ebe [CARBONDATA-2912] Support CSV table load csv data with spark2.2 1.upgrade commons-lang3 version 2.add some test case This closes #2691 Project:

carbondata git commit: [HOTFIX][Streaming] Avoid throwing NPE during deleting the streaming lock file

2018-09-28 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 8284d9ed1 -> c01636163 [HOTFIX][Streaming] Avoid throwing NPE during deleting the streaming lock file We should check whether the lock file is exists or not before deleting it. If the lock file is exists, need to delete it. If the

carbondata git commit: [HOTFIX] fix compile error after merging PR-2749

2018-09-26 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master b3a5e3a8b -> a9ddfbd7b [HOTFIX] fix compile error after merging PR-2749 fix compile error after merging PR-2749 This closes #2763 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2969]local dictioanry query fix for spark-2.3

2018-09-26 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master f2398948c -> 2ab2254be [CARBONDATA-2969]local dictioanry query fix for spark-2.3 This closes #2761 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [HOTFIX] Fixed data loading failure

2018-09-25 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 6a2a94d05 -> d7913b1fd [HOTFIX] Fixed data loading failure Problem: 1.Data loading is failing with ArrayIndexOutOfBoundException when all columns are not considered in sort columns. this is because while filling the sort columns

carbondata git commit: [CARBONDATA-2955] Fix bugs in adaptive delta integral codec with compressor

2018-09-21 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master d1bfb7477 -> 817230da1 [CARBONDATA-2955] Fix bugs in adaptive delta integral codec with compressor This closes #2741 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2938][DataMap] Update comment of blockletId in IndexDataMapRebuildRDD

2018-09-15 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 2fb7dc9a7 -> c65a6527d [CARBONDATA-2938][DataMap] Update comment of blockletId in IndexDataMapRebuildRDD This closes #2723 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

carbondata git commit: [CARBONDATA-2933] Fix errors in spelling

2018-09-14 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 560bfbe77 -> 055b7a784 [CARBONDATA-2933] Fix errors in spelling This closes #2718 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/055b7a78 Tree:

carbondata git commit: [HOTFIX] Fix streaming CI issue for Spark 2.3 integration

2018-09-12 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 8f08c4abb -> daa91c88e [HOTFIX] Fix streaming CI issue for Spark 2.3 integration This closes #2712 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit:

[1/4] carbondata git commit: [CARBONDATA-2851][CARBONDATA-2852] Support zstd as column compressor in final store

2018-09-12 Thread jackylk
Repository: carbondata Updated Branches: refs/heads/master 7b31b9168 -> 8f08c4abb http://git-wip-us.apache.org/repos/asf/carbondata/blob/8f08c4ab/processing/src/main/java/org/apache/carbondata/processing/store/CarbonFactDataHandlerModel.java

[3/4] carbondata git commit: [CARBONDATA-2851][CARBONDATA-2852] Support zstd as column compressor in final store

2018-09-12 Thread jackylk
http://git-wip-us.apache.org/repos/asf/carbondata/blob/8f08c4ab/core/src/main/java/org/apache/carbondata/core/datastore/page/DecoderBasedFallbackEncoder.java -- diff --git

<    1   2   3   4   5   6   7   8   9   10   >