carbondata git commit: [CARBONDATA-1490] Fixed memory allocation for carbon row

2017-09-20 Thread manishgupta88
a/diff/d4eabbe5 Branch: refs/heads/master Commit: d4eabbe56aa6825d84933ab5a0fc78f26762cea9 Parents: e9c24c5 Author: kunal642 Authored: Wed Sep 20 11:02:00 2017 +0530 Committer: manishgupta88 Committed: Wed Sep 20 14:41:38 2017

carbondata git commit: [CARBONDATA-2876]Fix Avro decimal datatype with precision and scale

2018-09-09 Thread manishgupta88
pos/asf/carbondata/diff/9ebab574 Branch: refs/heads/master Commit: 9ebab5748969398cf12969eedd4701c30bc028cd Parents: 0483b46 Author: Indhumathi27 Authored: Mon Sep 3 17:35:01 2018 +0530 Committer: manishgupta88 Committed: Mon Sep 10 12:14:24 2018 +0

carbondata git commit: [HOTFIX] Fixed 2.3 CI

2018-09-14 Thread manishgupta88
iff/2fb7dc9a Branch: refs/heads/master Commit: 2fb7dc9a7831b0d092b98d6716b9e065bd859fe1 Parents: ac79a34 Author: ravipesala Authored: Fri Sep 14 17:38:30 2018 +0530 Committer: manishgupta88 Committed: Fri Sep 14 20:10:58 2018 +0

[4/4] carbondata git commit: [CARBONDATA-2896][Refactor] Adaptive Encoding for Primitive data types

2018-09-18 Thread manishgupta88
-us.apache.org/repos/asf/carbondata/tree/c8f70630 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/c8f70630 Branch: refs/heads/master Commit: c8f7063048115d161de539cf277cc1ccb015159b Parents: 61fcdf2 Author: dhatchayani Authored: Wed Aug 22 12:45:44 2018 +0530 Committer: manishgupta88

[2/4] carbondata git commit: [CARBONDATA-2896][Refactor] Adaptive Encoding for Primitive data types

2018-09-18 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/c8f70630/datamap/bloom/src/main/java/org/apache/carbondata/datamap/bloom/BloomDataMapBuilder.java -- diff --git a/datamap/bloom/src/main/java/org/apache/carbondata/datamap/blo

[1/4] carbondata git commit: [CARBONDATA-2896][Refactor] Adaptive Encoding for Primitive data types

2018-09-18 Thread manishgupta88
Repository: carbondata Updated Branches: refs/heads/master 61fcdf286 -> c8f706304 http://git-wip-us.apache.org/repos/asf/carbondata/blob/c8f70630/processing/src/main/java/org/apache/carbondata/processing/sort/sortdata/SortParameters.java -

[3/4] carbondata git commit: [CARBONDATA-2896][Refactor] Adaptive Encoding for Primitive data types

2018-09-18 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/c8f70630/core/src/main/java/org/apache/carbondata/core/datastore/page/encoding/dimension/legacy/ComplexDimensionIndexCodec.java -- diff --git a/core/src/main/java/org/apache/c

carbondata git commit: [CARBONDATA-2973] Added documentation for fallback condition for complex columns in local Dictionary

2018-09-26 Thread manishgupta88
tree/3f99e9b7 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/3f99e9b7 Branch: refs/heads/master Commit: 3f99e9b7f87b387f03cb5bece2b2a8c5a50b Parents: a9ddfbd Author: praveenmeenakshi56 Authored: Wed Sep 26 12:40:37 2018 +0530 Committer: manishgupta88 Committed: Wed Sep 26 18:14:

carbondata git commit: [CARBONDATA-2972] Debug Logs and function added for Adaptive Encoding

2018-09-27 Thread manishgupta88
ter Commit: 54bcf49638262af82583d930632018da6c73c8c5 Parents: 1b4109d Author: Manish Nalla Authored: Tue Sep 25 17:44:49 2018 +0530 Committer: manishgupta88 Committed: Thu Sep 27 17:16:37 2018 +0530 -- .../core/datastore/p

carbondata git commit: [CARBONDATA-2980][BloomDataMap] Fix bug in clearing bloomindex cache when recreating table and datamap

2018-09-29 Thread manishgupta88
d32 Branch: refs/heads/master Commit: 1c1ced32d122ba8ce7cbad4fd29f778f5dbb4871 Parents: 9ae91cc Author: xuchuanyin Authored: Sat Sep 29 14:03:09 2018 +0800 Committer: manishgupta88 Committed: Sun Sep 30 12:19:56 2018 +0530 --

carbondata git commit: [CARBONDATA-2982] CarbonSchemaReader support array

2018-10-03 Thread manishgupta88
wip-us.apache.org/repos/asf/carbondata/diff/d8a51c9b Branch: refs/heads/master Commit: d8a51c9bf314fb1cd5f6112e66eb04e776a0553d Parents: 7d1fcb3 Author: xubo245 Authored: Fri Sep 28 11:47:22 2018 +0800 Committer: manishgupta88 Committed: Wed Oct 3 16:24:38 2018 +0

carbondata git commit: [CARBONDATA-2990] Fixed JVM crash when rebuilding bloom datamap

2018-10-04 Thread manishgupta88
nch: refs/heads/master Commit: 8fbd4a5f53070b3755f1f573b09e0066fa93a6ea Parents: c3a8704 Author: ravipesala Authored: Sun Sep 30 11:27:57 2018 +0530 Committer: manishgupta88 Committed: Thu Oct 4 14:39:25 2018 +0530 -- .../c

carbondata git commit: [CARBONDATA-3022] Refactor ColumnPageWrapper

2018-10-23 Thread manishgupta88
mit: fa9a4eeeb489b77b3040d54e7878bac93ccb12aa Parents: c7c8368 Author: dhatchayani Authored: Wed Oct 10 13:18:01 2018 +0530 Committer: manishgupta88 Committed: Tue Oct 23 15:12:21 2018 +0530 -- .../chunk/store/ColumnPageWrapper.java |

carbondata git commit: [CARBONDATA-2998] Refresh column schema for old store(before V3) for SORT_COLUMNS option

2018-10-24 Thread manishgupta88
asf/carbondata/diff/278d1717 Branch: refs/heads/master Commit: 278d1717880541a052aa4a5ee96ba73423d650b1 Parents: c429cee Author: dhatchayani Authored: Tue Oct 9 17:34:42 2018 +0530 Committer: manishgupta88 Committed: Wed Oct 24 14:52:25 2018 +0

carbondata git commit: [CARBONDATA-2977] Write uncompress_size to ChunkCompressMeta in the file

2018-10-25 Thread manishgupta88
pos/asf/carbondata/diff/e19c5da6 Branch: refs/heads/master Commit: e19c5da6dbb07056b1053319d48a64a4b0715129 Parents: 33a6dc2 Author: Jacky Li Authored: Thu Sep 27 00:39:29 2018 +0800 Committer: manishgupta88 Committed: Thu Oct 25 14:38:28 2018 +0

carbondata git commit: [CARBONDATA-1522] Support preaggregate table creation and loading on streaming tables

2018-03-30 Thread manishgupta88
ree/7b56126b Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/7b56126b Branch: refs/heads/master Commit: 7b56126b726bfc47504513d3994a2849f6412016 Parents: 05eda00 Author: kunal642 Authored: Tue Mar 20 11:41:17 2018 +0530 Committer: manishgupta88 Committed: Fri Mar 30 14:49:06 2018 +0

carbondata git commit: [CARBONDATA-2285] Spark integration code refactor

2018-03-30 Thread manishgupta88
018 +0530 Committer: manishgupta88 Committed: Fri Mar 30 19:34:36 2018 +0530 -- .../core/constants/CarbonCommonConstants.java | 6 ++ .../hadoop/api/CarbonTableInputFormat.java | 21 +++-- .../spark/u

carbondata git commit: [CARBONDATA-2289] If carbon merge index is enabled then after IUD operation if some blocks of a segment is deleted, then during query and IUD operation the driver is throwing Fi

2018-03-30 Thread manishgupta88
pos/asf/carbondata/tree/97e7eca6 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/97e7eca6 Branch: refs/heads/branch-1.3 Commit: 97e7eca64dd2fb85839886ffd8b07c2bbce5e5b3 Parents: b835e76 Author: mohammadshahidkhan Authored: Wed Mar 28 16:38:21 2018 +0530 Committer: manishgupta88 Commit

[1/2] carbondata git commit: [CARBONDATA-2274]fixed Partition table having more than 4 column giving zero record

2018-03-30 Thread manishgupta88
20:19:43 2018 +0530 Committer: manishgupta88 Committed: Fri Mar 30 20:12:28 2018 +0530 -- .../StandardPartitionTableLoadingTestCase.scala | 21 .../carbondata/spark/util/CarbonScalaUtil.scala |

[2/2] carbondata git commit: [CARBONDATA-2287] events added for alter hive partition table

2018-03-30 Thread manishgupta88
: http://git-wip-us.apache.org/repos/asf/carbondata/diff/c1035307 Branch: refs/heads/branch-1.3 Commit: c10353070136aa8d06c1995100ae0505361c9b43 Parents: 4b07db4 Author: rahulforallp Authored: Tue Mar 27 12:20:04 2018 +0530 Committer: manishgupta88 Committed: Fri Mar 30 20:13:02 2018 +0530

carbondata git commit: [HOTFIX] scalaStyle fixed

2018-03-30 Thread manishgupta88
ter: manishgupta88 Committed: Fri Mar 30 20:44:54 2018 +0530 -- .../partition/CarbonAlterTableSplitPartitionCommand.scala| 4 ++-- 1 file changed, 2 insertions(+), 2 deleti

[2/2] carbondata git commit: [CARBONDATA-2294] Partition preaggregate support

2018-04-05 Thread manishgupta88
/tree/55084602 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/55084602 Branch: refs/heads/master Commit: 55084602917aec5a2ff5c29e6e7ac501d7830d14 Parents: 248e0c8 Author: kunal642 Authored: Fri Mar 23 12:12:05 2018 +0530 Committer: manishgupta88 Committed: Thu Apr 5 15:31:39 2018 +0530

[1/2] carbondata git commit: [CARBONDATA-2294] Partition preaggregate support

2018-04-05 Thread manishgupta88
Repository: carbondata Updated Branches: refs/heads/master 248e0c850 -> 550846029 http://git-wip-us.apache.org/repos/asf/carbondata/blob/55084602/integration/spark2/src/main/scala/org/apache/spark/sql/execution/command/preaaggregate/PreAggregateListeners.scala --

carbondata git commit: [CARBONDATA-2277] Fix for filter of default values on all datatypes

2018-04-05 Thread manishgupta88
org/repos/asf/carbondata/diff/b52f1571 Branch: refs/heads/master Commit: b52f1571da554cb375b3fcd9b9fb6fff0fd7d9d6 Parents: 280a400 Author: Jatin Authored: Sun Mar 25 13:45:24 2018 +0530 Committer: manishgupta88 Committed: Thu Apr 5 19:28:32 2018 +0

carbondata git commit: [CARBONDATA-2277] Fix for filter of default values on all datatypes

2018-04-05 Thread manishgupta88
org/repos/asf/carbondata/diff/f71d3050 Branch: refs/heads/branch-1.3 Commit: f71d3050c2617f65b10863b29182bfdd56ee7803 Parents: 30bc68c Author: Jatin Authored: Sun Mar 25 13:45:24 2018 +0530 Committer: manishgupta88 Committed: Thu Apr 5 19:32:28 2018 +0

carbondata git commit: [CARBONDATA-2315] Success and failure log fixed when no data is loaded into table

2018-04-06 Thread manishgupta88
mit: 85a958ee3a87bba7b4312bff2aac88dc6814bcc7 Parents: 638ed1f Author: Indhumathi27 Authored: Fri Apr 6 11:27:18 2018 +0530 Committer: manishgupta88 Committed: Fri Apr 6 13:59:55 2018 +0530 -- .../apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala

carbondata git commit: [CARBONDATA-2315] Success and failure log fixed when no data is loaded into table

2018-04-06 Thread manishgupta88
mit: 31c7b505aeb4f4b66f2664a16fe7cb977300cd36 Parents: f71d305 Author: Indhumathi27 Authored: Fri Apr 6 11:27:18 2018 +0530 Committer: manishgupta88 Committed: Fri Apr 6 14:02:37 2018 +0530 -- .../apache/carbondata/spark/rdd/CarbonDataRDDFactory.sc

[2/2] carbondata git commit: [CARBONDATA-2310] Refactored code to improve Distributable interface

2018-04-10 Thread manishgupta88
: manishgupta88 Committed: Tue Apr 10 16:16:27 2018 +0530 -- .../org/apache/carbondata/core/cache/Cache.java | 10 ++ .../dictionary/AbstractDictionaryCache.java | 4 + .../core/constants/CarbonCommonConstants.java | 3

[1/2] carbondata git commit: [CARBONDATA-2310] Refactored code to improve Distributable interface

2018-04-10 Thread manishgupta88
Repository: carbondata Updated Branches: refs/heads/branch-1.3 31c7b505a -> 3c48df396 http://git-wip-us.apache.org/repos/asf/carbondata/blob/3c48df39/hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonTableInputFormat.java ---

carbondata git commit: [CARBONDATA-2257] Added SDV test cases for Partition with Global Sort

2018-04-10 Thread manishgupta88
nts: 8a5369d Author: praveenmeenakshi56 Authored: Wed Mar 14 20:29:11 2018 +0530 Committer: manishgupta88 Committed: Wed Apr 11 11:06:51 2018 +0530 -- .../generated/TestPartitionWithGlobalSort.scala | 282 +++ .../clus

carbondata git commit: [CARBONDATA-2317] Concurrent datamap with same name and schema creation throws exception

2018-04-10 Thread manishgupta88
mit: 4cbd5cdf20341f1ae07c7cbb8275c1e333856cae Parents: 9ca9b6d Author: rahulforallp Authored: Fri Apr 6 15:17:54 2018 +0530 Committer: manishgupta88 Committed: Wed Apr 11 11:15:15 2018 +0530 -- .../preaggregate/TestPreAggCreateCommand.scala |

carbondata git commit: [CARBONDATA-2317] Concurrent datamap with same name and schema creation throws exception

2018-04-11 Thread manishgupta88
mit: cc2a74e65001ee73da4fad47852984d4f1c42adf Parents: 3c48df3 Author: rahulforallp Authored: Fri Apr 6 15:17:54 2018 +0530 Committer: manishgupta88 Committed: Wed Apr 11 13:55:41 2018 +0530 -- .../preaggregate/TestPreAggCreateCommand.sc

carbondata git commit: [CARBONDATA-2321] Fix selection of partition column after concurrent load ails randomly

2018-04-11 Thread manishgupta88
mit: 4544765a486b3fb1fbd4513992fbd79d3f9565ea Parents: cc2a74e Author: Jatin Authored: Wed Apr 11 12:04:31 2018 +0530 Committer: manishgupta88 Committed: Wed Apr 11 14:13:54 2018 +0530 -- .../core/writer/CarbonIndexFileMergeWriter.java |

carbondata git commit: [CARBONDATA-2321] Fix for selection of partion column after concurrent load fails randomly

2018-04-11 Thread manishgupta88
mit: df8f06739d752d39863846eacb8947e667ce5a55 Parents: 4cbd5cd Author: Jatin Authored: Sun Apr 8 15:35:19 2018 +0530 Committer: manishgupta88 Committed: Wed Apr 11 14:17:59 2018 +0530 -- .../core/writer/CarbonIndexFileMergeWriter.java |

carbondata git commit: [CARBONDATA-2329] Non Serializable extra info in session is overwritten from stale thread

2018-04-11 Thread manishgupta88
mit: 359f6e6b22cca44a344545470720c02d07bbb4f4 Parents: df8f067 Author: KanakaKumar Authored: Tue Apr 10 19:42:30 2018 +0530 Committer: manishgupta88 Committed: Wed Apr 11 14:25:55 2018 +0530 -- .../org/apache/carbondata/core/u

carbondata git commit: [CARBONDATA-2329] Non Serializable extra info in session is overwritten from stale thread

2018-04-11 Thread manishgupta88
mit: 28f33746a2feb8774cf40e8e392e9980c64d0292 Parents: 4544765 Author: KanakaKumar Authored: Tue Apr 10 19:42:30 2018 +0530 Committer: manishgupta88 Committed: Wed Apr 11 14:33:44 2018 +0530 -- .../org/apache/carbondata/core/u

carbondata git commit: [CARBONDATA-2316] Executor task is failed but UI shows success issue is fixed

2018-04-11 Thread manishgupta88
mit: f1d84646a50ab6e47310419947d5045c767f2b75 Parents: 13cdeb9 Author: rahulforallp Authored: Fri Apr 6 14:16:06 2018 +0530 Committer: manishgupta88 Committed: Wed Apr 11 18:19:01 2018 +0530 -- .../org/apache/carbondata/spark/rdd/CarbonMergerRDD.sc

carbondata git commit: [CARBONDATA-2316] Executor task is failed but UI shows success issue fixed

2018-04-11 Thread manishgupta88
mit: ea751bc7aae477f2ee0417ce61968a22509d660a Parents: 28f3374 Author: rahulforallp Authored: Fri Apr 6 14:16:06 2018 +0530 Committer: manishgupta88 Committed: Wed Apr 11 18:21:51 2018 +0530 -- .../core/indexstore/blockletindex/BlockletDataMapFactory.java

carbondata git commit: [CARBONDATA-2303] clean files issue resolved for partition folder

2018-04-11 Thread manishgupta88
17:38:51 2018 +0530 Committer: manishgupta88 Committed: Wed Apr 11 18:34:14 2018 +0530 -- .../filesystem/AbstractDFSCarbonFile.java | 15 .../datastore/filesystem/AlluxioCarbonFile.java | 12 .../core/datast

carbondata git commit: [CARBONDATA-2311][Streaming] Fix bug to avoid to append data to streaming finish segment

2018-04-12 Thread manishgupta88
org/repos/asf/carbondata/tree/da0cb4f6 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/da0cb4f6 Branch: refs/heads/branch-1.3 Commit: da0cb4f6aa1e73bf0961b86d087160f55ee3d696 Parents: 167260d Author: QiangCai Authored: Tue Apr 3 14:32:59 2018 +0800 Committer: manishgupta88 Committed:

carbondata git commit: [CARBONDATA-2307] Fix OOM issue when using DataFrame.coalesce

2018-04-14 Thread manishgupta88
Jin Zhou Authored: Tue Apr 3 18:48:51 2018 +0800 Committer: manishgupta88 Committed: Sat Apr 14 13:09:41 2018 +0530 -- .../datastore/chunk/AbstractRawColumnChunk.java | 4 +++- .../chunk/impl/AbstractDimensionColumnPage.java |

carbondata git commit: [CARBONDATA-2362] Changing the Cacheable object from DataMap to Wrapper

2018-04-26 Thread manishgupta88
1.3 Commit: 0b0d8e6536ff1d657e5201affd671c2e21c03ad9 Parents: bb35c25 Author: dhatchayani Authored: Wed Apr 25 11:32:26 2018 +0530 Committer: manishgupta88 Committed: Thu Apr 26 16:12:52 2018 +0530 -- .../diction

carbondata git commit: [HOTFIX][CARBONDATA-2362] Presto test case failure fix

2018-04-26 Thread manishgupta88
018 +0530 Committer: manishgupta88 Committed: Thu Apr 26 16:50:21 2018 +0530 -- .../apache/carbondata/core/indexstore/BlockletDetailInfo.java | 7 +++ 1 file changed, 7 inserti

carbondata git commit: [CARBONDATA-2251] Refactored sdv testcase

2018-04-26 Thread manishgupta88
asf/carbondata/tree/25d12d95 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/25d12d95 Branch: refs/heads/master Commit: 25d12d954ea21a0bef98b61f8525f1010b3a4b80 Parents: 3262230 Author: Jatin Authored: Tue Mar 13 17:13:13 2018 +0530 Committer: manishgupta88 Committed: Thu Apr 26 19:59:30 2

carbondata git commit: [CARBONDATA-2275]Query Failed for 0 byte deletedelta file

2018-04-26 Thread manishgupta88
ter Commit: 1849358278df7e5c738e7497e2d0d2be26f87d5a Parents: 25d12d9 Author: BJangir Authored: Fri Mar 23 22:49:27 2018 +0530 Committer: manishgupta88 Committed: Thu Apr 26 20:03:49 2018 +0530 -- .../datastore/filesys

carbondata git commit: [CARBONDATA-2033] Support user specified segments in compaction

2018-04-30 Thread manishgupta88
red: Tue Jan 16 17:02:51 2018 +0800 Committer: manishgupta88 Committed: Mon Apr 30 15:27:14 2018 +0530 -- docs/data-management-on-carbondata.md | 15 ++- ...CompactionSupportSpecifiedSegmentsTest.scala |

carbondata git commit: [CARBONDATA-2406][Dataload] Dictionary Server and Dictionary Client MD5 Validation failed with hive.server2.enable.doAs = true

2018-05-02 Thread manishgupta88
4ec Author: mohammadshahidkhan Authored: Thu Apr 26 16:32:21 2018 +0530 Committer: manishgupta88 Committed: Wed May 2 14:22:37 2018 +0530 -- .../server/SecureDictionaryServer.java | 32 ++-- 1 file changed,

carbondata git commit: [CARBONDATA-2396] Add CTAS support for using DataSource syntax

2018-05-03 Thread manishgupta88
master Commit: 167b6c00402963c9cea278f6246fdd21e3a1987d Parents: f7c0670 Author: Indhumathi27 Authored: Tue Apr 24 20:43:19 2018 +0530 Committer: manishgupta88 Committed: Thu May 3 14:18:08 2018 +0530 -- .../sql/commands/UsingCarbondataSuite.scala | 74 +++- .

carbondata git commit: [CARBONDATA-2410] Error message correction when column value length exceeds 320000 character

2018-05-03 Thread manishgupta88
iff/2c095542 Branch: refs/heads/master Commit: 2c095542bd3969c28fe13866ec5bad6a94cf6b3d Parents: 167b6c0 Author: mohammadshahidkhan Authored: Fri Apr 27 19:08:03 2018 +0530 Committer: manishgupta88 Committed: Thu May 3 14:26:29 2018 +0

carbondata git commit: [CARBONDATA-2436] Block pruning problem post the carbon schema restructure.

2018-05-06 Thread manishgupta88
red: Fri May 4 16:36:57 2018 +0530 Committer: manishgupta88 Committed: Mon May 7 11:32:18 2018 +0530 -- .../blockletindex/BlockletDataMap.java | 6 - .../AlterTableValidationTestCase.scala |

carbondata git commit: [CARBONDATA-2448] Adding compacted segments to load and alter events

2018-05-07 Thread manishgupta88
nts: 1128d89 Author: dhatchayani Authored: Mon May 7 11:16:02 2018 +0530 Committer: manishgupta88 Committed: Tue May 8 11:34:15 2018 +0530 -- .../indexstore/blockletindex/BlockletDataMap.java | 2 +- .../apache/carbondata/eve

[02/50] [abbrv] carbondata git commit: [HOTFIX][Search] Carbon should throw exception for TEXT_MATCH UDF

2018-05-17 Thread manishgupta88
[HOTFIX][Search] Carbon should throw exception for TEXT_MATCH UDF This closes #2242 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/325eac2b Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/325eac2b Diff

[11/50] [abbrv] carbondata git commit: [CARBONDATA-2457] Add converter to get Carbon SDK Schema from Avro schema directly.

2018-05-17 Thread manishgupta88
[CARBONDATA-2457] Add converter to get Carbon SDK Schema from Avro schema directly. In the current implementation, SDK users have to manually create carbon schema of fields from avro schema. This is time-consuming and error-prone. Also, user should not be worried about this logic. So, abstract

[07/50] [abbrv] carbondata git commit: [CARBONDATA-2441][Datamap] Implement distribute interface for bloom datamap

2018-05-17 Thread manishgupta88
[CARBONDATA-2441][Datamap] Implement distribute interface for bloom datamap Implement distribute interface for bloom datamap This closes #2272 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/452c42b9 Tree: http://g

[06/50] [abbrv] carbondata git commit: [CARBONDATA-2454][DataMap] Add fpp property for bloom datamap

2018-05-17 Thread manishgupta88
[CARBONDATA-2454][DataMap] Add fpp property for bloom datamap add fpp(false positive probability) property to configure bloom filter that used by bloom datamap. This closes #2279 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbo

[01/50] [abbrv] carbondata git commit: [CARBONDATA-2443][SDK]Added the test cases for avro multilevel complex type support

2018-05-17 Thread manishgupta88
Repository: carbondata Updated Branches: refs/heads/spark-2.3 3262230cb -> 8fe165668 [CARBONDATA-2443][SDK]Added the test cases for avro multilevel complex type support This closes #2276 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/rep

[08/50] [abbrv] carbondata git commit: [CARBONDATA-2408] Fix search mode master SaslException issue in the first time

2018-05-17 Thread manishgupta88
[CARBONDATA-2408] Fix search mode master SaslException issue in the first time This closes #2239 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/fb128974 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/

[05/50] [abbrv] carbondata git commit: [CARBONDATA-2458] Remove unnecessary TableProvider interface

2018-05-17 Thread manishgupta88
[CARBONDATA-2458] Remove unnecessary TableProvider interface Remove unused / unnecessary TableProvider Interface This closes #2280 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/2c0fa107 Tree: http://git-wip-us.ap

[04/50] [abbrv] carbondata git commit: [CARBONDATA-2434] Add ExternalTableExample and LuceneDataMapExample

2018-05-17 Thread manishgupta88
[CARBONDATA-2434] Add ExternalTableExample and LuceneDataMapExample For preparing 1.4.0 release. This closes #2268 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/d5da9a19 Tree: http://git-wip-us.apache.org/repos/a

[12/50] [abbrv] carbondata git commit: [HOTFIX]Add new modules to coverage report and make package name consistent with directory structure

2018-05-17 Thread manishgupta88
[HOTFIX]Add new modules to coverage report and make package name consistent with directory structure This closes #2285 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/e70b6b44 Tree: http://git-wip-us.apache.org/rep

[03/50] [abbrv] carbondata git commit: [CARBONDATA-2426] Added fix for data mismatch after compaction on Partition with Pre-Aggregate tables

2018-05-17 Thread manishgupta88
[CARBONDATA-2426] Added fix for data mismatch after compaction on Partition with Pre-Aggregate tables Problem: Partition directory is getting deleted when one on the segment is marked for delete and another segment is loaded in the same partition. In case of aggregate table we only have partitio

[46/50] [abbrv] carbondata git commit: [CARBONDATA-2463] concurrent insert requires separtate temp path which is differentiated with seg_id only

2018-05-17 Thread manishgupta88
[CARBONDATA-2463] concurrent insert requires separtate temp path which is differentiated with seg_id only issue : for non-transaction table we are not setting any segment-id in loadmodel . temp location contains databasenaem_tablename_segId_taskid . during concurrent insert in same table, temp

[09/50] [abbrv] carbondata git commit: [CARBONDATA-2416] Support DEFERRED REBUILD when creating DataMap

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/747be9b1/integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/datamap/TestDataMapStatus.scala -- diff --git a/integration/spark-common-test/src/t

[22/50] [abbrv] carbondata git commit: [CARBONDATA-2455]Fix _System Folder creation and lucene AND, OR, NOT Filter fix

2018-05-17 Thread manishgupta88
[CARBONDATA-2455]Fix _System Folder creation and lucene AND,OR,NOT Filter fix This closes #2281 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/61afa42d Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/6

[20/50] [abbrv] carbondata git commit: [HOTFIX] Fixed checkstyle issue

2018-05-17 Thread manishgupta88
[HOTFIX] Fixed checkstyle issue Fixed checkstyle issue This closes #2298 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/8e7fceb7 Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/8e7fceb7 Diff: http://g

[13/50] [abbrv] carbondata git commit: [CARBONDATA-2352] Added SDV test cases for Partition with Pre-Aggregate table

2018-05-17 Thread manishgupta88
[CARBONDATA-2352] Added SDV test cases for Partition with Pre-Aggregate table Added SDV test cases for Support of partitioning with Pre-Aggregate tables. This closes #2175 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/c

[17/50] [abbrv] carbondata git commit: [CARBONDATA-2443][SDK] Multi level complex type support for AVRO based SDK

2018-05-17 Thread manishgupta88
/35a7b5e9 Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/35a7b5e9 Branch: refs/heads/spark-2.3 Commit: 35a7b5e9af5cabe85794274e07cab9a6c53f Parents: ff5166e Author: manishgupta88 Authored: Thu May 10 17:09:17 2018 +0530 Committer: ravipesala Committed: Thu May 10 20:49:28 2018 +0530

[18/50] [abbrv] carbondata git commit: [CARBONDATA-2417] [SDK Writer] SDK writer goes to infinite wait when consumer thread goes dead

2018-05-17 Thread manishgupta88
t-wip-us.apache.org/repos/asf/carbondata/diff/fe436c3e Branch: refs/heads/spark-2.3 Commit: fe436c3ecef632f6a5621d391c6dd8724813b25f Parents: 35a7b5e Author: manishgupta88 Authored: Wed May 9 15:08:05 2018 +0530 Committer: ravipesala Committed: Thu May 10 20:54:11 2018

[29/50] [abbrv] carbondata git commit: [CARBONDATA-2474] Support Modular Plan for Materialized View DataMap

2018-05-17 Thread manishgupta88
[CARBONDATA-2474] Support Modular Plan for Materialized View DataMap Currently carbon supports preaggregate datamap, which only supports preaggregate on single table. To improve it, we can add join capability by implementing Materialized View. In carbon Materialized View, Modular Plan is the ba

[19/50] [abbrv] carbondata git commit: [CARBONDATA-2442][CARBONDATA-2469] Fixed: multiple issues in sdk writer and external table

2018-05-17 Thread manishgupta88
[CARBONDATA-2442][CARBONDATA-2469] Fixed: multiple issues in sdk writer and external table problem1: when two sdk writer output with differnt schema is placed in same folder for reading, output is not as expected. It has many null output. root cause: when multiple carbondata and indexx files is

[16/50] [abbrv] carbondata git commit: [CARBONDATA-2435] Remove SDK dependency on spark jars.

2018-05-17 Thread manishgupta88
[CARBONDATA-2435] Remove SDK dependency on spark jars. [CARBONDATA-2435] Remove SDK dependency on spark jars. Problem and cause : when sdk writer is used in standalone cluster without spark jars, exception is thrown during reverse dictionary cache initialize time. Solution: carbon SDK doesn't sup

[21/50] [abbrv] carbondata git commit: [CARBONDATA-2452] [CARBONDATA-2451] [CARBONDATA-2450] [CARBONDATA-2453] Fixed issues related to complex types

2018-05-17 Thread manishgupta88
[CARBONDATA-2452] [CARBONDATA-2451] [CARBONDATA-2450] [CARBONDATA-2453] Fixed issues related to complex types Issue 1: Dictionary encoding was being added to complex types in SDK case which led to data load failure Issue 2: Sort columns were not being checked against table schema to validate the

[28/50] [abbrv] carbondata git commit: [CARBONDATA-2474] Support Modular Plan for Materialized View DataMap

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/ffddba70/datamap/mv/plan/src/main/scala/org/apache/carbondata/mv/plans/util/BirdcageOptimizer.scala -- diff --git a/datamap/mv/plan/src/main/scala/org/apache/carbondata/mv/pla

[10/50] [abbrv] carbondata git commit: [CARBONDATA-2416] Support DEFERRED REBUILD when creating DataMap

2018-05-17 Thread manishgupta88
[CARBONDATA-2416] Support DEFERRED REBUILD when creating DataMap 1. REFRESH DATAMAP is changed to REBUILD DATAMAP command 2. When creating datamap, user can choose to load the datamap immediately or later by manually trigger REBUILD DATAMAP command This closes #2255 Project: http://git-wip-us.

[14/50] [abbrv] carbondata git commit: [CARBONDATA-2464]Fixed OOM issue in case of Complex type

2018-05-17 Thread manishgupta88
[CARBONDATA-2464]Fixed OOM issue in case of Complex type Problem: Query with Complex type is failing with OOM Root Cause: Complex type child column(No-dictionary) values are written in LV format, while reading the data it will read length then based on length it is reading the data. Converting

[32/50] [abbrv] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/bf73e9fe/datamap/mv/core/src/test/scala/org/apache/carbondata/mv/rewrite/MVTpchTestCase.scala -- diff --git a/datamap/mv/core/src/test/scala/org/apache/carbondata/mv/rewrite/M

[41/50] [abbrv] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark-common-test/src/test/resources/tpch/customers.csv -- diff --git a/integration/spark-common-test/src/test/resources/tpch/customers.csv b/integration

[31/50] [abbrv] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/bf73e9fe/datamap/mv/core/src/test/scala/org/apache/carbondata/mv/rewrite/matching/TestTPCDS_1_4_Batch.scala -- diff --git a/datamap/mv/core/src/test/scala/org/apache/carbondat

[35/50] [abbrv] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark2/src/main/spark2.2/org/apache/spark/sql/hive/CarbonAnalyzer.scala -- diff --git a/integration/spark2/src/main/spark2.2/org/apache/spark/sql/hive/Car

[15/50] [abbrv] carbondata git commit: [CARBONDATA-2401] Date and Timestamp options are not working in SDK

2018-05-17 Thread manishgupta88
[CARBONDATA-2401] Date and Timestamp options are not working in SDK Issue:- Date and Timestamp format is passed in options of SDK but data load is failed even correct data is set as per format . Cause:- Load model is getting overwritten with default . Fix :- if user has passed the options then Loa

[24/50] [abbrv] carbondata git commit: [CARBONDATA-2471]Added support for No Dictionary Complex type for Double, Decimal, Date type in SDK

2018-05-17 Thread manishgupta88
[CARBONDATA-2471]Added support for No Dictionary Complex type for Double, Decimal, Date type in SDK Added support for No Dictionary Complex type for Double, Decimal, Date type in SDK This is closes #2297 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us

[49/50] [abbrv] carbondata git commit: [CARBONDATA-2477]Fixed No dictionary Complex type with double/date/decimal data type

2018-05-17 Thread manishgupta88
[CARBONDATA-2477]Fixed No dictionary Complex type with double/date/decimal data type Problem: SDK create table with No Dictionary complex type is failing when complex type child contain double/date/decimal data type Solution: In complex type validation , it is not allowing double/date/decimal d

[34/50] [abbrv] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-17 Thread manishgupta88
[CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting Support Modular Core for Materialized View DataMap This closes #2302 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/c

[42/50] [abbrv] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-17 Thread manishgupta88
[CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting Integrate MV DataMap to Carbon This closes #2302 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/2881c6bb Tree:

[36/50] [abbrv] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark-common-test/src/test/resources/tpch/supplier.csv -- diff --git a/integration/spark-common-test/src/test/resources/tpch/supplier.csv b/integration/sp

[23/50] [abbrv] carbondata git commit: [CARBONDATA-2460] [CARBONDATA-2461] [CARBONDATA-2462] Fixed bug in AvroCarbonWriter

2018-05-17 Thread manishgupta88
[CARBONDATA-2460] [CARBONDATA-2461] [CARBONDATA-2462] Fixed bug in AvroCarbonWriter Issue1: If Null type is passed from avro schema then Unsupported data type exception is thrown. Solution1: Ignore column which has NULL data type. Issue2: Array fields were being cast to ArrayList without any ins

[33/50] [abbrv] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/bf73e9fe/datamap/mv/core/src/main/scala/org/apache/carbondata/mv/rewrite/Utils.scala -- diff --git a/datamap/mv/core/src/main/scala/org/apache/carbondata/mv/rewrite/Utils.scal

[48/50] [abbrv] carbondata git commit: [CARBONDATA-2479] Multiple issue fixes in SDK writer and external table flow

2018-05-17 Thread manishgupta88
[CARBONDATA-2479] Multiple issue fixes in SDK writer and external table flow [CARBONDATA-2479] Multiple issues: fixed external table path display fixed default value for array in AVRO fixed NPE when delete folder before the second select query fixed: avro float value precision change issue This c

[30/50] [abbrv] carbondata git commit: [CARBONDATA-2459][DataMap] Add cache for bloom filter datamap

2018-05-17 Thread manishgupta88
[CARBONDATA-2459][DataMap] Add cache for bloom filter datamap Loading bloom filter from bloomindex file is slow. Adding cache for this procedure will surely improve the query performance This closes #2300 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us

[38/50] [abbrv] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark-common-test/src/test/resources/tpch/orders.csv -- diff --git a/integration/spark-common-test/src/test/resources/tpch/orders.csv b/integration/spark-

[37/50] [abbrv] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark-common-test/src/test/resources/tpch/region.csv -- diff --git a/integration/spark-common-test/src/test/resources/tpch/region.csv b/integration/spark-

[47/50] [abbrv] carbondata git commit: [CARBONDATA-2486][DOC] Update set search mode information in the documentation

2018-05-17 Thread manishgupta88
[CARBONDATA-2486][DOC] Update set search mode information in the documentation Update set search mode information in the documentation This closes #2312 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/1d302a8b Tree

[27/50] [abbrv] carbondata git commit: [CARBONDATA-2474] Support Modular Plan for Materialized View DataMap

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/ffddba70/datamap/mv/plan/src/main/scala/org/apache/carbondata/mv/testutil/Tpcds_1_4_QueryBatch.scala -- diff --git a/datamap/mv/plan/src/main/scala/org/apache/carbondata/mv/te

[26/50] [abbrv] carbondata git commit: [CARBONDATA-2474] Support Modular Plan for Materialized View DataMap

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/ffddba70/datamap/mv/plan/src/main/scala/org/apache/carbondata/mv/testutil/Tpcds_1_4_Tables.scala -- diff --git a/datamap/mv/plan/src/main/scala/org/apache/carbondata/mv/testut

[44/50] [abbrv] carbondata git commit: [CARBONDATA-2468] addition of column to default sort_column is handled

2018-05-17 Thread manishgupta88
[CARBONDATA-2468] addition of column to default sort_column is handled issue : default sort_column handling was missing solution : condition added for default sort_columns This closes #2293 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repo

[43/50] [abbrv] carbondata git commit: [CARBONDATA-2431] Incremental data added after external table creation is not reflecting while doing select query issue is fixed.

2018-05-17 Thread manishgupta88
[CARBONDATA-2431] Incremental data added after external table creation is not reflecting while doing select query issue is fixed. This closes #2262 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/f1a6c7cf Tree: htt

[50/50] [abbrv] carbondata git commit: [CARBONDATA-2465] Improve the carbondata file reliability in data load when direct hdfs write is enabled

2018-05-17 Thread manishgupta88
[CARBONDATA-2465] Improve the carbondata file reliability in data load when direct hdfs write is enabled Problem: At present if we enable direct write on HDFS, data is written with replication of 1 which can cause data loss. Solution: Write with cluster replication. With this change No need to i

[25/50] [abbrv] carbondata git commit: [CARBONDATA-2369] updated the document about AVRO to carbon schema converter

2018-05-17 Thread manishgupta88
[CARBONDATA-2369] updated the document about AVRO to carbon schema converter updated the document about AVRO to carbon schema converter This closes #2296 Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/443b717d Tre

[39/50] [abbrv] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark-common-test/src/test/resources/tpch/nation.csv -- diff --git a/integration/spark-common-test/src/test/resources/tpch/nation.csv b/integration/spark-

[40/50] [abbrv] carbondata git commit: [CARBONDATA-2475] Support Modular Core for Materialized View DataMap for query matching and rewriting

2018-05-17 Thread manishgupta88
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2881c6bb/integration/spark-common-test/src/test/resources/tpch/lineitem.csv -- diff --git a/integration/spark-common-test/src/test/resources/tpch/lineitem.csv b/integration/sp

  1   2   3   >