[GitHub] carbondata pull request #2850: [WIP] Added concurrent reading through SDK

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2850#discussion_r229183542 --- Diff: store/sdk/src/test/java/org/apache/carbondata/sdk/file/ConcurrentSdkReaderTest.java --- @@ -0,0 +1,153 @@ +/* + * Licensed to

[GitHub] carbondata pull request #2850: [WIP] Added concurrent reading through SDK

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2850#discussion_r229183179 --- Diff: store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java --- @@ -114,6 +117,43 @@ public static CarbonReaderBuilder

[GitHub] carbondata issue #2868: [CARBONDATA-3052] Improve drop table performance by ...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2868 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1346/ ---

[GitHub] carbondata issue #2868: [CARBONDATA-3052] Improve drop table performance by ...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2868 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9398/ ---

[GitHub] carbondata pull request #2850: [WIP] Added concurrent reading through SDK

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2850#discussion_r229179978 --- Diff: store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java --- @@ -114,6 +117,43 @@ public static CarbonReaderBuilder

[GitHub] carbondata pull request #2850: [WIP] Added concurrent reading through SDK

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2850#discussion_r229179713 --- Diff: store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java --- @@ -114,6 +117,43 @@ public static CarbonReaderBuilder

[GitHub] carbondata pull request #2850: [WIP] Added concurrent reading through SDK

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2850#discussion_r229179428 --- Diff: store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java --- @@ -114,6 +117,43 @@ public static CarbonReaderBuilder

[GitHub] carbondata issue #2869: [WIP] Changes for improving carbon reader performanc...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2869 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1136/ ---

[GitHub] carbondata issue #2869: [WIP] Changes for improving carbon reader performanc...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2869 Build Failed with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9400/ ---

[GitHub] carbondata issue #2807: [CARBONDATA-2997] Support read schema from index fil...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2807 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1345/ ---

[GitHub] carbondata issue #2869: [WIP] Changes for improving carbon reader performanc...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2869 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1348/ ---

[GitHub] carbondata issue #2876: [CARBONDATA-3054] Fix Dictionary file cannot be read...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2876 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1135/ ---

[GitHub] carbondata issue #2876: [CARBONDATA-3054] Fix Dictionary file cannot be read...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on the issue: https://github.com/apache/carbondata/pull/2876 retest this please ---

[GitHub] carbondata issue #2807: [CARBONDATA-2997] Support read schema from index fil...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2807 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9397/ ---

[GitHub] carbondata issue #2868: [CARBONDATA-3052] Improve drop table performance by ...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2868 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1134/ ---

[GitHub] carbondata pull request #2804: [CARBONDATA-2996] CarbonSchemaReader support ...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2804#discussion_r229173861 --- Diff: store/sdk/src/test/java/org/apache/carbondata/sdk/file/CarbonSchemaReaderTest.java --- @@ -0,0 +1,170 @@ +/* + * Licensed to

[GitHub] carbondata pull request #2804: [CARBONDATA-2996] CarbonSchemaReader support ...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2804#discussion_r229173916 --- Diff: store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonSchemaReader.java --- @@ -59,11 +60,30 @@ public static Schema

[GitHub] carbondata pull request #2804: [CARBONDATA-2996] CarbonSchemaReader support ...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2804#discussion_r229173821 --- Diff: store/sdk/src/test/java/org/apache/carbondata/sdk/file/CarbonSchemaReaderTest.java --- @@ -0,0 +1,170 @@ +/* + * Licensed to

[GitHub] carbondata issue #2804: [CARBONDATA-2996] CarbonSchemaReader support read sc...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on the issue: https://github.com/apache/carbondata/pull/2804 @xubo245 : In that case you can implement, String getFirstCarbonFile(path, ExtenstionType) and pass it to existing method. ReadSchemaFromFile() must only read it. It

[GitHub] carbondata issue #2816: [CARBONDATA-3003] Suppor read batch row in CSDK

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2816 Build Failed with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9396/ ---

[GitHub] carbondata issue #2816: [CARBONDATA-3003] Suppor read batch row in CSDK

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2816 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1344/ ---

[GitHub] carbondata pull request #2868: [CARBONDATA-3052] Improve drop table performa...

2018-10-29 Thread manishgupta88
Github user manishgupta88 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2868#discussion_r229173642 --- Diff: integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/detailquery/SubqueryWithFilterAndSortTestCase.scala ---

[GitHub] carbondata pull request #2836: [CARBONDATA-3027] Increase unsafe working mem...

2018-10-29 Thread xubo245
Github user xubo245 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2836#discussion_r229170138 --- Diff: core/src/main/java/org/apache/carbondata/core/constants/CarbonCommonConstants.java --- @@ -1234,7 +1234,7 @@ @CarbonProperty

[GitHub] carbondata issue #2836: [CARBONDATA-3027] Increase unsafe working memory def...

2018-10-29 Thread xubo245
Github user xubo245 commented on the issue: https://github.com/apache/carbondata/pull/2836 @xuchuanyin @jackylk I added some describe in ahead about this issue. ---

[GitHub] carbondata issue #2807: [CARBONDATA-2997] Support read schema from index fil...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2807 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1133/ ---

[GitHub] carbondata issue #2804: [CARBONDATA-2996] CarbonSchemaReader support read sc...

2018-10-29 Thread xubo245
Github user xubo245 commented on the issue: https://github.com/apache/carbondata/pull/2804 @ajantha-bhat @KanakaKumar Please review again. ---

[GitHub] carbondata pull request #2807: [CARBONDATA-2997] Support read schema from in...

2018-10-29 Thread xubo245
Github user xubo245 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2807#discussion_r229167327 --- Diff: store/CSDK/test/main.cpp --- @@ -116,6 +118,66 @@ void printResult(JNIEnv *env, CarbonReader reader) { reader.close(); }

[GitHub] carbondata pull request #2807: [CARBONDATA-2997] Support read schema from in...

2018-10-29 Thread xubo245
Github user xubo245 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2807#discussion_r229167245 --- Diff: store/CSDK/test/main.cpp --- @@ -116,6 +118,66 @@ void printResult(JNIEnv *env, CarbonReader reader) { reader.close(); }

[GitHub] carbondata issue #2816: [CARBONDATA-3003] Suppor read batch row in CSDK

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2816 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1132/ ---

[GitHub] carbondata issue #2816: [CARBONDATA-3003] Suppor read batch row in CSDK

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2816 Build Failed with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9395/ ---

[GitHub] carbondata issue #2816: [CARBONDATA-3003] Suppor read batch row in CSDK

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2816 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1343/ ---

[GitHub] carbondata issue #2816: [CARBONDATA-3003] Suppor read batch row in CSDK

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2816 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1131/ ---

[GitHub] carbondata issue #2816: [CARBONDATA-3003] Suppor read batch row in CSDK

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2816 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1130/ ---

[GitHub] carbondata issue #2816: [CARBONDATA-3003] Suppor read batch row in CSDK

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2816 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1342/ ---

[GitHub] carbondata issue #2816: [CARBONDATA-3003] Suppor read batch row in CSDK

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2816 Build Failed with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9394/ ---

[GitHub] carbondata pull request #2816: [CARBONDATA-3003] Suppor read batch row in CS...

2018-10-29 Thread xubo245
Github user xubo245 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2816#discussion_r229162173 --- Diff: store/sdk/src/test/java/org/apache/carbondata/sdk/file/CarbonReaderTest.java --- @@ -1737,4 +1739,95 @@ public void

[GitHub] carbondata pull request #2816: [CARBONDATA-3003] Suppor read batch row in CS...

2018-10-29 Thread xubo245
Github user xubo245 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2816#discussion_r229161840 --- Diff: store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java --- @@ -90,6 +93,20 @@ public T readNextRow() throws IOException,

[GitHub] carbondata pull request #2816: [CARBONDATA-3003] Suppor read batch row in CS...

2018-10-29 Thread xubo245
Github user xubo245 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2816#discussion_r229161378 --- Diff: store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java --- @@ -90,6 +93,20 @@ public T readNextRow() throws IOException,

[GitHub] carbondata pull request #2816: [CARBONDATA-3003] Suppor read batch row in CS...

2018-10-29 Thread xubo245
Github user xubo245 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2816#discussion_r229161334 --- Diff: store/CSDK/test/main.cpp --- @@ -220,6 +393,86 @@ bool tryCatchException(JNIEnv *env) { */ bool readFromS3(JNIEnv *env, char

[GitHub] carbondata pull request #2816: [CARBONDATA-3003] Suppor read batch row in CS...

2018-10-29 Thread xubo245
Github user xubo245 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2816#discussion_r229161289 --- Diff: store/CSDK/test/main.cpp --- @@ -220,6 +393,86 @@ bool tryCatchException(JNIEnv *env) { */ bool readFromS3(JNIEnv *env, char

[GitHub] carbondata pull request #2816: [CARBONDATA-3003] Suppor read batch row in CS...

2018-10-29 Thread xubo245
Github user xubo245 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2816#discussion_r229155198 --- Diff: core/src/main/java/org/apache/carbondata/core/scan/result/RowBatch.java --- @@ -100,4 +100,25 @@ public int getSize() { counter++;

[GitHub] carbondata pull request #2861: [CARBONDATA-3025]handle passing spark appname...

2018-10-29 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2861#discussion_r229147458 --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/execution/datasources/SparkCarbonTableFormat.scala --- @@ -175,6 +174,12 @@ with

[GitHub] carbondata pull request #2868: [CARBONDATA-3052] Improve drop table performa...

2018-10-29 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2868#discussion_r229146066 --- Diff: integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/detailquery/SubqueryWithFilterAndSortTestCase.scala ---

[GitHub] carbondata issue #2874: [CARBONDATA-3053][Cli] Fix bugs for carbon-cli found...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2874 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9391/ ---

[GitHub] carbondata issue #2876: [CARBONDATA-3054] Fix Dictionary file cannot be read...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2876 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9390/ ---

[GitHub] carbondata issue #2870: [HOTFIX-compatibility] Handle Lazy loading with inve...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2870 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9393/ ---

[GitHub] carbondata issue #2872: [WIP] Added reusable buffer code

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2872 Build Failed with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9392/ ---

[GitHub] carbondata issue #2872: [WIP] Added reusable buffer code

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2872 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1338/ ---

[GitHub] carbondata issue #2876: [CARBONDATA-3054] Fix Dictionary file cannot be read...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2876 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1339/ ---

[GitHub] carbondata issue #2870: [HOTFIX-compatibility] Handle Lazy loading with inve...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2870 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1340/ ---

[GitHub] carbondata issue #2872: [WIP] Added reusable buffer code

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2872 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1128/ ---

[GitHub] carbondata issue #2877: [WIP] Added validation for supported format version ...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2877 Build Failed with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9389/ ---

[GitHub] carbondata issue #2870: [HOTFIX-compatibility] Handle Lazy loading with inve...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2870 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1129/ ---

[GitHub] carbondata issue #2876: [CARBONDATA-3054] Fix Dictionary file cannot be read...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2876 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1126/ ---

[GitHub] carbondata issue #2874: [CARBONDATA-3053][Cli] Fix bugs for carbon-cli found...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2874 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1127/ ---

[GitHub] carbondata issue #2877: [WIP] Added validation for supported format version ...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2877 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1341/ ---

[GitHub] carbondata issue #2874: [CARBONDATA-3053][Cli] Fix bugs for carbon-cli found...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2874 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1337/ ---

[GitHub] carbondata issue #2877: [WIP] Added validation for supported format version ...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2877 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1125/ ---

[GitHub] carbondata pull request #2877: [WIP] Added validation for supported format v...

2018-10-29 Thread manishgupta88
GitHub user manishgupta88 opened a pull request: https://github.com/apache/carbondata/pull/2877 [WIP] Added validation for supported format version and Encoding type to throw proper exception to the user while reading a file **This PR contains:** 1. Validation for columnar

[GitHub] carbondata issue #2876: [CARBONDATA-3054] Fix Dictionary file cannot be read...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on the issue: https://github.com/apache/carbondata/pull/2876 retest this please ---

[GitHub] carbondata issue #2870: [HOTFIX-compatibility] Handle Lazy loading with inve...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on the issue: https://github.com/apache/carbondata/pull/2870 @ravipesala : please review ---

[GitHub] carbondata issue #2874: [CARBONDATA-3053][Cli] Fix bugs for carbon-cli found...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2874 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9387/ ---

[jira] [Updated] (CARBONDATA-3056) Implement concurrent reading through CarbonReader

2018-10-29 Thread Naman Rastogi (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naman Rastogi updated CARBONDATA-3056: -- Summary: Implement concurrent reading through CarbonReader (was: Implement

[jira] [Updated] (CARBONDATA-3055) Improve SDK Reader Performance

2018-10-29 Thread Naman Rastogi (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naman Rastogi updated CARBONDATA-3055: -- Summary: Improve SDK Reader Performance (was: Improve CarbonReader performance)

[jira] [Created] (CARBONDATA-3057) Implement Vectorized CarbonReader for SDK

2018-10-29 Thread Naman Rastogi (JIRA)
Naman Rastogi created CARBONDATA-3057: - Summary: Implement Vectorized CarbonReader for SDK Key: CARBONDATA-3057 URL: https://issues.apache.org/jira/browse/CARBONDATA-3057 Project: CarbonData

[jira] [Created] (CARBONDATA-3056) Implement Concurrent SDK Reader

2018-10-29 Thread Naman Rastogi (JIRA)
Naman Rastogi created CARBONDATA-3056: - Summary: Implement Concurrent SDK Reader Key: CARBONDATA-3056 URL: https://issues.apache.org/jira/browse/CARBONDATA-3056 Project: CarbonData Issue

[jira] [Created] (CARBONDATA-3055) Improve CarbonReader performance

2018-10-29 Thread Naman Rastogi (JIRA)
Naman Rastogi created CARBONDATA-3055: - Summary: Improve CarbonReader performance Key: CARBONDATA-3055 URL: https://issues.apache.org/jira/browse/CARBONDATA-3055 Project: CarbonData

[GitHub] carbondata issue #2869: [WIP] Changes for improving carbon reader performanc...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2869 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1124/ ---

[GitHub] carbondata issue #2869: [WIP] Changes for improving carbon reader performanc...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2869 Build Failed with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9388/ ---

[GitHub] carbondata issue #2869: [WIP] Changes for improving carbon reader performanc...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2869 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1336/ ---

[GitHub] carbondata issue #2876: [CARBONDATA-3054] Fix Dictionary file cannot be read...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2876 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1334/ ---

[GitHub] carbondata issue #2873: [WIP] Fix partition load issue when custom location ...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2873 Build Failed with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9385/ ---

[GitHub] carbondata pull request #2816: [CARBONDATA-3003] Suppor read batch row in CS...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2816#discussion_r228935418 --- Diff: store/sdk/src/test/java/org/apache/carbondata/sdk/file/CarbonReaderTest.java --- @@ -1737,4 +1739,95 @@ public void

[GitHub] carbondata pull request #2816: [CARBONDATA-3003] Suppor read batch row in CS...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2816#discussion_r228932987 --- Diff: store/sdk/src/main/java/org/apache/carbondata/sdk/file/CarbonReader.java --- @@ -90,6 +93,20 @@ public T readNextRow() throws

[GitHub] carbondata pull request #2816: [CARBONDATA-3003] Suppor read batch row in CS...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2816#discussion_r228932584 --- Diff: store/CSDK/test/main.cpp --- @@ -220,6 +393,86 @@ bool tryCatchException(JNIEnv *env) { */ bool readFromS3(JNIEnv *env, char

[GitHub] carbondata pull request #2816: [CARBONDATA-3003] Suppor read batch row in CS...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2816#discussion_r228932392 --- Diff: store/CSDK/test/main.cpp --- @@ -220,6 +393,86 @@ bool tryCatchException(JNIEnv *env) { */ bool readFromS3(JNIEnv *env, char

[GitHub] carbondata issue #2874: [CARBONDATA-3053][Cli] Fix bugs for carbon-cli found...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2874 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1123/ ---

[GitHub] carbondata issue #2876: [CARBONDATA-3054] Fix Dictionary file cannot be read...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2876 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1122/ ---

[GitHub] carbondata pull request #2816: [CARBONDATA-3003] Suppor read batch row in CS...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2816#discussion_r228926855 --- Diff: core/src/main/java/org/apache/carbondata/core/scan/result/RowBatch.java --- @@ -100,4 +100,25 @@ public int getSize() {

[GitHub] carbondata issue #2872: [WIP] Added reusable buffer code

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2872 Build Failed with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9379/ ---

[GitHub] carbondata pull request #2807: [CARBONDATA-2997] Support read schema from in...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2807#discussion_r228920818 --- Diff: store/CSDK/test/main.cpp --- @@ -116,6 +118,66 @@ void printResult(JNIEnv *env, CarbonReader reader) { reader.close(); }

[GitHub] carbondata issue #2873: [WIP] Fix partition load issue when custom location ...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2873 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1121/ ---

[GitHub] carbondata issue #2874: [CARBONDATA-3053][Cli] Fix bugs for carbon-cli found...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2874 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1120/ ---

[GitHub] carbondata pull request #2807: [CARBONDATA-2997] Support read schema from in...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2807#discussion_r228920786 --- Diff: store/CSDK/test/main.cpp --- @@ -116,6 +118,66 @@ void printResult(JNIEnv *env, CarbonReader reader) { reader.close(); }

[GitHub] carbondata issue #2875: [WIP][CARBONDATA-3038] Refactor dynamic configuratio...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2875 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1119/ ---

[GitHub] carbondata issue #2873: [WIP] Fix partition load issue when custom location ...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2873 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1333/ ---

[GitHub] carbondata issue #2868: [CARBONDATA-3052] Improve drop table performance by ...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2868 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9382/ ---

[GitHub] carbondata issue #2875: [WIP][CARBONDATA-3038] Refactor dynamic configuratio...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2875 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1331/ ---

[GitHub] carbondata issue #2875: [WIP][CARBONDATA-3038] Refactor dynamic configuratio...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2875 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9383/ ---

[GitHub] carbondata pull request #2872: [WIP] Added reusable buffer code

2018-10-29 Thread kumarvishal09
Github user kumarvishal09 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2872#discussion_r228915613 --- Diff: core/src/main/java/org/apache/carbondata/core/datastore/compression/ZstdCompressor.java --- @@ -167,4 +167,12 @@ public long

[GitHub] carbondata pull request #2872: [WIP] Added reusable buffer code

2018-10-29 Thread kumarvishal09
Github user kumarvishal09 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2872#discussion_r228915419 --- Diff: core/src/main/java/org/apache/carbondata/core/datastore/page/ColumnPageByteUtil.java --- @@ -0,0 +1,49 @@ +/* + * Licensed to

[GitHub] carbondata issue #2868: [CARBONDATA-3052] Improve drop table performance by ...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2868 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1330/ ---

[GitHub] carbondata issue #2872: [WIP] Added reusable buffer code

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2872 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1327/ ---

[GitHub] carbondata issue #2874: [CARBONDATA-3053][Cli] Fix bugs for carbon-cli found...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2874 Build Failed with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9384/ ---

[GitHub] carbondata pull request #2876: [CARBONDATA-3054] Fix Dictionary file cannot ...

2018-10-29 Thread ajantha-bhat
GitHub user ajantha-bhat opened a pull request: https://github.com/apache/carbondata/pull/2876 [CARBONDATA-3054] Fix Dictionary file cannot be read in S3a with CarbonDictionaryDecoder.doConsume() codeGen [CARBONDATA-3054] Fix Dictionary file cannot be read in S3a with

[GitHub] carbondata issue #2876: [CARBONDATA-3054] Fix Dictionary file cannot be read...

2018-10-29 Thread ajantha-bhat
Github user ajantha-bhat commented on the issue: https://github.com/apache/carbondata/pull/2876 @ravipesala , @kunal642 : please review ---

[GitHub] carbondata issue #2852: [CARBONDATA-3042] Column Schema objects are present ...

2018-10-29 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2852 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9381/ ---

[GitHub] carbondata pull request #2872: [WIP] Added reusable buffer code

2018-10-29 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2872#discussion_r228902627 --- Diff: core/src/main/java/org/apache/carbondata/core/datastore/page/ColumnPageByteUtil.java --- @@ -0,0 +1,49 @@ +/* + * Licensed to the

[GitHub] carbondata pull request #2872: [WIP] Added reusable buffer code

2018-10-29 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2872#discussion_r228901408 --- Diff: core/src/main/java/org/apache/carbondata/core/datastore/compression/ZstdCompressor.java --- @@ -167,4 +167,12 @@ public long

[jira] [Created] (CARBONDATA-3054) Dictionary file cannot be read in S3a with CarbonDictionaryDecoder.doConsume() codeGen

2018-10-29 Thread Ajantha Bhat (JIRA)
Ajantha Bhat created CARBONDATA-3054: Summary: Dictionary file cannot be read in S3a with CarbonDictionaryDecoder.doConsume() codeGen Key: CARBONDATA-3054 URL:

  1   2   >