[jira] [Created] (CARBONDATA-3870) Global lock impact the performance of the concurrent query

David Cai created CARBONDATA-3870: - Summary: Global lock impact the performance of the concurrent query Key: CARBONDATA-3870 URL: https://issues.apache.org/jira/browse/CARBONDATA-3870 Project: Carbon

[GitHub] [carbondata] asfgit closed pull request #3799: [CARBONDATA-3862] Insert stage performance optimazation

asfgit closed pull request #3799: URL: https://github.com/apache/carbondata/pull/3799 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3802: Delete Stale Segment files from Metadata folders when SI segments are deleted and added case for compaction in SILoadEventListenerF

CarbonDataQA1 commented on pull request #3802: URL: https://github.com/apache/carbondata/pull/3802#issuecomment-648696512 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3201/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3802: Delete Stale Segment files from Metadata folders when SI segments are deleted and added case for compaction in SILoadEventListenerF

CarbonDataQA1 commented on pull request #3802: URL: https://github.com/apache/carbondata/pull/3802#issuecomment-648697533 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1475/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3803: During Concurrent loads in main table with SI table with isSITableEnabled = false, one of the concurrent load fails

CarbonDataQA1 commented on pull request #3803: URL: https://github.com/apache/carbondata/pull/3803#issuecomment-648698402 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1476/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3803: During Concurrent loads in main table with SI table with isSITableEnabled = false, one of the concurrent load fails

CarbonDataQA1 commented on pull request #3803: URL: https://github.com/apache/carbondata/pull/3803#issuecomment-648699905 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3202/ -

[GitHub] [carbondata] kevinjmh opened a new pull request #3804: [CARBONDATA-3871] Optimize performance when getting row from heap

kevinjmh opened a new pull request #3804: URL: https://github.com/apache/carbondata/pull/3804 ### Why is this PR needed? Currently carbon uses priority queue to sort holders of sorted rows. It first polls a holder from the heap, and adds it back if holder is not empty. This wi

[jira] [Created] (CARBONDATA-3871) Optimize performance when getting row from heap

Manhua Jiang created CARBONDATA-3871: Summary: Optimize performance when getting row from heap Key: CARBONDATA-3871 URL: https://issues.apache.org/jira/browse/CARBONDATA-3871 Project: CarbonData

[GitHub] [carbondata] QiangCai opened a new pull request #3805: [CARBONDATA-3870] Optimize global lock to object lock for CarbonEnv.init

QiangCai opened a new pull request #3805: URL: https://github.com/apache/carbondata/pull/3805 ### Why is this PR needed? global lock of CarbonEnv.init impacts the performance of the concurrent query. ### What changes were proposed in this PR? 1. Optimize global lock to obje

[jira] [Created] (CARBONDATA-3872) IndexOutOfBoundsException in ResizableArray

SeaAndHill created CARBONDATA-3872: -- Summary: IndexOutOfBoundsException in ResizableArray Key: CARBONDATA-3872 URL: https://issues.apache.org/jira/browse/CARBONDATA-3872 Project: CarbonData

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] [CARBONDATA-3864] Store Size Optimization

CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-648729525 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3203/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] [CARBONDATA-3864] Store Size Optimization

CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-648730477 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1477/

[GitHub] [carbondata] ajantha-bhat commented on pull request #3801: adding comments with issue numbers.

ajantha-bhat commented on pull request #3801: URL: https://github.com/apache/carbondata/pull/3801#issuecomment-648758304 add to whitelist This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [carbondata] ajantha-bhat commented on pull request #3801: adding comments with issue numbers.

ajantha-bhat commented on pull request #3801: URL: https://github.com/apache/carbondata/pull/3801#issuecomment-648759885 @ackelcn : Its a good tool that you have. But inside IDE, simple annotate can tell the changes are from which PR. I personally feel, adding the issue ID is not good

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3801: adding comments with issue numbers.

CarbonDataQA1 commented on pull request #3801: URL: https://github.com/apache/carbondata/pull/3801#issuecomment-648760295 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1480/

[GitHub] [carbondata] ajantha-bhat commented on pull request #3785: [CARBONDATA-3843] Fix merge index issue in streaming table

ajantha-bhat commented on pull request #3785: URL: https://github.com/apache/carbondata/pull/3785#issuecomment-648760375 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [carbondata] ajantha-bhat commented on pull request #3770: [CARBONDATA-3829] Support pagination in SDK reader

ajantha-bhat commented on pull request #3770: URL: https://github.com/apache/carbondata/pull/3770#issuecomment-648760696 @akashrn5 , @xubo245 , @jack86596 : reminder ! This is an automated message from the Apache Git

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3801: adding comments with issue numbers.

CarbonDataQA1 commented on pull request #3801: URL: https://github.com/apache/carbondata/pull/3801#issuecomment-648760641 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3206/ -

[GitHub] [carbondata] ajantha-bhat commented on pull request #3770: [CARBONDATA-3829] Support pagination in SDK reader

ajantha-bhat commented on pull request #3770: URL: https://github.com/apache/carbondata/pull/3770#issuecomment-648760782 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [carbondata] ajantha-bhat commented on a change in pull request #3771: [CARBONDATA-3849] pushdown array_contains filter to carbon for array of primitive types

ajantha-bhat commented on a change in pull request #3771: URL: https://github.com/apache/carbondata/pull/3771#discussion_r444824720 ## File path: core/src/main/java/org/apache/carbondata/core/scan/filter/executer/RowLevelFilterExecuterImpl.java ## @@ -222,49 +228,103 @@ public

[GitHub] [carbondata] ajantha-bhat commented on a change in pull request #3771: [CARBONDATA-3849] pushdown array_contains filter to carbon for array of primitive types

ajantha-bhat commented on a change in pull request #3771: URL: https://github.com/apache/carbondata/pull/3771#discussion_r44482 ## File path: integration/spark/src/main/scala/org/apache/spark/sql/execution/strategy/CarbonLateDecodeStrategy.scala ## @@ -679,18 +681,20 @@ pr

[GitHub] [carbondata] ajantha-bhat commented on pull request #3771: [CARBONDATA-3849] pushdown array_contains filter to carbon for array of primitive types

ajantha-bhat commented on pull request #3771: URL: https://github.com/apache/carbondata/pull/3771#issuecomment-648763485 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3804: [CARBONDATA-3871] Optimize performance when getting row from heap

CarbonDataQA1 commented on pull request #3804: URL: https://github.com/apache/carbondata/pull/3804#issuecomment-648767888 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3204/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3804: [CARBONDATA-3871] Optimize performance when getting row from heap

CarbonDataQA1 commented on pull request #3804: URL: https://github.com/apache/carbondata/pull/3804#issuecomment-648768762 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1478/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3805: [CARBONDATA-3870] Optimize global lock to object lock for CarbonEnv.init

CarbonDataQA1 commented on pull request #3805: URL: https://github.com/apache/carbondata/pull/3805#issuecomment-648771222 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1479/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3805: [CARBONDATA-3870] Optimize global lock to object lock for CarbonEnv.init

CarbonDataQA1 commented on pull request #3805: URL: https://github.com/apache/carbondata/pull/3805#issuecomment-648772216 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3205/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] [CARBONDATA-3864] Store Size Optimization

CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-648826450 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1481/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3785: [CARBONDATA-3843] Fix merge index issue in streaming table

CarbonDataQA1 commented on pull request #3785: URL: https://github.com/apache/carbondata/pull/3785#issuecomment-648826422 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3209/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] [CARBONDATA-3864] Store Size Optimization

CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-648826642 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3207/ -

[GitHub] [carbondata] Indhumathi27 commented on pull request #3789: [WIP] [CARBONDATA-3864] Store Size Optimization

Indhumathi27 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-648828392 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3785: [CARBONDATA-3843] Fix merge index issue in streaming table

CarbonDataQA1 commented on pull request #3785: URL: https://github.com/apache/carbondata/pull/3785#issuecomment-648829424 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1482/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3770: [CARBONDATA-3829] Support pagination in SDK reader

CarbonDataQA1 commented on pull request #3770: URL: https://github.com/apache/carbondata/pull/3770#issuecomment-648830470 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1483/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3770: [CARBONDATA-3829] Support pagination in SDK reader

CarbonDataQA1 commented on pull request #3770: URL: https://github.com/apache/carbondata/pull/3770#issuecomment-648835883 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3210/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3771: [CARBONDATA-3849] pushdown array_contains filter to carbon for array of primitive types

CarbonDataQA1 commented on pull request #3771: URL: https://github.com/apache/carbondata/pull/3771#issuecomment-648837271 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1484/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3771: [CARBONDATA-3849] pushdown array_contains filter to carbon for array of primitive types

CarbonDataQA1 commented on pull request #3771: URL: https://github.com/apache/carbondata/pull/3771#issuecomment-648838314 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3211/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] [CARBONDATA-3864] Store Size Optimization

CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-648909599 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3212/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] [CARBONDATA-3864] Store Size Optimization

CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-648912506 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1485/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3784: [CARBONDATA-3841] Remove useless string in create and alter command

CarbonDataQA1 commented on pull request #3784: URL: https://github.com/apache/carbondata/pull/3784#issuecomment-648945566 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3213/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3804: [CARBONDATA-3871] Optimize performance when getting row from heap

CarbonDataQA1 commented on pull request #3804: URL: https://github.com/apache/carbondata/pull/3804#issuecomment-648946730 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3214/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3784: [CARBONDATA-3841] Remove useless string in create and alter command

CarbonDataQA1 commented on pull request #3784: URL: https://github.com/apache/carbondata/pull/3784#issuecomment-648947398 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1487/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3804: [CARBONDATA-3871] Optimize performance when getting row from heap

CarbonDataQA1 commented on pull request #3804: URL: https://github.com/apache/carbondata/pull/3804#issuecomment-648949038 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1486/

[GitHub] [carbondata] chenliang613 opened a new pull request #3806: Update build status to spark 2.4

chenliang613 opened a new pull request #3806: URL: https://github.com/apache/carbondata/pull/3806 ### Why is this PR needed? ### What changes were proposed in this PR? ### Does this PR introduce any user interface change? - No - Yes. (please explain the

[jira] [Updated] (CARBONDATA-3855) Support Carbondata SDK to load data from parquet, ORC, CSV, Avro and JSON.

[ https://issues.apache.org/jira/browse/CARBONDATA-3855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nihal kumar ojha updated CARBONDATA-3855: - Attachment: (was: CarbonData SDK support load from file .pdf) > Support

[jira] [Updated] (CARBONDATA-3855) Support Carbondata SDK to load data from parquet, ORC, CSV, Avro and JSON.

[ https://issues.apache.org/jira/browse/CARBONDATA-3855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nihal kumar ojha updated CARBONDATA-3855: - Attachment: CarbonData SDK support load from file.pdf > Support Carbondata S

[GitHub] [carbondata] asfgit merged pull request #3806: Update build status to spark 2.4

asfgit merged pull request #3806: URL: https://github.com/apache/carbondata/pull/3806 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [carbondata] asfgit closed pull request #3806: Update build status to spark 2.4

asfgit closed pull request #3806: URL: https://github.com/apache/carbondata/pull/3806 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3806: Update build status to spark 2.4

CarbonDataQA1 commented on pull request #3806: URL: https://github.com/apache/carbondata/pull/3806#issuecomment-649233717 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3216/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3806: Update build status to spark 2.4

CarbonDataQA1 commented on pull request #3806: URL: https://github.com/apache/carbondata/pull/3806#issuecomment-649235654 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1489/