[jira] [Updated] (CARBONDATA-3858) Increase the parallelism of CDC intermediate files processing

2020-06-18 Thread Xingjun Hao (Jira)
[ https://issues.apache.org/jira/browse/CARBONDATA-3858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingjun Hao updated CARBONDATA-3858: Summary: Increase the parallelism of CDC intermediate files processing (was: Increase

[GitHub] [carbondata] Indhumathi27 commented on pull request #3776: [CARBONDATA-3834]Segment directory and the segment file in metadata are not created for partitioned table when 'carbon.merge.index.i

2020-06-18 Thread GitBox
Indhumathi27 commented on pull request #3776: URL: https://github.com/apache/carbondata/pull/3776#issuecomment-64696 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [carbondata] Indhumathi27 commented on pull request #3792: [CARBONDATA-3856] Support the LIMIT operator for show segments command

2020-06-18 Thread GitBox
Indhumathi27 commented on pull request #3792: URL: https://github.com/apache/carbondata/pull/3792#issuecomment-646429823 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] Store Size Optimization

2020-06-18 Thread GitBox
CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-646116733 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1447/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] Store Size Optimization

2020-06-18 Thread GitBox
CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-646113706 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3172/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3793: [CARBONDATA-3858] Increase the parallelism of CDC deltafiles processing

2020-06-18 Thread GitBox
CarbonDataQA1 commented on pull request #3793: URL: https://github.com/apache/carbondata/pull/3793#issuecomment-646097526 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3171/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3793: [CARBONDATA-3858] Increase the parallelism of CDC deltafiles processing

2020-06-18 Thread GitBox
CarbonDataQA1 commented on pull request #3793: URL: https://github.com/apache/carbondata/pull/3793#issuecomment-646096200 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1445/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3792: [CARBONDATA-3856] Support the LIMIT operator for show segments command

2020-06-18 Thread GitBox
CarbonDataQA1 commented on pull request #3792: URL: https://github.com/apache/carbondata/pull/3792#issuecomment-646020176 Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1444/

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3792: [CARBONDATA-3856] Support the LIMIT operator for show segments command

2020-06-18 Thread GitBox
CarbonDataQA1 commented on pull request #3792: URL: https://github.com/apache/carbondata/pull/3792#issuecomment-646019412 Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3169/ -

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] Store Size Optimization

2020-06-18 Thread GitBox
CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-646009456 Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1446/

[GitHub] [carbondata] marchpure opened a new pull request #3793: [CARBONDATA-3858] Increase the parallelism of CDC deltafiles processing

2020-06-18 Thread GitBox
marchpure opened a new pull request #3793: URL: https://github.com/apache/carbondata/pull/3793 ### Why is this PR needed? In the CDC flow. the parallelism of processing deltafiles is the same as executor number. The insufficient parallelism limits CDC's performance. ### What ch

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3789: [WIP] Store Size Optimization

2020-06-18 Thread GitBox
CarbonDataQA1 commented on pull request #3789: URL: https://github.com/apache/carbondata/pull/3789#issuecomment-646006463 Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3170/ -

[jira] [Created] (CARBONDATA-3858) Increase the parallelism of CDC deltafiles processing

2020-06-18 Thread Xingjun Hao (Jira)
Xingjun Hao created CARBONDATA-3858: --- Summary: Increase the parallelism of CDC deltafiles processing Key: CARBONDATA-3858 URL: https://issues.apache.org/jira/browse/CARBONDATA-3858 Project: CarbonDat

[GitHub] [carbondata] Indhumathi27 commented on a change in pull request #3792: [CARBONDATA-3856] Support the LIMIT operator for show segments command

2020-06-18 Thread GitBox
Indhumathi27 commented on a change in pull request #3792: URL: https://github.com/apache/carbondata/pull/3792#discussion_r442174299 ## File path: docs/segment-management-on-carbondata.md ## @@ -54,6 +54,12 @@ concept which helps to maintain consistency of data and easy transac

[GitHub] [carbondata] Indhumathi27 commented on a change in pull request #3792: [CARBONDATA-3856] Support the LIMIT operator for show segments command

2020-06-18 Thread GitBox
Indhumathi27 commented on a change in pull request #3792: URL: https://github.com/apache/carbondata/pull/3792#discussion_r442174299 ## File path: docs/segment-management-on-carbondata.md ## @@ -54,6 +54,12 @@ concept which helps to maintain consistency of data and easy transac

[GitHub] [carbondata] marchpure commented on a change in pull request #3792: [CARBONDATA-3856] Support the LIMIT operator for show segments command

2020-06-18 Thread GitBox
marchpure commented on a change in pull request #3792: URL: https://github.com/apache/carbondata/pull/3792#discussion_r442154411 ## File path: docs/segment-management-on-carbondata.md ## @@ -54,6 +54,12 @@ concept which helps to maintain consistency of data and easy transactio

[GitHub] [carbondata] marchpure commented on a change in pull request #3792: [CARBONDATA-3856] Support the LIMIT operator for show segments command

2020-06-18 Thread GitBox
marchpure commented on a change in pull request #3792: URL: https://github.com/apache/carbondata/pull/3792#discussion_r442151742 ## File path: integration/spark/src/test/scala/org/apache/carbondata/spark/testsuite/segment/ShowSegmentTestCase.scala ## @@ -191,7 +214,11 @@ class

[GitHub] [carbondata] Indhumathi27 commented on a change in pull request #3792: [CARBONDATA-3856] Support the LIMIT operator for show segments command

2020-06-18 Thread GitBox
Indhumathi27 commented on a change in pull request #3792: URL: https://github.com/apache/carbondata/pull/3792#discussion_r442128902 ## File path: docs/segment-management-on-carbondata.md ## @@ -54,6 +54,12 @@ concept which helps to maintain consistency of data and easy transac

[jira] [Created] (CARBONDATA-3857) Implement delete and update feature in carbondata SDK.

2020-06-18 Thread Karanpreet Singh (Jira)
Karanpreet Singh created CARBONDATA-3857: Summary: Implement delete and update feature in carbondata SDK. Key: CARBONDATA-3857 URL: https://issues.apache.org/jira/browse/CARBONDATA-3857 Project