[GitHub] [hudi] hudi-bot commented on pull request #4933: [MINOR] RFC-38 markdown content error

hudi-bot commented on pull request #4933: URL: https://github.com/apache/hudi/pull/4933#issuecomment-1056506093 ## CI report: * 4d630f47e4eb049a11a0c3d7b89ca225020c66ff UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] liujinhui1994 opened a new pull request #4933: [MINOR] RFC-38 markdown content error

liujinhui1994 opened a new pull request #4933: URL: https://github.com/apache/hudi/pull/4933 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Assigned] (HUDI-2137) Make hudi examples runnable locally

[ https://issues.apache.org/jira/browse/HUDI-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang reassigned HUDI-2137: -- Assignee: Xianghu Wang > Make hudi examples runnable locally >

[GitHub] [hudi] fisser001 commented on issue #4887: [SUPPORT] Unexpected behaviour with partitioned hudi tables with impala as query engine

fisser001 commented on issue #4887: URL: https://github.com/apache/hudi/issues/4887#issuecomment-1056483661 Hi @garyli1019: I have run the queries again and checked the logs. There are no errors visible in the logs. The query simply does not find any data. But this does not seem to be an

[GitHub] [hudi] hudi-bot removed a comment on pull request #4930: [HUDI-3525] Introduce JsonkafkaSourcePostProcessor to support data preprocess before it is transformed to DataSet

hudi-bot removed a comment on pull request #4930: URL: https://github.com/apache/hudi/pull/4930#issuecomment-1056357002 ## CI report: * 902d714fb5f9cc1344603b460b29fe8d70bdb32a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4930: [HUDI-3525] Introduce JsonkafkaSourcePostProcessor to support data preprocess before it is transformed to DataSet

hudi-bot commented on pull request #4930: URL: https://github.com/apache/hudi/pull/4930#issuecomment-1056455960 ## CI report: * b31e57b6d3c2981e72c164f9844c82ff9b87ec68 Azure:

[hudi] branch master updated (85f47b5 -> 10d866f)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 85f47b5 [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds (#4866) add

[jira] [Resolved] (HUDI-3315) Make Flink MOR table writer in a streaming way

[ https://issues.apache.org/jira/browse/HUDI-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-3315. -- > Make Flink MOR table writer in a streaming way > -- > >

[jira] [Commented] (HUDI-3315) Make Flink MOR table writer in a streaming way

[ https://issues.apache.org/jira/browse/HUDI-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499928#comment-17499928 ] Danny Chen commented on HUDI-3315: -- Fixed via master branch: 10d866f083248d37923d694165e362a21f3d529d >

[jira] [Updated] (HUDI-3315) Make Flink MOR table writer in a streaming way

[ https://issues.apache.org/jira/browse/HUDI-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-3315: - Fix Version/s: 0.11.0 > Make Flink MOR table writer in a streaming way >

[GitHub] [hudi] danny0405 merged pull request #4679: [HUDI-3315] RFC-35 Part-1 Support bucket index in Flink writer

danny0405 merged pull request #4679: URL: https://github.com/apache/hudi/pull/4679 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4932: [HUDI-3069] compact improve

hudi-bot removed a comment on pull request #4932: URL: https://github.com/apache/hudi/pull/4932#issuecomment-1056419769 ## CI report: * 4c33fc175ac3efd0664e9e3fceba89c7493a7a45 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot

[GitHub] [hudi] hudi-bot commented on pull request #4932: [HUDI-3069] compact improve

hudi-bot commented on pull request #4932: URL: https://github.com/apache/hudi/pull/4932#issuecomment-1056426886 ## CI report: * 4c33fc175ac3efd0664e9e3fceba89c7493a7a45 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4932: [HUDI-3069] compact improve

hudi-bot commented on pull request #4932: URL: https://github.com/apache/hudi/pull/4932#issuecomment-1056419769 ## CI report: * 4c33fc175ac3efd0664e9e3fceba89c7493a7a45 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] scxwhite commented on pull request #4932: [HUDI-3069] compact improve

scxwhite commented on pull request #4932: URL: https://github.com/apache/hudi/pull/4932#issuecomment-1056414893 old pr : https://github.com/apache/hudi/pull/4400 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] scxwhite opened a new pull request #4932: [HUDI-3069] compact improve

scxwhite opened a new pull request #4932: URL: https://github.com/apache/hudi/pull/4932 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] scxwhite closed pull request #4400: [HUDI-3069] compact improve

scxwhite closed pull request #4400: URL: https://github.com/apache/hudi/pull/4400 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] scxwhite commented on pull request #4400: [HUDI-3069] compact improve

scxwhite commented on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1056404213 Very sorry, my fault, there was a problem with the merge. I will split it into two PRs and resubmit. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hudi] hudi-bot removed a comment on pull request #4400: [HUDI-3069] compact improve

hudi-bot removed a comment on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1056398637 ## CI report: * 4fa5ba742fc6e9d5c8be2ea079ac3a5a61ad94d1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4400: [HUDI-3069] compact improve

hudi-bot commented on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1056403518 ## CI report: * d67b33696581e91edeec1edb234f02313f9b8bd0 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1056402660 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c2606dd

[GitHub] [hudi] hudi-bot removed a comment on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot removed a comment on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1056373553 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN *

[GitHub] [hudi] hudi-bot removed a comment on pull request #4400: [HUDI-3069] compact improve

hudi-bot removed a comment on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1056388926 ## CI report: * 4fa5ba742fc6e9d5c8be2ea079ac3a5a61ad94d1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4400: [HUDI-3069] compact improve

hudi-bot commented on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1056398637 ## CI report: * 4fa5ba742fc6e9d5c8be2ea079ac3a5a61ad94d1 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4400: [HUDI-3069] compact improve

hudi-bot removed a comment on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1056384046 ## CI report: * 4fa5ba742fc6e9d5c8be2ea079ac3a5a61ad94d1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4400: [HUDI-3069] compact improve

hudi-bot commented on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1056388926 ## CI report: * 4fa5ba742fc6e9d5c8be2ea079ac3a5a61ad94d1 Azure:

[GitHub] [hudi] scxwhite commented on pull request #4400: [HUDI-3069] compact improve

scxwhite commented on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1056389257 I found that after modifying the reading order of the delta log, HoodieRecordPayload#preCombine may have some problems when compacting (when the orderingVal of the two data is

[GitHub] [hudi] hudi-bot commented on pull request #4400: [HUDI-3069] compact improve

hudi-bot commented on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1056384046 ## CI report: * 4fa5ba742fc6e9d5c8be2ea079ac3a5a61ad94d1 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4400: [HUDI-3069] compact improve

hudi-bot removed a comment on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1042517801 ## CI report: * 4fa5ba742fc6e9d5c8be2ea079ac3a5a61ad94d1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1056373553 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c2606dd

[GitHub] [hudi] hudi-bot removed a comment on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot removed a comment on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1056368928 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN *

[GitHub] [hudi] hudi-bot removed a comment on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot removed a comment on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1056355131 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1056368928 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c2606dd

[GitHub] [hudi] pratyakshsharma commented on pull request #4930: [HUDI-3525] Introduce JsonkafkaSourcePostProcessor to support data preprocess before it is transformed to DataSet

pratyakshsharma commented on pull request #4930: URL: https://github.com/apache/hudi/pull/4930#issuecomment-1056358823 > @pratyakshsharma : Can you assist in reviewing this patch. Ack. Will review it today. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hudi] hudi-bot commented on pull request #4930: [HUDI-3525] Introduce JsonkafkaSourcePostProcessor to support data preprocess before it is transformed to DataSet

hudi-bot commented on pull request #4930: URL: https://github.com/apache/hudi/pull/4930#issuecomment-1056357002 ## CI report: * 902d714fb5f9cc1344603b460b29fe8d70bdb32a Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4930: [HUDI-3525] Introduce JsonkafkaSourcePostProcessor to support data preprocess before it is transformed to DataSet

hudi-bot removed a comment on pull request #4930: URL: https://github.com/apache/hudi/pull/4930#issuecomment-1056352114 ## CI report: * 902d714fb5f9cc1344603b460b29fe8d70bdb32a Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot removed a comment on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055292951 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1056355131 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c2606dd

[GitHub] [hudi] hudi-bot commented on pull request #4930: [HUDI-3525] Introduce JsonkafkaSourcePostProcessor to support data preprocess before it is transformed to DataSet

hudi-bot commented on pull request #4930: URL: https://github.com/apache/hudi/pull/4930#issuecomment-1056352114 ## CI report: * 902d714fb5f9cc1344603b460b29fe8d70bdb32a Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4930: [HUDI-3525] Introduce JsonkafkaSourcePostProcessor to support data preprocess before it is transformed to DataSet

hudi-bot removed a comment on pull request #4930: URL: https://github.com/apache/hudi/pull/4930#issuecomment-1055840859 ## CI report: * 902d714fb5f9cc1344603b460b29fe8d70bdb32a Azure:

[hudi] branch master updated (3b2da9f -> 85f47b5)

This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 3b2da9f [HUDI-2631] In CompactFunction, set up the write schema each time with the latest schema (#4000) add

[GitHub] [hudi] yihua merged pull request #4866: [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds

yihua merged pull request #4866: URL: https://github.com/apache/hudi/pull/4866 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4866: [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds

hudi-bot removed a comment on pull request #4866: URL: https://github.com/apache/hudi/pull/4866#issuecomment-1056212872 ## CI report: * 180ea55d8c08a4933202dbb3cd2cc87b06e0ef3d UNKNOWN * ff1ccbd820c49ed9bfe89c762367d3a3f2b1e33d UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #4866: [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds

hudi-bot commented on pull request #4866: URL: https://github.com/apache/hudi/pull/4866#issuecomment-1056306853 ## CI report: * 180ea55d8c08a4933202dbb3cd2cc87b06e0ef3d UNKNOWN * ff1ccbd820c49ed9bfe89c762367d3a3f2b1e33d UNKNOWN * 95c0c7b9d535751ba540aa2440ad61f0f90d21c6

[jira] [Assigned] (HUDI-3376) Understand the implication of mismatch between metadata table vs FS during clean

[ https://issues.apache.org/jira/browse/HUDI-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-3376: --- Assignee: Yue Zhang (was: Ethan Guo) > Understand the implication of mismatch between metadata

[GitHub] [hudi] hudi-bot removed a comment on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

hudi-bot removed a comment on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1056155790 ## CI report: * 4cd46c8a580bd0e01d4a1bad28d5ad4a72181c3c UNKNOWN * 671d589463b6241bb6b1ffe971b366a621004737 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

hudi-bot commented on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1056288769 ## CI report: * 4cd46c8a580bd0e01d4a1bad28d5ad4a72181c3c UNKNOWN * 671d589463b6241bb6b1ffe971b366a621004737 UNKNOWN * 1f8fa758f993efbea4da161b965c87a30a94852b

[jira] [Assigned] (HUDI-2747) Fix hudi cli metadata commands

[ https://issues.apache.org/jira/browse/HUDI-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-2747: --- Assignee: Yue Zhang (was: Ethan Guo) > Fix hudi cli metadata commands >

[jira] [Updated] (HUDI-2747) Fix hudi cli metadata commands

[ https://issues.apache.org/jira/browse/HUDI-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-2747: Description: Fix hudi cli metadata commands.  Currently when running hudi cli metadata commands locally, it

[GitHub] [hudi] hudi-bot removed a comment on pull request #4866: [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds

hudi-bot removed a comment on pull request #4866: URL: https://github.com/apache/hudi/pull/4866#issuecomment-1056184592 ## CI report: * 180ea55d8c08a4933202dbb3cd2cc87b06e0ef3d UNKNOWN * ff1ccbd820c49ed9bfe89c762367d3a3f2b1e33d UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #4866: [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds

hudi-bot commented on pull request #4866: URL: https://github.com/apache/hudi/pull/4866#issuecomment-1056212872 ## CI report: * 180ea55d8c08a4933202dbb3cd2cc87b06e0ef3d UNKNOWN * ff1ccbd820c49ed9bfe89c762367d3a3f2b1e33d UNKNOWN * 95c0c7b9d535751ba540aa2440ad61f0f90d21c6

[GitHub] [hudi] alexeykudinkin commented on pull request #4866: [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds

alexeykudinkin commented on pull request #4866: URL: https://github.com/apache/hudi/pull/4866#issuecomment-1056208513 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (HUDI-3448) DeltaStreamer process does not exit for HoodieIncrSource when there is exception thrown and spark context is stopped

[ https://issues.apache.org/jira/browse/HUDI-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499887#comment-17499887 ] Harshal Patil commented on HUDI-3448: - [~shivnarayan]  

[GitHub] [hudi] danny0405 commented on pull request #4927: [HUDI-3524] - Docs for basic config page

danny0405 commented on pull request #4927: URL: https://github.com/apache/hudi/pull/4927#issuecomment-1056189689 > @danny0405 @leesf : we are looking to add a separate page for basic set of configs for newbies. Can you guys help w/ some basic configs required for flink engine. The

[GitHub] [hudi] hudi-bot removed a comment on pull request #4866: [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds

hudi-bot removed a comment on pull request #4866: URL: https://github.com/apache/hudi/pull/4866#issuecomment-1056106731 ## CI report: * 180ea55d8c08a4933202dbb3cd2cc87b06e0ef3d UNKNOWN * ff1ccbd820c49ed9bfe89c762367d3a3f2b1e33d UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #4866: [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds

hudi-bot commented on pull request #4866: URL: https://github.com/apache/hudi/pull/4866#issuecomment-1056184592 ## CI report: * 180ea55d8c08a4933202dbb3cd2cc87b06e0ef3d UNKNOWN * ff1ccbd820c49ed9bfe89c762367d3a3f2b1e33d UNKNOWN * 95c0c7b9d535751ba540aa2440ad61f0f90d21c6

[GitHub] [hudi] hudi-bot removed a comment on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

hudi-bot removed a comment on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1056130322 ## CI report: * 4cd46c8a580bd0e01d4a1bad28d5ad4a72181c3c UNKNOWN * 671d589463b6241bb6b1ffe971b366a621004737 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

hudi-bot commented on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1056155790 ## CI report: * 4cd46c8a580bd0e01d4a1bad28d5ad4a72181c3c UNKNOWN * 671d589463b6241bb6b1ffe971b366a621004737 UNKNOWN * ba2c73d0d83cbcba7c7397e3506ff48ac1953dab

[GitHub] [hudi] danny0405 commented on a change in pull request #4880: [HUDI-2752] The MOR DELETE block breaks the event time sequence of CDC

danny0405 commented on a change in pull request #4880: URL: https://github.com/apache/hudi/pull/4880#discussion_r817327210 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/DeleteKey.java ## @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [hudi] danny0405 commented on a change in pull request #4880: [HUDI-2752] The MOR DELETE block breaks the event time sequence of CDC

danny0405 commented on a change in pull request #4880: URL: https://github.com/apache/hudi/pull/4880#discussion_r817327210 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/DeleteKey.java ## @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [hudi] hudi-bot removed a comment on pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

hudi-bot removed a comment on pull request #4480: URL: https://github.com/apache/hudi/pull/4480#issuecomment-1056096125 ## CI report: * c4a2ace5e28fafb29394a1448e1a6c2a0645dda9 UNKNOWN * 56a911718e615762ca5718e79741f8a242355170 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

hudi-bot commented on pull request #4480: URL: https://github.com/apache/hudi/pull/4480#issuecomment-1056141641 ## CI report: * c4a2ace5e28fafb29394a1448e1a6c2a0645dda9 UNKNOWN * 754931ba448157b905feb75c34913919d215e5ab Azure:

[GitHub] [hudi] danny0405 commented on a change in pull request #4880: [HUDI-2752] The MOR DELETE block breaks the event time sequence of CDC

danny0405 commented on a change in pull request #4880: URL: https://github.com/apache/hudi/pull/4880#discussion_r817324704 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestMORDataSource.scala ## @@ -516,17 +516,14 @@ class

[GitHub] [hudi] danny0405 commented on a change in pull request #4880: [HUDI-2752] The MOR DELETE block breaks the event time sequence of CDC

danny0405 commented on a change in pull request #4880: URL: https://github.com/apache/hudi/pull/4880#discussion_r817323774 ## File path: hudi-common/src/test/java/org/apache/hudi/common/functional/TestHoodieLogFormat.java ## @@ -1091,6 +1092,123 @@ public void

[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4880: [HUDI-2752] The MOR DELETE block breaks the event time sequence of CDC

alexeykudinkin commented on a change in pull request #4880: URL: https://github.com/apache/hudi/pull/4880#discussion_r817321720 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/DeleteKey.java ## @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] hudi-bot removed a comment on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

hudi-bot removed a comment on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1054737042 ## CI report: * 4cd46c8a580bd0e01d4a1bad28d5ad4a72181c3c UNKNOWN * 671d589463b6241bb6b1ffe971b366a621004737 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #4907: [WIP][CI Test Only][HUDI-1180] Upgrade HBase to 2.4.9

hudi-bot commented on pull request #4907: URL: https://github.com/apache/hudi/pull/4907#issuecomment-1056130322 ## CI report: * 4cd46c8a580bd0e01d4a1bad28d5ad4a72181c3c UNKNOWN * 671d589463b6241bb6b1ffe971b366a621004737 UNKNOWN * ba2c73d0d83cbcba7c7397e3506ff48ac1953dab

[GitHub] [hudi] danny0405 commented on a change in pull request #4679: [HUDI-3315] RFC-35 Part-1 Support bucket index in Flink writer

danny0405 commented on a change in pull request #4679: URL: https://github.com/apache/hudi/pull/4679#discussion_r817320310 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/utils/Pipelines.java ## @@ -189,21 +191,32 @@ } public static DataStream

[GitHub] [hudi] danny0405 commented on a change in pull request #4679: [HUDI-3315] RFC-35 Part-1 Support bucket index in Flink writer

danny0405 commented on a change in pull request #4679: URL: https://github.com/apache/hudi/pull/4679#discussion_r817319167 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/BucketStreamWriteFunction.java ## @@ -0,0 +1,158 @@ +/* + * Licensed to the Apache Software

[jira] [Resolved] (HUDI-2631) In CompactFunction, set up the write schema each time with the latest schema

[ https://issues.apache.org/jira/browse/HUDI-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2631. -- > In CompactFunction, set up the write schema each time with the latest schema >

[jira] [Commented] (HUDI-2631) In CompactFunction, set up the write schema each time with the latest schema

[ https://issues.apache.org/jira/browse/HUDI-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499875#comment-17499875 ] Danny Chen commented on HUDI-2631: -- Fixed via master branch: 3b2da9f13847475be3dcef13b3d25df8818cecc7 >

[hudi] branch master updated: [HUDI-2631] In CompactFunction, set up the write schema each time with the latest schema (#4000)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 3b2da9f [HUDI-2631] In CompactFunction, set

[GitHub] [hudi] danny0405 merged pull request #4000: [HUDI-2631] In CompactFunction, set up the write schema each time wit…

danny0405 merged pull request #4000: URL: https://github.com/apache/hudi/pull/4000 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated (3fdc933 -> 3cfb52c)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 3fdc933 [HUDI-3516] Implement record iterator for HoodieDataBlock (#4909) add 3cfb52c [MINOR] fix get

[GitHub] [hudi] danny0405 merged pull request #4917: [MINOR] fix get builtin function issue from Hudi catalog

danny0405 merged pull request #4917: URL: https://github.com/apache/hudi/pull/4917 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] danny0405 commented on a change in pull request #4880: [HUDI-2752] The MOR DELETE block breaks the event time sequence of CDC

danny0405 commented on a change in pull request #4880: URL: https://github.com/apache/hudi/pull/4880#discussion_r817310737 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java ## @@ -153,9 +154,29 @@ protected void

[GitHub] [hudi] hudi-bot commented on pull request #4866: [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds

hudi-bot commented on pull request #4866: URL: https://github.com/apache/hudi/pull/4866#issuecomment-1056106731 ## CI report: * 180ea55d8c08a4933202dbb3cd2cc87b06e0ef3d UNKNOWN * ff1ccbd820c49ed9bfe89c762367d3a3f2b1e33d UNKNOWN * 95c0c7b9d535751ba540aa2440ad61f0f90d21c6

[GitHub] [hudi] hudi-bot removed a comment on pull request #4866: [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds

hudi-bot removed a comment on pull request #4866: URL: https://github.com/apache/hudi/pull/4866#issuecomment-1056102883 ## CI report: * 180ea55d8c08a4933202dbb3cd2cc87b06e0ef3d UNKNOWN * ff1ccbd820c49ed9bfe89c762367d3a3f2b1e33d UNKNOWN *

[GitHub] [hudi] alexeykudinkin commented on pull request #4866: [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds

alexeykudinkin commented on pull request #4866: URL: https://github.com/apache/hudi/pull/4866#issuecomment-1056106421 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] danny0405 commented on a change in pull request #4911: [HUDI-3460]Flink TM memory Optimization

danny0405 commented on a change in pull request #4911: URL: https://github.com/apache/hudi/pull/4911#discussion_r817309658 ## File path: hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java ## @@ -459,6 +461,18 @@ private FlinkOptions() { // Compaction

[GitHub] [hudi] danny0405 commented on a change in pull request #4911: [HUDI-3460]Flink TM memory Optimization

danny0405 commented on a change in pull request #4911: URL: https://github.com/apache/hudi/pull/4911#discussion_r817308532 ## File path: hudi-flink/src/main/java/org/apache/hudi/util/StreamerUtil.java ## @@ -507,4 +511,19 @@ public static String

[GitHub] [hudi] hudi-bot removed a comment on pull request #4866: [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds

hudi-bot removed a comment on pull request #4866: URL: https://github.com/apache/hudi/pull/4866#issuecomment-1056052072 ## CI report: * 180ea55d8c08a4933202dbb3cd2cc87b06e0ef3d UNKNOWN * ff1ccbd820c49ed9bfe89c762367d3a3f2b1e33d UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #4866: [HUDI-3469] Refactor `HoodieTestDataGenerator` to provide for reproducible Builds

hudi-bot commented on pull request #4866: URL: https://github.com/apache/hudi/pull/4866#issuecomment-1056102883 ## CI report: * 180ea55d8c08a4933202dbb3cd2cc87b06e0ef3d UNKNOWN * ff1ccbd820c49ed9bfe89c762367d3a3f2b1e33d UNKNOWN * 95c0c7b9d535751ba540aa2440ad61f0f90d21c6

[GitHub] [hudi] danny0405 commented on a change in pull request #4911: [HUDI-3460]Flink TM memory Optimization

danny0405 commented on a change in pull request #4911: URL: https://github.com/apache/hudi/pull/4911#discussion_r817307793 ## File path: hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java ## @@ -459,6 +461,18 @@ private FlinkOptions() { // Compaction

[GitHub] [hudi] danny0405 commented on a change in pull request #4911: [HUDI-3460]Flink TM memory Optimization

danny0405 commented on a change in pull request #4911: URL: https://github.com/apache/hudi/pull/4911#discussion_r817307793 ## File path: hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java ## @@ -459,6 +461,18 @@ private FlinkOptions() { // Compaction

[GitHub] [hudi] danny0405 commented on a change in pull request #4911: [HUDI-3460]Flink TM memory Optimization

danny0405 commented on a change in pull request #4911: URL: https://github.com/apache/hudi/pull/4911#discussion_r817306893 ## File path: hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java ## @@ -459,6 +461,18 @@ private FlinkOptions() { // Compaction

[GitHub] [hudi] hudi-bot removed a comment on pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

hudi-bot removed a comment on pull request #4480: URL: https://github.com/apache/hudi/pull/4480#issuecomment-1056084745 ## CI report: * c4a2ace5e28fafb29394a1448e1a6c2a0645dda9 UNKNOWN * 56a911718e615762ca5718e79741f8a242355170 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

hudi-bot commented on pull request #4480: URL: https://github.com/apache/hudi/pull/4480#issuecomment-1056096125 ## CI report: * c4a2ace5e28fafb29394a1448e1a6c2a0645dda9 UNKNOWN * 56a911718e615762ca5718e79741f8a242355170 Azure:

[GitHub] [hudi] cuibo01 commented on a change in pull request #4911: [HUDI-3460]Flink TM memory Optimization

cuibo01 commented on a change in pull request #4911: URL: https://github.com/apache/hudi/pull/4911#discussion_r817304805 ## File path: hudi-flink/src/test/java/org/apache/hudi/table/TestHoodieTableSource.java ## @@ -64,6 +65,7 @@ void beforeEach() throws Exception {

[GitHub] [hudi] cuibo01 commented on a change in pull request #4911: [HUDI-3460]Flink TM memory Optimization

cuibo01 commented on a change in pull request #4911: URL: https://github.com/apache/hudi/pull/4911#discussion_r817304805 ## File path: hudi-flink/src/test/java/org/apache/hudi/table/TestHoodieTableSource.java ## @@ -64,6 +65,7 @@ void beforeEach() throws Exception {

[GitHub] [hudi] hudi-bot removed a comment on pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

hudi-bot removed a comment on pull request #4480: URL: https://github.com/apache/hudi/pull/4480#issuecomment-1033225969 ## CI report: * c4a2ace5e28fafb29394a1448e1a6c2a0645dda9 UNKNOWN * 56a911718e615762ca5718e79741f8a242355170 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

hudi-bot commented on pull request #4480: URL: https://github.com/apache/hudi/pull/4480#issuecomment-1056084745 ## CI report: * c4a2ace5e28fafb29394a1448e1a6c2a0645dda9 UNKNOWN * 56a911718e615762ca5718e79741f8a242355170 Azure:

[GitHub] [hudi] danny0405 commented on a change in pull request #4911: [HUDI-3460]Flink TM memory Optimization

danny0405 commented on a change in pull request #4911: URL: https://github.com/apache/hudi/pull/4911#discussion_r817302591 ## File path: hudi-flink/src/test/java/org/apache/hudi/table/TestHoodieTableSource.java ## @@ -64,6 +65,7 @@ void beforeEach() throws Exception {

[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

hudi-bot commented on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1056080250 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * cb354756580e1a9b6515ff1c9cc670579a3e70f4

[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

hudi-bot removed a comment on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1056037774 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN *

[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4880: [HUDI-2752] The MOR DELETE block breaks the event time sequence of CDC

alexeykudinkin commented on a change in pull request #4880: URL: https://github.com/apache/hudi/pull/4880#discussion_r817300452 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java ## @@ -153,9 +154,29 @@ protected void

[GitHub] [hudi] danny0405 commented on a change in pull request #4880: [HUDI-2752] The MOR DELETE block breaks the event time sequence of CDC

danny0405 commented on a change in pull request #4880: URL: https://github.com/apache/hudi/pull/4880#discussion_r817300414 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/DeleteKey.java ## @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [hudi] YuweiXiao commented on a change in pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

YuweiXiao commented on a change in pull request #4480: URL: https://github.com/apache/hudi/pull/4480#discussion_r817300071 ## File path: hudi-client/hudi-client-common/src/test/java/org/apache/hudi/index/bucket/TestBucketIdentifier.java ## @@ -0,0 +1,122 @@ +/* + * Licensed

[GitHub] [hudi] danny0405 commented on a change in pull request #4880: [HUDI-2752] The MOR DELETE block breaks the event time sequence of CDC

danny0405 commented on a change in pull request #4880: URL: https://github.com/apache/hudi/pull/4880#discussion_r817298101 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java ## @@ -153,9 +154,29 @@ protected void

[GitHub] [hudi] danny0405 commented on a change in pull request #4880: [HUDI-2752] The MOR DELETE block breaks the event time sequence of CDC

danny0405 commented on a change in pull request #4880: URL: https://github.com/apache/hudi/pull/4880#discussion_r817298101 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java ## @@ -153,9 +154,29 @@ protected void

  1   2   3   4   >