Re: [PR] [MINOR] Fixed naming of methods in HoodieMetadataConfig [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11076: URL: https://github.com/apache/hudi/pull/11076#issuecomment-2072523610 ## CI report: * f597f95d19d0f09176efcb358f3d1980efc7f946 Azure:

Re: [PR] [HUDI-7653] Refactor HoodieFileIndex for more flexibility [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11074: URL: https://github.com/apache/hudi/pull/11074#issuecomment-2072523463 ## CI report: * c45d96645dd48aff96aa199693937c2d99c1ace0 Azure:

Re: [PR] [HUDI-7653] Refactor HoodieFileIndex for more flexibility [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11074: URL: https://github.com/apache/hudi/pull/11074#issuecomment-2072493453 ## CI report: * c45d96645dd48aff96aa199693937c2d99c1ace0 Azure:

(hudi) branch master updated: [HUDI-7653] Refactor HoodieFileIndex for more flexibility (#11074)

2024-04-23 Thread codope
This is an automated email from the ASF dual-hosted git repository. codope pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new cb6eb6785fd [HUDI-7653] Refactor HoodieFileIndex

[jira] [Updated] (HUDI-7653) Refactor HoodieFileIndex for more flexibility

2024-04-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7653: -- Labels: hudi-1.0.0-beta2 pull-request-available (was: pull-request-available) > Refactor

[jira] [Updated] (HUDI-7653) Refactor HoodieFileIndex for more flexibility

2024-04-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7653: -- Status: Patch Available (was: In Progress) > Refactor HoodieFileIndex for more flexibility >

[jira] [Updated] (HUDI-7653) Refactor HoodieFileIndex for more flexibility

2024-04-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7653: -- Fix Version/s: 1.0.0 > Refactor HoodieFileIndex for more flexibility >

[jira] [Closed] (HUDI-7653) Refactor HoodieFileIndex for more flexibility

2024-04-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7653. - Resolution: Done > Refactor HoodieFileIndex for more flexibility >

Re: [PR] [HUDI-7653] Refactor HoodieFileIndex for more flexibility [hudi]

2024-04-23 Thread via GitHub
codope merged PR #11074: URL: https://github.com/apache/hudi/pull/11074 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] [HUDI-7652] Add new `HoodieMergeKey` API to support simple and composite keys [hudi]

2024-04-23 Thread via GitHub
codope opened a new pull request, #11077: URL: https://github.com/apache/hudi/pull/11077 ### Change Logs This PR introduces a new class hierarchy for handling merge keys in a more flexible and decoupled manner. It adds the `HoodieMergeKey` interface, along with two implementations:

[jira] [Updated] (HUDI-7652) Add new MergeKey API to support simple and composite keys

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7652: - Labels: hudi-1.0.0-beta2 pull-request-available (was: hudi-1.0.0-beta2) > Add new MergeKey API

Re: [PR] [HUDI-7652] Add new `HoodieMergeKey` API to support simple and composite keys [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11077: URL: https://github.com/apache/hudi/pull/11077#issuecomment-2072997601 ## CI report: * 19a23e39e15d2818d28956959dc00f09bc51 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7146] [RFC-77] RFC for secondary index [hudi]

2024-04-23 Thread via GitHub
codope commented on code in PR #10814: URL: https://github.com/apache/hudi/pull/10814#discussion_r1576637313 ## rfc/rfc-77/rfc-77.md: ## @@ -0,0 +1,323 @@ + + +# RFC-77: Secondary Indexes + +## Proposers + +- @bhat-vinay +- @codope + +## Approvers + - @vinothchandar + -

Re: [PR] [HUDI-7146] [RFC-77] RFC for secondary index [hudi]

2024-04-23 Thread via GitHub
codope commented on code in PR #10814: URL: https://github.com/apache/hudi/pull/10814#discussion_r1576637885 ## rfc/rfc-77/rfc-77.md: ## @@ -0,0 +1,323 @@ + + +# RFC-77: Secondary Indexes + +## Proposers + +- @bhat-vinay +- @codope + +## Approvers + - @vinothchandar + -

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2071510989 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 1b754dffcc5dc2f82c62de06ed9d037ac201d194 Azure:

Re: [PR] [MINOR] Fix incorrect catch of ClassCastException using HoodieSparkKeyGeneratorFactory [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11062: URL: https://github.com/apache/hudi/pull/11062#issuecomment-2071512201 ## CI report: * f97bf7a9acdc086a5ada79c743b983c11947c3af UNKNOWN * a4faddba433d5e454cd409b2818cad6da4c46c32 Azure:

Re: [PR] [HUDI-6386] Enable testArchivalWithMultiWriters back as they are passing [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #9085: URL: https://github.com/apache/hudi/pull/9085#issuecomment-2071614427 ## CI report: * c818a7209bc320f3248f6ef5ea28fbf7358ccb8e Azure:

Re: [PR] [MINOR] Fix incorrect catch of ClassCastException using HoodieSparkKeyGeneratorFactory [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11062: URL: https://github.com/apache/hudi/pull/11062#issuecomment-2071494457 ## CI report: * f97bf7a9acdc086a5ada79c743b983c11947c3af UNKNOWN * a4faddba433d5e454cd409b2818cad6da4c46c32 Azure:

[jira] [Updated] (HUDI-7639) Refactor HoodieFileIndex so that different indexes can be used via optimizer rules

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7639: - Labels: pull-request-available (was: ) > Refactor HoodieFileIndex so that different indexes can

[PR] [HUDI-7639] Refactor HoodieFileIndex so that different indexes can be used via optimizer rules [hudi]

2024-04-23 Thread via GitHub
wombatu-kun opened a new pull request, #11074: URL: https://github.com/apache/hudi/pull/11074 ### Change Logs Task: https://issues.apache.org/jira/browse/HUDI-7639 Created new abstract class SparkBaseIndexSupport with abstract methods `getIndexName`, `isIndexAvailable`,

Re: [PR] [MINOR] Fix incorrect catch of ClassCastException using HoodieSparkKeyGeneratorFactory [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11062: URL: https://github.com/apache/hudi/pull/11062#issuecomment-2071503255 ## CI report: * f97bf7a9acdc086a5ada79c743b983c11947c3af UNKNOWN * a4faddba433d5e454cd409b2818cad6da4c46c32 Azure:

[jira] [Updated] (HUDI-7639) Refactor HoodieFileIndex so that different indexes can be used via optimizer rules

2024-04-23 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7639: Status: In Progress (was: Open) > Refactor HoodieFileIndex so that different indexes can be used

Re: [PR] [MINOR] Fix incorrect catch of ClassCastException using HoodieSparkKeyGeneratorFactory [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11062: URL: https://github.com/apache/hudi/pull/11062#issuecomment-2071617519 ## CI report: * f97bf7a9acdc086a5ada79c743b983c11947c3af UNKNOWN * a4faddba433d5e454cd409b2818cad6da4c46c32 Azure:

Re: [PR] [HUDI-7656] Disable a flaky test [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11078: URL: https://github.com/apache/hudi/pull/11078#issuecomment-2073406841 ## CI report: * ff7ab8d5c15cd2311b0cf0bd6eaa2f5061fc8db3 Azure:

Re: [PR] [HUDI-7657] Disable a flaky test in deltastreamer [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11079: URL: https://github.com/apache/hudi/pull/11079#issuecomment-2073406892 ## CI report: * bd68c36702ebde586b9f57bf1d36c3751b91e61a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7652] Add new `HoodieMergeKey` API to support simple and composite keys [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11077: URL: https://github.com/apache/hudi/pull/11077#issuecomment-2073101141 ## CI report: * 19a23e39e15d2818d28956959dc00f09bc51 Azure:

Re: [PR] [MINOR] Streamer test setup performance [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #10806: URL: https://github.com/apache/hudi/pull/10806#issuecomment-2073287758 ## CI report: * e0414708ebbd734156c0383cb4e5dbfe5ff4151a UNKNOWN * 11c19fa8fd39ed058a4e3487c99c793610b61564 UNKNOWN * d9f583043f1a5ffd532d613b2ce95aa7a8fddc47 Azure:

Re: [PR] [HUDI-7652] Add new `HoodieMergeKey` API to support simple and composite keys [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11077: URL: https://github.com/apache/hudi/pull/11077#issuecomment-2073013071 ## CI report: * 19a23e39e15d2818d28956959dc00f09bc51 Azure:

[jira] [Created] (HUDI-7655) Support configuration for clean to fail execution if there is at least one file is marked as a failed delete

2024-04-23 Thread Krishen Bhan (Jira)
Krishen Bhan created HUDI-7655: -- Summary: Support configuration for clean to fail execution if there is at least one file is marked as a failed delete Key: HUDI-7655 URL:

[jira] [Created] (HUDI-7656) Disable TestCOWDataSource.testCopyOnWriteConcurrentUpdates

2024-04-23 Thread Lin Liu (Jira)
Lin Liu created HUDI-7656: - Summary: Disable TestCOWDataSource.testCopyOnWriteConcurrentUpdates Key: HUDI-7656 URL: https://issues.apache.org/jira/browse/HUDI-7656 Project: Apache Hudi Issue Type:

[PR] [HUDI-7657] Disable a flaky test in deltastreamer [hudi]

2024-04-23 Thread via GitHub
linliu-code opened a new pull request, #11079: URL: https://github.com/apache/hudi/pull/11079 ### Change Logs Disable test: TestHoodieDeltaStreamer.testAutoGenerateRecordKeys ### Impact Less test coverage temporarily. ### Risk level (write none, low medium or high

[jira] [Updated] (HUDI-7657) disable flaky: TestHoodieDeltaStreamer.testAutoGenerateRecordKeys

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7657: - Labels: pull-request-available (was: ) > disable flaky:

Re: [PR] [MINOR] Streamer test setup performance [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #10806: URL: https://github.com/apache/hudi/pull/10806#issuecomment-2073275371 ## CI report: * e0414708ebbd734156c0383cb4e5dbfe5ff4151a UNKNOWN * 11c19fa8fd39ed058a4e3487c99c793610b61564 UNKNOWN * d9f583043f1a5ffd532d613b2ce95aa7a8fddc47 Azure:

[PR] [HUDI-7656] Disable a flaky test [hudi]

2024-04-23 Thread via GitHub
linliu-code opened a new pull request, #11078: URL: https://github.com/apache/hudi/pull/11078 ### Change Logs Disable test: TestCOWDataSource.testCopyOnWriteConcurrentUpdates ### Impact Less coverage temporarily. ### Risk level (write none, low medium or high

[jira] [Updated] (HUDI-7656) Disable TestCOWDataSource.testCopyOnWriteConcurrentUpdates

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7656: - Labels: pull-request-available (was: ) > Disable

[jira] [Created] (HUDI-7657) disable flaky: TestHoodieDeltaStreamer.testAutoGenerateRecordKeys

2024-04-23 Thread Lin Liu (Jira)
Lin Liu created HUDI-7657: - Summary: disable flaky: TestHoodieDeltaStreamer.testAutoGenerateRecordKeys Key: HUDI-7657 URL: https://issues.apache.org/jira/browse/HUDI-7657 Project: Apache Hudi Issue

Re: [PR] [HUDI-7656] Disable a flaky test [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11078: URL: https://github.com/apache/hudi/pull/11078#issuecomment-2073394659 ## CI report: * ff7ab8d5c15cd2311b0cf0bd6eaa2f5061fc8db3 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[jira] [Updated] (HUDI-7658) Log time taken when meta sync fails in stream sync

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7658: - Labels: pull-request-available (was: ) > Log time taken when meta sync fails in stream sync >

[PR] [HUDI-7658] add time to meta sync failure log [hudi]

2024-04-23 Thread via GitHub
jonvex opened a new pull request, #11080: URL: https://github.com/apache/hudi/pull/11080 ### Change Logs log the time taken when meta sync fails ### Impact more consistent logging between success an failure ### Risk level (write none, low medium or high below)

[jira] [Created] (HUDI-7659) Update 0.14.0 release docs to call out that row writer w/ clustering is enabled by default

2024-04-23 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-7659: - Summary: Update 0.14.0 release docs to call out that row writer w/ clustering is enabled by default Key: HUDI-7659 URL: https://issues.apache.org/jira/browse/HUDI-7659

[PR] [HUDI-7651] Add util methods for creating meta client [hudi]

2024-04-23 Thread via GitHub
yihua opened a new pull request, #11081: URL: https://github.com/apache/hudi/pull/11081 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performance

[jira] [Updated] (HUDI-7651) Add util methods for creating meta client

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7651: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Add util methods for

Re: [PR] [HUDI-7651] Add util methods for creating meta client [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11081: URL: https://github.com/apache/hudi/pull/11081#issuecomment-2073709014 ## CI report: * 3e1310ac3eceed725bc829bceb8a9dcbc81e4512 Azure:

Re: [PR] [HUDI-7596] Enable Jacoco code coverage report across multiple modules [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11073: URL: https://github.com/apache/hudi/pull/11073#issuecomment-2073708946 ## CI report: * 39c44a33eaae3bc17270cec93536ce727daacd98 UNKNOWN * c59ca7c5f11aad7435129f97904d8a2a6d958b03 Azure:

Re: [PR] [HUDI-7648] Refactor MetadataPartitionType so as to enahance reuse [hudi]

2024-04-23 Thread via GitHub
danny0405 commented on code in PR #11067: URL: https://github.com/apache/hudi/pull/11067#discussion_r1577074792 ## hudi-common/src/main/java/org/apache/hudi/metadata/MetadataPartitionType.java: ## @@ -70,6 +92,19 @@ public static Set getAllPartitionPaths() {

Re: [PR] [HUDI-7648] Refactor MetadataPartitionType so as to enahance reuse [hudi]

2024-04-23 Thread via GitHub
danny0405 commented on code in PR #11067: URL: https://github.com/apache/hudi/pull/11067#discussion_r1577074559 ## hudi-common/src/main/java/org/apache/hudi/metadata/MetadataPartitionType.java: ## @@ -18,30 +18,52 @@ package org.apache.hudi.metadata; +import

Re: [PR] [HUDI-7596] Enable Jacoco code coverage report across multiple modules [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11073: URL: https://github.com/apache/hudi/pull/11073#issuecomment-2073811600 ## CI report: * 39c44a33eaae3bc17270cec93536ce727daacd98 UNKNOWN * acdbe5f086b556febb77425596685670229451e7 Azure:

Re: [PR] [HUDI-7651] Add util methods for creating meta client [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11081: URL: https://github.com/apache/hudi/pull/11081#issuecomment-2073811653 ## CI report: * 3e6fcaaa1aaac9cf83bf410772a2690afc913bce UNKNOWN * be718668e54ed3235ec45dd2147cd514048b1945 Azure:

Re: [PR] [HUDI-7648] Refactor MetadataPartitionType so as to enahance reuse [hudi]

2024-04-23 Thread via GitHub
jonvex commented on code in PR #11067: URL: https://github.com/apache/hudi/pull/11067#discussion_r1577049959 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java: ## @@ -167,21 +167,15 @@ protected

Re: [PR] [HUDI-7651] Add util methods for creating meta client [hudi]

2024-04-23 Thread via GitHub
danny0405 commented on code in PR #11081: URL: https://github.com/apache/hudi/pull/11081#discussion_r1577097199 ## hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.java: ## @@ -584,6 +585,39 @@ public static HoodieTableMetaClient

Re: [PR] [HUDI-7651] Add util methods for creating meta client [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11081: URL: https://github.com/apache/hudi/pull/11081#issuecomment-2073828849 ## CI report: * 3e6fcaaa1aaac9cf83bf410772a2690afc913bce UNKNOWN * be718668e54ed3235ec45dd2147cd514048b1945 Azure:

[jira] [Updated] (HUDI-7652) Add new MergeKey API to support simple and composite keys

2024-04-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7652: -- Reviewers: Danny Chen, Ethan Guo > Add new MergeKey API to support simple and composite keys >

[PR] [HUDI-7632] Remove FileSystem usage in HoodieLogFormatWriter [hudi]

2024-04-23 Thread via GitHub
wombatu-kun opened a new pull request, #11082: URL: https://github.com/apache/hudi/pull/11082 ### Change Logs Removed FileSystem usage in HoodieLogFormatWriter by adding methods to HoodieStorage API `getDefaultBufferSize()`, `getDefaultReplication()`, `create(StoragePath path,

[jira] [Updated] (HUDI-7632) Remove FileSystem usage in HoodieLogFormatWriter

2024-04-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7632: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Remove FileSystem usage in

Re: [PR] [HUDI-7658] add time to meta sync failure log [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11080: URL: https://github.com/apache/hudi/pull/11080#issuecomment-2073591022 ## CI report: * 0d9301d153f8878a582bfe973a0aaa60ae6b0af9 Azure:

Re: [PR] [HUDI-7651] Add util methods for creating meta client [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11081: URL: https://github.com/apache/hudi/pull/11081#issuecomment-2073659591 ## CI report: * 3e1310ac3eceed725bc829bceb8a9dcbc81e4512 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7658] add time to meta sync failure log [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11080: URL: https://github.com/apache/hudi/pull/11080#issuecomment-2073659533 ## CI report: * 0d9301d153f8878a582bfe973a0aaa60ae6b0af9 Azure:

Re: [PR] [HUDI-7651] Add util methods for creating meta client [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11081: URL: https://github.com/apache/hudi/pull/11081#issuecomment-2073701612 ## CI report: * 3e1310ac3eceed725bc829bceb8a9dcbc81e4512 Azure:

[jira] [Updated] (HUDI-7651) Add util methods for creating meta client

2024-04-23 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7651: Story Points: 4 (was: 1) > Add util methods for creating meta client >

[jira] [Updated] (HUDI-7651) Add util methods for creating meta client

2024-04-23 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7651: Status: Patch Available (was: In Progress) > Add util methods for creating meta client >

[jira] [Updated] (HUDI-7651) Add util methods for creating meta client

2024-04-23 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7651: Sprint: Sprint 2024-03-25 > Add util methods for creating meta client >

[jira] [Updated] (HUDI-7588) Replace hadoop Configuration with StorageConfiguration in hudi-common module

2024-04-23 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7588: Status: Patch Available (was: In Progress) > Replace hadoop Configuration with StorageConfiguration in

[jira] [Updated] (HUDI-7651) Add util methods for creating meta client

2024-04-23 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7651: Epic Link: HUDI-6243 > Add util methods for creating meta client >

Re: [PR] [HUDI-7648] Refactor MetadataPartitionType so as to enahance reuse [hudi]

2024-04-23 Thread via GitHub
danny0405 commented on code in PR #11067: URL: https://github.com/apache/hudi/pull/11067#discussion_r1577076390 ## hudi-common/src/test/java/org/apache/hudi/metadata/TestMetadataPartitionType.java: ## @@ -0,0 +1,122 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

(hudi) branch master updated: [MINOR] Fixe naming of methods in HoodieMetadataConfig (#11076)

2024-04-23 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new c17f50dbbfc [MINOR] Fixe naming of methods in

Re: [PR] [MINOR] Fixed naming of methods in HoodieMetadataConfig [hudi]

2024-04-23 Thread via GitHub
danny0405 merged PR #11076: URL: https://github.com/apache/hudi/pull/11076 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7652] Add new `HoodieMergeKey` API to support simple and composite keys [hudi]

2024-04-23 Thread via GitHub
danny0405 commented on code in PR #11077: URL: https://github.com/apache/hudi/pull/11077#discussion_r1577086360 ## hudi-common/src/main/java/org/apache/hudi/common/model/HoodieMergeKey.java: ## @@ -0,0 +1,48 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] [HUDI-7651] Add util methods for creating meta client [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11081: URL: https://github.com/apache/hudi/pull/11081#issuecomment-2073803021 ## CI report: * 3e6fcaaa1aaac9cf83bf410772a2690afc913bce UNKNOWN * be718668e54ed3235ec45dd2147cd514048b1945 Azure:

Re: [PR] [HUDI-4732] Add support for confluent schema registry with proto [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11070: URL: https://github.com/apache/hudi/pull/11070#issuecomment-2073802830 ## CI report: * c250cc04340a016a04878a7647d4b27a608e7374 Azure:

Re: [PR] [HUDI-7596] Enable Jacoco code coverage report across multiple modules [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11073: URL: https://github.com/apache/hudi/pull/11073#issuecomment-2073802939 ## CI report: * 39c44a33eaae3bc17270cec93536ce727daacd98 UNKNOWN * acdbe5f086b556febb77425596685670229451e7 Azure:

[jira] [Updated] (HUDI-7651) Add util methods for creating meta client

2024-04-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7651: -- Reviewers: Sagar Sumit > Add util methods for creating meta client >

Re: [PR] [HUDI-7658] add time to meta sync failure log [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11080: URL: https://github.com/apache/hudi/pull/11080#issuecomment-2073885067 ## CI report: * 0d9301d153f8878a582bfe973a0aaa60ae6b0af9 Azure:

Re: [PR] [HUDI-7656] Disable a flaky test [hudi]

2024-04-23 Thread via GitHub
linliu-code closed pull request #11078: [HUDI-7656] Disable a flaky test URL: https://github.com/apache/hudi/pull/11078 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [HUDI-7657] Disable a flaky test in deltastreamer [hudi]

2024-04-23 Thread via GitHub
linliu-code closed pull request #11079: [HUDI-7657] Disable a flaky test in deltastreamer URL: https://github.com/apache/hudi/pull/11079 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [HUDI-7658] add time to meta sync failure log [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11080: URL: https://github.com/apache/hudi/pull/11080#issuecomment-2073583735 ## CI report: * 0d9301d153f8878a582bfe973a0aaa60ae6b0af9 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7658] add time to meta sync failure log [hudi]

2024-04-23 Thread via GitHub
yihua commented on code in PR #11080: URL: https://github.com/apache/hudi/pull/11080#discussion_r1576980964 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/streamer/StreamSync.java: ## @@ -1026,27 +1026,32 @@ public void runMetaSync() { Map failedMetaSyncs =

Re: [PR] [HUDI-7651] Add util methods for creating meta client [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11081: URL: https://github.com/apache/hudi/pull/11081#issuecomment-2073722586 ## CI report: * 3e1310ac3eceed725bc829bceb8a9dcbc81e4512 Azure:

[jira] [Comment Edited] (HUDI-7596) Enable Jacoco code coverage report across multiple modules

2024-04-23 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838411#comment-17838411 ] Danny Chen edited comment on HUDI-7596 at 4/24/24 12:38 AM: The link jacoco

Re: [PR] [HUDI-4732] Add support for confluent schema registry with proto [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11070: URL: https://github.com/apache/hudi/pull/11070#issuecomment-2073722347 ## CI report: * c250cc04340a016a04878a7647d4b27a608e7374 Azure:

Re: [PR] [HUDI-7648] Refactor MetadataPartitionType so as to enahance reuse [hudi]

2024-04-23 Thread via GitHub
danny0405 commented on code in PR #11067: URL: https://github.com/apache/hudi/pull/11067#discussion_r1577078330 ## hudi-common/src/test/java/org/apache/hudi/metadata/TestMetadataPartitionType.java: ## @@ -0,0 +1,122 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [I] A bug when RocksDBDAO executes the prefixDelete function to delete the last entry [hudi]

2024-04-23 Thread via GitHub
danny0405 commented on issue #11075: URL: https://github.com/apache/hudi/issues/11075#issuecomment-2073782944 Is this a bug from real production use case or just a code reviewing? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [HUDI-7596] Enable Jacoco code coverage report across multiple modules [hudi]

2024-04-23 Thread via GitHub
danny0405 commented on PR #11073: URL: https://github.com/apache/hudi/pull/11073#issuecomment-2073797993 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [HUDI-7651] Add util methods for creating meta client [hudi]

2024-04-23 Thread via GitHub
danny0405 commented on code in PR #11081: URL: https://github.com/apache/hudi/pull/11081#discussion_r1577095513 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/index/RunIndexActionExecutor.java: ## @@ -157,7 +157,8 @@ public Option execute() {

Re: [PR] [HUDI-4732] Add support for confluent schema registry with proto [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11070: URL: https://github.com/apache/hudi/pull/11070#issuecomment-2073879258 ## CI report: * 1ce1316840852fa8e21363100f6ce695a5ecf0a7 Azure:

Re: [PR] [HUDI-7596] Enable Jacoco code coverage report across multiple modules [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11073: URL: https://github.com/apache/hudi/pull/11073#issuecomment-2073879293 ## CI report: * 39c44a33eaae3bc17270cec93536ce727daacd98 UNKNOWN * acdbe5f086b556febb77425596685670229451e7 Azure:

Re: [PR] [HUDI-7651] Add util methods for creating meta client [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11081: URL: https://github.com/apache/hudi/pull/11081#issuecomment-2073879336 ## CI report: * 3e6fcaaa1aaac9cf83bf410772a2690afc913bce UNKNOWN * 694488f2df3181678a49d136170e2fd9729b45b4 Azure:

Re: [PR] [HUDI-7658] add time to meta sync failure log [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11080: URL: https://github.com/apache/hudi/pull/11080#issuecomment-2073891560 ## CI report: * 0d9301d153f8878a582bfe973a0aaa60ae6b0af9 Azure:

Re: [PR] [MINOR] Streamer test setup performance [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #10806: URL: https://github.com/apache/hudi/pull/10806#issuecomment-2073481386 ## CI report: * e0414708ebbd734156c0383cb4e5dbfe5ff4151a UNKNOWN * 11c19fa8fd39ed058a4e3487c99c793610b61564 UNKNOWN * b6faa0ddf78a193ed8cdb1ce8eb14ae49016a105 Azure:

Re: [PR] [HUDI-7657] Disable a flaky test in deltastreamer [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #11079: URL: https://github.com/apache/hudi/pull/11079#issuecomment-2073482219 ## CI report: * bd68c36702ebde586b9f57bf1d36c3751b91e61a Azure:

[jira] [Updated] (HUDI-7658) Log time taken when meta sync fails in stream sync

2024-04-23 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7658: -- Status: Patch Available (was: In Progress) > Log time taken when meta sync fails in stream

[jira] [Created] (HUDI-7658) Log time taken when meta sync fails in stream sync

2024-04-23 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7658: - Summary: Log time taken when meta sync fails in stream sync Key: HUDI-7658 URL: https://issues.apache.org/jira/browse/HUDI-7658 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-7658) Log time taken when meta sync fails in stream sync

2024-04-23 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7658: -- Status: In Progress (was: Open) > Log time taken when meta sync fails in stream sync >

[jira] [Assigned] (HUDI-7658) Log time taken when meta sync fails in stream sync

2024-04-23 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reassigned HUDI-7658: - Assignee: Jonathan Vexler > Log time taken when meta sync fails in stream sync >

(hudi) branch master updated: [HUDI-7647] READ_UTC_TIMEZONE doesn't affect log files for MOR tables (#11066)

2024-04-23 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new ce0c2671a0a [HUDI-7647] READ_UTC_TIMEZONE

Re: [PR] [HUDI-7647] READ_UTC_TIMEZONE doesn't affect log files for MOR tables [hudi]

2024-04-23 Thread via GitHub
danny0405 merged PR #11066: URL: https://github.com/apache/hudi/pull/11066 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Closed] (HUDI-7647) READ_UTC_TIMEZONE doesn't affect log files for MOR tables

2024-04-23 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-7647. Resolution: Fixed Fixed via master branch: ce0c2671a0a5e010173e0e6caf9c21ca2f175a30 > READ_UTC_TIMEZONE

[jira] [Assigned] (HUDI-7647) READ_UTC_TIMEZONE doesn't affect log files for MOR tables

2024-04-23 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen reassigned HUDI-7647: Assignee: Danny Chen > READ_UTC_TIMEZONE doesn't affect log files for MOR tables >

[jira] [Updated] (HUDI-7652) Add new MergeKey API to support simple and composite keys

2024-04-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7652: -- Status: In Progress (was: Open) > Add new MergeKey API to support simple and composite keys >

[jira] [Updated] (HUDI-7652) Add new MergeKey API to support simple and composite keys

2024-04-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7652: -- Status: Patch Available (was: In Progress) > Add new MergeKey API to support simple and composite keys

Re: [I] A bug when RocksDBDAO executes the prefixDelete function to delete the last entry [hudi]

2024-04-23 Thread via GitHub
MicroGery commented on issue #11075: URL: https://github.com/apache/hudi/issues/11075#issuecomment-2073932313 > Is this a bug from real production use case or just a code reviewing? Just a code reviewing -- This is an automated message from the Apache Git Service. To respond to the

  1   2   >