Re: [PR] [HUDI-7641] Adding metadata enablement metrics [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11053: URL: https://github.com/apache/hudi/pull/11053#issuecomment-2067071879 ## CI report: * 3f7d727e83f05cb5ce7f9a3da2bfffca72686345 Azure:

Re: [PR] [HUDI-7641] Adding metadata enablement metrics [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11053: URL: https://github.com/apache/hudi/pull/11053#issuecomment-2067161180 ## CI report: * 3f7d727e83f05cb5ce7f9a3da2bfffca72686345 Azure:

Re: [PR] [HUDI-7641] Adding metadata enablement metrics [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11053: URL: https://github.com/apache/hudi/pull/11053#issuecomment-2067152702 ## CI report: * 3f7d727e83f05cb5ce7f9a3da2bfffca72686345 Azure:

[jira] [Updated] (HUDI-7641) Add metrics to track what partitions are enabled in MDT

2024-04-19 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-7641: -- Fix Version/s: 0.15.0 > Add metrics to track what partitions are enabled in MDT >

Re: [PR] [HUDI-7641] Adding metadata enablement metrics [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11053: URL: https://github.com/apache/hudi/pull/11053#issuecomment-2067283377 ## CI report: * 59d53ba7cc510038dcaea707f434ebc5529b29dc UNKNOWN * ab39be7b9f1d7bf9de4b69640dce50105b6d9147 Azure:

[jira] [Assigned] (HUDI-7641) Add metrics to track what partitions are enabled in MDT

2024-04-19 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-7641: - Assignee: sivabalan narayanan > Add metrics to track what partitions are enabled

Re: [PR] [HUDI-7641] Adding metadata enablement metrics [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11053: URL: https://github.com/apache/hudi/pull/11053#issuecomment-2067081207 ## CI report: * 3f7d727e83f05cb5ce7f9a3da2bfffca72686345 Azure:

Re: [PR] [HUDI-7641] Adding metadata enablement metrics [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11053: URL: https://github.com/apache/hudi/pull/11053#issuecomment-2067143554 ## CI report: * 3f7d727e83f05cb5ce7f9a3da2bfffca72686345 Azure:

Re: [PR] [HUDI-7641] Adding metadata enablement metrics [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11053: URL: https://github.com/apache/hudi/pull/11053#issuecomment-2067215979 ## CI report: * 7d5d983e224a82cbb8b4253f8d9b374cd9e4b9aa Azure:

(hudi) branch master updated (7ac26bce3f3 -> 7a44b1ebc41)

2024-04-19 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 7ac26bce3f3 [HUDI-7643] Fix test by using the right StreamSync constructor (#11056) add 7a44b1ebc41

Re: [PR] [MINOR] Added configurations of Hudi table, file-based SQL source, Hudi error table, and timestamp key generator to configuration listing [hudi]

2024-04-19 Thread via GitHub
danny0405 merged PR #11057: URL: https://github.com/apache/hudi/pull/11057 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(hudi) branch asf-site updated: [DOCS] Added configurations of Hudi table, file-based SQL source, Hudi error table, and timestamp key generator to configuration listing (#11058)

2024-04-19 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new e3894931de4 [DOCS] Added configurations of

(hudi) branch master updated: [MINOR] Added configurations of Hudi table, file-based SQL source, Hudi error table, and timestamp key generator to configuration listing (#11057)

2024-04-19 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 60424c5f998 [MINOR] Added configurations of

Re: [PR] [DOCS] [MINOR] Added configurations of Hudi table, file-based SQL source, Hudi error table, and timestamp key generator to configuration listing [hudi]

2024-04-19 Thread via GitHub
danny0405 merged PR #11058: URL: https://github.com/apache/hudi/pull/11058 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Closed] (HUDI-7515) Fix partition metadata write failure

2024-04-19 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-7515. Resolution: Fixed Fixed via master branch: 7a44b1ebc41ce66621e958df22195524373434c1 > Fix partition

Re: [PR] [HUDI-7515] Fix partition metadata write failure [hudi]

2024-04-19 Thread via GitHub
danny0405 merged PR #10886: URL: https://github.com/apache/hudi/pull/10886 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] [SUPPORT] Some spark writer job failed caused by UserGroupInformation lost in the new thread of timeline service threadpool [hudi]

2024-04-19 Thread via GitHub
beyond1920 closed issue #11030: [SUPPORT] Some spark writer job failed caused by UserGroupInformation lost in the new thread of timeline service threadpool URL: https://github.com/apache/hudi/issues/11030 -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] [SUPPORT] Some spark writer job failed caused by UserGroupInformation lost in the new thread of timeline service threadpool [hudi]

2024-04-19 Thread via GitHub
beyond1920 commented on issue #11030: URL: https://github.com/apache/hudi/issues/11030#issuecomment-2067525049 Resolved by [pr#11039](https://github.com/apache/hudi/pull/11039). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

2024-04-19 Thread Krishen Bhan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7507: --- Description: *Scenarios:* Although HUDI operations hold a table lock when creating a .requested

Re: [PR] [HUDI-7628] Rename FSUtils.getPartitionPath to constructAbsolutePath [hudi]

2024-04-19 Thread via GitHub
yihua merged PR #11054: URL: https://github.com/apache/hudi/pull/11054 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(hudi) branch master updated: [HUDI-7628] Rename FSUtils.getPartitionPath to constructAbsolutePath (#11054)

2024-04-19 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 683c4998d6d [HUDI-7628] Rename

Re: [PR] [HUDI-7515] Fix partition metadata write failure [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #10886: URL: https://github.com/apache/hudi/pull/10886#issuecomment-2066077325 ## CI report: * 7b04755aa308766f3b0f0d5292ed9476630da90d Azure:

Re: [PR] [HUDI-7628] Rename FSUtils.getPartitionPath to constructAbsolutePath [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11054: URL: https://github.com/apache/hudi/pull/11054#issuecomment-2066077903 ## CI report: * 0d5781211cbe9977838db3ee7134bc473b6110aa Azure:

[PR] [HUDI-7629] Safely rename HoodieFileStatus [hudi]

2024-04-19 Thread via GitHub
wombatu-kun opened a new pull request, #11055: URL: https://github.com/apache/hudi/pull/11055 ### Change Logs Renamed `HoodieFileStatus` to `StorageLocationInfo`: https://github.com/apache/hudi/pull/10591#discussion_r1484912753 ### Impact none ### Risk level

[jira] [Updated] (HUDI-7629) Safely rename HoodieFileStatus

2024-04-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7629: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Safely rename

Re: [PR] [HUDI-7629] Safely rename HoodieFileStatus [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11055: URL: https://github.com/apache/hudi/pull/11055#issuecomment-2066165390 ## CI report: * 8957421b837bb5471701724e47ae908e0c0655fb UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[PR] [HUDI-7643] Fix test by using the right StreamSync constructor [hudi]

2024-04-19 Thread via GitHub
codope opened a new pull request, #11056: URL: https://github.com/apache/hudi/pull/11056 ### Change Logs `StreamSync` constructor changed after `HoodieStorage` abstraction was introduced and the commit https://github.com/apache/hudi/commit/ca77fda51fe3036f86d4ddb8b0e58a2f160882dc

Re: [PR] [HUDI-7640] Uses UUID as temporary file suffix for HoodieStorage.createImmutableFileInPath [hudi]

2024-04-19 Thread via GitHub
boneanxs commented on code in PR #11052: URL: https://github.com/apache/hudi/pull/11052#discussion_r1571861739 ## hudi-io/src/main/java/org/apache/hudi/storage/HoodieStorage.java: ## @@ -267,7 +270,7 @@ public final void createImmutableFileInPath(StoragePath path, if

[jira] [Updated] (HUDI-7628) Rename FSUtils.getPartitionPath to constructAbsolutePath

2024-04-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7628: Status: In Progress (was: Open) > Rename FSUtils.getPartitionPath to constructAbsolutePath >

Re: [PR] [HUDI-7628] Rename FSUtils.getPartitionPath to constructAbsolutePath [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11054: URL: https://github.com/apache/hudi/pull/11054#issuecomment-2066165313 ## CI report: * 0d5781211cbe9977838db3ee7134bc473b6110aa Azure:

[jira] [Created] (HUDI-7643) Fix TestStreamSyncUnitTests

2024-04-19 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7643: - Summary: Fix TestStreamSyncUnitTests Key: HUDI-7643 URL: https://issues.apache.org/jira/browse/HUDI-7643 Project: Apache Hudi Issue Type: Task

Re: [PR] [HUDI-7515] Fix partition metadata write failure [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #10886: URL: https://github.com/apache/hudi/pull/10886#issuecomment-2066065344 ## CI report: * 7b04755aa308766f3b0f0d5292ed9476630da90d Azure:

Re: [PR] [HUDI-7628] Rename FSUtils.getPartitionPath to constructAbsolutePath [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11054: URL: https://github.com/apache/hudi/pull/11054#issuecomment-2066065953 ## CI report: * 0d5781211cbe9977838db3ee7134bc473b6110aa UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[jira] [Created] (HUDI-7642) Compact MOR tables with operation fields cause data errors

2024-04-19 Thread Zeyu Wang (Jira)
Zeyu Wang created HUDI-7642: --- Summary: Compact MOR tables with operation fields cause data errors Key: HUDI-7642 URL: https://issues.apache.org/jira/browse/HUDI-7642 Project: Apache Hudi Issue

Re: [PR] [HUDI-7515] Fix partition metadata write failure [hudi]

2024-04-19 Thread via GitHub
danny0405 commented on code in PR #10886: URL: https://github.com/apache/hudi/pull/10886#discussion_r1572070120 ## hudi-common/src/main/java/org/apache/hudi/common/model/HoodiePartitionMetadata.java: ## @@ -94,36 +96,32 @@ public int getPartitionDepth() { /** * Write the

Re: [PR] [HUDI-7629] Safely rename HoodieFileStatus [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11055: URL: https://github.com/apache/hudi/pull/11055#issuecomment-2066178297 ## CI report: * 8957421b837bb5471701724e47ae908e0c0655fb Azure:

Re: [PR] [HUDI-7628] Rename FSUtils.getPartitionPath to constructAbsolutePath [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11054: URL: https://github.com/apache/hudi/pull/11054#issuecomment-2066178227 ## CI report: * 0d5781211cbe9977838db3ee7134bc473b6110aa Azure:

[jira] [Updated] (HUDI-7643) Fix TestStreamSyncUnitTests

2024-04-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7643: - Labels: pull-request-available (was: ) > Fix TestStreamSyncUnitTests >

Re: [PR] [HUDI-7629] Safely rename HoodieFileStatus [hudi]

2024-04-19 Thread via GitHub
wombatu-kun commented on PR #11055: URL: https://github.com/apache/hudi/pull/11055#issuecomment-2066223372 i thought the decision was already made as the task https://issues.apache.org/jira/browse/HUDI-7629 was created. @yihua @vinothchandar @danny0405 could you please make a decision

Re: [PR] [HUDI-7618] Add ability to ignore checkpoints in delta streamer [hudi]

2024-04-19 Thread via GitHub
nsivabalan merged PR #11018: URL: https://github.com/apache/hudi/pull/11018 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(hudi) branch master updated: [HUDI-7618] Add ability to ignore checkpoints in delta streamer (#11018)

2024-04-19 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new ca77fda51fe [HUDI-7618] Add ability to ignore

[jira] [Assigned] (HUDI-7630) Create a separate StorageUtils for hadoop-free util method

2024-04-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7630: --- Assignee: Vova Kolmakov > Create a separate StorageUtils for hadoop-free util method >

[jira] [Assigned] (HUDI-7629) Safely rename HoodieFileStatus

2024-04-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7629: --- Assignee: Vova Kolmakov > Safely rename HoodieFileStatus > -- >

[jira] [Assigned] (HUDI-7628) Rename FSUtils.getPartitionPath to constructAbsolutePath

2024-04-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7628: --- Assignee: Vova Kolmakov > Rename FSUtils.getPartitionPath to constructAbsolutePath >

[jira] [Assigned] (HUDI-7631) Clean up usage of `CachingPath` outside hudi-common module

2024-04-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7631: --- Assignee: Vova Kolmakov > Clean up usage of `CachingPath` outside hudi-common module >

[jira] [Updated] (HUDI-7628) Rename FSUtils.getPartitionPath to constructAbsolutePath

2024-04-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7628: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Rename

[PR] [HUDI-7628] Rename FSUtils.getPartitionPath to constructAbsolutePath [hudi]

2024-04-19 Thread via GitHub
wombatu-kun opened a new pull request, #11054: URL: https://github.com/apache/hudi/pull/11054 ### Change Logs https://github.com/apache/hudi/pull/10591#discussion_r1483632718 Rename FSUtils.getPartitionPath to constructAbsolutePath and partitionPath argument to

(hudi) branch master updated: [HUDI-7640] Uses UUID as temporary file suffix for HoodieStorage.createImmutableFileInPath (#11052)

2024-04-19 Thread rexan
This is an automated email from the ASF dual-hosted git repository. rexan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new caa1bef75c3 [HUDI-7640] Uses UUID as temporary

Re: [PR] [HUDI-7640] Uses UUID as temporary file suffix for HoodieStorage.createImmutableFileInPath [hudi]

2024-04-19 Thread via GitHub
boneanxs merged PR #11052: URL: https://github.com/apache/hudi/pull/11052 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Assigned] (HUDI-7632) Remove FileSystem usage in HoodieLogFormatWriter

2024-04-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-7632: --- Assignee: Vova Kolmakov > Remove FileSystem usage in HoodieLogFormatWriter >

[jira] [Updated] (HUDI-7629) Safely rename HoodieFileStatus

2024-04-19 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7629: Status: In Progress (was: Open) > Safely rename HoodieFileStatus > --

Re: [PR] [MINOR] Added configurations of Hudi table, file-based SQL source, Hudi error table, and timestamp key generator to configuration listing [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11057: URL: https://github.com/apache/hudi/pull/11057#issuecomment-2066453700 ## CI report: * d8ab7259a5c4825d6634eebb8610ca072abb4a05 Azure:

Re: [PR] [HUDI-7515] Fix partition metadata write failure [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #10886: URL: https://github.com/apache/hudi/pull/10886#issuecomment-2066536128 ## CI report: * cc4c48076b11d9a97fdb7fd0f6f0a5253d530ff1 Azure:

Re: [PR] [MINOR] Added configurations of Hudi table, file-based SQL source, Hudi error table, and timestamp key generator to configuration listing [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11057: URL: https://github.com/apache/hudi/pull/11057#issuecomment-2066570835 ## CI report: * d8ab7259a5c4825d6634eebb8610ca072abb4a05 Azure:

[PR] [DOCS] [MINOR] Added configurations of Hudi table, file-based SQL source, Hudi error table, and timestamp key generator to configuration listing [hudi]

2024-04-19 Thread via GitHub
geserdugarov opened a new pull request, #11058: URL: https://github.com/apache/hudi/pull/11058 ### Change Logs Updates to the docs. Should be merged only if [MR 11057](https://github.com/apache/hudi/pull/11057) with corresponding code changes will be merged. Not all

Re: [I] [SUPPORT] HudiDeltaStreaming consuming from Kafka - can't see the Kafka Consumer Group in Kafka [hudi]

2024-04-19 Thread via GitHub
Amar1404 commented on issue #11051: URL: https://github.com/apache/hudi/issues/11051#issuecomment-2066436408 Hi @mattssll - The hudiDeltaStream use the concept of checkpoint here instead of consumer group. Here in hoodie commit file it will store the last offset from each partiion it is

Re: [I] If Sanitastiion Enabled In HudiStreamer It is taking too much time [hudi]

2024-04-19 Thread via GitHub
Amar1404 commented on issue #10466: URL: https://github.com/apache/hudi/issues/10466#issuecomment-2066439568 hi @ad1happy2go - Any updates on this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] [MINOR] Added configurations of Hudi table, file-based SQL source, Hudi error table, and timestamp key generator to configuration listing [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11057: URL: https://github.com/apache/hudi/pull/11057#issuecomment-2066442267 ## CI report: * d8ab7259a5c4825d6634eebb8610ca072abb4a05 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7618] Add ability to ignore checkpoints in delta streamer [hudi]

2024-04-19 Thread via GitHub
danny0405 commented on PR #11018: URL: https://github.com/apache/hudi/pull/11018#issuecomment-2066267766 Hey, the master compile got crush with this patch, can you take care of it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [HUDI-7515] Fix partition metadata write failure [hudi]

2024-04-19 Thread via GitHub
danny0405 commented on PR #10886: URL: https://github.com/apache/hudi/pull/10886#issuecomment-2066274001 The master build is broken and here is the fix: https://github.com/apache/hudi/pull/11056, you may need to await for this patch and rebase with the latest master again~ -- This is an

Re: [I] [SUPPORT]Data Loss Issue with Hudi Table After 3 Days of Continuous Writes [hudi]

2024-04-19 Thread via GitHub
danny0405 commented on issue #11016: URL: https://github.com/apache/hudi/issues/11016#issuecomment-2066279351 > but the issue is that we can't access older data. If you table is ingested in streaming `upsert`, then you just specify the `read.start-commit` as the first commit instant

Re: [PR] [HUDI-7515] Fix partition metadata write failure [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #10886: URL: https://github.com/apache/hudi/pull/10886#issuecomment-2066365873 ## CI report: * af5d107b867fd97362710bc032a95743eb5d33a8 Azure:

[PR] [MINOR] Added configurations of Hudi table, file-based SQL source, Hudi error table, and timestamp key generator to configuration listing [hudi]

2024-04-19 Thread via GitHub
geserdugarov opened a new pull request, #11057: URL: https://github.com/apache/hudi/pull/11057 ### Change Logs Not all configurations are presented on [All configurations](https://hudi.apache.org/docs/configurations) page. This MR adds list of basic Hudi table configurations, and

Re: [PR] [HUDI-7515] Fix partition metadata write failure [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #10886: URL: https://github.com/apache/hudi/pull/10886#issuecomment-2066250342 ## CI report: * af5d107b867fd97362710bc032a95743eb5d33a8 Azure:

Re: [PR] [HUDI-7643] Fix test by using the right StreamSync constructor [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11056: URL: https://github.com/apache/hudi/pull/11056#issuecomment-2066274503 ## CI report: * 0dd750741922a580a0c8bee13996f7583f5b98c0 Azure:

Re: [PR] [HUDI-7629] Safely rename HoodieFileStatus [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11055: URL: https://github.com/apache/hudi/pull/11055#issuecomment-2066274445 ## CI report: * 8957421b837bb5471701724e47ae908e0c0655fb Azure:

Re: [PR] [HUDI-7515] Fix partition metadata write failure [hudi]

2024-04-19 Thread via GitHub
wecharyu commented on code in PR #10886: URL: https://github.com/apache/hudi/pull/10886#discussion_r1572163511 ## hudi-common/src/main/java/org/apache/hudi/common/model/HoodiePartitionMetadata.java: ## @@ -94,36 +96,32 @@ public int getPartitionDepth() { /** * Write the

[jira] [Updated] (HUDI-7643) Fix TestStreamSyncUnitTests

2024-04-19 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-7643: - Fix Version/s: 0.15.0 1.0.0 > Fix TestStreamSyncUnitTests >

[jira] [Closed] (HUDI-7643) Fix TestStreamSyncUnitTests

2024-04-19 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-7643. Resolution: Fixed Fixed via master branch: 7ac26bce3f3aad2c9aebeb55febc4375c4f7bd1d > Fix

Re: [PR] [HUDI-7515] Fix partition metadata write failure [hudi]

2024-04-19 Thread via GitHub
danny0405 commented on PR #10886: URL: https://github.com/apache/hudi/pull/10886#issuecomment-2066283997 You can rebase with the latest master now to resolve the compile error. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] [HUDI-7628] Rename FSUtils.getPartitionPath to constructAbsolutePath [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11054: URL: https://github.com/apache/hudi/pull/11054#issuecomment-2066251007 ## CI report: * 0d5781211cbe9977838db3ee7134bc473b6110aa Azure:

Re: [PR] [HUDI-7643] Fix test by using the right StreamSync constructor [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11056: URL: https://github.com/apache/hudi/pull/11056#issuecomment-2066263288 ## CI report: * 0dd750741922a580a0c8bee13996f7583f5b98c0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

(hudi) branch master updated: [HUDI-7643] Fix test by using the right StreamSync constructor (#11056)

2024-04-19 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 7ac26bce3f3 [HUDI-7643] Fix test by using the

Re: [PR] [HUDI-7643] Fix test by using the right StreamSync constructor [hudi]

2024-04-19 Thread via GitHub
danny0405 merged PR #11056: URL: https://github.com/apache/hudi/pull/11056 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7628] Rename FSUtils.getPartitionPath to constructAbsolutePath [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #11054: URL: https://github.com/apache/hudi/pull/11054#issuecomment-2066344280 ## CI report: * 0c8df7c7d066c2115e4a04dabb10fd14a54e40d2 Azure:

Re: [PR] [HUDI-7515] Fix partition metadata write failure [hudi]

2024-04-19 Thread via GitHub
hudi-bot commented on PR #10886: URL: https://github.com/apache/hudi/pull/10886#issuecomment-2066355763 ## CI report: * af5d107b867fd97362710bc032a95743eb5d33a8 Azure:

Re: [I] [SUPPORT] HudiDeltaStreaming consuming from Kafka - can't see the Kafka Consumer Group in Kafka [hudi]

2024-04-19 Thread via GitHub
mattssll closed issue #11051: [SUPPORT] HudiDeltaStreaming consuming from Kafka - can't see the Kafka Consumer Group in Kafka URL: https://github.com/apache/hudi/issues/11051 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and