Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-24 Thread via GitHub
bvaradar merged PR #10336: URL: https://github.com/apache/hudi/pull/10336 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-23 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2071510989 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 1b754dffcc5dc2f82c62de06ed9d037ac201d194 Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-22 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2071438237 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 47b68030e7be96d99cf7790b7836051c3958c1ca Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-22 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2071430162 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 47b68030e7be96d99cf7790b7836051c3958c1ca Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-17 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2060632818 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 47b68030e7be96d99cf7790b7836051c3958c1ca Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-17 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2060537918 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 5edeb0f1a9a1db3ba3df651a8f39a2459d7d4f21 Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-17 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2060524449 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 5edeb0f1a9a1db3ba3df651a8f39a2459d7d4f21 Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-17 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2060442988 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 5edeb0f1a9a1db3ba3df651a8f39a2459d7d4f21 Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-16 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2060364623 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 1bb5e222b29e392a69ef2ff0a4c990ba0ad7219d Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-16 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2060357745 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 1bb5e222b29e392a69ef2ff0a4c990ba0ad7219d Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-05 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2040753004 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 1bb5e222b29e392a69ef2ff0a4c990ba0ad7219d Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-05 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2040651358 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 0656fa60257ac3e8d5b6d3a4e5b47d6d12d20a03 Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-05 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2040642100 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 0656fa60257ac3e8d5b6d3a4e5b47d6d12d20a03 Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-03 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2033837320 ## CI report: * de49a9da9db751d6fd6e0eaa1a750f8726a55018 UNKNOWN * 0656fa60257ac3e8d5b6d3a4e5b47d6d12d20a03 Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-03 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2033723564 ## CI report: * 7f685a6be410a7e8516b6de32f692395723783a6 Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-03 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2033711605 ## CI report: * 7f685a6be410a7e8516b6de32f692395723783a6 Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-03 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2033649461 ## CI report: * 7f685a6be410a7e8516b6de32f692395723783a6 Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-03 Thread via GitHub
bvaradar commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2033642031 > @vinishjail97 : Can you address these comments and land it. Updated the diff after addressing review comments. -- This is an automated message from the Apache Git Service. To

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-03 Thread via GitHub
bvaradar commented on code in PR #10336: URL: https://github.com/apache/hudi/pull/10336#discussion_r1548893991 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/IncrSourceHelper.java: ## @@ -183,7 +183,8 @@ public static Pair>> filterAndGen

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-02 Thread via GitHub
bvaradar commented on code in PR #10336: URL: https://github.com/apache/hudi/pull/10336#discussion_r1548893991 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/IncrSourceHelper.java: ## @@ -183,7 +183,8 @@ public static Pair>> filterAndGen

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2024-04-01 Thread via GitHub
bvaradar commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-2030335892 @vinishjail97 : Can you address these comments and land it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2023-12-15 Thread via GitHub
bvaradar commented on code in PR #10336: URL: https://github.com/apache/hudi/pull/10336#discussion_r1428393493 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/GcsEventsHoodieIncrSource.java: ## @@ -181,8 +181,8 @@ public Pair>, String> fetchNextBatch(Option

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2023-12-15 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-1858356051 ## CI report: * 7f685a6be410a7e8516b6de32f692395723783a6 Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2023-12-15 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-1858196885 ## CI report: * 7f685a6be410a7e8516b6de32f692395723783a6 Azure:

Re: [PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2023-12-15 Thread via GitHub
hudi-bot commented on PR #10336: URL: https://github.com/apache/hudi/pull/10336#issuecomment-1858178502 ## CI report: * 7f685a6be410a7e8516b6de32f692395723783a6 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[PR] [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental Source [hudi]

2023-12-15 Thread via GitHub
vinishjail97 opened a new pull request, #10336: URL: https://github.com/apache/hudi/pull/10336 ### Change Logs Fix bug in checkpointing logic for S3/GCS in empty dataset use-case. The reason for the bug was following. 1st delta commit's checkpoint, processed 3 files. ```