[GitHub] [hudi] hudi-bot commented on pull request #7468: [HUDI-5394] Fix RowCustomColumnsSortPartitioner

2023-01-06 Thread GitBox
hudi-bot commented on PR #7468: URL: https://github.com/apache/hudi/pull/7468#issuecomment-1373315669 ## CI report: * c4166f0761b7fc3d5905cd8d180df63706ed53a2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7614: [HUDI-5509] check if dfs support atomic creation when using filesyste…

2023-01-06 Thread GitBox
hudi-bot commented on PR #7614: URL: https://github.com/apache/hudi/pull/7614#issuecomment-1373316380 ## CI report: * f24cdfcff263e0ccad4f241477997c45b70abe6b Azure:

[GitHub] [hudi] soumilshah1995 commented on issue #7591: [SUPPORT] Kinesis Data Analytics Flink1.13 to HUDI

2023-01-06 Thread GitBox
soumilshah1995 commented on issue #7591: URL: https://github.com/apache/hudi/issues/7591#issuecomment-1373625630 Hi danny i do not have logs i am using AWS kinesis managed service for Flink i have provided all necessary steps if needed team can replicate the error. please let me know

[GitHub] [hudi] hudi-bot commented on pull request #7468: [HUDI-5394] Fix RowCustomColumnsSortPartitioner

2023-01-06 Thread GitBox
hudi-bot commented on PR #7468: URL: https://github.com/apache/hudi/pull/7468#issuecomment-1373750636 ## CI report: * cbd6e7916ba0093e67b28e2bb2d6877e38f33623 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6732: [HUDI-4148] Add client for hudi table service manager

2023-01-06 Thread GitBox
hudi-bot commented on PR #6732: URL: https://github.com/apache/hudi/pull/6732#issuecomment-1373392309 ## CI report: * af728e3eeb1fd694eba037bc9a48869831ddb053 Azure:

[hudi] branch master updated (f745e645735 -> 3e49e4c26da)

2023-01-06 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from f745e645735 [HUDI-5341] CleanPlanner retains earliest commits must not be later than earliest pending commit (#7568)

[GitHub] [hudi] leesf merged pull request #7611: [HUDI-5506] StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event

2023-01-06 Thread GitBox
leesf merged PR #7611: URL: https://github.com/apache/hudi/pull/7611 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] soumilshah1995 commented on issue #7430: [BUG] MOR Table Hard Deletes Create issue with Athena Querying RT Tables

2023-01-06 Thread GitBox
soumilshah1995 commented on issue #7430: URL: https://github.com/apache/hudi/issues/7430#issuecomment-1373626282 Hi do we have any updates for this Task ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hudi] hudi-bot commented on pull request #6361: [HUDI-4690][HUDI-4503] Cleaning up Hudi custom Spark `Rule`s

2023-01-06 Thread GitBox
hudi-bot commented on PR #6361: URL: https://github.com/apache/hudi/pull/6361#issuecomment-1373748919 ## CI report: * 04d18204862b8eccdb6f3d78b5b4bc91ad1b4915 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7616: [MINOR] fix typo

2023-01-06 Thread GitBox
hudi-bot commented on PR #7616: URL: https://github.com/apache/hudi/pull/7616#issuecomment-1373751141 ## CI report: * 8088f0b69cc12be9ae022be1442ccc3d2500be42 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #6133: [HUDI-1575] Early Conflict Detection For Multi-writer

2023-01-06 Thread GitBox
hudi-bot commented on PR #6133: URL: https://github.com/apache/hudi/pull/6133#issuecomment-1373633366 ## CI report: * dbe3db845908d261baa5a1aa71d19e0db55816de UNKNOWN * 678cce4a9748cb54a90a559384a0cb0443082535 UNKNOWN * 6fc5bf1ce7921bf25acc3659565457264d8b9dc2 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #7618: [MINOR] Polish README and template.md in RFC.

2023-01-06 Thread GitBox
hudi-bot commented on PR #7618: URL: https://github.com/apache/hudi/pull/7618#issuecomment-1373768283 ## CI report: * a8e6918f30422bfbd7f9be740cb05b35609cd9dc UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] wuyouwuyoulian opened a new pull request, #7616: [MINOR] fix typo

2023-01-06 Thread GitBox
wuyouwuyoulian opened a new pull request, #7616: URL: https://github.com/apache/hudi/pull/7616 ### Change Logs fix typo ### Impact fix typo ### Risk level (write none, low medium or high below) none ### Documentation Update none ###

[GitHub] [hudi] MichaelUryukin opened a new issue, #7617: [SUPPORT] Hudi "write" command doesn't fail when on incompatible partition type, but "read" command fails.

2023-01-06 Thread GitBox
MichaelUryukin opened a new issue, #7617: URL: https://github.com/apache/hudi/issues/7617 **Describe the problem you faced** When we write a DF to a Hudi table, which is partitioned by column of a type "date", and the value of one of the rows for this column is NULL, Hudi will

[GitHub] [hudi] jackwener opened a new pull request, #7618: [MINOR] Polish README and template.md in RFC.

2023-01-06 Thread GitBox
jackwener opened a new pull request, #7618: URL: https://github.com/apache/hudi/pull/7618 ### Change Logs Polish the format of `README.md` and `template.md` in RFC. ### Impact N/A ### Risk level (write none, low medium or high below) none ###

[GitHub] [hudi] hudi-bot commented on pull request #7616: [MINOR] fix typo

2023-01-06 Thread GitBox
hudi-bot commented on PR #7616: URL: https://github.com/apache/hudi/pull/7616#issuecomment-1373758095 ## CI report: * 8088f0b69cc12be9ae022be1442ccc3d2500be42 Azure:

[GitHub] [hudi] zhangyue19921010 merged pull request #7616: [MINOR] fix typo

2023-01-06 Thread GitBox
zhangyue19921010 merged PR #7616: URL: https://github.com/apache/hudi/pull/7616 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated: [MINOR] fix typo (#7616)

2023-01-06 Thread zhangyue19921010
This is an automated email from the ASF dual-hosted git repository. zhangyue19921010 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new cf20c95f48d [MINOR] fix typo (#7616)

[GitHub] [hudi] hudi-bot commented on pull request #7615: [HUDI-5510] Reload active timeline when getInstantsToArchive

2023-01-06 Thread GitBox
hudi-bot commented on PR #7615: URL: https://github.com/apache/hudi/pull/7615#issuecomment-1373455830 ## CI report: * 92b37a1e5cd60d7fb5202fdc83308d0abdae63e3 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7608: [HUDI-5503]Optimize flink table factory option check

2023-01-06 Thread GitBox
hudi-bot commented on PR #7608: URL: https://github.com/apache/hudi/pull/7608#issuecomment-1373455720 ## CI report: * f7391999a7868e7c97797823cab078a3e42f0bca Azure:

[GitHub] [hudi] leesf commented on pull request #7611: [HUDI-5506] StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event

2023-01-06 Thread GitBox
leesf commented on PR #7611: URL: https://github.com/apache/hudi/pull/7611#issuecomment-1373568277 Merging as Flink IT passed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Updated] (HUDI-5510) The latest written commit is not used when getInstantsToArchive

2023-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5510: - Labels: pull-request-available (was: ) > The latest written commit is not used when

[GitHub] [hudi] Zouxxyy opened a new pull request, #7615: [HUDI-5510] Reload active timeline when getInstantsToArchive

2023-01-06 Thread GitBox
Zouxxyy opened a new pull request, #7615: URL: https://github.com/apache/hudi/pull/7615 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performance

[GitHub] [hudi] yuzhaojing commented on pull request #6732: [HUDI-4148] Add client for hudi table service manager

2023-01-06 Thread GitBox
yuzhaojing commented on PR #6732: URL: https://github.com/apache/hudi/pull/6732#issuecomment-1373391935 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] hudi-bot commented on pull request #7615: [HUDI-5510] Reload active timeline when getInstantsToArchive

2023-01-06 Thread GitBox
hudi-bot commented on PR #7615: URL: https://github.com/apache/hudi/pull/7615#issuecomment-1373393483 ## CI report: * 92b37a1e5cd60d7fb5202fdc83308d0abdae63e3 Azure:

[GitHub] [hudi] xushiyan merged pull request #7604: [DOCS][MINOR] add File base lock description

2023-01-06 Thread GitBox
xushiyan merged PR #7604: URL: https://github.com/apache/hudi/pull/7604 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch asf-site updated: [DOCS][MINOR] add File base lock description (#7604)

2023-01-06 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 5be0e27689 [DOCS][MINOR] add File base lock

[GitHub] [hudi] SabyasachiDasTR commented on issue #7600: Hoodie clean is not deleting old files for MOR table

2023-01-06 Thread GitBox
SabyasachiDasTR commented on issue #7600: URL: https://github.com/apache/hudi/issues/7600#issuecomment-1373515682 Also we want to understand what is the impact of executing "cleans run" command from cli manually. We have verified compaction and commits are working for the latest time but

[GitHub] [hudi] koochiswathiTR commented on issue #7530: Hudi Log files are increasing in our application day by day

2023-01-06 Thread GitBox
koochiswathiTR commented on issue #7530: URL: https://github.com/apache/hudi/issues/7530#issuecomment-1373523799 @nsivabalan @yihua @dacort @jfrazee Any update on this query? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] hudi-bot commented on pull request #5064: [HUDI-3654] Add new module `hudi-metaserver`

2023-01-06 Thread GitBox
hudi-bot commented on PR #5064: URL: https://github.com/apache/hudi/pull/5064#issuecomment-1373554356 ## CI report: * 53aa21bf23d2f8b0404743e6d016cfb2fac444f7 UNKNOWN * 07a3ea3956e5ce02a33a55eae4a0339796275f9d UNKNOWN * 810af96ee856bd94cfc82b01b67765a735f29c44 UNKNOWN *

[hudi] branch master updated: [HUDI-5341] CleanPlanner retains earliest commits must not be later than earliest pending commit (#7568)

2023-01-06 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new f745e645735 [HUDI-5341] CleanPlanner retains

[GitHub] [hudi] leesf merged pull request #7568: [HUDI-5341] CleanPlanner retains earliest commits must not be later than earliest pending commit

2023-01-06 Thread GitBox
leesf merged PR #7568: URL: https://github.com/apache/hudi/pull/7568 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] leesf closed pull request #7405: [HUDI-5341] IncrementalCleaning consider clustering completed later

2023-01-06 Thread GitBox
leesf closed pull request #7405: [HUDI-5341] IncrementalCleaning consider clustering completed later URL: https://github.com/apache/hudi/pull/7405 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] leesf commented on pull request #7405: [HUDI-5341] IncrementalCleaning consider clustering completed later

2023-01-06 Thread GitBox
leesf commented on PR #7405: URL: https://github.com/apache/hudi/pull/7405#issuecomment-1373346414 closing the PR as we have the PR https://github.com/apache/hudi/pull/7568 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] LinMingQiang commented on a diff in pull request #7440: [HUDI-5377] Write call stack information to lock file

2023-01-06 Thread GitBox
LinMingQiang commented on code in PR #7440: URL: https://github.com/apache/hudi/pull/7440#discussion_r1063247399 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/lock/FileSystemBasedLockProvider.java: ## @@ -139,7 +152,32 @@ private boolean

[GitHub] [hudi] hudi-bot commented on pull request #7615: [HUDI-5510] Reload active timeline when getInstantsToArchive

2023-01-06 Thread GitBox
hudi-bot commented on PR #7615: URL: https://github.com/apache/hudi/pull/7615#issuecomment-1373387673 ## CI report: * 92b37a1e5cd60d7fb5202fdc83308d0abdae63e3 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7615: [HUDI-5510] Reload active timeline when getInstantsToArchive

2023-01-06 Thread GitBox
hudi-bot commented on PR #7615: URL: https://github.com/apache/hudi/pull/7615#issuecomment-1373461327 ## CI report: * 92b37a1e5cd60d7fb5202fdc83308d0abdae63e3 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7568: [HUDI-5341] CleanPlanner retains earliest commits must not be later than earliest pending commit

2023-01-06 Thread GitBox
hudi-bot commented on PR #7568: URL: https://github.com/apache/hudi/pull/7568#issuecomment-1373382131 ## CI report: * d84940b6d979114fb62b54151d792d3db69ca51d Azure:

[jira] [Created] (HUDI-5510) The latest written commit is not used when getInstantsToArchive

2023-01-06 Thread zouxxyy (Jira)
zouxxyy created HUDI-5510: - Summary: The latest written commit is not used when getInstantsToArchive Key: HUDI-5510 URL: https://issues.apache.org/jira/browse/HUDI-5510 Project: Apache Hudi Issue

[GitHub] [hudi] hudi-bot commented on pull request #6732: [HUDI-4148] Add client for hudi table service manager

2023-01-06 Thread GitBox
hudi-bot commented on PR #6732: URL: https://github.com/apache/hudi/pull/6732#issuecomment-1373397662 ## CI report: * af728e3eeb1fd694eba037bc9a48869831ddb053 Azure:

[GitHub] [hudi] zhangyue19921010 commented on pull request #5359: [HUDI-3916] New Key Generator Option: NanoidKeyGenerator

2023-01-06 Thread GitBox
zhangyue19921010 commented on PR #5359: URL: https://github.com/apache/hudi/pull/5359#issuecomment-1373406693 > @zhangyue19921010 Are you still working on this? Do you need any assistance from the community? oooh almost forget this PR Orz... Sorry for that. Will add a benchmark asap.

[GitHub] [hudi] hudi-bot commented on pull request #7611: [HUDI-5506] StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event

2023-01-06 Thread GitBox
hudi-bot commented on PR #7611: URL: https://github.com/apache/hudi/pull/7611#issuecomment-1373551193 ## CI report: * ac296c702417461cedeef6e8974bd48c767a1b1c Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7618: [MINOR] Polish README and template.md in RFC.

2023-01-06 Thread GitBox
hudi-bot commented on PR #7618: URL: https://github.com/apache/hudi/pull/7618#issuecomment-1373869504 ## CI report: * a8e6918f30422bfbd7f9be740cb05b35609cd9dc Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7614: [HUDI-5509] check if dfs support atomic creation when using filesyste…

2023-01-06 Thread GitBox
hudi-bot commented on PR #7614: URL: https://github.com/apache/hudi/pull/7614#issuecomment-1373869430 ## CI report: * f24cdfcff263e0ccad4f241477997c45b70abe6b Azure:

[GitHub] [hudi] nsivabalan commented on a diff in pull request #7605: [HUDI-5349] Clean up partially failed restore

2023-01-06 Thread GitBox
nsivabalan commented on code in PR #7605: URL: https://github.com/apache/hudi/pull/7605#discussion_r1063633199 ## hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/TestClientRollback.java: ## @@ -740,4 +741,117 @@ public void

[GitHub] [hudi] jonvex commented on a diff in pull request #7605: [HUDI-5349] Clean up partially failed restore

2023-01-06 Thread GitBox
jonvex commented on code in PR #7605: URL: https://github.com/apache/hudi/pull/7605#discussion_r1063615487 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java: ## @@ -840,11 +841,25 @@ public boolean rollback(final String

[GitHub] [hudi] nsivabalan merged pull request #7473: [HUDI-5231] Suppress Checkstyle Warnings

2023-01-06 Thread GitBox
nsivabalan merged PR #7473: URL: https://github.com/apache/hudi/pull/7473 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated: [HUDI-5231] suppress checkstyle warnings (#7473)

2023-01-06 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 8ae1e8c6761 [HUDI-5231] suppress checkstyle

[GitHub] [hudi] hudi-bot commented on pull request #6732: [HUDI-4148] Add client for hudi table service manager

2023-01-06 Thread GitBox
hudi-bot commented on PR #6732: URL: https://github.com/apache/hudi/pull/6732#issuecomment-1373960675 ## CI report: * af728e3eeb1fd694eba037bc9a48869831ddb053 Azure:

[GitHub] [hudi] nsivabalan merged pull request #7597: [HUDI-5192] Prevent GH actions from running on trivial file changes

2023-01-06 Thread GitBox
nsivabalan merged PR #7597: URL: https://github.com/apache/hudi/pull/7597 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] nsivabalan commented on a diff in pull request #7605: [HUDI-5349] Clean up partially failed restore

2023-01-06 Thread GitBox
nsivabalan commented on code in PR #7605: URL: https://github.com/apache/hudi/pull/7605#discussion_r1063640166 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/restore/RestoreUtils.java: ## @@ -43,4 +46,24 @@ public static HoodieRestorePlan

[GitHub] [hudi] nsivabalan merged pull request #7535: [MINOR] Fixed some spelling and syntax issues in InternalSchemaUtils

2023-01-06 Thread GitBox
nsivabalan merged PR #7535: URL: https://github.com/apache/hudi/pull/7535 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated: [MINOR] fixed spelling and syntax (#7535)

2023-01-06 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 4e2a5bb488b [MINOR] fixed spelling and syntax

[hudi] branch master updated: [HUDI-5192] add non-code file extensions to ignore list (#7597)

2023-01-06 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new f75671454c9 [HUDI-5192] add non-code file

[GitHub] [hudi] hudi-bot commented on pull request #7585: [MINOR] Extending support to other special characters

2023-01-06 Thread GitBox
hudi-bot commented on PR #7585: URL: https://github.com/apache/hudi/pull/7585#issuecomment-1374038082 ## CI report: * 804591fe22d3afa9b3b365222c67bbf4a1b6e156 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7585: [MINOR] Extending support to other special characters

2023-01-06 Thread GitBox
hudi-bot commented on PR #7585: URL: https://github.com/apache/hudi/pull/7585#issuecomment-1374043600 ## CI report: * 804591fe22d3afa9b3b365222c67bbf4a1b6e156 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6732: [HUDI-4148] Add client for hudi table service manager

2023-01-06 Thread GitBox
hudi-bot commented on PR #6732: URL: https://github.com/apache/hudi/pull/6732#issuecomment-1374042226 ## CI report: * af728e3eeb1fd694eba037bc9a48869831ddb053 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] jonvex commented on a diff in pull request #7605: [HUDI-5349] Clean up partially failed restore

2023-01-06 Thread GitBox
jonvex commented on code in PR #7605: URL: https://github.com/apache/hudi/pull/7605#discussion_r1063758391 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java: ## @@ -840,11 +841,25 @@ public boolean rollback(final String

[GitHub] [hudi] hudi-bot commented on pull request #7615: [HUDI-5510] Reload active timeline when getInstantsToArchive

2023-01-06 Thread GitBox
hudi-bot commented on PR #7615: URL: https://github.com/apache/hudi/pull/7615#issuecomment-1374032879 ## CI report: * 6d63669cac8191009b6fc7df2e9ff768463f00d1 Azure:

[GitHub] [hudi] Shagish commented on issue #7577: [SUPPORT]

2023-01-06 Thread GitBox
Shagish commented on issue #7577: URL: https://github.com/apache/hudi/issues/7577#issuecomment-1374041500 hi @yihua , We have included hoodie.metadata.enable=false and didn't find any further issue. Question - what is the implication if we keep hoodie.metadata.enable=false

[GitHub] [hudi] hudi-bot commented on pull request #6732: [HUDI-4148] Add client for hudi table service manager

2023-01-06 Thread GitBox
hudi-bot commented on PR #6732: URL: https://github.com/apache/hudi/pull/6732#issuecomment-1374047811 ## CI report: * af728e3eeb1fd694eba037bc9a48869831ddb053 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6361: [HUDI-4690][HUDI-4503] Cleaning up Hudi custom Spark `Rule`s

2023-01-06 Thread GitBox
hudi-bot commented on PR #6361: URL: https://github.com/apache/hudi/pull/6361#issuecomment-1374205412 ## CI report: * 04d18204862b8eccdb6f3d78b5b4bc91ad1b4915 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6361: [HUDI-4690][HUDI-4503] Cleaning up Hudi custom Spark `Rule`s

2023-01-06 Thread GitBox
hudi-bot commented on PR #6361: URL: https://github.com/apache/hudi/pull/6361#issuecomment-1374209822 ## CI report: * 04d18204862b8eccdb6f3d78b5b4bc91ad1b4915 Azure:

[jira] [Closed] (HUDI-5508) Revamp hudi homepage website

2023-01-06 Thread nadine (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nadine closed HUDI-5508. Resolution: Fixed > Revamp hudi homepage website > > > Key: HUDI-5508

[jira] [Commented] (HUDI-5508) Revamp hudi homepage website

2023-01-06 Thread nadine (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655597#comment-17655597 ] nadine commented on HUDI-5508: -- closing issue- pr is merged.  > Revamp hudi homepage website >

[GitHub] [hudi] hudi-bot commented on pull request #7585: [MINOR] Extending support to other special characters

2023-01-06 Thread GitBox
hudi-bot commented on PR #7585: URL: https://github.com/apache/hudi/pull/7585#issuecomment-1374334148 ## CI report: * 9feb5f9256e9dae62fa657420b7c4b73af70ef92 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7490: [HUDI-5407] Fixing rollback in MDT to be eager

2023-01-06 Thread GitBox
hudi-bot commented on PR #7490: URL: https://github.com/apache/hudi/pull/7490#issuecomment-1374334066 ## CI report: * f0b791ecbc8da893188991f34490c165dceaf24d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7490: [HUDI-5407] Fixing rollback in MDT to be eager

2023-01-06 Thread GitBox
hudi-bot commented on PR #7490: URL: https://github.com/apache/hudi/pull/7490#issuecomment-1374371039 ## CI report: * 4dbf55bb566e21a4ec857e8c321459eef34900af Azure:

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #6361: [HUDI-4690][HUDI-4503] Cleaning up Hudi custom Spark `Rule`s

2023-01-06 Thread GitBox
alexeykudinkin commented on code in PR #6361: URL: https://github.com/apache/hudi/pull/6361#discussion_r1056726252 ## hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala: ## @@ -57,60 +54,82 @@ object HoodieAnalysis {

[GitHub] [hudi] xushiyan commented on a diff in pull request #7607: [HUDI-5499] Fixing Spark SQL configs not being properly propagated for CTAS and other commands

2023-01-06 Thread GitBox
xushiyan commented on code in PR #7607: URL: https://github.com/apache/hudi/pull/7607#discussion_r1063958149 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/ProvidesHoodieConfig.scala: ## @@ -81,10 +80,8 @@ trait ProvidesHoodieConfig extends

[GitHub] [hudi] hudi-bot commented on pull request #7620: [HUDI-5511] Do not clean the CkpMetadata dir when restart the job

2023-01-06 Thread GitBox
hudi-bot commented on PR #7620: URL: https://github.com/apache/hudi/pull/7620#issuecomment-1374386293 ## CI report: * cd670233392323f8602950a5d2595661b668f3e9 Azure:

[GitHub] [hudi] xushiyan commented on a diff in pull request #7607: [HUDI-5499] Fixing Spark SQL configs not being properly propagated for CTAS and other commands

2023-01-06 Thread GitBox
xushiyan commented on code in PR #7607: URL: https://github.com/apache/hudi/pull/7607#discussion_r1063957987 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/ProvidesHoodieConfig.scala: ## @@ -81,10 +80,8 @@ trait ProvidesHoodieConfig extends

[GitHub] [hudi] hudi-bot commented on pull request #7609: [HUDI-5504]Fix concurrency conflict when asyncCompaction is enabled

2023-01-06 Thread GitBox
hudi-bot commented on PR #7609: URL: https://github.com/apache/hudi/pull/7609#issuecomment-1374372947 ## CI report: * be11f7842cdb9fd4e108c6a7a5662281ec9e2dcc Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7619: [MINOR] Optimizing schema validation in Metadata table

2023-01-06 Thread GitBox
hudi-bot commented on PR #7619: URL: https://github.com/apache/hudi/pull/7619#issuecomment-1374372971 ## CI report: * 2e36086458f1f634fab4aa3cbca75c30a2afe592 Azure:

[GitHub] [hudi] xushiyan commented on a diff in pull request #7607: [HUDI-5499] Fixing Spark SQL configs not being properly propagated for CTAS and other commands

2023-01-06 Thread GitBox
xushiyan commented on code in PR #7607: URL: https://github.com/apache/hudi/pull/7607#discussion_r1062620289 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/ProvidesHoodieConfig.scala: ## @@ -203,26 +193,20 @@ trait ProvidesHoodieConfig

[jira] [Updated] (HUDI-5506) StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event

2023-01-06 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-5506: - Status: Patch Available (was: In Progress) > StreamWriteOperatorCoordinator may not recommit with

[jira] [Updated] (HUDI-5506) StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event

2023-01-06 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-5506: - Attachment: image-2023-01-07-10-58-14-728.png > StreamWriteOperatorCoordinator may not recommit with

[jira] [Commented] (HUDI-5506) StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event

2023-01-06 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655631#comment-17655631 ] Danny Chen commented on HUDI-5506: -- Fixed via master branch: ac296c702417461cedeef6e8974bd48c767a1b1c >

[jira] [Updated] (HUDI-5506) StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event

2023-01-06 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-5506: - Status: In Progress (was: Open) > StreamWriteOperatorCoordinator may not recommit with partial

[GitHub] [hudi] nsivabalan opened a new pull request, #7619: [MINOR] Optimizing schema validation in Metadata table

2023-01-06 Thread GitBox
nsivabalan opened a new pull request, #7619: URL: https://github.com/apache/hudi/pull/7619 ### Change Logs Metadata table schema is fixes and so there is no real necessity to check for schema compatability everytime. we can save off some latencies. ### Impact Avoiding

[GitHub] [hudi] hudi-bot commented on pull request #6361: [HUDI-4690][HUDI-4503] Cleaning up Hudi custom Spark `Rule`s

2023-01-06 Thread GitBox
hudi-bot commented on PR #6361: URL: https://github.com/apache/hudi/pull/6361#issuecomment-1374371824 ## CI report: * 36928781f82776d26733679217f244d911db339b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7609: [HUDI-5504]Fix concurrency conflict when asyncCompaction is enabled

2023-01-06 Thread GitBox
hudi-bot commented on PR #7609: URL: https://github.com/apache/hudi/pull/7609#issuecomment-1374372055 ## CI report: * be11f7842cdb9fd4e108c6a7a5662281ec9e2dcc Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7619: [MINOR] Optimizing schema validation in Metadata table

2023-01-06 Thread GitBox
hudi-bot commented on PR #7619: URL: https://github.com/apache/hudi/pull/7619#issuecomment-1374372068 ## CI report: * 2e36086458f1f634fab4aa3cbca75c30a2afe592 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Updated] (HUDI-5511) Do not clean the CkpMetadata dir when restart the job

2023-01-06 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-5511: - Sprint: 0.13.0 Final Sprint > Do not clean the CkpMetadata dir when restart the job >

[jira] [Updated] (HUDI-5511) Do not clean the CkpMetadata dir when restart the job

2023-01-06 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-5511: - Status: In Progress (was: Open) > Do not clean the CkpMetadata dir when restart the job >

[jira] [Created] (HUDI-5511) Do not clean the CkpMetadata dir when restart the job

2023-01-06 Thread Danny Chen (Jira)
Danny Chen created HUDI-5511: Summary: Do not clean the CkpMetadata dir when restart the job Key: HUDI-5511 URL: https://issues.apache.org/jira/browse/HUDI-5511 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-5511) Do not clean the CkpMetadata dir when restart the job

2023-01-06 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-5511: - Priority: Blocker (was: Major) > Do not clean the CkpMetadata dir when restart the job >

[GitHub] [hudi] hudi-bot commented on pull request #7620: [HUDI-5511] Do not clean the CkpMetadata dir when restart the job

2023-01-06 Thread GitBox
hudi-bot commented on PR #7620: URL: https://github.com/apache/hudi/pull/7620#issuecomment-1374385575 ## CI report: * cd670233392323f8602950a5d2595661b668f3e9 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #7619: [MINOR] Optimizing schema validation in Metadata table

2023-01-06 Thread GitBox
hudi-bot commented on PR #7619: URL: https://github.com/apache/hudi/pull/7619#issuecomment-1374397323 ## CI report: * 2e36086458f1f634fab4aa3cbca75c30a2afe592 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7609: [HUDI-5504]Fix concurrency conflict when asyncCompaction is enabled

2023-01-06 Thread GitBox
hudi-bot commented on PR #7609: URL: https://github.com/apache/hudi/pull/7609#issuecomment-1374397317 ## CI report: * 94a8e3bb534c386cc55c3150120c8e56b7596f29 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7612: [HUDI-5336] Fixing log file pattern match to ignore extraneous files

2023-01-06 Thread GitBox
hudi-bot commented on PR #7612: URL: https://github.com/apache/hudi/pull/7612#issuecomment-1374357360 ## CI report: * 66370e1d4085619050625bf32e08dc9c8cef8f76 Azure:

[GitHub] [hudi] ThinkerLei commented on a diff in pull request #7609: [HUDI-5504]Fix concurrency conflict when asyncCompaction is enabled

2023-01-06 Thread GitBox
ThinkerLei commented on code in PR #7609: URL: https://github.com/apache/hudi/pull/7609#discussion_r1063944665 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/compact/CompactOperator.java: ## @@ -98,10 +99,16 @@ public void open() throws Exception { }

[GitHub] [hudi] danny0405 merged pull request #7575: [MINOR] Set engine when creating meta write config

2023-01-06 Thread GitBox
danny0405 merged PR #7575: URL: https://github.com/apache/hudi/pull/7575 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] nsivabalan commented on a diff in pull request #6782: [HUDI-4911][HUDI-3301] Fixing `HoodieMetadataLogRecordReader` to avoid flushing cache for every lookup

2023-01-06 Thread GitBox
nsivabalan commented on code in PR #6782: URL: https://github.com/apache/hudi/pull/6782#discussion_r1063952944 ## hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java: ## @@ -108,30 +112,85 @@ protected

[hudi] branch master updated (8ae1e8c6761 -> 633fe09514e)

2023-01-06 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 8ae1e8c6761 [HUDI-5231] suppress checkstyle warnings (#7473) add 633fe09514e [MINOR] Set engine when creating

[GitHub] [hudi] danny0405 opened a new pull request, #7620: [HUDI-5511] Do not clean the CkpMetadata dir when restart the job

2023-01-06 Thread GitBox
danny0405 opened a new pull request, #7620: URL: https://github.com/apache/hudi/pull/7620 At the beginning, we bootstrap the ckp metadata by cleaning all the messages. This brings in some corner case like 'the write task can not fetch the pending instant correctly when restartting the

[GitHub] [hudi] hudi-bot commented on pull request #7585: [MINOR] Extending support to other special characters

2023-01-06 Thread GitBox
hudi-bot commented on PR #7585: URL: https://github.com/apache/hudi/pull/7585#issuecomment-1374384804 ## CI report: * 85370798131dd4272a55fdea95195c0dd880a2ef Azure:

[jira] [Updated] (HUDI-5511) Do not clean the CkpMetadata dir when restart the job

2023-01-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5511: - Labels: pull-request-available (was: ) > Do not clean the CkpMetadata dir when restart the job >

[GitHub] [hudi] hudi-bot commented on pull request #6361: [HUDI-4690][HUDI-4503] Cleaning up Hudi custom Spark `Rule`s

2023-01-06 Thread GitBox
hudi-bot commented on PR #6361: URL: https://github.com/apache/hudi/pull/6361#issuecomment-1374400111 ## CI report: * 36928781f82776d26733679217f244d911db339b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6361: [HUDI-4690][HUDI-4503] Cleaning up Hudi custom Spark `Rule`s

2023-01-06 Thread GitBox
hudi-bot commented on PR #6361: URL: https://github.com/apache/hudi/pull/6361#issuecomment-1374403379 ## CI report: * 36928781f82776d26733679217f244d911db339b Azure:

  1   2   >