Re: [PR] [HUDI-7682] Remove the files copy in Azure CI tests report [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #0: URL: https://github.com/apache/hudi/pull/0#issuecomment-2080372788 ## CI report: * 0bd6c0f397cd6e7c7be1b0cbc42685d818969865 UNKNOWN * 80c2761b2cb8859a2cf52e5f5d76df5a36387f03 Azure:

Re: [PR] [HUDI-7682] Remove the files copy in Azure CI tests report [hudi]

2024-04-26 Thread via GitHub
yihua commented on PR #0: URL: https://github.com/apache/hudi/pull/0#issuecomment-2080362367 BTW you can use the Azure test tab to verify the number of tests reported in the PR against master to make sure there is no change.

Re: [PR] [HUDI-7588] Replace hadoop Configuration with StorageConfiguration in meta client [hudi]

2024-04-26 Thread via GitHub
yihua commented on PR #11071: URL: https://github.com/apache/hudi/pull/11071#issuecomment-2080361946 @danny0405 this PR is ready for review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [HUDI-7588] Replace hadoop Configuration with StorageConfiguration in meta client [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11071: URL: https://github.com/apache/hudi/pull/11071#issuecomment-2080360659 ## CI report: * a9972fa230cade524432f51566a8e6345b39afb9 UNKNOWN * b53bb105516d44e5d64ee63a0413bd8ae344b06b Azure:

Re: [PR] [HUDI-7682] Remove the files copy in Azure CI tests report [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #0: URL: https://github.com/apache/hudi/pull/0#issuecomment-2080357569 ## CI report: * ae67c710b5abb8d2f9d78e3a6573d57aaf2179a2 Azure:

Re: [PR] [HUDI-7588] Replace hadoop Configuration with StorageConfiguration in meta client [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11071: URL: https://github.com/apache/hudi/pull/11071#issuecomment-2080347188 ## CI report: * a9972fa230cade524432f51566a8e6345b39afb9 UNKNOWN * fda91627daa7876faee4af98e160085e3b8758e5 Azure:

Re: [PR] [HUDI-7682] Remove the files copy in Azure CI tests report [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #0: URL: https://github.com/apache/hudi/pull/0#issuecomment-2080347204 ## CI report: * ae67c710b5abb8d2f9d78e3a6573d57aaf2179a2 Azure:

Re: [PR] [HUDI-7682] Remove the files copy in Azure CI tests report [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #0: URL: https://github.com/apache/hudi/pull/0#issuecomment-2080345882 ## CI report: * ae67c710b5abb8d2f9d78e3a6573d57aaf2179a2 Azure:

Re: [PR] [HUDI-7588] Replace hadoop Configuration with StorageConfiguration in meta client [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11071: URL: https://github.com/apache/hudi/pull/11071#issuecomment-2080345856 ## CI report: * a9972fa230cade524432f51566a8e6345b39afb9 UNKNOWN * fda91627daa7876faee4af98e160085e3b8758e5 Azure:

Re: [PR] [HUDI-7588] Replace hadoop Configuration with StorageConfiguration in meta client [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11071: URL: https://github.com/apache/hudi/pull/11071#issuecomment-2080344436 ## CI report: * a9972fa230cade524432f51566a8e6345b39afb9 UNKNOWN * 1d5483b93858cb8c1b150068ccc2eab7184b8e5c Azure:

Re: [PR] [HUDI-7682] Remove the files copy in Azure CI tests report [hudi]

2024-04-26 Thread via GitHub
danny0405 commented on code in PR #0: URL: https://github.com/apache/hudi/pull/0#discussion_r1581723030 ## azure-pipelines-20230430.yml: ## @@ -292,9 +292,6 @@ stages: && mvn clean install $(MVN_OPTS_INSTALL) -Phudi-platform-service -Pthrift-gen-source

[jira] [Updated] (HUDI-6296) Add Scala 2.13 build profile to support scala 2.13

2024-04-26 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6296: Story Points: 12 > Add Scala 2.13 build profile to support scala 2.13 >

[jira] [Updated] (HUDI-6296) Add Scala 2.13 build profile to support scala 2.13

2024-04-26 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6296: Priority: Blocker (was: Minor) > Add Scala 2.13 build profile to support scala 2.13 >

[jira] [Updated] (HUDI-6296) Add Scala 2.13 build profile to support scala 2.13

2024-04-26 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6296: Fix Version/s: 0.15.0 1.0.0 (was: 1.1.0) > Add Scala 2.13 build

[jira] [Assigned] (HUDI-6296) Add Scala 2.13 build profile to support scala 2.13

2024-04-26 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-6296: --- Assignee: Ethan Guo > Add Scala 2.13 build profile to support scala 2.13 >

Re: [PR] [HUDI-7682] Remove the files copy in Azure CI tests report [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #0: URL: https://github.com/apache/hudi/pull/0#issuecomment-2080332645 ## CI report: * ae67c710b5abb8d2f9d78e3a6573d57aaf2179a2 Azure:

Re: [PR] [HUDI-7682] Remove the files copy in Azure CI tests report [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #0: URL: https://github.com/apache/hudi/pull/0#issuecomment-2080331127 ## CI report: * ae67c710b5abb8d2f9d78e3a6573d57aaf2179a2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7682] Remove the files copy in Azure CI tests report [hudi]

2024-04-26 Thread via GitHub
yihua commented on code in PR #0: URL: https://github.com/apache/hudi/pull/0#discussion_r1581713234 ## azure-pipelines-20230430.yml: ## @@ -292,9 +292,6 @@ stages: && mvn clean install $(MVN_OPTS_INSTALL) -Phudi-platform-service -Pthrift-gen-source -pl

Re: [PR] [HUDI-7682] Remove the files copy in Azure CI tests report [hudi]

2024-04-26 Thread via GitHub
yihua commented on code in PR #0: URL: https://github.com/apache/hudi/pull/0#discussion_r1581713302 ## azure-pipelines-20230430.yml: ## @@ -292,9 +292,6 @@ stages: && mvn clean install $(MVN_OPTS_INSTALL) -Phudi-platform-service -Pthrift-gen-source -pl

[jira] [Updated] (HUDI-7682) Remove the files copy in Azure CI tests report

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7682: - Labels: pull-request-available (was: ) > Remove the files copy in Azure CI tests report >

[PR] [HUDI-7682] Remove the files copy in Azure CI tests report [hudi]

2024-04-26 Thread via GitHub
danny0405 opened a new pull request, #0: URL: https://github.com/apache/hudi/pull/0 ### Change Logs The copy is unnecessary now because the file permission issue has been fixed in: #11097 ### Impact none ### Risk level (write none, low medium or high

[jira] [Created] (HUDI-7682) Remove the files copy in Azure CI tests report

2024-04-26 Thread Danny Chen (Jira)
Danny Chen created HUDI-7682: Summary: Remove the files copy in Azure CI tests report Key: HUDI-7682 URL: https://issues.apache.org/jira/browse/HUDI-7682 Project: Apache Hudi Issue Type:

Re: [PR] [HUDI-7681] Remove Hadoop Path usage in a few classes in hudi-common module [hudi]

2024-04-26 Thread via GitHub
danny0405 merged PR #11108: URL: https://github.com/apache/hudi/pull/11108 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(hudi) branch master updated: [HUDI-7681] Remove Hadoop Path usage in a few classes in hudi-common module (#11108)

2024-04-26 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new f35ae58089f [HUDI-7681] Remove Hadoop Path

Re: [PR] [HUDI-7588][DO NOT MERGE][Stacked on others] Replace hadoop Configuration with StorageConfiguration in meta client [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11071: URL: https://github.com/apache/hudi/pull/11071#issuecomment-2080313459 ## CI report: * a9972fa230cade524432f51566a8e6345b39afb9 UNKNOWN * 1d5483b93858cb8c1b150068ccc2eab7184b8e5c Azure:

Re: [PR] [HUDI-7588][DO NOT MERGE][Stacked on others] Replace hadoop Configuration with StorageConfiguration in meta client [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11071: URL: https://github.com/apache/hudi/pull/11071#issuecomment-2080309110 ## CI report: * a9972fa230cade524432f51566a8e6345b39afb9 UNKNOWN * 10ddb253fee9fe2389ec68456d200d0cb91f42ff Azure:

Re: [PR] [HUDI-7681] Remove Hadoop Path usage in a few classes in hudi-common module [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11108: URL: https://github.com/apache/hudi/pull/11108#issuecomment-2080306734 ## CI report: * cea3181651861a4befa5e624ccfa63d7bcc1943d Azure:

Re: [PR] [HUDI-7669] Move config classes and utils to proper places [hudi]

2024-04-26 Thread via GitHub
danny0405 commented on PR #11095: URL: https://github.com/apache/hudi/pull/11095#issuecomment-2080281392 > Makes sense. Let me think about this and put up separate PRs. Sure, please update the description when you finished the change so the reviewer can get a briefing of the changes.

(hudi) branch master updated: [MINOR] Fix build on master (#11109)

2024-04-26 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new dffde114570 [MINOR] Fix build on master (#11109)

Re: [PR] [MINOR] Fix build on master [hudi]

2024-04-26 Thread via GitHub
yihua merged PR #11109: URL: https://github.com/apache/hudi/pull/11109 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [MINOR] Fix build on master [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11109: URL: https://github.com/apache/hudi/pull/11109#issuecomment-2080270383 ## CI report: * 7e44f6439d96cdb7eb6816a35caa0e825a78900e Azure:

Re: [I] [SUPPORT] Archive operation always release lock on the timeline when try lock failed [hudi]

2024-04-26 Thread via GitHub
danny0405 commented on issue #11104: URL: https://github.com/apache/hudi/issues/11104#issuecomment-2080266345 archive itself holds an transaction lock, so we need to release it in any case, what is the wrong case you have ecountered? -- This is an automated message from the Apache Git

Re: [I] [SUPPORT] java.lang.ClassCastException: class org.apache.spark.sql.catalyst.expressions.UnsafeRow cannot be cast to class org.apache.spark.sql.vectorized.ColumnarBatch [hudi]

2024-04-26 Thread via GitHub
danny0405 commented on issue #11106: URL: https://github.com/apache/hudi/issues/11106#issuecomment-2080257787 It looks like a known issue reported in: https://github.com/apache/hudi/issues/9305 -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [HUDI-7596] Enable Jacoco code coverage report across multiple modules [hudi]

2024-04-26 Thread via GitHub
danny0405 commented on code in PR #11073: URL: https://github.com/apache/hudi/pull/11073#discussion_r1581635800 ## pom.xml: ## @@ -2040,6 +2040,27 @@ + +org.jacoco +jacoco-maven-plugin + +

Re: [PR] [HUDI-7596] Enable Jacoco code coverage report across multiple modules [hudi]

2024-04-26 Thread via GitHub
yihua commented on code in PR #11073: URL: https://github.com/apache/hudi/pull/11073#discussion_r1581634620 ## pom.xml: ## @@ -2040,6 +2040,27 @@ + +org.jacoco +jacoco-maven-plugin + +

[jira] [Closed] (HUDI-7674) Hudi CLI : Command "metadata validate-files" not using file listing to validate

2024-04-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-7674. Resolution: Fixed Fixed via master branch: 2c4192fa0f80fa7552293dcb93f20eb88759c977 > Hudi CLI : Command

[jira] [Updated] (HUDI-7674) Hudi CLI : Command "metadata validate-files" not using file listing to validate

2024-04-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-7674: - Fix Version/s: 0.15.0 1.0.0 > Hudi CLI : Command "metadata validate-files" not using

(hudi) branch master updated (32ecf248e5f -> 2c4192fa0f8)

2024-04-26 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 32ecf248e5f [HUDI-7675] Don't set default value for primary key when get schema from hms (#11101) add

Re: [PR] [HUDI-7674] Fix Hudi CLI Command "metadata validate-files" to use file listing to validate [hudi]

2024-04-26 Thread via GitHub
danny0405 merged PR #11100: URL: https://github.com/apache/hudi/pull/11100 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Closed] (HUDI-7675) Don't set default value for primary key when get schema from hms

2024-04-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-7675. Resolution: Fixed Fixed via master branch: 32ecf248e5fe93ef3d3ce5027c58550eb2966827 > Don't set default

[jira] [Updated] (HUDI-7675) Don't set default value for primary key when get schema from hms

2024-04-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-7675: - Fix Version/s: 1.15 1.0.0 > Don't set default value for primary key when get schema

(hudi) branch master updated: [HUDI-7675] Don't set default value for primary key when get schema from hms (#11101)

2024-04-26 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 32ecf248e5f [HUDI-7675] Don't set default

Re: [PR] [HUDI-7675]Don't set default value for primary key when get schema from hms [hudi]

2024-04-26 Thread via GitHub
danny0405 merged PR #11101: URL: https://github.com/apache/hudi/pull/11101 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [MINOR] Fix build on master [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11109: URL: https://github.com/apache/hudi/pull/11109#issuecomment-2080243214 ## CI report: * 7e44f6439d96cdb7eb6816a35caa0e825a78900e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7681] Remove Hadoop Path usage in a few classes in hudi-common module [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11108: URL: https://github.com/apache/hudi/pull/11108#issuecomment-2080243193 ## CI report: * cea3181651861a4befa5e624ccfa63d7bcc1943d Azure:

[PR] [MINOR] Fix build on master [hudi]

2024-04-26 Thread via GitHub
yihua opened a new pull request, #11109: URL: https://github.com/apache/hudi/pull/11109 ### Change Logs As above. ### Impact Fix build due to conflicts among PRs. ### Risk level none ### Documentation Update none ### Contributor's

Re: [PR] [HUDI-7681] Remove Hadoop Path usage in a few classes in hudi-common module [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11108: URL: https://github.com/apache/hudi/pull/11108#issuecomment-2080240006 ## CI report: * cea3181651861a4befa5e624ccfa63d7bcc1943d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

(hudi) branch master updated: [HUDI-7668] Add and rename APIs in StorageConfiguration (#11102)

2024-04-26 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 658e964cf77 [HUDI-7668] Add and rename APIs in

Re: [PR] [HUDI-7668] Add and rename APIs in StorageConfiguration [hudi]

2024-04-26 Thread via GitHub
yihua merged PR #11102: URL: https://github.com/apache/hudi/pull/11102 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(hudi) branch master updated: [HUDI-7670] Return StorageConfiguration from getConf() in HoodieStorage (#11096)

2024-04-26 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 3b613ffec62 [HUDI-7670] Return

Re: [PR] [HUDI-7670] Return StorageConfiguration from getConf() and add unwrapConf() in HoodieStorage [hudi]

2024-04-26 Thread via GitHub
yihua merged PR #11096: URL: https://github.com/apache/hudi/pull/11096 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7670] Return StorageConfiguration from getConf() and add unwrapConf() in HoodieStorage [hudi]

2024-04-26 Thread via GitHub
yihua commented on PR #11096: URL: https://github.com/apache/hudi/pull/11096#issuecomment-2080227716 Azure CI is green https://github.com/apache/hudi/assets/2497195/3e0298b7-1d3c-4374-b269-6716400ad6b6;> -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (HUDI-7681) Remove Hadoop Path usage in a few classes in hudi-common module

2024-04-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7681: - Labels: hoodie-storage pull-request-available (was: hoodie-storage) > Remove Hadoop Path usage

[PR] [HUDI-7681] Remove Hadoop Path usage in a few classes in hudi-common module [hudi]

2024-04-26 Thread via GitHub
yihua opened a new pull request, #11108: URL: https://github.com/apache/hudi/pull/11108 ### Change Logs As above. ### Impact As above. ### Risk level none ### Documentation Update none ### Contributor's checklist - [ ] Read

[jira] [Assigned] (HUDI-7681) Remove Hadoop Path usage in a few classes in hudi-common module

2024-04-26 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-7681: --- Assignee: Ethan Guo > Remove Hadoop Path usage in a few classes in hudi-common module >

[jira] [Updated] (HUDI-7681) Remove Hadoop Path usage in a few classes in hudi-common module

2024-04-26 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7681: Labels: hoodie-storage (was: ) > Remove Hadoop Path usage in a few classes in hudi-common module >

[jira] [Updated] (HUDI-7681) Remove Hadoop Path usage in a few classes in hudi-common module

2024-04-26 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7681: Fix Version/s: 0.15.0 1.0.0 > Remove Hadoop Path usage in a few classes in hudi-common

[jira] [Created] (HUDI-7681) Remove Hadoop Path usage in a few classes in hudi-common module

2024-04-26 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-7681: --- Summary: Remove Hadoop Path usage in a few classes in hudi-common module Key: HUDI-7681 URL: https://issues.apache.org/jira/browse/HUDI-7681 Project: Apache Hudi

[jira] [Updated] (HUDI-7681) Remove Hadoop Path usage in a few classes in hudi-common module

2024-04-26 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7681: Story Points: 0.5 > Remove Hadoop Path usage in a few classes in hudi-common module >

Re: [PR] [HUDI-7668] Add and rename APIs in StorageConfiguration [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11102: URL: https://github.com/apache/hudi/pull/11102#issuecomment-2080209329 ## CI report: * 0689b43874f53d52e1b2b8ea38eefdb4ab9d2310 Azure:

[jira] [Updated] (HUDI-1045) Support updates during clustering

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1045: - Status: In Progress (was: Open) > Support updates during clustering >

[jira] [Updated] (HUDI-6495) Finalize the RFC-61/Non-blocking Concurrency Control design

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-6495: - Sprint: Sprint 2023-04-26 > Finalize the RFC-61/Non-blocking Concurrency Control design >

[jira] [Updated] (HUDI-1045) Support updates during clustering

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1045: - Sprint: Sprint 2023-04-26 > Support updates during clustering > -

Re: [PR] update fork count [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11107: URL: https://github.com/apache/hudi/pull/11107#issuecomment-2080166018 ## CI report: * db85bf40e090038ebe7af7e26c88e2f57bc66455 Azure:

Re: [PR] [HUDI-7668] Add and rename APIs in StorageConfiguration [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11102: URL: https://github.com/apache/hudi/pull/11102#issuecomment-2080165984 ## CI report: * 0f4f043e78b470cdc8bd5ca48327c61224a79104 Azure:

Re: [PR] [HUDI-7670] Return StorageConfiguration from getConf() and add unwrapConf() in HoodieStorage [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11096: URL: https://github.com/apache/hudi/pull/11096#issuecomment-2080165932 ## CI report: * 4f9c84e4d433587e569770f0c2c43e3cbd73ebb0 Azure:

Re: [PR] [HUDI-7670] Return StorageConfiguration from getConf() and add unwrapConf() in HoodieStorage [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11096: URL: https://github.com/apache/hudi/pull/11096#issuecomment-2080159119 ## CI report: * 4f9c84e4d433587e569770f0c2c43e3cbd73ebb0 Azure:

Re: [PR] [HUDI-7668] Add and rename APIs in StorageConfiguration [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11102: URL: https://github.com/apache/hudi/pull/11102#issuecomment-2080159234 ## CI report: * 0f4f043e78b470cdc8bd5ca48327c61224a79104 Azure:

Re: [PR] [HUDI-7668] Add APIs in StorageConfiguration [hudi]

2024-04-26 Thread via GitHub
yihua commented on PR #11102: URL: https://github.com/apache/hudi/pull/11102#issuecomment-2080121512 > I feel like "newCopy()" should return a copy of the storageconfiguration not a copy of the underlying configuration. > > maybe "getCopy()" would make more sense, because then it

Re: [PR] [HUDI-7670] Return StorageConfiguration from getConf() in HoodieStorage [hudi]

2024-04-26 Thread via GitHub
yihua commented on PR #11096: URL: https://github.com/apache/hudi/pull/11096#issuecomment-2080113039 > Why can't we just call getConf().get()? Or we could just define unwrapConf as that? We can. As mentioned by @danny0405 , it's mostly for convenience. -- This is an automated

Re: [PR] update fork count [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11107: URL: https://github.com/apache/hudi/pull/11107#issuecomment-2080105744 ## CI report: * ec6dd428aae1af3c7a8f12a0a5359bc8581b5f42 Azure:

Re: [PR] [MINOR] Make ordering deterministic in small file selection [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11008: URL: https://github.com/apache/hudi/pull/11008#issuecomment-2080105462 ## CI report: * 3204af717737f8a4f75d1534b2ec4415ebd08676 Azure:

Re: [PR] update fork count [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11107: URL: https://github.com/apache/hudi/pull/11107#issuecomment-2080097766 ## CI report: * ec6dd428aae1af3c7a8f12a0a5359bc8581b5f42 Azure:

Re: [PR] update fork count [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11107: URL: https://github.com/apache/hudi/pull/11107#issuecomment-2080087364 ## CI report: * ec6dd428aae1af3c7a8f12a0a5359bc8581b5f42 Azure:

Re: [PR] update fork count [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11107: URL: https://github.com/apache/hudi/pull/11107#issuecomment-2080037353 ## CI report: * ec6dd428aae1af3c7a8f12a0a5359bc8581b5f42 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [MINOR] Make ordering deterministic in small file selection [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11008: URL: https://github.com/apache/hudi/pull/11008#issuecomment-2080037055 ## CI report: * 17c9f852515b869c08d317553fac266ff493a3f2 Azure:

Re: [PR] [MINOR] Make ordering deterministic in small file selection [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11008: URL: https://github.com/apache/hudi/pull/11008#issuecomment-2080026236 ## CI report: * 17c9f852515b869c08d317553fac266ff493a3f2 Azure:

[PR] update fork count [hudi]

2024-04-26 Thread via GitHub
the-other-tim-brown opened a new pull request, #11107: URL: https://github.com/apache/hudi/pull/11107 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or

Re: [PR] [HUDI-7674] Fix Hudi CLI Command "metadata validate-files" to use file listing to validate [hudi]

2024-04-26 Thread via GitHub
yihua commented on code in PR #11100: URL: https://github.com/apache/hudi/pull/11100#discussion_r1581463647 ## hudi-cli/src/main/java/org/apache/hudi/cli/commands/MetadataCommand.java: ## @@ -285,13 +290,14 @@ public String validateFiles( return "[ERROR] Metadata Table

(hudi) branch master updated: [MINOR] Streamer test setup performance (#10806)

2024-04-26 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 6911abf1755 [MINOR] Streamer test setup

Re: [PR] [MINOR] Streamer test setup performance [hudi]

2024-04-26 Thread via GitHub
yihua merged PR #10806: URL: https://github.com/apache/hudi/pull/10806 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [MINOR] Streamer test setup performance [hudi]

2024-04-26 Thread via GitHub
the-other-tim-brown commented on code in PR #10806: URL: https://github.com/apache/hudi/pull/10806#discussion_r1581446532 ## hudi-utilities/src/test/java/org/apache/hudi/utilities/testutils/UtilitiesTestBase.java: ## @@ -266,6 +268,17 @@ public void teardown() throws Exception

Re: [PR] [MINOR] Streamer test setup performance [hudi]

2024-04-26 Thread via GitHub
the-other-tim-brown commented on code in PR #10806: URL: https://github.com/apache/hudi/pull/10806#discussion_r1581445403 ## hudi-utilities/src/test/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamerTestBase.java: ## @@ -157,9 +155,9 @@ public void

Re: [PR] [MINOR] Streamer test setup performance [hudi]

2024-04-26 Thread via GitHub
yihua commented on code in PR #10806: URL: https://github.com/apache/hudi/pull/10806#discussion_r1581442892 ## hudi-utilities/src/test/java/org/apache/hudi/utilities/testutils/UtilitiesTestBase.java: ## @@ -266,6 +268,17 @@ public void teardown() throws Exception {

Re: [PR] [HUDI-7674] Fix Hudi CLI Command "metadata validate-files" to use file listing to validate [hudi]

2024-04-26 Thread via GitHub
hudi-bot commented on PR #11100: URL: https://github.com/apache/hudi/pull/11100#issuecomment-2079929037 ## CI report: * efe2c45383cc1b3b2facc2ce9d140bdbc27a6255 Azure:

[jira] [Assigned] (HUDI-7610) Delete records are inconsistent depending on MOR/COW, Avro/Spark record merger, new filegroup reader enabled/disabled

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-7610: Assignee: Ethan Guo (was: Vinoth Chandar) > Delete records are inconsistent depending on

[jira] [Assigned] (HUDI-7610) Delete records are inconsistent depending on MOR/COW, Avro/Spark record merger, new filegroup reader enabled/disabled

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-7610: Assignee: Vinoth Chandar > Delete records are inconsistent depending on MOR/COW,

[jira] [Updated] (HUDI-7280) Add/Drop/Rename table properties hoodie.properties

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-7280: - Sprint: Sprint 2023-04-26 > Add/Drop/Rename table properties hoodie.properties >

[jira] [Updated] (HUDI-7539) Use .compaction for compaction action consistently

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-7539: - Sprint: Sprint 2023-04-26 > Use .compaction for compaction action consistently >

[jira] [Commented] (HUDI-7610) Delete records are inconsistent depending on MOR/COW, Avro/Spark record merger, new filegroup reader enabled/disabled

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841338#comment-17841338 ] Vinoth Chandar commented on HUDI-7610: -- [~guoyihua] to triage > Delete records are inconsistent

[jira] [Assigned] (HUDI-7280) Add/Drop/Rename table properties hoodie.properties

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-7280: Assignee: Vinoth Chandar > Add/Drop/Rename table properties hoodie.properties >

[jira] [Deleted] (HUDI-7680) Decide on changing compaction completed action to be compaction vs .commit

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar deleted HUDI-7680: - > Decide on changing compaction completed action to be compaction vs .commit >

[jira] [Updated] (HUDI-1739) Standardize usage of replacecommit files across the code base

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1739: - Sprint: Sprint 2023-04-26 > Standardize usage of replacecommit files across the code base >

[jira] [Created] (HUDI-7680) Decide on changing compaction completed action to be compaction vs .commit

2024-04-26 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-7680: Summary: Decide on changing compaction completed action to be compaction vs .commit Key: HUDI-7680 URL: https://issues.apache.org/jira/browse/HUDI-7680 Project:

[jira] [Updated] (HUDI-7679) Ensure extensibility to unstructured data, logs (CLP), vectors, other index types

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-7679: - Sprint: Sprint 2023-04-26 > Ensure extensibility to unstructured data, logs (CLP), vectors, other

[jira] [Assigned] (HUDI-7679) Ensure extensibility to unstructured data, logs (CLP), vectors, other index types

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-7679: Assignee: Vinoth Chandar > Ensure extensibility to unstructured data, logs (CLP), vectors,

[jira] [Updated] (HUDI-7679) Ensure extensibility to unstructured data, logs (CLP), vectors, other index types

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-7679: - Fix Version/s: 1.0.0 > Ensure extensibility to unstructured data, logs (CLP), vectors, other

[jira] [Created] (HUDI-7679) Ensure extensibility to unstructured data, logs (CLP), vectors, other index types

2024-04-26 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-7679: Summary: Ensure extensibility to unstructured data, logs (CLP), vectors, other index types Key: HUDI-7679 URL: https://issues.apache.org/jira/browse/HUDI-7679

[jira] [Updated] (HUDI-7542) Ensure extensibility to time-travel writes

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-7542: - Sprint: Sprint 2024-03-25 (was: Sprint 2024-03-25, Sprint 2023-04-26) > Ensure extensibility to

[jira] [Comment Edited] (HUDI-6495) Finalize the RFC-61/Non-blocking Concurrency Control design

2024-04-26 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17841334#comment-17841334 ] Vinoth Chandar edited comment on HUDI-6495 at 4/26/24 6:22 PM: --- We still

  1   2   3   >