[jira] [Closed] (HUDI-7187) Fix integ test props to honor new streamer properties

2024-03-30 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov closed HUDI-7187. --- Resolution: Fixed Fixed via master branch: 26c00a3adefff9217187ca0ab9a5b2a7c9e42199 > Fix integ test

[jira] [Updated] (HUDI-7187) Fix integ test props to honor new streamer properties

2024-03-30 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-7187: Status: Open (was: In Progress) > Fix integ test props to honor new streamer properties >

Re: [I] Tracking ticket for folks to be added to slack group [hudi]

2024-03-30 Thread via GitHub
wombatu-kun commented on issue #143: URL: https://github.com/apache/hudi/issues/143#issuecomment-2028564232 Hi! Please, add me to the slack group: wombatu...@gmail.com Thanx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] [HUDI-7511] Fixing offset range calculation for kafka [hudi]

2024-03-30 Thread via GitHub
bvaradar commented on code in PR #10875: URL: https://github.com/apache/hudi/pull/10875#discussion_r1545549852 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/KafkaOffsetGen.java: ## @@ -174,6 +174,13 @@ public static OffsetRange[]

Re: [PR] [HUDI-7187] Fix integ test props to honor new streamer properties [hudi]

2024-03-30 Thread via GitHub
wombatu-kun commented on PR #10866: URL: https://github.com/apache/hudi/pull/10866#issuecomment-2028558096 > @wombatu-kun Thanks for the contribution! Are you interested in more code restructuring and core abstraction work? Feel free to reach out to me on Hudi Slack. @yihua Yes, i'm

(hudi) branch master updated: [HUDI-7187] Fix integ test props to honor new streamer properties (#10866)

2024-03-30 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 26c00a3adef [HUDI-7187] Fix integ test props to

[jira] [Updated] (HUDI-6884) hudi-cli should generate correct HoodieTimeGeneratorConfig

2024-03-30 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-6884: - Fix Version/s: 1.0.0 > hudi-cli should generate correct HoodieTimeGeneratorConfig >

Re: [PR] [HUDI-7187] Fix integ test props to honor new streamer properties [hudi]

2024-03-30 Thread via GitHub
yihua merged PR #10866: URL: https://github.com/apache/hudi/pull/10866 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7187] Fix integ test props to honor new streamer properties [hudi]

2024-03-30 Thread via GitHub
yihua commented on PR #10866: URL: https://github.com/apache/hudi/pull/10866#issuecomment-2028548116 @wombatu-kun Thanks for the contribution! Are you interested in more code restructuring and core abstraction work? Feel free to reach out to me on Hudi Slack. -- This is an automated

(hudi) branch master updated (ae4f46874a9 -> 06d3bb8cfbd)

2024-03-30 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from ae4f46874a9 [MINOR} When M3 metrics reporter type is used HoodieMetricsConfig should create default values for

[jira] [Closed] (HUDI-6884) hudi-cli should generate correct HoodieTimeGeneratorConfig

2024-03-30 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-6884. Resolution: Fixed Fixed via master branch: 06d3bb8cfbd0b55264deb24b813c512b05843a74 > hudi-cli should

Re: [PR] [HUDI-6884] hudi-cli should generate correct HoodieTimeGeneratorConfig [hudi]

2024-03-30 Thread via GitHub
danny0405 merged PR #10941: URL: https://github.com/apache/hudi/pull/10941 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-6884] hudi-cli should generate correct HoodieTimeGeneratorConfig [hudi]

2024-03-30 Thread via GitHub
wombatu-kun commented on code in PR #10941: URL: https://github.com/apache/hudi/pull/10941#discussion_r1545519468 ## hudi-cli/src/main/java/org/apache/hudi/cli/commands/TableCommand.java: ## @@ -85,13 +87,25 @@ public String connect( @ShellOption(value =

Re: [PR] [HUDI-6884] hudi-cli should generate correct HoodieTimeGeneratorConfig [hudi]

2024-03-30 Thread via GitHub
danny0405 commented on code in PR #10941: URL: https://github.com/apache/hudi/pull/10941#discussion_r1545518905 ## hudi-cli/src/main/java/org/apache/hudi/cli/commands/TableCommand.java: ## @@ -85,13 +87,25 @@ public String connect( @ShellOption(value =

Re: [PR] [HUDI-6884] hudi-cli should generate correct HoodieTimeGeneratorConfig [hudi]

2024-03-30 Thread via GitHub
hudi-bot commented on PR #10941: URL: https://github.com/apache/hudi/pull/10941#issuecomment-2028259127 ## CI report: * be7805c337c63009b62bb5c4af1306526b0003ce Azure:

Re: [PR] [HUDI-6884] hudi-cli should generate correct HoodieTimeGeneratorConfig [hudi]

2024-03-30 Thread via GitHub
hudi-bot commented on PR #10941: URL: https://github.com/apache/hudi/pull/10941#issuecomment-2028151179 ## CI report: * be7805c337c63009b62bb5c4af1306526b0003ce Azure:

Re: [PR] [HUDI-6884] hudi-cli should generate correct HoodieTimeGeneratorConfig [hudi]

2024-03-30 Thread via GitHub
hudi-bot commented on PR #10941: URL: https://github.com/apache/hudi/pull/10941#issuecomment-2028097235 ## CI report: * be7805c337c63009b62bb5c4af1306526b0003ce UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[PR] [HUDI-6884] hudi-cli should generate correct HoodieTimeGeneratorConfig [hudi]

2024-03-30 Thread via GitHub
wombatu-kun opened a new pull request, #10941: URL: https://github.com/apache/hudi/pull/10941 ### Change Logs Currently, we build HoodieTimeGeneratorConfig with default configuration, instead we should respect props users set. ### Impact none ### Risk level

[jira] [Updated] (HUDI-6884) hudi-cli should generate correct HoodieTimeGeneratorConfig

2024-03-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6884: - Labels: pull-request-available (was: ) > hudi-cli should generate correct

[jira] [Updated] (HUDI-6884) hudi-cli should generate correct HoodieTimeGeneratorConfig

2024-03-30 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-6884: Status: In Progress (was: Open) > hudi-cli should generate correct HoodieTimeGeneratorConfig >

[jira] [Assigned] (HUDI-6884) hudi-cli should generate correct HoodieTimeGeneratorConfig

2024-03-30 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-6884: --- Assignee: Vova Kolmakov > hudi-cli should generate correct HoodieTimeGeneratorConfig >

Re: [PR] [HUDI-7187] Fix integ test props to honor new streamer properties [hudi]

2024-03-30 Thread via GitHub
hudi-bot commented on PR #10866: URL: https://github.com/apache/hudi/pull/10866#issuecomment-2028045511 ## CI report: * c5f68a42d67d749e8b8218d937d808901ffefcb6 Azure:

Re: [PR] [HUDI-7187] Fix integ test props to honor new streamer properties [hudi]

2024-03-30 Thread via GitHub
hudi-bot commented on PR #10866: URL: https://github.com/apache/hudi/pull/10866#issuecomment-2028025772 ## CI report: * cc2ead88aba164d6cb0971d8a77fc668acc355b8 Azure:

Re: [PR] [HUDI-7187] Fix integ test props to honor new streamer properties [hudi]

2024-03-30 Thread via GitHub
hudi-bot commented on PR #10866: URL: https://github.com/apache/hudi/pull/10866#issuecomment-2028023649 ## CI report: * cc2ead88aba164d6cb0971d8a77fc668acc355b8 Azure:

Re: [PR] [HUDI-7187] Fix integ test props to honor new streamer properties [hudi]

2024-03-30 Thread via GitHub
wombatu-kun commented on code in PR #10866: URL: https://github.com/apache/hudi/pull/10866#discussion_r1545284823 ## hudi-utilities/src/test/java/org/apache/hudi/utilities/config/SourceTestConfig.java: ## @@ -21,29 +21,36 @@ import

Re: [PR] [HUDI-3676] Enhance tests for trigger clean every Nth commit [hudi]

2024-03-30 Thread via GitHub
hudi-bot commented on PR #6926: URL: https://github.com/apache/hudi/pull/6926#issuecomment-2027979187 ## CI report: * 36c0fdaa872c9ccc14729b09169b647f3d88efa4 Azure:

Re: [PR] [HUDI-3676] Enhance tests for trigger clean every Nth commit [hudi]

2024-03-30 Thread via GitHub
hudi-bot commented on PR #6926: URL: https://github.com/apache/hudi/pull/6926#issuecomment-2027957658 ## CI report: * 5ebe5720f5f5b7ceb3210da2a7e259c25ac1169e Azure:

Re: [PR] [HUDI-3676] Enhance tests for trigger clean every Nth commit [hudi]

2024-03-30 Thread via GitHub
hudi-bot commented on PR #6926: URL: https://github.com/apache/hudi/pull/6926#issuecomment-2027956043 ## CI report: * 5ebe5720f5f5b7ceb3210da2a7e259c25ac1169e Azure:

[jira] [Updated] (HUDI-5422) Control KEPP_LATEST_VERSIONS clean replaced files immediately or not

2024-03-30 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5422: Component/s: cleaning table-service > Control KEPP_LATEST_VERSIONS clean replaced files

[jira] [Updated] (HUDI-5583) multiple writers dead lock while cleaning

2024-03-30 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5583: Component/s: cleaning table-service > multiple writers dead lock while cleaning >

[jira] [Updated] (HUDI-5710) Load all partitions in advance for clean when MDT is enabled

2024-03-30 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5710: Component/s: cleaning table-service > Load all partitions in advance for clean when MDT is

[jira] [Updated] (HUDI-5659) Support cleaning for archived files

2024-03-30 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5659: Component/s: archiving cleaning table-service > Support cleaning for

[jira] [Updated] (HUDI-5583) multiple writers dead lock while cleaning

2024-03-30 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5583: Component/s: multi-writer > multiple writers dead lock while cleaning >

[jira] [Updated] (HUDI-5924) hudi cli clean command could OOM if there are too many commits in active timeline

2024-03-30 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5924: Component/s: cleaning table-service > hudi cli clean command could OOM if there are too

[jira] [Updated] (HUDI-5733) TestHoodieDeltaStreamer.testHoodieIndexer failure

2024-03-30 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5733: Epic Link: HUDI-4302 > TestHoodieDeltaStreamer.testHoodieIndexer failure >

[jira] [Updated] (HUDI-5959) Add docs for clean policy inference

2024-03-30 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5959: Component/s: cleaning table-service > Add docs for clean policy inference >

[jira] [Updated] (HUDI-5936) Potential serialization issue when FileStatus is not serializable

2024-03-30 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5936: Component/s: cleaning table-service > Potential serialization issue when FileStatus is not

[jira] [Updated] (HUDI-6004) failed to execute Spark procedure for table not in current database

2024-03-30 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6004: Component/s: table-service > failed to execute Spark procedure for table not in current database >

[jira] [Updated] (HUDI-6056) Add guard rails to archival configs when cleaner configs is based on hours

2024-03-30 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6056: Component/s: archiving cleaning table-service > Add guard rails to

[jira] [Updated] (HUDI-6078) Clean is always triggered with flink

2024-03-30 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6078: Component/s: cleaning flink table-service > Clean is always triggered