Re: [PR] [HUDI-7023] Support querying without syncing partition metadata to catalog [hudi]

2023-12-05 Thread via GitHub
codope commented on code in PR #10153: URL: https://github.com/apache/hudi/pull/10153#discussion_r1416836312 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/command/index/TestFunctionalIndex.scala: ## @@ -140,6 +146,68 @@ class TestFunctionalIndex

Re: [PR] [HUDI-7078] Re-enable TestNestedSchemaPruningOptimization [hudi]

2023-12-05 Thread via GitHub
linliu-code commented on PR #10245: URL: https://github.com/apache/hudi/pull/10245#issuecomment-1842273234 @yihua The PR is ready. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [HUDI-6954] Fixing unpartitioned datasets for col stats and bloom filter partition in MDT [hudi]

2023-12-05 Thread via GitHub
codope commented on code in PR #10251: URL: https://github.com/apache/hudi/pull/10251#discussion_r1416826728 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestMetadataTableWithSparkDataSource.scala: ## @@ -104,9 +127,90 @@ class

Re: [PR] [HUDI-6836] Shutting down deltastreamer in tests and shutting down metrics for write client [hudi]

2023-12-05 Thread via GitHub
bvaradar merged PR #9667: URL: https://github.com/apache/hudi/pull/9667 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(hudi) branch master updated: [HUDI-6836] Shutting down deltastreamer in tests and shutting down metrics for write client (#9667)

2023-12-05 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 594b0ea4abe [HUDI-6836] Shutting down

Re: [PR] [HUDI-7174] Disable a flaky test [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10253: URL: https://github.com/apache/hudi/pull/10253#issuecomment-1842234620 ## CI report: * 1179a3bf78cea56810480076e1029beb501fde60 Azure:

Re: [PR] [HUDI-7171] Fix 'show partitions' not display rewritten partitions [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10242: URL: https://github.com/apache/hudi/pull/10242#issuecomment-1842234342 ## CI report: * 9dcaaba4cd709ec45a2427b1123789a321b60bf6 Azure:

Re: [PR] [HUDI-6954] Fixing unpartitioned datasets for col stats and bloom filter partition in MDT [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10251: URL: https://github.com/apache/hudi/pull/10251#issuecomment-1842234519 ## CI report: * e5268c80f0635503cbf9b6c9236058e6e8bf1ddf Azure:

[jira] [Assigned] (HUDI-4169) Decouple AwsGlueCatalogSyncTool from HiveSyncTool

2023-12-05 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-4169: - Assignee: Louis Huang > Decouple AwsGlueCatalogSyncTool from HiveSyncTool >

Re: [PR] [HUDI-7174] Disable a flaky test [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10253: URL: https://github.com/apache/hudi/pull/10253#issuecomment-1842220914 ## CI report: * 1179a3bf78cea56810480076e1029beb501fde60 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[jira] [Updated] (HUDI-7174) Fix ITTestHoodieDataSource.testMultipleLogBlocksWithDataSkipping:1645

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7174: - Labels: pull-request-available (was: ) > Fix

[PR] [HUDI-7174] Disable a flaky test [hudi]

2023-12-05 Thread via GitHub
linliu-code opened a new pull request, #10253: URL: https://github.com/apache/hudi/pull/10253 ### Change Logs Disabling the test due to its flakiness. ### Impact No impact. ### Risk level (write none, low medium or high below) Low due to its flakiness.

[jira] [Updated] (HUDI-7182) Failed to archive commits caused by npe

2023-12-05 Thread wuzhenhua (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuzhenhua updated HUDI-7182: Description: {code:java} 2023-12-06 14:32:16 [ INFO]

[jira] [Created] (HUDI-7182) Failed to archive commits caused by npe

2023-12-05 Thread wuzhenhua (Jira)
wuzhenhua created HUDI-7182: --- Summary: Failed to archive commits caused by npe Key: HUDI-7182 URL: https://issues.apache.org/jira/browse/HUDI-7182 Project: Apache Hudi Issue Type: Bug

[jira] [Updated] (HUDI-7174) Fix ITTestHoodieDataSource.testMultipleLogBlocksWithDataSkipping:1645

2023-12-05 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu updated HUDI-7174: -- Description: {code:java} Error: testMultipleLogBlocksWithDataSkipping Time elapsed: 2.289 s <<< FAILURE!

[jira] [Created] (HUDI-7181) Failure to archive commits caused by npe

2023-12-05 Thread wuzhenhua (Jira)
wuzhenhua created HUDI-7181: --- Summary: Failure to archive commits caused by npe Key: HUDI-7181 URL: https://issues.apache.org/jira/browse/HUDI-7181 Project: Apache Hudi Issue Type: Bug

Re: [PR] [HUDI-7080] Enable two tests [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10250: URL: https://github.com/apache/hudi/pull/10250#issuecomment-1842165659 ## CI report: * 715c85d894f95192405dbdf7be443513c9ef6e0a Azure:

Re: [PR] [HUDI-7080] Enable two tests [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10250: URL: https://github.com/apache/hudi/pull/10250#issuecomment-1842159781 ## CI report: * 715c85d894f95192405dbdf7be443513c9ef6e0a Azure:

Re: [PR] [HUDI-7077] Fix missing field error caused by meta columns [hudi]

2023-12-05 Thread via GitHub
nsivabalan merged PR #10216: URL: https://github.com/apache/hudi/pull/10216 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(hudi) branch master updated: [HUDI-7077] Fix OOM error for a test (#10216)

2023-12-05 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 231e45c8a0b [HUDI-7077] Fix OOM error for a

[jira] [Commented] (HUDI-7051) Incorrect replace operation in compaction strategy filter

2023-12-05 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793494#comment-17793494 ] sivabalan narayanan commented on HUDI-7051: --- hey [~vmaster] :  sorry I am bit confused.  as per

Re: [PR] [HUDI-7171] Fix 'show partitions' not display rewritten partitions [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10242: URL: https://github.com/apache/hudi/pull/10242#issuecomment-1842021037 ## CI report: * b23c47f2029f3c9cbeecc3608c6dc00c2af684e9 Azure:

Re: [PR] [HUDI-7171] Fix 'show partitions' not display rewritten partitions [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10242: URL: https://github.com/apache/hudi/pull/10242#issuecomment-1842016651 ## CI report: * b23c47f2029f3c9cbeecc3608c6dc00c2af684e9 Azure:

Re: [PR] [HUDI-7135] Spark reads hudi table error when flink creates the table without pre… [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10157: URL: https://github.com/apache/hudi/pull/10157#issuecomment-1842016530 ## CI report: * 799dddf6479b1e1eeade99caa0d49a4dde484bfd Azure:

Re: [PR] [HUDI-7080] Enable two tests [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10250: URL: https://github.com/apache/hudi/pull/10250#issuecomment-1842011178 ## CI report: * 715c85d894f95192405dbdf7be443513c9ef6e0a Azure:

Re: [PR] [HUDI-7173] Fix hudi-on-flink read issues involving schema evolution … [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10247: URL: https://github.com/apache/hudi/pull/10247#issuecomment-1842011147 ## CI report: * 41539b8c02774378535f5a75cb66570d51b99aad UNKNOWN * a7e024174e549c3d13999022358653f779f7bc10 Azure:

Re: [PR] [HUDI-7078] Re-enable TestNestedSchemaPruningOptimization [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10245: URL: https://github.com/apache/hudi/pull/10245#issuecomment-184201 ## CI report: * b1cf625e1f306b3e4b879d05dc846843453f7e63 Azure:

Re: [PR] [HUDI-7135] Spark reads hudi table error when flink creates the table without pre… [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10157: URL: https://github.com/apache/hudi/pull/10157#issuecomment-1842010940 ## CI report: * 799dddf6479b1e1eeade99caa0d49a4dde484bfd Azure:

Re: [PR] [HUDI-7171] Fix 'show partitions' not display rewritten partitions [hudi]

2023-12-05 Thread via GitHub
wecharyu commented on code in PR #10242: URL: https://github.com/apache/hudi/pull/10242#discussion_r1416586204 ## hudi-common/src/main/java/org/apache/hudi/common/model/WriteOperationType.java: ## @@ -164,4 +164,8 @@ public static boolean isUpsert(WriteOperationType operation)

Re: [PR] [HUDI-7135] Spark reads hudi table error when flink creates the table without pre… [hudi]

2023-12-05 Thread via GitHub
empcl commented on PR #10157: URL: https://github.com/apache/hudi/pull/10157#issuecomment-1841994035 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [HUDI-6954] Fixing unpartitioned datasets for col stats and bloom filter partition in MDT [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10251: URL: https://github.com/apache/hudi/pull/10251#issuecomment-1841980281 ## CI report: * e5268c80f0635503cbf9b6c9236058e6e8bf1ddf Azure:

Re: [PR] [HUDI-7173] Fix hudi-on-flink read issues involving schema evolution … [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10247: URL: https://github.com/apache/hudi/pull/10247#issuecomment-1841980247 ## CI report: * 41539b8c02774378535f5a75cb66570d51b99aad UNKNOWN * a7e024174e549c3d13999022358653f779f7bc10 Azure:

Re: [PR] [HUDI-7173] Fix hudi-on-flink read issues involving schema evolution … [hudi]

2023-12-05 Thread via GitHub
voonhous commented on PR #10247: URL: https://github.com/apache/hudi/pull/10247#issuecomment-1841974148 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [HUDI-6954] Fixing unpartitioned datasets for col stats and bloom filter partition in MDT [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10251: URL: https://github.com/apache/hudi/pull/10251#issuecomment-1841974065 ## CI report: * e5268c80f0635503cbf9b6c9236058e6e8bf1ddf UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[jira] [Updated] (HUDI-7174) Fix ITTestHoodieDataSource.testMultipleLogBlocksWithDataSkipping:1645

2023-12-05 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu updated HUDI-7174: -- Fix Version/s: 1.0.0 > FixITTestHoodieDataSource.testMultipleLogBlocksWithDataSkipping:1645 >

Re: [PR] [HUDI-7080] Enable two tests [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10250: URL: https://github.com/apache/hudi/pull/10250#issuecomment-1841968459 ## CI report: * f8f59d07b5e26db920698176b79bc79abab89104 Azure:

[jira] [Created] (HUDI-7180) Performance Test for CDC queries (MOR and COW)

2023-12-05 Thread Lin Liu (Jira)
Lin Liu created HUDI-7180: - Summary: Performance Test for CDC queries (MOR and COW) Key: HUDI-7180 URL: https://issues.apache.org/jira/browse/HUDI-7180 Project: Apache Hudi Issue Type: Task

[jira] [Created] (HUDI-7179) Performance Test for Incremental Queries (MOR and COW)

2023-12-05 Thread Lin Liu (Jira)
Lin Liu created HUDI-7179: - Summary: Performance Test for Incremental Queries (MOR and COW) Key: HUDI-7179 URL: https://issues.apache.org/jira/browse/HUDI-7179 Project: Apache Hudi Issue Type: Task

[jira] [Created] (HUDI-7178) Performance test for Time Travel Queries (MOR and COW)

2023-12-05 Thread Lin Liu (Jira)
Lin Liu created HUDI-7178: - Summary: Performance test for Time Travel Queries (MOR and COW) Key: HUDI-7178 URL: https://issues.apache.org/jira/browse/HUDI-7178 Project: Apache Hudi Issue Type: Task

(hudi) branch master updated (0b4a196f32f -> 450518cdf6a)

2023-12-05 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 0b4a196f32f [HUDI-7172] Fix the timeline archiver to support concurrent writer (#10244) add 450518cdf6a

Re: [PR] [HUDI-7125] Fix bugs for CDC queries [hudi]

2023-12-05 Thread via GitHub
yihua merged PR #10144: URL: https://github.com/apache/hudi/pull/10144 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7077] Fix missing field error caused by meta columns [hudi]

2023-12-05 Thread via GitHub
yihua commented on PR #10216: URL: https://github.com/apache/hudi/pull/10216#issuecomment-1841954222 > This test itself runs for an hour or so. thats why we left it disabled. and run it just during releases. The tests ran before and were disabled by #9998. They should be re-enabed.

[PR] [HUDI-6954] Fixing unpartitioned datasets for col stats and bloom filter partition in MDT [hudi]

2023-12-05 Thread via GitHub
nsivabalan opened a new pull request, #10251: URL: https://github.com/apache/hudi/pull/10251 ### Change Logs Fixing unpartitioned datasets for col stats and bloom filter partition in MDT ### Impact Col stats and bloom filter should be directly queryable for both

[jira] [Updated] (HUDI-6954) Corrupted column stats in metadata table in non-partitioned table

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-6954: - Labels: pull-request-available (was: ) > Corrupted column stats in metadata table in

Re: [PR] [HUDI-7077] Fix missing field error caused by meta columns [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10216: URL: https://github.com/apache/hudi/pull/10216#issuecomment-1841910290 ## CI report: * 3b876ca26dd36fd17c3a4b3a9cf3d068caebd548 Azure:

[jira] [Created] (HUDI-7177) Test MOR snapshot queries with custom merger

2023-12-05 Thread Lin Liu (Jira)
Lin Liu created HUDI-7177: - Summary: Test MOR snapshot queries with custom merger Key: HUDI-7177 URL: https://issues.apache.org/jira/browse/HUDI-7177 Project: Apache Hudi Issue Type: Task

[jira] [Updated] (HUDI-7176) Add more test cases for core write and read

2023-12-05 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu updated HUDI-7176: -- Summary: Add more test cases for core write and read (was: Add more test cases ) > Add more test cases for

[jira] [Created] (HUDI-7176) Add more test cases

2023-12-05 Thread Lin Liu (Jira)
Lin Liu created HUDI-7176: - Summary: Add more test cases Key: HUDI-7176 URL: https://issues.apache.org/jira/browse/HUDI-7176 Project: Apache Hudi Issue Type: Task Reporter: Lin Liu

[jira] [Closed] (HUDI-7172) Fix the timeline archiver to support concurrent writer

2023-12-05 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-7172. Resolution: Fixed Fixed via master branch: 0b4a196f32fbc6bca1980ec693e5c929b19e54be > Fix the timeline

Re: [PR] [HUDI-7125] Fix bugs for CDC queries [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10144: URL: https://github.com/apache/hudi/pull/10144#issuecomment-1841853204 ## CI report: * cf7a4a013b8c6604b95dd1b0b38e14a6b26406ab Azure:

[jira] [Created] (HUDI-7175) Add test for event time merging

2023-12-05 Thread Lin Liu (Jira)
Lin Liu created HUDI-7175: - Summary: Add test for event time merging Key: HUDI-7175 URL: https://issues.apache.org/jira/browse/HUDI-7175 Project: Apache Hudi Issue Type: Task Reporter:

Re: [PR] [HUDI-7080] Enable two tests [hudi]

2023-12-05 Thread via GitHub
linliu-code commented on PR #10250: URL: https://github.com/apache/hudi/pull/10250#issuecomment-1841790736 Checked the ci failure, which should have been fixed by hudi-7077. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Assigned] (HUDI-7080) Re-enable a few tests with new Spark file format and file group reader

2023-12-05 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu reassigned HUDI-7080: - Assignee: Lin Liu > Re-enable a few tests with new Spark file format and file group reader >

(hudi) branch master updated: [HUDI-7172] Fix the timeline archiver to support concurrent writer (#10244)

2023-12-05 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 0b4a196f32f [HUDI-7172] Fix the timeline

Re: [PR] [HUDI-7172] Fix the timeline archiver to support concurrent writer [hudi]

2023-12-05 Thread via GitHub
danny0405 merged PR #10244: URL: https://github.com/apache/hudi/pull/10244 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [MINOR] Allow concurrent modification for heartbeat map [hudi]

2023-12-05 Thread via GitHub
yihua merged PR #10215: URL: https://github.com/apache/hudi/pull/10215 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(hudi) branch master updated (70a2064525a -> 3734162859f)

2023-12-05 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 70a2064525a [MINOR] Fixing view manager reuse with Embedded timeline server (#10240) add 3734162859f [MINOR] Allow

Re: [PR] [MINOR] Allow concurrent modification for heartbeat map [hudi]

2023-12-05 Thread via GitHub
yihua commented on PR #10215: URL: https://github.com/apache/hudi/pull/10215#issuecomment-1841720485 Failed tests are flaky. Merging this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Closed] (HUDI-7102) A file slice bug for the time travel queries for MOR tables

2023-12-05 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu closed HUDI-7102. - Resolution: Fixed > A file slice bug for the time travel queries for MOR tables >

Re: [PR] [HUDI-7080] Enable two tests [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10250: URL: https://github.com/apache/hudi/pull/10250#issuecomment-1841714939 ## CI report: * f8f59d07b5e26db920698176b79bc79abab89104 Azure:

Re: [PR] [HUDI-7078] Re-enable TestNestedSchemaPruningOptimization [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10245: URL: https://github.com/apache/hudi/pull/10245#issuecomment-1841714850 ## CI report: * d1767a58db6482dd33062a522412ea0758ef313c Azure:

Re: [PR] [HUDI-7080] Enable two tests [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10250: URL: https://github.com/apache/hudi/pull/10250#issuecomment-1841703474 ## CI report: * f8f59d07b5e26db920698176b79bc79abab89104 Azure:

Re: [PR] [HUDI-7078] Re-enable TestNestedSchemaPruningOptimization [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10245: URL: https://github.com/apache/hudi/pull/10245#issuecomment-184170 ## CI report: * d1767a58db6482dd33062a522412ea0758ef313c Azure:

Re: [PR] [HUDI-7125] Fix bugs for CDC queries [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10144: URL: https://github.com/apache/hudi/pull/10144#issuecomment-1841691366 ## CI report: * 3252779dc0eecf1c7b455125f6ca116d540efed9 Azure:

Re: [PR] [HUDI-7078] Re-enable TestNestedSchemaPruningOptimization [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10245: URL: https://github.com/apache/hudi/pull/10245#issuecomment-1841691810 ## CI report: * d1767a58db6482dd33062a522412ea0758ef313c Azure:

Re: [I] [SUPPORT] Large gap between stages on read [hudi]

2023-12-05 Thread via GitHub
noahtaite closed issue #10239: [SUPPORT] Large gap between stages on read URL: https://github.com/apache/hudi/issues/10239 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] [SUPPORT] Large gap between stages on read [hudi]

2023-12-05 Thread via GitHub
noahtaite commented on issue #10239: URL: https://github.com/apache/hudi/issues/10239#issuecomment-1841683174 @ad1happy2go Thank you for the response. I confirmed my readers **were not** setting this option on read, thinking it was enabled by default. After enabling, the large gap

Re: [PR] [HUDI-7080] Enable two tests [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10250: URL: https://github.com/apache/hudi/pull/10250#issuecomment-1841631465 ## CI report: * f8f59d07b5e26db920698176b79bc79abab89104 Azure:

Re: [PR] [HUDI-6836] Shutting down deltastreamer in tests and shutting down metrics for write client [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #9667: URL: https://github.com/apache/hudi/pull/9667#issuecomment-1841630466 ## CI report: * bb4d4d8e964a17b520b6dc932fefb8c216d6df1c Azure:

Re: [PR] [HUDI-7080] Enable two tests [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10250: URL: https://github.com/apache/hudi/pull/10250#issuecomment-1841621683 ## CI report: * f8f59d07b5e26db920698176b79bc79abab89104 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7125] Fix bugs for CDC queries [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10144: URL: https://github.com/apache/hudi/pull/10144#issuecomment-1841620986 ## CI report: * 3252779dc0eecf1c7b455125f6ca116d540efed9 Azure:

[jira] [Updated] (HUDI-7080) Re-enable a few tests with new Spark file format and file group reader

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7080: - Labels: pull-request-available (was: ) > Re-enable a few tests with new Spark file format and

[PR] [HUDI-7080] Enable two tests [hudi]

2023-12-05 Thread via GitHub
linliu-code opened a new pull request, #10250: URL: https://github.com/apache/hudi/pull/10250 ### Change Logs Re-enable two tests which were failing during our release. ### Impact Improve robustness of Hudi. ### Risk level (write none, low medium or high below)

Re: [PR] [HUDI-7077] Fix OOM error for a test [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10216: URL: https://github.com/apache/hudi/pull/10216#issuecomment-1841559269 ## CI report: * 377d575507cb070d98c60cfc694a5ecb1b7367d2 Azure:

Re: [PR] [HUDI-7125] Fix bugs for CDC queries [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10144: URL: https://github.com/apache/hudi/pull/10144#issuecomment-1841559048 ## CI report: * 3252779dc0eecf1c7b455125f6ca116d540efed9 Azure:

Re: [PR] [HUDI-6836] Shutting down deltastreamer in tests and shutting down metrics for write client [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #9667: URL: https://github.com/apache/hudi/pull/9667#issuecomment-1841558494 ## CI report: * c781a6a5b146b562f290633fda4694694ca2d550 Azure:

Re: [PR] [HUDI-7077] Fix OOM error for a test [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10216: URL: https://github.com/apache/hudi/pull/10216#issuecomment-1841549428 ## CI report: * 377d575507cb070d98c60cfc694a5ecb1b7367d2 Azure:

Re: [PR] [HUDI-7125] Fix bugs for CDC queries [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10144: URL: https://github.com/apache/hudi/pull/10144#issuecomment-1841549138 ## CI report: * 3252779dc0eecf1c7b455125f6ca116d540efed9 Azure:

Re: [PR] [HUDI-6836] Shutting down deltastreamer in tests and shutting down metrics for write client [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #9667: URL: https://github.com/apache/hudi/pull/9667#issuecomment-1841548555 ## CI report: * c781a6a5b146b562f290633fda4694694ca2d550 Azure:

Re: [PR] [HUDI-6836] Shutting down deltastreamer in tests and shutting down metrics for write client [hudi]

2023-12-05 Thread via GitHub
bvaradar commented on PR #9667: URL: https://github.com/apache/hudi/pull/9667#issuecomment-1841521208 Updated the PR after merging conflicts -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [HUDI-7078] Re-enable TestNestedSchemaPruningOptimization [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10245: URL: https://github.com/apache/hudi/pull/10245#issuecomment-1841483995 ## CI report: * c19b11e3015715188f55eebc2dce407348eda454 Azure:

Re: [PR] [HUDI-7078] Re-enable TestNestedSchemaPruningOptimization [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10245: URL: https://github.com/apache/hudi/pull/10245#issuecomment-1841472512 ## CI report: * c19b11e3015715188f55eebc2dce407348eda454 Azure:

Re: [PR] In the Flink catalog scenario, solve the problem of using SimpleKeyGe… [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10227: URL: https://github.com/apache/hudi/pull/10227#issuecomment-1841461283 ## CI report: * 132d7d0f9d7960539b262454300b1241bab845ee Azure:

Re: [PR] [HUDI-7135] Spark reads hudi table error when flink creates the table without pre… [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10157: URL: https://github.com/apache/hudi/pull/10157#issuecomment-1841446051 ## CI report: * 799dddf6479b1e1eeade99caa0d49a4dde484bfd Azure:

Re: [PR] [HUDI-7125] Fix bugs for CDC queries [hudi]

2023-12-05 Thread via GitHub
yihua commented on code in PR #10144: URL: https://github.com/apache/hudi/pull/10144#discussion_r1416117334 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/HoodieFileGroupReaderBasedParquetFileFormat.scala: ## @@

Re: [PR] [HUDI-7173] Fix hudi-on-flink read issues involving schema evolution … [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10247: URL: https://github.com/apache/hudi/pull/10247#issuecomment-1841361498 ## CI report: * 41539b8c02774378535f5a75cb66570d51b99aad UNKNOWN * a7e024174e549c3d13999022358653f779f7bc10 Azure:

Re: [PR] [HUDI-7077] Fix OOM error for a test [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10216: URL: https://github.com/apache/hudi/pull/10216#issuecomment-1841264065 ## CI report: * 377d575507cb070d98c60cfc694a5ecb1b7367d2 Azure:

Re: [PR] [HUDI-7171] Fix 'show partitions' not display rewritten partitions [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10242: URL: https://github.com/apache/hudi/pull/10242#issuecomment-1841249866 ## CI report: * b23c47f2029f3c9cbeecc3608c6dc00c2af684e9 Azure:

[jira] [Updated] (HUDI-7174) Fix ITTestHoodieDataSource.testMultipleLogBlocksWithDataSkipping:1645

2023-12-05 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu updated HUDI-7174: -- Description: {code:java} Error: testMultipleLogBlocksWithDataSkipping Time elapsed: 2.289 s <<< FAILURE!

[jira] [Created] (HUDI-7174) Fix ITTestHoodieDataSource.testMultipleLogBlocksWithDataSkipping:1645

2023-12-05 Thread Lin Liu (Jira)
Lin Liu created HUDI-7174: - Summary: Fix ITTestHoodieDataSource.testMultipleLogBlocksWithDataSkipping:1645 Key: HUDI-7174 URL: https://issues.apache.org/jira/browse/HUDI-7174 Project: Apache Hudi

[jira] [Assigned] (HUDI-7174) Fix ITTestHoodieDataSource.testMultipleLogBlocksWithDataSkipping:1645

2023-12-05 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu reassigned HUDI-7174: - Assignee: Danny Chen > FixITTestHoodieDataSource.testMultipleLogBlocksWithDataSkipping:1645 >

Re: [PR] [HUDI-7059] Hudi filter pushdown for positional merging [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10167: URL: https://github.com/apache/hudi/pull/10167#issuecomment-1841149433 ## CI report: * 25ee0036413d10722d804e0c935162f2175d7934 UNKNOWN * ce28d60f139e8baac53710b32774d38677abf37f Azure:

Re: [PR] [HUDI-7078] Re-enable TestNestedSchemaPruningOptimization [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10245: URL: https://github.com/apache/hudi/pull/10245#issuecomment-1841132444 ## CI report: * c19b11e3015715188f55eebc2dce407348eda454 Azure:

Re: [PR] [HUDI-7078] Re-enable TestNestedSchemaPruningOptimization [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10245: URL: https://github.com/apache/hudi/pull/10245#issuecomment-1841113322 ## CI report: * c19b11e3015715188f55eebc2dce407348eda454 Azure:

Re: [PR] [HUDI-7078] Re-enable TestNestedSchemaPruningOptimization [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10245: URL: https://github.com/apache/hudi/pull/10245#issuecomment-1841096365 ## CI report: * c19b11e3015715188f55eebc2dce407348eda454 Azure:

Re: [PR] [HUDI-7172] Fix the timeline archiver to support concurrent writer [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10244: URL: https://github.com/apache/hudi/pull/10244#issuecomment-1841012424 ## CI report: * 3763acfffaf1ac4760865f11edeb1cf91a91942c Azure:

Re: [PR] [HUDI-7125] Fix bugs for CDC queries [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10144: URL: https://github.com/apache/hudi/pull/10144#issuecomment-1840753689 ## CI report: * 3252779dc0eecf1c7b455125f6ca116d540efed9 Azure:

Re: [PR] [HUDI-7140] [DNM] Trial Patch to test CI run [hudi]

2023-12-05 Thread via GitHub
hudi-bot commented on PR #10176: URL: https://github.com/apache/hudi/pull/10176#issuecomment-1840753900 ## CI report: * 574d9561fdf35a76412a1f1d968b0588be2454f9 Azure:

Re: [PR] [HUDI-5823][RFC-65] RFC for Partition Lifecycle Management [hudi]

2023-12-05 Thread via GitHub
geserdugarov commented on PR #8062: URL: https://github.com/apache/hudi/pull/8062#issuecomment-1840714919 > @danny0405 @geserdugarov Thanks for your review! I have addressed all comments, hope for your opinions. @stream2000 Thank you for reply. As you mentioned, I've wrote all my

Re: [PR] [HUDI-5823][RFC-65] RFC for Partition Lifecycle Management [hudi]

2023-12-05 Thread via GitHub
geserdugarov commented on code in PR #8062: URL: https://github.com/apache/hudi/pull/8062#discussion_r1415523349 ## rfc/rfc-65/rfc-65.md: ## @@ -0,0 +1,209 @@ +## Proposers + +- @stream2000 +- @hujincalrin +- @huberylee +- @YuweiXiao + +## Approvers + +## Status + +JIRA:

  1   2   >