Re: [PR] [HUDI-7197] Adding mis fixes related with table services testing [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10280: URL: https://github.com/apache/hudi/pull/10280#issuecomment-1846683099 ## CI report: * 058081cf29ac5df752f777bcdbada03d1aeef9c8 Azure:

Re: [PR] [HUDI-7197] Adding mis fixes related with table services testing [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10280: URL: https://github.com/apache/hudi/pull/10280#issuecomment-1846674479 ## CI report: * 058081cf29ac5df752f777bcdbada03d1aeef9c8 Azure:

Re: [PR] [HUDI-7169][TEST]Add test case with the partition value is null to PartitionPruner [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10279: URL: https://github.com/apache/hudi/pull/10279#issuecomment-1846668084 ## CI report: * 94e2b6030dc3d9f3b414b9c37f90060511fad33d Azure:

Re: [PR] [HUDI-5973] Fixing refreshing of schemas in HoodieStreamer continuous mode [hudi]

2023-12-07 Thread via GitHub
nsivabalan commented on code in PR #10261: URL: https://github.com/apache/hudi/pull/10261#discussion_r1419995289 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/schema/FilebasedSchemaProvider.java: ## @@ -87,4 +95,11 @@ private static Schema

Re: [PR] [HUDI-7197] Adding mis fixes related with table services testing [hudi]

2023-12-07 Thread via GitHub
harsh1231 commented on code in PR #10280: URL: https://github.com/apache/hudi/pull/10280#discussion_r1419991310 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieDefaultTimeline.java: ## @@ -131,6 +131,14 @@ public HoodieTimeline

Re: [PR] [HUDI-7197] Adding mis fixes related with table services testing [hudi]

2023-12-07 Thread via GitHub
harsh1231 commented on code in PR #10280: URL: https://github.com/apache/hudi/pull/10280#discussion_r1419991310 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieDefaultTimeline.java: ## @@ -131,6 +131,14 @@ public HoodieTimeline

Re: [PR] [HUDI-7197] Adding mis fixes related with table services testing [hudi]

2023-12-07 Thread via GitHub
nsivabalan commented on code in PR #10280: URL: https://github.com/apache/hudi/pull/10280#discussion_r1419990894 ## hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieDefaultTimeline.java: ## @@ -131,6 +131,14 @@ public HoodieTimeline

Re: [PR] [HUDI-7197] Adding mis fixes related with table services testing [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10280: URL: https://github.com/apache/hudi/pull/10280#issuecomment-1846610471 ## CI report: * 058081cf29ac5df752f777bcdbada03d1aeef9c8 Azure:

Re: [PR] [HUDI-7197] Adding mis fixes related with table services testing [hudi]

2023-12-07 Thread via GitHub
nsivabalan commented on code in PR #10280: URL: https://github.com/apache/hudi/pull/10280#discussion_r1419962937 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/BaseCommitActionExecutor.java: ## @@ -285,6 +285,7 @@ protected

Re: [PR] [HUDI-7159]Check the table type between hoodie.properies and table options [hudi]

2023-12-07 Thread via GitHub
hehuiyuan commented on code in PR #10209: URL: https://github.com/apache/hudi/pull/10209#discussion_r1419955281 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java: ## @@ -100,6 +100,7 @@ public DynamicTableSink

Re: [PR] [HUDI-7159]Check the table type between hoodie.properies and table options [hudi]

2023-12-07 Thread via GitHub
hehuiyuan commented on code in PR #10209: URL: https://github.com/apache/hudi/pull/10209#discussion_r1419955281 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java: ## @@ -100,6 +100,7 @@ public DynamicTableSink

Re: [PR] [HUDI-7184] Add IncrementalQueryAnalyzer for completion time based in… [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10255: URL: https://github.com/apache/hudi/pull/10255#issuecomment-1846571904 ## CI report: * bde657c2c091c062c342b0600c3269bbc15ebaaa Azure:

Re: [PR] [HUDI-7198]Create nested node path if does not exist for zookeeper. [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10281: URL: https://github.com/apache/hudi/pull/10281#issuecomment-1846571978 ## CI report: * 42fe04327b9dbb6050b514641954739e686036a5 Azure:

[jira] [Updated] (HUDI-7198) Zookeeper lock provider nested node-path creation

2023-12-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7198: - Labels: pull-request-available (was: ) > Zookeeper lock provider nested node-path creation >

Re: [PR] [HUDI-7198]Create nested node path if does not exist for zookeeper. [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10281: URL: https://github.com/apache/hudi/pull/10281#issuecomment-1846566876 ## CI report: * 42fe04327b9dbb6050b514641954739e686036a5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7184] Add IncrementalQueryAnalyzer for completion time based in… [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10255: URL: https://github.com/apache/hudi/pull/10255#issuecomment-1846566776 ## CI report: * bde657c2c091c062c342b0600c3269bbc15ebaaa Azure:

Re: [PR] [HUDI-7197] Adding mis fixes related with table services testing [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10280: URL: https://github.com/apache/hudi/pull/10280#issuecomment-1846561581 ## CI report: * 058081cf29ac5df752f777bcdbada03d1aeef9c8 Azure:

Re: [I] Found duplicate column(s) in the data schema when tries to read COW table in incremental mode with Replacecommit action in timeline [hudi]

2023-12-07 Thread via GitHub
beyond1920 commented on issue #10258: URL: https://github.com/apache/hudi/issues/10258#issuecomment-1846540730 @eg-kazakov Hi, is the replacement commit generated by clustering or `insert overwrite`? we could skip it if it's generated by clustering, but we could not skip it if it's

[PR] Create nested node path if does not exist for zookeeper. [hudi]

2023-12-07 Thread via GitHub
harsh1231 opened a new pull request, #10281: URL: https://github.com/apache/hudi/pull/10281 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any

[jira] [Updated] (HUDI-7197) Mis bug fixes around table services

2023-12-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7197: - Labels: pull-request-available (was: ) > Mis bug fixes around table services >

Re: [PR] [HUDI-7197] Adding mis fixes related with table services testing [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10280: URL: https://github.com/apache/hudi/pull/10280#issuecomment-1846535533 ## CI report: * 058081cf29ac5df752f777bcdbada03d1aeef9c8 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[jira] [Created] (HUDI-7198) Zookeeper lock provider nested node-path creation

2023-12-07 Thread Harshal Patil (Jira)
Harshal Patil created HUDI-7198: --- Summary: Zookeeper lock provider nested node-path creation Key: HUDI-7198 URL: https://issues.apache.org/jira/browse/HUDI-7198 Project: Apache Hudi Issue

[jira] [Assigned] (HUDI-7197) Mis bug fixes around table services

2023-12-07 Thread Harshal Patil (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harshal Patil reassigned HUDI-7197: --- Assignee: Harshal Patil > Mis bug fixes around table services >

[jira] [Updated] (HUDI-7197) Mis bug fixes around table services

2023-12-07 Thread Harshal Patil (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harshal Patil updated HUDI-7197: Description: Fixes around compaction timeline .  Null-pointer exception for cleaner table service 

[jira] [Updated] (HUDI-7197) Mis bug fixes around table services

2023-12-07 Thread Harshal Patil (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harshal Patil updated HUDI-7197: Priority: Minor (was: Major) > Mis bug fixes around table services >

[PR] Adding mis fixes related with table services testing [hudi]

2023-12-07 Thread via GitHub
harsh1231 opened a new pull request, #10280: URL: https://github.com/apache/hudi/pull/10280 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any

[jira] [Created] (HUDI-7197) Mis bug fixes around table services

2023-12-07 Thread Harshal Patil (Jira)
Harshal Patil created HUDI-7197: --- Summary: Mis bug fixes around table services Key: HUDI-7197 URL: https://issues.apache.org/jira/browse/HUDI-7197 Project: Apache Hudi Issue Type: Bug

Re: [PR] [HUDI-7159]Check the table type between hoodie.properies and table options [hudi]

2023-12-07 Thread via GitHub
danny0405 commented on code in PR #10209: URL: https://github.com/apache/hudi/pull/10209#discussion_r1419911129 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java: ## @@ -100,6 +100,7 @@ public DynamicTableSink

Re: [PR] [HUDI-6658] inject filters for incremental query [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10225: URL: https://github.com/apache/hudi/pull/10225#issuecomment-1846522498 ## CI report: * 18ecefc2f57a446bfb5bb7d1cd0eaa23be1a0506 Azure:

[jira] [Closed] (HUDI-7196) Call register metric before rollback compcation for CompactionPlanOperator

2023-12-07 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-7196. Resolution: Fixed Fixed via master branch: d5ba82b60c77183c6abfdfb897b2d7174135d12b > Call register metric

[jira] [Updated] (HUDI-7196) Call register metric before rollback compcation for CompactionPlanOperator

2023-12-07 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-7196: - Fix Version/s: 1.0.0 > Call register metric before rollback compcation for CompactionPlanOperator >

[jira] [Updated] (HUDI-7196) Call register metric before rollback compcation for CompactionPlanOperator

2023-12-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7196: - Labels: pull-request-available (was: ) > Call register metric before rollback compcation for

(hudi) branch master updated: [HUDI-7196] Call register metric before rollback compcation (#10268)

2023-12-07 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new d5ba82b60c7 [HUDI-7196] Call register metric

Re: [PR] [HUDI-7196]Call register metric before rollback compcation for CompactionPlanOperator [hudi]

2023-12-07 Thread via GitHub
danny0405 merged PR #10268: URL: https://github.com/apache/hudi/pull/10268 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7169][TEST]Add test case with the partition value is null to PartitionPruner [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10279: URL: https://github.com/apache/hudi/pull/10279#issuecomment-1846497717 ## CI report: * 94e2b6030dc3d9f3b414b9c37f90060511fad33d Azure:

Re: [PR] [HUDI-7159]Check the table type between hoodie.properies and table options [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10209: URL: https://github.com/apache/hudi/pull/10209#issuecomment-1846497629 ## CI report: * 1241d0c1b026a3f262393caef26f5fa56f91b66e Azure:

Re: [PR] [HUDI-7169][TEST]Add test case with the partition value is null to PartitionPruner [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10279: URL: https://github.com/apache/hudi/pull/10279#issuecomment-1846493464 ## CI report: * 94e2b6030dc3d9f3b414b9c37f90060511fad33d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7159]Check the table type between hoodie.properies and table options [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10209: URL: https://github.com/apache/hudi/pull/10209#issuecomment-1846493352 ## CI report: * 1241d0c1b026a3f262393caef26f5fa56f91b66e Azure:

[jira] [Commented] (HUDI-7196) Call register metric before rollback compcation for CompactionPlanOperator

2023-12-07 Thread hehuiyuan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794500#comment-17794500 ] hehuiyuan commented on HUDI-7196: -   {{Caused by: java.lang.NullPointerException at

[jira] [Created] (HUDI-7196) Call register metric before rollback compcation for CompactionPlanOperator

2023-12-07 Thread hehuiyuan (Jira)
hehuiyuan created HUDI-7196: --- Summary: Call register metric before rollback compcation for CompactionPlanOperator Key: HUDI-7196 URL: https://issues.apache.org/jira/browse/HUDI-7196 Project: Apache Hudi

Re: [PR] [HUDI-7159]Check the table type between hoodie.properies and table options [hudi]

2023-12-07 Thread via GitHub
hehuiyuan commented on PR #10209: URL: https://github.com/apache/hudi/pull/10209#issuecomment-1846489369 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Closed] (HUDI-7135) Spark reads hudi table error when flink creates the table without preCombine fields by catalog or factory

2023-12-07 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-7135. Resolution: Fixed Fixed via master branch: f036ee498ce05acd25e8b866297aa8ce20ed711c > Spark reads hudi

[jira] [Updated] (HUDI-7135) Spark reads hudi table error when flink creates the table without preCombine fields by catalog or factory

2023-12-07 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-7135: - Fix Version/s: 1.0.0 > Spark reads hudi table error when flink creates the table without preCombine >

(hudi) branch master updated (60b668fc167 -> f036ee498ce)

2023-12-07 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 60b668fc167 [HUDI-5823][RFC-65] RFC for Partition Lifecycle Management (#8062) add f036ee498ce [HUDI-7135]

Re: [PR] [HUDI-7135] Spark reads hudi table error when flink creates the table without pre… [hudi]

2023-12-07 Thread via GitHub
danny0405 merged PR #10157: URL: https://github.com/apache/hudi/pull/10157 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] Add test case with the partition value is null to PartitionPruner [hudi]

2023-12-07 Thread via GitHub
hehuiyuan opened a new pull request, #10279: URL: https://github.com/apache/hudi/pull/10279 ### Change Logs Add test case with the partition value is null to PartitionPruner ### Impact ### Risk level (write none, low medium or high below) ###

Re: [PR] [HUDI-5823][RFC-65] RFC for Partition Lifecycle Management [hudi]

2023-12-07 Thread via GitHub
geserdugarov commented on PR #8062: URL: https://github.com/apache/hudi/pull/8062#issuecomment-1846475981 > @geserdugarov I'm gonna merge this one first, can you fire your suggestion chagne PR incrementally based on this one? And we can move the discussions there. @danny0405 Ok, I will

[jira] [Commented] (HUDI-5823) RFC-65 : Partition TTL Management

2023-12-07 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794494#comment-17794494 ] Danny Chen commented on HUDI-5823: -- RFC commit merged on master: 60b668fc1670e61f76393888e38dd9f817f92c1b

(hudi) branch master updated: [HUDI-5823][RFC-65] RFC for Partition Lifecycle Management (#8062)

2023-12-07 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 60b668fc167 [HUDI-5823][RFC-65] RFC for

Re: [PR] [HUDI-5823][RFC-65] RFC for Partition Lifecycle Management [hudi]

2023-12-07 Thread via GitHub
danny0405 merged PR #8062: URL: https://github.com/apache/hudi/pull/8062 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-5823][RFC-65] RFC for Partition Lifecycle Management [hudi]

2023-12-07 Thread via GitHub
danny0405 commented on PR #8062: URL: https://github.com/apache/hudi/pull/8062#issuecomment-1846473187 @geserdugarov I'm gonna merge this one first, can you fire your suggestion chagne PR incrementally based on this one? And we can move the discussions there. -- This is an automated

Re: [I] Found duplicate column(s) in the data schema when tries to read COW table in incremental mode with Replacecommit action in timeline [hudi]

2023-12-07 Thread via GitHub
danny0405 commented on issue #10258: URL: https://github.com/apache/hudi/issues/10258#issuecomment-1846471293 cc @beyond1920 for visibility. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] Found duplicate column(s) in the data schema when tries to read COW table in incremental mode with Replacecommit action in timeline [hudi]

2023-12-07 Thread via GitHub
danny0405 commented on issue #10258: URL: https://github.com/apache/hudi/issues/10258#issuecomment-1846471171 We are planning to migrate all our incremental queries to base on compleiton time instead of the instant time(start time), and would support the skipping for clustering and

Re: [I] [SUPPORT] [OCC] HoodieException: Error getting all file groups in pending clustering [hudi]

2023-12-07 Thread via GitHub
jjtjiang commented on issue #7057: URL: https://github.com/apache/hudi/issues/7057#issuecomment-1846470553 @ad1happy2go i also face this problem . version : hudi 0.12.3 how to reproduce the issue: just use the insert overwirte sql when insert a big table . here is my

Re: [PR] [HUDI-7190] Fix nested columns vectorized read for spark33+ legacy formats [hudi]

2023-12-07 Thread via GitHub
danny0405 commented on code in PR #10265: URL: https://github.com/apache/hudi/pull/10265#discussion_r1419872471 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestInsertTable.scala: ## @@ -2075,6 +2075,45 @@ class TestInsertTable extends

Re: [PR] [HUDI-6979][RFC-74] support event time based compaction strategy [hudi]

2023-12-07 Thread via GitHub
voonhous commented on PR #10266: URL: https://github.com/apache/hudi/pull/10266#issuecomment-1846464636 @waitingF Might need to update the RFC claim number as these **RFC-74** and **RFC-75** were claimed recently under this PR https://github.com/apache/hudi/pull/10275 -- This is

Re: [PR] [HUDI-7023] Support querying without syncing partition metadata to catalog [hudi]

2023-12-07 Thread via GitHub
codope commented on code in PR #10153: URL: https://github.com/apache/hudi/pull/10153#discussion_r1419868357 ## hudi-spark-datasource/hudi-spark3.2plus-common/src/main/scala/org/apache/spark/sql/hudi/catalog/HoodieCatalog.scala: ## @@ -369,4 +378,28 @@ object HoodieCatalog {

Re: [PR] [HUDI-7023] Support querying without syncing partition metadata to catalog [hudi]

2023-12-07 Thread via GitHub
codope commented on code in PR #10153: URL: https://github.com/apache/hudi/pull/10153#discussion_r1419865453 ## hudi-spark-datasource/hudi-spark3.2plus-common/src/main/scala/org/apache/spark/sql/hudi/catalog/HoodieCatalog.scala: ## @@ -369,4 +378,28 @@ object HoodieCatalog {

Re: [PR] [HUDI-7023] Support querying without syncing partition metadata to catalog [hudi]

2023-12-07 Thread via GitHub
codope commented on code in PR #10153: URL: https://github.com/apache/hudi/pull/10153#discussion_r1419864951 ## hudi-spark-datasource/hudi-spark3.2plus-common/src/main/scala/org/apache/spark/sql/hudi/catalog/HoodieCatalog.scala: ## @@ -54,7 +59,8 @@ class HoodieCatalog extends

Re: [PR] [HUDI-6658] inject filters for incremental query [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10225: URL: https://github.com/apache/hudi/pull/10225#issuecomment-1846457831 ## CI report: * fd247787271f2f9e52de1c32227dcea61420ab3c Azure:

Re: [PR] [HUDI-7023] Support querying without syncing partition metadata to catalog [hudi]

2023-12-07 Thread via GitHub
codope commented on code in PR #10153: URL: https://github.com/apache/hudi/pull/10153#discussion_r1419864232 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/command/index/TestFunctionalIndex.scala: ## @@ -140,6 +147,75 @@ class TestFunctionalIndex

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1846457921 ## CI report: * c95a0cbceff428fe3826039a11e604d4e4c1f7c0 Azure:

Re: [I] [SUPPORT][SPARK][NATIVE] make hudi integrate into gluten/velox [hudi]

2023-12-07 Thread via GitHub
YannByron commented on issue #10252: URL: https://github.com/apache/hudi/issues/10252#issuecomment-1846456893 > After we support HadoopFsRelation for all queries types, what else has been left for Gluten/Velox integration? A native reader is required for cases where the existing

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1846453228 ## CI report: * c95a0cbceff428fe3826039a11e604d4e4c1f7c0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-6658] inject filters for incremental query [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10225: URL: https://github.com/apache/hudi/pull/10225#issuecomment-1846453110 ## CI report: * fd247787271f2f9e52de1c32227dcea61420ab3c Azure:

Re: [PR] [MINOR] Relaxing required props with defaults [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10259: URL: https://github.com/apache/hudi/pull/10259#issuecomment-1846448289 ## CI report: * 7793ad61ab80a490afee76b533133fd9f78f6f49 Azure:

[PR] [HUDI-7045] Create parquet readers inside the reader context [hudi]

2023-12-07 Thread via GitHub
jonvex opened a new pull request, #10278: URL: https://github.com/apache/hudi/pull/10278 ### Change Logs First step to implementing schema evolution is to create the readers in the reader context instead of passing in map. ### Impact Will enable us to implement schema

[jira] [Closed] (HUDI-7137) Implement bootstrap for new filegroup reader

2023-12-07 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7137. - Resolution: Fixed > Implement bootstrap for new filegroup reader >

Re: [PR] Fg reader make parquet reader [hudi]

2023-12-07 Thread via GitHub
jonvex closed pull request #10276: Fg reader make parquet reader URL: https://github.com/apache/hudi/pull/10276 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] [MINOR] Fix functional index for nonpartitioned table [hudi]

2023-12-07 Thread via GitHub
codope commented on PR #10271: URL: https://github.com/apache/hudi/pull/10271#issuecomment-1846434557 Thanks for the fix @Alowator -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [HUDI-6658] inject filters for incremental query [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10225: URL: https://github.com/apache/hudi/pull/10225#issuecomment-1846415293 ## CI report: * fd247787271f2f9e52de1c32227dcea61420ab3c Azure:

(hudi) branch master updated (78a84ea7521 -> 48b59869140)

2023-12-07 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 78a84ea7521 [HUDI-7137] Implement Bootstrap for new FG reader (#10137) add 48b59869140 [MINOR] Fix functional

Re: [PR] [MINOR] Fix functional index for nonpartitioned table [hudi]

2023-12-07 Thread via GitHub
bvaradar merged PR #10271: URL: https://github.com/apache/hudi/pull/10271 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [Hudi 7175] Add unit tests for event time merging [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10277: URL: https://github.com/apache/hudi/pull/10277#issuecomment-1846302737 ## CI report: * 9536c32add0a438554ebb5ae5819546706c4e5fb Azure:

Re: [I] [SUPPORT][SPARK][NATIVE] make hudi integrate into gluten/velox [hudi]

2023-12-07 Thread via GitHub
linliu-code commented on issue #10252: URL: https://github.com/apache/hudi/issues/10252#issuecomment-1846269966 After we support HadoopFsRelation for all queries types, what else has been left for Gluten/Velox integration? -- This is an automated message from the Apache Git Service. To

Re: [PR] Fg reader make parquet reader [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10276: URL: https://github.com/apache/hudi/pull/10276#issuecomment-1846267408 ## CI report: * 7c428bb0dd431f0f99e306f4fbb561ddadb922ec Azure:

Re: [PR] [HUDI-6658] inject filters for incremental query [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10225: URL: https://github.com/apache/hudi/pull/10225#issuecomment-1846267211 ## CI report: * 1ba88ec8c8a18247b628741e5cac180f15f0d8a9 Azure:

Re: [PR] [Hudi 7175] Add unit tests for event time merging [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10277: URL: https://github.com/apache/hudi/pull/10277#issuecomment-1846261476 ## CI report: * 9536c32add0a438554ebb5ae5819546706c4e5fb Azure:

Re: [PR] [HUDI-6658] inject filters for incremental query [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10225: URL: https://github.com/apache/hudi/pull/10225#issuecomment-1846261324 ## CI report: * 73f73cc86999e819f584f9c63bfb49f9e9636ea5 Azure:

Re: [PR] [Hudi 7175] Add unit tests for event time merging [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10277: URL: https://github.com/apache/hudi/pull/10277#issuecomment-1846255694 ## CI report: * 9536c32add0a438554ebb5ae5819546706c4e5fb UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-6658] inject filters for incremental query [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10225: URL: https://github.com/apache/hudi/pull/10225#issuecomment-184625 ## CI report: * 73f73cc86999e819f584f9c63bfb49f9e9636ea5 Azure:

Re: [PR] [HUDI-6658] inject filters for incremental query [hudi]

2023-12-07 Thread via GitHub
jonvex closed pull request #10063: [HUDI-6658] inject filters for incremental query URL: https://github.com/apache/hudi/pull/10063 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [MINOR] Fix functional index for nonpartitioned table [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10271: URL: https://github.com/apache/hudi/pull/10271#issuecomment-1846248254 ## CI report: * 70a599e309a32014162b0212ac39656972408995 Azure:

(hudi) branch master updated: [HUDI-7137] Implement Bootstrap for new FG reader (#10137)

2023-12-07 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 78a84ea7521 [HUDI-7137] Implement Bootstrap for

Re: [PR] [HUDI-7137] Implement Bootstrap for new FG reader [hudi]

2023-12-07 Thread via GitHub
yihua merged PR #10137: URL: https://github.com/apache/hudi/pull/10137 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7137] Implement Bootstrap for new FG reader [hudi]

2023-12-07 Thread via GitHub
yihua commented on PR #10137: URL: https://github.com/apache/hudi/pull/10137#issuecomment-1846236617 CI is green. https://github.com/apache/hudi/assets/2497195/13a096e5-3d67-4dd3-88dd-7a7e11bc27ad;> -- This is an automated message from the Apache Git Service. To respond to the

[PR] [Hudi 7175] Add unit tests for event time merging [hudi]

2023-12-07 Thread via GitHub
linliu-code opened a new pull request, #10277: URL: https://github.com/apache/hudi/pull/10277 ### Change Logs Added the unit tests for event time merging. ### Impact Improve system robustness. ### Risk level (write none, low medium or high below) None.

Re: [PR] Fg reader make parquet reader [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10276: URL: https://github.com/apache/hudi/pull/10276#issuecomment-1846209584 ## CI report: * 7c428bb0dd431f0f99e306f4fbb561ddadb922ec Azure:

Re: [PR] [MINOR] Relaxing required props with defaults [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10259: URL: https://github.com/apache/hudi/pull/10259#issuecomment-1846209478 ## CI report: * c01f4cd3deaf7ddfca671b4810595a75741d6ff1 Azure:

Re: [PR] Fg reader make parquet reader [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10276: URL: https://github.com/apache/hudi/pull/10276#issuecomment-1846201299 ## CI report: * 7c428bb0dd431f0f99e306f4fbb561ddadb922ec UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [MINOR] Relaxing required props with defaults [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10259: URL: https://github.com/apache/hudi/pull/10259#issuecomment-1846201187 ## CI report: * c01f4cd3deaf7ddfca671b4810595a75741d6ff1 Azure:

Re: [PR] Call register metric before rollback compcation for CompactionPlanOperator [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10268: URL: https://github.com/apache/hudi/pull/10268#issuecomment-1846193208 ## CI report: * cdb05bb26631b69f5db9a2a3399f5c230abd33a7 Azure:

Re: [PR] [HUDI-7190] Fix nested columns vectorized read for spark33+ legacy formats [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10265: URL: https://github.com/apache/hudi/pull/10265#issuecomment-1846193152 ## CI report: * 46d0981677ee34913bbeaee46c6e6e783712d51c Azure:

[PR] Fg reader make parquet reader [hudi]

2023-12-07 Thread via GitHub
jonvex opened a new pull request, #10276: URL: https://github.com/apache/hudi/pull/10276 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any

Re: [PR] Incr query real [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10225: URL: https://github.com/apache/hudi/pull/10225#issuecomment-1846134728 ## CI report: * 73f73cc86999e819f584f9c63bfb49f9e9636ea5 Azure:

Re: [PR] Incr query real [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10225: URL: https://github.com/apache/hudi/pull/10225#issuecomment-1846125919 ## CI report: * 73f73cc86999e819f584f9c63bfb49f9e9636ea5 Azure:

Re: [PR] [HUDI-7194] Claim RFC-74 and RFC-75 [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10275: URL: https://github.com/apache/hudi/pull/10275#issuecomment-1846062960 ## CI report: * fa1b6be1cae51e37efc89ae162df85dcad9ef0b0 Azure:

(hudi) branch master updated: [HUDI-7194][HUDI-7195] Claim RFC-74 and RFC-75 (#10275)

2023-12-07 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 115c01be37b [HUDI-7194][HUDI-7195] Claim RFC-74

Re: [PR] [HUDI-7194] Claim RFC-74 and RFC-75 [hudi]

2023-12-07 Thread via GitHub
yihua merged PR #10275: URL: https://github.com/apache/hudi/pull/10275 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7194][HUDI-7195] Claim RFC-74 and RFC-75 [hudi]

2023-12-07 Thread via GitHub
hudi-bot commented on PR #10275: URL: https://github.com/apache/hudi/pull/10275#issuecomment-1846052160 ## CI report: * fa1b6be1cae51e37efc89ae162df85dcad9ef0b0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

  1   2   >