[GitHub] [hudi] hudi-bot commented on pull request #5564: [HUDI-4087] Support dropping RO and RT table in DropHoodieTableCommand

2022-05-15 Thread GitBox
hudi-bot commented on PR #5564: URL: https://github.com/apache/hudi/pull/5564#issuecomment-1126875752 ## CI report: * ed44089bf95146b90871ec173056a3296c9f3a2e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5560: [HUDI-2673] Add kafka connect sink in docker demo

2022-05-15 Thread GitBox
hudi-bot commented on PR #5560: URL: https://github.com/apache/hudi/pull/5560#issuecomment-1126891700 ## CI report: * dae11df4242147242d90ebf72b5c6983bdcd62b6 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5564: [HUDI-4087] Support dropping RO and RT table in DropHoodieTableCommand

2022-05-15 Thread GitBox
hudi-bot commented on PR #5564: URL: https://github.com/apache/hudi/pull/5564#issuecomment-1126891707 ## CI report: * 1678247d3b83688ad92590aa2626d153475c0509 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5564: [HUDI-4087] Support dropping RO and RT table in DropHoodieTableCommand

2022-05-15 Thread GitBox
hudi-bot commented on PR #5564: URL: https://github.com/apache/hudi/pull/5564#issuecomment-1126875271 ## CI report: * ed44089bf95146b90871ec173056a3296c9f3a2e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5560: [HUDI-2673] Add kafka connect sink in docker demo

2022-05-15 Thread GitBox
hudi-bot commented on PR #5560: URL: https://github.com/apache/hudi/pull/5560#issuecomment-1126902519 ## CI report: * 3203eb09510f40b607078ded11159ce135ed2e11 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5587: fix rat plugin issue

2022-05-15 Thread GitBox
hudi-bot commented on PR #5587: URL: https://github.com/apache/hudi/pull/5587#issuecomment-1126903528 ## CI report: * dc7921b3be5d009873a13ec761386e52ad952854 Azure:

[GitHub] [hudi] gnailJC opened a new issue, #5586: [SUPPORT] 0.11.0 SparkSQL ParseException occurs in 0.11.0 when creating view with `timestamp as of`

2022-05-15 Thread GitBox
gnailJC opened a new issue, #5586: URL: https://github.com/apache/hudi/issues/5586 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? yes - Join the mailing list to engage in conversations and get faster support at

[GitHub] [hudi] hudi-bot commented on pull request #5560: [HUDI-2673] Add kafka connect sink in docker demo

2022-05-15 Thread GitBox
hudi-bot commented on PR #5560: URL: https://github.com/apache/hudi/pull/5560#issuecomment-1126892198 ## CI report: * dae11df4242147242d90ebf72b5c6983bdcd62b6 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5320: [HUDI-3861] update tblp 'path' when rename table

2022-05-15 Thread GitBox
hudi-bot commented on PR #5320: URL: https://github.com/apache/hudi/pull/5320#issuecomment-1126894380 ## CI report: * b0064e9b4c46e6bb2398eddd3a5161c53ac62421 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5320: [HUDI-3861] update tblp 'path' when rename table

2022-05-15 Thread GitBox
hudi-bot commented on PR #5320: URL: https://github.com/apache/hudi/pull/5320#issuecomment-1126900295 ## CI report: * b0064e9b4c46e6bb2398eddd3a5161c53ac62421 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5587: fix rat plugin issue

2022-05-15 Thread GitBox
hudi-bot commented on PR #5587: URL: https://github.com/apache/hudi/pull/5587#issuecomment-1126903081 ## CI report: * dc7921b3be5d009873a13ec761386e52ad952854 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] uday08bce opened a new pull request, #5587: fix rat plugin issue

2022-05-15 Thread GitBox
uday08bce opened a new pull request, #5587: URL: https://github.com/apache/hudi/pull/5587 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] xiarixiaoyao commented on a diff in pull request #5572: [HUDI-3654] Preparations for hudi metastore.

2022-05-15 Thread GitBox
xiarixiaoyao commented on code in PR #5572: URL: https://github.com/apache/hudi/pull/5572#discussion_r873115257 ## hudi-common/src/main/java/org/apache/hudi/common/config/HoodieMetastoreConfig.java: ## @@ -0,0 +1,93 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [hudi] xiarixiaoyao commented on pull request #5572: [HUDI-3654] Preparations for hudi metastore.

2022-05-15 Thread GitBox
xiarixiaoyao commented on PR #5572: URL: https://github.com/apache/hudi/pull/5572#issuecomment-1126868812 LGTM @minihippo just a few comments, looking forward to the implementation of HoodieTableMetastoreClient -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] hudi-bot commented on pull request #5478: [HUDI-3998] Fix getCommitsSinceLastCleaning failed when async cleaning

2022-05-15 Thread GitBox
hudi-bot commented on PR #5478: URL: https://github.com/apache/hudi/pull/5478#issuecomment-1126874791 ## CI report: * cece46a6cd515e141779415a499e8942f3589375 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5587: fix rat plugin issue

2022-05-15 Thread GitBox
hudi-bot commented on PR #5587: URL: https://github.com/apache/hudi/pull/5587#issuecomment-1126915244 ## CI report: * dc7921b3be5d009873a13ec761386e52ad952854 Azure:

[GitHub] [hudi] KnightChess commented on a diff in pull request #5320: [HUDI-3861] update tblp 'path' when rename table

2022-05-15 Thread GitBox
KnightChess commented on code in PR #5320: URL: https://github.com/apache/hudi/pull/5320#discussion_r873147813 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/command/AlterHoodieTableRenameCommand.scala: ## @@ -47,7 +47,7 @@ case class

[GitHub] [hudi] KnightChess commented on a diff in pull request #5320: [HUDI-3861] update tblp 'path' when rename table

2022-05-15 Thread GitBox
KnightChess commented on code in PR #5320: URL: https://github.com/apache/hudi/pull/5320#discussion_r873147603 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestAlterTable.scala: ## @@ -194,9 +194,14 @@ class TestAlterTable extends

[GitHub] [hudi] bettermouse commented on issue #5569: [SUPPORT] Issues with URL_ENCODE_PARTITIONING_OPT_KEY in hudi 0.11.0

2022-05-15 Thread GitBox
bettermouse commented on issue #5569: URL: https://github.com/apache/hudi/issues/5569#issuecomment-1126979897 //hudi-client/hudi-client-common/src/main/java/org/apache/hudi/keygen/KeyGenUtils.java getRecordPartitionPath //https://github.com/apache/hudi/pull/2645

[GitHub] [hudi] hudi-bot commented on pull request #5320: [HUDI-3861] update tblp 'path' when rename table

2022-05-15 Thread GitBox
hudi-bot commented on PR #5320: URL: https://github.com/apache/hudi/pull/5320#issuecomment-1126910787 ## CI report: * 855eb02e145337afea5b1e9bec95c60ecd282bc8 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3599: [HUDI-2207] Support independent flink hudi clustering function

2022-05-15 Thread GitBox
hudi-bot commented on PR #3599: URL: https://github.com/apache/hudi/pull/3599#issuecomment-1127150032 ## CI report: * c3405300e9bc97445637c7251536ec0f0d6fbbd1 UNKNOWN * e5003cfa74eb34255bceb50f1916c57c9c8812de Azure:

[jira] [Updated] (HUDI-4100) CTAS failed to clean up when given an illegal MANAGED table definition

2022-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4100: - Labels: pull-request-available (was: ) > CTAS failed to clean up when given an illegal MANAGED

[GitHub] [hudi] jinxing64 opened a new pull request, #5588: [HUDI-4100] CTAS failed to clean up when given an illegal MANAGED table definition

2022-05-15 Thread GitBox
jinxing64 opened a new pull request, #5588: URL: https://github.com/apache/hudi/pull/5588 ## What is the purpose of the pull request Current HoodieStagedTable#abortStagedChanges cleans up data path by the table property of location, which doesn't work for a MANAGED table. This PR

[GitHub] [hudi] BruceKellan closed issue #5561: [SUPPORT] [Metadata table] Metadata table heartbeat for instant has expired, last heartbeat 0

2022-05-15 Thread GitBox
BruceKellan closed issue #5561: [SUPPORT] [Metadata table] Metadata table heartbeat for instant has expired, last heartbeat 0 URL: https://github.com/apache/hudi/issues/5561 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] BruceKellan commented on issue #5561: [SUPPORT] [Metadata table] Metadata table heartbeat for instant has expired, last heartbeat 0

2022-05-15 Thread GitBox
BruceKellan commented on issue #5561: URL: https://github.com/apache/hudi/issues/5561#issuecomment-1127153034 I will close this issue. If there are still problems I will reopen this issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hudi] jinxing64 commented on a diff in pull request #5588: [HUDI-4100] CTAS failed to clean up when given an illegal MANAGED table definition

2022-05-15 Thread GitBox
jinxing64 commented on code in PR #5588: URL: https://github.com/apache/hudi/pull/5588#discussion_r873303190 ## hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/hudi/catalog/HoodieCatalog.scala: ## @@ -192,8 +200,31 @@ class HoodieCatalog extends

[GitHub] [hudi] lihuahui5683 closed issue #5382: [SUPPORT] org.apache.hudi.hadoop.hive.HoodieCombineRealtimeFileSplit cannot be cast to org.apache.hadoop.hive.shims.HadoopShimsSecure$InputSplitShim

2022-05-15 Thread GitBox
lihuahui5683 closed issue #5382: [SUPPORT] org.apache.hudi.hadoop.hive.HoodieCombineRealtimeFileSplit cannot be cast to org.apache.hadoop.hive.shims.HadoopShimsSecure$InputSplitShim URL: https://github.com/apache/hudi/issues/5382 -- This is an automated message from the Apache Git Service.

[jira] [Created] (HUDI-4101) Bucket index hash algorithm should take partition path for better dispersion

2022-05-15 Thread Danny Chen (Jira)
Danny Chen created HUDI-4101: Summary: Bucket index hash algorithm should take partition path for better dispersion Key: HUDI-4101 URL: https://issues.apache.org/jira/browse/HUDI-4101 Project: Apache

[GitHub] [hudi] wzx140 commented on a diff in pull request #5522: [HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

2022-05-15 Thread GitBox
wzx140 commented on code in PR #5522: URL: https://github.com/apache/hudi/pull/5522#discussion_r873308062 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieAppendHandle.java: ## @@ -201,33 +202,24 @@ protected boolean isUpdateRecord(HoodieRecord

[GitHub] [hudi] BalaMahesh opened a new issue, #5591: [SUPPORT] Hudi Error rolling back using marker files

2022-05-15 Thread GitBox
BalaMahesh opened a new issue, #5591: URL: https://github.com/apache/hudi/issues/5591 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at

[GitHub] [hudi] XuQianJin-Stars commented on pull request #5564: [HUDI-4087] Support dropping RO and RT table in DropHoodieTableCommand

2022-05-15 Thread GitBox
XuQianJin-Stars commented on PR #5564: URL: https://github.com/apache/hudi/pull/5564#issuecomment-1127131256 hi @jinxing64 There is one more situation to consider here The operation is as follows: 1. Create the mor table hudi_table with sparksql, there are no `ro` and `rt`

[GitHub] [hudi] hudi-bot commented on pull request #5532: [HUDI-3985] Refactor DLASyncTool to support read hoodie table as spark datasource table

2022-05-15 Thread GitBox
hudi-bot commented on PR #5532: URL: https://github.com/apache/hudi/pull/5532#issuecomment-1127147455 ## CI report: * 56bb2432a41ff2ae576db041e40a0e32080724f8 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3599: [HUDI-2207] Support independent flink hudi clustering function

2022-05-15 Thread GitBox
hudi-bot commented on PR #3599: URL: https://github.com/apache/hudi/pull/3599#issuecomment-1127151573 ## CI report: * c3405300e9bc97445637c7251536ec0f0d6fbbd1 UNKNOWN * e5003cfa74eb34255bceb50f1916c57c9c8812de Azure:

[GitHub] [hudi] wzx140 commented on pull request #5522: [HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

2022-05-15 Thread GitBox
wzx140 commented on PR #5522: URL: https://github.com/apache/hudi/pull/5522#issuecomment-1127158433 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot commented on pull request #5522: [HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

2022-05-15 Thread GitBox
hudi-bot commented on PR #5522: URL: https://github.com/apache/hudi/pull/5522#issuecomment-1127169092 ## CI report: * 986960516f86a1426725141cd7cb25e84d260020 UNKNOWN * c5fb81a0b229ded9a2b925790366b62f1bf7ade9 UNKNOWN * f0e8e71d9c2891115daa6bbef5b40231c7a76460 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5583: [HUDI-4098] Metadata table heartbeat for instant has expired, last he…

2022-05-15 Thread GitBox
hudi-bot commented on PR #5583: URL: https://github.com/apache/hudi/pull/5583#issuecomment-1127174807 ## CI report: * 9192e47e4069c54b8a305bd174b00f995c613fbb Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5588: [HUDI-4100] CTAS failed to clean up when given an illegal MANAGED table definition

2022-05-15 Thread GitBox
hudi-bot commented on PR #5588: URL: https://github.com/apache/hudi/pull/5588#issuecomment-1127199004 ## CI report: * a94b8616a5515088ca59836f64124f3577aab4a9 Azure:

[GitHub] [hudi] cdmikechen commented on a diff in pull request #3391: [HUDI-83] Fix Timestamp/Date type read by Hive3

2022-05-15 Thread GitBox
cdmikechen commented on code in PR #3391: URL: https://github.com/apache/hudi/pull/3391#discussion_r873107531 ## hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/HiveSyncConfig.java: ## @@ -160,7 +160,7 @@ public class HiveSyncConfig extends HoodieSyncConfig {

[GitHub] [hudi] yuzhaojing commented on pull request #3599: [HUDI-2207] Support independent flink hudi clustering function

2022-05-15 Thread GitBox
yuzhaojing commented on PR #3599: URL: https://github.com/apache/hudi/pull/3599#issuecomment-1127149977 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] codope commented on a diff in pull request #5560: [HUDI-2673] Add kafka connect sink in docker demo

2022-05-15 Thread GitBox
codope commented on code in PR #5560: URL: https://github.com/apache/hudi/pull/5560#discussion_r873312838 ## docker/hoodie/kafka_connect/pom.xml: ## @@ -0,0 +1,122 @@ + + + +http://maven.apache.org/POM/4.0.0; + xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; +

[jira] [Updated] (HUDI-4025) Add support to validate presto, trino and hive queries in integ test framework

2022-05-15 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4025: -- Status: In Progress (was: Open) > Add support to validate presto, trino and hive queries in integ test

[GitHub] [hudi] jinxing64 commented on pull request #5564: [HUDI-4087] Support dropping RO and RT table in DropHoodieTableCommand

2022-05-15 Thread GitBox
jinxing64 commented on PR #5564: URL: https://github.com/apache/hudi/pull/5564#issuecomment-1127232082 Thanks @XuQianJin-Stars taking time to review this PR ~ >There is one more situation to consider here The operation is as follows: Create the mor table hudi_table with

[hudi] branch master updated: [HUDI-4001] Filter the properties should not be used when create table for Spark SQL (#5495)

2022-05-15 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 75f847691f [HUDI-4001] Filter the properties

[GitHub] [hudi] XuQianJin-Stars merged pull request #5495: [HUDI-4001] Filter the properties should not be used when create table for Spark SQL

2022-05-15 Thread GitBox
XuQianJin-Stars merged PR #5495: URL: https://github.com/apache/hudi/pull/5495 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] danny0405 commented on pull request #5583: [HUDI-4098] Metadata table heartbeat for instant has expired, last he…

2022-05-15 Thread GitBox
danny0405 commented on PR #5583: URL: https://github.com/apache/hudi/pull/5583#issuecomment-1127171825 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] hudi-bot commented on pull request #5583: [HUDI-4098] Metadata table heartbeat for instant has expired, last he…

2022-05-15 Thread GitBox
hudi-bot commented on PR #5583: URL: https://github.com/apache/hudi/pull/5583#issuecomment-1127172841 ## CI report: * 9192e47e4069c54b8a305bd174b00f995c613fbb Azure:

[jira] [Updated] (HUDI-4100) CTAS failed to clean up when given an illegal MANAGED table definition

2022-05-15 Thread Jin Xing (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jin Xing updated HUDI-4100: --- Description: Current HoodieStagedTable#abortStagedChanges cleans up data path by the table property of

[GitHub] [hudi] hudi-bot commented on pull request #5532: [HUDI-3985] Refactor DLASyncTool to support read hoodie table as spark datasource table

2022-05-15 Thread GitBox
hudi-bot commented on PR #5532: URL: https://github.com/apache/hudi/pull/5532#issuecomment-1127194188 ## CI report: * be25641540231b290306ef9195faedd46106175e Azure:

[GitHub] [hudi] danny0405 commented on a diff in pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

2022-05-15 Thread GitBox
danny0405 commented on code in PR #4480: URL: https://github.com/apache/hudi/pull/4480#discussion_r873316153 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bucket/BucketIndexLocationMapper.java: ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] leesf merged pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

2022-05-15 Thread GitBox
leesf merged PR #4480: URL: https://github.com/apache/hudi/pull/4480 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated: [HUDI-3123] consistent hashing index: basic write path (upsert/insert) (#4480)

2022-05-15 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 61030d8e7a [HUDI-3123] consistent hashing index:

[jira] [Created] (HUDI-4100) CTAS failed to clean up when given an illegal table definition

2022-05-15 Thread Jin Xing (Jira)
Jin Xing created HUDI-4100: -- Summary: CTAS failed to clean up when given an illegal table definition Key: HUDI-4100 URL: https://issues.apache.org/jira/browse/HUDI-4100 Project: Apache Hudi Issue

[GitHub] [hudi] xushiyan commented on a diff in pull request #5522: [HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

2022-05-15 Thread GitBox
xushiyan commented on code in PR #5522: URL: https://github.com/apache/hudi/pull/5522#discussion_r873267889 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/execution/CopyOnWriteInsertHandler.java: ## @@ -69,8 +69,8 @@ public

[GitHub] [hudi] LinMingQiang opened a new issue, #5589: [SUPPORT] Optimization of bucket index in Flink

2022-05-15 Thread GitBox
LinMingQiang opened a new issue, #5589: URL: https://github.com/apache/hudi/issues/5589 A clear and concise description of the problem. write.task value can only be less than or equal to bucket num value, because even if it is exceeded, the writing efficiency cannot be improved.This is

[GitHub] [hudi] LinMingQiang commented on issue #5589: [SUPPORT] Optimization of bucket index in Flink

2022-05-15 Thread GitBox
LinMingQiang commented on issue #5589: URL: https://github.com/apache/hudi/issues/5589#issuecomment-1127197963 https://issues.apache.org/jira/browse/HUDI-4102 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] XuQianJin-Stars merged pull request #5585: [HUDI-4099][MINOR]fix hive sync no partition table error

2022-05-15 Thread GitBox
XuQianJin-Stars merged PR #5585: URL: https://github.com/apache/hudi/pull/5585 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated: fix hive sync no partition table error (#5585)

2022-05-15 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 1fded18dff fix hive sync no partition table

[GitHub] [hudi] hudi-bot commented on pull request #5532: [HUDI-3985] Refactor DLASyncTool to support read hoodie table as spark datasource table

2022-05-15 Thread GitBox
hudi-bot commented on PR #5532: URL: https://github.com/apache/hudi/pull/5532#issuecomment-1127145919 ## CI report: * 56bb2432a41ff2ae576db041e40a0e32080724f8 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5522: [HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

2022-05-15 Thread GitBox
hudi-bot commented on PR #5522: URL: https://github.com/apache/hudi/pull/5522#issuecomment-1127167426 ## CI report: * 986960516f86a1426725141cd7cb25e84d260020 UNKNOWN * c5fb81a0b229ded9a2b925790366b62f1bf7ade9 UNKNOWN * f0e8e71d9c2891115daa6bbef5b40231c7a76460 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5522: [HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

2022-05-15 Thread GitBox
hudi-bot commented on PR #5522: URL: https://github.com/apache/hudi/pull/5522#issuecomment-1127196379 ## CI report: * 986960516f86a1426725141cd7cb25e84d260020 UNKNOWN * c5fb81a0b229ded9a2b925790366b62f1bf7ade9 UNKNOWN * 07029886584651cb81f767b7bc8c5a310f47d400 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5588: [HUDI-4100] CTAS failed to clean up when given an illegal MANAGED table definition

2022-05-15 Thread GitBox
hudi-bot commented on PR #5588: URL: https://github.com/apache/hudi/pull/5588#issuecomment-1127196510 ## CI report: * a94b8616a5515088ca59836f64124f3577aab4a9 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Created] (HUDI-4102) Optimization of bucket index in Flink

2022-05-15 Thread HunterHunter (Jira)
HunterHunter created HUDI-4102: -- Summary: Optimization of bucket index in Flink Key: HUDI-4102 URL: https://issues.apache.org/jira/browse/HUDI-4102 Project: Apache Hudi Issue Type: Improvement

[GitHub] [hudi] YuweiXiao commented on a diff in pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

2022-05-15 Thread GitBox
YuweiXiao commented on code in PR #4480: URL: https://github.com/apache/hudi/pull/4480#discussion_r873317466 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bucket/BucketIndexLocationMapper.java: ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] YuweiXiao commented on a diff in pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

2022-05-15 Thread GitBox
YuweiXiao commented on code in PR #4480: URL: https://github.com/apache/hudi/pull/4480#discussion_r873322299 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/bucket/BucketIndexLocationMapper.java: ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software

[jira] [Updated] (HUDI-3781) spark delete sql can't delete record

2022-05-15 Thread KnightChess (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KnightChess updated HUDI-3781: -- Fix Version/s: 0.11.0 > spark delete sql can't delete record > > >

[jira] [Updated] (HUDI-4101) BucketIndexPartitioner should take partition path for better dispersion

2022-05-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4101: - Labels: pull-request-available (was: ) > BucketIndexPartitioner should take partition path for

[jira] [Updated] (HUDI-4101) BucketIndexPartitioner should take partition path for better dispersion

2022-05-15 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-4101: - Summary: BucketIndexPartitioner should take partition path for better dispersion (was: Bucket index hash

[GitHub] [hudi] danny0405 opened a new pull request, #5590: [HUDI-4101] BucketIndexPartitioner should take partition path for bet…

2022-05-15 Thread GitBox
danny0405 opened a new pull request, #5590: URL: https://github.com/apache/hudi/pull/5590 …ter dispersion ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*

[GitHub] [hudi] XuQianJin-Stars commented on issue #5586: [SUPPORT] 0.11.0 SparkSQL ParseException occurs in 0.11.0 when creating view with `timestamp as of`

2022-05-15 Thread GitBox
XuQianJin-Stars commented on issue #5586: URL: https://github.com/apache/hudi/issues/5586#issuecomment-1127135537 hi @gnailJC Thanks for the question, now timestamp as of only supports table operations, not view related operations yet. If there is a business scenario requirement, we can

[GitHub] [hudi] yuzhaojing closed pull request #3599: [HUDI-2207] Support independent flink hudi clustering function

2022-05-15 Thread GitBox
yuzhaojing closed pull request #3599: [HUDI-2207] Support independent flink hudi clustering function URL: https://github.com/apache/hudi/pull/3599 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] hudi-bot commented on pull request #5522: [HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

2022-05-15 Thread GitBox
hudi-bot commented on PR #5522: URL: https://github.com/apache/hudi/pull/5522#issuecomment-1127152108 ## CI report: * 986960516f86a1426725141cd7cb25e84d260020 UNKNOWN * c5fb81a0b229ded9a2b925790366b62f1bf7ade9 UNKNOWN * f0e8e71d9c2891115daa6bbef5b40231c7a76460 Azure:

[jira] [Updated] (HUDI-4100) CTAS failed to clean up when given an illegal MANAGED table definition

2022-05-15 Thread Jin Xing (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jin Xing updated HUDI-4100: --- Summary: CTAS failed to clean up when given an illegal MANAGED table definition (was: CTAS failed to clean

[GitHub] [hudi] XuQianJin-Stars commented on a diff in pull request #5564: [HUDI-4087] Support dropping RO and RT table in DropHoodieTableCommand

2022-05-15 Thread GitBox
XuQianJin-Stars commented on code in PR #5564: URL: https://github.com/apache/hudi/pull/5564#discussion_r873305945 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/command/DropHoodieTableCommand.scala: ## @@ -69,13 +67,13 @@ extends

[GitHub] [hudi] wzx140 commented on a diff in pull request #5522: [HUDI-3378][HUDI-3379][HUDI-3381] Rebasing usages of HoodieRecordPayload and raw Avro payload to rely on HoodieRecord instead

2022-05-15 Thread GitBox
wzx140 commented on code in PR #5522: URL: https://github.com/apache/hudi/pull/5522#discussion_r873311346 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieCreateHandle.java: ## @@ -180,18 +176,14 @@ public void write() { } else { keyIterator

[jira] [Closed] (HUDI-3781) spark delete sql can't delete record

2022-05-15 Thread KnightChess (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KnightChess closed HUDI-3781. - Resolution: Fixed > spark delete sql can't delete record > > >

[GitHub] [hudi] jinxing64 commented on a diff in pull request #5564: [HUDI-4087] Support dropping RO and RT table in DropHoodieTableCommand

2022-05-15 Thread GitBox
jinxing64 commented on code in PR #5564: URL: https://github.com/apache/hudi/pull/5564#discussion_r873331963 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/command/DropHoodieTableCommand.scala: ## @@ -69,13 +67,13 @@ extends

[GitHub] [hudi] jinxing64 commented on a diff in pull request #5564: [HUDI-4087] Support dropping RO and RT table in DropHoodieTableCommand

2022-05-15 Thread GitBox
jinxing64 commented on code in PR #5564: URL: https://github.com/apache/hudi/pull/5564#discussion_r873331963 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/command/DropHoodieTableCommand.scala: ## @@ -69,13 +67,13 @@ extends