[GitHub] [hudi] hudi-bot commented on pull request #4958: [HUDI-3558] Consistent bucket index: bucket resizing (split) & concurrent write during resizing

2022-07-11 Thread GitBox
hudi-bot commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1181344995 ## CI report: * 643fb48078f832e5454e5de66257f8c487520b5f Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6081: [HUDI-4382] Add logger for HoodieCopyOnWriteTableInputFormat

2022-07-11 Thread GitBox
hudi-bot commented on PR #6081: URL: https://github.com/apache/hudi/pull/6081#issuecomment-1181343384 ## CI report: * 5b7c7576a84242d8b186936b4a79636fb4ea73cf Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4958: [HUDI-3558] Consistent bucket index: bucket resizing (split) & concurrent write during resizing

2022-07-11 Thread GitBox
hudi-bot commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1181342614 ## CI report: * 643fb48078f832e5454e5de66257f8c487520b5f Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6081: [HUDI-4382] Add logger for HoodieCopyOnWriteTableInputFormat

2022-07-11 Thread GitBox
hudi-bot commented on PR #6081: URL: https://github.com/apache/hudi/pull/6081#issuecomment-1181340973 ## CI report: * 5b7c7576a84242d8b186936b4a79636fb4ea73cf Azure:

[GitHub] [hudi] jiezi2026 commented on issue #6070: [SUPPORT]'hoodie.datasource.write.hive_style_partitioning':'true' does not take effect in hudi-0.11.1 & spark 3.2.1

2022-07-11 Thread GitBox
jiezi2026 commented on issue #6070: URL: https://github.com/apache/hudi/issues/6070#issuecomment-118133 @TengHuo Thanks, I'm trying to replace my code with sparksql. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] zhedoubushishi commented on pull request #6081: [HUDI-4382] Add logger for HoodieCopyOnWriteTableInputFormat

2022-07-11 Thread GitBox
zhedoubushishi commented on PR #6081: URL: https://github.com/apache/hudi/pull/6081#issuecomment-1181332162 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] zhedoubushishi commented on pull request #6081: [HUDI-4382] Add logger for HoodieCopyOnWriteTableInputFormat

2022-07-11 Thread GitBox
zhedoubushishi commented on PR #6081: URL: https://github.com/apache/hudi/pull/6081#issuecomment-1181331944 > I have a quesion, if don't have FileINputFormat class, maybe it will cause ClassNotFound when load this class? Right. During the presto query, it would throw something like:

[GitHub] [hudi] yuzhaojing commented on a diff in pull request #5681: [HUDI-4148] Preparations and client for hudi table manager service

2022-07-11 Thread GitBox
yuzhaojing commented on code in PR #5681: URL: https://github.com/apache/hudi/pull/5681#discussion_r918561931 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/table/manager/HoodieTableManagerClient.java: ## @@ -0,0 +1,191 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] danny0405 commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-07-11 Thread GitBox
danny0405 commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1181326389 Thanks, i will take a look this week, and before that, please do not merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] trushev commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-07-11 Thread GitBox
trushev commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1181325353 I think it is ready to merge -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1181306711 ## CI report: * 7982061f9d492b4c4d51ca4589e5a30dbc76530a Azure:

[jira] [Closed] (HUDI-4095) delete sql trigger sync metadata cause error action

2022-07-11 Thread KnightChess (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KnightChess closed HUDI-4095. - Resolution: Fixed > delete sql trigger sync metadata cause error action >

[GitHub] [hudi] KnightChess closed pull request #5576: [HUDI-4095] spark delete sql trigger sync metadata cause error action

2022-07-11 Thread GitBox
KnightChess closed pull request #5576: [HUDI-4095] spark delete sql trigger sync metadata cause error action URL: https://github.com/apache/hudi/pull/5576 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] KnightChess commented on pull request #5576: [HUDI-4095] spark delete sql trigger sync metadata cause error action

2022-07-11 Thread GitBox
KnightChess commented on PR #5576: URL: https://github.com/apache/hudi/pull/5576#issuecomment-1181290162 #6073 can fix it too, close this pr -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] hudi-bot commented on pull request #6046: [HUDI-4363] Support Clustering row writer to improve performance

2022-07-11 Thread GitBox
hudi-bot commented on PR #6046: URL: https://github.com/apache/hudi/pull/6046#issuecomment-1181277681 ## CI report: * dd79426d234315d90b2deffcd54dc0e9ab43e38e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6046: [HUDI-4363] Support Clustering row writer to improve performance

2022-07-11 Thread GitBox
hudi-bot commented on PR #6046: URL: https://github.com/apache/hudi/pull/6046#issuecomment-1181275610 ## CI report: * dd79426d234315d90b2deffcd54dc0e9ab43e38e Azure:

[GitHub] [hudi] TengHuo commented on issue #6070: [SUPPORT]'hoodie.datasource.write.hive_style_partitioning':'true' does not take effect in hudi-0.11.1 & spark 3.2.1

2022-07-11 Thread GitBox
TengHuo commented on issue #6070: URL: https://github.com/apache/hudi/issues/6070#issuecomment-1181259695 Yeah, we got the same issue when using bulk_insert in 0.11, and there is no problem in 0.10.1 @jiezi2026 you can try 0.10.1 if you are urgent -- This is an automated message

[GitHub] [hudi] boneanxs commented on pull request #6046: [HUDI-4363] Support Clustering row writer to improve performance

2022-07-11 Thread GitBox
boneanxs commented on PR #6046: URL: https://github.com/apache/hudi/pull/6046#issuecomment-1181254713 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] hudi-bot commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1181248326 ## CI report: * ef13a2d832c21b69938c958e1e84e4667d0b402d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1181245839 ## CI report: * ef13a2d832c21b69938c958e1e84e4667d0b402d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4958: [HUDI-3558] Consistent bucket index: bucket resizing (split) & concurrent write during resizing

2022-07-11 Thread GitBox
hudi-bot commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1181245320 ## CI report: * 643fb48078f832e5454e5de66257f8c487520b5f Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1181243368 ## CI report: * ef13a2d832c21b69938c958e1e84e4667d0b402d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4958: [HUDI-3558] Consistent bucket index: bucket resizing (split) & concurrent write during resizing

2022-07-11 Thread GitBox
hudi-bot commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1181242763 ## CI report: * 643fb48078f832e5454e5de66257f8c487520b5f Azure:

[GitHub] [hudi] boneanxs commented on a diff in pull request #5722: [HUDI-4170] Make user can use hoodie.datasource.read.paths to read necessary files

2022-07-11 Thread GitBox
boneanxs commented on code in PR #5722: URL: https://github.com/apache/hudi/pull/5722#discussion_r918487318 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala: ## @@ -340,20 +341,51 @@ abstract class HoodieBaseRelation(val

[GitHub] [hudi] YuweiXiao commented on pull request #4958: [HUDI-3558] Consistent bucket index: bucket resizing (split) & concurrent write during resizing

2022-07-11 Thread GitBox
YuweiXiao commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1181233003 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] XuQianJin-Stars commented on a diff in pull request #5681: [HUDI-4148] Preparations and client for hudi table manager service

2022-07-11 Thread GitBox
XuQianJin-Stars commented on code in PR #5681: URL: https://github.com/apache/hudi/pull/5681#discussion_r918477485 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java: ## @@ -564,9 +569,13 @@ protected void

[GitHub] [hudi] txl2017 commented on issue #6007: spark query partition field error

2022-07-11 Thread GitBox
txl2017 commented on issue #6007: URL: https://github.com/apache/hudi/issues/6007#issuecomment-1181209134 use 0.11.1, is ok now -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #6082: [HUDI-4098]Support HMS for flink HudiCatalog

2022-07-11 Thread GitBox
hudi-bot commented on PR #6082: URL: https://github.com/apache/hudi/pull/6082#issuecomment-1181209015 ## CI report: * 240e52afdd199101b060ef0b20229d958219cafc Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6081: [HUDI-4382] Add logger for HoodieCopyOnWriteTableInputFormat

2022-07-11 Thread GitBox
hudi-bot commented on PR #6081: URL: https://github.com/apache/hudi/pull/6081#issuecomment-1181208998 ## CI report: * 5b7c7576a84242d8b186936b4a79636fb4ea73cf Azure:

[GitHub] [hudi] txl2017 closed issue #6007: spark query partition field error

2022-07-11 Thread GitBox
txl2017 closed issue #6007: spark query partition field error URL: https://github.com/apache/hudi/issues/6007 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[jira] [Updated] (HUDI-3967) Exempt savepoint from archiving and add automated savepoint

2022-07-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3967: - Fix Version/s: 0.12.0 > Exempt savepoint from archiving and add automated savepoint >

[GitHub] [hudi] hudi-bot commented on pull request #6082: [HUDI-4098]Support HMS for flink HudiCatalog

2022-07-11 Thread GitBox
hudi-bot commented on PR #6082: URL: https://github.com/apache/hudi/pull/6082#issuecomment-1181168389 ## CI report: * 240e52afdd199101b060ef0b20229d958219cafc Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1181168133 ## CI report: * faa859369ddf9c3724487eb5a028186d0a970154 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6082: [HUDI-4098]Support HMS for flink HudiCatalog

2022-07-11 Thread GitBox
hudi-bot commented on PR #6082: URL: https://github.com/apache/hudi/pull/6082#issuecomment-1181165704 ## CI report: * 240e52afdd199101b060ef0b20229d958219cafc UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1181165434 ## CI report: * faa859369ddf9c3724487eb5a028186d0a970154 Azure:

[GitHub] [hudi] cuibo01 commented on pull request #6013: [HUDI-4089] Support HMS for flink HoodieCatalog

2022-07-11 Thread GitBox
cuibo01 commented on PR #6013: URL: https://github.com/apache/hudi/pull/6013#issuecomment-1181158606 https://github.com/apache/hudi/pull/6082 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] cuibo01 opened a new pull request, #6082: [HUDI-4098]Support HMS for flink HudiCatalog

2022-07-11 Thread GitBox
cuibo01 opened a new pull request, #6082: URL: https://github.com/apache/hudi/pull/6082 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] cuibo01 closed pull request #6013: [HUDI-4089] Support HMS for flink HoodieCatalog

2022-07-11 Thread GitBox
cuibo01 closed pull request #6013: [HUDI-4089] Support HMS for flink HoodieCatalog URL: https://github.com/apache/hudi/pull/6013 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #6013: [HUDI-4089] Support HMS for flink HoodieCatalog

2022-07-11 Thread GitBox
hudi-bot commented on PR #6013: URL: https://github.com/apache/hudi/pull/6013#issuecomment-1181063822 ## CI report: * 4cb269cf6fadc020ed8e512d673d3435a69e4740 UNKNOWN * 9619231aabbd36a02215098f1b329aa1ef44a581 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6081: [HUDI-4382] Add logger for HoodieCopyOnWriteTableInputFormat

2022-07-11 Thread GitBox
hudi-bot commented on PR #6081: URL: https://github.com/apache/hudi/pull/6081#issuecomment-1181055437 ## CI report: * 5b7c7576a84242d8b186936b4a79636fb4ea73cf Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6081: [HUDI-4382] Add logger for HoodieCopyOnWriteTableInputFormat

2022-07-11 Thread GitBox
hudi-bot commented on PR #6081: URL: https://github.com/apache/hudi/pull/6081#issuecomment-1181046472 ## CI report: * 5b7c7576a84242d8b186936b4a79636fb4ea73cf UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1181036007 ## CI report: * faa859369ddf9c3724487eb5a028186d0a970154 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1181035742 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN *

[jira] [Updated] (HUDI-4382) Add logger for HoodieCopyOnWriteTableInputFormat

2022-07-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4382: - Labels: pull-request-available (was: ) > Add logger for HoodieCopyOnWriteTableInputFormat >

[GitHub] [hudi] zhedoubushishi opened a new pull request, #6081: [HUDI-4382] Add logger for HoodieCopyOnWriteTableInputFormat

2022-07-11 Thread GitBox
zhedoubushishi opened a new pull request, #6081: URL: https://github.com/apache/hudi/pull/6081 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] bhasudha commented on pull request #6010: [DOCS] Add Chinese community call page.

2022-07-11 Thread GitBox
bhasudha commented on PR #6010: URL: https://github.com/apache/hudi/pull/6010#issuecomment-1180977188 > BTW, this is the record of the first chinese community call meeting, https://bytedance.feishu.cn/minutes/obcnwkj2p21x4b31r6413562. Could you please upload to the youtube channel? Here is

[jira] [Created] (HUDI-4382) Add logger for HoodieCopyOnWriteTableInputFormat

2022-07-11 Thread Wenning Ding (Jira)
Wenning Ding created HUDI-4382: -- Summary: Add logger for HoodieCopyOnWriteTableInputFormat Key: HUDI-4382 URL: https://issues.apache.org/jira/browse/HUDI-4382 Project: Apache Hudi Issue Type:

[GitHub] [hudi] hudi-bot commented on pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1180921653 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1180921734 ## CI report: * 239534226d5cf6cbef8ef1e8dc454daf3dacf20b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1180918861 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1180918936 ## CI report: * 239534226d5cf6cbef8ef1e8dc454daf3dacf20b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1180916017 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN *

[GitHub] [hudi] zhedoubushishi commented on a diff in pull request #4915: [HUDI-3764] Allow loading external configs while querying Hudi tables with Spark

2022-07-11 Thread GitBox
zhedoubushishi commented on code in PR #4915: URL: https://github.com/apache/hudi/pull/4915#discussion_r918385731 ## hudi-common/src/main/java/org/apache/hudi/common/config/DFSPropertiesConfiguration.java: ## @@ -174,6 +174,11 @@ public static TypedProperties getGlobalProps() {

[GitHub] [hudi] rahil-c commented on pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1180914903 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] rahil-c commented on pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1180911986 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] zhedoubushishi commented on a diff in pull request #4915: [HUDI-3764] Allow loading external configs while querying Hudi tables with Spark

2022-07-11 Thread GitBox
zhedoubushishi commented on code in PR #4915: URL: https://github.com/apache/hudi/pull/4915#discussion_r918382537 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala: ## @@ -785,13 +785,14 @@ object DataSourceOptionsHelper { def

[GitHub] [hudi] rahil-c closed pull request #5374: [WIP][HUDI-2955] Support Hadoop 3.x Hive 3.x Spark 3.x

2022-07-11 Thread GitBox
rahil-c closed pull request #5374: [WIP][HUDI-2955] Support Hadoop 3.x Hive 3.x Spark 3.x URL: https://github.com/apache/hudi/pull/5374 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1180871747 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1180868275 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1180864148 ## CI report: * d0eccf905d4778c46160e08fb48d4087bfd3d5d3 UNKNOWN * 0519143412014cf44a61571635eea4beb5688638 UNKNOWN * cdb27bea041845d0056ab013f8f637dbbe0cc739 UNKNOWN *

[GitHub] [hudi] rahil-c commented on pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on PR #5786: URL: https://github.com/apache/hudi/pull/5786#issuecomment-1180855254 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[hudi] branch asf-site updated: [DOCS] Fix blog date for hudi-dbt-blog

2022-07-11 Thread bhavanisudha
This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new f1a764630e [DOCS] Fix blog date for

[GitHub] [hudi] hudi-bot commented on pull request #5630: [HUDI-3994] - Added support for initializing DeltaStreamer without a …

2022-07-11 Thread GitBox
hudi-bot commented on PR #5630: URL: https://github.com/apache/hudi/pull/5630#issuecomment-1180826180 ## CI report: * 73e346f2520c3c72a9960a4c35d95c8672ef3db8 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5630: [HUDI-3994] - Added support for initializing DeltaStreamer without a …

2022-07-11 Thread GitBox
hudi-bot commented on PR #5630: URL: https://github.com/apache/hudi/pull/5630#issuecomment-1180822010 ## CI report: * 73e346f2520c3c72a9960a4c35d95c8672ef3db8 Azure:

[GitHub] [hudi] Neuw84 commented on pull request #5630: [HUDI-3994] - Added support for initializing DeltaStreamer without a …

2022-07-11 Thread GitBox
Neuw84 commented on PR #5630: URL: https://github.com/apache/hudi/pull/5630#issuecomment-1180818671 Hi @codope, Added your suggestions to the commit, thanks for the inputs. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] Neuw84 commented on pull request #5630: [HUDI-3994] - Added support for initializing DeltaStreamer without a …

2022-07-11 Thread GitBox
Neuw84 commented on PR #5630: URL: https://github.com/apache/hudi/pull/5630#issuecomment-1180818862 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1180806609 ## CI report: * 239534226d5cf6cbef8ef1e8dc454daf3dacf20b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5630: [HUDI-3994] - Added support for initializing DeltaStreamer without a …

2022-07-11 Thread GitBox
hudi-bot commented on PR #5630: URL: https://github.com/apache/hudi/pull/5630#issuecomment-1180806278 ## CI report: * 73e346f2520c3c72a9960a4c35d95c8672ef3db8 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5629: [HUDI-3384][HUDI-3385] Spark specific file reader/writer.

2022-07-11 Thread GitBox
hudi-bot commented on PR #5629: URL: https://github.com/apache/hudi/pull/5629#issuecomment-1180806229 ## CI report: * d0f078159313f8b35a41b1d1e016583204811383 UNKNOWN * 02f8bdabc35820fa3765e77b154de6478440739d Azure:

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #5722: [HUDI-4170] Make user can use hoodie.datasource.read.paths to read necessary files

2022-07-11 Thread GitBox
alexeykudinkin commented on code in PR #5722: URL: https://github.com/apache/hudi/pull/5722#discussion_r918262428 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala: ## @@ -87,6 +85,16 @@ class DefaultSource extends RelationProvider

[GitHub] [hudi] rahil-c commented on a diff in pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on code in PR #5786: URL: https://github.com/apache/hudi/pull/5786#discussion_r917463189 ## packaging/hudi-hadoop-mr-bundle/pom.xml: ## @@ -29,6 +29,8 @@ true ${project.parent.basedir} + +1.10.1 Review Comment: @umehrot2 Will make the

[GitHub] [hudi] rahil-c commented on a diff in pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on code in PR #5786: URL: https://github.com/apache/hudi/pull/5786#discussion_r917462567 ## pom.xml: ## @@ -78,28 +78,31 @@ 3.2.0 +3.3.0 2.22.2 2.22.2 3.2.4 3.1.1 -3.8.0 +3.8.1 2.4 0.15 1.7

[GitHub] [hudi] hudi-bot commented on pull request #5629: [HUDI-3384][HUDI-3385] Spark specific file reader/writer.

2022-07-11 Thread GitBox
hudi-bot commented on PR #5629: URL: https://github.com/apache/hudi/pull/5629#issuecomment-1180754243 ## CI report: * d0f078159313f8b35a41b1d1e016583204811383 UNKNOWN * d12f5116645664470119b8c79787c2a7da5feb87 Azure:

[GitHub] [hudi] rahil-c commented on a diff in pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on code in PR #5786: URL: https://github.com/apache/hudi/pull/5786#discussion_r918250071 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeRecordReaderUtils.java: ## @@ -189,7 +190,13 @@ public static Writable

[GitHub] [hudi] hudi-bot commented on pull request #5629: [HUDI-3384][HUDI-3385] Spark specific file reader/writer.

2022-07-11 Thread GitBox
hudi-bot commented on PR #5629: URL: https://github.com/apache/hudi/pull/5629#issuecomment-1180750871 ## CI report: * d0f078159313f8b35a41b1d1e016583204811383 UNKNOWN * 5f47e8e08a77e72c0916868e296e80d72fcd7d18 Azure:

[GitHub] [hudi] rahil-c commented on a diff in pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on code in PR #5786: URL: https://github.com/apache/hudi/pull/5786#discussion_r918250071 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeRecordReaderUtils.java: ## @@ -189,7 +190,13 @@ public static Writable

[GitHub] [hudi] rahil-c commented on a diff in pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on code in PR #5786: URL: https://github.com/apache/hudi/pull/5786#discussion_r918239436 ## hudi-spark-datasource/hudi-spark3.1.x/pom.xml: ## @@ -202,6 +202,18 @@ + + org.apache.hudi + ${hudi.spark.common.module} Review Comment:

[GitHub] [hudi] rahil-c commented on a diff in pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on code in PR #5786: URL: https://github.com/apache/hudi/pull/5786#discussion_r918238488 ## hudi-spark-datasource/hudi-spark3-common/pom.xml: ## @@ -166,7 +166,7 @@ org.apache.spark -spark-sql_2.12 +

[GitHub] [hudi] hudi-bot commented on pull request #5771: [HUDI-4071] Relax record key requirement and write with minimal options

2022-07-11 Thread GitBox
hudi-bot commented on PR #5771: URL: https://github.com/apache/hudi/pull/5771#issuecomment-1180690286 ## CI report: * 9bcf600cc1b0c41ff21f87aeacd1f7ddd8814e48 UNKNOWN * 21fd1a406a402f438e402c6ce4203e6374687a71 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5630: [HUDI-3994] - Added support for initializing DeltaStreamer without a …

2022-07-11 Thread GitBox
hudi-bot commented on PR #5630: URL: https://github.com/apache/hudi/pull/5630#issuecomment-1180690046 ## CI report: * d51051ef654e32ed894b31e425383935f419aef9 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5629: [HUDI-3384][HUDI-3385] Spark specific file reader/writer.

2022-07-11 Thread GitBox
hudi-bot commented on PR #5629: URL: https://github.com/apache/hudi/pull/5629#issuecomment-1180689993 ## CI report: * d0f078159313f8b35a41b1d1e016583204811383 UNKNOWN * 5f47e8e08a77e72c0916868e296e80d72fcd7d18 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4958: [HUDI-3558] Consistent bucket index: bucket resizing (split) & concurrent write during resizing

2022-07-11 Thread GitBox
hudi-bot commented on PR #4958: URL: https://github.com/apache/hudi/pull/4958#issuecomment-1180689331 ## CI report: * 643fb48078f832e5454e5de66257f8c487520b5f Azure:

[GitHub] [hudi] rahil-c commented on a diff in pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on code in PR #5786: URL: https://github.com/apache/hudi/pull/5786#discussion_r918187871 ## hudi-client/hudi-spark-client/pom.xml: ## @@ -174,6 +208,12 @@ awaitility test + Review Comment: My assumption is you are referring to this

[GitHub] [hudi] rahil-c commented on a diff in pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on code in PR #5786: URL: https://github.com/apache/hudi/pull/5786#discussion_r918187871 ## hudi-client/hudi-spark-client/pom.xml: ## @@ -174,6 +208,12 @@ awaitility test + Review Comment: My assumption is you are referring to this

[GitHub] [hudi] rahil-c commented on a diff in pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on code in PR #5786: URL: https://github.com/apache/hudi/pull/5786#discussion_r918187871 ## hudi-client/hudi-spark-client/pom.xml: ## @@ -174,6 +208,12 @@ awaitility test + Review Comment: My assumption is you are referring to this

[GitHub] [hudi] desaismi commented on issue #6069: [SUPPORT] /hoodie/temp Folder and contents not getting deleted

2022-07-11 Thread GitBox
desaismi commented on issue #6069: URL: https://github.com/apache/hudi/issues/6069#issuecomment-1180639732 The instant `20220502180145` is in the `.hoodie/.temp/` folder, but not in the `.hoodie/` folder. I also see no records when querying `_hoodie_commit_time = 20220502180145` -- This

[GitHub] [hudi] rahil-c commented on a diff in pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on code in PR #5786: URL: https://github.com/apache/hudi/pull/5786#discussion_r918144201 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestCOWDataSourceStorage.scala: ## @@ -61,10 +61,8 @@ class TestCOWDataSourceStorage extends

[GitHub] [hudi] hudi-bot commented on pull request #5771: [HUDI-4071] Relax record key requirement and write with minimal options

2022-07-11 Thread GitBox
hudi-bot commented on PR #5771: URL: https://github.com/apache/hudi/pull/5771#issuecomment-1180631255 ## CI report: * 9bcf600cc1b0c41ff21f87aeacd1f7ddd8814e48 UNKNOWN * 117383bd60a5eb04409f95041054bcfba6303146 Azure:

[GitHub] [hudi] rahil-c commented on a diff in pull request #5786: [HUDI-2955] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default (rebase)

2022-07-11 Thread GitBox
rahil-c commented on code in PR #5786: URL: https://github.com/apache/hudi/pull/5786#discussion_r918141727 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/HiveIncrementalPuller.java: ## @@ -214,8 +214,6 @@ private void initHiveBeelineProperties(Statement stmt) throws

[jira] [Reopened] (HUDI-940) Audit bad/dangling configs and code

2022-07-11 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reopened HUDI-940: -- > Audit bad/dangling configs and code > > > Key:

[GitHub] [hudi] hudi-bot commented on pull request #6046: [HUDI-4363] Support Clustering row writer to improve performance

2022-07-11 Thread GitBox
hudi-bot commented on PR #6046: URL: https://github.com/apache/hudi/pull/6046#issuecomment-1180574406 ## CI report: * dd79426d234315d90b2deffcd54dc0e9ab43e38e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5630: [HUDI-3994] - Added support for initializing DeltaStreamer without a …

2022-07-11 Thread GitBox
hudi-bot commented on PR #5630: URL: https://github.com/apache/hudi/pull/5630#issuecomment-1180491924 ## CI report: * 44e48a40ffb1dc0d81c757f5269cad151b846b4e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6066: [HUDI-4372] Enable matadata table by default for flink

2022-07-11 Thread GitBox
hudi-bot commented on PR #6066: URL: https://github.com/apache/hudi/pull/6066#issuecomment-1180487480 ## CI report: * 9197002ae68820b261a22be222a9112e974b006b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5630: [HUDI-3994] - Added support for initializing DeltaStreamer without a …

2022-07-11 Thread GitBox
hudi-bot commented on PR #5630: URL: https://github.com/apache/hudi/pull/5630#issuecomment-1180486655 ## CI report: * 44e48a40ffb1dc0d81c757f5269cad151b846b4e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6080: [HUDI-4379] Bump Flink versions to 1.14.5 and 1.15.1

2022-07-11 Thread GitBox
hudi-bot commented on PR #6080: URL: https://github.com/apache/hudi/pull/6080#issuecomment-1180482045 ## CI report: * 6ca6da4e2d3f3a61d562c5156431c0dd81dafaca Azure:

[GitHub] [hudi] KWIGNIS commented on issue #3042: [SUPPORT]Caused by: java.lang.NoSuchMethodError: org.apache.parquet.schema.Types$PrimitiveBuilder.as(Lorg/apache/parquet/schema/LogicalTypeAnnotation;

2022-07-11 Thread GitBox
KWIGNIS commented on issue #3042: URL: https://github.com/apache/hudi/issues/3042#issuecomment-1180452026 > thanks~~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] hudi-bot commented on pull request #5681: [HUDI-4148] Preparations and client for hudi table manager service

2022-07-11 Thread GitBox
hudi-bot commented on PR #5681: URL: https://github.com/apache/hudi/pull/5681#issuecomment-1180426819 ## CI report: * 6566d731e9d462a78a2a85a37c09d5a24ffc45fb UNKNOWN * f50bb15f02020f3c345488a8bce6226b07cbe00c Azure:

[jira] [Created] (HUDI-4381) Add support for reading Protobuf data from Kafka

2022-07-11 Thread Vinay (Jira)
Vinay created HUDI-4381: --- Summary: Add support for reading Protobuf data from Kafka Key: HUDI-4381 URL: https://issues.apache.org/jira/browse/HUDI-4381 Project: Apache Hudi Issue Type: New Feature

[GitHub] [hudi] codope commented on a diff in pull request #5630: [HUDI-3994] - Added support for initializing DeltaStreamer without a …

2022-07-11 Thread GitBox
codope commented on code in PR #5630: URL: https://github.com/apache/hudi/pull/5630#discussion_r917937105 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieMultiTableDeltaStreamer.java: ## @@ -355,8 +355,8 @@ public static class Config implements

[GitHub] [hudi] hudi-bot commented on pull request #5830: [HUDI-3981] Flink engine support for comprehensive schema evolution(RFC-33)

2022-07-11 Thread GitBox
hudi-bot commented on PR #5830: URL: https://github.com/apache/hudi/pull/5830#issuecomment-1180412074 ## CI report: * 691626338b1af1235755ec876dbd35ffbf050ca1 Azure:

  1   2   >