[GitHub] [hudi] gnailJC commented on issue #5586: [SUPPORT] 0.11.0 SparkSQL ParseException occurs in 0.11.0 when creating view with `timestamp as of`

2022-05-20 Thread GitBox
gnailJC commented on issue #5586: URL: https://github.com/apache/hudi/issues/5586#issuecomment-1133541321 > > > hi @gnailJC Thanks for the question, now `timestamp as of` only supports `table` operations, not `view` related operations yet. If there is a business scenario requirement, we

[GitHub] [hudi] hudi-bot commented on pull request #5644: [HUDI-3890] fix rat plugin issue

2022-05-20 Thread GitBox
hudi-bot commented on PR #5644: URL: https://github.com/apache/hudi/pull/5644#issuecomment-1133541113 ## CI report: * 7f247c84bcc8602633a2a7fe52ef8bef5ad63e44 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5651: [WIP][MINOR] Add OperationField's enable to table config

2022-05-20 Thread GitBox
hudi-bot commented on PR #5651: URL: https://github.com/apache/hudi/pull/5651#issuecomment-1133539758 ## CI report: * d2c42d96b2bf86391b1e2968f93dc15fb78651d5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5517: [HUDI-4051] Allow nested field as preCombineField in spark sql

2022-05-20 Thread GitBox
hudi-bot commented on PR #5517: URL: https://github.com/apache/hudi/pull/5517#issuecomment-1133539233 ## CI report: * a640e08f81fc4b24adb2fa37949115b21d5237c9 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5517: [HUDI-4051] Allow nested field as preCombineField in spark sql

2022-05-20 Thread GitBox
hudi-bot commented on PR #5517: URL: https://github.com/apache/hudi/pull/5517#issuecomment-1133538824 ## CI report: * a640e08f81fc4b24adb2fa37949115b21d5237c9 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5651: [WIP][MINOR] Add OperationField's enable to table config

2022-05-20 Thread GitBox
hudi-bot commented on PR #5651: URL: https://github.com/apache/hudi/pull/5651#issuecomment-1133538875 ## CI report: * d2c42d96b2bf86391b1e2968f93dc15fb78651d5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-20 Thread GitBox
hudi-bot commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1133538359 ## CI report: * 8c6f6e19940ce7ac04dfcfce52da3ccdaf3a8b0f UNKNOWN * c4799803cff8adffef56e889a5cd4d52599fcf73 UNKNOWN * e08168041de8785ea2b03d2c14d93be97424f0f3 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5651: [WIP][MINOR] Add OperationField's enable to table config

2022-05-20 Thread GitBox
hudi-bot commented on PR #5651: URL: https://github.com/apache/hudi/pull/5651#issuecomment-1133532015 ## CI report: * d2c42d96b2bf86391b1e2968f93dc15fb78651d5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-20 Thread GitBox
hudi-bot commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1133531381 ## CI report: * 8c6f6e19940ce7ac04dfcfce52da3ccdaf3a8b0f UNKNOWN * c4799803cff8adffef56e889a5cd4d52599fcf73 UNKNOWN * 604bf7b1ef90771eec6ae8db475d812ec05d13ce Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5651: [WIP][MINOR] Add OperationField's enable to table config

2022-05-20 Thread GitBox
hudi-bot commented on PR #5651: URL: https://github.com/apache/hudi/pull/5651#issuecomment-1133530206 ## CI report: * d2c42d96b2bf86391b1e2968f93dc15fb78651d5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5644: [HUDI-3890] fix rat plugin issue

2022-05-20 Thread GitBox
hudi-bot commented on PR #5644: URL: https://github.com/apache/hudi/pull/5644#issuecomment-1133530199 ## CI report: * 3c61f356ad7330f713d007f22f3e3410eec5b78f Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-20 Thread GitBox
hudi-bot commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1133530123 ## CI report: * 8c6f6e19940ce7ac04dfcfce52da3ccdaf3a8b0f UNKNOWN * c4799803cff8adffef56e889a5cd4d52599fcf73 UNKNOWN * 604bf7b1ef90771eec6ae8db475d812ec05d13ce Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5644: [HUDI-3890] fix rat plugin issue

2022-05-20 Thread GitBox
hudi-bot commented on PR #5644: URL: https://github.com/apache/hudi/pull/5644#issuecomment-1133529694 ## CI report: * 3c61f356ad7330f713d007f22f3e3410eec5b78f Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5651: [WIP][MINOR] Add OperationField's enable to table config

2022-05-20 Thread GitBox
hudi-bot commented on PR #5651: URL: https://github.com/apache/hudi/pull/5651#issuecomment-1133529704 ## CI report: * d2c42d96b2bf86391b1e2968f93dc15fb78651d5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] XuQianJin-Stars commented on pull request #3599: [HUDI-2207] Support independent flink hudi clustering function

2022-05-20 Thread GitBox
XuQianJin-Stars commented on PR #3599: URL: https://github.com/apache/hudi/pull/3599#issuecomment-1133527643 hi @yuzhaojing rebase thise pr. the CI's error is fixed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hudi] XuQianJin-Stars opened a new pull request, #5651: [MINOR] add OperationField's enable to table config

2022-05-20 Thread GitBox
XuQianJin-Stars opened a new pull request, #5651: URL: https://github.com/apache/hudi/pull/5651 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is

[GitHub] [hudi] rahil-c commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-20 Thread GitBox
rahil-c commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1133522715 > cc @yihua , will we cut this feature into release 0.12.0 then ? @danny0405 Yes we are trying to land this for .12 -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] rahil-c commented on pull request #5402: [WIP] Support Hadoop 3.x Hive 3.x and Spark 3.2.x default

2022-05-20 Thread GitBox
rahil-c commented on PR #5402: URL: https://github.com/apache/hudi/pull/5402#issuecomment-1133522533 > > @yihua @rahil-c Hi~ I have a question: As we know, from hive2 to hive3 is a major version change, which will involve the adjustment of many original methods and classes. Should we also

[GitHub] [hudi] hudi-bot commented on pull request #5430: [HUDI-3979][Stacked on 5428] Optimize out mandatory columns when no merging is performed

2022-05-20 Thread GitBox
hudi-bot commented on PR #5430: URL: https://github.com/apache/hudi/pull/5430#issuecomment-1133521297 ## CI report: * 5b241061bde4ca74684f07677c7f5afa828e269c UNKNOWN * 1e18026d200b36f5416c53ce2c49665c8d789dd9 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5428: [HUDI-3896] Porting Nested Schema Pruning optimization for Hudi's custom Relations

2022-05-20 Thread GitBox
hudi-bot commented on PR #5428: URL: https://github.com/apache/hudi/pull/5428#issuecomment-1133521283 ## CI report: * a0b466cb8e3f166c716f5776ac4c80f778dd9936 UNKNOWN * 6c8e8050df684a073bc32164bceb079215283ea4 Azure:

[hudi] branch master updated: [HUDI-4122] Fix NPE caused by adding kafka nodes (#5632)

2022-05-20 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 2af98303d3 [HUDI-4122] Fix NPE caused by

[GitHub] [hudi] XuQianJin-Stars merged pull request #5632: [HUDI-4122] Fix NPE caused by adding kafka nodes

2022-05-20 Thread GitBox
XuQianJin-Stars merged PR #5632: URL: https://github.com/apache/hudi/pull/5632 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #5428: [HUDI-3896] Porting Nested Schema Pruning optimization for Hudi's custom Relations

2022-05-20 Thread GitBox
hudi-bot commented on PR #5428: URL: https://github.com/apache/hudi/pull/5428#issuecomment-1133513782 ## CI report: * a0b466cb8e3f166c716f5776ac4c80f778dd9936 UNKNOWN * 6952bc2c08c25f911ce358db0107a101733f4dc9 Azure:

[GitHub] [hudi] XuQianJin-Stars commented on pull request #5111: [HUDI-3695] Add a ORC reader in HoodieBaseRelation

2022-05-20 Thread GitBox
XuQianJin-Stars commented on PR #5111: URL: https://github.com/apache/hudi/pull/5111#issuecomment-1133513598 hi @miomiocat fix the CI failed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] hudi-bot commented on pull request #5430: [HUDI-3979][Stacked on 5428] Optimize out mandatory columns when no merging is performed

2022-05-20 Thread GitBox
hudi-bot commented on PR #5430: URL: https://github.com/apache/hudi/pull/5430#issuecomment-1133512274 ## CI report: * 5b241061bde4ca74684f07677c7f5afa828e269c UNKNOWN * f2e15cb0a9d8cef06be2321b1346bf07e5bf6d7b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5428: [HUDI-3896] Porting Nested Schema Pruning optimization for Hudi's custom Relations

2022-05-20 Thread GitBox
hudi-bot commented on PR #5428: URL: https://github.com/apache/hudi/pull/5428#issuecomment-1133512269 ## CI report: * a0b466cb8e3f166c716f5776ac4c80f778dd9936 UNKNOWN * 6952bc2c08c25f911ce358db0107a101733f4dc9 Azure:

[GitHub] [hudi] XuQianJin-Stars commented on issue #5571: [SUPPORT] Catalog and FileIO extension interface

2022-05-20 Thread GitBox
XuQianJin-Stars commented on issue #5571: URL: https://github.com/apache/hudi/issues/5571#issuecomment-1133489190 Flink has `HoodieCatalog` and spark has `SessionCatalog`, which can provide metadata for querying and accessing hudi, but currently there is no further encapsulation of a

[GitHub] [hudi] tjtoll commented on issue #5636: [SUPPORT]Need info on the versions of hudi dependent jars which can be used with Glue 3.0

2022-05-20 Thread GitBox
tjtoll commented on issue #5636: URL: https://github.com/apache/hudi/issues/5636#issuecomment-1133482798 For Glue 3.0 we use: hudi-spark3-bundle_2.12-0.9.0.jar spark-avro_2.12-3.1.2.jar calcite-core-1.16.0.jar Switch out the hudi-spark3-bundle2.12 for .10 or .11 if you want

[GitHub] [hudi] hudi-bot commented on pull request #5649: Bump gson from 2.3.1 to 2.8.9

2022-05-20 Thread GitBox
hudi-bot commented on PR #5649: URL: https://github.com/apache/hudi/pull/5649#issuecomment-1133461999 ## CI report: * e4c369c2f32eaa70a0c7171e819e2e0dc2a068f9 Azure:

[hudi] branch master updated: [MINOR] Minor fixes to exception log and removing unwanted metrics flush in integ test (#5646)

2022-05-20 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 7d02b1fd3c [MINOR] Minor fixes to exception log

[GitHub] [hudi] yanghua merged pull request #5646: [MINOR] Minor fixes to exception log and removing unwanted metrics flush in integ test

2022-05-20 Thread GitBox
yanghua merged PR #5646: URL: https://github.com/apache/hudi/pull/5646 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] yanghua commented on pull request #5644: [HUDI-3890] fix rat plugin issue

2022-05-20 Thread GitBox
yanghua commented on PR #5644: URL: https://github.com/apache/hudi/pull/5644#issuecomment-1133460165 It's not necessary to create another PR. IMO. Anyway, this PR also contains some commits which are not related to this topic. Please exclude them, thx. -- This is an

[hudi] branch asf-site updated: [DOCS] Fix community sync time (#5650)

2022-05-20 Thread bhavanisudha
This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 80b8081446 [DOCS] Fix community sync

[GitHub] [hudi] bhasudha merged pull request #5650: [DOCS] Fix community sync time

2022-05-20 Thread GitBox
bhasudha merged PR #5650: URL: https://github.com/apache/hudi/pull/5650 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] bhasudha commented on a diff in pull request #5650: [DOCS] Fix community sync time

2022-05-20 Thread GitBox
bhasudha commented on code in PR #5650: URL: https://github.com/apache/hudi/pull/5650#discussion_r878581071 ## website/community/syncs.md: ## @@ -32,6 +36,8 @@ Here are some upcoming calls for convenience. ![Upcoming calls](/assets/images/upcoming-community-calls.png) +

[GitHub] [hudi] nsivabalan commented on a diff in pull request #5650: [DOCS] Fix community sync time

2022-05-20 Thread GitBox
nsivabalan commented on code in PR #5650: URL: https://github.com/apache/hudi/pull/5650#discussion_r878579816 ## website/community/syncs.md: ## @@ -32,6 +36,8 @@ Here are some upcoming calls for convenience. ![Upcoming calls](/assets/images/upcoming-community-calls.png) +

[GitHub] [hudi] hudi-bot commented on pull request #5644: [HUDI-3890] fix rat plugin issue

2022-05-20 Thread GitBox
hudi-bot commented on PR #5644: URL: https://github.com/apache/hudi/pull/5644#issuecomment-1133436358 ## CI report: * 3c61f356ad7330f713d007f22f3e3410eec5b78f Azure:

[GitHub] [hudi] bhasudha commented on pull request #5650: [DOCS] Fix community sync time

2022-05-20 Thread GitBox
bhasudha commented on PR #5650: URL: https://github.com/apache/hudi/pull/5650#issuecomment-1133435377 https://user-images.githubusercontent.com/2179254/169620523-f3fab5cc-769e-4110-ab00-9734c0d3e552.png;>

[GitHub] [hudi] bhasudha opened a new pull request, #5650: [DOCS] Fix community sync time

2022-05-20 Thread GitBox
bhasudha opened a new pull request, #5650: URL: https://github.com/apache/hudi/pull/5650 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] hudi-bot commented on pull request #5644: [HUDI-3890] fix rat plugin issue

2022-05-20 Thread GitBox
hudi-bot commented on PR #5644: URL: https://github.com/apache/hudi/pull/5644#issuecomment-1133405157 ## CI report: * 32c88606c1bd49c4a29264726d2aaee5e6e67157 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5644: [HUDI-3890] fix rat plugin issue

2022-05-20 Thread GitBox
hudi-bot commented on PR #5644: URL: https://github.com/apache/hudi/pull/5644#issuecomment-1133400935 ## CI report: * 32c88606c1bd49c4a29264726d2aaee5e6e67157 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5649: Bump gson from 2.3.1 to 2.8.9

2022-05-20 Thread GitBox
hudi-bot commented on PR #5649: URL: https://github.com/apache/hudi/pull/5649#issuecomment-1133401049 ## CI report: * e4c369c2f32eaa70a0c7171e819e2e0dc2a068f9 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5649: Bump gson from 2.3.1 to 2.8.9

2022-05-20 Thread GitBox
hudi-bot commented on PR #5649: URL: https://github.com/apache/hudi/pull/5649#issuecomment-1133397025 ## CI report: * e4c369c2f32eaa70a0c7171e819e2e0dc2a068f9 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[hudi] branch dependabot/maven/com.google.code.gson-gson-2.8.9 created (now e4c369c2f3)

2022-05-20 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/com.google.code.gson-gson-2.8.9 in repository https://gitbox.apache.org/repos/asf/hudi.git at e4c369c2f3 Bump gson from 2.3.1 to 2.8.9 No new revisions were added by

[GitHub] [hudi] dependabot[bot] opened a new pull request, #5649: Bump gson from 2.3.1 to 2.8.9

2022-05-20 Thread GitBox
dependabot[bot] opened a new pull request, #5649: URL: https://github.com/apache/hudi/pull/5649 Bumps [gson](https://github.com/google/gson) from 2.3.1 to 2.8.9. Release notes Sourced from https://github.com/google/gson/releases;>gson's releases. Gson 2.8.9 Make OSGi

[GitHub] [hudi] hudi-bot commented on pull request #5632: [HUDI-4122] Fix NPE caused by adding kafka nodes

2022-05-20 Thread GitBox
hudi-bot commented on PR #5632: URL: https://github.com/apache/hudi/pull/5632#issuecomment-115251 ## CI report: * 97966b9a535c0644048fc6b02534f6171808bb28 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5648: [HUDI-4132] Fixing determining target table schema for delta sync with empty batch

2022-05-20 Thread GitBox
hudi-bot commented on PR #5648: URL: https://github.com/apache/hudi/pull/5648#issuecomment-1133248063 ## CI report: * fe54afa0058143cda925eac10463da3e506989d4 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5646: [MINOR] Minor fixes to exception log and removing unwanted metrics flush in integ test

2022-05-20 Thread GitBox
hudi-bot commented on PR #5646: URL: https://github.com/apache/hudi/pull/5646#issuecomment-1133208444 ## CI report: * c2d1057b6bd341114e4867305c5b8081f3c9 Azure:

[GitHub] [hudi] umehrot2 commented on issue #5553: [SUPPORT] java.io.EOFException: Invalid position - exceeds the bounds of the stream

2022-05-20 Thread GitBox
umehrot2 commented on issue #5553: URL: https://github.com/apache/hudi/issues/5553#issuecomment-1133216912 We are facing same issue via Spark SQL DML for merge on read tables: ``` Exception in thread "main" org.apache.spark.sql.AnalysisException: Table or view not found:

[GitHub] [hudi] bhasudha commented on pull request #4927: [HUDI-3524] - Docs for basic config page

2022-05-20 Thread GitBox
bhasudha commented on PR #4927: URL: https://github.com/apache/hudi/pull/4927#issuecomment-1133210644 > Thank you for patiently addressing all the previous comments @bhasudha . Few more minor comments and we should be good to land. Addressed all the comments. Please take a look

[GitHub] [hudi] hudi-bot commented on pull request #5645: Bump mysql-connector-java from 5.1.47 to 8.0.16 in /hudi-sync/hudi-adb-sync

2022-05-20 Thread GitBox
hudi-bot commented on PR #5645: URL: https://github.com/apache/hudi/pull/5645#issuecomment-1133201647 ## CI report: * a74dd944cbf952f6b5b4778b7c941573e0724c55 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3391: [HUDI-83] Fix Timestamp/Date type read by Hive3

2022-05-20 Thread GitBox
hudi-bot commented on PR #3391: URL: https://github.com/apache/hudi/pull/3391#issuecomment-1133150631 ## CI report: * af302882429df16c8271bb198dd042c88cf5ac00 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5111: [HUDI-3695] Add a ORC reader in HoodieBaseRelation

2022-05-20 Thread GitBox
hudi-bot commented on PR #5111: URL: https://github.com/apache/hudi/pull/5111#issuecomment-1133114356 ## CI report: * 344e7f1327ee91a271aaa01e05f4afc35c533041 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5632: [HUDI-4122] Fix NPE caused by adding kafka nodes

2022-05-20 Thread GitBox
hudi-bot commented on PR #5632: URL: https://github.com/apache/hudi/pull/5632#issuecomment-1133108231 ## CI report: * 9dcab3f9cdfa513efad3939c8af59aecf8e56d63 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5648: [HUDI-4132] Fixing determining target table schema for delta sync with empty batch

2022-05-20 Thread GitBox
hudi-bot commented on PR #5648: URL: https://github.com/apache/hudi/pull/5648#issuecomment-1133105141 ## CI report: * fe54afa0058143cda925eac10463da3e506989d4 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5632: [HUDI-4122] Fix NPE caused by adding kafka nodes

2022-05-20 Thread GitBox
hudi-bot commented on PR #5632: URL: https://github.com/apache/hudi/pull/5632#issuecomment-1133105024 ## CI report: * 9dcab3f9cdfa513efad3939c8af59aecf8e56d63 Azure:

[jira] [Updated] (HUDI-4132) Fix target schema w/ delta sync when table is empty and when pulled in data is empty batch

2022-05-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-4132: - Labels: pull-request-available (was: ) > Fix target schema w/ delta sync when table is empty and

[jira] [Assigned] (HUDI-4132) Fix target schema w/ delta sync when table is empty and when pulled in data is empty batch

2022-05-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-4132: - Assignee: sivabalan narayanan > Fix target schema w/ delta sync when table is

[jira] [Updated] (HUDI-4132) Fix target schema w/ delta sync when table is empty and when pulled in data is empty batch

2022-05-20 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4132: -- Fix Version/s: 0.11.1 > Fix target schema w/ delta sync when table is empty and when

[GitHub] [hudi] hudi-bot commented on pull request #5648: [HUDI-4132] Fixing determining target table schema for delta sync with empty batch

2022-05-20 Thread GitBox
hudi-bot commented on PR #5648: URL: https://github.com/apache/hudi/pull/5648#issuecomment-1133102245 ## CI report: * fe54afa0058143cda925eac10463da3e506989d4 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5644: [HUDI-3890] fix rat plugin issue

2022-05-20 Thread GitBox
hudi-bot commented on PR #5644: URL: https://github.com/apache/hudi/pull/5644#issuecomment-1133099241 ## CI report: * 32c88606c1bd49c4a29264726d2aaee5e6e67157 Azure:

[GitHub] [hudi] Guanpx commented on issue #5575: [SUPPORT] upgrade hudi 0.10.1 to hudi 0.11.0, Can not read value at 0 in block -1 in file ....

2022-05-20 Thread GitBox
Guanpx commented on issue #5575: URL: https://github.com/apache/hudi/issues/5575#issuecomment-1133089431 > What is the precision of the decimal, you mean the decimal written by Spark can not be read with flink ? Sorry for the late reply,column precision is DECIMAL(20,10) and we use

[jira] [Created] (HUDI-4132) Fix target schema w/ delta sync when table is empty and when pulled in data is empty batch

2022-05-20 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-4132: - Summary: Fix target schema w/ delta sync when table is empty and when pulled in data is empty batch Key: HUDI-4132 URL: https://issues.apache.org/jira/browse/HUDI-4132

[GitHub] [hudi] nsivabalan opened a new pull request, #5648: [MINOR] Fixing determining target table schema for delta sync with empty batch

2022-05-20 Thread GitBox
nsivabalan opened a new pull request, #5648: URL: https://github.com/apache/hudi/pull/5648 ## What is the purpose of the pull request *(For example: This pull request adds quick-start document.)* ## Brief change log *(for example:)* - *Modify AnnotationLocation

[GitHub] [hudi] hudi-bot commented on pull request #5458: [HUDI-3984] Remove mandatory check of partiton path for cli command

2022-05-20 Thread GitBox
hudi-bot commented on PR #5458: URL: https://github.com/apache/hudi/pull/5458#issuecomment-1133040029 ## CI report: * 14fd7d474c15b65ba60132ffb8101efc090231bc Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5646: [MINOR] Minor fixes to exception log and removing unwanted metrics flush in integ test

2022-05-20 Thread GitBox
hudi-bot commented on PR #5646: URL: https://github.com/apache/hudi/pull/5646#issuecomment-1133040466 ## CI report: * c2d1057b6bd341114e4867305c5b8081f3c9 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5646: [MINOR] Minor fixes to exception log and removing unwanted metrics flush in integ test

2022-05-20 Thread GitBox
hudi-bot commented on PR #5646: URL: https://github.com/apache/hudi/pull/5646#issuecomment-1133037099 ## CI report: * c2d1057b6bd341114e4867305c5b8081f3c9 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5637: [HUDI-4124] Add valid check in Spark Datasource configs

2022-05-20 Thread GitBox
hudi-bot commented on PR #5637: URL: https://github.com/apache/hudi/pull/5637#issuecomment-1133036982 ## CI report: * 010c94ed70bff816fd674c753e0763a0307ffdff Azure:

[GitHub] [hudi] leobiscassi commented on pull request #5647: Update the docs for Distributed File System (DFS) section on Hudi Delta Streamer page

2022-05-20 Thread GitBox
leobiscassi commented on PR #5647: URL: https://github.com/apache/hudi/pull/5647#issuecomment-1133033707 @yihua @bhasudha this PR is related to #5485 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] leobiscassi opened a new pull request, #5647: Update the docs for Distributed File System (DFS) section on Hudi Delta Streamer page

2022-05-20 Thread GitBox
leobiscassi opened a new pull request, #5647: URL: https://github.com/apache/hudi/pull/5647 ## What is the purpose of the pull request This PR aims to improve the docs on hudi delta streamer for DFS on two things: - The expected behavior around partitions that @yihua explained

[GitHub] [hudi] zhangyue19921010 commented on a diff in pull request #5567: [RFC-53] Use Lock-Free Message Queue Disruptor Improving Hoodie Writing Efficiency

2022-05-20 Thread GitBox
zhangyue19921010 commented on code in PR #5567: URL: https://github.com/apache/hudi/pull/5567#discussion_r878254732 ## rfc/rfc-53/rfc-53.md: ## @@ -0,0 +1,120 @@ + +# RFC-53: Use Lock-Free Message Queue Improving Hoodie Writing Efficiency + + +## Proposers +@zhangyue19921010 +

[GitHub] [hudi] zhangyue19921010 commented on a diff in pull request #5567: [RFC-53] Use Lock-Free Message Queue Disruptor Improving Hoodie Writing Efficiency

2022-05-20 Thread GitBox
zhangyue19921010 commented on code in PR #5567: URL: https://github.com/apache/hudi/pull/5567#discussion_r878253130 ## rfc/rfc-53/rfc-53.md: ## @@ -0,0 +1,154 @@ + +# RFC-53: Use Lock-Free Message Queue Improving Hoodie Writing Efficiency + + +## Proposers +@zhangyue19921010 +

[GitHub] [hudi] zhangyue19921010 commented on a diff in pull request #5567: [RFC-53] Use Lock-Free Message Queue Disruptor Improving Hoodie Writing Efficiency

2022-05-20 Thread GitBox
zhangyue19921010 commented on code in PR #5567: URL: https://github.com/apache/hudi/pull/5567#discussion_r878253812 ## rfc/rfc-53/rfc-53.md: ## @@ -0,0 +1,154 @@ + +# RFC-53: Use Lock-Free Message Queue Improving Hoodie Writing Efficiency + + +## Proposers +@zhangyue19921010 +

[jira] [Comment Edited] (HUDI-1575) Early detection by periodically checking last written commit & active markers

2022-05-20 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540154#comment-17540154 ] Yue Zhang edited comment on HUDI-1575 at 5/20/22 2:58 PM: -- Eager conflict

[jira] [Commented] (HUDI-1575) Early detection by periodically checking last written commit & active markers

2022-05-20 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540158#comment-17540158 ] Yue Zhang commented on HUDI-1575: - Also we may need more design here for example 1. How to adapt both

[jira] [Commented] (HUDI-1575) Early detection by periodically checking last written commit & active markers

2022-05-20 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540154#comment-17540154 ] Yue Zhang commented on HUDI-1575: - Eager conflict detection based on marker file For now we have three

[GitHub] [hudi] nsivabalan opened a new pull request, #5646: [MINOR] Minor fixes to exception log and removing unwanted metrics flush in integ test

2022-05-20 Thread GitBox
nsivabalan opened a new pull request, #5646: URL: https://github.com/apache/hudi/pull/5646 ## What is the purpose of the pull request - Minor fixes to exception log with DeltaSync. - removing unwanted metrics flush in integ test ## Brief change log *(for example:)*

[GitHub] [hudi] dependabot[bot] commented on pull request #5228: Bump mysql-connector-java from 5.1.47 to 8.0.16 in /hudi-sync/hudi-dla-sync

2022-05-20 Thread GitBox
dependabot[bot] commented on PR #5228: URL: https://github.com/apache/hudi/pull/5228#issuecomment-1132973516 Dependabot tried to update this pull request, but something went wrong. We're looking into it, but in the meantime you can retry the update by commenting `@dependabot rebase`. --

[GitHub] [hudi] hudi-bot commented on pull request #5645: Bump mysql-connector-java from 5.1.47 to 8.0.16 in /hudi-sync/hudi-adb-sync

2022-05-20 Thread GitBox
hudi-bot commented on PR #5645: URL: https://github.com/apache/hudi/pull/5645#issuecomment-1132972209 ## CI report: * a74dd944cbf952f6b5b4778b7c941573e0724c55 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5111: [HUDI-3695] Add a ORC reader in HoodieBaseRelation

2022-05-20 Thread GitBox
hudi-bot commented on PR #5111: URL: https://github.com/apache/hudi/pull/5111#issuecomment-1132970496 ## CI report: * f97c922bfe5e9e320052d4c31e215f3668d50ab1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3391: [HUDI-83] Fix Timestamp/Date type read by Hive3

2022-05-20 Thread GitBox
hudi-bot commented on PR #3391: URL: https://github.com/apache/hudi/pull/3391#issuecomment-1132969178 ## CI report: * 689164ecbc425c45d752fb2aff31138f295cef7c Azure:

[GitHub] [hudi] xushiyan commented on issue #5605: [SUPPORT]Support Apache Spark 3.3 in hudi

2022-05-20 Thread GitBox
xushiyan commented on issue #5605: URL: https://github.com/apache/hudi/issues/5605#issuecomment-1132967295 @melin thanks for highlighting this. we'll upgrade and support newer version of spark with a proper timeline. -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] xushiyan closed issue #5605: [SUPPORT]Support Apache Spark 3.3 in hudi

2022-05-20 Thread GitBox
xushiyan closed issue #5605: [SUPPORT]Support Apache Spark 3.3 in hudi URL: https://github.com/apache/hudi/issues/5605 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] hudi-bot commented on pull request #5645: Bump mysql-connector-java from 5.1.47 to 8.0.16 in /hudi-sync/hudi-adb-sync

2022-05-20 Thread GitBox
hudi-bot commented on PR #5645: URL: https://github.com/apache/hudi/pull/5645#issuecomment-1132966861 ## CI report: * a74dd944cbf952f6b5b4778b7c941573e0724c55 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5111: [HUDI-3695] Add a ORC reader in HoodieBaseRelation

2022-05-20 Thread GitBox
hudi-bot commented on PR #5111: URL: https://github.com/apache/hudi/pull/5111#issuecomment-1132965726 ## CI report: * f97c922bfe5e9e320052d4c31e215f3668d50ab1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3391: [HUDI-83] Fix Timestamp/Date type read by Hive3

2022-05-20 Thread GitBox
hudi-bot commented on PR #3391: URL: https://github.com/apache/hudi/pull/3391#issuecomment-1132964454 ## CI report: * 689164ecbc425c45d752fb2aff31138f295cef7c Azure:

[hudi] branch dependabot/maven/hudi-sync/hudi-adb-sync/mysql-mysql-connector-java-8.0.16 created (now a74dd944cb)

2022-05-20 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/hudi-sync/hudi-adb-sync/mysql-mysql-connector-java-8.0.16 in repository https://gitbox.apache.org/repos/asf/hudi.git at a74dd944cb Bump mysql-connector-java in

[GitHub] [hudi] dependabot[bot] opened a new pull request, #5645: Bump mysql-connector-java from 5.1.47 to 8.0.16 in /hudi-sync/hudi-adb-sync

2022-05-20 Thread GitBox
dependabot[bot] opened a new pull request, #5645: URL: https://github.com/apache/hudi/pull/5645 Bumps [mysql-connector-java](https://github.com/mysql/mysql-connector-j) from 5.1.47 to 8.0.16. Changelog Sourced from

[hudi] branch master updated (c7576f7613 -> 85b146d3d5)

2022-05-20 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from c7576f7613 [HUDI-4130] Remove the upgrade/downgrade for flink #initTable (#5642) add 85b146d3d5 [HUDI-3985]

[GitHub] [hudi] leesf merged pull request #5532: [HUDI-3985] Refactor DLASyncTool to support read hoodie table as spark datasource table

2022-05-20 Thread GitBox
leesf merged PR #5532: URL: https://github.com/apache/hudi/pull/5532 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] leesf commented on a diff in pull request #5567: [RFC-53] Use Lock-Free Message Queue Disruptor Improving Hoodie Writing Efficiency

2022-05-20 Thread GitBox
leesf commented on code in PR #5567: URL: https://github.com/apache/hudi/pull/5567#discussion_r878201800 ## rfc/rfc-53/rfc-53.md: ## @@ -0,0 +1,120 @@ + +# RFC-53: Use Lock-Free Message Queue Improving Hoodie Writing Efficiency + + +## Proposers +@zhangyue19921010 + +##

[GitHub] [hudi] leesf commented on a diff in pull request #5567: [RFC-53] Use Lock-Free Message Queue Disruptor Improving Hoodie Writing Efficiency

2022-05-20 Thread GitBox
leesf commented on code in PR #5567: URL: https://github.com/apache/hudi/pull/5567#discussion_r878200906 ## rfc/rfc-53/rfc-53.md: ## @@ -0,0 +1,154 @@ + +# RFC-53: Use Lock-Free Message Queue Improving Hoodie Writing Efficiency + + +## Proposers +@zhangyue19921010 + +##

[GitHub] [hudi] leesf commented on a diff in pull request #5567: [RFC-53] Use Lock-Free Message Queue Disruptor Improving Hoodie Writing Efficiency

2022-05-20 Thread GitBox
leesf commented on code in PR #5567: URL: https://github.com/apache/hudi/pull/5567#discussion_r878200093 ## rfc/rfc-53/rfc-53.md: ## @@ -0,0 +1,154 @@ + +# RFC-53: Use Lock-Free Message Queue Improving Hoodie Writing Efficiency + + +## Proposers +@zhangyue19921010 + +##

[GitHub] [hudi] leesf commented on issue #5488: [SUPPORT] Read hive Table fail when HoodieCatalog used

2022-05-20 Thread GitBox
leesf commented on issue #5488: URL: https://github.com/apache/hudi/issues/5488#issuecomment-1132950771 > yeah sorry this was internal code leading to the same result: > SparkSession.builder().config("spark.sql.catalog.spark_catalog",

[GitHub] [hudi] miomiocat commented on pull request #5458: [HUDI-3984] Remove mandatory check of partiton path for cli command

2022-05-20 Thread GitBox
miomiocat commented on PR #5458: URL: https://github.com/apache/hudi/pull/5458#issuecomment-1132949189 > can you check the CI failure please? Thank you, all CI passed, PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] cdmikechen commented on a diff in pull request #3391: [HUDI-83] Fix Timestamp/Date type read by Hive3

2022-05-20 Thread GitBox
cdmikechen commented on code in PR #3391: URL: https://github.com/apache/hudi/pull/3391#discussion_r878161873 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/avro/HudiAvroParquetReader.java: ## @@ -0,0 +1,104 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [hudi] hudi-bot commented on pull request #5637: [HUDI-4124] Add valid check in Spark Datasource configs

2022-05-20 Thread GitBox
hudi-bot commented on PR #5637: URL: https://github.com/apache/hudi/pull/5637#issuecomment-1132909629 ## CI report: * dc838867d8ee1c7332b79c11cc1e0f62614ee975 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5644: [HUDI-3890] fix rat plugin issue

2022-05-20 Thread GitBox
hudi-bot commented on PR #5644: URL: https://github.com/apache/hudi/pull/5644#issuecomment-1132909711 ## CI report: * 32c88606c1bd49c4a29264726d2aaee5e6e67157 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5458: [HUDI-3984] Remove mandatory check of partiton path for cli command

2022-05-20 Thread GitBox
hudi-bot commented on PR #5458: URL: https://github.com/apache/hudi/pull/5458#issuecomment-1132909205 ## CI report: * 14fef008fd841daf937eaa730ef5416101af3677 Azure:

[jira] [Commented] (HUDI-4130) Remove the upgrade/downgrade for flink #initTable

2022-05-20 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540133#comment-17540133 ] Danny Chen commented on HUDI-4130: -- Fixed via master branch: c7576f7613ba76ab7db6608598182d8970ce1bd9 >

  1   2   >