[GitHub] [hudi] BruceKellan closed issue #7643: [SUPPORT] Too slow while using trino-hudi connector while querying partitioned tables.

2023-02-22 Thread via GitHub
BruceKellan closed issue #7643: [SUPPORT] Too slow while using trino-hudi connector while querying partitioned tables. URL: https://github.com/apache/hudi/issues/7643 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] hudi-bot commented on pull request #8024: [MINOR] Improve RollbackToInstantTimeProcedure

2023-02-22 Thread via GitHub
hudi-bot commented on PR #8024: URL: https://github.com/apache/hudi/pull/8024#issuecomment-1441302888 ## CI report: * 7c0543843874887de825c3af7bc1941e2abe0049 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7987: URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441302794 ## CI report: * 8a5dd3249ed91fd70842ec274fc905d2e04bff07 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7871: [HUDI-4690][HUDI-4503] Cleaning up Hudi custom Spark `Rule`s

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7871: URL: https://github.com/apache/hudi/pull/7871#issuecomment-1441302450 ## CI report: * 286533b5f8edf1d85a49fcf6449fb11d4f4085d6 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8024: [MINOR] Improve RollbackToInstantTimeProcedure

2023-02-22 Thread via GitHub
hudi-bot commented on PR #8024: URL: https://github.com/apache/hudi/pull/8024#issuecomment-1441297202 ## CI report: * 7c0543843874887de825c3af7bc1941e2abe0049 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #8015: [HUDI-5317] Fix insert overwrite table for partitioned table

2023-02-22 Thread via GitHub
hudi-bot commented on PR #8015: URL: https://github.com/apache/hudi/pull/8015#issuecomment-1441297151 ## CI report: * 8aa97ffd3030c5472d3efe0a325db4725812b227 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7987: URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441297058 ## CI report: * 8a5dd3249ed91fd70842ec274fc905d2e04bff07 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7871: [HUDI-4690][HUDI-4503] Cleaning up Hudi custom Spark `Rule`s

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7871: URL: https://github.com/apache/hudi/pull/7871#issuecomment-1441296660 ## CI report: * 286533b5f8edf1d85a49fcf6449fb11d4f4085d6 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7159: [HUDI-5173]Skip if there is only one file in clusteringGroup

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7159: URL: https://github.com/apache/hudi/pull/7159#issuecomment-1441295802 ## CI report: * 15ecd91180d32c7fa1905c11408f4bc23347e682 UNKNOWN * b938bca41640daf3587e52d15ae48c911a9f5e76 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8015: [HUDI-5317] Fix insert overwrite table for partitioned table

2023-02-22 Thread via GitHub
hudi-bot commented on PR #8015: URL: https://github.com/apache/hudi/pull/8015#issuecomment-1441292032 ## CI report: * 8aa97ffd3030c5472d3efe0a325db4725812b227 Azure:

[GitHub] [hudi] XuQianJin-Stars opened a new pull request, #8024: [MINOR] improve RollbackToInstantTimeProcedure

2023-02-22 Thread via GitHub
XuQianJin-Stars opened a new pull request, #8024: URL: https://github.com/apache/hudi/pull/8024 ### Change Logs improve RollbackToInstantTimeProcedure ### Impact NA ### Risk level (write none, low medium or high below) none ### Documentation Update

[GitHub] [hudi] zhuanshenbsj1 commented on a diff in pull request #7159: [HUDI-5173]Skip if there is only one file in clusteringGroup

2023-02-22 Thread via GitHub
zhuanshenbsj1 commented on code in PR #7159: URL: https://github.com/apache/hudi/pull/7159#discussion_r1115286599 ## hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/client/clustering/plan/strategy/FlinkSizeBasedClusteringPlanStrategy.java: ## @@ -63,27 +63,41 @@

[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7987: URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441261059 ## CI report: * 8a5dd3249ed91fd70842ec274fc905d2e04bff07 Azure:

[jira] [Comment Edited] (HUDI-4341) HoodieHFileReader is not compatible with Hadoop 3

2023-02-22 Thread waywtdcc (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692506#comment-17692506 ] waywtdcc edited comment on HUDI-4341 at 2/23/23 6:14 AM: - Hello, why is this

[jira] [Commented] (HUDI-4341) HoodieHFileReader is not compatible with Hadoop 3

2023-02-22 Thread waywtdcc (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692506#comment-17692506 ] waywtdcc commented on HUDI-4341: Hello, why is this possible? After compiling, I found that the method

[GitHub] [hudi] waywtdcc commented on issue #5765: [SUPPORT] throw "java.lang.NoSuchMethodError: org.apache.hadoop.hdfs.client.HdfsDataInputStream.getReadStatistics()"

2023-02-22 Thread via GitHub
waywtdcc commented on issue #5765: URL: https://github.com/apache/hudi/issues/5765#issuecomment-1441257445 @nsivabalan Hello, why is this possible? After compiling, I found that the method reference of HdfsDataInputStream.getReadStatistics has not changed -- This is an automated message

[GitHub] [hudi] stream2000 commented on pull request #8015: [HUDI-5317] Fix insert overwrite table for partitioned table

2023-02-22 Thread via GitHub
stream2000 commented on PR #8015: URL: https://github.com/apache/hudi/pull/8015#issuecomment-1441246202 > @stream2000 Hi, I'm quite confused with the behavior here, for `insert_overwrite_table` with `bulk_insert` enabled, we'll directly drop the data first, and then do the write operation,

[GitHub] [hudi] bvaradar commented on pull request #7515: Bump gson from 2.6.2 to 2.8.9 in /packaging/hudi-cli-bundle

2023-02-22 Thread via GitHub
bvaradar commented on PR #7515: URL: https://github.com/apache/hudi/pull/7515#issuecomment-1441239250 @yihua : Not sure if there is any recent context with gson dependency. Is this safe to be merged in ? -- This is an automated message from the Apache Git Service. To respond to the

[hudi] branch master updated: Fix usage of SchemaRegistryProvider with Row source (#7601)

2023-02-22 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 24c9a86dae2 Fix usage of SchemaRegistryProvider

[GitHub] [hudi] bvaradar merged pull request #7601: [MINOR]: Fix usage of SchemaRegistryProvider with Row source

2023-02-22 Thread via GitHub
bvaradar merged PR #7601: URL: https://github.com/apache/hudi/pull/7601 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] shursulei commented on issue #6894: [SUPPORT]Error running child : java.lang.NoSuchMethodError: org.apache.parquet.avro.AvroSchemaConverter.convert(Lorg/apache/parquet/schema/MessageTy

2023-02-22 Thread via GitHub
shursulei commented on issue #6894: URL: https://github.com/apache/hudi/issues/6894#issuecomment-1441234619 i have to solve this problem.Beacuse of the version of the flink and the version of the hudi. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7987: URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441200660 ## CI report: * f1306b01c7b6025b26a64217498c00077dbe6e29 Azure:

[GitHub] [hudi] nfarah86 commented on issue #8019: [SUPPORT] How to Restore from Checkpoints from disaster recovery in hudi using Pyspark and not Hudi CLI and use proc in PySpark

2023-02-22 Thread via GitHub
nfarah86 commented on issue #8019: URL: https://github.com/apache/hudi/issues/8019#issuecomment-1441199915 thanks @soumilshah1995 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] bithw1 commented on issue #7994: [SUPPORT]How to get back the historic commit time information in my scenario

2023-02-22 Thread via GitHub
bithw1 commented on issue #7994: URL: https://github.com/apache/hudi/issues/7994#issuecomment-1441196696 Could some one help take a look? How to get the commit times that can't be queried out with `select distinct _hoodie_commit_time from mytabl` -- This is an automated message from

[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7987: URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441193620 ## CI report: * f1306b01c7b6025b26a64217498c00077dbe6e29 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7987: URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441166804 ## CI report: * f1306b01c7b6025b26a64217498c00077dbe6e29 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7987: [HUDI-5514] Record Keys Auto-gen Prototype

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7987: URL: https://github.com/apache/hudi/pull/7987#issuecomment-1441162562 ## CI report: * f1306b01c7b6025b26a64217498c00077dbe6e29 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Commented] (HUDI-5641) Streamline Advanced Schema Evolution flow

2023-02-22 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692465#comment-17692465 ] Alexey Kudinkin commented on HUDI-5641: --- [~xushiyan] good catch! It's actually > Streamline

[jira] [Closed] (HUDI-5641) Streamline Advanced Schema Evolution flow

2023-02-22 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin closed HUDI-5641. - Resolution: Fixed > Streamline Advanced Schema Evolution flow >

[GitHub] [hudi] hudi-bot commented on pull request #7998: [HUDI-5824] Fix: do not combine if write operation is Upsert and COMBINE_BEFORE_UPSERT is false

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7998: URL: https://github.com/apache/hudi/pull/7998#issuecomment-1441159107 ## CI report: * 27d61f01fb6709e3aaa08de9ace7738dbedffb24 UNKNOWN * c164a3991b8bd900b802fa8de8e85ccb54f6cb98 Azure:

[jira] [Assigned] (HUDI-5514) Add support for auto generation of record keys for Hudi

2023-02-22 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin reassigned HUDI-5514: - Assignee: Alexey Kudinkin (was: sivabalan narayanan) > Add support for auto generation

[GitHub] [hudi] boneanxs commented on pull request #8015: [HUDI-5317] Fix insert overwrite table for partitioned table

2023-02-22 Thread via GitHub
boneanxs commented on PR #8015: URL: https://github.com/apache/hudi/pull/8015#issuecomment-1441146491 @stream2000 Hi, I'm quite confused with the behavior here, for `insert_overwrite_table` with `bulk_insert` enabled, we'll directly drop the data first, and then do the write operation,

[GitHub] [hudi] nsivabalan commented on a diff in pull request #7901: [HUDI-5665] Adding support to re-use table configs

2023-02-22 Thread via GitHub
nsivabalan commented on code in PR #7901: URL: https://github.com/apache/hudi/pull/7901#discussion_r1115179371 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieWriterUtils.scala: ## @@ -86,6 +83,20 @@ object HoodieWriterUtils {

[GitHub] [hudi] nsivabalan commented on a diff in pull request #7901: [HUDI-5665] Adding support to re-use table configs

2023-02-22 Thread via GitHub
nsivabalan commented on code in PR #7901: URL: https://github.com/apache/hudi/pull/7901#discussion_r1115179259 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala: ## @@ -121,15 +122,19 @@ object HoodieSparkSqlWriter { val

[GitHub] [hudi] hudi-bot commented on pull request #7998: [HUDI-5824] Fix: do not combine if write operation is Upsert and COMBINE_BEFORE_UPSERT is false

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7998: URL: https://github.com/apache/hudi/pull/7998#issuecomment-1441127487 ## CI report: * 13fafcd633926980f7e01117c8039138f14fa3f5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1441127203 ## CI report: * 38b3bf82a57801e27cf28532590327b785754fc5 UNKNOWN * 6323b40d1d2d6ad9f54a21e0bc1f8d71249b96dc UNKNOWN * 50daa6066c84f6a9c45cb9e6fa3427ee83544576 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7998: [HUDI-5824] Fix: do not combine if write operation is Upsert and COMBINE_BEFORE_UPSERT is false

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7998: URL: https://github.com/apache/hudi/pull/7998#issuecomment-1441102791 ## CI report: * 13fafcd633926980f7e01117c8039138f14fa3f5 Azure:

[jira] [Updated] (HUDI-5834) Cutting website docs for 0.13.0

2023-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5834: - Labels: pull-request-available (was: ) > Cutting website docs for 0.13.0 >

[GitHub] [hudi] yihua opened a new pull request, #8023: [HUDI-5834] Add 0.13.0 docs

2023-02-22 Thread via GitHub
yihua opened a new pull request, #8023: URL: https://github.com/apache/hudi/pull/8023 ### Change Logs This PR adds the version of docs for 0.13.0 release. ### Impact As above. The website is tested locally. ### Risk level none ### Documentation

[GitHub] [hudi] hudi-bot commented on pull request #7998: [HUDI-5824] Fix: do not combine if write operation is Upsert and COMBINE_BEFORE_UPSERT is false

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7998: URL: https://github.com/apache/hudi/pull/7998#issuecomment-1441098868 ## CI report: * 13fafcd633926980f7e01117c8039138f14fa3f5 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7901: [HUDI-5665] Adding support to re-use table configs

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7901: URL: https://github.com/apache/hudi/pull/7901#issuecomment-1441098686 ## CI report: * c55e96ff2e67739855776b50b3a88dd43bfc2f9d Azure:

[hudi] branch asf-site updated: [DOCS] Change Config generator to generate subgroups (#7970)

2023-02-22 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 48bc60d8298 [DOCS] Change Config generator to

[GitHub] [hudi] yihua merged pull request #7970: [DOCS] Change Config generator to generate subgroups

2023-02-22 Thread via GitHub
yihua merged PR #7970: URL: https://github.com/apache/hudi/pull/7970 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HUDI-5834) Cutting website docs for 0.13.0

2023-02-22 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5834: Fix Version/s: 0.13.0 > Cutting website docs for 0.13.0 > --- > >

[jira] [Assigned] (HUDI-5834) Cutting website docs for 0.13.0

2023-02-22 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-5834: --- Assignee: Ethan Guo > Cutting website docs for 0.13.0 > --- > >

[jira] [Updated] (HUDI-5834) Cutting website docs for 0.13.0

2023-02-22 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5834: Story Points: 1 > Cutting website docs for 0.13.0 > --- > >

[jira] [Updated] (HUDI-5833) Add 0.13.0 release notes

2023-02-22 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5833: Story Points: 2 (was: 1) > Add 0.13.0 release notes > > > Key:

[jira] [Created] (HUDI-5834) Cutting website docs for 0.13.0

2023-02-22 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-5834: --- Summary: Cutting website docs for 0.13.0 Key: HUDI-5834 URL: https://issues.apache.org/jira/browse/HUDI-5834 Project: Apache Hudi Issue Type: Improvement

[jira] [Updated] (HUDI-5834) Cutting website docs for 0.13.0

2023-02-22 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5834: Priority: Blocker (was: Major) > Cutting website docs for 0.13.0 > --- > >

[GitHub] [hudi] yihua commented on pull request #8022: [HUDI-5833] Add 0.13.0 release notes

2023-02-22 Thread via GitHub
yihua commented on PR #8022: URL: https://github.com/apache/hudi/pull/8022#issuecomment-1441025181 Preview: ![release-0 13 0](https://user-images.githubusercontent.com/2497195/220791798-1e07d722-6e45-4d0e-b750-2a49e7c0dd30.png) -- This is an automated message from the Apache Git

[jira] [Updated] (HUDI-5833) Add 0.13.0 release notes

2023-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-5833: - Labels: pull-request-available (was: ) > Add 0.13.0 release notes > > >

[GitHub] [hudi] hudi-bot commented on pull request #7951: [HUDI-5796] Adding auto inferring partition from incoming df

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7951: URL: https://github.com/apache/hudi/pull/7951#issuecomment-1441022595 ## CI report: * ffc4e3d7fb447cb72feaeaa4a1aec866c519e561 Azure:

[GitHub] [hudi] yihua opened a new pull request, #8022: [HUDI-5833] Add 0.13.0 release notes

2023-02-22 Thread via GitHub
yihua opened a new pull request, #8022: URL: https://github.com/apache/hudi/pull/8022 ### Change Logs This PR adds the 0.13.0 release notes and download links for 0.13.0. ### Impact Announces 0.13.0 on Hudi website. The changes are tested locally by building and

[hudi] branch master updated: [HUDI-5817] Fix async indexer metadata writer to avoid eager rollback and failed write cleaning (#8001)

2023-02-22 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new ad2a37d6796 [HUDI-5817] Fix async indexer

[GitHub] [hudi] nsivabalan merged pull request #8001: [HUDI-5817] Fix async indexer metadata writer to avoid eager rollback and failed write cleaning

2023-02-22 Thread via GitHub
nsivabalan merged PR #8001: URL: https://github.com/apache/hudi/pull/8001 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #7948: [HUDI-5794] Failing new commits on any pending restore commits

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7948: URL: https://github.com/apache/hudi/pull/7948#issuecomment-1440986915 ## CI report: * 0d3b0bbbf1aa55f5fe65f3a052d9d3839687898b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7901: [HUDI-5665] Adding support to re-use table configs

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7901: URL: https://github.com/apache/hudi/pull/7901#issuecomment-1440986768 ## CI report: * 4f81cc10efc5863beb8f9656c05fc2e03ce6c7ee Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1440986688 ## CI report: * 38b3bf82a57801e27cf28532590327b785754fc5 UNKNOWN * 6323b40d1d2d6ad9f54a21e0bc1f8d71249b96dc UNKNOWN * 0732460d48dc088dfbe64fb7c85917cd04515ca2 Azure:

[jira] [Closed] (HUDI-5746) 0.13.0 release note part 4

2023-02-22 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5746. --- Resolution: Fixed > 0.13.0 release note part 4 > -- > > Key:

[jira] [Closed] (HUDI-5748) 0.13.0 release note part 6

2023-02-22 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5748. --- Resolution: Fixed > 0.13.0 release note part 6 > -- > > Key:

[jira] [Closed] (HUDI-5744) 0.13.0 release note part 2

2023-02-22 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5744. --- Resolution: Fixed > 0.13.0 release note part 2 > -- > > Key:

[jira] [Closed] (HUDI-5743) 0.13.0 release note part 1

2023-02-22 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5743. --- Resolution: Fixed > 0.13.0 release note part 1 > -- > > Key:

[jira] [Closed] (HUDI-5747) 0.13.0 release note part 5

2023-02-22 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5747. --- Resolution: Fixed > 0.13.0 release note part 5 > -- > > Key:

[GitHub] [hudi] hudi-bot commented on pull request #7901: [HUDI-5665] Adding support to re-use table configs

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7901: URL: https://github.com/apache/hudi/pull/7901#issuecomment-1440980804 ## CI report: * 4f81cc10efc5863beb8f9656c05fc2e03ce6c7ee Azure:

[jira] [Commented] (HUDI-5828) Support df.write.format("hudi") with out any additional options

2023-02-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692402#comment-17692402 ] sivabalan narayanan commented on HUDI-5828: --- looks like having tableName as a mandatory should

[jira] [Comment Edited] (HUDI-5828) Support df.write.format("hudi") with out any additional options

2023-02-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692402#comment-17692402 ] sivabalan narayanan edited comment on HUDI-5828 at 2/22/23 10:36 PM: -

[jira] [Updated] (HUDI-5828) Support df.write.format("hudi") with out any additional options

2023-02-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5828: -- Summary: Support df.write.format("hudi") with out any additional options (was: Support

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1440900070 ## CI report: * 38b3bf82a57801e27cf28532590327b785754fc5 UNKNOWN * 6323b40d1d2d6ad9f54a21e0bc1f8d71249b96dc UNKNOWN * 0732460d48dc088dfbe64fb7c85917cd04515ca2 Azure:

[GitHub] [hudi] soumilshah1995 opened a new issue, #8021: [DOC] Adding new stored procedures and brief documentation to the Hudi website

2023-02-22 Thread via GitHub
soumilshah1995 opened a new issue, #8021: URL: https://github.com/apache/hudi/issues/8021 Update the Hudi website with the most recent instructions, which are available at the following URL. Having a centralized repository for information benefits the community. Adding this Ticket for

[GitHub] [hudi] kazdy commented on issue #8018: [SUPPORT] why is the schema evolution done while not setting hoodie.schema.on.read.enable

2023-02-22 Thread via GitHub
kazdy commented on issue #8018: URL: https://github.com/apache/hudi/issues/8018#issuecomment-1440891084 Hi, Hudi has optional "schema on read" and "out of the box schema evolution" which is the default. With "out of the box schema evolution" adding new columns is supported by

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1440887798 ## CI report: * 38b3bf82a57801e27cf28532590327b785754fc5 UNKNOWN * 6323b40d1d2d6ad9f54a21e0bc1f8d71249b96dc UNKNOWN * 546a221d5f28c7ee0a4e2b86f796efb6f3ae1f42 Azure:

[GitHub] [hudi] soumilshah1995 closed issue #8019: [SUPPORT] How to Restore from Checkpoints from disaster recovery in hudi using Pyspark and not Hudi CLI and use proc in PySpark

2023-02-22 Thread via GitHub
soumilshah1995 closed issue #8019: [SUPPORT] How to Restore from Checkpoints from disaster recovery in hudi using Pyspark and not Hudi CLI and use proc in PySpark URL: https://github.com/apache/hudi/issues/8019 -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] soumilshah1995 commented on issue #8019: [SUPPORT] How to Restore from Checkpoints from disaster recovery in hudi using Pyspark and not Hudi CLI and use proc in PySpark

2023-02-22 Thread via GitHub
soumilshah1995 commented on issue #8019: URL: https://github.com/apache/hudi/issues/8019#issuecomment-1440886019 # My Issue have been resolved and would be making content for community

[GitHub] [hudi] hudi-bot commented on pull request #7951: [HUDI-5796] Adding auto inferring partition from incoming df

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7951: URL: https://github.com/apache/hudi/pull/7951#issuecomment-1440808948 ## CI report: * 1bc2fd1e84e07cff545656df5eb0d7163223a8b4 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7948: [HUDI-5794] Failing new commits on any pending restore commits

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7948: URL: https://github.com/apache/hudi/pull/7948#issuecomment-1440808843 ## CI report: * 44ccfacd787a566ff73343955389b080576ab225 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7885: [HUDI-5352] Make sure FTs are run in GH CI

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7885: URL: https://github.com/apache/hudi/pull/7885#issuecomment-1440808508 ## CI report: * 38b3bf82a57801e27cf28532590327b785754fc5 UNKNOWN * 6323b40d1d2d6ad9f54a21e0bc1f8d71249b96dc UNKNOWN * 546a221d5f28c7ee0a4e2b86f796efb6f3ae1f42 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7951: [HUDI-5796] Adding auto inferring partition from incoming df

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7951: URL: https://github.com/apache/hudi/pull/7951#issuecomment-1440800610 ## CI report: * 7209efd0df54978907b937f1a2aaef0e6b1f74b0 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7948: [HUDI-5794] Failing new commits on any pending restore commits

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7948: URL: https://github.com/apache/hudi/pull/7948#issuecomment-1440800516 ## CI report: * 44ccfacd787a566ff73343955389b080576ab225 Azure:

[GitHub] [hudi] nsivabalan commented on pull request #7951: [HUDI-5796] Adding auto inferring partition from incoming df

2023-02-22 Thread via GitHub
nsivabalan commented on PR #7951: URL: https://github.com/apache/hudi/pull/7951#issuecomment-1440783829 @xushiyan : ready for review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] nsivabalan commented on pull request #7948: [HUDI-5794] Failing new commits on any pending restore commits

2023-02-22 Thread via GitHub
nsivabalan commented on PR #7948: URL: https://github.com/apache/hudi/pull/7948#issuecomment-1440783540 @xushiyan : ready for review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] nsivabalan commented on a diff in pull request #7951: [HUDI-5796] Adding auto inferring partition from incoming df

2023-02-22 Thread via GitHub
nsivabalan commented on code in PR #7951: URL: https://github.com/apache/hudi/pull/7951#discussion_r1114942532 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala: ## @@ -295,30 +295,35 @@ object DataSourceWriteOptions { def

[GitHub] [hudi] hudi-bot commented on pull request #7951: [HUDI-5796] Adding auto inferring partition from incoming df

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7951: URL: https://github.com/apache/hudi/pull/7951#issuecomment-1440737610 ## CI report: * 7209efd0df54978907b937f1a2aaef0e6b1f74b0 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8010: [HUDI-4442] [HUDI-5001] Sanitize JsonConversion and RowSource

2023-02-22 Thread via GitHub
hudi-bot commented on PR #8010: URL: https://github.com/apache/hudi/pull/8010#issuecomment-1440728816 ## CI report: * 7dd3bae6a568456284d48df18c0ab558d675169b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #7951: [HUDI-5796] Adding auto inferring partition from incoming df

2023-02-22 Thread via GitHub
hudi-bot commented on PR #7951: URL: https://github.com/apache/hudi/pull/7951#issuecomment-1440728509 ## CI report: * 7209efd0df54978907b937f1a2aaef0e6b1f74b0 Azure:

[GitHub] [hudi] nsivabalan commented on a diff in pull request #7951: [HUDI-5796] Adding auto inferring partition from incoming df

2023-02-22 Thread via GitHub
nsivabalan commented on code in PR #7951: URL: https://github.com/apache/hudi/pull/7951#discussion_r1114880387 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala: ## @@ -1018,6 +1023,26 @@ object HoodieSparkSqlWriter { }

[jira] [Created] (HUDI-5833) Add 0.13.0 release notes

2023-02-22 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-5833: --- Summary: Add 0.13.0 release notes Key: HUDI-5833 URL: https://issues.apache.org/jira/browse/HUDI-5833 Project: Apache Hudi Issue Type: Improvement

[jira] [Updated] (HUDI-5833) Add 0.13.0 release notes

2023-02-22 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5833: Fix Version/s: 0.13.0 > Add 0.13.0 release notes > > > Key:

[jira] [Assigned] (HUDI-5833) Add 0.13.0 release notes

2023-02-22 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-5833: --- Assignee: Ethan Guo > Add 0.13.0 release notes > > > Key:

[GitHub] [hudi] hudi-bot commented on pull request #8011: [HUDI-5808] Add Support for kaffka ofsets in jsonkafkasource and avrokafkasource

2023-02-22 Thread via GitHub
hudi-bot commented on PR #8011: URL: https://github.com/apache/hudi/pull/8011#issuecomment-1440668488 ## CI report: * 608b303b0b6fb858d575f6942857a6eade742f90 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8011: [HUDI-5808] Add Support for kaffka ofsets in jsonkafkasource and avrokafkasource

2023-02-22 Thread via GitHub
hudi-bot commented on PR #8011: URL: https://github.com/apache/hudi/pull/8011#issuecomment-1440457000 ## CI report: * 0ad210a6500dfe7d8a070346e2bbda72805b4b78 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8010: [HUDI-4442] [HUDI-5001] Sanitize JsonConversion and RowSource

2023-02-22 Thread via GitHub
hudi-bot commented on PR #8010: URL: https://github.com/apache/hudi/pull/8010#issuecomment-1440456938 ## CI report: * 1cb788947969f4573d5a4b2171fbedee696b73d8 Azure:

[GitHub] [hudi] alexeykudinkin closed pull request #7898: [HUDI-5731] Add guava dependency to Spark and MR bundle

2023-02-22 Thread via GitHub
alexeykudinkin closed pull request #7898: [HUDI-5731] Add guava dependency to Spark and MR bundle URL: https://github.com/apache/hudi/pull/7898 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] alexeykudinkin commented on pull request #7898: [HUDI-5731] Add guava dependency to Spark and MR bundle

2023-02-22 Thread via GitHub
alexeykudinkin commented on PR #7898: URL: https://github.com/apache/hudi/pull/7898#issuecomment-1440443878 @bvaradar yes, we can close this one -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] hudi-bot commented on pull request #8011: [HUDI-5808] Add Support for kaffka ofsets in jsonkafkasource and avrokafkasource

2023-02-22 Thread via GitHub
hudi-bot commented on PR #8011: URL: https://github.com/apache/hudi/pull/8011#issuecomment-1440441993 ## CI report: * 0ad210a6500dfe7d8a070346e2bbda72805b4b78 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #8010: [HUDI-4442] [HUDI-5001] Sanitize JsonConversion and RowSource

2023-02-22 Thread via GitHub
hudi-bot commented on PR #8010: URL: https://github.com/apache/hudi/pull/8010#issuecomment-1440441875 ## CI report: * 1cb788947969f4573d5a4b2171fbedee696b73d8 Azure:

[GitHub] [hudi] soumilshah1995 commented on issue #8019: [SUPPORT] How to Restore from Checkpoints from disaster recovery in hudi using Pyspark and not Hudi CLI and use proc in PySpark

2023-02-22 Thread via GitHub
soumilshah1995 commented on issue #8019: URL: https://github.com/apache/hudi/issues/8019#issuecomment-1440395879 Hi @papablus i tried show_commit and im getting following error can you please tell me if there is something i am not doing right ``` try: import sys

[GitHub] [hudi] nsivabalan commented on a diff in pull request #7901: [HUDI-5665] Adding support to re-use table configs

2023-02-22 Thread via GitHub
nsivabalan commented on code in PR #7901: URL: https://github.com/apache/hudi/pull/7901#discussion_r1114603509 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala: ## @@ -121,15 +122,19 @@ object HoodieSparkSqlWriter { val

[GitHub] [hudi] nsivabalan commented on a diff in pull request #7901: [HUDI-5665] Adding support to re-use table configs

2023-02-22 Thread via GitHub
nsivabalan commented on code in PR #7901: URL: https://github.com/apache/hudi/pull/7901#discussion_r1114602192 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala: ## @@ -830,6 +830,33 @@ object DataSourceOptionsHelper {

[GitHub] [hudi] nsivabalan commented on pull request #7901: [HUDI-5665] Adding support to re-use table configs

2023-02-22 Thread via GitHub
nsivabalan commented on PR #7901: URL: https://github.com/apache/hudi/pull/7901#issuecomment-1440360040 @codope : table configs are immutable in general. thats why. its like database name, tablename or primary key in rdbms world. -- This is an automated message from the Apache Git

[GitHub] [hudi] nsivabalan commented on pull request #7901: [HUDI-5665] Adding support to re-use table configs

2023-02-22 Thread via GitHub
nsivabalan commented on PR #7901: URL: https://github.com/apache/hudi/pull/7901#issuecomment-1440355311 @xushiyan : this is to improve the usability. wrt table configs, they are not allowed to be modified once created. they are deemed to be immutable. hence we thought we can simplify

  1   2   >