Re: [PR] Bump org.apache.commons:commons-configuration2 from 2.8.0 to 2.10.1 in /packaging/hudi-cli-bundle [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10920: URL: https://github.com/apache/hudi/pull/10920#issuecomment-2017244085 ## CI report: * 882fb5ceed433aad4e9f05199886c69571069d2a Azure:

[jira] [Updated] (HUDI-4444) Refactor DataSourceInternalWriterHelper

2024-03-24 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-: Status: Open (was: In Progress) > Refactor DataSourceInternalWriterHelper >

Re: [PR] [HUDI-4444] Refactor DataSourceInternalWriterHelper [hudi]

2024-03-24 Thread via GitHub
wombatu-kun closed pull request #10715: [HUDI-] Refactor DataSourceInternalWriterHelper URL: https://github.com/apache/hudi/pull/10715 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [HUDI-7510] Loosen the compaction scheduling and rollback check for MDT [hudi]

2024-03-24 Thread via GitHub
yihua commented on code in PR #10874: URL: https://github.com/apache/hudi/pull/10874#discussion_r1537052000 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieBackedTableMetadataWriter.java: ## @@ -1134,8 +1126,9 @@ protected void validateRollback(

[jira] [Closed] (HUDI-7534) Refactoring of handleUpdate in CommitActionExecutors and HoodieTables

2024-03-24 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov closed HUDI-7534. --- Resolution: Not A Problem > Refactoring of handleUpdate in CommitActionExecutors and HoodieTables >

Re: [PR] [HUDI-7534] Refactoring of handleUpdate in CommitActionExecutors and HoodieTables [hudi]

2024-03-24 Thread via GitHub
wombatu-kun commented on code in PR #10917: URL: https://github.com/apache/hudi/pull/10917#discussion_r1537030730 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java: ## @@ -1096,11 +1104,37 @@ private Set getDropPartitionColNames() {

Re: [PR] [HUDI-7534] Refactoring of handleUpdate in CommitActionExecutors and HoodieTables [hudi]

2024-03-24 Thread via GitHub
wombatu-kun closed pull request #10917: [HUDI-7534] Refactoring of handleUpdate in CommitActionExecutors and HoodieTables URL: https://github.com/apache/hudi/pull/10917 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [HUDI-7534] Refactoring of handleUpdate in CommitActionExecutors and HoodieTables [hudi]

2024-03-24 Thread via GitHub
wombatu-kun commented on code in PR #10917: URL: https://github.com/apache/hudi/pull/10917#discussion_r1537030730 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java: ## @@ -1096,11 +1104,37 @@ private Set getDropPartitionColNames() {

Re: [PR] Bump org.apache.commons:commons-configuration2 from 2.8.0 to 2.10.1 in /packaging/hudi-cli-bundle [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10920: URL: https://github.com/apache/hudi/pull/10920#issuecomment-2017156098 ## CI report: * 882fb5ceed433aad4e9f05199886c69571069d2a Azure:

Re: [PR] Bump org.apache.commons:commons-configuration2 from 2.8.0 to 2.10.1 in /packaging/hudi-cli-bundle [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10920: URL: https://github.com/apache/hudi/pull/10920#issuecomment-2017151112 ## CI report: * 882fb5ceed433aad4e9f05199886c69571069d2a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7534] Refactoring of handleUpdate in CommitActionExecutors and HoodieTables [hudi]

2024-03-24 Thread via GitHub
danny0405 commented on code in PR #10917: URL: https://github.com/apache/hudi/pull/10917#discussion_r1537019796 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java: ## @@ -1096,11 +1104,37 @@ private Set getDropPartitionColNames() {

[jira] [Closed] (HUDI-7513) Add jackson-module-scala to spark bundle

2024-03-24 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-7513. Resolution: Fixed Fixed via master branch: d749457f9d5efcef3f7abff4765e6da50afca412 > Add

Re: [PR] [HUDI-7513] Add jackson-module-scala to spark bundle [hudi]

2024-03-24 Thread via GitHub
danny0405 merged PR #10877: URL: https://github.com/apache/hudi/pull/10877 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(hudi) branch master updated (da9660bf38a -> d749457f9d5)

2024-03-24 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from da9660bf38a checkstyle (#10919) add d749457f9d5 [HUDI-7513] Add jackson-module-scala to spark bundle (#10877)

(hudi) branch dependabot/maven/packaging/hudi-cli-bundle/org.apache.commons-commons-configuration2-2.10.1 created (now 882fb5ceed4)

2024-03-24 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/packaging/hudi-cli-bundle/org.apache.commons-commons-configuration2-2.10.1 in repository https://gitbox.apache.org/repos/asf/hudi.git at 882fb5ceed4 Bump

[PR] Bump org.apache.commons:commons-configuration2 from 2.8.0 to 2.10.1 in /packaging/hudi-cli-bundle [hudi]

2024-03-24 Thread via GitHub
dependabot[bot] opened a new pull request, #10920: URL: https://github.com/apache/hudi/pull/10920 Bumps org.apache.commons:commons-configuration2 from 2.8.0 to 2.10.1. [![Dependabot compatibility

[jira] [Updated] (HUDI-7513) Add jackson-module-scala to spark bundle

2024-03-24 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-7513: - Fix Version/s: 0.15.0 1.0.0 > Add jackson-module-scala to spark bundle >

Re: [PR] [HUDI-7513] Add jackson-module-scala to spark bundle [hudi]

2024-03-24 Thread via GitHub
danny0405 commented on PR #10877: URL: https://github.com/apache/hudi/pull/10877#issuecomment-2017143707 Would merge it first, we can fire following-up fix if it is necessary for specific bundles. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] [HUDI-7534] Refactoring of handleUpdate in CommitActionExecutors and HoodieTables [hudi]

2024-03-24 Thread via GitHub
wombatu-kun commented on code in PR #10917: URL: https://github.com/apache/hudi/pull/10917#discussion_r1536992371 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java: ## @@ -1096,11 +1104,37 @@ private Set getDropPartitionColNames() {

Re: [PR] [HUDI-7534] Refactoring of handleUpdate in CommitActionExecutors and HoodieTables [hudi]

2024-03-24 Thread via GitHub
wombatu-kun commented on code in PR #10917: URL: https://github.com/apache/hudi/pull/10917#discussion_r1536992371 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java: ## @@ -1096,11 +1104,37 @@ private Set getDropPartitionColNames() {

Re: [PR] [HUDI-7534] Refactoring of handleUpdate in CommitActionExecutors and HoodieTables [hudi]

2024-03-24 Thread via GitHub
wombatu-kun commented on code in PR #10917: URL: https://github.com/apache/hudi/pull/10917#discussion_r1536992371 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java: ## @@ -1096,11 +1104,37 @@ private Set getDropPartitionColNames() {

Re: [PR] [HUDI-7534] Refactoring of handleUpdate in CommitActionExecutors and HoodieTables [hudi]

2024-03-24 Thread via GitHub
wombatu-kun commented on code in PR #10917: URL: https://github.com/apache/hudi/pull/10917#discussion_r1536992371 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java: ## @@ -1096,11 +1104,37 @@ private Set getDropPartitionColNames() {

Re: [PR] [HUDI-7513] Add jackson-module-scala to spark bundle [hudi]

2024-03-24 Thread via GitHub
xicm commented on PR #10877: URL: https://github.com/apache/hudi/pull/10877#issuecomment-2017076552 I searched the whole project, only jackson-module-afterburner and jackson-module-scala have the package path "com.fasterxml.jackson.module". And the fix is in the main pom, this change also

Re: [I] [SUPPORT] IllegalArgumentException at org.apache.hudi.common.util.ValidationUtils.checkArgument(ValidationUtils.java:33) [hudi]

2024-03-24 Thread via GitHub
michael1991 commented on issue #10906: URL: https://github.com/apache/hudi/issues/10906#issuecomment-2017059823 I disable metadata in reader side, so the reader job just treat them as normal parquet files and ignore reading metadata. But exception has been thrown at beginning of every day.

Re: [PR] [HUDI-7466] Add tests to AWSGlueCatalogSyncClient [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10897: URL: https://github.com/apache/hudi/pull/10897#issuecomment-2017047981 ## CI report: * 3eee08ae9050ad22f2fc6418eb56d6ca7668f4a6 Azure:

(hudi) branch master updated: checkstyle (#10919)

2024-03-24 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new da9660bf38a checkstyle (#10919) da9660bf38a is

Re: [PR] [MINOR] Fix the checkstyle of /StreamReadAppendPartitioner [hudi]

2024-03-24 Thread via GitHub
danny0405 merged PR #10919: URL: https://github.com/apache/hudi/pull/10919 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7534] Refactoring of handleUpdate in CommitActionExecutors and HoodieTables [hudi]

2024-03-24 Thread via GitHub
danny0405 commented on code in PR #10917: URL: https://github.com/apache/hudi/pull/10917#discussion_r1536959896 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTable.java: ## @@ -1096,11 +1104,37 @@ private Set getDropPartitionColNames() {

Re: [PR] [HUDI-7466] Add tests to AWSGlueCatalogSyncClient [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10897: URL: https://github.com/apache/hudi/pull/10897#issuecomment-2017021914 ## CI report: * 6648a3c133ca42a6f5179b8aae97659e3ec7ff81 Azure:

Re: [PR] [HUDI-6758] Fixing deducing spurious log blocks due to spark retries [hudi]

2024-03-24 Thread via GitHub
danny0405 commented on PR #9611: URL: https://github.com/apache/hudi/pull/9611#issuecomment-2017018919 I would rather we revert this change first if there is no thorough solution or put a flag for switching whereas by default as disabled. -- This is an automated message from the Apache

Re: [PR] [HUDI-7466] Add tests to AWSGlueCatalogSyncClient [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10897: URL: https://github.com/apache/hudi/pull/10897#issuecomment-2017018637 ## CI report: * 6648a3c133ca42a6f5179b8aae97659e3ec7ff81 Azure:

Re: [PR] [HUDI-7466] Add tests to AWSGlueCatalogSyncClient [hudi]

2024-03-24 Thread via GitHub
VitoMakarevich commented on PR #10897: URL: https://github.com/apache/hudi/pull/10897#issuecomment-2016993415 The log of my tests: 1. Saw this test - submitted first PR without tests, then @parisni asked for it. 2. Checked that tests were disabled, so indeed tried to make them work on

Re: [I] [SUPPORT] AWS Glue 4.0 taking to long to write to S3 [hudi]

2024-03-24 Thread via GitHub
CTTY commented on issue #10916: URL: https://github.com/apache/hudi/issues/10916#issuecomment-2016940414 I feel like there are multiple things at play here. It can be Glue being slow or Hudi Hadoop relation needs to be refreshed after syncing. The easiest solution may be upgrading to a

Re: [PR] [MINOR] Fix the checkstyle of /StreamReadAppendPartitioner [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10919: URL: https://github.com/apache/hudi/pull/10919#issuecomment-2016917262 ## CI report: * fdc5cdb76cf43b61cb4172c02e4d1caea3b64fb9 Azure:

Re: [PR] [MINOR] Fix the checkstyle of /StreamReadAppendPartitioner [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10919: URL: https://github.com/apache/hudi/pull/10919#issuecomment-2016897284 ## CI report: * fdc5cdb76cf43b61cb4172c02e4d1caea3b64fb9 Azure:

Re: [PR] [MINOR] Fix the checkstyle of /StreamReadAppendPartitioner [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10919: URL: https://github.com/apache/hudi/pull/10919#issuecomment-2016895407 ## CI report: * fdc5cdb76cf43b61cb4172c02e4d1caea3b64fb9 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[PR] [MINOR] Fix the checkstyle of /StreamReadAppendPartitioner [hudi]

2024-03-24 Thread via GitHub
zhuanshenbsj1 opened a new pull request, #10919: URL: https://github.com/apache/hudi/pull/10919 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any

[jira] [Updated] (HUDI-3309) Integrate quickstart examples into integration tests

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3309: - Epic Link: HUDI-7536 (was: HUDI-2224) > Integrate quickstart examples into integration tests >

[jira] [Updated] (HUDI-3585) Docs for (consistent) hashing index

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3585: - Issue Type: Task (was: New Feature) > Docs for (consistent) hashing index >

[jira] [Closed] (HUDI-7301) Update hudi docs/websites with documentation for the new spark TVF

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-7301. Assignee: (was: Vinaykumar Bhat) Resolution: Fixed

[jira] [Updated] (HUDI-7301) Update hudi docs/websites with documentation for the new spark TVF

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-7301: - Fix Version/s: 0.14.0 (was: 0.15.0) > Update hudi docs/websites with documentation

[jira] [Updated] (HUDI-1916) Create a matrix of datatypes across spark, hive, presto, Avro, parquet.

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1916: - Fix Version/s: 0.15.0 (was: 1.1.0) > Create a matrix of datatypes across spark,

[jira] [Assigned] (HUDI-1916) Create a matrix of datatypes across spark, hive, presto, Avro, parquet.

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1916: Assignee: Raymond Xu (was: Nishith Agarwal) > Create a matrix of datatypes across spark, hive,

[jira] [Closed] (HUDI-533) Update Setup docs with lastest checkstyle

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-533. --- Assignee: Raymond Xu Resolution: Fixed https://hudi.apache.org/contribute/developer-setup/ > Update

[jira] [Assigned] (HUDI-3) Add a guide for running Hudi pipelines using AWS Glue

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3: - Assignee: Raymond Xu (was: Vinoth Chandar) > Add a guide for running Hudi pipelines using AWS Glue >

[jira] [Updated] (HUDI-691) hoodie.*.consume.* should be set whitelist in hive-site.xml

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-691: Fix Version/s: 0.15.0 (was: 1.1.0) > hoodie.*.consume.* should be set whitelist in

[jira] [Updated] (HUDI-3) Add a guide for running Hudi pipelines using AWS Glue

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3: -- Fix Version/s: 0.15.0 > Add a guide for running Hudi pipelines using AWS Glue >

[jira] [Assigned] (HUDI-691) hoodie.*.consume.* should be set whitelist in hive-site.xml

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-691: --- Assignee: Raymond Xu (was: GarudaGuo) > hoodie.*.consume.* should be set whitelist in hive-site.xml

Re: [PR] [HUDI-7466] Add tests to AWSGlueCatalogSyncClient [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10897: URL: https://github.com/apache/hudi/pull/10897#issuecomment-2016863665 ## CI report: * 6648a3c133ca42a6f5179b8aae97659e3ec7ff81 Azure:

[jira] [Closed] (HUDI-1972) Document set hive.conversion=none when using clause like LIMIT

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1972. Resolution: Abandoned > Document set hive.conversion=none when using clause like LIMIT >

[jira] [Assigned] (HUDI-1605) Add more documentation around archival process and configs

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1605: Assignee: Raymond Xu (was: Kyle Weller) > Add more documentation around archival process and

[jira] [Updated] (HUDI-1964) Update guide around hive metastore and hive sync for hudi tables

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1964: - Summary: Update guide around hive metastore and hive sync for hudi tables (was: Add a blog around hive

[jira] [Updated] (HUDI-1964) Update guide around hive metastore and hive sync for hudi tables

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1964: - Fix Version/s: 0.15.0 > Update guide around hive metastore and hive sync for hudi tables >

[jira] [Updated] (HUDI-1605) Add more documentation around archival process and configs

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1605: - Fix Version/s: 0.15.0 > Add more documentation around archival process and configs >

[jira] [Updated] (HUDI-2609) Clarify small file configs in config page

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2609: - Fix Version/s: 0.15.0 > Clarify small file configs in config page >

[jira] [Assigned] (HUDI-1964) Update guide around hive metastore and hive sync for hudi tables

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1964: Assignee: Raymond Xu (was: Nishith Agarwal) > Update guide around hive metastore and hive sync

[jira] [Closed] (HUDI-2035) Create document for PrometheusReporter

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2035. Resolution: Fixed https://hudi.apache.org/docs/0.14.0/metrics#prometheusmetricsreporter > Create document

[jira] [Assigned] (HUDI-2609) Clarify small file configs in config page

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2609: Assignee: Raymond Xu (was: Kyle Weller) > Clarify small file configs in config page >

[jira] [Assigned] (HUDI-3074) Docs for Z-order

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3074: Assignee: Raymond Xu (was: Kyle Weller) > Docs for Z-order > > >

[jira] [Updated] (HUDI-3074) Docs for Z-order

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3074: - Fix Version/s: 0.15.0 > Docs for Z-order > > > Key: HUDI-3074 >

[jira] [Assigned] (HUDI-3075) Docs for Debezium source

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3075: Assignee: Raymond Xu (was: Kyle Weller) > Docs for Debezium source > > >

[jira] [Updated] (HUDI-3075) Docs for Debezium source

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3075: - Fix Version/s: 0.15.0 > Docs for Debezium source > > > Key:

[jira] [Updated] (HUDI-3079) Docs for Flink 0.10.0 new features

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3079: - Fix Version/s: (was: 0.15.0) > Docs for Flink 0.10.0 new features >

[jira] [Closed] (HUDI-3079) Docs for Flink 0.10.0 new features

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3079. Assignee: (was: Raymond Xu) Resolution: Fixed

[jira] [Assigned] (HUDI-3079) Docs for Flink 0.10.0 new features

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3079: Assignee: Raymond Xu (was: Kyle Weller) > Docs for Flink 0.10.0 new features >

[jira] [Updated] (HUDI-3079) Docs for Flink 0.10.0 new features

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3079: - Fix Version/s: 0.15.0 > Docs for Flink 0.10.0 new features > -- > >

[jira] [Updated] (HUDI-2151) Make performant out-of-box configs

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2151: - Component/s: (was: docs) > Make performant out-of-box configs > -- >

[jira] [Closed] (HUDI-1600) Fix document to reflect Hudi supports MOR for spark datasource for incremental queries

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1600. Assignee: (was: Gary Li) Resolution: Fixed

[jira] [Comment Edited] (HUDI-1111) Highlight Hudi guarantees in documentation section of website

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830270#comment-17830270 ] Raymond Xu edited comment on HUDI- at 3/24/24 4:26 PM: ---

[jira] [Assigned] (HUDI-1569) Add Flink examples to QuickStartUtils and Docker demo page

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1569: Assignee: Raymond Xu (was: Danny Chen) > Add Flink examples to QuickStartUtils and Docker demo

[jira] [Updated] (HUDI-1569) Add Flink examples to QuickStartUtils and Docker demo page

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1569: - Fix Version/s: 0.15.0 > Add Flink examples to QuickStartUtils and Docker demo page >

[jira] [Updated] (HUDI-1081) Document AWS Hudi integration

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1081: - Fix Version/s: 0.15.0 > Document AWS Hudi integration > - > >

[jira] [Assigned] (HUDI-1081) Document AWS Hudi integration

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1081: Assignee: Raymond Xu (was: Bhavani Sudha) > Document AWS Hudi integration >

[jira] [Closed] (HUDI-1111) Highlight Hudi guarantees in documentation section of website

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-. Resolution: Fixed https://hudi.apache.org/docs/next/concurrency_control > Highlight Hudi guarantees in

[jira] [Assigned] (HUDI-851) Add Documentation on partitioning data with examples and details on how to sync to Hive

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-851: --- Assignee: Raymond Xu (was: Sagar Sumit) > Add Documentation on partitioning data with examples and

[jira] [Commented] (HUDI-336) Improve page related content on Hudi website

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830268#comment-17830268 ] Raymond Xu commented on HUDI-336: - website landing page updated > Improve page related content on Hudi

[jira] [Closed] (HUDI-336) Improve page related content on Hudi website

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-336. --- Resolution: Done > Improve page related content on Hudi website >

[jira] [Closed] (HUDI-295) Do one-time cleanup of Hudi git history

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-295. --- Resolution: Abandoned > Do one-time cleanup of Hudi git history > --- > >

[jira] [Assigned] (HUDI-17) Better documentation for paths passed to incr and ro views from Spark datasource

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-17?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-17: -- Assignee: Raymond Xu > Better documentation for paths passed to incr and ro views from Spark >

[jira] [Updated] (HUDI-17) Better documentation for paths passed to incr and ro views from Spark datasource

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-17?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-17: --- Fix Version/s: 0.15.0 > Better documentation for paths passed to incr and ro views from Spark > datasource >

[jira] [Commented] (HUDI-6330) Update user document to introduce this feature

2024-03-24 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830267#comment-17830267 ] Jing Zhang commented on HUDI-6330: -- [~xushiyan] Yes, I would like take it recently. > Update user

[jira] [Commented] (HUDI-6331) Update user doc of partial update for MERGE INTO

2024-03-24 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830265#comment-17830265 ] Jing Zhang commented on HUDI-6331: -- [~xushiyan] Sorry, not yet. But I would like take it recently. >

Re: [PR] [HUDI-7466] Add tests to AWSGlueCatalogSyncClient [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10897: URL: https://github.com/apache/hudi/pull/10897#issuecomment-2016847801 ## CI report: * 7f8cf6295186dc445620267c4729a4c3e5cb40b7 Azure:

Re: [PR] [HUDI-7466] Add tests to AWSGlueCatalogSyncClient [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10897: URL: https://github.com/apache/hudi/pull/10897#issuecomment-2016845684 ## CI report: * 7f8cf6295186dc445620267c4729a4c3e5cb40b7 Azure:

Re: [PR] [HUDI-7512] sort input records for insert operation [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10876: URL: https://github.com/apache/hudi/pull/10876#issuecomment-2016810146 ## CI report: * 2c83cfaf2bdaef6b5075989992aeeff8052461ed UNKNOWN * 9329d8d43e9274478e64a0d40cbe7a5a0362ec90 Azure:

Re: [I] [SUPPORT] Requesting Support for insert_overwrite in Delta Streamer [hudi]

2024-03-24 Thread via GitHub
soumilshah1995 commented on issue #10896: URL: https://github.com/apache/hudi/issues/10896#issuecomment-2016802840 I tried --op insert_overwrite I guess its not natively supported on docs as well it says support for insert | bulk_insert| upsert -- This is an automated message from

Re: [PR] [HUDI-7512] sort input records for insert operation [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10876: URL: https://github.com/apache/hudi/pull/10876#issuecomment-2016795397 ## CI report: * 2c83cfaf2bdaef6b5075989992aeeff8052461ed UNKNOWN * e2296a2de6391dee42a83d390410eb71f193d55c Azure:

Re: [PR] [HUDI-7512] sort input records for insert operation [hudi]

2024-03-24 Thread via GitHub
hudi-bot commented on PR #10876: URL: https://github.com/apache/hudi/pull/10876#issuecomment-2016793663 ## CI report: * 2c83cfaf2bdaef6b5075989992aeeff8052461ed UNKNOWN * e2296a2de6391dee42a83d390410eb71f193d55c Azure:

[jira] [Updated] (HUDI-4859) Adding a blog on how to run Hudi on Serverless Platforms (AWS Glue)

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4859: - Component/s: (was: docs) > Adding a blog on how to run Hudi on Serverless Platforms (AWS Glue) >

[jira] [Updated] (HUDI-1564) Blog: Dfs -> Hudi followed by Kafka to Hudi

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1564: - Component/s: (was: docs) > Blog: Dfs -> Hudi followed by Kafka to Hudi >

[jira] [Updated] (HUDI-4859) Adding a blog on how to run Hudi on Serverless Platforms (AWS Glue)

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4859: - Fix Version/s: (was: 0.15.0) > Adding a blog on how to run Hudi on Serverless Platforms (AWS Glue) >

[jira] [Updated] (HUDI-4859) Adding a blog on how to run Hudi on Serverless Platforms (AWS Glue)

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4859: - Labels: (was: Blog docs) > Adding a blog on how to run Hudi on Serverless Platforms (AWS Glue) >

[jira] [Closed] (HUDI-1022) Document examples for Spark structured streaming writing into Hudi

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1022. Resolution: Fixed https://hudi.apache.org/docs/next/writing_tables_streaming_writes > Document examples

[jira] [Updated] (HUDI-1112) Blog on Tracking Hudi Data along transaction time and buisness time

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1112: - Component/s: blog (was: docs) > Blog on Tracking Hudi Data along transaction time

[jira] [Updated] (HUDI-2341) Publish a blog on immutable data lakes

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2341: - Component/s: (was: docs) > Publish a blog on immutable data lakes >

[jira] [Updated] (HUDI-4310) Add docs around spark scheduler configs for compaction and clustering

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4310: - Fix Version/s: 0.15.0 > Add docs around spark scheduler configs for compaction and clustering >

[jira] [Assigned] (HUDI-4310) Add docs around spark scheduler configs for compaction and clustering

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-4310: Assignee: Raymond Xu > Add docs around spark scheduler configs for compaction and clustering >

[jira] [Closed] (HUDI-1565) Document all maven commands

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1565. Resolution: Fixed In readme > Document all maven commands > --- > >

[jira] [Closed] (HUDI-1966) Add a CLI command to capture .hoodie output for debugging

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1966. Resolution: Abandoned > Add a CLI command to capture .hoodie output for debugging >

[jira] [Closed] (HUDI-1968) Add documentation around Hive 1.x vs Hive 2.x (spark vs hudi)

2024-03-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1968. Resolution: Abandoned > Add documentation around Hive 1.x vs Hive 2.x (spark vs hudi) >

  1   2   >