danny0405 commented on code in PR #9223:
URL: https://github.com/apache/hudi/pull/9223#discussion_r1294257025
##
hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java:
##
@@ -87,14 +88,15 @@
import java.util.LinkedList;
import java.util.List;
import
danny0405 commented on code in PR #9223:
URL: https://github.com/apache/hudi/pull/9223#discussion_r1294256449
##
hudi-common/pom.xml:
##
@@ -103,6 +103,13 @@
+
+
+ org.scala-lang
+ scala-library
Review Comment:
I don't think we should introduce an
codope commented on code in PR #9433:
URL: https://github.com/apache/hudi/pull/9433#discussion_r1294252246
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/S3EventsHoodieIncrSource.java:
##
@@ -157,26 +157,24 @@ public Pair>, String>
fetchNextBatch(Option lastC
codope opened a new pull request, #9448:
URL: https://github.com/apache/hudi/pull/9448
### Change Logs
Changed pom version to `1.0.0-SNAPSHOT`.
### Impact
none
### Risk level (write none, low medium or high below)
none
### Documentation Update
hudi-bot commented on PR #9447:
URL: https://github.com/apache/hudi/pull/9447#issuecomment-1678480510
## CI report:
* c181bd4a3fa227cef4ab96457c38d9b207b6a981 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1929
hudi-bot commented on PR #9447:
URL: https://github.com/apache/hudi/pull/9447#issuecomment-1678475353
## CI report:
* c181bd4a3fa227cef4ab96457c38d9b207b6a981 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #9437:
URL: https://github.com/apache/hudi/pull/9437#issuecomment-1678469976
## CI report:
* 0cc0c34422625e63bf9e421d73c22959b7cc9916 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1929
danny0405 opened a new pull request, #9447:
URL: https://github.com/apache/hudi/pull/9447
### Change Logs
Table created by Spark may not have the preCombine field set up.
### Impact
none
### Risk level (write none, low medium or high below)
none
### D
ksoullpwk commented on issue #9440:
URL: https://github.com/apache/hudi/issues/9440#issuecomment-1678460113
Yes, it works. Thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific com
hudi-bot commented on PR #9434:
URL: https://github.com/apache/hudi/pull/9434#issuecomment-1678442027
## CI report:
* e895bfb27350f497100c3cd50246badcba99f27d Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1927
hudi-bot commented on PR #9434:
URL: https://github.com/apache/hudi/pull/9434#issuecomment-1678437811
## CI report:
* e895bfb27350f497100c3cd50246badcba99f27d Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1927
danny0405 commented on code in PR #8683:
URL: https://github.com/apache/hudi/pull/8683#discussion_r1294178078
##
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/catalog/TableOptionProperties.java:
##
@@ -184,7 +184,9 @@ public static Map
translateFlinkTable
Riddle4045 commented on issue #9435:
URL: https://github.com/apache/hudi/issues/9435#issuecomment-1678406201
> > HMS props for the Hudi table creating using Flink SQL
>
> You are using the Flink Hive catalog, the table are actually created by
the hive catalog. Actually we have a separ
This is an automated email from the ASF dual-hosted git repository.
yihua pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new b1b1b524bbd [DOCS] Updated image paths for blog
yihua merged PR #9446:
URL: https://github.com/apache/hudi/pull/9446
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
[
https://issues.apache.org/jira/browse/HUDI-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-6654:
Epic Link: HUDI-6242
> Add new log block header type to store record positions
> ---
[
https://issues.apache.org/jira/browse/HUDI-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-6654:
Fix Version/s: 1.0.0
> Add new log block header type to store record positions
> ---
[
https://issues.apache.org/jira/browse/HUDI-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo closed HUDI-6654.
---
Resolution: Fixed
> Add new log block header type to store record positions
>
danny0405 commented on issue #9435:
URL: https://github.com/apache/hudi/issues/9435#issuecomment-1678355424
> HMS props for the Hudi table creating using Flink SQL
You are using the Flink Hive catalog, the table are actually created by the
hive catalog. Actually we have a separate Hud
danny0405 commented on issue #8848:
URL: https://github.com/apache/hudi/issues/8848#issuecomment-1678352784
In principle, we do not package any hadoop related jars into the bundle jar,
the classpath of the runtime env should include it.
--
This is an automated message from the Apache Git
This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new b0e57453d3a [HUDI-6685] Fix code typo in py
nsivabalan merged PR #9432:
URL: https://github.com/apache/hudi/pull/9432
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apach
hudi-bot commented on PR #9437:
URL: https://github.com/apache/hudi/pull/9437#issuecomment-1678342431
## CI report:
* b25b5402c1e3e14264c6bbfd38910f4b93b8a871 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1929
yihua commented on code in PR #9437:
URL: https://github.com/apache/hudi/pull/9437#discussion_r1294125375
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieMetadataTableValidator.java:
##
@@ -741,6 +791,116 @@ private void validateBloomFilters(
validate(metada
boneanxs commented on code in PR #9408:
URL: https://github.com/apache/hudi/pull/9408#discussion_r1294125769
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/command/AlterHoodieTableAddPartitionCommand.scala:
##
@@ -0,0 +1,88 @@
+/*
+ * License
yihua commented on code in PR #9437:
URL: https://github.com/apache/hudi/pull/9437#discussion_r1294125576
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieMetadataTableValidator.java:
##
@@ -741,6 +791,116 @@ private void validateBloomFilters(
validate(metada
codope commented on issue #9440:
URL: https://github.com/apache/hudi/issues/9440#issuecomment-1678338350
@ksoullpwk Thanks for the diagnosis. Could you check if this fix helps you?
https://github.com/trinodb/trino/pull/18213
--
This is an automated message from the Apache Git Service.
To
hudi-bot commented on PR #9437:
URL: https://github.com/apache/hudi/pull/9437#issuecomment-1678336975
## CI report:
* b25b5402c1e3e14264c6bbfd38910f4b93b8a871 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1929
danny0405 commented on PR #9444:
URL: https://github.com/apache/hudi/pull/9444#issuecomment-1678331086
> If a write to a table with a pk was missing the recordkey field in options
it would think it was a pkless write. now it fails
I'm confused, if we already know it is a table with pk
This is an automated email from the ASF dual-hosted git repository.
danny0405 pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new f138422fcb9 [HUDI-6676][DOCS] Add command f
danny0405 merged PR #9441:
URL: https://github.com/apache/hudi/pull/9441
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache
[
https://issues.apache.org/jira/browse/HUDI-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen closed HUDI-6683.
Resolution: Fixed
Fixed via master branch: 4099e1d18b78583d739fdb252f85b58d991d2fb0
> Added kafka key as pa
This is an automated email from the ASF dual-hosted git repository.
danny0405 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 4099e1d18b7 [HUDI-6683] Added kafka key as part
danny0405 merged PR #9403:
URL: https://github.com/apache/hudi/pull/9403
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache
danny0405 commented on PR #9403:
URL: https://github.com/apache/hudi/pull/9403#issuecomment-1678327812
Thanks for the nice feedback @hussein-awala , maybe you can fire a separate
PR to address it.
--
This is an automated message from the Apache Git Service.
To respond to the message, plea
[
https://issues.apache.org/jira/browse/HUDI-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-6683:
-
Fix Version/s: 1.1.0
(was: 1.0.0)
> Added kafka key as part of hudi metadat
[
https://issues.apache.org/jira/browse/HUDI-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-6585:
-
Fix Version/s: 1.1.0
0.15.0
(was: 1.0.0)
> Certify Dedup
[
https://issues.apache.org/jira/browse/HUDI-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-6586:
-
Fix Version/s: 0.15.0
0.14.1
> Add Incremental scan support to dbt
> --
[
https://issues.apache.org/jira/browse/HUDI-6490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17754362#comment-17754362
]
Vinoth Chandar commented on HUDI-6490:
--
[~tim.brown] Do you want to take this work up
[
https://issues.apache.org/jira/browse/HUDI-6490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-6490:
-
Fix Version/s: 0.15.0
0.14.1
> Implement support for applying updates as delete
[
https://issues.apache.org/jira/browse/HUDI-6490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar reassigned HUDI-6490:
Assignee: Timothy Brown
> Implement support for applying updates as deletes + inserts
> ---
[
https://issues.apache.org/jira/browse/HUDI-6296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-6296:
-
Fix Version/s: 1.1.0
(was: 1.0.0)
> Add Scala 2.13 build profile to support
[
https://issues.apache.org/jira/browse/HUDI-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17754361#comment-17754361
]
Vinoth Chandar commented on HUDI-6640:
--
This is a duplicate of HUDI-5672
> Non-bloc
[
https://issues.apache.org/jira/browse/HUDI-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1045:
-
Epic Link: HUDI-5672 (was: HUDI-1042)
> Support updates during clustering
> -
[
https://issues.apache.org/jira/browse/HUDI-5672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-5672:
-
Summary: Non-blocking multi writer support (was: Lockless multi writer
support)
> Non-blocking m
[
https://issues.apache.org/jira/browse/HUDI-1238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1238:
-
Fix Version/s: 1.1.0
(was: 1.0.0)
> [UMBRELLA] Perf test env
>
[
https://issues.apache.org/jira/browse/HUDI-2519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-2519:
-
Fix Version/s: 1.0.0
(was: 1.1.0)
> [UMBRELLA] Seamless meta sync
> ---
[
https://issues.apache.org/jira/browse/HUDI-2519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-2519:
-
Fix Version/s: 1.1.0
(was: 1.0.0)
> [UMBRELLA] Seamless meta sync
> ---
hudi-bot commented on PR #9444:
URL: https://github.com/apache/hudi/pull/9444#issuecomment-167822
## CI report:
* c7e99fd19a00469c0e181b6c64b63aa9cfb7ed4e Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1929
danny0405 commented on code in PR #9425:
URL: https://github.com/apache/hudi/pull/9425#discussion_r1294098528
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala:
##
@@ -965,8 +965,9 @@ object HoodieSparkSqlWriter {
// we mus
[
https://issues.apache.org/jira/browse/HUDI-2638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-2638:
-
Fix Version/s: (was: 1.0.0)
> Rewrite tests around Hudi index
> --
[
https://issues.apache.org/jira/browse/HUDI-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-3121:
-
Fix Version/s: 1.1.0
(was: 1.0.0)
> Spark datasource with bucket index unit
[
https://issues.apache.org/jira/browse/HUDI-2638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-2638:
-
Fix Version/s: 1.1.0
> Rewrite tests around Hudi index
> ---
>
>
[
https://issues.apache.org/jira/browse/HUDI-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1916:
-
Fix Version/s: 1.1.0
(was: 1.0.0)
> Create a matrix of datatypes across spa
[
https://issues.apache.org/jira/browse/HUDI-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-2375:
-
Fix Version/s: 1.1.0
(was: 1.0.0)
> Create common SchemaProvider and Record
[
https://issues.apache.org/jira/browse/HUDI-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar reassigned HUDI-309:
---
Assignee: Danny Chen (was: Balaji Varadarajan)
> General Redesign of Archived Timeline for ef
danny0405 commented on PR #9199:
URL: https://github.com/apache/hudi/pull/9199#issuecomment-1678284808
@prashantwason You can cherry pick https://github.com/apache/hudi/pull/9401
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
[
https://issues.apache.org/jira/browse/HUDI-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen updated HUDI-6676:
-
Fix Version/s: 1.0.0
> Add command for CreateHoodieTableLike
> -
>
>
[
https://issues.apache.org/jira/browse/HUDI-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen closed HUDI-6676.
Resolution: Fixed
Fixed via master branch: 8220d23be19af4783a9a776dfffa48167975a6a2
> Add command for Creat
[
https://issues.apache.org/jira/browse/HUDI-3529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-3529:
-
Fix Version/s: 1.1.0
(was: 1.0.0)
> Improve dependency management and bundl
danny0405 merged PR #9412:
URL: https://github.com/apache/hudi/pull/9412
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache
This is an automated email from the ASF dual-hosted git repository.
danny0405 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 8220d23be19 [HUDI-6676] Add command for CreateH
[
https://issues.apache.org/jira/browse/HUDI-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-2871:
-
Fix Version/s: 1.1.0
(was: 1.0.0)
> Decouple metrics dependencies from hudi
[
https://issues.apache.org/jira/browse/HUDI-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-6483:
-
Fix Version/s: 1.1.0
> MERGE INTO should support schema evolution for partial updates.
> -
[
https://issues.apache.org/jira/browse/HUDI-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-2687:
-
Fix Version/s: 1.0.0
(was: 1.1.0)
> [UMBRELLA] A new Trino connector for Hu
[
https://issues.apache.org/jira/browse/HUDI-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1574:
-
Fix Version/s: 1.1.0
(was: 1.0.0)
> Trim existing unit tests to finish in m
[
https://issues.apache.org/jira/browse/HUDI-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17754349#comment-17754349
]
Vinoth Chandar commented on HUDI-1457:
--
this does not work on cloud storage, since we
[
https://issues.apache.org/jira/browse/HUDI-3057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-3057:
-
Fix Version/s: 1.1.0
> Instants should be generated strictly under locks
> ---
[
https://issues.apache.org/jira/browse/HUDI-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1457:
-
Fix Version/s: (was: 0.15.0)
> Add multi writing to Hudi tables using DFS based locking (only
[
https://issues.apache.org/jira/browse/HUDI-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-4068:
-
Fix Version/s: 1.1.0
(was: 1.0.0)
> Add Cosmos based lock provider for Azur
[
https://issues.apache.org/jira/browse/HUDI-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-4067:
-
Fix Version/s: 1.1.0
(was: 1.0.0)
> Add Spanner based lock provider for GCP
[
https://issues.apache.org/jira/browse/HUDI-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-2173:
-
Fix Version/s: 1.1.0
> Enhancing DynamoDB based LockProvider
> ---
[
https://issues.apache.org/jira/browse/HUDI-2687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-2687:
-
Fix Version/s: 1.1.0
(was: 1.0.0)
> [UMBRELLA] A new Trino connector for Hu
hussein-awala commented on code in PR #9441:
URL: https://github.com/apache/hudi/pull/9441#discussion_r1294085403
##
website/docs/quick-start-guide.md:
##
@@ -384,6 +384,68 @@ create table hudi_ctas_cow_pt_tbl2 using hudi location
'file:/tmp/hudi/hudi_tbl/
partitioned by (date
[
https://issues.apache.org/jira/browse/HUDI-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-4141:
-
Start Date: 4/Sep/23
Due Date: 4/Oct/23
> [RFC-64] Table Format APIs
> -
hussein-awala commented on code in PR #9444:
URL: https://github.com/apache/hudi/pull/9444#discussion_r1294078912
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieWriterUtils.scala:
##
@@ -179,9 +179,11 @@ object HoodieWriterUtils {
if (null
hudi-bot commented on PR #9445:
URL: https://github.com/apache/hudi/pull/9445#issuecomment-1678258723
## CI report:
* 06d72d5563b9cd26e131c3907dcc653e59a2b8be Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1929
hudi-bot commented on PR #9445:
URL: https://github.com/apache/hudi/pull/9445#issuecomment-1678253584
## CI report:
* 06d72d5563b9cd26e131c3907dcc653e59a2b8be UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #9437:
URL: https://github.com/apache/hudi/pull/9437#issuecomment-1678253520
## CI report:
* b25b5402c1e3e14264c6bbfd38910f4b93b8a871 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1929
hussein-awala commented on code in PR #9403:
URL: https://github.com/apache/hudi/pull/9403#discussion_r1294069377
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/AvroConvertor.java:
##
@@ -175,9 +176,11 @@ public GenericRecord
withKafkaFieldsAppended(C
yihua opened a new pull request, #5269:
URL: https://github.com/apache/hudi/pull/5269
## What is the purpose of the pull request
- In Deltastreamer, we re-instantiate WriteClient whenever schema changes.
Same write client is used by all async table services as well. This poses an
iss
nfarah86 opened a new pull request, #9446:
URL: https://github.com/apache/hudi/pull/9446
### Change Logs
fixed broken images
https://github.com/apache/hudi/assets/5392555/055efb07-c4bc-4727-a4e4-bdb81fdbf546";>
@nsivabalan please review
--
This is an automated message from t
[
https://issues.apache.org/jira/browse/HUDI-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-6694:
-
Labels: pull-request-available (was: )
> Fix log file CLI around command blocks
> ---
yihua opened a new pull request, #9445:
URL: https://github.com/apache/hudi/pull/9445
### Change Logs
This PR fixes the log file CLI commands when the log file contains command
blocks like rollback commands.
The tests are adjusted to consider such a scenario. Without the fix,
[
https://issues.apache.org/jira/browse/HUDI-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-6694:
Description:
When there are rollback command blocks in the log files, the log file command
throws NPE:
{co
[
https://issues.apache.org/jira/browse/HUDI-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-6694:
Description:
When there are rollback command blocks in the log files, the
> Fix log file CLI around comma
Ethan Guo created HUDI-6694:
---
Summary: Fix log file CLI around command blocks
Key: HUDI-6694
URL: https://issues.apache.org/jira/browse/HUDI-6694
Project: Apache Hudi
Issue Type: Bug
Re
[
https://issues.apache.org/jira/browse/HUDI-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo reassigned HUDI-6694:
---
Assignee: Ethan Guo
> Fix log file CLI around command blocks
> --
yihua commented on code in PR #9437:
URL: https://github.com/apache/hudi/pull/9437#discussion_r1294049901
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieMetadataTableValidator.java:
##
@@ -741,6 +791,116 @@ private void validateBloomFilters(
validate(metada
hudi-bot commented on PR #9444:
URL: https://github.com/apache/hudi/pull/9444#issuecomment-1678162678
## CI report:
* c7e99fd19a00469c0e181b6c64b63aa9cfb7ed4e Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1929
hudi-bot commented on PR #9444:
URL: https://github.com/apache/hudi/pull/9444#issuecomment-1678153770
## CI report:
* c7e99fd19a00469c0e181b6c64b63aa9cfb7ed4e UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
nsivabalan commented on code in PR #9437:
URL: https://github.com/apache/hudi/pull/9437#discussion_r1294013795
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieMetadataTableValidator.java:
##
@@ -741,6 +791,116 @@ private void validateBloomFilters(
validate(m
prashantwason commented on PR #9199:
URL: https://github.com/apache/hudi/pull/9199#issuecomment-1678132749
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment
prashantwason commented on PR #9199:
URL: https://github.com/apache/hudi/pull/9199#issuecomment-1678132491
@stream2000 The build is failing due to a test failure due to this commit.
Can you please check?
https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/
sivabalan narayanan created HUDI-6693:
-
Summary: Streaming writes fail in quick start w/ 0.14.0
Key: HUDI-6693
URL: https://issues.apache.org/jira/browse/HUDI-6693
Project: Apache Hudi
I
[
https://issues.apache.org/jira/browse/HUDI-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-6692:
-
Labels: pull-request-available (was: )
> If table with recordkey doesn't have recordkey in spark
jonvex opened a new pull request, #9444:
URL: https://github.com/apache/hudi/pull/9444
### Change Logs
if the write was missing the recordkey it would think it was a pkless write.
now it fails
### Impact
prevent unexpected behavior
### Risk level (write none, low
Jonathan Vexler created HUDI-6692:
-
Summary: If table with recordkey doesn't have recordkey in spark
ds write, it will bulk insert by default
Key: HUDI-6692
URL: https://issues.apache.org/jira/browse/HUDI-6692
Riddle4045 commented on issue #9435:
URL: https://github.com/apache/hudi/issues/9435#issuecomment-1678089145
@danny0405 I checked the Table props in metastore of a table that's synced
using Hudi HMS sync tool vs the Flink table I mentioned below. I see very
different properties here
hudi-bot commented on PR #9437:
URL: https://github.com/apache/hudi/pull/9437#issuecomment-1678003863
## CI report:
* 699793358327fe0caf4df52a0ee199a9c54ab58d Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=192
1 - 100 of 134 matches
Mail list logo