codecov-io commented on pull request #2708:
URL: https://github.com/apache/hudi/pull/2708#issuecomment-805560787
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2708?src=pr&el=h1) Report
> Merging
[#2708](https://codecov.io/gh/apache/hudi/pull/2708?src=pr&el=desc) (1aaf8b1)
into
[ma
codecov-io edited a comment on pull request #2645:
URL: https://github.com/apache/hudi/pull/2645#issuecomment-792430670
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2645?src=pr&el=h1) Report
> Merging
[#2645](https://codecov.io/gh/apache/hudi/pull/2645?src=pr&el=desc) (c4316ae)
in
codecov-io commented on pull request #2711:
URL: https://github.com/apache/hudi/pull/2711#issuecomment-805632411
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2711?src=pr&el=h1) Report
> Merging
[#2711](https://codecov.io/gh/apache/hudi/pull/2711?src=pr&el=desc) (ae47544)
into
[ma
garyli1019 merged pull request #2708:
URL: https://github.com/apache/hudi/pull/2708
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
This is an automated email from the ASF dual-hosted git repository.
garyli pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git.
from 03668db [HUDI-1710] Read optimized query type for Flink batch reader
(#2702)
add 01a1d79 [HUDI-1712] Rename & s
Sugamber commented on issue #2637:
URL: https://github.com/apache/hudi/issues/2637#issuecomment-805645355
There is an open pull request for partial update for CoW table.
https://github.com/apache/hudi/pull/1929
It looks like my use case .
--
This is an automated message from the
Sugamber commented on pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#issuecomment-805652102
@liujinhui1994 We are also need the same feature in hudi. Is there any
working branch which can be referred?
--
This is an automated message from the Apache Git Service.
To re
liujinhui1994 commented on pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#issuecomment-805655005
@Sugamber This branch should be available
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL abo
Sugamber commented on pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#issuecomment-805666558
Is there any timeline for this pull request?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above
liujinhui1994 commented on pull request #2666:
URL: https://github.com/apache/hudi/pull/2666#issuecomment-805667943
Maybe after 0.8 is released
-- 原始邮件 --
发件人:
codecov-io edited a comment on pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#issuecomment-794945140
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2651?src=pr&el=h1) Report
> Merging
[#2651](https://codecov.io/gh/apache/hudi/pull/2651?src=pr&el=desc) (fb7a9b1)
in
garyli1019 merged pull request #2711:
URL: https://github.com/apache/hudi/pull/2711
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
This is an automated email from the ASF dual-hosted git repository.
garyli pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 29b79c9 [hotfix] Log the error message for creati
Sugamber edited a comment on issue #2637:
URL: https://github.com/apache/hudi/issues/2637#issuecomment-805645355
There is an open pull request for partial update for CoW table.
https://github.com/apache/hudi/pull/1929
It looks like my use case is similar to this .
--
This is an
IloveZiHan opened a new pull request #2713:
URL: https://github.com/apache/hudi/pull/2713
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose of the
IloveZiHan commented on pull request #2713:
URL: https://github.com/apache/hudi/pull/2713#issuecomment-805712787
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For que
IloveZiHan closed pull request #2713:
URL: https://github.com/apache/hudi/pull/2713
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
Sugamber commented on issue #2637:
URL: https://github.com/apache/hudi/issues/2637#issuecomment-805713856
@nsivabalan Do we have any timeline for this pull request ?
Pull request 1- https://github.com/apache/hudi/pull/1929/
Pull request 2- https://github.com/apache/hudi/pull/2666
Jagmeet Bali created HUDI-1714:
--
Summary: Improve code coverage of TestHoodieTimelineArchiveLog
Key: HUDI-1714
URL: https://issues.apache.org/jira/browse/HUDI-1714
Project: Apache Hudi
Issue Typ
nsivabalan commented on issue #2675:
URL: https://github.com/apache/hudi/issues/2675#issuecomment-805805044
1. do you use the RowBasedSchemaProvider and hence can't explicitly provide
schema? If you were to use your own schema registry, you might as well provide
an updated schema to hudi w
jsbali commented on a change in pull request #2677:
URL: https://github.com/apache/hudi/pull/2677#discussion_r600461519
##
File path:
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java
##
@@ -388,6 +391,31 @@ public void testArchiv
jsbali commented on a change in pull request #2677:
URL: https://github.com/apache/hudi/pull/2677#discussion_r600462395
##
File path:
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java
##
@@ -491,6 +519,166 @@ public void testConve
jsbali commented on a change in pull request #2677:
URL: https://github.com/apache/hudi/pull/2677#discussion_r600463160
##
File path:
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java
##
@@ -491,6 +519,166 @@ public void testConve
jsbali commented on a change in pull request #2677:
URL: https://github.com/apache/hudi/pull/2677#discussion_r600463420
##
File path:
hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java
##
@@ -491,6 +519,166 @@ public void testConve
jsbali commented on pull request #2677:
URL: https://github.com/apache/hudi/pull/2677#issuecomment-805810171
@vinothchandar added [JIRA](https://issues.apache.org/jira/browse/HUDI-1714)
for it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please
jsbali edited a comment on pull request #2677:
URL: https://github.com/apache/hudi/pull/2677#issuecomment-805810171
@vinothchandar added
[HUDI-1714](https://issues.apache.org/jira/browse/HUDI-1714) for it.
--
This is an automated message from the Apache Git Service.
To respond to the mes
This is an automated email from the ASF dual-hosted git repository.
garyli pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 6e803e0 Moving to 0.9.0-SNAPSHOT on master branch
This is an automated email from the ASF dual-hosted git repository.
garyli pushed a change to branch release-0.8.0
in repository https://gitbox.apache.org/repos/asf/hudi.git.
at 9bfd810 Create release branch for version 0.8.0.
This branch includes the following new commits:
new 9bf
This is an automated email from the ASF dual-hosted git repository.
garyli pushed a commit to branch release-0.8.0
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 9bfd810e745202bd27980fa696d61b47922f46a9
Author: garyli1019
AuthorDate: Wed Mar 24 21:37:43 2021 +0800
Create
[
https://issues.apache.org/jira/browse/HUDI-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Li resolved HUDI-1712.
---
Resolution: Resolved
> Standardize prefix for hoodie lock configs
> --
[
https://issues.apache.org/jira/browse/HUDI-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Li closed HUDI-1712.
-
> Standardize prefix for hoodie lock configs
> --
>
> Key: HUD
[
https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Li updated HUDI-909:
-
Issue Type: New Feature (was: Task)
> Integrate hudi with flink engine
>
>
>
[
https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Li updated HUDI-909:
-
Summary: [UMBRELLA]Integrate hudi with flink engine (was: Integrate hudi
with flink engine)
> [UMBRELLA]Integrate
[
https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Li updated HUDI-1521:
--
Summary: [UMBRELLA]HUDI Flink writer proposal (was: HUDI Flink writer
proposal)
> [UMBRELLA]HUDI Flink writer
[
https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Li updated HUDI-1521:
--
Issue Type: New Feature (was: Improvement)
> HUDI Flink writer proposal
> --
>
>
[
https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Li updated HUDI-1521:
--
Fix Version/s: 0.8.0
> [UMBRELLA]HUDI Flink writer proposal
>
>
>
[
https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Li updated HUDI-1521:
--
Summary: [UMBRELLA] RFC-24 HUDI Flink writer proposal (was: [UMBRELLA]HUDI
Flink writer proposal)
> [UMBRELLA]
Gary Li created HUDI-1715:
-
Summary: Refactor the BaseFlinkCommitActionExecutor to adapt to
the new Flink writer
Key: HUDI-1715
URL: https://issues.apache.org/jira/browse/HUDI-1715
Project: Apache Hudi
[
https://issues.apache.org/jira/browse/HUDI-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Li updated HUDI-1715:
--
Component/s: Flink Integration
> Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer
> -
[
https://issues.apache.org/jira/browse/HUDI-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Li closed HUDI-1581.
-
Resolution: Duplicate
> Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer
>
[
https://issues.apache.org/jira/browse/HUDI-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Li updated HUDI-1715:
--
Description:
In order to adapt to the new Flink writer, the executor needs to support:
1. specify the bucket ty
[
https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Li closed HUDI-1521.
-
> [UMBRELLA] RFC-24 HUDI Flink writer proposal
>
>
> Key:
[
https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Li resolved HUDI-1521.
---
Resolution: Implemented
> [UMBRELLA] RFC-24 HUDI Flink writer proposal
> -
vburenin opened a new pull request #2714:
URL: https://github.com/apache/hudi/pull/2714
## What is the purpose of the pull request
Some log messages are too verbose and some are not really readable, this PR
is aimed at moving most verbose messages from info to debug level as well as
[
https://issues.apache.org/jira/browse/HUDI-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1707:
-
Labels: pull-request-available (was: )
> Improve Logging subsystem
> -
>
vburenin commented on a change in pull request #2687:
URL: https://github.com/apache/hudi/pull/2687#discussion_r600554090
##
File path: docs/_docs/0.7.0/1_4_powered_by.md
##
@@ -146,6 +146,8 @@ Meanwhile, we build a set of data access standards based on
Hudi, which provides
kema-wish opened a new pull request #2715:
URL: https://github.com/apache/hudi/pull/2715
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose of the p
kema-wish closed pull request #2715:
URL: https://github.com/apache/hudi/pull/2715
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please
n3nash merged pull request #2709:
URL: https://github.com/apache/hudi/pull/2709
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please con
This is an automated email from the ASF dual-hosted git repository.
nagarwal pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new f48fc59 Updating config name (#2709)
f48fc5
[
https://issues.apache.org/jira/browse/HUDI-1713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1713:
-
Labels: pull-request-available (was: )
> Fix config name for concurrency
> --
n3nash edited a comment on pull request #2701:
URL: https://github.com/apache/hudi/pull/2701#issuecomment-804432752
@vinothchandar Can you take an early cursory look at this PR ? I have not
added any tests yet and more changes need to be done for the build to work.
--
This is an automat
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new cd78ade Travis CI build asf-site
cd78ade is d
vinothchandar commented on a change in pull request #2645:
URL: https://github.com/apache/hudi/pull/2645#discussion_r597997690
##
File path:
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieMergeHandle.java
##
@@ -394,4 +405,36 @@ public IOType getIOType()
pengzhiwei2018 edited a comment on pull request #2645:
URL: https://github.com/apache/hudi/pull/2645#issuecomment-803355840
> Getting started on this. Sorry for the delay.
>
> How important are the changes around writeSchema vs inputSchema and such
changes to the SQL implementation?
vinothchandar commented on pull request #2645:
URL: https://github.com/apache/hudi/pull/2645#issuecomment-806141760
Let me see how/if we can simplify the inputSchema vs writeSchema thing.
I went over the PR now. LGTM at a high level.
Few questions though
- I see we are in
vinothchandar commented on pull request #2645:
URL: https://github.com/apache/hudi/pull/2645#issuecomment-806159133
Can we also handle DELETE in this PR itself? That way, we have some basic
support for all of the major DMLs
--
This is an automated message from the Apache Git Service.
T
vinothchandar commented on pull request #2645:
URL: https://github.com/apache/hudi/pull/2645#issuecomment-806165264
cc @vingov this may also be useful for you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL ab
xiarixiaoyao commented on pull request #2645:
URL: https://github.com/apache/hudi/pull/2645#issuecomment-806300975
@pengzhiwei2018 it's a great work, thanks. MERGE/DELETE
expresssions(MergeIntoTable, MergeAction... ) in your pr is copy from
v2Commands.scala in spark 3.0 which will lead
xiarixiaoyao commented on a change in pull request #2651:
URL: https://github.com/apache/hudi/pull/2651#discussion_r600990095
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala
##
@@ -0,0 +1,349 @@
+/*
+ * Licensed to the Apache
xiarixiaoyao commented on a change in pull request #2645:
URL: https://github.com/apache/hudi/pull/2645#discussion_r600992762
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieSparkSessionExtension.scala
##
@@ -0,0 +1,48 @@
+/*
+ * L
xiarixiaoyao commented on a change in pull request #2645:
URL: https://github.com/apache/hudi/pull/2645#discussion_r600993546
##
File path: hudi-spark-datasource/hudi-spark2/src/main/antlr4/imports/SqlBase.g4
##
@@ -0,0 +1,1099 @@
+/*
+ * Licensed under the Apache License, Vers
sivabalan narayanan created HUDI-1716:
-
Summary: rt view w/ MOR tables fails after schema evolution
Key: HUDI-1716
URL: https://issues.apache.org/jira/browse/HUDI-1716
Project: Apache Hudi
nsivabalan commented on issue #2675:
URL: https://github.com/apache/hudi/issues/2675#issuecomment-806348073
yes, you are right. I was able to reproduce the issue(local spark). Have
filed a [bug](https://issues.apache.org/jira/browse/HUDI-1716).
I am yet to try out the hive issue. but it
[
https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1716:
--
Labels: sev:critical user-support-issues (was: )
> rt view w/ MOR tables fails after sc
[
https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1716:
--
Fix Version/s: 0.9.0
> rt view w/ MOR tables fails after schema evolution
>
[
https://issues.apache.org/jira/browse/HUDI-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen reopened HUDI-1495:
--
Reopen for release 0.9.0
> Upgrade Flink version to 1.12.0
> ---
>
>
[
https://issues.apache.org/jira/browse/HUDI-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen updated HUDI-1495:
-
Fix Version/s: (was: 0.7.0)
0.9.0
> Upgrade Flink version to 1.12.0
> -
[
https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1716:
--
Description:
Looks like realtime view w/ MOR table fails if schema present in existing l
[
https://issues.apache.org/jira/browse/HUDI-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308346#comment-17308346
]
sivabalan narayanan commented on HUDI-1711:
---
sure
> Avro Schema Exception with
[
https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1716:
--
Description:
Looks like realtime view w/ MOR table fails if schema present in existing l
codecov-io commented on pull request #2710:
URL: https://github.com/apache/hudi/pull/2710#issuecomment-806393474
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2710?src=pr&el=h1) Report
> Merging
[#2710](https://codecov.io/gh/apache/hudi/pull/2710?src=pr&el=desc) (d446d2d)
into
[ma
[
https://issues.apache.org/jira/browse/HUDI-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308414#comment-17308414
]
Prashant Wason commented on HUDI-1717:
--
[~vinothchandar] FYI
> Metadata Table reader
Prashant Wason created HUDI-1717:
Summary: Metadata Table reader does not show correct view of the
metadata
Key: HUDI-1717
URL: https://issues.apache.org/jira/browse/HUDI-1717
Project: Apache Hudi
74 matches
Mail list logo