[GitHub] [hudi] codecov-io commented on pull request #2708: [HUDI-1712] Rename & standardize config to match other configs

2021-03-24 Thread GitBox
codecov-io commented on pull request #2708: URL: https://github.com/apache/hudi/pull/2708#issuecomment-805560787 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2708?src=pr&el=h1) Report > Merging [#2708](https://codecov.io/gh/apache/hudi/pull/2708?src=pr&el=desc) (1aaf8b1) into [ma

[GitHub] [hudi] codecov-io edited a comment on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
codecov-io edited a comment on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-792430670 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2645?src=pr&el=h1) Report > Merging [#2645](https://codecov.io/gh/apache/hudi/pull/2645?src=pr&el=desc) (c4316ae) in

[GitHub] [hudi] codecov-io commented on pull request #2711: [hotfix] Log the error message for creating table source first

2021-03-24 Thread GitBox
codecov-io commented on pull request #2711: URL: https://github.com/apache/hudi/pull/2711#issuecomment-805632411 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2711?src=pr&el=h1) Report > Merging [#2711](https://codecov.io/gh/apache/hudi/pull/2711?src=pr&el=desc) (ae47544) into [ma

[GitHub] [hudi] garyli1019 merged pull request #2708: [HUDI-1712] Rename & standardize config to match other configs

2021-03-24 Thread GitBox
garyli1019 merged pull request #2708: URL: https://github.com/apache/hudi/pull/2708 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[hudi] branch master updated (03668db -> 01a1d79)

2021-03-24 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 03668db [HUDI-1710] Read optimized query type for Flink batch reader (#2702) add 01a1d79 [HUDI-1712] Rename & s

[GitHub] [hudi] Sugamber commented on issue #2637: [SUPPORT] - Partial Update : update few columns of a table

2021-03-24 Thread GitBox
Sugamber commented on issue #2637: URL: https://github.com/apache/hudi/issues/2637#issuecomment-805645355 There is an open pull request for partial update for CoW table. https://github.com/apache/hudi/pull/1929 It looks like my use case . -- This is an automated message from the

[GitHub] [hudi] Sugamber commented on pull request #2666: [HUDI-1160] Support update partial fields for CoW table

2021-03-24 Thread GitBox
Sugamber commented on pull request #2666: URL: https://github.com/apache/hudi/pull/2666#issuecomment-805652102 @liujinhui1994 We are also need the same feature in hudi. Is there any working branch which can be referred? -- This is an automated message from the Apache Git Service. To re

[GitHub] [hudi] liujinhui1994 commented on pull request #2666: [HUDI-1160] Support update partial fields for CoW table

2021-03-24 Thread GitBox
liujinhui1994 commented on pull request #2666: URL: https://github.com/apache/hudi/pull/2666#issuecomment-805655005 @Sugamber This branch should be available -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [hudi] Sugamber commented on pull request #2666: [HUDI-1160] Support update partial fields for CoW table

2021-03-24 Thread GitBox
Sugamber commented on pull request #2666: URL: https://github.com/apache/hudi/pull/2666#issuecomment-805666558 Is there any timeline for this pull request? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hudi] liujinhui1994 commented on pull request #2666: [HUDI-1160] Support update partial fields for CoW table

2021-03-24 Thread GitBox
liujinhui1994 commented on pull request #2666: URL: https://github.com/apache/hudi/pull/2666#issuecomment-805667943 Maybe after 0.8 is released -- 原始邮件 -- 发件人:

[GitHub] [hudi] codecov-io edited a comment on pull request #2651: [HUDI-1591] [RFC-26] Improve Hoodie Table Query Performance And Ease Of Use Fo…

2021-03-24 Thread GitBox
codecov-io edited a comment on pull request #2651: URL: https://github.com/apache/hudi/pull/2651#issuecomment-794945140 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2651?src=pr&el=h1) Report > Merging [#2651](https://codecov.io/gh/apache/hudi/pull/2651?src=pr&el=desc) (fb7a9b1) in

[GitHub] [hudi] garyli1019 merged pull request #2711: [hotfix] Log the error message for creating table source first

2021-03-24 Thread GitBox
garyli1019 merged pull request #2711: URL: https://github.com/apache/hudi/pull/2711 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[hudi] branch master updated: [hotfix] Log the error message for creating table source first (#2711)

2021-03-24 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 29b79c9 [hotfix] Log the error message for creati

[GitHub] [hudi] Sugamber edited a comment on issue #2637: [SUPPORT] - Partial Update : update few columns of a table

2021-03-24 Thread GitBox
Sugamber edited a comment on issue #2637: URL: https://github.com/apache/hudi/issues/2637#issuecomment-805645355 There is an open pull request for partial update for CoW table. https://github.com/apache/hudi/pull/1929 It looks like my use case is similar to this . -- This is an

[GitHub] [hudi] IloveZiHan opened a new pull request #2713: 查阅Structured Streaming写入Hudi执行计划

2021-03-24 Thread GitBox
IloveZiHan opened a new pull request #2713: URL: https://github.com/apache/hudi/pull/2713 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[GitHub] [hudi] IloveZiHan commented on pull request #2713: 查阅Structured Streaming写入Hudi执行计划

2021-03-24 Thread GitBox
IloveZiHan commented on pull request #2713: URL: https://github.com/apache/hudi/pull/2713#issuecomment-805712787 ok -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For que

[GitHub] [hudi] IloveZiHan closed pull request #2713: 查阅Structured Streaming写入Hudi执行计划

2021-03-24 Thread GitBox
IloveZiHan closed pull request #2713: URL: https://github.com/apache/hudi/pull/2713 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] Sugamber commented on issue #2637: [SUPPORT] - Partial Update : update few columns of a table

2021-03-24 Thread GitBox
Sugamber commented on issue #2637: URL: https://github.com/apache/hudi/issues/2637#issuecomment-805713856 @nsivabalan Do we have any timeline for this pull request ? Pull request 1- https://github.com/apache/hudi/pull/1929/ Pull request 2- https://github.com/apache/hudi/pull/2666

[jira] [Created] (HUDI-1714) Improve code coverage of TestHoodieTimelineArchiveLog

2021-03-24 Thread Jagmeet Bali (Jira)
Jagmeet Bali created HUDI-1714: -- Summary: Improve code coverage of TestHoodieTimelineArchiveLog Key: HUDI-1714 URL: https://issues.apache.org/jira/browse/HUDI-1714 Project: Apache Hudi Issue Typ

[GitHub] [hudi] nsivabalan commented on issue #2675: [SUPPORT] Unable to query MOR table after schema evolution

2021-03-24 Thread GitBox
nsivabalan commented on issue #2675: URL: https://github.com/apache/hudi/issues/2675#issuecomment-805805044 1. do you use the RowBasedSchemaProvider and hence can't explicitly provide schema? If you were to use your own schema registry, you might as well provide an updated schema to hudi w

[GitHub] [hudi] jsbali commented on a change in pull request #2677: Added tests to TestHoodieTimelineArchiveLog for the archival of compl…

2021-03-24 Thread GitBox
jsbali commented on a change in pull request #2677: URL: https://github.com/apache/hudi/pull/2677#discussion_r600461519 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java ## @@ -388,6 +391,31 @@ public void testArchiv

[GitHub] [hudi] jsbali commented on a change in pull request #2677: Added tests to TestHoodieTimelineArchiveLog for the archival of compl…

2021-03-24 Thread GitBox
jsbali commented on a change in pull request #2677: URL: https://github.com/apache/hudi/pull/2677#discussion_r600462395 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java ## @@ -491,6 +519,166 @@ public void testConve

[GitHub] [hudi] jsbali commented on a change in pull request #2677: Added tests to TestHoodieTimelineArchiveLog for the archival of compl…

2021-03-24 Thread GitBox
jsbali commented on a change in pull request #2677: URL: https://github.com/apache/hudi/pull/2677#discussion_r600463160 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java ## @@ -491,6 +519,166 @@ public void testConve

[GitHub] [hudi] jsbali commented on a change in pull request #2677: Added tests to TestHoodieTimelineArchiveLog for the archival of compl…

2021-03-24 Thread GitBox
jsbali commented on a change in pull request #2677: URL: https://github.com/apache/hudi/pull/2677#discussion_r600463420 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java ## @@ -491,6 +519,166 @@ public void testConve

[GitHub] [hudi] jsbali commented on pull request #2677: Added tests to TestHoodieTimelineArchiveLog for the archival of compl…

2021-03-24 Thread GitBox
jsbali commented on pull request #2677: URL: https://github.com/apache/hudi/pull/2677#issuecomment-805810171 @vinothchandar added [JIRA](https://issues.apache.org/jira/browse/HUDI-1714) for it. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] jsbali edited a comment on pull request #2677: Added tests to TestHoodieTimelineArchiveLog for the archival of compl…

2021-03-24 Thread GitBox
jsbali edited a comment on pull request #2677: URL: https://github.com/apache/hudi/pull/2677#issuecomment-805810171 @vinothchandar added [HUDI-1714](https://issues.apache.org/jira/browse/HUDI-1714) for it. -- This is an automated message from the Apache Git Service. To respond to the mes

[hudi] branch master updated: Moving to 0.9.0-SNAPSHOT on master branch.

2021-03-24 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 6e803e0 Moving to 0.9.0-SNAPSHOT on master branch

[hudi] branch release-0.8.0 created (now 9bfd810)

2021-03-24 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a change to branch release-0.8.0 in repository https://gitbox.apache.org/repos/asf/hudi.git. at 9bfd810 Create release branch for version 0.8.0. This branch includes the following new commits: new 9bf

[hudi] 01/01: Create release branch for version 0.8.0.

2021-03-24 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a commit to branch release-0.8.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 9bfd810e745202bd27980fa696d61b47922f46a9 Author: garyli1019 AuthorDate: Wed Mar 24 21:37:43 2021 +0800 Create

[jira] [Resolved] (HUDI-1712) Standardize prefix for hoodie lock configs

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li resolved HUDI-1712. --- Resolution: Resolved > Standardize prefix for hoodie lock configs > --

[jira] [Closed] (HUDI-1712) Standardize prefix for hoodie lock configs

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1712. - > Standardize prefix for hoodie lock configs > -- > > Key: HUD

[jira] [Updated] (HUDI-909) Integrate hudi with flink engine

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-909: - Issue Type: New Feature (was: Task) > Integrate hudi with flink engine > > >

[jira] [Updated] (HUDI-909) [UMBRELLA]Integrate hudi with flink engine

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-909: - Summary: [UMBRELLA]Integrate hudi with flink engine (was: Integrate hudi with flink engine) > [UMBRELLA]Integrate

[jira] [Updated] (HUDI-1521) [UMBRELLA]HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1521: -- Summary: [UMBRELLA]HUDI Flink writer proposal (was: HUDI Flink writer proposal) > [UMBRELLA]HUDI Flink writer

[jira] [Updated] (HUDI-1521) HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1521: -- Issue Type: New Feature (was: Improvement) > HUDI Flink writer proposal > -- > >

[jira] [Updated] (HUDI-1521) [UMBRELLA]HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1521: -- Fix Version/s: 0.8.0 > [UMBRELLA]HUDI Flink writer proposal > > >

[jira] [Updated] (HUDI-1521) [UMBRELLA] RFC-24 HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1521: -- Summary: [UMBRELLA] RFC-24 HUDI Flink writer proposal (was: [UMBRELLA]HUDI Flink writer proposal) > [UMBRELLA]

[jira] [Created] (HUDI-1715) Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer

2021-03-24 Thread Gary Li (Jira)
Gary Li created HUDI-1715: - Summary: Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer Key: HUDI-1715 URL: https://issues.apache.org/jira/browse/HUDI-1715 Project: Apache Hudi

[jira] [Updated] (HUDI-1715) Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1715: -- Component/s: Flink Integration > Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer > -

[jira] [Closed] (HUDI-1581) Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1581. - Resolution: Duplicate > Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer >

[jira] [Updated] (HUDI-1715) Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1715: -- Description: In order to adapt to the new Flink writer, the executor needs to support: 1. specify the bucket ty

[jira] [Closed] (HUDI-1521) [UMBRELLA] RFC-24 HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1521. - > [UMBRELLA] RFC-24 HUDI Flink writer proposal > > > Key:

[jira] [Resolved] (HUDI-1521) [UMBRELLA] RFC-24 HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li resolved HUDI-1521. --- Resolution: Implemented > [UMBRELLA] RFC-24 HUDI Flink writer proposal > -

[GitHub] [hudi] vburenin opened a new pull request #2714: [HUDI-1707] Reduces log level for too verbose messages from info to debug level.

2021-03-24 Thread GitBox
vburenin opened a new pull request #2714: URL: https://github.com/apache/hudi/pull/2714 ## What is the purpose of the pull request Some log messages are too verbose and some are not really readable, this PR is aimed at moving most verbose messages from info to debug level as well as

[jira] [Updated] (HUDI-1707) Improve Logging subsystem

2021-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1707: - Labels: pull-request-available (was: ) > Improve Logging subsystem > - >

[GitHub] [hudi] vburenin commented on a change in pull request #2687: [HUDI-1700] Hudi Meetup with Uber video link

2021-03-24 Thread GitBox
vburenin commented on a change in pull request #2687: URL: https://github.com/apache/hudi/pull/2687#discussion_r600554090 ## File path: docs/_docs/0.7.0/1_4_powered_by.md ## @@ -146,6 +146,8 @@ Meanwhile, we build a set of data access standards based on Hudi, which provides

[GitHub] [hudi] kema-wish opened a new pull request #2715: Fix non object id key

2021-03-24 Thread GitBox
kema-wish opened a new pull request #2715: URL: https://github.com/apache/hudi/pull/2715 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the p

[GitHub] [hudi] kema-wish closed pull request #2715: Fix non object id key

2021-03-24 Thread GitBox
kema-wish closed pull request #2715: URL: https://github.com/apache/hudi/pull/2715 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] n3nash merged pull request #2709: [HUDI-1713] Updating config name for concurrency

2021-03-24 Thread GitBox
n3nash merged pull request #2709: URL: https://github.com/apache/hudi/pull/2709 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please con

[hudi] branch asf-site updated: Updating config name (#2709)

2021-03-24 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new f48fc59 Updating config name (#2709) f48fc5

[jira] [Updated] (HUDI-1713) Fix config name for concurrency

2021-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1713: - Labels: pull-request-available (was: ) > Fix config name for concurrency > --

[GitHub] [hudi] n3nash edited a comment on pull request #2701: [HUDI 1623] New Hoodie Instant on disk format with end time and milliseconds granularity

2021-03-24 Thread GitBox
n3nash edited a comment on pull request #2701: URL: https://github.com/apache/hudi/pull/2701#issuecomment-804432752 @vinothchandar Can you take an early cursory look at this PR ? I have not added any tests yet and more changes need to be done for the build to work. -- This is an automat

[hudi] branch asf-site updated: Travis CI build asf-site

2021-03-24 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new cd78ade Travis CI build asf-site cd78ade is d

[GitHub] [hudi] vinothchandar commented on a change in pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
vinothchandar commented on a change in pull request #2645: URL: https://github.com/apache/hudi/pull/2645#discussion_r597997690 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieMergeHandle.java ## @@ -394,4 +405,36 @@ public IOType getIOType()

[GitHub] [hudi] pengzhiwei2018 edited a comment on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
pengzhiwei2018 edited a comment on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-803355840 > Getting started on this. Sorry for the delay. > > How important are the changes around writeSchema vs inputSchema and such changes to the SQL implementation?

[GitHub] [hudi] vinothchandar commented on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
vinothchandar commented on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-806141760 Let me see how/if we can simplify the inputSchema vs writeSchema thing. I went over the PR now. LGTM at a high level. Few questions though - I see we are in

[GitHub] [hudi] vinothchandar commented on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
vinothchandar commented on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-806159133 Can we also handle DELETE in this PR itself? That way, we have some basic support for all of the major DMLs -- This is an automated message from the Apache Git Service. T

[GitHub] [hudi] vinothchandar commented on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
vinothchandar commented on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-806165264 cc @vingov this may also be useful for you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [hudi] xiarixiaoyao commented on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
xiarixiaoyao commented on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-806300975 @pengzhiwei2018 it's a great work, thanks. MERGE/DELETE expresssions(MergeIntoTable, MergeAction... ) in your pr is copy from v2Commands.scala in spark 3.0 which will lead

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #2651: [HUDI-1591] [RFC-26] Improve Hoodie Table Query Performance And Ease Of Use Fo…

2021-03-24 Thread GitBox
xiarixiaoyao commented on a change in pull request #2651: URL: https://github.com/apache/hudi/pull/2651#discussion_r600990095 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala ## @@ -0,0 +1,349 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
xiarixiaoyao commented on a change in pull request #2645: URL: https://github.com/apache/hudi/pull/2645#discussion_r600992762 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieSparkSessionExtension.scala ## @@ -0,0 +1,48 @@ +/* + * L

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
xiarixiaoyao commented on a change in pull request #2645: URL: https://github.com/apache/hudi/pull/2645#discussion_r600993546 ## File path: hudi-spark-datasource/hudi-spark2/src/main/antlr4/imports/SqlBase.g4 ## @@ -0,0 +1,1099 @@ +/* + * Licensed under the Apache License, Vers

[jira] [Created] (HUDI-1716) rt view w/ MOR tables fails after schema evolution

2021-03-24 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-1716: - Summary: rt view w/ MOR tables fails after schema evolution Key: HUDI-1716 URL: https://issues.apache.org/jira/browse/HUDI-1716 Project: Apache Hudi

[GitHub] [hudi] nsivabalan commented on issue #2675: [SUPPORT] Unable to query MOR table after schema evolution

2021-03-24 Thread GitBox
nsivabalan commented on issue #2675: URL: https://github.com/apache/hudi/issues/2675#issuecomment-806348073 yes, you are right. I was able to reproduce the issue(local spark). Have filed a [bug](https://issues.apache.org/jira/browse/HUDI-1716). I am yet to try out the hive issue. but it

[jira] [Updated] (HUDI-1716) rt view w/ MOR tables fails after schema evolution

2021-03-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1716: -- Labels: sev:critical user-support-issues (was: ) > rt view w/ MOR tables fails after sc

[jira] [Updated] (HUDI-1716) rt view w/ MOR tables fails after schema evolution

2021-03-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1716: -- Fix Version/s: 0.9.0 > rt view w/ MOR tables fails after schema evolution >

[jira] [Reopened] (HUDI-1495) Upgrade Flink version to 1.12.0

2021-03-24 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen reopened HUDI-1495: -- Reopen for release 0.9.0 > Upgrade Flink version to 1.12.0 > --- > >

[jira] [Updated] (HUDI-1495) Upgrade Flink version to 1.12.0

2021-03-24 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1495: - Fix Version/s: (was: 0.7.0) 0.9.0 > Upgrade Flink version to 1.12.0 > -

[jira] [Updated] (HUDI-1716) rt view w/ MOR tables fails after schema evolution

2021-03-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1716: -- Description: Looks like realtime view w/ MOR table fails if schema present in existing l

[jira] [Commented] (HUDI-1711) Avro Schema Exception with Spark 3.0 in 0.7

2021-03-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308346#comment-17308346 ] sivabalan narayanan commented on HUDI-1711: --- sure > Avro Schema Exception with

[jira] [Updated] (HUDI-1716) rt view w/ MOR tables fails after schema evolution

2021-03-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1716: -- Description: Looks like realtime view w/ MOR table fails if schema present in existing l

[GitHub] [hudi] codecov-io commented on pull request #2710: [RFC-20][HUDI-648] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

2021-03-24 Thread GitBox
codecov-io commented on pull request #2710: URL: https://github.com/apache/hudi/pull/2710#issuecomment-806393474 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2710?src=pr&el=h1) Report > Merging [#2710](https://codecov.io/gh/apache/hudi/pull/2710?src=pr&el=desc) (d446d2d) into [ma

[jira] [Commented] (HUDI-1717) Metadata Table reader does not show correct view of the metadata

2021-03-24 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308414#comment-17308414 ] Prashant Wason commented on HUDI-1717: -- [~vinothchandar] FYI > Metadata Table reader

[jira] [Created] (HUDI-1717) Metadata Table reader does not show correct view of the metadata

2021-03-24 Thread Prashant Wason (Jira)
Prashant Wason created HUDI-1717: Summary: Metadata Table reader does not show correct view of the metadata Key: HUDI-1717 URL: https://issues.apache.org/jira/browse/HUDI-1717 Project: Apache Hudi