[GitHub] [hudi] hudi-bot edited a comment on pull request #2643: DO NOT MERGE (Azure CI) test branch ci

2021-03-24 Thread GitBox
hudi-bot edited a comment on pull request #2643: URL: https://github.com/apache/hudi/pull/2643#issuecomment-792368481 ## CI report: * 9831a6c50e9f49f8a71c02fc6ac50ae1446f7c1f UNKNOWN * a569dbe9409910fbb83b3764b300574c0e52612e Azure:

[GitHub] [hudi] codecov-io commented on pull request #2708: [HUDI-1712] Rename & standardize config to match other configs

2021-03-24 Thread GitBox
codecov-io commented on pull request #2708: URL: https://github.com/apache/hudi/pull/2708#issuecomment-805560787 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2708?src=pr=h1) Report > Merging [#2708](https://codecov.io/gh/apache/hudi/pull/2708?src=pr=desc) (1aaf8b1) into

[GitHub] [hudi] Sugamber commented on issue #2637: [SUPPORT] - Partial Update : update few columns of a table

2021-03-24 Thread GitBox
Sugamber commented on issue #2637: URL: https://github.com/apache/hudi/issues/2637#issuecomment-805645355 There is an open pull request for partial update for CoW table. https://github.com/apache/hudi/pull/1929 It looks like my use case . -- This is an automated message from

[GitHub] [hudi] Sugamber commented on pull request #2666: [HUDI-1160] Support update partial fields for CoW table

2021-03-24 Thread GitBox
Sugamber commented on pull request #2666: URL: https://github.com/apache/hudi/pull/2666#issuecomment-805652102 @liujinhui1994 We are also need the same feature in hudi. Is there any working branch which can be referred? -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] codecov-io edited a comment on pull request #2651: [HUDI-1591] [RFC-26] Improve Hoodie Table Query Performance And Ease Of Use Fo…

2021-03-24 Thread GitBox
codecov-io edited a comment on pull request #2651: URL: https://github.com/apache/hudi/pull/2651#issuecomment-794945140 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2651?src=pr=h1) Report > Merging [#2651](https://codecov.io/gh/apache/hudi/pull/2651?src=pr=desc) (fb7a9b1) into

[GitHub] [hudi] codecov-io edited a comment on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
codecov-io edited a comment on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-792430670 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2645?src=pr=h1) Report > Merging [#2645](https://codecov.io/gh/apache/hudi/pull/2645?src=pr=desc) (c4316ae) into

[GitHub] [hudi] garyli1019 merged pull request #2711: [hotfix] Log the error message for creating table source first

2021-03-24 Thread GitBox
garyli1019 merged pull request #2711: URL: https://github.com/apache/hudi/pull/2711 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[hudi] branch master updated: [hotfix] Log the error message for creating table source first (#2711)

2021-03-24 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 29b79c9 [hotfix] Log the error message for

[GitHub] [hudi] liujinhui1994 commented on pull request #2666: [HUDI-1160] Support update partial fields for CoW table

2021-03-24 Thread GitBox
liujinhui1994 commented on pull request #2666: URL: https://github.com/apache/hudi/pull/2666#issuecomment-805655005 @Sugamber This branch should be available -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] liujinhui1994 commented on pull request #2666: [HUDI-1160] Support update partial fields for CoW table

2021-03-24 Thread GitBox
liujinhui1994 commented on pull request #2666: URL: https://github.com/apache/hudi/pull/2666#issuecomment-805667943 Maybe after 0.8 is released --原始邮件-- 发件人:

[GitHub] [hudi] Sugamber edited a comment on issue #2637: [SUPPORT] - Partial Update : update few columns of a table

2021-03-24 Thread GitBox
Sugamber edited a comment on issue #2637: URL: https://github.com/apache/hudi/issues/2637#issuecomment-805645355 There is an open pull request for partial update for CoW table. https://github.com/apache/hudi/pull/1929 It looks like my use case is similar to this . -- This is an

[GitHub] [hudi] garyli1019 merged pull request #2708: [HUDI-1712] Rename & standardize config to match other configs

2021-03-24 Thread GitBox
garyli1019 merged pull request #2708: URL: https://github.com/apache/hudi/pull/2708 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[hudi] branch master updated (03668db -> 01a1d79)

2021-03-24 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 03668db [HUDI-1710] Read optimized query type for Flink batch reader (#2702) add 01a1d79 [HUDI-1712] Rename &

[GitHub] [hudi] IloveZiHan opened a new pull request #2713: 查阅Structured Streaming写入Hudi执行计划

2021-03-24 Thread GitBox
IloveZiHan opened a new pull request #2713: URL: https://github.com/apache/hudi/pull/2713 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[GitHub] [hudi] IloveZiHan commented on pull request #2713: 查阅Structured Streaming写入Hudi执行计划

2021-03-24 Thread GitBox
IloveZiHan commented on pull request #2713: URL: https://github.com/apache/hudi/pull/2713#issuecomment-805712787 ok -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [hudi] IloveZiHan closed pull request #2713: 查阅Structured Streaming写入Hudi执行计划

2021-03-24 Thread GitBox
IloveZiHan closed pull request #2713: URL: https://github.com/apache/hudi/pull/2713 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hudi] codecov-io commented on pull request #2711: [hotfix] Log the error message for creating table source first

2021-03-24 Thread GitBox
codecov-io commented on pull request #2711: URL: https://github.com/apache/hudi/pull/2711#issuecomment-805632411 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2711?src=pr=h1) Report > Merging [#2711](https://codecov.io/gh/apache/hudi/pull/2711?src=pr=desc) (ae47544) into

[GitHub] [hudi] Sugamber commented on pull request #2666: [HUDI-1160] Support update partial fields for CoW table

2021-03-24 Thread GitBox
Sugamber commented on pull request #2666: URL: https://github.com/apache/hudi/pull/2666#issuecomment-805666558 Is there any timeline for this pull request? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] Sugamber commented on issue #2637: [SUPPORT] - Partial Update : update few columns of a table

2021-03-24 Thread GitBox
Sugamber commented on issue #2637: URL: https://github.com/apache/hudi/issues/2637#issuecomment-805713856 @nsivabalan Do we have any timeline for this pull request ? Pull request 1- https://github.com/apache/hudi/pull/1929/ Pull request 2- https://github.com/apache/hudi/pull/2666

[jira] [Updated] (HUDI-909) Integrate hudi with flink engine

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-909: - Issue Type: New Feature (was: Task) > Integrate hudi with flink engine > > >

[GitHub] [hudi] vburenin opened a new pull request #2714: [HUDI-1707] Reduces log level for too verbose messages from info to debug level.

2021-03-24 Thread GitBox
vburenin opened a new pull request #2714: URL: https://github.com/apache/hudi/pull/2714 ## What is the purpose of the pull request Some log messages are too verbose and some are not really readable, this PR is aimed at moving most verbose messages from info to debug level as well as

[GitHub] [hudi] jsbali commented on a change in pull request #2677: Added tests to TestHoodieTimelineArchiveLog for the archival of compl…

2021-03-24 Thread GitBox
jsbali commented on a change in pull request #2677: URL: https://github.com/apache/hudi/pull/2677#discussion_r600463420 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java ## @@ -491,6 +519,166 @@ public void

[GitHub] [hudi] jsbali commented on pull request #2677: Added tests to TestHoodieTimelineArchiveLog for the archival of compl…

2021-03-24 Thread GitBox
jsbali commented on pull request #2677: URL: https://github.com/apache/hudi/pull/2677#issuecomment-805810171 @vinothchandar added [JIRA](https://issues.apache.org/jira/browse/HUDI-1714) for it. -- This is an automated message from the Apache Git Service. To respond to the message,

[hudi] branch master updated: Moving to 0.9.0-SNAPSHOT on master branch.

2021-03-24 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 6e803e0 Moving to 0.9.0-SNAPSHOT on master

[hudi] branch release-0.8.0 created (now 9bfd810)

2021-03-24 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a change to branch release-0.8.0 in repository https://gitbox.apache.org/repos/asf/hudi.git. at 9bfd810 Create release branch for version 0.8.0. This branch includes the following new commits: new

[jira] [Created] (HUDI-1715) Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer

2021-03-24 Thread Gary Li (Jira)
Gary Li created HUDI-1715: - Summary: Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer Key: HUDI-1715 URL: https://issues.apache.org/jira/browse/HUDI-1715 Project: Apache Hudi

[jira] [Updated] (HUDI-1715) Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1715: -- Component/s: Flink Integration > Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer >

[GitHub] [hudi] jsbali commented on a change in pull request #2677: Added tests to TestHoodieTimelineArchiveLog for the archival of compl…

2021-03-24 Thread GitBox
jsbali commented on a change in pull request #2677: URL: https://github.com/apache/hudi/pull/2677#discussion_r600462395 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java ## @@ -491,6 +519,166 @@ public void

[GitHub] [hudi] jsbali commented on a change in pull request #2677: Added tests to TestHoodieTimelineArchiveLog for the archival of compl…

2021-03-24 Thread GitBox
jsbali commented on a change in pull request #2677: URL: https://github.com/apache/hudi/pull/2677#discussion_r600461519 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java ## @@ -388,6 +391,31 @@ public void

[GitHub] [hudi] jsbali edited a comment on pull request #2677: Added tests to TestHoodieTimelineArchiveLog for the archival of compl…

2021-03-24 Thread GitBox
jsbali edited a comment on pull request #2677: URL: https://github.com/apache/hudi/pull/2677#issuecomment-805810171 @vinothchandar added [HUDI-1714](https://issues.apache.org/jira/browse/HUDI-1714) for it. -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Closed] (HUDI-1581) Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1581. - Resolution: Duplicate > Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer >

[jira] [Updated] (HUDI-1715) Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1715: -- Description: In order to adapt to the new Flink writer, the executor needs to support: 1. specify the bucket

[GitHub] [hudi] vburenin commented on a change in pull request #2687: [HUDI-1700] Hudi Meetup with Uber video link

2021-03-24 Thread GitBox
vburenin commented on a change in pull request #2687: URL: https://github.com/apache/hudi/pull/2687#discussion_r600554090 ## File path: docs/_docs/0.7.0/1_4_powered_by.md ## @@ -146,6 +146,8 @@ Meanwhile, we build a set of data access standards based on Hudi, which provides

[GitHub] [hudi] jsbali commented on a change in pull request #2677: Added tests to TestHoodieTimelineArchiveLog for the archival of compl…

2021-03-24 Thread GitBox
jsbali commented on a change in pull request #2677: URL: https://github.com/apache/hudi/pull/2677#discussion_r600463160 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieTimelineArchiveLog.java ## @@ -491,6 +519,166 @@ public void

[hudi] 01/01: Create release branch for version 0.8.0.

2021-03-24 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a commit to branch release-0.8.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 9bfd810e745202bd27980fa696d61b47922f46a9 Author: garyli1019 AuthorDate: Wed Mar 24 21:37:43 2021 +0800 Create

[jira] [Resolved] (HUDI-1712) Standardize prefix for hoodie lock configs

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li resolved HUDI-1712. --- Resolution: Resolved > Standardize prefix for hoodie lock configs >

[jira] [Closed] (HUDI-1712) Standardize prefix for hoodie lock configs

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1712. - > Standardize prefix for hoodie lock configs > -- > > Key:

[jira] [Updated] (HUDI-1521) [UMBRELLA]HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1521: -- Fix Version/s: 0.8.0 > [UMBRELLA]HUDI Flink writer proposal > > >

[jira] [Updated] (HUDI-1521) [UMBRELLA] RFC-24 HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1521: -- Summary: [UMBRELLA] RFC-24 HUDI Flink writer proposal (was: [UMBRELLA]HUDI Flink writer proposal) >

[jira] [Closed] (HUDI-1521) [UMBRELLA] RFC-24 HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1521. - > [UMBRELLA] RFC-24 HUDI Flink writer proposal > > >

[jira] [Resolved] (HUDI-1521) [UMBRELLA] RFC-24 HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li resolved HUDI-1521. --- Resolution: Implemented > [UMBRELLA] RFC-24 HUDI Flink writer proposal >

[jira] [Created] (HUDI-1714) Improve code coverage of TestHoodieTimelineArchiveLog

2021-03-24 Thread Jagmeet Bali (Jira)
Jagmeet Bali created HUDI-1714: -- Summary: Improve code coverage of TestHoodieTimelineArchiveLog Key: HUDI-1714 URL: https://issues.apache.org/jira/browse/HUDI-1714 Project: Apache Hudi Issue

[GitHub] [hudi] nsivabalan commented on issue #2675: [SUPPORT] Unable to query MOR table after schema evolution

2021-03-24 Thread GitBox
nsivabalan commented on issue #2675: URL: https://github.com/apache/hudi/issues/2675#issuecomment-805805044 1. do you use the RowBasedSchemaProvider and hence can't explicitly provide schema? If you were to use your own schema registry, you might as well provide an updated schema to hudi

[jira] [Updated] (HUDI-909) [UMBRELLA]Integrate hudi with flink engine

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-909: - Summary: [UMBRELLA]Integrate hudi with flink engine (was: Integrate hudi with flink engine) >

[jira] [Updated] (HUDI-1521) [UMBRELLA]HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1521: -- Summary: [UMBRELLA]HUDI Flink writer proposal (was: HUDI Flink writer proposal) > [UMBRELLA]HUDI Flink writer

[jira] [Updated] (HUDI-1521) HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1521: -- Issue Type: New Feature (was: Improvement) > HUDI Flink writer proposal > -- > >

[jira] [Updated] (HUDI-1707) Improve Logging subsystem

2021-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1707: - Labels: pull-request-available (was: ) > Improve Logging subsystem > - >

[GitHub] [hudi] kema-wish closed pull request #2715: Fix non object id key

2021-03-24 Thread GitBox
kema-wish closed pull request #2715: URL: https://github.com/apache/hudi/pull/2715 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] kema-wish opened a new pull request #2715: Fix non object id key

2021-03-24 Thread GitBox
kema-wish opened a new pull request #2715: URL: https://github.com/apache/hudi/pull/2715 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[GitHub] [hudi] n3nash merged pull request #2709: [HUDI-1713] Updating config name for concurrency

2021-03-24 Thread GitBox
n3nash merged pull request #2709: URL: https://github.com/apache/hudi/pull/2709 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[hudi] branch asf-site updated: Updating config name (#2709)

2021-03-24 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new f48fc59 Updating config name (#2709)

[jira] [Updated] (HUDI-1713) Fix config name for concurrency

2021-03-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1713: - Labels: pull-request-available (was: ) > Fix config name for concurrency >

[GitHub] [hudi] n3nash edited a comment on pull request #2701: [HUDI 1623] New Hoodie Instant on disk format with end time and milliseconds granularity

2021-03-24 Thread GitBox
n3nash edited a comment on pull request #2701: URL: https://github.com/apache/hudi/pull/2701#issuecomment-804432752 @vinothchandar Can you take an early cursory look at this PR ? I have not added any tests yet and more changes need to be done for the build to work. -- This is an

[GitHub] [hudi] vinothchandar commented on a change in pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
vinothchandar commented on a change in pull request #2645: URL: https://github.com/apache/hudi/pull/2645#discussion_r597997690 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieMergeHandle.java ## @@ -394,4 +405,36 @@ public IOType

[GitHub] [hudi] pengzhiwei2018 edited a comment on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
pengzhiwei2018 edited a comment on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-803355840 > Getting started on this. Sorry for the delay. > > How important are the changes around writeSchema vs inputSchema and such changes to the SQL implementation?

[GitHub] [hudi] vinothchandar commented on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
vinothchandar commented on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-806141760 Let me see how/if we can simplify the inputSchema vs writeSchema thing. I went over the PR now. LGTM at a high level. Few questions though - I see we are

[hudi] branch asf-site updated: Travis CI build asf-site

2021-03-24 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new cd78ade Travis CI build asf-site cd78ade is

[GitHub] [hudi] vinothchandar commented on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
vinothchandar commented on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-806159133 Can we also handle DELETE in this PR itself? That way, we have some basic support for all of the major DMLs -- This is an automated message from the Apache Git Service.

[GitHub] [hudi] vinothchandar commented on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
vinothchandar commented on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-806165264 cc @vingov this may also be useful for you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] xiarixiaoyao commented on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
xiarixiaoyao commented on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-806300975 @pengzhiwei2018 it's a great work, thanks. MERGE/DELETE expresssions(MergeIntoTable, MergeAction... ) in your pr is copy from v2Commands.scala in spark 3.0 which will lead

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #2651: [HUDI-1591] [RFC-26] Improve Hoodie Table Query Performance And Ease Of Use Fo…

2021-03-24 Thread GitBox
xiarixiaoyao commented on a change in pull request #2651: URL: https://github.com/apache/hudi/pull/2651#discussion_r600990095 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieFileIndex.scala ## @@ -0,0 +1,349 @@ +/* + * Licensed to the

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
xiarixiaoyao commented on a change in pull request #2645: URL: https://github.com/apache/hudi/pull/2645#discussion_r600992762 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieSparkSessionExtension.scala ## @@ -0,0 +1,48 @@ +/* + *

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-03-24 Thread GitBox
xiarixiaoyao commented on a change in pull request #2645: URL: https://github.com/apache/hudi/pull/2645#discussion_r600993546 ## File path: hudi-spark-datasource/hudi-spark2/src/main/antlr4/imports/SqlBase.g4 ## @@ -0,0 +1,1099 @@ +/* + * Licensed under the Apache License,

[jira] [Created] (HUDI-1716) rt view w/ MOR tables fails after schema evolution

2021-03-24 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-1716: - Summary: rt view w/ MOR tables fails after schema evolution Key: HUDI-1716 URL: https://issues.apache.org/jira/browse/HUDI-1716 Project: Apache Hudi

[GitHub] [hudi] nsivabalan commented on issue #2675: [SUPPORT] Unable to query MOR table after schema evolution

2021-03-24 Thread GitBox
nsivabalan commented on issue #2675: URL: https://github.com/apache/hudi/issues/2675#issuecomment-806348073 yes, you are right. I was able to reproduce the issue(local spark). Have filed a [bug](https://issues.apache.org/jira/browse/HUDI-1716). I am yet to try out the hive issue. but

[jira] [Updated] (HUDI-1716) rt view w/ MOR tables fails after schema evolution

2021-03-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1716: -- Description: Looks like realtime view w/ MOR table fails if schema present in existing

[jira] [Updated] (HUDI-1716) rt view w/ MOR tables fails after schema evolution

2021-03-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1716: -- Fix Version/s: 0.9.0 > rt view w/ MOR tables fails after schema evolution >

[jira] [Updated] (HUDI-1716) rt view w/ MOR tables fails after schema evolution

2021-03-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1716: -- Labels: sev:critical user-support-issues (was: ) > rt view w/ MOR tables fails after

[jira] [Reopened] (HUDI-1495) Upgrade Flink version to 1.12.0

2021-03-24 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen reopened HUDI-1495: -- Reopen for release 0.9.0 > Upgrade Flink version to 1.12.0 > --- > >

[jira] [Updated] (HUDI-1495) Upgrade Flink version to 1.12.0

2021-03-24 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1495: - Fix Version/s: (was: 0.7.0) 0.9.0 > Upgrade Flink version to 1.12.0 >

[jira] [Commented] (HUDI-1711) Avro Schema Exception with Spark 3.0 in 0.7

2021-03-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308346#comment-17308346 ] sivabalan narayanan commented on HUDI-1711: --- sure > Avro Schema Exception with Spark 3.0 in 0.7

[jira] [Updated] (HUDI-1716) rt view w/ MOR tables fails after schema evolution

2021-03-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1716: -- Description: Looks like realtime view w/ MOR table fails if schema present in existing