[GitHub] [hudi] codecov-commenter edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-830002783 #

[GitHub] [hudi] nsivabalan commented on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

2021-06-08 Thread GitBox
nsivabalan commented on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-856934315 my bad. I have no idea why I complicated it so much. Fixed it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Updated] (HUDI-1248) [UMBRELLA] Tests cleanup and fixes

2021-06-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1248: -- Description: There are quite few tickets that requires some fixes to tests. Creating

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-830002783 #

[GitHub] [hudi] zhedoubushishi commented on pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-06-08 Thread GitBox
zhedoubushishi commented on pull request #2833: URL: https://github.com/apache/hudi/pull/2833#issuecomment-857031617 > @zhedoubushishi could you please review the change here that re-implements config registry, by simply fetching all static ConfigProperty members of a class and setting

[GitHub] [hudi] zhedoubushishi commented on a change in pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-06-08 Thread GitBox
zhedoubushishi commented on a change in pull request #2833: URL: https://github.com/apache/hudi/pull/2833#discussion_r647728123 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/lock/LockManager.java ## @@ -61,8 +61,8 @@ public void

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-830002783 #

[GitHub] [hudi] veenaypatil commented on pull request #3051: [HUDI-1892] Fix NPE when avro field value is null

2021-06-08 Thread GitBox
veenaypatil commented on pull request #3051: URL: https://github.com/apache/hudi/pull/3051#issuecomment-856964765 > Can you check CI failure @nsivabalan Yes, I checked this earlier but this does not seem to be related to this change. ``` [ERROR]

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3051: [HUDI-1892] Fix NPE when avro field value is null

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3051: URL: https://github.com/apache/hudi/pull/3051#issuecomment-856747473 #

[jira] [Updated] (HUDI-1932) Hive Sync should not always update last_commit_time_sync

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1932: - Labels: AWS pull-request-available (was: AWS) > Hive Sync should not always update

[jira] [Created] (HUDI-1989) Flaky test : TestHoodieMergeOnReadTable.testCOWToMORConvertedTableRollbackUsingMarkers

2021-06-08 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-1989: - Summary: Flaky test : TestHoodieMergeOnReadTable.testCOWToMORConvertedTableRollbackUsingMarkers Key: HUDI-1989 URL: https://issues.apache.org/jira/browse/HUDI-1989

[jira] [Updated] (HUDI-1989) Flaky test : TestHoodieMergeOnReadTable.testCOWToMORConvertedTableRollbackUsingMarkers

2021-06-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1989: -- Issue Type: Bug (was: Task) > Flaky test : >

[GitHub] [hudi] nateradtke opened a new pull request #3053: [HUDI-1932] Update Hive sync timestamp when change detected

2021-06-08 Thread GitBox
nateradtke opened a new pull request #3053: URL: https://github.com/apache/hudi/pull/3053 ## What is the purpose of the pull request Addressing [HUDI-1932](https://issues.apache.org/jira/browse/HUDI-1932); only update the last commit timestamp on the Hive table when the table schema

[hudi] branch master updated (75d663f -> 11360f7)

2021-06-08 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 75d663f [HUDI-1980] Optimize the code to prevent other exceptions from causing resources not to be closed (#3038)

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3053: [HUDI-1932] Update Hive sync timestamp when change detected

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3053: URL: https://github.com/apache/hudi/pull/3053#issuecomment-857205888 #

[jira] [Created] (HUDI-1990) Delete duplicate BootstrapFunction

2021-06-08 Thread yuzhaojing (Jira)
yuzhaojing created HUDI-1990: Summary: Delete duplicate BootstrapFunction Key: HUDI-1990 URL: https://issues.apache.org/jira/browse/HUDI-1990 Project: Apache Hudi Issue Type: Bug

[GitHub] [hudi] yuzhaojing edited a comment on pull request #3052: [HUDI-1990] Delete duplicate BootstrapFunction

2021-06-08 Thread GitBox
yuzhaojing edited a comment on pull request #3052: URL: https://github.com/apache/hudi/pull/3052#issuecomment-857332442 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[jira] [Updated] (HUDI-1990) Delete duplicate BootstrapFunction

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1990: - Labels: pull-request-available (was: ) > Delete duplicate BootstrapFunction >

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #2999: URL: https://github.com/apache/hudi/pull/2999#issuecomment-849318661 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3052: [HUDI-1990] Delete duplicate BootstrapFunction

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3052: URL: https://github.com/apache/hudi/pull/3052#issuecomment-856817842 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2925: [HUDI-1879] Fix RO Tables Returning Snapshot Result

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #2925: URL: https://github.com/apache/hudi/pull/2925#issuecomment-835164772 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3046: [HUDI-1984] Support independent flink hudi compaction function

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3046: URL: https://github.com/apache/hudi/pull/3046#issuecomment-855935024 #

[GitHub] [hudi] yuzhaojing commented on pull request #3052: [HUDI-1990] Delete duplicate BootstrapFunction

2021-06-08 Thread GitBox
yuzhaojing commented on pull request #3052: URL: https://github.com/apache/hudi/pull/3052#issuecomment-857353165 > I have added some cosmetic fix, please also fix it. Thanks for cosmetic fix, already fix in this pr. -- This is an automated message from the Apache Git Service. To

[jira] [Resolved] (HUDI-1929) Support configure KeyGenerator by type

2021-06-08 Thread Xianghu Wang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang resolved HUDI-1929. Fix Version/s: 0.9.0 Resolution: Resolved Resolved vai master : 

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2925: [HUDI-1879] Fix RO Tables Returning Snapshot Result

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #2925: URL: https://github.com/apache/hudi/pull/2925#issuecomment-835164772 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] vaibhav-sinha commented on a change in pull request #2923: [HUDI-1864] Added support for Date, Timestamp, LocalDate and LocalDateTime in TimestampBasedAvroKeyGenerator

2021-06-08 Thread GitBox
vaibhav-sinha commented on a change in pull request #2923: URL: https://github.com/apache/hudi/pull/2923#discussion_r647963726 ## File path: hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java ## @@ -485,6 +488,10 @@ private static Object

[GitHub] [hudi] nsivabalan opened a new pull request #3055: [HUDI-1991] Fixing drop dups exception in bulk insert row writer path

2021-06-08 Thread GitBox
nsivabalan opened a new pull request #3055: URL: https://github.com/apache/hudi/pull/3055 ## What is the purpose of the pull request - Fixing drop dups exception in bulk insert row writer path ## Brief change log - Fixing drop dups exception in bulk insert row writer

[jira] [Updated] (HUDI-1991) Fix drop dups flow for bulk insert in row writer path

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1991: - Labels: pull-request-available (was: ) > Fix drop dups flow for bulk insert in row writer path >

[jira] [Assigned] (HUDI-1991) Fix drop dups flow for bulk insert in row writer path

2021-06-08 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-1991: - Assignee: sivabalan narayanan > Fix drop dups flow for bulk insert in row writer

[jira] [Created] (HUDI-1991) Fix drop dups flow for bulk insert in row writer path

2021-06-08 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-1991: - Summary: Fix drop dups flow for bulk insert in row writer path Key: HUDI-1991 URL: https://issues.apache.org/jira/browse/HUDI-1991 Project: Apache Hudi

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3047: [HUDI-1986] Skip creating marker files for flink merge handle

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3047: URL: https://github.com/apache/hudi/pull/3047#issuecomment-856400331 #

[GitHub] [hudi] danny0405 commented on a change in pull request #3046: [HUDI-1984] Support independent flink hudi compaction function

2021-06-08 Thread GitBox
danny0405 commented on a change in pull request #3046: URL: https://github.com/apache/hudi/pull/3046#discussion_r647922855 ## File path: hudi-flink/src/test/java/org/apache/hudi/sink/StreamWriteITCase.java ## @@ -137,6 +159,101 @@ public void testWriteToHoodie() throws

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3052: Delete duplicate BootstrapFunction

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3052: URL: https://github.com/apache/hudi/pull/3052#issuecomment-856817842 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2925: [HUDI-1879] Fix RO Tables Returning Snapshot Result

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #2925: URL: https://github.com/apache/hudi/pull/2925#issuecomment-835164772 #

[GitHub] [hudi] codecov-commenter commented on pull request #3053: [HUDI-1932] Update Hive sync timestamp when change detected

2021-06-08 Thread GitBox
codecov-commenter commented on pull request #3053: URL: https://github.com/apache/hudi/pull/3053#issuecomment-857205888 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3053?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] jintaoguan edited a comment on pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-08 Thread GitBox
jintaoguan edited a comment on pull request #2999: URL: https://github.com/apache/hudi/pull/2999#issuecomment-857228051 @leesf I have added one more unit test that reads the ORC file with all 5 different evolved schema. -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] jintaoguan commented on pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-08 Thread GitBox
jintaoguan commented on pull request #2999: URL: https://github.com/apache/hudi/pull/2999#issuecomment-857228051 @leesf I have added one more unit test that reads the orc file with all 5 different evolved schema. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #2999: URL: https://github.com/apache/hudi/pull/2999#issuecomment-849318661 #

[GitHub] [hudi] Vikas-kum opened a new issue #3054: [QUESTION] Point query at hudi tables

2021-06-08 Thread GitBox
Vikas-kum opened a new issue #3054: URL: https://github.com/apache/hudi/issues/3054 Does Hudi supports point in time queries. I want to know if I can query the value of specific row from table at certain time instant. For example: select * from ABC where key='p1' and

[GitHub] [hudi] nsivabalan merged pull request #3051: [HUDI-1892] Fix NPE when avro field value is null

2021-06-08 Thread GitBox
nsivabalan merged pull request #3051: URL: https://github.com/apache/hudi/pull/3051 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #2999: URL: https://github.com/apache/hudi/pull/2999#issuecomment-849318661 #

[GitHub] [hudi] danny0405 closed pull request #3047: [HUDI-1986] Skip creating marker files for flink merge handle

2021-06-08 Thread GitBox
danny0405 closed pull request #3047: URL: https://github.com/apache/hudi/pull/3047 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3047: [HUDI-1986] Skip creating marker files for flink merge handle

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3047: URL: https://github.com/apache/hudi/pull/3047#issuecomment-856400331 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3047: [HUDI-1986] Skip creating marker files for flink merge handle

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3047: URL: https://github.com/apache/hudi/pull/3047#issuecomment-856400331 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3047: [HUDI-1986] Skip creating marker files for flink merge handle

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3047: URL: https://github.com/apache/hudi/pull/3047#issuecomment-856400331 #

[GitHub] [hudi] danny0405 commented on a change in pull request #3046: [HUDI-1984] Support independent flink hudi compaction function

2021-06-08 Thread GitBox
danny0405 commented on a change in pull request #3046: URL: https://github.com/apache/hudi/pull/3046#discussion_r647921902 ## File path: hudi-flink/src/main/java/org/apache/hudi/util/CompactionUtil.java ## @@ -0,0 +1,95 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [hudi] danny0405 commented on a change in pull request #3046: [HUDI-1984] Support independent flink hudi compaction function

2021-06-08 Thread GitBox
danny0405 commented on a change in pull request #3046: URL: https://github.com/apache/hudi/pull/3046#discussion_r647922129 ## File path: hudi-flink/src/main/java/org/apache/hudi/util/StreamerUtil.java ## @@ -218,7 +218,7 @@ public static HoodieWriteConfig

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3052: [HUDI-1990] Delete duplicate BootstrapFunction

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3052: URL: https://github.com/apache/hudi/pull/3052#issuecomment-856817842 #

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-06-08 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359760#comment-17359760 ] Nishith Agarwal commented on HUDI-1138: --- Okay, thanks for sharing this info.  > Re-implement marker

[GitHub] [hudi] nsivabalan commented on pull request #3051: [HUDI-1892] Fix NPE when avro field value is null

2021-06-08 Thread GitBox
nsivabalan commented on pull request #3051: URL: https://github.com/apache/hudi/pull/3051#issuecomment-857211470 I have filed a tracking ticket on this flaky test. https://issues.apache.org/jira/browse/HUDI-1989 thanks. -- This is an automated message from the Apache Git Service.

[GitHub] [hudi] jintaoguan commented on a change in pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-08 Thread GitBox
jintaoguan commented on a change in pull request #2999: URL: https://github.com/apache/hudi/pull/2999#discussion_r647842633 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/AvroOrcUtils.java ## @@ -0,0 +1,798 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #2999: URL: https://github.com/apache/hudi/pull/2999#issuecomment-849318661 #

[GitHub] [hudi] codecov-commenter commented on pull request #3055: [HUDI-1991] Fixing drop dups exception in bulk insert row writer path

2021-06-08 Thread GitBox
codecov-commenter commented on pull request #3055: URL: https://github.com/apache/hudi/pull/3055#issuecomment-857384377 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3055?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] xushiyan commented on pull request #3053: [HUDI-1932] Update Hive sync timestamp when change detected

2021-06-08 Thread GitBox
xushiyan commented on pull request #3053: URL: https://github.com/apache/hudi/pull/3053#issuecomment-857220649 @nateradtke looks like there is similar implementation in `DLASyncTool`, which would be better to stay consistent with this. -- This is an automated message from the Apache Git

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3047: [HUDI-1986] Skip creating marker files for flink merge handle

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3047: URL: https://github.com/apache/hudi/pull/3047#issuecomment-856400331 #

[GitHub] [hudi] yuzhaojing commented on pull request #3052: Delete duplicate BootstrapFunction

2021-06-08 Thread GitBox
yuzhaojing commented on pull request #3052: URL: https://github.com/apache/hudi/pull/3052#issuecomment-857332442 > +1, can we log an issue and bing the PR with it. > +1, can we log an issue and bing the PR with it. ok -- This is an automated message from the Apache

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3046: [HUDI-1984] Support independent flink hudi compaction function

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3046: URL: https://github.com/apache/hudi/pull/3046#issuecomment-855935024 #

[GitHub] [hudi] danny0405 commented on pull request #3052: [HUDI-1990] Delete duplicate BootstrapFunction

2021-06-08 Thread GitBox
danny0405 commented on pull request #3052: URL: https://github.com/apache/hudi/pull/3052#issuecomment-857343799 I have added some cosmetic fix, please also fix it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3046: [HUDI-1984] Support independent flink hudi compaction function

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3046: URL: https://github.com/apache/hudi/pull/3046#issuecomment-855935024 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3052: [HUDI-1990] Delete duplicate BootstrapFunction

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3052: URL: https://github.com/apache/hudi/pull/3052#issuecomment-856817842 #

[GitHub] [hudi] vinothchandar commented on pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-06-08 Thread GitBox
vinothchandar commented on pull request #2645: URL: https://github.com/apache/hudi/pull/2645#issuecomment-856486009 @pengzhiwei2018 Thanks for this champion effort! and tons of patience! We are really lucky to work with contributors like yourself! Look forward to taking this across the

[GitHub] [hudi] vinothchandar commented on a change in pull request #2915: [HUDI-251] Adds JDBC source support for DeltaStreamer

2021-06-08 Thread GitBox
vinothchandar commented on a change in pull request #2915: URL: https://github.com/apache/hudi/pull/2915#discussion_r647135255 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/JdbcSource.java ## @@ -0,0 +1,326 @@ +/* + * Licensed to the Apache

[hudi] branch master updated (cf83f10 -> f760ec5)

2021-06-08 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from cf83f10 add BootstrapFunction to support index bootstrap (#3024) add f760ec5 [HUDI-1659] Basic Implement Of

[GitHub] [hudi] vinothchandar merged pull request #2645: [HUDI-1659] Basic Implementation Of Spark Sql Support

2021-06-08 Thread GitBox
vinothchandar merged pull request #2645: URL: https://github.com/apache/hudi/pull/2645 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Created] (HUDI-1987) Fix non partition table hive meta sync for flink writer

2021-06-08 Thread Danny Chen (Jira)
Danny Chen created HUDI-1987: Summary: Fix non partition table hive meta sync for flink writer Key: HUDI-1987 URL: https://issues.apache.org/jira/browse/HUDI-1987 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-1987) Fix non partition table hive meta sync for flink writer

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1987: - Labels: pull-request-available (was: ) > Fix non partition table hive meta sync for flink writer

[GitHub] [hudi] danny0405 opened a new pull request #3049: [HUDI-1987] Fix non partition table hive meta sync for flink writer

2021-06-08 Thread GitBox
danny0405 opened a new pull request #3049: URL: https://github.com/apache/hudi/pull/3049 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[GitHub] [hudi] danny0405 commented on pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

2021-06-08 Thread GitBox
danny0405 commented on pull request #3024: URL: https://github.com/apache/hudi/pull/3024#issuecomment-856594064 Thanks for the merge @wangxianghu ~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Commented] (HUDI-1676) Support SQL with spark3

2021-06-08 Thread pengzhiwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359092#comment-17359092 ] pengzhiwei commented on HUDI-1676: -- Currently, we have already support spark 3.0 in HUDI-1659 > Support

[GitHub] [hudi] jintaoguan commented on a change in pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-08 Thread GitBox
jintaoguan commented on a change in pull request #2999: URL: https://github.com/apache/hudi/pull/2999#discussion_r647202110 ## File path: hudi-common/src/test/java/org/apache/hudi/io/storage/TestHoodieOrcReader.java ## @@ -0,0 +1,159 @@ +/* + * Licensed to the Apache Software

[jira] [Resolved] (HUDI-1659) Basic implementation Of Spark Sql Support

2021-06-08 Thread pengzhiwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengzhiwei resolved HUDI-1659. -- Resolution: Done > Basic implementation Of Spark Sql Support >

[GitHub] [hudi] codecov-commenter commented on pull request #3049: [HUDI-1987] Fix non partition table hive meta sync for flink writer

2021-06-08 Thread GitBox
codecov-commenter commented on pull request #3049: URL: https://github.com/apache/hudi/pull/3049#issuecomment-856652206 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3049?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] swuferhong opened a new pull request #3050: [HUDI-1988] FinalizeWrite() been executed twice in AbstractHoodieWrit…

2021-06-08 Thread GitBox
swuferhong opened a new pull request #3050: URL: https://github.com/apache/hudi/pull/3050 …eClient$commitstats ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.*

[GitHub] [hudi] danny0405 commented on a change in pull request #3047: [HUDI-1986] Skip creating marker files for flink merge handle

2021-06-08 Thread GitBox
danny0405 commented on a change in pull request #3047: URL: https://github.com/apache/hudi/pull/3047#discussion_r647369453 ## File path: hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/io/FlinkMergeHandle.java ## @@ -94,6 +94,9 @@ private void

[GitHub] [hudi] swuferhong commented on a change in pull request #3046: [HUDI-1984] Support independent flink hudi compaction function

2021-06-08 Thread GitBox
swuferhong commented on a change in pull request #3046: URL: https://github.com/apache/hudi/pull/3046#discussion_r647295843 ## File path: hudi-flink/src/test/java/org/apache/hudi/sink/StreamWriteITCase.java ## @@ -137,6 +145,60 @@ public void testWriteToHoodie() throws

[GitHub] [hudi] garyli1019 commented on a change in pull request #3047: [HUDI-1986] Skip creating marker files for flink merge handle

2021-06-08 Thread GitBox
garyli1019 commented on a change in pull request #3047: URL: https://github.com/apache/hudi/pull/3047#discussion_r647307513 ## File path: hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/io/FlinkMergeHandle.java ## @@ -94,6 +94,9 @@ private void

[jira] [Updated] (HUDI-1988) FinalizeWrite() been executed twice in AbstractHoodieWriteClient$commitstats

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1988: - Labels: pull-request-available (was: ) > FinalizeWrite() been executed twice in

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3046: [HUDI-1984] Support independent flink hudi compaction function

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3046: URL: https://github.com/apache/hudi/pull/3046#issuecomment-855935024 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3049: [HUDI-1987] Fix non partition table hive meta sync for flink writer

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3049: URL: https://github.com/apache/hudi/pull/3049#issuecomment-856652206 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3046: [HUDI-1984] Support independent flink hudi compaction function

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3046: URL: https://github.com/apache/hudi/pull/3046#issuecomment-855935024 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] wangxianghu commented on pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

2021-06-08 Thread GitBox
wangxianghu commented on pull request #2993: URL: https://github.com/apache/hudi/pull/2993#issuecomment-856676625 reopen to trigger the ci -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] wangxianghu closed pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

2021-06-08 Thread GitBox
wangxianghu closed pull request #2993: URL: https://github.com/apache/hudi/pull/2993 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hudi] danny0405 closed pull request #3049: [HUDI-1987] Fix non partition table hive meta sync for flink writer

2021-06-08 Thread GitBox
danny0405 closed pull request #3049: URL: https://github.com/apache/hudi/pull/3049 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] danny0405 closed pull request #3047: [HUDI-1986] Skip creating marker files for flink merge handle

2021-06-08 Thread GitBox
danny0405 closed pull request #3047: URL: https://github.com/apache/hudi/pull/3047 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3049: [HUDI-1987] Fix non partition table hive meta sync for flink writer

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3049: URL: https://github.com/apache/hudi/pull/3049#issuecomment-856652206 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3047: [HUDI-1986] Skip creating marker files for flink merge handle

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3047: URL: https://github.com/apache/hudi/pull/3047#issuecomment-856400331 #

[GitHub] [hudi] codecov-commenter commented on pull request #3050: [HUDI-1988] FinalizeWrite() been executed twice in AbstractHoodieWrit…

2021-06-08 Thread GitBox
codecov-commenter commented on pull request #3050: URL: https://github.com/apache/hudi/pull/3050#issuecomment-856664630 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3050?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3047: [HUDI-1986] Skip creating marker files for flink merge handle

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3047: URL: https://github.com/apache/hudi/pull/3047#issuecomment-856400331 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3050: [HUDI-1988] FinalizeWrite() been executed twice in AbstractHoodieWrit…

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3050: URL: https://github.com/apache/hudi/pull/3050#issuecomment-856664630 #

[GitHub] [hudi] wangxianghu commented on pull request #2963: [HUDI-1904] Introduce SchemaProviderInterface to make SchemaProvider unified

2021-06-08 Thread GitBox
wangxianghu commented on pull request #2963: URL: https://github.com/apache/hudi/pull/2963#issuecomment-856678097 @nsivabalan I have re-implement this by Introducing an interface, please take a look when free -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Created] (HUDI-1988) FinalizeWrite() been executed twice in AbstractHoodieWriteClient$commitstats

2021-06-08 Thread Zheng yunhong (Jira)
Zheng yunhong created HUDI-1988: --- Summary: FinalizeWrite() been executed twice in AbstractHoodieWriteClient$commitstats Key: HUDI-1988 URL: https://issues.apache.org/jira/browse/HUDI-1988 Project:

[GitHub] [hudi] danny0405 commented on a change in pull request #3046: [HUDI-1984] Support independent flink hudi compaction function

2021-06-08 Thread GitBox
danny0405 commented on a change in pull request #3046: URL: https://github.com/apache/hudi/pull/3046#discussion_r647299632 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/compact/CompactFunction.java ## @@ -78,21 +89,30 @@ public void

[jira] [Assigned] (HUDI-1676) Support SQL with spark3

2021-06-08 Thread tao meng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tao meng reassigned HUDI-1676: -- Assignee: tao meng > Support SQL with spark3 > --- > > Key:

[jira] [Commented] (HUDI-1676) Support SQL with spark3

2021-06-08 Thread tao meng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359310#comment-17359310 ] tao meng commented on HUDI-1676: [~pzw2018] great works  > Support SQL with spark3 >

[jira] [Closed] (HUDI-1676) Support SQL with spark3

2021-06-08 Thread tao meng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tao meng closed HUDI-1676. -- Resolution: Fixed > Support SQL with spark3 > --- > > Key: HUDI-1676 >

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3049: [HUDI-1987] Fix non partition table hive meta sync for flink writer

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3049: URL: https://github.com/apache/hudi/pull/3049#issuecomment-856652206 #

[jira] [Assigned] (HUDI-1892) NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at hudi 0.9.0

2021-06-08 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1892: --- Assignee: Vinay > NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at > hudi 0.9.0

[jira] [Updated] (HUDI-1892) NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at hudi 0.9.0

2021-06-08 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1892: Status: In Progress (was: Open) > NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at >

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3049: [HUDI-1987] Fix non partition table hive meta sync for flink writer

2021-06-08 Thread GitBox
codecov-commenter edited a comment on pull request #3049: URL: https://github.com/apache/hudi/pull/3049#issuecomment-856652206 #

[GitHub] [hudi] nsivabalan commented on pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

2021-06-08 Thread GitBox
nsivabalan commented on pull request #2993: URL: https://github.com/apache/hudi/pull/2993#issuecomment-856765758 Thanks for the contribution :) Will land this in. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

  1   2   >