[GitHub] [hudi] danny0405 commented on a change in pull request #3348: [HUDI-2229] refact hoodie stream creator

2021-07-26 Thread GitBox
danny0405 commented on a change in pull request #3348: URL: https://github.com/apache/hudi/pull/3348#discussion_r677171295 ## File path: hudi-flink/src/main/java/org/apache/hudi/streamer/HoodieFlinkStreamer.java ## @@ -111,53 +101,7 @@ public static void main(String[] args) th

[jira] [Commented] (HUDI-2219) Fix NPE of HoodieConfig

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387823#comment-17387823 ] ASF GitHub Bot commented on HUDI-2219: -- zhedoubushishi commented on pull request #334

[GitHub] [hudi] zhedoubushishi commented on pull request #3342: [HUDI-2219] Fix NPE of HoodieConfig

2021-07-26 Thread GitBox
zhedoubushishi commented on pull request #3342: URL: https://github.com/apache/hudi/pull/3342#issuecomment-887261539 I see. LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[jira] [Commented] (HUDI-2228) Add option 'hive_sync.mode' for flink writer

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387817#comment-17387817 ] ASF GitHub Bot commented on HUDI-2228: -- hudi-bot edited a comment on pull request #33

[jira] [Commented] (HUDI-2215) Add rateLimiter when Flink writes to hudi

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387816#comment-17387816 ] ASF GitHub Bot commented on HUDI-2215: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3352: [HUDI-2228] Add option 'hive_sync.mode' for flink writer

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3352: URL: https://github.com/apache/hudi/pull/3352#issuecomment-887234262 ## CI report: * 5db6e107c2f39b1374020f7298b75b856d71c180 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot edited a comment on pull request #3338: [HUDI-2215] Add rateLimiter when Flink writes to hudi.

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3338: URL: https://github.com/apache/hudi/pull/3338#issuecomment-88662 ## CI report: * dc68cdb096dc501fc28f5ee8e9d5b35feb270b5f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] codope commented on issue #3349: [SUPPORT] request to add an example of flink in hudi-examples module with java

2021-07-26 Thread GitBox
codope commented on issue #3349: URL: https://github.com/apache/hudi/issues/3349#issuecomment-887256855 @danny0405 Please move/create a JIRA under this ubrella ticket https://issues.apache.org/jira/browse/HUDI-2224. Feel free to add more sub-tasks here. -- This is an automated message f

[jira] [Updated] (HUDI-2229) refact hoodie stream creator in flink

2021-07-26 Thread wu xingbo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wu xingbo updated HUDI-2229: Status: In Progress (was: Open) > refact hoodie stream creator in flink > -

[jira] [Commented] (HUDI-2228) Add option 'hive_sync.mode' for flink writer

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387815#comment-17387815 ] ASF GitHub Bot commented on HUDI-2228: -- hudi-bot edited a comment on pull request #33

[jira] [Updated] (HUDI-2228) Add option 'hive_sync.mode' for flink writer

2021-07-26 Thread Zheng yunhong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng yunhong updated HUDI-2228: Summary: Add option 'hive_sync.mode' for flink writer (was: Support FlinkOptions setting hive sync

[GitHub] [hudi] hudi-bot edited a comment on pull request #3352: [HUDI-2228] Add option 'hive_sync.mode' for flink writer

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3352: URL: https://github.com/apache/hudi/pull/3352#issuecomment-887234262 ## CI report: * 5db6e107c2f39b1374020f7298b75b856d71c180 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Updated] (HUDI-2228) Add option 'hive_sync.mode' for flink writer

2021-07-26 Thread Zheng yunhong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng yunhong updated HUDI-2228: Description: [Add option 'hive_sync.mode' for flink writer|https://github.com/apache/hudi/pull/3352/

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387813#comment-17387813 ] ASF GitHub Bot commented on HUDI-2101: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571 ## CI report: * 267d3889eef4da36a7e29986ac97d7ee0b16781a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2208) Support Bulk Insert For Spark Sql

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387812#comment-17387812 ] ASF GitHub Bot commented on HUDI-2208: -- hudi-bot edited a comment on pull request #33

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387811#comment-17387811 ] ASF GitHub Bot commented on HUDI-2101: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3328: URL: https://github.com/apache/hudi/pull/3328#issuecomment-884869427 ## CI report: * 9c9f804618dd0275abdae10673c21bf1f5737caf UNKNOWN * 50539ec543951e7a4442798ac7c66e5dc3d3705a UNKNOWN * f8b449c31ee8601542f00e3cc15fbcab77da778

[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571 ## CI report: * 267d3889eef4da36a7e29986ac97d7ee0b16781a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] danny0405 commented on pull request #3352: [HUDI-2228] Support FlinkOptions setting hive sync mode

2021-07-26 Thread GitBox
danny0405 commented on pull request #3352: URL: https://github.com/apache/hudi/pull/3352#issuecomment-887247679 Change the title and commit message to "[HUDI-2228] Add option 'hive_sync.mode' for flink writer", also add a config option for `FlinkStreamerConfig`. -- This is an automated

[jira] [Created] (HUDI-2229) refact hoodie stream creator in flink

2021-07-26 Thread wu xingbo (Jira)
wu xingbo created HUDI-2229: --- Summary: refact hoodie stream creator in flink Key: HUDI-2229 URL: https://issues.apache.org/jira/browse/HUDI-2229 Project: Apache Hudi Issue Type: Improvement

[jira] [Commented] (HUDI-2228) Support FlinkOptions setting hive sync mode

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387806#comment-17387806 ] ASF GitHub Bot commented on HUDI-2228: -- danny0405 commented on pull request #3352: UR

[jira] [Commented] (HUDI-2208) Support Bulk Insert For Spark Sql

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387805#comment-17387805 ] ASF GitHub Bot commented on HUDI-2208: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3328: URL: https://github.com/apache/hudi/pull/3328#issuecomment-884869427 ## CI report: * 9c9f804618dd0275abdae10673c21bf1f5737caf UNKNOWN * 50539ec543951e7a4442798ac7c66e5dc3d3705a UNKNOWN * f8b449c31ee8601542f00e3cc15fbcab77da778

[jira] [Commented] (HUDI-2223) Fix Alter Partitioned Table Failed

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387801#comment-17387801 ] ASF GitHub Bot commented on HUDI-2223: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3350: [HUDI-2223] Fix Alter Partitioned Table Failed

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3350: URL: https://github.com/apache/hudi/pull/3350#issuecomment-887174998 ## CI report: * 98821e981b9f9879c7de44d9b458386474d22600 UNKNOWN * 11773f89d84b0359bf1d2a8fe6802d6aaaf5fa65 Azure: [FAILURE](https://dev.azure.com/apache-hudi-

[jira] [Commented] (HUDI-2191) Bump flink version to 1.13.1

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387800#comment-17387800 ] ASF GitHub Bot commented on HUDI-2191: -- garyli1019 commented on pull request #3291: U

[GitHub] [hudi] garyli1019 commented on pull request #3291: [HUDI-2191] Bump flink version to 1.13.1

2021-07-26 Thread GitBox
garyli1019 commented on pull request #3291: URL: https://github.com/apache/hudi/pull/3291#issuecomment-887241780 > @garyli1019 something are not work well, like pulsar sql connector > > https://search.maven.org/artifact/io.streamnative.connectors/pulsar-flink-sql-connector_2.11

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387798#comment-17387798 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #32

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN * e689b18e9261a07f6eeaf109a11237e89a218d5

[jira] [Commented] (HUDI-2228) Support FlinkOptions setting hive sync mode

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387796#comment-17387796 ] ASF GitHub Bot commented on HUDI-2228: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3352: [HUDI-2228] Support FlinkOptions setting hive sync mode

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3352: URL: https://github.com/apache/hudi/pull/3352#issuecomment-887234262 ## CI report: * 5db6e107c2f39b1374020f7298b75b856d71c180 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2228) Support FlinkOptions setting hive sync mode

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387795#comment-17387795 ] ASF GitHub Bot commented on HUDI-2228: -- hudi-bot commented on pull request #3352: URL

[GitHub] [hudi] hudi-bot commented on pull request #3352: [HUDI-2228] Support FlinkOptions setting hive sync mode

2021-07-26 Thread GitBox
hudi-bot commented on pull request #3352: URL: https://github.com/apache/hudi/pull/3352#issuecomment-887234262 ## CI report: * 5db6e107c2f39b1374020f7298b75b856d71c180 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] vinothchandar merged pull request #3322: [BLOG] Apache Hudi is the Streaming Data Lake Platform

2021-07-26 Thread GitBox
vinothchandar merged pull request #3322: URL: https://github.com/apache/hudi/pull/3322 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-uns

[hudi] branch asf-site updated: [BLOG] Apache Hudi is the Streaming Data Lake Platform (#3322)

2021-07-26 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 2c71f98 [BLOG] Apache Hudi is the Streaming D

[GitHub] [hudi] vinothchandar commented on a change in pull request #3322: [BLOG] Apache Hudi is the Streaming Data Lake Platform

2021-07-26 Thread GitBox
vinothchandar commented on a change in pull request #3322: URL: https://github.com/apache/hudi/pull/3322#discussion_r674434993 ## File path: docs/_posts/2021-07-21-streaming-data-lake-platform.md ## @@ -0,0 +1,143 @@ +--- +title: "Apache Hudi - The Streaming Data Lake Platform"

[jira] [Updated] (HUDI-2228) Support FlinkOptions setting hive sync mode

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2228: - Labels: pull-request-available (was: ) > Support FlinkOptions setting hive sync mode > --

[jira] [Commented] (HUDI-2228) Support FlinkOptions setting hive sync mode

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387793#comment-17387793 ] ASF GitHub Bot commented on HUDI-2228: -- swuferhong opened a new pull request #3352: U

[GitHub] [hudi] swuferhong opened a new pull request #3352: [HUDI-2228] Support FlinkOptions setting hive sync mode

2021-07-26 Thread GitBox
swuferhong opened a new pull request #3352: URL: https://github.com/apache/hudi/pull/3352 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[jira] [Commented] (HUDI-2189) Delete partition support in HoodieDeltaStreamer

2021-07-26 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387791#comment-17387791 ] Sagar Sumit commented on HUDI-2189: --- [~samrat007]  # Delete partition operation deletes

[jira] [Created] (HUDI-2228) Support FlinkOptions setting hive sync mode

2021-07-26 Thread Zheng yunhong (Jira)
Zheng yunhong created HUDI-2228: --- Summary: Support FlinkOptions setting hive sync mode Key: HUDI-2228 URL: https://issues.apache.org/jira/browse/HUDI-2228 Project: Apache Hudi Issue Type: Impro

[jira] [Commented] (HUDI-2227) Only sync hive meta on successful commit for flink batch writer

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387789#comment-17387789 ] ASF GitHub Bot commented on HUDI-2227: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3351: [HUDI-2227] Only sync hive meta on successful commit for flink batch …

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3351: URL: https://github.com/apache/hudi/pull/3351#issuecomment-887227670 ## CI report: * d897f612ef302e6c6d74bafc64c17328f45c9214 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2217) Fix no value present in incremental query on MOR

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387787#comment-17387787 ] ASF GitHub Bot commented on HUDI-2217: -- pengzhiwei2018 commented on pull request #334

[GitHub] [hudi] pengzhiwei2018 commented on pull request #3340: [HUDI-2217] Fix no value present in incremental query on MOR

2021-07-26 Thread GitBox
pengzhiwei2018 commented on pull request #3340: URL: https://github.com/apache/hudi/pull/3340#issuecomment-887227961 LGTM +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (HUDI-2227) Only sync hive meta on successful commit for flink batch writer

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387786#comment-17387786 ] ASF GitHub Bot commented on HUDI-2227: -- hudi-bot commented on pull request #3351: URL

[GitHub] [hudi] hudi-bot commented on pull request #3351: [HUDI-2227] Only sync hive meta on successful commit for flink batch …

2021-07-26 Thread GitBox
hudi-bot commented on pull request #3351: URL: https://github.com/apache/hudi/pull/3351#issuecomment-887227670 ## CI report: * d897f612ef302e6c6d74bafc64c17328f45c9214 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Commented] (HUDI-2208) Support Bulk Insert For Spark Sql

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387785#comment-17387785 ] ASF GitHub Bot commented on HUDI-2208: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3328: URL: https://github.com/apache/hudi/pull/3328#issuecomment-884869427 ## CI report: * 9c9f804618dd0275abdae10673c21bf1f5737caf UNKNOWN * 50539ec543951e7a4442798ac7c66e5dc3d3705a UNKNOWN * f8b449c31ee8601542f00e3cc15fbcab77da778

[jira] [Commented] (HUDI-2227) Only sync hive meta on successful commit for flink batch writer

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387784#comment-17387784 ] ASF GitHub Bot commented on HUDI-2227: -- danny0405 opened a new pull request #3351: UR

[jira] [Updated] (HUDI-2227) Only sync hive meta on successful commit for flink batch writer

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2227: - Labels: pull-request-available (was: ) > Only sync hive meta on successful commit for flink batch

[GitHub] [hudi] danny0405 opened a new pull request #3351: [HUDI-2227] Only sync hive meta on successful commit for flink batch …

2021-07-26 Thread GitBox
danny0405 opened a new pull request #3351: URL: https://github.com/apache/hudi/pull/3351 …writer ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the p

[jira] [Created] (HUDI-2227) Only sync hive meta on successful commit for flink batch writer

2021-07-26 Thread Danny Chen (Jira)
Danny Chen created HUDI-2227: Summary: Only sync hive meta on successful commit for flink batch writer Key: HUDI-2227 URL: https://issues.apache.org/jira/browse/HUDI-2227 Project: Apache Hudi Is

[jira] [Commented] (HUDI-2215) Add rateLimiter when Flink writes to hudi

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387782#comment-17387782 ] ASF GitHub Bot commented on HUDI-2215: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3338: [HUDI-2215] Add rateLimiter when Flink writes to hudi.

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3338: URL: https://github.com/apache/hudi/pull/3338#issuecomment-88662 ## CI report: * ef008a1f7cdc2ab3e9aa9b6241a1ebab17ee9ba8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2215) Add rateLimiter when Flink writes to hudi

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387781#comment-17387781 ] ASF GitHub Bot commented on HUDI-2215: -- hudi-bot edited a comment on pull request #33

[jira] [Commented] (HUDI-2208) Support Bulk Insert For Spark Sql

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387780#comment-17387780 ] ASF GitHub Bot commented on HUDI-2208: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3338: [HUDI-2215] Add rateLimiter when Flink writes to hudi.

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3338: URL: https://github.com/apache/hudi/pull/3338#issuecomment-88662 ## CI report: * ef008a1f7cdc2ab3e9aa9b6241a1ebab17ee9ba8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] hudi-bot edited a comment on pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3328: URL: https://github.com/apache/hudi/pull/3328#issuecomment-884869427 ## CI report: * 9c9f804618dd0275abdae10673c21bf1f5737caf UNKNOWN * 50539ec543951e7a4442798ac7c66e5dc3d3705a UNKNOWN * f8b449c31ee8601542f00e3cc15fbcab77da778

[jira] [Commented] (HUDI-2223) Fix Alter Partitioned Table Failed

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387776#comment-17387776 ] ASF GitHub Bot commented on HUDI-2223: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3350: [HUDI-2223] Fix Alter Partitioned Table Failed

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3350: URL: https://github.com/apache/hudi/pull/3350#issuecomment-887174998 ## CI report: * 98821e981b9f9879c7de44d9b458386474d22600 UNKNOWN * 00b92c9aa62365cf9b49bafb038724b0e75ffb3b Azure: [CANCELED](https://dev.azure.com/apache-hudi

[jira] [Commented] (HUDI-2223) Fix Alter Partitioned Table Failed

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387774#comment-17387774 ] ASF GitHub Bot commented on HUDI-2223: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3350: [HUDI-2223] Fix Alter Partitioned Table Failed

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3350: URL: https://github.com/apache/hudi/pull/3350#issuecomment-887174998 ## CI report: * 98821e981b9f9879c7de44d9b458386474d22600 UNKNOWN * 00b92c9aa62365cf9b49bafb038724b0e75ffb3b Azure: [CANCELED](https://dev.azure.com/apache-hudi

[jira] [Commented] (HUDI-2223) Fix Alter Partitioned Table Failed

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387773#comment-17387773 ] ASF GitHub Bot commented on HUDI-2223: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3350: [HUDI-2223] Fix Alter Partitioned Table Failed

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3350: URL: https://github.com/apache/hudi/pull/3350#issuecomment-887174998 ## CI report: * 94bc5ca7a0a95acf9b90fd13bfdf4127794a05b4 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[jira] [Commented] (HUDI-2225) Add compaction example

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387771#comment-17387771 ] ASF GitHub Bot commented on HUDI-2225: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3347: [HUDI-2225] Add a compaction job in hudi-examples

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3347: URL: https://github.com/apache/hudi/pull/3347#issuecomment-886770307 ## CI report: * 344f6ce74d64cb939c507857c3db10b6b9b56dd4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387768#comment-17387768 ] ASF GitHub Bot commented on HUDI-1138: -- yihua commented on a change in pull request #

[GitHub] [hudi] yihua commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-26 Thread GitBox
yihua commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r677119308 ## File path: hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/handlers/MarkerHandler.java ## @@ -0,0 +1,484 @@ +/* + * Licensed to the Ap

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387767#comment-17387767 ] ASF GitHub Bot commented on HUDI-1138: -- yihua commented on a change in pull request #

[GitHub] [hudi] yihua commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-26 Thread GitBox
yihua commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r677110738 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java ## @@ -228,6 +229,30 @@ + "files from lake

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387764#comment-17387764 ] ASF GitHub Bot commented on HUDI-2101: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571 ## CI report: * 267d3889eef4da36a7e29986ac97d7ee0b16781a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-1371) Support file listing using metadata for Spark DataSource and Spark SQL queries

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387763#comment-17387763 ] ASF GitHub Bot commented on HUDI-1371: -- hudi-bot edited a comment on pull request #28

[GitHub] [hudi] hudi-bot edited a comment on pull request #2893: [HUDI-1371] [HUDI-1893] Support metadata based listing for Spark DataSource and Spark SQL

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #2893: URL: https://github.com/apache/hudi/pull/2893#issuecomment-863021428 ## CI report: * 2b77fa8ce77591a835d85660dda33e135135d33a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[GitHub] [hudi] mithalee commented on issue #3336: [SUPPORT] Delete not functioning with deltastreamer

2021-07-26 Thread GitBox
mithalee commented on issue #3336: URL: https://github.com/apache/hudi/issues/3336#issuecomment-887202873 Does the source ordering config and precombine field has to be a timestamp field? ![image](https://user-images.githubusercontent.com/64560358/127096311-937eec6b-94f5-4a96-a77b-0aac

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387762#comment-17387762 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #32

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN * 1d7f4a2f9e4fb2155e8f0383dce6c73a56f953f

[GitHub] [hudi] mithalee commented on issue #3336: [SUPPORT] Delete not functioning with deltastreamer

2021-07-26 Thread GitBox
mithalee commented on issue #3336: URL: https://github.com/apache/hudi/issues/3336#issuecomment-887201790 I changed the input data set a bit so that I can provide 3 different fields for the 3 differnt mentioned configs. ./spark-submit --master k8s://https://..sk1.us-west-1.eks.amazonaws.

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387761#comment-17387761 ] ASF GitHub Bot commented on HUDI-1138: -- yihua commented on a change in pull request #

[GitHub] [hudi] yihua commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-26 Thread GitBox
yihua commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r677110192 ## File path: hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/TimelineService.java ## @@ -52,36 +53,50 @@ private int serverPort;

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387760#comment-17387760 ] ASF GitHub Bot commented on HUDI-1138: -- yihua commented on a change in pull request #

[GitHub] [hudi] yihua commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-26 Thread GitBox
yihua commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r677107014 ## File path: hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/handlers/MarkerHandler.java ## @@ -0,0 +1,482 @@ +/* + * Licensed to the Ap

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387759#comment-17387759 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #32

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN * 1d7f4a2f9e4fb2155e8f0383dce6c73a56f953f

[jira] [Commented] (HUDI-2223) Fix Alter Partitioned Table Failed

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387757#comment-17387757 ] ASF GitHub Bot commented on HUDI-2223: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3350: [HUDI-2223] Fix Alter Partitioned Table Failed

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3350: URL: https://github.com/apache/hudi/pull/3350#issuecomment-887174998 ## CI report: * 94bc5ca7a0a95acf9b90fd13bfdf4127794a05b4 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[jira] [Commented] (HUDI-2208) Support Bulk Insert For Spark Sql

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387756#comment-17387756 ] ASF GitHub Bot commented on HUDI-2208: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3328: URL: https://github.com/apache/hudi/pull/3328#issuecomment-884869427 ## CI report: * 9c9f804618dd0275abdae10673c21bf1f5737caf UNKNOWN * 50539ec543951e7a4442798ac7c66e5dc3d3705a UNKNOWN * f8b449c31ee8601542f00e3cc15fbcab77da778

[jira] [Commented] (HUDI-2225) Add compaction example

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387752#comment-17387752 ] ASF GitHub Bot commented on HUDI-2225: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3347: [HUDI-2225] Add a compaction job in hudi-examples

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3347: URL: https://github.com/apache/hudi/pull/3347#issuecomment-886770307 ## CI report: * e46cb2465a28120f3161ea285b666cb67d4c2eb0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2225) Add compaction example

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387751#comment-17387751 ] ASF GitHub Bot commented on HUDI-2225: -- codope commented on pull request #3347: URL:

[jira] [Commented] (HUDI-2225) Add compaction example

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387750#comment-17387750 ] ASF GitHub Bot commented on HUDI-2225: -- hudi-bot edited a comment on pull request #33

[jira] [Updated] (HUDI-2225) Add compaction example

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2225: - Labels: pull-request-available (was: ) > Add compaction example > -- > >

[GitHub] [hudi] codope commented on pull request #3347: [HUDI-2225] Add a compaction job in hudi-examples

2021-07-26 Thread GitBox
codope commented on pull request #3347: URL: https://github.com/apache/hudi/pull/3347#issuecomment-887191766 > Hi @codope Thanks for your contribution. Based on the official contribution guide, this PR is not suitable for the "MINOR" category. You should file a Jira ticket then change the

[GitHub] [hudi] hudi-bot edited a comment on pull request #3347: [HUDI-2225] Add a compaction job in hudi-examples

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3347: URL: https://github.com/apache/hudi/pull/3347#issuecomment-886770307 ## CI report: * e46cb2465a28120f3161ea285b666cb67d4c2eb0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387745#comment-17387745 ] ASF GitHub Bot commented on HUDI-2101: -- hudi-bot edited a comment on pull request #33

[GitHub] [hudi] hudi-bot edited a comment on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-26 Thread GitBox
hudi-bot edited a comment on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-885350571 ## CI report: * 7aa992695a0155054e7b73cb641197dc7f677b88 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/res

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387744#comment-17387744 ] ASF GitHub Bot commented on HUDI-2101: -- hudi-bot edited a comment on pull request #33

  1   2   3   4   >