[GitHub] [hudi] hudi-bot edited a comment on pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3328: URL: https://github.com/apache/hudi/pull/3328#issuecomment-884869427 ## CI report: * 9c9f804618dd0275abdae10673c21bf1f5737caf UNKNOWN * 50539ec543951e7a4442798ac7c66e5dc3d3705a UNKNOWN *

[GitHub] [hudi] hudi-bot edited a comment on pull request #3334: [HUDI-2209] Bulk insert for flink writer

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3334: URL: https://github.com/apache/hudi/pull/3334#issuecomment-885497812 ## CI report: * d23d24f8cee6fd55de1e433f1c07b40a2e0a3391 Azure:

[jira] [Commented] (HUDI-2164) Build cluster plan and execute this plan at once for HoodieClusteringJob

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386103#comment-17386103 ] ASF GitHub Bot commented on HUDI-2164: -- hudi-bot edited a comment on pull request #3259: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3259: [HUDI-2164] Let users build cluster plan and execute this plan at once using HoodieClusteringJob for async clustering

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3259: URL: https://github.com/apache/hudi/pull/3259#issuecomment-878086249 ## CI report: * ec01ad1f162813a5fafb7d14da7b65eea64d06ea Azure:

[GitHub] [hudi] leoluan2009 commented on pull request #3333: [HUDI-2213] Remove unnecessary parameter for HoodieMetrics constructo…

2021-07-23 Thread GitBox
leoluan2009 commented on pull request #: URL: https://github.com/apache/hudi/pull/#issuecomment-885522885 @yanghua can you help to review this pr? thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (HUDI-2182) Support Compaction Command For Spark Sql

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386131#comment-17386131 ] ASF GitHub Bot commented on HUDI-2182: -- hudi-bot edited a comment on pull request #3277: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3277: [HUDI-2182] Support Compaction Command For Spark Sql

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3277: URL: https://github.com/apache/hudi/pull/3277#issuecomment-880506300 ## CI report: * ddbbd6098b0c74a85231f14a5b6909b671f406b0 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3189: [HUDI-2098] Support hdfs file lock

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3189: URL: https://github.com/apache/hudi/pull/3189#issuecomment-871217447 ## CI report: * 51ad1f1e7316e61db862dc1d2934d4d5fc54848b Azure:

[jira] [Commented] (HUDI-2214) residual temporary files after clustering are not cleaned up

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386152#comment-17386152 ] ASF GitHub Bot commented on HUDI-2214: -- hudi-bot edited a comment on pull request #3335: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3335: [HUDI-2214] fix the bug that residual temporary files after clustering are not cleaned up

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3335: URL: https://github.com/apache/hudi/pull/3335#issuecomment-885523651 ## CI report: * 9bebeaf2c723810d6c6d5df00e4d6f36b4f478e4 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3277: [HUDI-2182] Support Compaction Command For Spark Sql

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3277: URL: https://github.com/apache/hudi/pull/3277#issuecomment-880506300 ## CI report: * 0eeef02b58baa7ade8fc0196c2c16c165daafcdf Azure:

[jira] [Closed] (HUDI-2213) Remove unnecessary parameter for HoodieMetrics constructor and fix NPE in UT

2021-07-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-2213. -- Resolution: Done 71e14cf866d2ddeee7238a3f15b59912c2537943 > Remove unnecessary parameter for HoodieMetrics

[GitHub] [hudi] hudi-bot edited a comment on pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3328: URL: https://github.com/apache/hudi/pull/3328#issuecomment-884869427 ## CI report: * 9c9f804618dd0275abdae10673c21bf1f5737caf UNKNOWN * 52f852a534a7d1106ed25dcb48374e5c9947380c Azure:

[GitHub] [hudi] nsivabalan commented on pull request #3315: [HUDI-2177][HUDI-2200] Adding virtual keys support for MOR

2021-07-23 Thread GitBox
nsivabalan commented on pull request #3315: URL: https://github.com/apache/hudi/pull/3315#issuecomment-885443569 @vinothchandar : this patch is good to be reviewed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386019#comment-17386019 ] ASF GitHub Bot commented on HUDI-2101: -- pengzhiwei2018 commented on a change in pull request #3330:

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-23 Thread GitBox
xiarixiaoyao commented on a change in pull request #3330: URL: https://github.com/apache/hudi/pull/3330#discussion_r675348220 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/WriteOperationType.java ## @@ -48,6 +48,8 @@

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386020#comment-17386020 ] ASF GitHub Bot commented on HUDI-2101: -- pengzhiwei2018 commented on a change in pull request #3330:

[jira] [Commented] (HUDI-2177) Virtual keys support for Compaction

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386023#comment-17386023 ] ASF GitHub Bot commented on HUDI-2177: -- nsivabalan commented on pull request #3315: URL:

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386022#comment-17386022 ] ASF GitHub Bot commented on HUDI-2101: -- xiarixiaoyao commented on a change in pull request #3330:

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386042#comment-17386042 ] ASF GitHub Bot commented on HUDI-2101: -- xiarixiaoyao commented on a change in pull request #3330:

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-23 Thread GitBox
xiarixiaoyao commented on a change in pull request #3330: URL: https://github.com/apache/hudi/pull/3330#discussion_r675356988 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/WriteOperationType.java ## @@ -48,6 +48,8 @@

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3189: [HUDI-2098] Support hdfs file lock

2021-07-23 Thread GitBox
xiarixiaoyao commented on a change in pull request #3189: URL: https://github.com/apache/hudi/pull/3189#discussion_r675378651 ## File path: hudi-common/src/main/java/org/apache/hudi/common/lock/HdfsFileLockProvider.java ## @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache

[jira] [Commented] (HUDI-2098) add Hdfs file lock for HUDI

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386074#comment-17386074 ] ASF GitHub Bot commented on HUDI-2098: -- xiarixiaoyao commented on a change in pull request #3189:

[jira] [Commented] (HUDI-2214) residual temporary files after clustering are not cleaned up

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386121#comment-17386121 ] ASF GitHub Bot commented on HUDI-2214: -- hudi-bot commented on pull request #3335: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3328: URL: https://github.com/apache/hudi/pull/3328#issuecomment-884869427 ## CI report: * 9c9f804618dd0275abdae10673c21bf1f5737caf UNKNOWN * 50539ec543951e7a4442798ac7c66e5dc3d3705a UNKNOWN *

[jira] [Commented] (HUDI-2208) Support Bulk Insert For Spark Sql

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386147#comment-17386147 ] ASF GitHub Bot commented on HUDI-2208: -- hudi-bot edited a comment on pull request #3328: URL:

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-23 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3330: URL: https://github.com/apache/hudi/pull/3330#discussion_r675346210 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/WriteOperationType.java ## @@ -48,6 +48,8 @@

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-23 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3330: URL: https://github.com/apache/hudi/pull/3330#discussion_r675346210 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/WriteOperationType.java ## @@ -48,6 +48,8 @@

[GitHub] [hudi] pengzhiwei2018 commented on a change in pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-23 Thread GitBox
pengzhiwei2018 commented on a change in pull request #3330: URL: https://github.com/apache/hudi/pull/3330#discussion_r675352754 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/WriteOperationType.java ## @@ -48,6 +48,8 @@

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386033#comment-17386033 ] ASF GitHub Bot commented on HUDI-2101: -- pengzhiwei2018 commented on a change in pull request #3330:

[jira] [Commented] (HUDI-2212) Missing PrimaryKey In Hoodie Properties For CTAS Table

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386032#comment-17386032 ] ASF GitHub Bot commented on HUDI-2212: -- hudi-bot edited a comment on pull request #3332: URL:

[jira] [Commented] (HUDI-2177) Virtual keys support for Compaction

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386031#comment-17386031 ] ASF GitHub Bot commented on HUDI-2177: -- hudi-bot edited a comment on pull request #3315: URL:

[jira] [Commented] (HUDI-2212) Missing PrimaryKey In Hoodie Properties For CTAS Table

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386041#comment-17386041 ] ASF GitHub Bot commented on HUDI-2212: -- pengzhiwei2018 merged pull request #3332: URL:

[jira] [Commented] (HUDI-1848) Add support for HMS in Hive-sync-tool

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386075#comment-17386075 ] ASF GitHub Bot commented on HUDI-1848: -- hudi-bot edited a comment on pull request #2879: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2879: [HUDI-1848] Adding support for HMS for running DDL queries in hive-sy…

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #2879: URL: https://github.com/apache/hudi/pull/2879#issuecomment-861653620 ## CI report: * 9a0da13a40b43fff15980d721343f0ae64bad945 Azure:

[jira] [Commented] (HUDI-2213) Remove unnecessary parameter for HoodieMetrics constructor and fix NPE in UT

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386088#comment-17386088 ] ASF GitHub Bot commented on HUDI-2213: -- hudi-bot edited a comment on pull request #: URL:

[jira] [Commented] (HUDI-2209) Bulk insert for flink writer

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386094#comment-17386094 ] ASF GitHub Bot commented on HUDI-2209: -- danny0405 opened a new pull request #3334: URL:

[jira] [Updated] (HUDI-2209) Bulk insert for flink writer

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2209: - Labels: pull-request-available (was: ) > Bulk insert for flink writer >

[GitHub] [hudi] pratyakshsharma commented on pull request #3003: [HUDI-1939] Replace joda-time api with java8 new time api

2021-07-23 Thread GitBox
pratyakshsharma commented on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-885496934 will circle back on this today. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (HUDI-2209) Bulk insert for flink writer

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386100#comment-17386100 ] ASF GitHub Bot commented on HUDI-2209: -- hudi-bot edited a comment on pull request #3334: URL:

[jira] [Commented] (HUDI-2208) Support Bulk Insert For Spark Sql

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386099#comment-17386099 ] ASF GitHub Bot commented on HUDI-2208: -- hudi-bot edited a comment on pull request #3328: URL:

[jira] [Updated] (HUDI-2214) residual temporary files after clustering are not cleaned up

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2214: - Labels: pull-request-available (was: ) > residual temporary files after clustering are not

[GitHub] [hudi] hudi-bot edited a comment on pull request #3189: [HUDI-2098] Support hdfs file lock

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3189: URL: https://github.com/apache/hudi/pull/3189#issuecomment-871217447 ## CI report: * 9fd24bd0fe268bd631edf17853aad02be9c5ed84 Azure:

[jira] [Commented] (HUDI-2214) residual temporary files after clustering are not cleaned up

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386116#comment-17386116 ] ASF GitHub Bot commented on HUDI-2214: -- xiarixiaoyao opened a new pull request #3335: URL:

[GitHub] [hudi] xiarixiaoyao opened a new pull request #3335: [HUDI-2214] fix the bug that residual temporary files after clustering are not cleaned up

2021-07-23 Thread GitBox
xiarixiaoyao opened a new pull request #3335: URL: https://github.com/apache/hudi/pull/3335 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[GitHub] [hudi] zhangyue19921010 commented on pull request #3259: [HUDI-2164] Let users build cluster plan and execute this plan at once using HoodieClusteringJob for async clustering

2021-07-23 Thread GitBox
zhangyue19921010 commented on pull request #3259: URL: https://github.com/apache/hudi/pull/3259#issuecomment-885574686 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] hudi-bot edited a comment on pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3328: URL: https://github.com/apache/hudi/pull/3328#issuecomment-884869427 ## CI report: * 9c9f804618dd0275abdae10673c21bf1f5737caf UNKNOWN * 50539ec543951e7a4442798ac7c66e5dc3d3705a UNKNOWN *

[jira] [Commented] (HUDI-2164) Build cluster plan and execute this plan at once for HoodieClusteringJob

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386205#comment-17386205 ] ASF GitHub Bot commented on HUDI-2164: -- hudi-bot edited a comment on pull request #3259: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3259: [HUDI-2164] Let users build cluster plan and execute this plan at once using HoodieClusteringJob for async clustering

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3259: URL: https://github.com/apache/hudi/pull/3259#issuecomment-878086249 ## CI report: * ec01ad1f162813a5fafb7d14da7b65eea64d06ea Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3334: [HUDI-2209] Bulk insert for flink writer

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3334: URL: https://github.com/apache/hudi/pull/3334#issuecomment-885497812 ## CI report: * d23d24f8cee6fd55de1e433f1c07b40a2e0a3391 Azure:

[jira] [Commented] (HUDI-2209) Bulk insert for flink writer

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386235#comment-17386235 ] ASF GitHub Bot commented on HUDI-2209: -- hudi-bot edited a comment on pull request #3334: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * f1095198d43636de20b525d80341c32f84591d48 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN *

[jira] [Commented] (HUDI-2209) Bulk insert for flink writer

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386366#comment-17386366 ] ASF GitHub Bot commented on HUDI-2209: -- yuzhaojing commented on a change in pull request #3334: URL:

[GitHub] [hudi] yuzhaojing commented on a change in pull request #3334: [HUDI-2209] Bulk insert for flink writer

2021-07-23 Thread GitBox
yuzhaojing commented on a change in pull request #3334: URL: https://github.com/apache/hudi/pull/3334#discussion_r675673937 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/bulk/BulkInsertWriterHelper.java ## @@ -0,0 +1,192 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] vinothchandar commented on pull request #3285: [HUDI-1771] Propagate CDC format for hoodie

2021-07-23 Thread GitBox
vinothchandar commented on pull request #3285: URL: https://github.com/apache/hudi/pull/3285#issuecomment-885764276 @codope please help me close out the schema evolution story here. my point was: when mixing old files where _hoodie_operation is NOT present with new files where it

[jira] [Commented] (HUDI-1771) Propagate CDC format for hoodie

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386369#comment-17386369 ] ASF GitHub Bot commented on HUDI-1771: -- vinothchandar commented on pull request #3285: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3334: [HUDI-2209] Bulk insert for flink writer

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3334: URL: https://github.com/apache/hudi/pull/3334#issuecomment-885497812 ## CI report: * bec06d2304c67b544befff79bc6559520024f7b3 Azure:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386310#comment-17386310 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[jira] [Commented] (HUDI-2209) Bulk insert for flink writer

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386236#comment-17386236 ] ASF GitHub Bot commented on HUDI-2209: -- hudi-bot edited a comment on pull request #3334: URL:

[jira] [Commented] (HUDI-2209) Bulk insert for flink writer

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386264#comment-17386264 ] ASF GitHub Bot commented on HUDI-2209: -- hudi-bot edited a comment on pull request #3334: URL:

[GitHub] [hudi] FelixKJose edited a comment on issue #3323: [SUPPORT] Trouble with Point in time, Incremental queries

2021-07-23 Thread GitBox
FelixKJose edited a comment on issue #3323: URL: https://github.com/apache/hudi/issues/3323#issuecomment-885762685 @nsivabalan is this only a problem in 0.8.0 version or older version as well? Could you please provide some insights? -- This is an automated message from the Apache Git

[GitHub] [hudi] FelixKJose commented on issue #3323: [SUPPORT] Trouble with Point in time, Incremental queries

2021-07-23 Thread GitBox
FelixKJose commented on issue #3323: URL: https://github.com/apache/hudi/issues/3323#issuecomment-885762685 @nsivabalan is this only a problem in 0.8.0 version or older version as well? -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (HUDI-1848) Add support for HMS in Hive-sync-tool

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386345#comment-17386345 ] ASF GitHub Bot commented on HUDI-1848: -- satishkotha merged pull request #2879: URL:

[GitHub] [hudi] satishkotha merged pull request #2879: [HUDI-1848] Adding support for HMS for running DDL queries in hive-sy…

2021-07-23 Thread GitBox
satishkotha merged pull request #2879: URL: https://github.com/apache/hudi/pull/2879 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-2208) Support Bulk Insert For Spark Sql

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386197#comment-17386197 ] ASF GitHub Bot commented on HUDI-2208: -- hudi-bot edited a comment on pull request #3328: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3334: [HUDI-2209] Bulk insert for flink writer

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3334: URL: https://github.com/apache/hudi/pull/3334#issuecomment-885497812 ## CI report: * d23d24f8cee6fd55de1e433f1c07b40a2e0a3391 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * f1095198d43636de20b525d80341c32f84591d48 Azure:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386290#comment-17386290 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386359#comment-17386359 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[jira] [Commented] (HUDI-2209) Bulk insert for flink writer

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386599#comment-17386599 ] ASF GitHub Bot commented on HUDI-2209: -- hudi-bot edited a comment on pull request #3334: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3334: [HUDI-2209] Bulk insert for flink writer

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3334: URL: https://github.com/apache/hudi/pull/3334#issuecomment-885497812 ## CI report: * 6f7f38716d9a2c0ef10ebf2c349cdcf0e5f053de UNKNOWN * 6fecd2b043e75f3327d4a8f7348c7675682fcd70 Azure:

[jira] [Commented] (HUDI-2209) Bulk insert for flink writer

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386609#comment-17386609 ] ASF GitHub Bot commented on HUDI-2209: -- hudi-bot edited a comment on pull request #3334: URL:

[GitHub] [hudi] leesf commented on a change in pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-23 Thread GitBox
leesf commented on a change in pull request #3330: URL: https://github.com/apache/hudi/pull/3330#discussion_r675935419 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/spark/sql/hudi/UnsafeAccess.java ## @@ -0,0 +1,70 @@ +/* + * Licensed to the Apache

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386621#comment-17386621 ] ASF GitHub Bot commented on HUDI-2101: -- leesf commented on a change in pull request #3330: URL:

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386624#comment-17386624 ] ASF GitHub Bot commented on HUDI-2101: -- leesf commented on a change in pull request #3330: URL:

[GitHub] [hudi] leesf commented on a change in pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-23 Thread GitBox
leesf commented on a change in pull request #3330: URL: https://github.com/apache/hudi/pull/3330#discussion_r675935594 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java ## @@ -182,6 +183,13 @@ public boolean

[GitHub] [hudi] leesf commented on a change in pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-23 Thread GitBox
leesf commented on a change in pull request #3330: URL: https://github.com/apache/hudi/pull/3330#discussion_r675935583 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java ## @@ -182,6 +183,13 @@ public boolean

[jira] [Assigned] (HUDI-1042) [Umbrella] Support clustering on filegroups

2021-07-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-1042: - Assignee: Sagar Sumit (was: liwei) > [Umbrella] Support clustering on filegroups >

[jira] [Commented] (HUDI-2215) Add rateLimiter when Flink writes to hudi

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386642#comment-17386642 ] ASF GitHub Bot commented on HUDI-2215: -- mincwang opened a new pull request #3338: URL:

[GitHub] [hudi] nsivabalan edited a comment on issue #3336: [SUPPORT]

2021-07-23 Thread GitBox
nsivabalan edited a comment on issue #3336: URL: https://github.com/apache/hudi/issues/3336#issuecomment-886003132 Also, have you tried doing an update ("upsert") operation? Once that succeeds, then we know delete has some issue. but if update is failing, then could be some config issue

[jira] [Commented] (HUDI-1241) Generate config docs automatically

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386585#comment-17386585 ] ASF GitHub Bot commented on HUDI-1241: -- hudi-bot edited a comment on pull request #3302: URL:

[jira] [Commented] (HUDI-2209) Bulk insert for flink writer

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386587#comment-17386587 ] ASF GitHub Bot commented on HUDI-2209: -- hudi-bot edited a comment on pull request #3334: URL:

[jira] [Commented] (HUDI-887) Add ability to read Snapshot and Incremental Queries from Presto

2021-07-23 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386597#comment-17386597 ] zhoukang commented on HUDI-887: --- any progress for this ? thanks > Add ability to read Snapshot and

[jira] [Commented] (HUDI-2209) Bulk insert for flink writer

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386598#comment-17386598 ] ASF GitHub Bot commented on HUDI-2209: -- hudi-bot edited a comment on pull request #3334: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3334: [HUDI-2209] Bulk insert for flink writer

2021-07-23 Thread GitBox
hudi-bot edited a comment on pull request #3334: URL: https://github.com/apache/hudi/pull/3334#issuecomment-885497812 ## CI report: * bec06d2304c67b544befff79bc6559520024f7b3 Azure:

[GitHub] [hudi] vinothchandar opened a new issue #3337: [SUPPORT] Trouble getting yyyy/mm partitioning to work with Hive sync

2021-07-23 Thread GitBox
vinothchandar opened a new issue #3337: URL: https://github.com/apache/hudi/issues/3337 **Describe the problem you faced** Hi, everyone! We ingest data with options: ``` hoodie.datasource.write.keygenerator.class=org.apache.hudi.keygen.CustomKeyGenerator

[GitHub] [hudi] vinothchandar commented on issue #3337: [SUPPORT] Trouble getting yyyy/mm partitioning to work with Hive sync

2021-07-23 Thread GitBox
vinothchandar commented on issue #3337: URL: https://github.com/apache/hudi/issues/3337#issuecomment-885979308 Have you tried ``` --partition-value-extractor org.apache.hudi.hive.MultiPartKeysValueExtractor --partitioned-by year, month ``` if you look at this code below, it

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386617#comment-17386617 ] ASF GitHub Bot commented on HUDI-2101: -- leesf commented on a change in pull request #3330: URL:

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386618#comment-17386618 ] ASF GitHub Bot commented on HUDI-2101: -- leesf commented on a change in pull request #3330: URL:

[GitHub] [hudi] leesf commented on a change in pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-23 Thread GitBox
leesf commented on a change in pull request #3330: URL: https://github.com/apache/hudi/pull/3330#discussion_r675934932 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/clustering/SparkZSortAndSizeExecutionStrategy.java ## @@ -0,0 +1,142 @@ +/* + *

[GitHub] [hudi] leesf commented on a change in pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-23 Thread GitBox
leesf commented on a change in pull request #3330: URL: https://github.com/apache/hudi/pull/3330#discussion_r675934932 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/clustering/SparkZSortAndSizeExecutionStrategy.java ## @@ -0,0 +1,142 @@ +/* + *

[jira] [Assigned] (HUDI-1483) async clustering for deltastreamer

2021-07-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-1483: - Assignee: Sagar Sumit (was: liwei) > async clustering for deltastreamer >

[jira] [Resolved] (HUDI-1483) async clustering for deltastreamer

2021-07-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit resolved HUDI-1483. --- Resolution: Fixed > async clustering for deltastreamer > -- > >

[jira] [Updated] (HUDI-1483) async clustering for deltastreamer

2021-07-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1483: -- Status: Open (was: New) > async clustering for deltastreamer > -- > >

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386625#comment-17386625 ] ASF GitHub Bot commented on HUDI-2101: -- leesf commented on a change in pull request #3330: URL:

[GitHub] [hudi] leesf commented on a change in pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-23 Thread GitBox
leesf commented on a change in pull request #3330: URL: https://github.com/apache/hudi/pull/3330#discussion_r675936338 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/cluster/SparkExecuteClusteringCommitActionExecutor.java ## @@ -105,6

[jira] [Commented] (HUDI-2101) support z-order for hudi

2021-07-23 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386626#comment-17386626 ] ASF GitHub Bot commented on HUDI-2101: -- leesf commented on a change in pull request #3330: URL:

[GitHub] [hudi] leesf commented on a change in pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-07-23 Thread GitBox
leesf commented on a change in pull request #3330: URL: https://github.com/apache/hudi/pull/3330#discussion_r675936393 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/spark/sql/hudi/ZOrderingUtil.java ## @@ -0,0 +1,228 @@ +/* + * Licensed to the Apache

[jira] [Updated] (HUDI-2215) Add rateLimiter when Flink writes to hudi

2021-07-23 Thread WangMinChao (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] WangMinChao updated HUDI-2215: -- Summary: Add rateLimiter when Flink writes to hudi (was: Add rate limiter when Flink writes to hudi)

<    1   2   3   >