[jira] [Comment Edited] (HUDI-2151) Make performant out-of-box configs

2021-08-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380194#comment-17380194 ] Vinoth Chandar edited comment on HUDI-2151 at 8/5/21, 11:33 PM:  [High

[jira] [Comment Edited] (HUDI-2151) Make performant out-of-box configs

2021-08-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380336#comment-17380336 ] Vinoth Chandar edited comment on HUDI-2151 at 8/5/21, 11:34 PM:  [High

[jira] [Comment Edited] (HUDI-2151) Make performant out-of-box configs

2021-08-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380198#comment-17380198 ] Vinoth Chandar edited comment on HUDI-2151 at 8/5/21, 11:33 PM:  [High

[jira] [Comment Edited] (HUDI-2151) Make performant out-of-box configs

2021-08-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380196#comment-17380196 ] Vinoth Chandar edited comment on HUDI-2151 at 8/5/21, 11:33 PM:  [High

[jira] [Commented] (HUDI-2080) Migrate to ubuntu 20.04 for Azure pipeline builds

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394411#comment-17394411 ] ASF GitHub Bot commented on HUDI-2080: -- hudi-bot edited a comment on pull request #3409: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3409: [HUDI-2080] Move to ubuntu-18.04 for Azure CI

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3409: URL: https://github.com/apache/hudi/pull/3409#issuecomment-892942265 ## CI report: * 2dab0596a2d884145dd6f516ced082e55619835b UNKNOWN * b5a96cf362b3f61ceeb42cddea9c98ac341f5213 Azure:

[jira] [Commented] (HUDI-2276) Enable Metadata Table by default for both writers and readers

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394435#comment-17394435 ] ASF GitHub Bot commented on HUDI-2276: -- hudi-bot edited a comment on pull request #3411: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3411: [HUDI-2276] Enable metadata table by default for readers and writers

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3411: URL: https://github.com/apache/hudi/pull/3411#issuecomment-893073002 ## CI report: * dd289aac1d64bd9aaffb0157dee3432c5f509464 Azure:

[jira] [Commented] (HUDI-2080) Migrate to ubuntu 20.04 for Azure pipeline builds

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394440#comment-17394440 ] ASF GitHub Bot commented on HUDI-2080: -- hudi-bot edited a comment on pull request #3409: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3409: [HUDI-2080] Move to ubuntu-18.04 for Azure CI

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3409: URL: https://github.com/apache/hudi/pull/3409#issuecomment-892942265 ## CI report: * 2dab0596a2d884145dd6f516ced082e55619835b UNKNOWN * 1bf00907e4c2978b8c0b6aaf9463d356c56e9417 Azure:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394446#comment-17394446 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[jira] [Resolved] (HUDI-2274) Allows INSERT duplicates for Flink MOR table

2021-08-05 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2274. -- Resolution: Fixed Fixed via master branch: b7586a563253082a00d62ac81e3b5acbb378472a > Allows INSERT

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN *

[jira] [Commented] (HUDI-2274) Allows INSERT duplicates for Flink MOR table

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1739#comment-1739 ] ASF GitHub Bot commented on HUDI-2274: -- danny0405 merged pull request #3403: URL:

[GitHub] [hudi] vinothchandar commented on pull request #3411: [HUDI-2276] Enable metadata table by default for readers and writers

2021-08-05 Thread GitBox
vinothchandar commented on pull request #3411: URL: https://github.com/apache/hudi/pull/3411#issuecomment-893959083 Look at azure. Travis is beyond redemption -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Commented] (HUDI-2247) Filter file where length less than parquet MAGIC length

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394473#comment-17394473 ] ASF GitHub Bot commented on HUDI-2247: -- hudi-bot edited a comment on pull request #3363: URL:

[jira] [Commented] (HUDI-2247) Filter file where length less than parquet MAGIC length

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394497#comment-17394497 ] ASF GitHub Bot commented on HUDI-2247: -- hudi-bot edited a comment on pull request #3363: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3363: [HUDI-2247] Filter file where length less than parquet MAGIC length

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3363: URL: https://github.com/apache/hudi/pull/3363#issuecomment-888165582 ## CI report: * 5d971095b96f3b960c0b958b52cb7633ae752cb5 Azure:

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394505#comment-17394505 ] ASF GitHub Bot commented on HUDI-2170: -- vinothchandar commented on a change in pull request #3401:

[GitHub] [hudi] vinothchandar commented on a change in pull request #3401: [HUDI-2170] [HUDI-1763] Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread GitBox
vinothchandar commented on a change in pull request #3401: URL: https://github.com/apache/hudi/pull/3401#discussion_r683938063 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieMergeHandle.java ## @@ -239,7 +240,14 @@ protected void

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394533#comment-17394533 ] ASF GitHub Bot commented on HUDI-2170: -- swuferhong opened a new pull request #3401: URL:

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394532#comment-17394532 ] ASF GitHub Bot commented on HUDI-2170: -- swuferhong closed pull request #3401: URL:

[GitHub] [hudi] swuferhong closed pull request #3401: [HUDI-2170] [HUDI-1763] Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread GitBox
swuferhong closed pull request #3401: URL: https://github.com/apache/hudi/pull/3401 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-2243) Support Time Travel Query For Hoodie Table

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394396#comment-17394396 ] ASF GitHub Bot commented on HUDI-2243: -- nsivabalan commented on a change in pull request #3360: URL:

[GitHub] [hudi] vinothchandar commented on pull request #3411: [HUDI-2276] Enable metadata table by default for readers and writers

2021-08-05 Thread GitBox
vinothchandar commented on pull request #3411: URL: https://github.com/apache/hudi/pull/3411#issuecomment-893905062 seems like a lot of test failures? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (HUDI-2119) Syncing of rollbacks to metadata table does not work in all cases

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394404#comment-17394404 ] ASF GitHub Bot commented on HUDI-2119: -- vinothchandar commented on a change in pull request #3210:

[GitHub] [hudi] vinothchandar commented on a change in pull request #3210: [HUDI-2119] Ensure the rolled-back instance was previously synced to the Metadata Table when syncing a Rollback Instant.

2021-08-05 Thread GitBox
vinothchandar commented on a change in pull request #3210: URL: https://github.com/apache/hudi/pull/3210#discussion_r683866218 ## File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java ## @@ -236,30 +239,50 @@ * * During a rollback

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394409#comment-17394409 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN *

[jira] [Commented] (HUDI-2276) Enable Metadata Table by default for both writers and readers

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394436#comment-17394436 ] ASF GitHub Bot commented on HUDI-2276: -- hudi-bot edited a comment on pull request #3411: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3363: [HUDI-2247] Filter file where length less than parquet MAGIC length

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3363: URL: https://github.com/apache/hudi/pull/3363#issuecomment-888165582 ## CI report: * Unknown: [CANCELED](TBD) * 5d971095b96f3b960c0b958b52cb7633ae752cb5 Azure:

[jira] [Commented] (HUDI-1468) incremental read support with clustering

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394492#comment-17394492 ] ASF GitHub Bot commented on HUDI-1468: -- hudi-bot commented on pull request #3419: URL:

[GitHub] [hudi] hudi-bot commented on pull request #3419: [HUDI-1468] Support custom clustering strategies and preserve commit …

2021-08-05 Thread GitBox
hudi-bot commented on pull request #3419: URL: https://github.com/apache/hudi/pull/3419#issuecomment-893980561 ## CI report: * 9a72ddd7f012528a3e7c0c9441f760bfb2a18f3d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Commented] (HUDI-1468) incremental read support with clustering

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394496#comment-17394496 ] ASF GitHub Bot commented on HUDI-1468: -- hudi-bot edited a comment on pull request #3419: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3419: [HUDI-1468] Support custom clustering strategies and preserve commit …

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3419: URL: https://github.com/apache/hudi/pull/3419#issuecomment-893980561 ## CI report: * 9a72ddd7f012528a3e7c0c9441f760bfb2a18f3d Azure:

[GitHub] [hudi] vinothchandar commented on pull request #3285: [HUDI-1771] Propagate CDC format for hoodie

2021-08-05 Thread GitBox
vinothchandar commented on pull request #3285: URL: https://github.com/apache/hudi/pull/3285#issuecomment-893991056 >For existing tables, this will cause issues with schema evol? or we only do. it for new tables? Then it will break if someone upgrades from 0.8.0 to 0.9.0 on an

[GitHub] [hudi] nsivabalan commented on a change in pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-05 Thread GitBox
nsivabalan commented on a change in pull request #3393: URL: https://github.com/apache/hudi/pull/3393#discussion_r683847551 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestCreateTable.scala ## @@ -272,4 +277,154 @@ class

[jira] [Comment Edited] (HUDI-2151) Make performant out-of-box configs

2021-08-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377615#comment-17377615 ] Vinoth Chandar edited comment on HUDI-2151 at 8/5/21, 11:26 PM: [High

[jira] [Commented] (HUDI-2182) Support Compaction Command For Spark Sql

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394388#comment-17394388 ] ASF GitHub Bot commented on HUDI-2182: -- vinothchandar commented on a change in pull request #3277:

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394389#comment-17394389 ] ASF GitHub Bot commented on HUDI-1842: -- nsivabalan commented on a change in pull request #3393: URL:

[jira] [Comment Edited] (HUDI-2151) Make performant out-of-box configs

2021-08-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17378870#comment-17378870 ] Vinoth Chandar edited comment on HUDI-2151 at 8/5/21, 11:30 PM: [High

[GitHub] [hudi] nsivabalan commented on a change in pull request #3360: [HUDI-2243] Support Time Travel Query For Hoodie Table

2021-08-05 Thread GitBox
nsivabalan commented on a change in pull request #3360: URL: https://github.com/apache/hudi/pull/3360#discussion_r683854325 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/HoodieSqlUtils.scala ## @@ -194,4 +198,26 @@ object

[jira] [Commented] (HUDI-2119) Syncing of rollbacks to metadata table does not work in all cases

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394399#comment-17394399 ] ASF GitHub Bot commented on HUDI-2119: -- hudi-bot edited a comment on pull request #3210: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN *

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394439#comment-17394439 ] ASF GitHub Bot commented on HUDI-2170: -- swuferhong commented on a change in pull request #3401: URL:

[GitHub] [hudi] swuferhong commented on a change in pull request #3401: [HUDI-2170] [HUDI-1763] Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread GitBox
swuferhong commented on a change in pull request #3401: URL: https://github.com/apache/hudi/pull/3401#discussion_r683900152 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/io/TestHoodieMergeHandle.java ## @@ -231,6 +229,83 @@ public void

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394437#comment-17394437 ] ASF GitHub Bot commented on HUDI-2170: -- swuferhong commented on pull request #3401: URL:

[GitHub] [hudi] swuferhong commented on a change in pull request #3401: [HUDI-2170] [HUDI-1763] Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread GitBox
swuferhong commented on a change in pull request #3401: URL: https://github.com/apache/hudi/pull/3401#discussion_r683900091 ## File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java ## @@ -70,6 +70,10 @@ private int type = 0; private

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394438#comment-17394438 ] ASF GitHub Bot commented on HUDI-2170: -- swuferhong commented on a change in pull request #3401: URL:

[GitHub] [hudi] codope opened a new pull request #3419: [HUDI-1468] Support custom clustering strategies and preserve commit …

2021-08-05 Thread GitBox
codope opened a new pull request #3419: URL: https://github.com/apache/hudi/pull/3419 …metadata as part of clustering This PR is a re-work of #3211 with some minor changes and tests. ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit

[jira] [Commented] (HUDI-1468) incremental read support with clustering

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394491#comment-17394491 ] ASF GitHub Bot commented on HUDI-1468: -- codope opened a new pull request #3419: URL:

[jira] [Commented] (HUDI-1771) Propagate CDC format for hoodie

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394503#comment-17394503 ] ASF GitHub Bot commented on HUDI-1771: -- vinothchandar commented on pull request #3285: URL:

[jira] [Commented] (HUDI-1771) Propagate CDC format for hoodie

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394504#comment-17394504 ] ASF GitHub Bot commented on HUDI-1771: -- vinothchandar edited a comment on pull request #3285: URL:

[GitHub] [hudi] vinothchandar edited a comment on pull request #3285: [HUDI-1771] Propagate CDC format for hoodie

2021-08-05 Thread GitBox
vinothchandar edited a comment on pull request #3285: URL: https://github.com/apache/hudi/pull/3285#issuecomment-893991056 >For existing tables, this will cause issues with schema evol? or we only do. it for new tables? Then it will break if someone upgrades from 0.8.0 to 0.9.0 on

[jira] [Commented] (HUDI-1468) incremental read support with clustering

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394513#comment-17394513 ] ASF GitHub Bot commented on HUDI-1468: -- hudi-bot edited a comment on pull request #3419: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3419: [HUDI-1468] Support custom clustering strategies and preserve commit …

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3419: URL: https://github.com/apache/hudi/pull/3419#issuecomment-893980561 ## CI report: * 9a72ddd7f012528a3e7c0c9441f760bfb2a18f3d Azure:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394528#comment-17394528 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN *

[jira] [Commented] (HUDI-2159) Supporting Clustering and Metadata Table together

2021-08-05 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394392#comment-17394392 ] Vinoth Chandar commented on HUDI-2159: -- [~nishith29] [~pwason] any updates on this? Like to get this

[jira] [Commented] (HUDI-2119) Syncing of rollbacks to metadata table does not work in all cases

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394403#comment-17394403 ] ASF GitHub Bot commented on HUDI-2119: -- vinothchandar commented on a change in pull request #3210:

[GitHub] [hudi] vinothchandar commented on a change in pull request #3210: [HUDI-2119] Ensure the rolled-back instance was previously synced to the Metadata Table when syncing a Rollback Instant.

2021-08-05 Thread GitBox
vinothchandar commented on a change in pull request #3210: URL: https://github.com/apache/hudi/pull/3210#discussion_r683865065 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/TestHoodieBackedMetadata.java ## @@ -480,6 +482,131 @@

[GitHub] [hudi] hudi-bot edited a comment on pull request #3409: [HUDI-2080] Move to ubuntu-18.04 for Azure CI

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3409: URL: https://github.com/apache/hudi/pull/3409#issuecomment-892942265 ## CI report: * 2dab0596a2d884145dd6f516ced082e55619835b UNKNOWN * b5a96cf362b3f61ceeb42cddea9c98ac341f5213 Azure:

[jira] [Commented] (HUDI-2276) Enable Metadata Table by default for both writers and readers

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394431#comment-17394431 ] ASF GitHub Bot commented on HUDI-2276: -- umehrot2 commented on pull request #3411: URL:

[jira] [Commented] (HUDI-2276) Enable Metadata Table by default for both writers and readers

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394432#comment-17394432 ] ASF GitHub Bot commented on HUDI-2276: -- umehrot2 edited a comment on pull request #3411: URL:

[GitHub] [hudi] swuferhong commented on pull request #3401: [HUDI-2170] [HUDI-1763] Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread GitBox
swuferhong commented on pull request #3401: URL: https://github.com/apache/hudi/pull/3401#issuecomment-893953643 > @swuferhong can you please address these and also verify once that #2977 is also fully handled by this PR Yes, I checked that this PR fully handle

[jira] [Commented] (HUDI-2276) Enable Metadata Table by default for both writers and readers

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394448#comment-17394448 ] ASF GitHub Bot commented on HUDI-2276: -- vinothchandar commented on pull request #3411: URL:

[jira] [Resolved] (HUDI-2278) Use INT64 timestamp with precision 3 for flink parquet writer

2021-08-05 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2278. -- Resolution: Fixed Fixed via master branch: 20feb1a8970b7ec658d4d3f1994eaedd24b9874a > Use INT64

[jira] [Commented] (HUDI-2278) Use INT64 timestamp with precision 3 for flink parquet writer

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394463#comment-17394463 ] ASF GitHub Bot commented on HUDI-2278: -- danny0405 commented on pull request #3414: URL:

[jira] [Commented] (HUDI-2278) Use INT64 timestamp with precision 3 for flink parquet writer

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394461#comment-17394461 ] ASF GitHub Bot commented on HUDI-2278: -- danny0405 merged pull request #3414: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3363: [HUDI-2247] Filter file where length less than parquet MAGIC length

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3363: URL: https://github.com/apache/hudi/pull/3363#issuecomment-888165582 ## CI report: * Unknown: [CANCELED](TBD) * 5d971095b96f3b960c0b958b52cb7633ae752cb5 UNKNOWN Bot commands @hudi-bot supports the following

[jira] [Commented] (HUDI-1468) incremental read support with clustering

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394508#comment-17394508 ] ASF GitHub Bot commented on HUDI-1468: -- vinothchandar closed pull request #3211: URL:

[jira] [Commented] (HUDI-1468) incremental read support with clustering

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394507#comment-17394507 ] ASF GitHub Bot commented on HUDI-1468: -- vinothchandar commented on pull request #3211: URL:

[GitHub] [hudi] vinothchandar commented on pull request #3211: [HUDI-1468] Support more flexible clustering strategies and preserve commit …

2021-08-05 Thread GitBox
vinothchandar commented on pull request #3211: URL: https://github.com/apache/hudi/pull/3211#issuecomment-893993045 Closing in favor of #3419 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] vinothchandar closed pull request #3211: [HUDI-1468] Support more flexible clustering strategies and preserve commit …

2021-08-05 Thread GitBox
vinothchandar closed pull request #3211: URL: https://github.com/apache/hudi/pull/3211 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394512#comment-17394512 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[jira] [Commented] (HUDI-2119) Syncing of rollbacks to metadata table does not work in all cases

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394398#comment-17394398 ] ASF GitHub Bot commented on HUDI-2119: -- hudi-bot edited a comment on pull request #3210: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3210: [HUDI-2119] Ensure the rolled-back instance was previously synced to the Metadata Table when syncing a Rollback Instant.

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3210: URL: https://github.com/apache/hudi/pull/3210#issuecomment-872541566 ## CI report: * 45925d349630415ee9e10cb8b32ae7fad7f25b25 Azure:

[jira] [Commented] (HUDI-2276) Enable Metadata Table by default for both writers and readers

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394400#comment-17394400 ] ASF GitHub Bot commented on HUDI-2276: -- vinothchandar commented on pull request #3411: URL:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394419#comment-17394419 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[GitHub] [hudi] umehrot2 commented on pull request #3411: [HUDI-2276] Enable metadata table by default for readers and writers

2021-08-05 Thread GitBox
umehrot2 commented on pull request #3411: URL: https://github.com/apache/hudi/pull/3411#issuecomment-893948358 > seems like a lot of test failures? Yes. Push a new revision that fixes some more tests. Lets see. Travis itself isn't running man ! -- This is an automated message

[GitHub] [hudi] umehrot2 edited a comment on pull request #3411: [HUDI-2276] Enable metadata table by default for readers and writers

2021-08-05 Thread GitBox
umehrot2 edited a comment on pull request #3411: URL: https://github.com/apache/hudi/pull/3411#issuecomment-893948358 > seems like a lot of test failures? Yes. Pushed a new revision that fixes some more tests. Lets see. Travis itself isn't running man ! -- This is an automated

[GitHub] [hudi] hudi-bot edited a comment on pull request #3401: [HUDI-2170] [HUDI-1763] Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3401: URL: https://github.com/apache/hudi/pull/3401#issuecomment-892472052 ## CI report: * 7fe0db6bdda8a2f543d068efa1cbb60682b2ef95 UNKNOWN * 0b34d55f238b889fb2fcc2526e4657ea981c431c Azure:

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394449#comment-17394449 ] ASF GitHub Bot commented on HUDI-2170: -- hudi-bot edited a comment on pull request #3401: URL:

[GitHub] [hudi] danny0405 merged pull request #3414: [HUDI-2278] Use INT64 timestamp with precision 3 for flink parquet wr…

2021-08-05 Thread GitBox
danny0405 merged pull request #3414: URL: https://github.com/apache/hudi/pull/3414 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] danny0405 commented on pull request #3414: [HUDI-2278] Use INT64 timestamp with precision 3 for flink parquet wr…

2021-08-05 Thread GitBox
danny0405 commented on pull request #3414: URL: https://github.com/apache/hudi/pull/3414#issuecomment-893967508 The azure success, i would just merge it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (HUDI-2278) Use INT64 timestamp with precision 3 for flink parquet writer

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394460#comment-17394460 ] ASF GitHub Bot commented on HUDI-2278: -- yuzhaojing commented on pull request #3414: URL:

[hudi] branch master updated (b7586a5 -> 20feb1a)

2021-08-05 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from b7586a5 [HUDI-2274] Allows INSERT duplicates for Flink MOR table (#3403) add 20feb1a [HUDI-2278] Use INT64

[GitHub] [hudi] yuzhaojing commented on pull request #3414: [HUDI-2278] Use INT64 timestamp with precision 3 for flink parquet wr…

2021-08-05 Thread GitBox
yuzhaojing commented on pull request #3414: URL: https://github.com/apache/hudi/pull/3414#issuecomment-893967000 +1 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394511#comment-17394511 ] ASF GitHub Bot commented on HUDI-2170: -- hudi-bot edited a comment on pull request #3401: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3401: [HUDI-2170] [HUDI-1763] Always choose the latest record for HoodieRecordPayload

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3401: URL: https://github.com/apache/hudi/pull/3401#issuecomment-892472052 ## CI report: * 7fe0db6bdda8a2f543d068efa1cbb60682b2ef95 UNKNOWN * d00f0bc28228f3699e29ed30ea60cd11b45d5eae Azure:

[jira] [Commented] (HUDI-2276) Enable Metadata Table by default for both writers and readers

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394394#comment-17394394 ] ASF GitHub Bot commented on HUDI-2276: -- hudi-bot edited a comment on pull request #3411: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3411: [HUDI-2276] Enable metadata table by default for readers and writers

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3411: URL: https://github.com/apache/hudi/pull/3411#issuecomment-893073002 ## CI report: * dd289aac1d64bd9aaffb0157dee3432c5f509464 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3210: [HUDI-2119] Ensure the rolled-back instance was previously synced to the Metadata Table when syncing a Rollback Instant.

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3210: URL: https://github.com/apache/hudi/pull/3210#issuecomment-872541566 ## CI report: * 45925d349630415ee9e10cb8b32ae7fad7f25b25 Azure:

[jira] [Commented] (HUDI-2119) Syncing of rollbacks to metadata table does not work in all cases

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394407#comment-17394407 ] ASF GitHub Bot commented on HUDI-2119: -- hudi-bot edited a comment on pull request #3210: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3210: [HUDI-2119] Ensure the rolled-back instance was previously synced to the Metadata Table when syncing a Rollback Instant.

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3210: URL: https://github.com/apache/hudi/pull/3210#issuecomment-872541566 ## CI report: * 40b0fb75b0cf18dab3559a20a6fa44a3378764fa Azure:

[GitHub] [hudi] danny0405 commented on pull request #3363: [HUDI-2247] Filter file where length less than parquet MAGIC length

2021-08-05 Thread GitBox
danny0405 commented on pull request #3363: URL: https://github.com/apache/hudi/pull/3363#issuecomment-893969967 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HUDI-2247) Filter file where length less than parquet MAGIC length

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394470#comment-17394470 ] ASF GitHub Bot commented on HUDI-2247: -- danny0405 commented on pull request #3363: URL:

[jira] [Commented] (HUDI-2247) Filter file where length less than parquet MAGIC length

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394477#comment-17394477 ] ASF GitHub Bot commented on HUDI-2247: -- hudi-bot edited a comment on pull request #3363: URL:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394489#comment-17394489 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-05 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN *

<    1   2   3   4   5   >