[GitHub] [hudi] stym06 commented on issue #1083: [SUPPORT] getting error in KafkaOffsetGen,

2021-11-15 Thread GitBox
stym06 commented on issue #1083: URL: https://github.com/apache/hudi/issues/1083#issuecomment-969960792 Any comments on this? This is still happening... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] hudi-bot removed a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-969886937 ## CI report: * ee973637958fb9c1496cfb45f78346e2f01ffa02 UNKNOWN * c435898754ec3ce579eb2b67c473443c9ee70e46 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-969926345 ## CI report: * ee973637958fb9c1496cfb45f78346e2f01ffa02 UNKNOWN * c435898754ec3ce579eb2b67c473443c9ee70e46 UNKNOWN * b1c5d4edfc7d4cb52944e7f0912bdd28930f4ce6

[GitHub] [hudi] hudi-bot commented on pull request #3992: [MINOR] Add more configuration to Kafka setup script

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3992: URL: https://github.com/apache/hudi/pull/3992#issuecomment-969912459 ## CI report: * d6ba30a69737a8842afa5fe41fa8b3e0453b5e47 UNKNOWN * e710a71570654b50d9dde1a1c5a3f4c683cb16bf Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3992: [MINOR] Add more configuration to Kafka setup script

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #3992: URL: https://github.com/apache/hudi/pull/3992#issuecomment-969865795 ## CI report: * d6ba30a69737a8842afa5fe41fa8b3e0453b5e47 UNKNOWN * e710a71570654b50d9dde1a1c5a3f4c683cb16bf Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3986: [HUDI-2550][WIP] Expand File-Group candidates list for appending for MOR tables

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #3986: URL: https://github.com/apache/hudi/pull/3986#issuecomment-969861810 ## CI report: * d6873a12f5a3d16b4e3505243780ea56339b3d2e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3986: [HUDI-2550][WIP] Expand File-Group candidates list for appending for MOR tables

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3986: URL: https://github.com/apache/hudi/pull/3986#issuecomment-969897836 ## CI report: * d6873a12f5a3d16b4e3505243780ea56339b3d2e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-969886937 ## CI report: * ee973637958fb9c1496cfb45f78346e2f01ffa02 UNKNOWN * c435898754ec3ce579eb2b67c473443c9ee70e46 UNKNOWN * b1c5d4edfc7d4cb52944e7f0912bdd28930f4ce6

[GitHub] [hudi] hudi-bot removed a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-969135461 ## CI report: * ee973637958fb9c1496cfb45f78346e2f01ffa02 UNKNOWN * c435898754ec3ce579eb2b67c473443c9ee70e46 UNKNOWN *

[GitHub] [hudi] minihippo commented on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-11-15 Thread GitBox
minihippo commented on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-969886594 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Resolved] (HUDI-2769) Fix StreamerUtil#medianInstantTime for very near instant time

2021-11-15 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2769. -- > Fix StreamerUtil#medianInstantTime for very near instant time >

[jira] [Commented] (HUDI-2769) Fix StreamerUtil#medianInstantTime for very near instant time

2021-11-15 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444277#comment-17444277 ] Danny Chen commented on HUDI-2769: -- Fixed via master branch: 6f5e661010a85f342613baff962a6d6ba91e >

[hudi] branch master updated: [HUDI-2769] Fix StreamerUtil#medianInstantTime for very near instant time (#4005)

2021-11-15 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 6f5e661 [HUDI-2769] Fix

[GitHub] [hudi] danny0405 merged pull request #4005: [HUDI-2769] Fix StreamerUtil#medianInstantTime for very near instant …

2021-11-15 Thread GitBox
danny0405 merged pull request #4005: URL: https://github.com/apache/hudi/pull/4005 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-969847717 ## CI report: * 2afbd368d00403fda5056e0e8795f18ee4582768 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-969881218 ## CI report: * d28da05aad1955161c37ee0800b8e89ed08ff1b5 Azure:

[GitHub] [hudi] boneanxs commented on issue #3856: [SUPPORT] Maybe should cache baseDir in nonHoodiePathCache in HoodieROTablePathFilter?

2021-11-15 Thread GitBox
boneanxs commented on issue #3856: URL: https://github.com/apache/hudi/issues/3856#issuecomment-969870494 Yes, I'm willing to put up a fix for it, will do it these days. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] manojpec commented on a change in pull request #3968: [WIP] [HUDI-2593] Virtual keys support for metadata table

2021-11-15 Thread GitBox
manojpec commented on a change in pull request #3968: URL: https://github.com/apache/hudi/pull/3968#discussion_r749904766 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java ## @@ -451,6 +472,10 @@ public boolean

[GitHub] [hudi] manojpec commented on a change in pull request #3968: [WIP] [HUDI-2593] Virtual keys support for metadata table

2021-11-15 Thread GitBox
manojpec commented on a change in pull request #3968: URL: https://github.com/apache/hudi/pull/3968#discussion_r749904247 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieLogFormatReader.java ## @@ -39,6 +39,8 @@ private final List logFiles;

[GitHub] [hudi] hudi-bot removed a comment on pull request #3992: [MINOR] Add more configuration to Kafka setup script

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #3992: URL: https://github.com/apache/hudi/pull/3992#issuecomment-969670756 ## CI report: * d6ba30a69737a8842afa5fe41fa8b3e0453b5e47 UNKNOWN * e710a71570654b50d9dde1a1c5a3f4c683cb16bf Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3992: [MINOR] Add more configuration to Kafka setup script

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3992: URL: https://github.com/apache/hudi/pull/3992#issuecomment-969865795 ## CI report: * d6ba30a69737a8842afa5fe41fa8b3e0453b5e47 UNKNOWN * e710a71570654b50d9dde1a1c5a3f4c683cb16bf Azure:

[GitHub] [hudi] yihua commented on pull request #3992: [MINOR] Add more configuration to Kafka setup script

2021-11-15 Thread GitBox
yihua commented on pull request #3992: URL: https://github.com/apache/hudi/pull/3992#issuecomment-969864889 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Assigned] (HUDI-2443) KVComparator in HFile for metadata table is tied to HBase version and shading

2021-11-15 Thread Rajesh Mahindra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Mahindra reassigned HUDI-2443: - Assignee: Sagar Sumit (was: Manoj Govindassamy) > KVComparator in HFile for metadata

[GitHub] [hudi] hudi-bot removed a comment on pull request #3986: [HUDI-2550][WIP] Expand File-Group candidates list for appending for MOR tables

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #3986: URL: https://github.com/apache/hudi/pull/3986#issuecomment-969344397 ## CI report: * d6873a12f5a3d16b4e3505243780ea56339b3d2e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3986: [HUDI-2550][WIP] Expand File-Group candidates list for appending for MOR tables

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3986: URL: https://github.com/apache/hudi/pull/3986#issuecomment-969861810 ## CI report: * d6873a12f5a3d16b4e3505243780ea56339b3d2e Azure:

[GitHub] [hudi] alexeykudinkin commented on pull request #3986: [HUDI-2550][WIP] Expand File-Group candidates list for appending for MOR tables

2021-11-15 Thread GitBox
alexeykudinkin commented on pull request #3986: URL: https://github.com/apache/hudi/pull/3986#issuecomment-969861249 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] hudi-bot removed a comment on pull request #4005: [HUDI-2769] Fix StreamerUtil#medianInstantTime for very near instant …

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #4005: URL: https://github.com/apache/hudi/pull/4005#issuecomment-969842123 ## CI report: * 9189925d76fd6e3e7e259abe701810d64d6293bf UNKNOWN * f21b05457d876a784fa0b08055021479c227216a Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4005: [HUDI-2769] Fix StreamerUtil#medianInstantTime for very near instant …

2021-11-15 Thread GitBox
hudi-bot commented on pull request #4005: URL: https://github.com/apache/hudi/pull/4005#issuecomment-969860741 ## CI report: * 9189925d76fd6e3e7e259abe701810d64d6293bf UNKNOWN * f21b05457d876a784fa0b08055021479c227216a Azure:

[jira] [Commented] (HUDI-2743) Remove fs.exists() in AbstractTableFileSystemView

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444272#comment-17444272 ] sivabalan narayanan commented on HUDI-2743: --- Closing in favor of

[jira] [Closed] (HUDI-2743) Remove fs.exists() in AbstractTableFileSystemView

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-2743. - Resolution: Duplicate > Remove fs.exists() in AbstractTableFileSystemView >

[GitHub] [hudi] manojpec commented on a change in pull request #3968: [WIP] [HUDI-2593] Virtual keys support for metadata table

2021-11-15 Thread GitBox
manojpec commented on a change in pull request #3968: URL: https://github.com/apache/hudi/pull/3968#discussion_r749896878 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/block/HoodieAvroDataBlock.java ## @@ -58,22 +59,27 @@ private ThreadLocal

[GitHub] [hudi] yihua commented on a change in pull request #4003: [HUDI-2734] Setting default metadata enable per engine

2021-11-15 Thread GitBox
yihua commented on a change in pull request #4003: URL: https://github.com/apache/hudi/pull/4003#discussion_r749896360 ## File path: hudi-common/src/main/java/org/apache/hudi/common/config/HoodieMetadataConfig.java ## @@ -18,6 +18,9 @@ package

[GitHub] [hudi] manojpec commented on a change in pull request #3968: [WIP] [HUDI-2593] Virtual keys support for metadata table

2021-11-15 Thread GitBox
manojpec commented on a change in pull request #3968: URL: https://github.com/apache/hudi/pull/3968#discussion_r749895295 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieAppendHandle.java ## @@ -360,7 +360,8 @@ protected void

[jira] [Updated] (HUDI-2151) Make performant out-of-box configs

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2151: -- Priority: Critical (was: Blocker) > Make performant out-of-box configs >

[jira] [Updated] (HUDI-2409) Using HBase shaded jars in Hudi presto bundle

2021-11-15 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2409: -- Reviewers: Vinoth Chandar > Using HBase shaded jars in Hudi presto bundle >

[jira] [Updated] (HUDI-2734) Disable metadata by default for flink and java

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2734: -- Reviewers: Ethan Guo (was: Sagar Sumit) > Disable metadata by default for flink and

[jira] [Updated] (HUDI-2768) Enable async timeline server by default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2768: -- Story Points: 4 > Enable async timeline server by default >

[jira] [Updated] (HUDI-2768) Enable async timeline server by default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2768: -- Reviewers: Sagar Sumit > Enable async timeline server by default >

[jira] [Updated] (HUDI-2766) Enable marker based rollback by default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2766: -- Reviewers: Sagar Sumit > Enable marker based rollback by default >

[jira] [Updated] (HUDI-2766) Enable marker based rollback by default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2766: -- Story Points: 4 > Enable marker based rollback by default >

[jira] [Updated] (HUDI-2767) Enable timeline server based marker type as default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2767: -- Story Points: 4 > Enable timeline server based marker type as default >

[jira] [Updated] (HUDI-2767) Enable timeline server based marker type as default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2767: -- Reviewers: Manoj Govindassamy > Enable timeline server based marker type as default >

[jira] [Updated] (HUDI-2734) Disable metadata by default for flink and java

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2734: -- Story Points: 2 > Disable metadata by default for flink and java >

[jira] [Updated] (HUDI-2734) Disable metadata by default for flink and java

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2734: -- Reviewers: Sagar Sumit > Disable metadata by default for flink and java >

[GitHub] [hudi] hudi-bot commented on pull request #3977: [HUDI-2716] InLineFS path conversion support for S3 FS paths

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3977: URL: https://github.com/apache/hudi/pull/3977#issuecomment-969847854 ## CI report: * c20db31b8bd31c55e14e3390b22d165e59366958 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3977: [HUDI-2716] InLineFS path conversion support for S3 FS paths

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #3977: URL: https://github.com/apache/hudi/pull/3977#issuecomment-969816238 ## CI report: * 8bb5df882ac134a7f04e66d15bc74f4e63384094 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-969797527 ## CI report: * 2afbd368d00403fda5056e0e8795f18ee4582768 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-969847717 ## CI report: * 2afbd368d00403fda5056e0e8795f18ee4582768 Azure:

[jira] [Created] (HUDI-2770) Update docs for HoodieCompactor (compaction) and HoodieClusteringJob (clustering)

2021-11-15 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-2770: --- Summary: Update docs for HoodieCompactor (compaction) and HoodieClusteringJob (clustering) Key: HUDI-2770 URL: https://issues.apache.org/jira/browse/HUDI-2770 Project: Apache

[jira] [Updated] (HUDI-2599) [Performance] Lower parallelism with snapshot query on COW tables in Presto

2021-11-15 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2599: -- Status: Patch Available (was: In Progress) > [Performance] Lower parallelism with snapshot query on

[GitHub] [hudi] hudi-bot commented on pull request #4005: [HUDI-2769] Fix StreamerUtil#medianInstantTime for very near instant …

2021-11-15 Thread GitBox
hudi-bot commented on pull request #4005: URL: https://github.com/apache/hudi/pull/4005#issuecomment-969842123 ## CI report: * 9189925d76fd6e3e7e259abe701810d64d6293bf UNKNOWN * f21b05457d876a784fa0b08055021479c227216a Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4005: [HUDI-2769] Fix StreamerUtil#medianInstantTime for very near instant …

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #4005: URL: https://github.com/apache/hudi/pull/4005#issuecomment-969840881 ## CI report: * 9189925d76fd6e3e7e259abe701810d64d6293bf UNKNOWN * f21b05457d876a784fa0b08055021479c227216a UNKNOWN Bot commands @hudi-bot

[GitHub] [hudi] manojpec commented on a change in pull request #3977: [HUDI-2716] InLineFS path conversion support for S3 FS paths

2021-11-15 Thread GitBox
manojpec commented on a change in pull request #3977: URL: https://github.com/apache/hudi/pull/3977#discussion_r749886365 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java ## @@ -374,21 +374,23 @@ private void

[GitHub] [hudi] hudi-bot removed a comment on pull request #4005: [HUDI-2769] Fix StreamerUtil#medianInstantTime for very near instant …

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #4005: URL: https://github.com/apache/hudi/pull/4005#issuecomment-969839670 ## CI report: * 9189925d76fd6e3e7e259abe701810d64d6293bf UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4005: [HUDI-2769] Fix StreamerUtil#medianInstantTime for very near instant …

2021-11-15 Thread GitBox
hudi-bot commented on pull request #4005: URL: https://github.com/apache/hudi/pull/4005#issuecomment-969840881 ## CI report: * 9189925d76fd6e3e7e259abe701810d64d6293bf UNKNOWN * f21b05457d876a784fa0b08055021479c227216a UNKNOWN Bot commands @hudi-bot supports

[GitHub] [hudi] hudi-bot commented on pull request #4005: [HUDI-2769] Fix StreamerUtil#medianInstantTime for very near instant …

2021-11-15 Thread GitBox
hudi-bot commented on pull request #4005: URL: https://github.com/apache/hudi/pull/4005#issuecomment-969839670 ## CI report: * 9189925d76fd6e3e7e259abe701810d64d6293bf UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Updated] (HUDI-2769) Fix StreamerUtil#medianInstantTime for very near instant time

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2769: - Labels: pull-request-available (was: ) > Fix StreamerUtil#medianInstantTime for very near

[GitHub] [hudi] danny0405 opened a new pull request #4005: [HUDI-2769] Fix StreamerUtil#medianInstantTime for very near instant …

2021-11-15 Thread GitBox
danny0405 opened a new pull request #4005: URL: https://github.com/apache/hudi/pull/4005 …time ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ##

[jira] [Created] (HUDI-2769) Fix StreamerUtil#medianInstantTime for very near instant time

2021-11-15 Thread Danny Chen (Jira)
Danny Chen created HUDI-2769: Summary: Fix StreamerUtil#medianInstantTime for very near instant time Key: HUDI-2769 URL: https://issues.apache.org/jira/browse/HUDI-2769 Project: Apache Hudi

[jira] [Updated] (HUDI-2767) Enable timeline server based marker type as default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2767: -- Status: Patch Available (was: In Progress) > Enable timeline server based marker type

[jira] [Updated] (HUDI-2766) Enable marker based rollback by default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2766: -- Status: Patch Available (was: In Progress) > Enable marker based rollback by default >

[jira] [Created] (HUDI-2768) Enable async timeline server by default

2021-11-15 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2768: - Summary: Enable async timeline server by default Key: HUDI-2768 URL: https://issues.apache.org/jira/browse/HUDI-2768 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-2768) Enable async timeline server by default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2768: -- Fix Version/s: 0.10.0 > Enable async timeline server by default >

[jira] [Assigned] (HUDI-2768) Enable async timeline server by default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2768: - Assignee: sivabalan narayanan > Enable async timeline server by default >

[jira] [Updated] (HUDI-2767) Enable timeline server based marker type as default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2767: -- Fix Version/s: 0.10.0 > Enable timeline server based marker type as default >

[jira] [Updated] (HUDI-2767) Enable timeline server based marker type as default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2767: -- Priority: Blocker (was: Major) > Enable timeline server based marker type as default >

[jira] [Assigned] (HUDI-2767) Enable timeline server based marker type as default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2767: - Assignee: sivabalan narayanan > Enable timeline server based marker type as

[jira] [Updated] (HUDI-2768) Enable async timeline server by default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2768: -- Priority: Blocker (was: Major) > Enable async timeline server by default >

[jira] [Created] (HUDI-2767) Enable timeline server based marker type as default

2021-11-15 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2767: - Summary: Enable timeline server based marker type as default Key: HUDI-2767 URL: https://issues.apache.org/jira/browse/HUDI-2767 Project: Apache Hudi

[jira] [Updated] (HUDI-2766) Enable marker based rollback by default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2766: -- Priority: Blocker (was: Major) > Enable marker based rollback by default >

[jira] [Assigned] (HUDI-2766) Enable marker based rollback by default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2766: - Assignee: sivabalan narayanan > Enable marker based rollback by default >

[jira] [Created] (HUDI-2766) Enable marker based rollback by default

2021-11-15 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2766: - Summary: Enable marker based rollback by default Key: HUDI-2766 URL: https://issues.apache.org/jira/browse/HUDI-2766 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-2766) Enable marker based rollback by default

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2766: -- Fix Version/s: 0.10.0 > Enable marker based rollback by default >

[jira] [Assigned] (HUDI-2637) Triage all bugs around Multi-writer and certify the tested flows

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2637: - Assignee: sivabalan narayanan (was: Vinoth Chandar) > Triage all bugs around

[jira] [Updated] (HUDI-2151) Make performant out-of-box configs

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2151: -- Status: Patch Available (was: In Progress) > Make performant out-of-box configs >

[jira] [Updated] (HUDI-2753) Rollback plan does has to take in explicit arg from restore for rollback strategy

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2753: -- Status: Patch Available (was: In Progress) > Rollback plan does has to take in

[jira] [Updated] (HUDI-2734) Disable metadata by default for flink and java

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2734: -- Status: Patch Available (was: In Progress) > Disable metadata by default for flink and

[jira] [Updated] (HUDI-2734) Disable metadata by default for flink and java

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2734: -- Summary: Disable metadata by default for flink and java (was: Disable metadata by

[jira] [Reopened] (HUDI-2712) rollback of a partially failed commit which has new partitions fails with metadata table

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-2712: --- > rollback of a partially failed commit which has new partitions fails with > metadata

[jira] [Updated] (HUDI-2712) rollback of a partially failed commit which has new partitions fails with metadata table

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2712: -- Status: Closed (was: Patch Available) > rollback of a partially failed commit which

[jira] [Resolved] (HUDI-2712) rollback of a partially failed commit which has new partitions fails with metadata table

2021-11-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-2712. --- > rollback of a partially failed commit which has new partitions fails with > metadata

[GitHub] [hudi] nsivabalan commented on a change in pull request #3977: [HUDI-2716] InLineFS path conversion support for S3 FS paths

2021-11-15 Thread GitBox
nsivabalan commented on a change in pull request #3977: URL: https://github.com/apache/hudi/pull/3977#discussion_r749877639 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java ## @@ -374,21 +374,23 @@ private void

[hudi] branch master updated (38b6934 -> bff8769)

2021-11-15 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 38b6934 [HUDI-2683] Parallelize deleting archived hoodie commits (#3920) add bff8769 [HUDI-2712] Fixing a

[GitHub] [hudi] manojpec commented on a change in pull request #3977: [HUDI-2716] InLineFS path conversion support for S3 FS paths

2021-11-15 Thread GitBox
manojpec commented on a change in pull request #3977: URL: https://github.com/apache/hudi/pull/3977#discussion_r749873065 ## File path: hudi-common/src/main/java/org/apache/hudi/common/fs/inline/InLineFSUtils.java ## @@ -54,21 +57,26 @@ public static Path

[jira] [Updated] (HUDI-2593) Enable virtual keys for metadata table

2021-11-15 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HUDI-2593: - Story Points: 15 (was: 10) > Enable virtual keys for metadata table >

[GitHub] [hudi] hudi-bot removed a comment on pull request #3977: [HUDI-2716] InLineFS path conversion support for S3 FS paths

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #3977: URL: https://github.com/apache/hudi/pull/3977#issuecomment-969811686 ## CI report: * 8bb5df882ac134a7f04e66d15bc74f4e63384094 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3977: [HUDI-2716] InLineFS path conversion support for S3 FS paths

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3977: URL: https://github.com/apache/hudi/pull/3977#issuecomment-969816238 ## CI report: * 8bb5df882ac134a7f04e66d15bc74f4e63384094 Azure:

[jira] [Updated] (HUDI-2602) Publish design doc/RFC for metadata based range index

2021-11-15 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HUDI-2602: - Status: Patch Available (was: In Progress) > Publish design doc/RFC for metadata based

[jira] [Updated] (HUDI-2602) Publish design doc/RFC for metadata based range index

2021-11-15 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HUDI-2602: - Story Points: 8 > Publish design doc/RFC for metadata based range index >

[GitHub] [hudi] nsivabalan merged pull request #3947: [HUDI-2712] Fixing list based rollback of partially failed commit which has new partitions

2021-11-15 Thread GitBox
nsivabalan merged pull request #3947: URL: https://github.com/apache/hudi/pull/3947 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] nsivabalan commented on a change in pull request #4003: [HUDI-2734] Setting default metadata enable per engine

2021-11-15 Thread GitBox
nsivabalan commented on a change in pull request #4003: URL: https://github.com/apache/hudi/pull/4003#discussion_r749874318 ## File path: hudi-common/src/main/java/org/apache/hudi/common/config/HoodieMetadataConfig.java ## @@ -233,10 +237,28 @@ public Builder

[GitHub] [hudi] hudi-bot removed a comment on pull request #3977: [HUDI-2716] InLineFS path conversion support for S3 FS paths

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #3977: URL: https://github.com/apache/hudi/pull/3977#issuecomment-966731462 ## CI report: * 8bb5df882ac134a7f04e66d15bc74f4e63384094 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3977: [HUDI-2716] InLineFS path conversion support for S3 FS paths

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3977: URL: https://github.com/apache/hudi/pull/3977#issuecomment-969811686 ## CI report: * 8bb5df882ac134a7f04e66d15bc74f4e63384094 Azure:

[GitHub] [hudi] manojpec commented on pull request #3977: [HUDI-2716] InLineFS path conversion support for S3 FS paths

2021-11-15 Thread GitBox
manojpec commented on pull request #3977: URL: https://github.com/apache/hudi/pull/3977#issuecomment-969807044 @nsivabalan please take one more look. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] manojpec commented on a change in pull request #3977: [HUDI-2716] InLineFS path conversion support for S3 FS paths

2021-11-15 Thread GitBox
manojpec commented on a change in pull request #3977: URL: https://github.com/apache/hudi/pull/3977#discussion_r749873209 ## File path: hudi-common/src/main/java/org/apache/hudi/common/fs/inline/InLineFSUtils.java ## @@ -29,20 +29,23 @@ public class InLineFSUtils {

[GitHub] [hudi] hudi-bot commented on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-969797527 ## CI report: * 2afbd368d00403fda5056e0e8795f18ee4582768 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-969789717 ## CI report: * 4afb1a587e0809c4d6d3106aa33e6cf1eda47f0e Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-11-15 Thread GitBox
hudi-bot removed a comment on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-969785112 ## CI report: * 4afb1a587e0809c4d6d3106aa33e6cf1eda47f0e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-969789717 ## CI report: * 4afb1a587e0809c4d6d3106aa33e6cf1eda47f0e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-11-15 Thread GitBox
hudi-bot commented on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-969785112 ## CI report: * 4afb1a587e0809c4d6d3106aa33e6cf1eda47f0e Azure:

  1   2   3   4   >