[jira] [Created] (HUDI-2265) Adding Trino to Docker setup

2021-08-02 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2265: - Summary: Adding Trino to Docker setup Key: HUDI-2265 URL: https://issues.apache.org/jira/browse/HUDI-2265 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-2267) Test suite infra Automate with playbook

2021-08-02 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2267: - Summary: Test suite infra Automate with playbook Key: HUDI-2267 URL: https://issues.apache.org/jira/browse/HUDI-2267 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-2267) Test suite infra Automate with playbook

2021-08-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2267: -- Fix Version/s: 0.9.0 > Test suite infra Automate with playbook >

[jira] [Commented] (HUDI-2189) Delete partition support in HoodieDeltaStreamer

2021-08-02 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391514#comment-17391514 ] Sagar Sumit commented on HUDI-2189: --- Yeah, it's more like truncate operation. We already have record

[jira] [Commented] (HUDI-2258) Metadata table for flink

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391515#comment-17391515 ] ASF GitHub Bot commented on HUDI-2258: -- hudi-bot edited a comment on pull request #3381: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3381: [HUDI-2258] Metadata table for flink

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3381: URL: https://github.com/apache/hudi/pull/3381#issuecomment-890891194 ## CI report: * 20d4cda110df84fa8c439e683bb84b0484ed0667 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3382: [MINOR] Improving runtime of TestStructuredStreaming by 2 mins

2021-08-02 Thread GitBox
hudi-bot commented on pull request #3382: URL: https://github.com/apache/hudi/pull/3382#issuecomment-891093440 ## CI report: * 308a1b963a182cd31351cf5af83f2daf6a71c3f8 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] vinothchandar commented on pull request #3366: [HUDI-1985] Migrate the hudi site to docusaurus platform (website complete re-design)

2021-08-02 Thread GitBox
vinothchandar commented on pull request #3366: URL: https://github.com/apache/hudi/pull/3366#issuecomment-891253719 - [ ] Use `Current` instead of `Next` for denoting the master build - [ ] Retain the hyperlinks from the current site's footer

[GitHub] [hudi] vinothchandar commented on pull request #3366: [HUDI-1985] Migrate the hudi site to docusaurus platform (website complete re-design)

2021-08-02 Thread GitBox
vinothchandar commented on pull request #3366: URL: https://github.com/apache/hudi/pull/3366#issuecomment-891254028 @vingov this is really good work! and also very laborious. Thanks for doing this! Once we address these, we can land this -- This is an automated message from the Apache

[jira] [Commented] (HUDI-1527) Automatically infer the data directory, users only need to specify the table directory

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391802#comment-17391802 ] ASF GitHub Bot commented on HUDI-1527: -- vinothchandar commented on pull request #3353: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN *

[GitHub] [hudi] dude0001 edited a comment on issue #2409: [SUPPORT] Spark structured Streaming writes to Hudi and synchronizes Hive to create only read-optimized tables without creating real-time tabl

2021-08-02 Thread GitBox
dude0001 edited a comment on issue #2409: URL: https://github.com/apache/hudi/issues/2409#issuecomment-889924380 I'm seeing the same error, and the same symptom of only the _ro table is created. I am using this with AWS Glue (managed) ETL jobs and trying to sync the Hudi metadata to Glue

[GitHub] [hudi] vinothchandar commented on pull request #3353: [HUDI-1527] Automatically infer the full partition path when user only specifies the table path

2021-08-02 Thread GitBox
vinothchandar commented on pull request #3353: URL: https://github.com/apache/hudi/pull/3353#issuecomment-891336366 @pengzhiwei2018 . I am planning on taking this over. If you have cycles, please feel free give it a shot as well. -- This is an automated message from the Apache Git

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391764#comment-17391764 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN *

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391768#comment-17391768 ] ASF GitHub Bot commented on HUDI-1985: -- vinothchandar commented on pull request #3366: URL:

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391769#comment-17391769 ] ASF GitHub Bot commented on HUDI-1985: -- vinothchandar commented on pull request #3366: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN *

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391779#comment-17391779 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391744#comment-17391744 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-02 Thread GitBox
nsivabalan commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r681224528 ## File path: hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/handlers/MarkerHandler.java ## @@ -0,0 +1,184 @@ +/* + * Licensed to

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391783#comment-17391783 ] ASF GitHub Bot commented on HUDI-1138: -- nsivabalan commented on a change in pull request #3233: URL:

[jira] [Updated] (HUDI-2233) [SQL] Hive sync is not working

2021-08-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2233: -- Labels: release-blocker (was: ) > [SQL] Hive sync is not working >

[GitHub] [hudi] vinothchandar commented on pull request #3382: [MINOR] Improving runtime of TestStructuredStreaming by 2 mins

2021-08-02 Thread GitBox
vinothchandar commented on pull request #3382: URL: https://github.com/apache/hudi/pull/3382#issuecomment-891319053 https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=1306=results passed -- This is an automated message from the Apache Git Service. To

[hudi] branch master updated: [MINOR] Improving runtime of TestStructuredStreaming by 2 mins (#3382)

2021-08-02 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new b21ae68 [MINOR] Improving runtime of

[GitHub] [hudi] vinothchandar merged pull request #3382: [MINOR] Improving runtime of TestStructuredStreaming by 2 mins

2021-08-02 Thread GitBox
vinothchandar merged pull request #3382: URL: https://github.com/apache/hudi/pull/3382 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (HUDI-2266) Implement resource manager for cloud sources

2021-08-02 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2266: - Summary: Implement resource manager for cloud sources Key: HUDI-2266 URL: https://issues.apache.org/jira/browse/HUDI-2266 Project: Apache Hudi Issue Type:

[jira] [Commented] (HUDI-2182) Support Compaction Command For Spark Sql

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391801#comment-17391801 ] ASF GitHub Bot commented on HUDI-2182: -- vinothchandar commented on a change in pull request #3277:

[GitHub] [hudi] vinothchandar commented on a change in pull request #3277: [HUDI-2182] Support Compaction Command For Spark Sql

2021-08-02 Thread GitBox
vinothchandar commented on a change in pull request #3277: URL: https://github.com/apache/hudi/pull/3277#discussion_r681271066 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/CompactionHoodiePathCommand.scala ## @@ -0,0 +1,134

[GitHub] [hudi] hudi-bot edited a comment on pull request #3382: [MINOR] Improving runtime of TestStructuredStreaming by 2 mins

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3382: URL: https://github.com/apache/hudi/pull/3382#issuecomment-891093440 ## CI report: * 308a1b963a182cd31351cf5af83f2daf6a71c3f8 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3382: [MINOR] Improving runtime of TestStructuredStreaming by 2 mins

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3382: URL: https://github.com/apache/hudi/pull/3382#issuecomment-891093440 ## CI report: * 308a1b963a182cd31351cf5af83f2daf6a71c3f8 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3382: [MINOR] Improving runtime of TestStructuredStreaming by 2 mins

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3382: URL: https://github.com/apache/hudi/pull/3382#issuecomment-891093440 ## CI report: * ce16fa75704c4de14fb88f73f851051085f92ce0 Azure:

[GitHub] [hudi] nsivabalan merged pull request #3315: [HUDI-2177][HUDI-2200] Adding virtual keys support for MOR

2021-08-02 Thread GitBox
nsivabalan merged pull request #3315: URL: https://github.com/apache/hudi/pull/3315 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated (dde57b2 -> fe50837)

2021-08-02 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from dde57b2 [HUDI-2164] Let users build cluster plan and execute this plan at once using HoodieClusteringJob for

[jira] [Commented] (HUDI-2177) Virtual keys support for Compaction

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391601#comment-17391601 ] ASF GitHub Bot commented on HUDI-2177: -- nsivabalan merged pull request #3315: URL:

[jira] [Updated] (HUDI-2260) Fix hardcoding of SimpleKeyGen for default KeyGenProp for virtual key configs

2021-08-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2260: -- Parent: HUDI-2235 Issue Type: Sub-task (was: Improvement) > Fix hardcoding of

[jira] [Resolved] (HUDI-2177) Virtual keys support for Compaction

2021-08-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-2177. --- Resolution: Fixed > Virtual keys support for Compaction >

[jira] [Resolved] (HUDI-2200) Virtual keys support for MOR table: realtime/snapshot read

2021-08-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-2200. --- Resolution: Fixed > Virtual keys support for MOR table: realtime/snapshot read >

[jira] [Resolved] (HUDI-2236) Add virtual key support to Clustering in MOR

2021-08-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-2236. --- Resolution: Fixed > Add virtual key support to Clustering in MOR >

[jira] [Updated] (HUDI-2260) Fix hardcoding of SimpleKeyGen for default KeyGenProp for virtual key configs

2021-08-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2260: -- Fix Version/s: 0.9.0 > Fix hardcoding of SimpleKeyGen for default KeyGenProp for

[GitHub] [hudi] vinothchandar commented on pull request #3366: [HUDI-1985] Migrate the hudi site to docusaurus platform (website complete re-design)

2021-08-02 Thread GitBox
vinothchandar commented on pull request #3366: URL: https://github.com/apache/hudi/pull/3366#issuecomment-891153432 @vingov this is awesome! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391681#comment-17391681 ] ASF GitHub Bot commented on HUDI-1985: -- vinothchandar commented on pull request #3366: URL:

[GitHub] [hudi] vinothchandar opened a new pull request #3382: [MINOR] Improving runtime of TestStructuredStreaming by 2 mins

2021-08-02 Thread GitBox
vinothchandar opened a new pull request #3382: URL: https://github.com/apache/hudi/pull/3382 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[GitHub] [hudi] hudi-bot edited a comment on pull request #3382: [MINOR] Improving runtime of TestStructuredStreaming by 2 mins

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3382: URL: https://github.com/apache/hudi/pull/3382#issuecomment-891093440 ## CI report: * 308a1b963a182cd31351cf5af83f2daf6a71c3f8 Azure:

[jira] [Created] (HUDI-2260) Fix hardcoding of SimpleKeyGen for default KeyGenProp for virtual key configs

2021-08-02 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2260: - Summary: Fix hardcoding of SimpleKeyGen for default KeyGenProp for virtual key configs Key: HUDI-2260 URL: https://issues.apache.org/jira/browse/HUDI-2260

[GitHub] [hudi] hudi-bot edited a comment on pull request #3382: [MINOR] Improving runtime of TestStructuredStreaming by 2 mins

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3382: URL: https://github.com/apache/hudi/pull/3382#issuecomment-891093440 ## CI report: * 308a1b963a182cd31351cf5af83f2daf6a71c3f8 Azure:

[jira] [Created] (HUDI-2262) Eliminate build warnings

2021-08-02 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2262: - Summary: Eliminate build warnings Key: HUDI-2262 URL: https://issues.apache.org/jira/browse/HUDI-2262 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-2263) Document checkstyle setup

2021-08-02 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2263: - Summary: Document checkstyle setup Key: HUDI-2263 URL: https://issues.apache.org/jira/browse/HUDI-2263 Project: Apache Hudi Issue Type: Sub-task

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391659#comment-17391659 ] sivabalan narayanan commented on HUDI-1842: --- Even with string formatted partition_path, guess

[jira] [Created] (HUDI-2264) Refactor Spark datasource functional tests

2021-08-02 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2264: - Summary: Refactor Spark datasource functional tests Key: HUDI-2264 URL: https://issues.apache.org/jira/browse/HUDI-2264 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-2261) [UMBRELLA] Dev Hygiene Issues

2021-08-02 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2261: - Summary: [UMBRELLA] Dev Hygiene Issues Key: HUDI-2261 URL: https://issues.apache.org/jira/browse/HUDI-2261 Project: Apache Hudi Issue Type: Improvement

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391811#comment-17391811 ] ASF GitHub Bot commented on HUDI-2170: -- vinothchandar commented on a change in pull request #3267:

[GitHub] [hudi] hudi-bot commented on pull request #3383: [HUDI-2151] Enable defaults for out of box performance

2021-08-02 Thread GitBox
hudi-bot commented on pull request #3383: URL: https://github.com/apache/hudi/pull/3383#issuecomment-891428716 ## CI report: * fa321504eff0ee56a7fc0cf578f5743ef497af13 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] hudi-bot edited a comment on pull request #3383: [HUDI-2151] Enable defaults for out of box performance

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3383: URL: https://github.com/apache/hudi/pull/3383#issuecomment-891428716 ## CI report: * fa321504eff0ee56a7fc0cf578f5743ef497af13 Azure:

[jira] [Assigned] (HUDI-2233) [SQL] Hive sync is not working

2021-08-02 Thread pengzhiwei (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengzhiwei reassigned HUDI-2233: Assignee: pengzhiwei > [SQL] Hive sync is not working > -- > >

[hudi] branch master updated (b21ae68 -> aa857be)

2021-08-02 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from b21ae68 [MINOR] Improving runtime of TestStructuredStreaming by 2 mins (#3382) add aa857be [HUDI-2225] Add a

[GitHub] [hudi] yanghua merged pull request #3347: [HUDI-2225] Add a compaction job in hudi-examples

2021-08-02 Thread GitBox
yanghua merged pull request #3347: URL: https://github.com/apache/hudi/pull/3347 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3384: [HUDI-2269] Release the disk map resource for flink streaming reader

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3384: URL: https://github.com/apache/hudi/pull/3384#issuecomment-891490405 ## CI report: * 271a1306778f9d3c5dc24324d57686b529dbde7f Azure:

[jira] [Commented] (HUDI-2247) Filter file where length less than parquet MAGIC length

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391955#comment-17391955 ] ASF GitHub Bot commented on HUDI-2247: -- hudi-bot edited a comment on pull request #3363: URL:

[GitHub] [hudi] vinothchandar commented on pull request #3211: [HUDI-1468] Support more flexible clustering strategies and preserve commit …

2021-08-02 Thread GitBox
vinothchandar commented on pull request #3211: URL: https://github.com/apache/hudi/pull/3211#issuecomment-891366331 @codope @satishkotha what's the next step here? Could I help somehow to get this moving along -- This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (HUDI-2151) Make performant out-of-box configs

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391852#comment-17391852 ] ASF GitHub Bot commented on HUDI-2151: -- hudi-bot edited a comment on pull request #3383: URL:

[jira] [Commented] (HUDI-2151) Make performant out-of-box configs

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391850#comment-17391850 ] ASF GitHub Bot commented on HUDI-2151: -- hudi-bot commented on pull request #3383: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3383: [HUDI-2151] Enable defaults for out of box performance

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3383: URL: https://github.com/apache/hudi/pull/3383#issuecomment-891428716 ## CI report: * fa321504eff0ee56a7fc0cf578f5743ef497af13 Azure:

[GitHub] [hudi] danny0405 commented on pull request #3267: [HUDI-2170] Always choose the latest record for HoodieRecordPayload

2021-08-02 Thread GitBox
danny0405 commented on pull request #3267: URL: https://github.com/apache/hudi/pull/3267#issuecomment-891459773 The issue is taken by my colleague, so close it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] danny0405 closed pull request #3267: [HUDI-2170] Always choose the latest record for HoodieRecordPayload

2021-08-02 Thread GitBox
danny0405 closed pull request #3267: URL: https://github.com/apache/hudi/pull/3267 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-2151) Make performant out-of-box configs

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391863#comment-17391863 ] ASF GitHub Bot commented on HUDI-2151: -- hudi-bot edited a comment on pull request #3383: URL:

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391908#comment-17391908 ] ASF GitHub Bot commented on HUDI-1985: -- vinothchandar merged pull request #3366: URL:

[GitHub] [hudi] vinothchandar merged pull request #3366: [HUDI-1985] Migrate the hudi site to docusaurus platform (website complete re-design)

2021-08-02 Thread GitBox
vinothchandar merged pull request #3366: URL: https://github.com/apache/hudi/pull/3366 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-1468) incremental read support with clustering

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391812#comment-17391812 ] ASF GitHub Bot commented on HUDI-1468: -- vinothchandar commented on pull request #3211: URL:

[GitHub] [hudi] nsivabalan commented on pull request #3267: [HUDI-2170] Always choose the latest record for HoodieRecordPayload

2021-08-02 Thread GitBox
nsivabalan commented on pull request #3267: URL: https://github.com/apache/hudi/pull/3267#issuecomment-891469002 @danny0405 : can you ask your colleague to CC me in the patch once he/she has put up one. -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391892#comment-17391892 ] ASF GitHub Bot commented on HUDI-2170: -- nsivabalan commented on pull request #3267: URL:

[jira] [Commented] (HUDI-1527) Automatically infer the data directory, users only need to specify the table directory

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391920#comment-17391920 ] ASF GitHub Bot commented on HUDI-1527: -- pengzhiwei2018 commented on pull request #3353: URL:

[jira] [Commented] (HUDI-2269) Release the disk map resource for flink streaming reader

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391919#comment-17391919 ] ASF GitHub Bot commented on HUDI-2269: -- danny0405 opened a new pull request #3384: URL:

[jira] [Updated] (HUDI-2269) Release the disk map resource for flink streaming reader

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2269: - Labels: pull-request-available (was: ) > Release the disk map resource for flink streaming

[GitHub] [hudi] danny0405 opened a new pull request #3384: [HUDI-2269] Release the disk map resource for flink streaming reader

2021-08-02 Thread GitBox
danny0405 opened a new pull request #3384: URL: https://github.com/apache/hudi/pull/3384 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[GitHub] [hudi] pengzhiwei2018 commented on pull request #3353: [HUDI-1527] Automatically infer the full partition path when user only specifies the table path

2021-08-02 Thread GitBox
pengzhiwei2018 commented on pull request #3353: URL: https://github.com/apache/hudi/pull/3353#issuecomment-891489626 > please feel free give it a shot as well > @vinothchandar It works for CoW, the final test in `TestMORDataSource.java` fails, so I have special cased it for

[jira] [Closed] (HUDI-2225) Add compaction example

2021-08-02 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-2225. -- Fix Version/s: 0.9.0 Resolution: Done aa857beee00a764cee90d6e790ee4b0ab4ad4862 > Add compaction example

[GitHub] [hudi] hudi-bot edited a comment on pull request #3381: [HUDI-2258] Metadata table for flink

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3381: URL: https://github.com/apache/hudi/pull/3381#issuecomment-890891194 ## CI report: * ab7c145c737dc47fd3fc3121ab13e0d0f7ec40bc Azure:

[jira] [Commented] (HUDI-2258) Metadata table for flink

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391929#comment-17391929 ] ASF GitHub Bot commented on HUDI-2258: -- hudi-bot edited a comment on pull request #3381: URL:

[jira] [Commented] (HUDI-2225) Add compaction example

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391927#comment-17391927 ] ASF GitHub Bot commented on HUDI-2225: -- yanghua merged pull request #3347: URL:

[GitHub] [hudi] satishmittal1111 opened a new pull request #3385: [HUDI-2263] add steps for checkstyle

2021-08-02 Thread GitBox
satishmittal opened a new pull request #3385: URL: https://github.com/apache/hudi/pull/3385 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose

[jira] [Commented] (HUDI-2269) Release the disk map resource for flink streaming reader

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391949#comment-17391949 ] ASF GitHub Bot commented on HUDI-2269: -- hudi-bot edited a comment on pull request #3384: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3384: [HUDI-2269] Release the disk map resource for flink streaming reader

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3384: URL: https://github.com/apache/hudi/pull/3384#issuecomment-891490405 ## CI report: * 271a1306778f9d3c5dc24324d57686b529dbde7f Azure:

[jira] [Commented] (HUDI-2269) Release the disk map resource for flink streaming reader

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391943#comment-17391943 ] ASF GitHub Bot commented on HUDI-2269: -- hudi-bot edited a comment on pull request #3384: URL:

[jira] [Commented] (HUDI-2208) [SQL] Support Bulk Insert For Spark Sql

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391810#comment-17391810 ] ASF GitHub Bot commented on HUDI-2208: -- nsivabalan commented on a change in pull request #3328: URL:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-08-02 Thread GitBox
nsivabalan commented on a change in pull request #3328: URL: https://github.com/apache/hudi/pull/3328#discussion_r680197209 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/InsertIntoHoodieTableCommand.scala ## @@ -209,19 +209,32

[GitHub] [hudi] vinothchandar commented on a change in pull request #3267: [HUDI-2170] Always choose the latest record for HoodieRecordPayload

2021-08-02 Thread GitBox
vinothchandar commented on a change in pull request #3267: URL: https://github.com/apache/hudi/pull/3267#discussion_r681298546 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/OverwriteWithLatestAvroPayload.java ## @@ -25,8 +25,12 @@ import

[jira] [Updated] (HUDI-2268) Upgrade hoodie table to 0.9.0

2021-08-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2268: -- Description: Wrt upgrading/downgrading hoodie.properties, here is what we can go.  Add

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391874#comment-17391874 ] ASF GitHub Bot commented on HUDI-2170: -- danny0405 closed pull request #3267: URL:

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391872#comment-17391872 ] ASF GitHub Bot commented on HUDI-2170: -- danny0405 commented on pull request #3267: URL:

[jira] [Created] (HUDI-2269) Release the disk map resource for flink streaming reader

2021-08-02 Thread Danny Chen (Jira)
Danny Chen created HUDI-2269: Summary: Release the disk map resource for flink streaming reader Key: HUDI-2269 URL: https://issues.apache.org/jira/browse/HUDI-2269 Project: Apache Hudi Issue

[GitHub] [hudi] danny0405 commented on pull request #3267: [HUDI-2170] Always choose the latest record for HoodieRecordPayload

2021-08-02 Thread GitBox
danny0405 commented on pull request #3267: URL: https://github.com/apache/hudi/pull/3267#issuecomment-891490535 Sure, would cc you to review when he fires the PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (HUDI-2269) Release the disk map resource for flink streaming reader

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391923#comment-17391923 ] ASF GitHub Bot commented on HUDI-2269: -- hudi-bot commented on pull request #3384: URL:

[jira] [Commented] (HUDI-2170) Always choose the latest record for HoodieRecordPayload

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391924#comment-17391924 ] ASF GitHub Bot commented on HUDI-2170: -- danny0405 commented on pull request #3267: URL:

[GitHub] [hudi] hudi-bot commented on pull request #3384: [HUDI-2269] Release the disk map resource for flink streaming reader

2021-08-02 Thread GitBox
hudi-bot commented on pull request #3384: URL: https://github.com/apache/hudi/pull/3384#issuecomment-891490405 ## CI report: * 271a1306778f9d3c5dc24324d57686b529dbde7f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Commented] (HUDI-2247) Filter file where length less than parquet MAGIC length

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391930#comment-17391930 ] ASF GitHub Bot commented on HUDI-2247: -- hudi-bot edited a comment on pull request #3363: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3363: [HUDI-2247] Filter file where length less than parquet MAGIC length

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3363: URL: https://github.com/apache/hudi/pull/3363#issuecomment-888165582 ## CI report: * 3aaac96fc79ce3e927c5f7e85d4c79e6ab3c83c9 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3384: [HUDI-2269] Release the disk map resource for flink streaming reader

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3384: URL: https://github.com/apache/hudi/pull/3384#issuecomment-891490405 ## CI report: * 271a1306778f9d3c5dc24324d57686b529dbde7f Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3384: [HUDI-2269] Release the disk map resource for flink streaming reader

2021-08-02 Thread GitBox
hudi-bot edited a comment on pull request #3384: URL: https://github.com/apache/hudi/pull/3384#issuecomment-891490405 ## CI report: * 271a1306778f9d3c5dc24324d57686b529dbde7f Azure:

[jira] [Commented] (HUDI-2269) Release the disk map resource for flink streaming reader

2021-08-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17391953#comment-17391953 ] ASF GitHub Bot commented on HUDI-2269: -- hudi-bot edited a comment on pull request #3384: URL:

  1   2   3   >