[jira] [Updated] (HUDI-2452) spark on hudi metadata key length < 0 and file not found error

2021-11-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2452: - Labels: (was: sev:critical) > spark on hudi metadata key length < 0 and file not found error >

[jira] [Created] (HUDI-2724) Benchamark connector

2021-11-09 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2724: - Summary: Benchamark connector Key: HUDI-2724 URL: https://issues.apache.org/jira/browse/HUDI-2724 Project: Apache Hudi Issue Type: Sub-task Reporter:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964171790 ## CI report: * bb54241f6f48e05192a289089d75dde77118ff29 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964747579 ## CI report: * bb54241f6f48e05192a289089d75dde77118ff29 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-964769572 ## CI report: * e1fa12b9a35058673bdefa9859dffa9c10c1535a Azure:

[GitHub] [hudi] vinothchandar commented on a change in pull request #3955: [HUDI-2718] ExternalSpillableMap payload size re-estimation throws ArithmeticException

2021-11-09 Thread GitBox
vinothchandar commented on a change in pull request #3955: URL: https://github.com/apache/hudi/pull/3955#discussion_r746288477 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/collection/ExternalSpillableMap.java ## @@ -204,19 +205,21 @@ public R get(Object

[hudi] branch master updated (fd0f5df -> a40ac62)

2021-11-09 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from fd0f5df [HUDI-2297] Estimate available memory size for spillable map accurately. (#3455) add a40ac62

[jira] [Resolved] (HUDI-2086) redo the logical of mor_incremental_view for hive

2021-11-09 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2086. -- > redo the logical of mor_incremental_view for hive > - > >

[jira] [Updated] (HUDI-2086) redo the logical of mor_incremental_view for hive

2021-11-09 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2086: - Affects Version/s: 0.9.0 > redo the logical of mor_incremental_view for hive >

[jira] [Updated] (HUDI-2086) redo the logical of mor_incremental_view for hive

2021-11-09 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2086: - Fix Version/s: 0.10.0 > redo the logical of mor_incremental_view for hive >

[GitHub] [hudi] danny0405 merged pull request #3203: [HUDI-2086] Refactor hive mor_incremental_view

2021-11-09 Thread GitBox
danny0405 merged pull request #3203: URL: https://github.com/apache/hudi/pull/3203 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (HUDI-2730) Move EventTimeAvroPayload into hudi-common module

2021-11-09 Thread Danny Chen (Jira)
Danny Chen created HUDI-2730: Summary: Move EventTimeAvroPayload into hudi-common module Key: HUDI-2730 URL: https://issues.apache.org/jira/browse/HUDI-2730 Project: Apache Hudi Issue Type: Task

[jira] [Updated] (HUDI-2691) Implement connector metadata

2021-11-09 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2691: -- Summary: Implement connector metadata (was: Implement connector SPIs) > Implement connector metadata >

[GitHub] [hudi] hudi-bot commented on pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-964753119 ## CI report: * e1fa12b9a35058673bdefa9859dffa9c10c1535a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[hudi] branch master updated (dfe3b84 -> bb6a19e)

2021-11-09 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from dfe3b84 [HUDI-2579] Make deltastreamer checkpoint state merging more explicit (#3820) add bb6a19e [HUDI-1877]

[jira] [Updated] (HUDI-1877) clustering support for external index

2021-11-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1877: - Status: Closed (was: Patch Available) > clustering support for external index >

[jira] [Reopened] (HUDI-1877) clustering support for external index

2021-11-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reopened HUDI-1877: -- > clustering support for external index > - > >

[jira] [Resolved] (HUDI-1877) clustering support for external index

2021-11-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-1877. -- > clustering support for external index > - > >

[GitHub] [hudi] vinothchandar merged pull request #3833: [HUDI-1877] Support records staying in same fileId after clustering

2021-11-09 Thread GitBox
vinothchandar merged pull request #3833: URL: https://github.com/apache/hudi/pull/3833 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated (bb6a19e -> fd0f5df)

2021-11-09 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from bb6a19e [HUDI-1877] Support records staying in same fileId after clustering (#3833) add fd0f5df [HUDI-2297]

[GitHub] [hudi] garyli1019 merged pull request #3455: [HUDI-2297] Estimate available memory size accurately for spillable map.

2021-11-09 Thread GitBox
garyli1019 merged pull request #3455: URL: https://github.com/apache/hudi/pull/3455 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Assigned] (HUDI-2730) Move EventTimeAvroPayload into hudi-common module

2021-11-09 Thread yuzhaojing (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuzhaojing reassigned HUDI-2730: Assignee: yuzhaojing > Move EventTimeAvroPayload into hudi-common module >

[GitHub] [hudi] hudi-bot commented on pull request #3955: [HUDI-2718] ExternalSpillableMap payload size re-estimation throws ArithmeticException

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3955: URL: https://github.com/apache/hudi/pull/3955#issuecomment-964661625 ## CI report: * a580e6377fbf3e65d1c04eef66f40793a410acb9 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3955: [HUDI-2718] ExternalSpillableMap payload size re-estimation throws ArithmeticException

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3955: URL: https://github.com/apache/hudi/pull/3955#issuecomment-964646448 ## CI report: * a580e6377fbf3e65d1c04eef66f40793a410acb9 Azure:

[jira] [Assigned] (HUDI-1866) Investigate if hive-sync works as expected in a quickstart environment for 0.8

2021-11-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-1866: Assignee: Alexey Kudinkin (was: Nishith Agarwal) > Investigate if hive-sync works as

[jira] [Updated] (HUDI-1866) Investigate if hive-sync works as expected in a quickstart environment

2021-11-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1866: - Summary: Investigate if hive-sync works as expected in a quickstart environment (was:

[jira] [Commented] (HUDI-1866) Investigate if hive-sync works as expected in a quickstart environment

2021-11-09 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441443#comment-17441443 ] Vinoth Chandar commented on HUDI-1866: -- [~alexey.kudinkin] this is jsut a small verification ticket.

[jira] [Created] (HUDI-2720) Document File Sizing

2021-11-09 Thread Kyle Weller (Jira)
Kyle Weller created HUDI-2720: - Summary: Document File Sizing Key: HUDI-2720 URL: https://issues.apache.org/jira/browse/HUDI-2720 Project: Apache Hudi Issue Type: Sub-task Reporter:

[jira] [Created] (HUDI-2722) Implement conenctor splits and split manager

2021-11-09 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2722: - Summary: Implement conenctor splits and split manager Key: HUDI-2722 URL: https://issues.apache.org/jira/browse/HUDI-2722 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-2721) Implement connector data sources

2021-11-09 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2721: - Summary: Implement connector data sources Key: HUDI-2721 URL: https://issues.apache.org/jira/browse/HUDI-2721 Project: Apache Hudi Issue Type: Sub-task

[jira] [Updated] (HUDI-2641) One inflight commit rolling back other concurrent inflight commits causing them to fail

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2641: - Labels: pull-request-available release-blocker (was: release-blocker) > One inflight commit

[GitHub] [hudi] hudi-bot commented on pull request #3956: [HUDI-2641] Avoid deleting all inflight commits heartbeats while rolling back failed writes

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3956: URL: https://github.com/apache/hudi/pull/3956#issuecomment-964723639 ## CI report: * add8acecb367ee7b8506e5abda9137d203e34645 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Assigned] (HUDI-2726) Document the different utilities (snapshotter, exporter, schemaprovider etc)

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller reassigned HUDI-2726: - Assignee: Kyle Weller > Document the different utilities (snapshotter, exporter, schemaprovider

[GitHub] [hudi] hudi-bot commented on pull request #3956: [HUDI-2641] Avoid deleting all inflight commits heartbeats while rolling back failed writes

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3956: URL: https://github.com/apache/hudi/pull/3956#issuecomment-964746409 ## CI report: * add8acecb367ee7b8506e5abda9137d203e34645 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-964753986 ## CI report: * e1fa12b9a35058673bdefa9859dffa9c10c1535a Azure:

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3956: [HUDI-2641] Avoid deleting all inflight commits heartbeats while rolling back failed writes

2021-11-09 Thread GitBox
zhangyue19921010 commented on a change in pull request #3956: URL: https://github.com/apache/hudi/pull/3956#discussion_r746260110 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java ## @@ -856,13 +856,9 @@ protected

[GitHub] [hudi] yuzhaojing commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
yuzhaojing commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964840749 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot removed a comment on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964862614 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN *

[jira] [Commented] (HUDI-2729) Fix the options of flink quick start page

2021-11-09 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441557#comment-17441557 ] Danny Chen commented on HUDI-2729: -- Fixed via master branch: e4d28aa366560ab68136821f3a1297fd9a9fd18c >

[GitHub] [hudi] hudi-bot commented on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964863983 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 73094907e1ed6ea6083736582a10f9f7910a5562

[jira] [Resolved] (HUDI-2729) Fix the options of flink quick start page

2021-11-09 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2729. -- > Fix the options of flink quick start page > - > >

[jira] [Updated] (HUDI-2727) Add prometheus reporter docs

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2727: -- Fix Version/s: 0.10.0 > Add prometheus reporter docs > > >

[jira] [Updated] (HUDI-2720) Add File Sizing doc

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2720: -- Fix Version/s: 0.10.0 > Add File Sizing doc > --- > > Key: HUDI-2720 >

[jira] [Updated] (HUDI-2728) Clean up concepts and consolidate from cwiki

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2728: -- Fix Version/s: 0.10.0 > Clean up concepts and consolidate from cwiki >

[jira] [Updated] (HUDI-2725) Add precommit validators doc

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2725: -- Fix Version/s: 0.10.0 > Add precommit validators doc > > >

[jira] [Updated] (HUDI-2726) Document the different utilities (snapshotter, exporter, schemaprovider etc)

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2726: -- Fix Version/s: 0.10.0 > Document the different utilities (snapshotter, exporter, schemaprovider etc) >

[jira] [Updated] (HUDI-2688) RFC

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2688: - Labels: pull-request-available (was: ) > RFC > --- > > Key: HUDI-2688 >

[GitHub] [hudi] codope opened a new pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
codope opened a new pull request #3957: URL: https://github.com/apache/hudi/pull/3957 Add implementation details Update table with new rfc ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review

[GitHub] [hudi] nsivabalan commented on pull request #2069: [WIP][HUDI-945] Cleanup Spillable map files eagerly for DiskBasedMap

2021-11-09 Thread GitBox
nsivabalan commented on pull request #2069: URL: https://github.com/apache/hudi/pull/2069#issuecomment-964767074 @bvaradar : Can you chime in here please. Can you check Rajesh's comment above. Can you help us understand if we need to fix the concurrency on spillable map as such or should

[GitHub] [hudi] caneGuy commented on pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
caneGuy commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-964819219 greate @codope thanks for this. i will take a look later this week! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] hudi-bot commented on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964865467 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 73094907e1ed6ea6083736582a10f9f7910a5562

[GitHub] [hudi] hudi-bot removed a comment on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964863983 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #3955: [HUDI-2718] ExternalSpillableMap payload size re-estimation throws ArithmeticException

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3955: URL: https://github.com/apache/hudi/pull/3955#issuecomment-964688002 ## CI report: * 6c6b38a59d917c0a637f74ced4a623b1e82cb314 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3955: [HUDI-2718] ExternalSpillableMap payload size re-estimation throws ArithmeticException

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3955: URL: https://github.com/apache/hudi/pull/3955#issuecomment-964661625 ## CI report: * a580e6377fbf3e65d1c04eef66f40793a410acb9 Azure:

[GitHub] [hudi] umehrot2 opened a new pull request #3956: [HUDI-2663] Avoid deleting all inflight commits heartbeats while rolling back failed writes

2021-11-09 Thread GitBox
umehrot2 opened a new pull request #3956: URL: https://github.com/apache/hudi/pull/3956 ## What is the purpose of the pull request This PR resolves a critical with Hudi concurrent writes feature, which has been described in more detail in

[jira] [Created] (HUDI-2726) Document the different utilities (snapshotter, exporter, etc)

2021-11-09 Thread Kyle Weller (Jira)
Kyle Weller created HUDI-2726: - Summary: Document the different utilities (snapshotter, exporter, etc) Key: HUDI-2726 URL: https://issues.apache.org/jira/browse/HUDI-2726 Project: Apache Hudi

[jira] [Created] (HUDI-2725) Add precommit validators doc

2021-11-09 Thread Kyle Weller (Jira)
Kyle Weller created HUDI-2725: - Summary: Add precommit validators doc Key: HUDI-2725 URL: https://issues.apache.org/jira/browse/HUDI-2725 Project: Apache Hudi Issue Type: Sub-task

[GitHub] [hudi] nsivabalan commented on a change in pull request #3486: [HUDI-2314] Add support for DynamoDb based lock

2021-11-09 Thread GitBox
nsivabalan commented on a change in pull request #3486: URL: https://github.com/apache/hudi/pull/3486#discussion_r741536160 ## File path: hudi-client/hudi-client-common/pom.xml ## @@ -218,6 +222,27 @@ ${zk-curator.version} test + + com.amazonaws

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964748875 ## CI report: * bb54241f6f48e05192a289089d75dde77118ff29 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964747579 ## CI report: * bb54241f6f48e05192a289089d75dde77118ff29 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-964753986 ## CI report: * e1fa12b9a35058673bdefa9859dffa9c10c1535a Azure:

[jira] [Commented] (HUDI-2656) Generalize HoodieIndex for flexible record data type

2021-11-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441499#comment-17441499 ] Ethan Guo commented on HUDI-2656: - The work to generalize HoodieIndex aims to unblock the implementation

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964816532 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964765984 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964841042 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN * 49a813a067fccf3bad68648b7b0164d7d36a5947

[GitHub] [hudi] hudi-bot removed a comment on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-961589881 ## CI report: * f20758076b7fd9355a6b3075fc03d93982b80cc9 UNKNOWN * 4efd2f4b2a47c7417aa6dc84ef40162637448fdf UNKNOWN *

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964821274 ## CI report: * 5c71686aff049029f1080a624a7e235445635e30 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964841135 ## CI report: * 5c71686aff049029f1080a624a7e235445635e30 Azure:

[jira] [Commented] (HUDI-2086) redo the logical of mor_incremental_view for hive

2021-11-09 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441555#comment-17441555 ] Danny Chen commented on HUDI-2086: -- Fixed via master branch: a40ac62e0ce7ec807a00803d23ed223d7c607459 >

[jira] [Updated] (HUDI-2720) Add File Sizing doc

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2720: -- Summary: Add File Sizing doc (was: Document File Sizing) > Add File Sizing doc > --- >

[jira] [Created] (HUDI-2723) Add product integration tests

2021-11-09 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-2723: - Summary: Add product integration tests Key: HUDI-2723 URL: https://issues.apache.org/jira/browse/HUDI-2723 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-2728) Clean up concepts and consolidate from cwiki

2021-11-09 Thread Kyle Weller (Jira)
Kyle Weller created HUDI-2728: - Summary: Clean up concepts and consolidate from cwiki Key: HUDI-2728 URL: https://issues.apache.org/jira/browse/HUDI-2728 Project: Apache Hudi Issue Type:

[GitHub] [hudi] codope commented on pull request #3957: [HUDI-2688][RFC-37] A new Hudi connector for Trino

2021-11-09 Thread GitBox
codope commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-964758378 cc: @vinothchandar @bvaradar @caneGuy @yihua -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3956: [HUDI-2641] Avoid deleting all inflight commits heartbeats while rolling back failed writes

2021-11-09 Thread GitBox
zhangyue19921010 commented on a change in pull request #3956: URL: https://github.com/apache/hudi/pull/3956#discussion_r746260110 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java ## @@ -856,13 +856,9 @@ protected

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3956: [HUDI-2641] Avoid deleting all inflight commits heartbeats while rolling back failed writes

2021-11-09 Thread GitBox
zhangyue19921010 commented on a change in pull request #3956: URL: https://github.com/apache/hudi/pull/3956#discussion_r746260110 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java ## @@ -856,13 +856,9 @@ protected

[GitHub] [hudi] xiarixiaoyao commented on pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-11-09 Thread GitBox
xiarixiaoyao commented on pull request #3330: URL: https://github.com/apache/hudi/pull/3330#issuecomment-964815945 @vinothchandar Of course, let's finish this together -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964817766 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964820149 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure:

[GitHub] [hudi] vinothchandar commented on pull request #3875: [HUDI-2442] Change default values for certain clustering configs

2021-11-09 Thread GitBox
vinothchandar commented on pull request #3875: URL: https://github.com/apache/hudi/pull/3875#issuecomment-964836911 Makes sense to me as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] danny0405 opened a new pull request #3958: [HUDI-2729] Fix the options of flink quick start page

2021-11-09 Thread GitBox
danny0405 opened a new pull request #3958: URL: https://github.com/apache/hudi/pull/3958 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Updated] (HUDI-2729) Fix the options of flink quick start page

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2729: - Labels: pull-request-available (was: ) > Fix the options of flink quick start page >

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3808: [HUDI-2560] introduce id_based schema to support full schema evolution.

2021-11-09 Thread GitBox
xiarixiaoyao commented on a change in pull request #3808: URL: https://github.com/apache/hudi/pull/3808#discussion_r746325758 ## File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/utils/AvroSchemaUtil.java ## @@ -0,0 +1,276 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964845144 ## CI report: * 5c71686aff049029f1080a624a7e235445635e30 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964871330 ## CI report: * 5c71686aff049029f1080a624a7e235445635e30 Azure:

[jira] [Assigned] (HUDI-2720) Add File Sizing doc

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller reassigned HUDI-2720: - Assignee: Kyle Weller > Add File Sizing doc > --- > > Key:

[jira] [Assigned] (HUDI-2725) Add precommit validators doc

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller reassigned HUDI-2725: - Assignee: Kyle Weller > Add precommit validators doc > > >

[jira] [Updated] (HUDI-2725) Add precommit validators doc

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2725: -- Priority: Blocker (was: Major) > Add precommit validators doc > > >

[jira] [Updated] (HUDI-2726) Document the different utilities (snapshotter, exporter, schemaprovider etc)

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2726: -- Priority: Blocker (was: Major) > Document the different utilities (snapshotter, exporter,

[jira] [Updated] (HUDI-2636) Make release notes discoverable

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2636: -- Priority: Blocker (was: Minor) > Make release notes discoverable > --- > >

[jira] [Updated] (HUDI-2720) Add File Sizing doc

2021-11-09 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2720: -- Priority: Blocker (was: Major) > Add File Sizing doc > --- > > Key:

[jira] [Updated] (HUDI-2516) Upgrade to Junit 5.8.1

2021-11-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2516: - Priority: Critical (was: Blocker) > Upgrade to Junit 5.8.1 > -- > >

[jira] [Resolved] (HUDI-2579) Deltastreamer checkpoint metadata is not merged from previous commit instant

2021-11-09 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-2579. --- > Deltastreamer checkpoint metadata is not merged from previous commit instant >

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964748875 ## CI report: * bb54241f6f48e05192a289089d75dde77118ff29 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964765984 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot removed a comment on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964816532 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3928: [HUDI-2685] Support scheduling online compaction plan when there are …

2021-11-09 Thread GitBox
hudi-bot commented on pull request #3928: URL: https://github.com/apache/hudi/pull/3928#issuecomment-964817766 ## CI report: * fbfaf76c7484b975b915650e5a1aef02775850aa Azure:

[GitHub] [hudi] yuzhaojing commented on pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-09 Thread GitBox
yuzhaojing commented on pull request #3888: URL: https://github.com/apache/hudi/pull/3888#issuecomment-964864484 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Assigned] (HUDI-2593) Enable virtual keys for metadata table

2021-11-09 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy reassigned HUDI-2593: Assignee: Manoj Govindassamy (was: Vinoth Chandar) > Enable virtual keys for

[jira] [Commented] (HUDI-2593) Enable virtual keys for metadata table

2021-11-09 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441442#comment-17441442 ] Manoj Govindassamy commented on HUDI-2593: -- My bad, my intention was not close the ticket, but

[jira] [Closed] (HUDI-2655) Non partitioned dataset with metadata fails

2021-11-09 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-2655. - Resolution: Invalid > Non partitioned dataset with metadata fails >

  1   2   3   >