[GitHub] [hudi] n3nash commented on a change in pull request #2542: [WIP] Global consistency

2021-06-04 Thread GitBox
n3nash commented on a change in pull request #2542: URL: https://github.com/apache/hudi/pull/2542#discussion_r645799116 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.java ## @@ -96,9 +96,9 @@ private HoodieArchivedTimeline

[GitHub] [hudi] wangxianghu commented on pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

2021-06-04 Thread GitBox
wangxianghu commented on pull request #2993: URL: https://github.com/apache/hudi/pull/2993#issuecomment-855174332 @nsivabalan this pr is ready now, please take a look when free -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[hudi] branch master updated: [HUDI-1954] only reset bucket when flush bucket success (#3029)

2021-06-04 Thread garyli
This is an automated email from the ASF dual-hosted git repository. garyli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new c4a2ad2 [HUDI-1954] only reset bucket when flush

[GitHub] [hudi] garyli1019 merged pull request #3029: [HUDI-1954] Only reset bucket when flush bucket success

2021-06-04 Thread GitBox
garyli1019 merged pull request #3029: URL: https://github.com/apache/hudi/pull/3029 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3018: [HUDI-1281] Add deltacommit to ActionType

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #3018: URL: https://github.com/apache/hudi/pull/3018#issuecomment-851564696 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] n3nash commented on issue #3009: Dependency error when attempt to build Hudi from git source ..

2021-06-04 Thread GitBox
n3nash commented on issue #3009: URL: https://github.com/apache/hudi/issues/3009#issuecomment-855184359 @arun990 A fix for this was landed today -> https://github.com/apache/hudi/pull/3034 Can you check if the master works for you now ? -- This is an automated message from the Apache

[GitHub] [hudi] n3nash commented on issue #2905: Website redesign

2021-06-04 Thread GitBox
n3nash commented on issue #2905: URL: https://github.com/apache/hudi/issues/2905#issuecomment-855188325 @xushiyan LGTM! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hudi] n3nash commented on a change in pull request #2542: [WIP] Global consistency

2021-06-04 Thread GitBox
n3nash commented on a change in pull request #2542: URL: https://github.com/apache/hudi/pull/2542#discussion_r645800278 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/InputPathHandler.java ## @@ -50,20 +59,22 @@ private final Map>

[GitHub] [hudi] n3nash commented on a change in pull request #2542: [WIP] Global consistency

2021-06-04 Thread GitBox
n3nash commented on a change in pull request #2542: URL: https://github.com/apache/hudi/pull/2542#discussion_r645800278 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/InputPathHandler.java ## @@ -50,20 +59,22 @@ private final Map>

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2993: URL: https://github.com/apache/hudi/pull/2993#issuecomment-848384059 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2963: URL: https://github.com/apache/hudi/pull/2963#issuecomment-843155329 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] wangxianghu commented on a change in pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

2021-06-04 Thread GitBox
wangxianghu commented on a change in pull request #3024: URL: https://github.com/apache/hudi/pull/3024#discussion_r645943934 ## File path: hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableSink.java ## @@ -73,10 +76,20 @@ public SinkRuntimeProvider

[GitHub] [hudi] wangxianghu commented on a change in pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

2021-06-04 Thread GitBox
wangxianghu commented on a change in pull request #3024: URL: https://github.com/apache/hudi/pull/3024#discussion_r645943833 ## File path: hudi-flink/src/main/java/org/apache/hudi/streamer/HoodieFlinkStreamer.java ## @@ -93,8 +95,15 @@ public static void main(String[] args)

[jira] [Updated] (HUDI-1958) [Umbrella] Follow up items from 1 pass over GH issues

2021-06-04 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1958: -- Summary: [Umbrella] Follow up items from 1 pass over GH issues (was: [Umbrella] Improve

[GitHub] [hudi] wangxianghu commented on a change in pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

2021-06-04 Thread GitBox
wangxianghu commented on a change in pull request #3024: URL: https://github.com/apache/hudi/pull/3024#discussion_r645943833 ## File path: hudi-flink/src/main/java/org/apache/hudi/streamer/HoodieFlinkStreamer.java ## @@ -93,8 +95,15 @@ public static void main(String[] args)

[GitHub] [hudi] yuzhaojing commented on pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

2021-06-04 Thread GitBox
yuzhaojing commented on pull request #3024: URL: https://github.com/apache/hudi/pull/3024#issuecomment-855187253 @wangxianghu @danny0405 Thanks for review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] vinothchandar commented on issue #2905: Website redesign

2021-06-04 Thread GitBox
vinothchandar commented on issue #2905: URL: https://github.com/apache/hudi/issues/2905#issuecomment-854946774 The new nav makes sense! How do we proceed? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] garyli1019 commented on a change in pull request #3026: [HUDI-1931] BucketAssignFunction use ValueState instead of MapState

2021-06-04 Thread GitBox
garyli1019 commented on a change in pull request #3026: URL: https://github.com/apache/hudi/pull/3026#discussion_r645929404 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/partitioner/BucketAssignFunction.java ## @@ -138,7 +139,7 @@ public void open(Configuration

[GitHub] [hudi] wangxianghu commented on a change in pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-06-04 Thread GitBox
wangxianghu commented on a change in pull request #2963: URL: https://github.com/apache/hudi/pull/2963#discussion_r645932010 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/schema/SchemaProvider.java ## @@ -34,18 +32,9 @@ @PublicAPIClass(maturity =

[jira] [Assigned] (HUDI-1971) Debug small file handling taking a long time

2021-06-04 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal reassigned HUDI-1971: - Assignee: Nishith Agarwal > Debug small file handling taking a long time >

[jira] [Created] (HUDI-1971) Debug small file handling taking a long time

2021-06-04 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-1971: - Summary: Debug small file handling taking a long time Key: HUDI-1971 URL: https://issues.apache.org/jira/browse/HUDI-1971 Project: Apache Hudi Issue Type:

[GitHub] [hudi] n3nash commented on issue #2941: the step of get small file has very poor performance by spark struct streaming

2021-06-04 Thread GitBox
n3nash commented on issue #2941: URL: https://github.com/apache/hudi/issues/2941#issuecomment-855185973 @dong0808 Can you provide more details to help debug this issue ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] n3nash commented on issue #2924: [SUPPORT]presto query:could not initialize class org.apache.hudi.common.util.HoodieAvroUtils

2021-06-04 Thread GitBox
n3nash commented on issue #2924: URL: https://github.com/apache/hudi/issues/2924#issuecomment-855186102 @root18039532923 Can you confirm if hudi-hadoop-mr bundle is in the classpath ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2833: URL: https://github.com/apache/hudi/pull/2833#issuecomment-828792354 #

[GitHub] [hudi] wangxianghu commented on a change in pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-06-04 Thread GitBox
wangxianghu commented on a change in pull request #2963: URL: https://github.com/apache/hudi/pull/2963#discussion_r645924017 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/schema/SchemaProvider.java ## @@ -34,18 +32,9 @@ @PublicAPIClass(maturity =

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2993: URL: https://github.com/apache/hudi/pull/2993#issuecomment-848384059 #

[GitHub] [hudi] wangxianghu commented on a change in pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-06-04 Thread GitBox
wangxianghu commented on a change in pull request #2963: URL: https://github.com/apache/hudi/pull/2963#discussion_r645925416 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/schema/SchemaProvider.java ## @@ -34,18 +32,9 @@ @PublicAPIClass(maturity =

[GitHub] [hudi] wangxianghu commented on a change in pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-06-04 Thread GitBox
wangxianghu commented on a change in pull request #2963: URL: https://github.com/apache/hudi/pull/2963#discussion_r645925416 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/schema/SchemaProvider.java ## @@ -34,18 +32,9 @@ @PublicAPIClass(maturity =

[GitHub] [hudi] n3nash commented on a change in pull request #2542: [WIP] Global consistency

2021-06-04 Thread GitBox
n3nash commented on a change in pull request #2542: URL: https://github.com/apache/hudi/pull/2542#discussion_r645798650 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/InputPathHandler.java ## @@ -50,20 +59,22 @@ private final Map>

[GitHub] [hudi] vinothchandar commented on a change in pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-06-04 Thread GitBox
vinothchandar commented on a change in pull request #2833: URL: https://github.com/apache/hudi/pull/2833#discussion_r645552783 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieHBaseIndexConfig.java ## @@ -18,107 +18,133 @@ package

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2833: URL: https://github.com/apache/hudi/pull/2833#issuecomment-828792354 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2993: URL: https://github.com/apache/hudi/pull/2993#issuecomment-848384059 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3029: [HUDI-1954] Only reset bucket when flush bucket success

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #3029: URL: https://github.com/apache/hudi/pull/3029#issuecomment-853731624 #

[GitHub] [hudi] n3nash commented on issue #2973: [SUPPORT]Fail to run compaction in Docker Demo

2021-06-04 Thread GitBox
n3nash commented on issue #2973: URL: https://github.com/apache/hudi/issues/2973#issuecomment-855185577 @fengjian428 Are you running it off the master branch ? I did not see any problems with it. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] vinothchandar merged pull request #3018: [HUDI-1281] Add deltacommit to ActionType

2021-06-04 Thread GitBox
vinothchandar merged pull request #3018: URL: https://github.com/apache/hudi/pull/3018 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hudi] n3nash commented on issue #3022: [FEATURE REQUEST] Better support for Trino

2021-06-04 Thread GitBox
n3nash commented on issue #3022: URL: https://github.com/apache/hudi/issues/3022#issuecomment-855186869 @rubenssoto You should be able to use CopyOnWrite with Trino + Hudi. I'm aware that MOR is not supported. Full Hudi support on Trino is on the roadmap. -- This is an automated

[hudi] branch master updated (c4a2ad2 -> cf90f17)

2021-06-04 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from c4a2ad2 [HUDI-1954] only reset bucket when flush bucket success (#3029) add cf90f17 [HUDI-1281] Add

[jira] [Updated] (HUDI-1958) [Umbrella] Follow up items from 1 pass over GH issues

2021-06-04 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1958: -- Labels: release-blocker (was: ) > [Umbrella] Follow up items from 1 pass over GH issues >

[jira] [Updated] (HUDI-1958) [Umbrella] Follow up items from 1 pass over GH issues

2021-06-04 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1958: -- Fix Version/s: 0.9.0 > [Umbrella] Follow up items from 1 pass over GH issues >

[GitHub] [hudi] wangxianghu commented on a change in pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-06-04 Thread GitBox
wangxianghu commented on a change in pull request #2963: URL: https://github.com/apache/hudi/pull/2963#discussion_r645924017 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/schema/SchemaProvider.java ## @@ -34,18 +32,9 @@ @PublicAPIClass(maturity =

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2963: URL: https://github.com/apache/hudi/pull/2963#issuecomment-843155329 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2963: URL: https://github.com/apache/hudi/pull/2963#issuecomment-843155329 #

[GitHub] [hudi] n3nash commented on issue #2849: [SUPPORT] - org.apache.hudi.exception.HoodieIOException: Could not load Hoodie properties from file:/tmp/hudi_trips_cow/.hoodie/hoodie.properties

2021-06-04 Thread GitBox
n3nash commented on issue #2849: URL: https://github.com/apache/hudi/issues/2849#issuecomment-855186466 @AdeloreSimiloluwa Closing this issue. Please re-open if you see the same issue or need assistance. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] n3nash closed issue #2849: [SUPPORT] - org.apache.hudi.exception.HoodieIOException: Could not load Hoodie properties from file:/tmp/hudi_trips_cow/.hoodie/hoodie.properties

2021-06-04 Thread GitBox
n3nash closed issue #2849: URL: https://github.com/apache/hudi/issues/2849 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] hudi-bot edited a comment on pull request #2984: (Azure CI) test PR

2021-06-04 Thread GitBox
hudi-bot edited a comment on pull request #2984: URL: https://github.com/apache/hudi/pull/2984#issuecomment-846794102 ## CI report: * 24baac9967e7f0d3e1c814e41583092068156146 Azure:

[GitHub] [hudi] vinothchandar commented on a change in pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-06-04 Thread GitBox
vinothchandar commented on a change in pull request #2833: URL: https://github.com/apache/hudi/pull/2833#discussion_r645869201 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/lock/LockManager.java ## @@ -61,8 +61,8 @@ public void

[GitHub] [hudi] wangxianghu commented on pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

2021-06-04 Thread GitBox
wangxianghu commented on pull request #3024: URL: https://github.com/apache/hudi/pull/3024#issuecomment-855186725 The ci failed because of this ``` [ERROR]

[jira] [Updated] (HUDI-1958) [Umbrella] Follow up items from 1 pass over GH issues

2021-06-04 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1958: -- Priority: Blocker (was: Major) > [Umbrella] Follow up items from 1 pass over GH issues >

[GitHub] [hudi] nsivabalan merged pull request #3034: [MINOR] Resolve build issue arising from inaccessible pentaho jar

2021-06-04 Thread GitBox
nsivabalan merged pull request #3034: URL: https://github.com/apache/hudi/pull/3034 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[hudi] branch master updated (a658328 -> d02c0e5)

2021-06-04 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from a658328 [HUDI-1961] Add a debezium json integration test case for flink (#3030) add d02c0e5 [MINOR] Resolve

[GitHub] [hudi] nsivabalan closed issue #160: Failure to find org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde

2021-06-04 Thread GitBox
nsivabalan closed issue #160: URL: https://github.com/apache/hudi/issues/160 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2833: URL: https://github.com/apache/hudi/pull/2833#issuecomment-828792354 #

[GitHub] [hudi] wangxianghu commented on a change in pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-06-04 Thread GitBox
wangxianghu commented on a change in pull request #2963: URL: https://github.com/apache/hudi/pull/2963#discussion_r645925416 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/schema/SchemaProvider.java ## @@ -34,18 +32,9 @@ @PublicAPIClass(maturity =

[GitHub] [hudi] n3nash commented on a change in pull request #2542: [WIP] Global consistency

2021-06-04 Thread GitBox
n3nash commented on a change in pull request #2542: URL: https://github.com/apache/hudi/pull/2542#discussion_r645797595 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableGloballyConsistentMetaClient.java ## @@ -0,0 +1,114 @@ +/* + * Licensed to

[GitHub] [hudi] prashantwason commented on a change in pull request #2999: [HUDI-764] [HUDI-765] Orc reader writer Implementation

2021-06-04 Thread GitBox
prashantwason commented on a change in pull request #2999: URL: https://github.com/apache/hudi/pull/2999#discussion_r645677619 ## File path: hudi-common/src/test/java/org/apache/hudi/io/storage/TestHoodieOrcReader.java ## @@ -0,0 +1,159 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2833: URL: https://github.com/apache/hudi/pull/2833#issuecomment-828792354 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2993: URL: https://github.com/apache/hudi/pull/2993#issuecomment-848384059 #

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2993: [HUDI-1929] Support configure KeyGenerator by type

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2993: URL: https://github.com/apache/hudi/pull/2993#issuecomment-848384059 #

[GitHub] [hudi] vinothchandar commented on pull request #3018: [HUDI-1281] Add deltacommit to ActionType

2021-06-04 Thread GitBox
vinothchandar commented on pull request #3018: URL: https://github.com/apache/hudi/pull/3018#issuecomment-855172998 cc @prashantwason as FYI . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] vinothchandar commented on pull request #3018: [HUDI-1281] Add deltacommit to ActionType

2021-06-04 Thread GitBox
vinothchandar commented on pull request #3018: URL: https://github.com/apache/hudi/pull/3018#issuecomment-855172971 LGTM. Re-kicked the CI. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2963: [HUDI-1904] Make SchemaProvider spark free and move it to hudi-client-common

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2963: URL: https://github.com/apache/hudi/pull/2963#issuecomment-843155329 #

[GitHub] [hudi] vinothchandar closed issue #1491: [SUPPORT] OutOfMemoryError during upsert 53M records

2021-06-04 Thread GitBox
vinothchandar closed issue #1491: URL: https://github.com/apache/hudi/issues/1491 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-commenter edited a comment on pull request #2833: [HUDI-89] Add configOption & refactor Hudi configuration framework

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #2833: URL: https://github.com/apache/hudi/pull/2833#issuecomment-828792354 #

[jira] [Closed] (HUDI-1281) deltacommit is not part of ActionType used in HoodieArchivedMetaEntry

2021-06-04 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay closed HUDI-1281. --- > deltacommit is not part of ActionType used in HoodieArchivedMetaEntry >

[jira] [Resolved] (HUDI-1281) deltacommit is not part of ActionType used in HoodieArchivedMetaEntry

2021-06-04 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HUDI-1281. - Resolution: Fixed > deltacommit is not part of ActionType used in HoodieArchivedMetaEntry >

[jira] [Commented] (HUDI-1281) deltacommit is not part of ActionType used in HoodieArchivedMetaEntry

2021-06-04 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357761#comment-17357761 ] Vinay commented on HUDI-1281: - cf90f17732e313cf71248a8baaf10307463d9b6e > deltacommit is not part of

[GitHub] [hudi] hudi-bot edited a comment on pull request #2984: (Azure CI) test PR

2021-06-04 Thread GitBox
hudi-bot edited a comment on pull request #2984: URL: https://github.com/apache/hudi/pull/2984#issuecomment-846794102 ## CI report: * fa95b4448c260e28d0aa7506c9ad71234c154d4f Azure:

[GitHub] [hudi] n3nash commented on issue #2680: [SUPPORT]Hive sync error by using run_sync_tool.sh

2021-06-04 Thread GitBox
n3nash commented on issue #2680: URL: https://github.com/apache/hudi/issues/2680#issuecomment-854394779 @ztcheck Since I haven't heard from you in a while, closing thing ticket. Please feel free to re-open if needed. -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] n3nash closed issue #2680: [SUPPORT]Hive sync error by using run_sync_tool.sh

2021-06-04 Thread GitBox
n3nash closed issue #2680: URL: https://github.com/apache/hudi/issues/2680 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] n3nash closed issue #2797: [SUPPORT] Can not create a Path from an empty string on unpartitioned table

2021-06-04 Thread GitBox
n3nash closed issue #2797: URL: https://github.com/apache/hudi/issues/2797 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3029: [HUDI-1954] Only reset bucket when flush bucket success

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #3029: URL: https://github.com/apache/hudi/pull/3029#issuecomment-853731624 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] n3nash commented on issue #2797: [SUPPORT] Can not create a Path from an empty string on unpartitioned table

2021-06-04 Thread GitBox
n3nash commented on issue #2797: URL: https://github.com/apache/hudi/issues/2797#issuecomment-854400468 @ismailsimsek @vansimonsen Closing this due to inactivity, please re-open it or open a new one if you need further assistance. -- This is an automated message from the Apache Git

[GitHub] [hudi] n3nash closed issue #2810: [SUPPORT] How Hudi with Spark Streaming works?

2021-06-04 Thread GitBox
n3nash closed issue #2810: URL: https://github.com/apache/hudi/issues/2810 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] n3nash commented on issue #2810: [SUPPORT] How Hudi with Spark Streaming works?

2021-06-04 Thread GitBox
n3nash commented on issue #2810: URL: https://github.com/apache/hudi/issues/2810#issuecomment-854403589 @rubenssoto Closing this ticket due to inactivity - feel free to re-open if you need further assistance. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hudi] n3nash closed issue #2820: getting ClassNotFoundException: com.esotericsoftware.shaded.org.objenesis.strategy.InstantiatorStrategy

2021-06-04 Thread GitBox
n3nash closed issue #2820: URL: https://github.com/apache/hudi/issues/2820 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] n3nash commented on issue #2820: getting ClassNotFoundException: com.esotericsoftware.shaded.org.objenesis.strategy.InstantiatorStrategy

2021-06-04 Thread GitBox
n3nash commented on issue #2820: URL: https://github.com/apache/hudi/issues/2820#issuecomment-854406438 @ismailsimsek Closing this issue due to inactivity. Please re-open if you need further assistance. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] n3nash commented on issue #2841: hoodie.cleaner.commits.retained max value?

2021-06-04 Thread GitBox
n3nash commented on issue #2841: URL: https://github.com/apache/hudi/issues/2841#issuecomment-854409312 Yes, that is correct @AkshayChan. Closing this ticket, please open one if you need further assistance -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] n3nash closed issue #2841: hoodie.cleaner.commits.retained max value?

2021-06-04 Thread GitBox
n3nash closed issue #2841: URL: https://github.com/apache/hudi/issues/2841 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] n3nash closed issue #2883: [SUPPORT] Does Hudi support flink DataStream API?

2021-06-04 Thread GitBox
n3nash closed issue #2883: URL: https://github.com/apache/hudi/issues/2883 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] n3nash commented on issue #2883: [SUPPORT] Does Hudi support flink DataStream API?

2021-06-04 Thread GitBox
n3nash commented on issue #2883: URL: https://github.com/apache/hudi/issues/2883#issuecomment-854411727 @jiegzhan Closing this ticket due to inactivity. Please re-open if you need further assistance. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] n3nash commented on issue #2887: [SUPPORT]

2021-06-04 Thread GitBox
n3nash commented on issue #2887: URL: https://github.com/apache/hudi/issues/2887#issuecomment-854411953 @rancylive Gentle ping if you got a chance to try out the simple index -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] danny0405 commented on a change in pull request #3029: [HUDI-1954] Only reset bucket when flush bucket success

2021-06-04 Thread GitBox
danny0405 commented on a change in pull request #3029: URL: https://github.com/apache/hudi/pull/3029#discussion_r645336456 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteFunction.java ## @@ -470,30 +470,34 @@ private void bufferRecord(HoodieRecord

[GitHub] [hudi] codecov-commenter edited a comment on pull request #3028: [HUDI-1957] Fix flink timeline service lack jetty dependency

2021-06-04 Thread GitBox
codecov-commenter edited a comment on pull request #3028: URL: https://github.com/apache/hudi/pull/3028#issuecomment-853696055 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] nsivabalan edited a comment on pull request #2438: [HUDI-1447] DeltaStreamer kafka source supports consuming from specified timestamp

2021-06-04 Thread GitBox
nsivabalan edited a comment on pull request #2438: URL: https://github.com/apache/hudi/pull/2438#issuecomment-853866564 good point. Tell me if my understanding is right in general wrt usage of timestamp based checkpointing. user would like to use timestamp based checkpointing in

[GitHub] [hudi] pratyakshsharma commented on pull request #2967: Added blog for Hudi cleaner service

2021-06-04 Thread GitBox
pratyakshsharma commented on pull request #2967: URL: https://github.com/apache/hudi/pull/2967#issuecomment-853878207 https://user-images.githubusercontent.com/30863489/120653442-4c5d6c80-c49e-11eb-8881-30366627206b.png;>

[GitHub] [hudi] hk-lrzy commented on a change in pull request #3024: [HUDI-1924] Add BootstrapFunction to support index bootstrap

2021-06-04 Thread GitBox
hk-lrzy commented on a change in pull request #3024: URL: https://github.com/apache/hudi/pull/3024#discussion_r644650661 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/partitioner/BucketAssignFunction.java ## @@ -168,31 +150,28 @@ public void

[GitHub] [hudi] n3nash commented on issue #2537: [SUPPORT] delta streamer sql transformer does not work for my kafka data

2021-06-04 Thread GitBox
n3nash commented on issue #2537: URL: https://github.com/apache/hudi/issues/2537#issuecomment-854307353 Closing this issue due to no activity. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] n3nash commented on issue #2614: Caused by: com.fasterxml.jackson.core.JsonParseException: Unrecognized token

2021-06-04 Thread GitBox
n3nash commented on issue #2614: URL: https://github.com/apache/hudi/issues/2614#issuecomment-854344142 Closing this ticket since the patch is now landed and can be picked up from master if needed. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] yanghua merged pull request #3023: [HUDI-1953] Fix NPE due to not set the output type of the operator

2021-06-04 Thread GitBox
yanghua merged pull request #3023: URL: https://github.com/apache/hudi/pull/3023 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-commenter commented on pull request #3028: [HUDI-1957] Fix flink timeline service lack jetty dependency

2021-06-04 Thread GitBox
codecov-commenter commented on pull request #3028: URL: https://github.com/apache/hudi/pull/3028#issuecomment-853696055 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3028?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] codecov-commenter commented on pull request #3032: [HUDI-1967] Fix the NPE for MOR Hive rt table query

2021-06-04 Thread GitBox
codecov-commenter commented on pull request #3032: URL: https://github.com/apache/hudi/pull/3032#issuecomment-854351660 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3032?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] yanghua merged pull request #3028: [HUDI-1957] Fix flink timeline service lack jetty dependency

2021-06-04 Thread GitBox
yanghua merged pull request #3028: URL: https://github.com/apache/hudi/pull/3028 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hudi] codecov-commenter commented on pull request #3030: [HUDI-1961] Add a debezium json integration test case for flink

2021-06-04 Thread GitBox
codecov-commenter commented on pull request #3030: URL: https://github.com/apache/hudi/pull/3030#issuecomment-853883816 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3030?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation)

[GitHub] [hudi] xdingou commented on issue #143: Tracking ticket for folks to be added to slack group

2021-06-04 Thread GitBox
xdingou commented on issue #143: URL: https://github.com/apache/hudi/issues/143#issuecomment-853606643 Please add me to slack group Email: dinesh.go...@gmail.com Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] djKooks edited a comment on issue #160: Failure to find org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde

2021-06-04 Thread GitBox
djKooks edited a comment on issue #160: URL: https://github.com/apache/hudi/issues/160#issuecomment-853671434 Also facing with this issue...is there any solution? (it was working well about 2 weeks ago...) -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] hudi-bot edited a comment on pull request #2984: (Azure CI) test PR

2021-06-04 Thread GitBox
hudi-bot edited a comment on pull request #2984: URL: https://github.com/apache/hudi/pull/2984#issuecomment-846794102 ## CI report: * ca2010202c42fe61dcba8ed7a53f18a390effad7 Azure:

[GitHub] [hudi] n3nash commented on issue #2832: [SUPPORT] Hive on Spark dont work

2021-06-04 Thread GitBox
n3nash commented on issue #2832: URL: https://github.com/apache/hudi/issues/2832#issuecomment-854408139 @nevgin Closing this issue due to inactivity. Please re-open if you need further assistance. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] n3nash closed issue #2832: [SUPPORT] Hive on Spark dont work

2021-06-04 Thread GitBox
n3nash closed issue #2832: URL: https://github.com/apache/hudi/issues/2832 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact

[GitHub] [hudi] n3nash commented on issue #2834: [SUPPORT] Help~~~org.apache.hudi.exception.TableNotFoundException

2021-06-04 Thread GitBox
n3nash commented on issue #2834: URL: https://github.com/apache/hudi/issues/2834#issuecomment-854408512 @wk888 Could you please let @yanghua know if you need further assistance ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Created] (HUDI-1968) Add documentation around Hive 1.x vs Hive 2.x (spark vs hudi)

2021-06-04 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-1968: - Summary: Add documentation around Hive 1.x vs Hive 2.x (spark vs hudi) Key: HUDI-1968 URL: https://issues.apache.org/jira/browse/HUDI-1968 Project: Apache Hudi

  1   2   3   >