[GitHub] [incubator-hudi] EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605391332 @lamber-ken So I swtich the java version of the maven docker image that

[GitHub] [incubator-hudi] lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605389857 > So mine is (JI)I, what is your java build version? Opened a

[jira] [Created] (HUDI-742) Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

lamber-ken created HUDI-742: --- Summary: Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I Key: HUDI-742 URL: https://issues.apache.org/jira/browse/HUDI-742 Project: Apache Hudi (incubating)

[jira] [Updated] (HUDI-742) Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

[ https://issues.apache.org/jira/browse/HUDI-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-742: Status: Open (was: New) > Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I >

[GitHub] [incubator-hudi] EdwinGuo edited a comment on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

EdwinGuo edited a comment on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605388998 So mine is (JI)I, what is your java build version?

[GitHub] [incubator-hudi] EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605388928 @lamber-ken Yes, I build the jar myself. Below is my java version:

[GitHub] [incubator-hudi] EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605388998 So mine is (JI)I

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #230

See Changes: -- [...truncated 2.32 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml

[GitHub] [incubator-hudi] EdwinGuo edited a comment on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

EdwinGuo edited a comment on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605388928 @lamber-ken Yes, I build the jar myself. Below is my java

[GitHub] [incubator-hudi] lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605386569 I checked `0.5.2-incubating `

[GitHub] [incubator-hudi] PhatakN1 commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

PhatakN1 commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458#issuecomment-605385347 I am using 0.5.1

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

lamber-ken edited a comment on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605368991 hi @EdwinGuo, the log level is `WARN` in spark-shell by default,

[GitHub] [incubator-hudi] hddong commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command

hddong commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command URL: https://github.com/apache/incubator-hudi/pull/1452#discussion_r399609420 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/SparkMain.java

[jira] [Updated] (HUDI-723) SqlTransformer's schema sometimes is not registered.

[ https://issues.apache.org/jira/browse/HUDI-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-723: Status: Open (was: New) > SqlTransformer's schema sometimes is not registered. >

[jira] [Assigned] (HUDI-723) SqlTransformer's schema sometimes is not registered.

[ https://issues.apache.org/jira/browse/HUDI-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-723: --- Assignee: lamber-ken > SqlTransformer's schema sometimes is not registered. >

[GitHub] [incubator-hudi] lamber-ken commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

lamber-ken commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458#issuecomment-605376759 hi @PhatakN1, thanks for reporting this issue, which hudi version you are

[jira] [Updated] (HUDI-418) Bootstrap Index - Implementation

[ https://issues.apache.org/jira/browse/HUDI-418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-418: Labels: pull-request-available (was: ) > Bootstrap Index - Implementation >

[GitHub] [incubator-hudi] bvaradar opened a new pull request #1459: [WIP] [HUDI-418] [HUDI-421] Bootstrap Index using HFile and File System View Changes with unit-test

bvaradar opened a new pull request #1459: [WIP] [HUDI-418] [HUDI-421] Bootstrap Index using HFile and File System View Changes with unit-test URL: https://github.com/apache/incubator-hudi/pull/1459 ## What is the purpose of the pull request This is part of code changes needed to

[jira] [Updated] (HUDI-718) java.lang.ClassCastException during upsert

[ https://issues.apache.org/jira/browse/HUDI-718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-718: Status: Open (was: New) > java.lang.ClassCastException during upsert >

[jira] [Assigned] (HUDI-718) java.lang.ClassCastException during upsert

[ https://issues.apache.org/jira/browse/HUDI-718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-718: --- Assignee: lamber-ken > java.lang.ClassCastException during upsert >

[jira] [Commented] (HUDI-722) IndexOutOfBoundsException in MessageColumnIORecordConsumer.addBinary when writing parquet

[ https://issues.apache.org/jira/browse/HUDI-722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069160#comment-17069160 ] lamber-ken commented on HUDI-722: - Sure. Hi [~afilipchik], if you have time, can you share more context

[jira] [Assigned] (HUDI-722) IndexOutOfBoundsException in MessageColumnIORecordConsumer.addBinary when writing parquet

[ https://issues.apache.org/jira/browse/HUDI-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-722: --- Assignee: lamber-ken > IndexOutOfBoundsException in MessageColumnIORecordConsumer.addBinary when >

[jira] [Updated] (HUDI-722) IndexOutOfBoundsException in MessageColumnIORecordConsumer.addBinary when writing parquet

[ https://issues.apache.org/jira/browse/HUDI-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-722: Status: Open (was: New) > IndexOutOfBoundsException in MessageColumnIORecordConsumer.addBinary when >

[GitHub] [incubator-hudi] lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605368991 hi @EdwinGuo, the log level is `WARN` in spark-shell by default, you

[jira] [Commented] (HUDI-686) Implement BloomIndexV2 that does not depend on memory caching

[ https://issues.apache.org/jira/browse/HUDI-686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069083#comment-17069083 ] sivabalan narayanan commented on HUDI-686: -- yeah,  was about to respond to lander-ken that

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399542571 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399542370 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399542132 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399541806 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399542054 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399541700 ## File path:

[GitHub] [incubator-hudi] melkimohamed commented on issue #1439: Hudi class loading problem

melkimohamed commented on issue #1439: Hudi class loading problem URL: https://github.com/apache/incubator-hudi/issues/1439#issuecomment-605300589 @lamber-ken , @bvaradar thank you for your answers, I solved the problem by changing the deployment method: the variable

[GitHub] [incubator-hudi] melkimohamed closed issue #1439: Hudi class loading problem

melkimohamed closed issue #1439: Hudi class loading problem URL: https://github.com/apache/incubator-hudi/issues/1439 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399519630 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399518706 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#issuecomment-605297172 @gdineshbabu88 Yeah I will update documentation for this tool. That is

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399504930 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399503228 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399500147 ## File path:

[GitHub] [incubator-hudi] PhatakN1 opened a new issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

PhatakN1 opened a new issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458 Hi, I have integrated Hoodiedeltastreamer with DMS using --payload-class

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399494359 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema

pratyakshsharma commented on a change in pull request #1427: [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema URL: https://github.com/apache/incubator-hudi/pull/1427#discussion_r399490062 ## File path:

[GitHub] [incubator-hudi] EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605213668 @lamber-ken I have the jar recompiled. A quick question, how to turn on

[GitHub] [incubator-hudi] prashantwason opened a new pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

prashantwason opened a new pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457 ## What is the purpose of the pull request HUDI specific validation of schema evolution should ensure that a newer

[jira] [Updated] (HUDI-741) Fix Hoodie's schema evolution checks

[ https://issues.apache.org/jira/browse/HUDI-741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-741: Labels: pull-request-available (was: ) > Fix Hoodie's schema evolution checks >

[GitHub] [incubator-hudi] prashantwason opened a new pull request #1456: [MINOR] Updated HoodieMergeOnReadTestUtils for future testing requirements.

prashantwason opened a new pull request #1456: [MINOR] Updated HoodieMergeOnReadTestUtils for future testing requirements. URL: https://github.com/apache/incubator-hudi/pull/1456 ## What is the purpose of the pull request Minor changes to enhance HoodieMergeOnReadTestUtils for

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports.

prashantwason commented on a change in pull request #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1450#discussion_r399467520 ## File path: .codecov.yml ## @@ -0,0 +1,46 @@ +# Licensed to

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports.

prashantwason commented on a change in pull request #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1450#discussion_r399467199 ## File path: .codecov.yml ## @@ -0,0 +1,46 @@ +# Licensed to

[GitHub] [incubator-hudi] prashantwason commented on issue #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports.

prashantwason commented on issue #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1450#issuecomment-605203860 Exclusions are for classes which most-probably will not see any unit testing ever. There

[GitHub] [incubator-hudi] lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605197774 hi @vinothchandar, any thoughs? IMO, it caused by JVM runtime

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1432: [HUDI-716] Exception: Not an Avro data file when running HoodieCleanClient.runClean

lamber-ken commented on a change in pull request #1432: [HUDI-716] Exception: Not an Avro data file when running HoodieCleanClient.runClean URL: https://github.com/apache/incubator-hudi/pull/1432#discussion_r399455231 ## File path:

[GitHub] [incubator-hudi] lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605151836 And, try do following changes: ``` final int idx =

[GitHub] [incubator-hudi] garyli1019 commented on issue #1453: HUDI-644 kafka connect checkpoint provider

garyli1019 commented on issue #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#issuecomment-605148461 @pratyakshsharma Thanks for reviewing. I think the scenario you mentioned could be similar to our last discussion. The user can do

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r399431388 ## File path:

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r399429038 ## File path:

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r399427876 ## File path:

[GitHub] [incubator-hudi] bvaradar commented on issue #1420: Broken Maven dependencies.

bvaradar commented on issue #1420: Broken Maven dependencies. URL: https://github.com/apache/incubator-hudi/issues/1420#issuecomment-605122681 Closing this due to inactivity. This is an automated message from the Apache Git

[GitHub] [incubator-hudi] bvaradar closed issue #1420: Broken Maven dependencies.

bvaradar closed issue #1420: Broken Maven dependencies. URL: https://github.com/apache/incubator-hudi/issues/1420 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [incubator-hudi] bvaradar commented on issue #1439: Hudi class loading problem

bvaradar commented on issue #1439: Hudi class loading problem URL: https://github.com/apache/incubator-hudi/issues/1439#issuecomment-605121815 @melkimohamed : Let us know if you are still encountering issues. This is an

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

nsivabalan commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r399408154 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieSimpleIndex.java ## @@ -0,0

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

nsivabalan commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r399408154 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieSimpleIndex.java ## @@ -0,0

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

nsivabalan commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r399405882 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieSimpleIndex.java ## @@ -0,0

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

nsivabalan commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r399407043 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieSimpleIndex.java ## @@ -0,0

[GitHub] [incubator-hudi] lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605107232 I think this issue caused by JVM how to execution the bytecode.

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index

nsivabalan commented on a change in pull request #1402: [WIP][HUDI-407] Adding Simple Index URL: https://github.com/apache/incubator-hudi/pull/1402#discussion_r399404807 ## File path: hudi-client/src/main/java/org/apache/hudi/index/HoodieIndex.java ## @@ -118,9 +121,10 @@

[GitHub] [incubator-hudi] EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605104105 @lamber-ken , ok I will clone the repo, add the loggings and get back to

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

lamber-ken edited a comment on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605100639 Welcome @EdwinGuo, to figure it out, we need to add some log

[GitHub] [incubator-hudi] lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605100639 Welcome @EdwinGuo, to figure it out, we need to add some log statement.

[GitHub] [incubator-hudi] EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605095463 Thanks for replying @lamber-ken. 1: java -version (from edge node,

[jira] [Commented] (HUDI-686) Implement BloomIndexV2 that does not depend on memory caching

[ https://issues.apache.org/jira/browse/HUDI-686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068840#comment-17068840 ] Vinoth Chandar commented on HUDI-686: - >May I know why we need external spillableMap? why can't we use

[jira] [Commented] (HUDI-686) Implement BloomIndexV2 that does not depend on memory caching

[ https://issues.apache.org/jira/browse/HUDI-686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068837#comment-17068837 ] Vinoth Chandar commented on HUDI-686: - >if the input data is large, need to increase partitions,

[GitHub] [incubator-hudi] lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

lamber-ken commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605086930 hi, someone met the same issue before, need more context: 1.jdk

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399372702 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399371617 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on issue #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports.

vinothchandar commented on issue #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1450#issuecomment-605075969 Would love to understand the rationale for excluding some core classes here..

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports.

vinothchandar commented on a change in pull request #1450: [MINOR] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1450#discussion_r399364951 ## File path: .codecov.yml ## @@ -0,0 +1,46 @@ +# Licensed to

[jira] [Commented] (HUDI-737) Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder

[ https://issues.apache.org/jira/browse/HUDI-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068801#comment-17068801 ] Suneel Marthi commented on HUDI-737: This has been fixed in the PR for HUDI-479 > Simplify/Eliminate

[jira] [Updated] (HUDI-737) Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder

[ https://issues.apache.org/jira/browse/HUDI-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-737: --- Status: In Progress (was: Open) > Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder >

[jira] [Updated] (HUDI-737) Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder

[ https://issues.apache.org/jira/browse/HUDI-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-737: --- Status: Open (was: New) > Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder >

[jira] [Updated] (HUDI-737) Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder

[ https://issues.apache.org/jira/browse/HUDI-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-737: --- Fix Version/s: 0.6.0 > Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder >

[jira] [Updated] (HUDI-737) Simplify/Eliminate need for CollectionUtils#Maps/MapsBuilder

[ https://issues.apache.org/jira/browse/HUDI-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-737: --- Status: Patch Available (was: In Progress) > Simplify/Eliminate need for

[GitHub] [incubator-hudi] vinothchandar commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

vinothchandar commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-605046821 If its already used elsewhere, nvm. We can deal with it later

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

smarthi commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r399324299 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/FileIOUtils.java

[GitHub] [incubator-hudi] smarthi commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

smarthi commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-605043851 > ``` > [INFO] There is 1 error reported by Checkstyle 8.18 with style/checkstyle.xml ruleset. > 593[ERROR]

[GitHub] [incubator-hudi] vinothchandar commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

vinothchandar commented on issue #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#issuecomment-605037325 ``` [INFO] There is 1 error reported by Checkstyle 8.18 with style/checkstyle.xml ruleset. 593[ERROR]

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible

vinothchandar commented on a change in pull request #1159: [HUDI-479] Eliminate or Minimize use of Guava if possible URL: https://github.com/apache/incubator-hudi/pull/1159#discussion_r399312059 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/FileIOUtils.java

[GitHub] [incubator-hudi] EdwinGuo opened a new issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

EdwinGuo opened a new issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455 **_Tips before filing an issue_** - Have you gone through our

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command

pratyakshsharma commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command URL: https://github.com/apache/incubator-hudi/pull/1452#discussion_r399232900 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #1453: HUDI-644 kafka connect checkpoint provider

pratyakshsharma commented on issue #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#issuecomment-604972381 Thank you for making this tool @garyli1019 Have you thought of a use case where user might want to switch the source

[GitHub] [incubator-hudi] nsivabalan commented on issue #1438: How to get the file name corresponding to HoodieKey through the GlobalBloomIndex

nsivabalan commented on issue #1438: How to get the file name corresponding to HoodieKey through the GlobalBloomIndex URL: https://github.com/apache/incubator-hudi/issues/1438#issuecomment-604970042 Hi @loagosad : guess you were looking for fileId. In the test code you have given,

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r399224698 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r399218307 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r399206469 ## File path:

[jira] [Commented] (HUDI-741) Fix Hoodie's schema evolution checks

[ https://issues.apache.org/jira/browse/HUDI-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068589#comment-17068589 ] Pratyaksh Sharma commented on HUDI-741: --- Hi [~pwason], I am already working with [~nishith29] to

[jira] [Commented] (HUDI-741) Fix Hoodie's schema evolution checks

[ https://issues.apache.org/jira/browse/HUDI-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068374#comment-17068374 ] Prashant Wason commented on HUDI-741: - Background -- When a record is read from the

[jira] [Commented] (HUDI-741) Fix Hoodie's schema evolution checks

[ https://issues.apache.org/jira/browse/HUDI-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068364#comment-17068364 ] Prashant Wason commented on HUDI-741: - Implementation notes: hudi-hive-sync module already has code

[jira] [Commented] (HUDI-741) Fix Hoodie's schema evolution checks

[ https://issues.apache.org/jira/browse/HUDI-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068359#comment-17068359 ] Prashant Wason commented on HUDI-741: - Since inserts/updates are performed using the HoodieWriteClient,

[jira] [Commented] (HUDI-741) Fix Hoodie's schema evolution checks

[ https://issues.apache.org/jira/browse/HUDI-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068356#comment-17068356 ] Prashant Wason commented on HUDI-741: - Inserts and Updates to the HUDI table should validate that the

[jira] [Updated] (HUDI-741) Fix Hoodie's schema evolution checks

[ https://issues.apache.org/jira/browse/HUDI-741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-741: Status: In Progress (was: Open) > Fix Hoodie's schema evolution checks >

[jira] [Updated] (HUDI-741) Fix Hoodie's schema evolution checks

[ https://issues.apache.org/jira/browse/HUDI-741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-741: Status: Open (was: New) > Fix Hoodie's schema evolution checks >

  1   2   >