[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction

2020-03-29 Thread GitBox
bvaradar commented on a change in pull request #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction URL: https://github.com/apache/incubator-hudi/pull/1396#discussion_r399958899 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeli

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command URL: https://github.com/apache/incubator-hudi/pull/1452#issuecomment-604806506 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1452?src=pr&el=h1) Report > Mergin

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command URL: https://github.com/apache/incubator-hudi/pull/1452#issuecomment-604806506 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1452?src=pr&el=h1) Report > Mergin

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-29 Thread GitBox
garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r399926313 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/sources/checkpoint/TestCheckPointPro

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-29 Thread GitBox
garyli1019 commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r399925788 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/checkpoint/KafkaConnectHdfsP

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1466: [HUDI-742] Fix Java Math Exception

2020-03-29 Thread GitBox
lamber-ken commented on a change in pull request #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#discussion_r399921954 ## File path: hudi-client/src/test/java/org/apache/hudi/index/bloom/TestBucketizedBloomCheckPartitioner.java ###

[GitHub] [incubator-hudi] leesf commented on issue #1465: [HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
leesf commented on issue #1465: [HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605773685 > @leesf quick clarification.. if we refactor / touch more classes, then the import order warning will keep recurring? I wonder, if we should

[GitHub] [incubator-hudi] smarthi edited a comment on issue #1465: [HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
smarthi edited a comment on issue #1465: [HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605772848 > If we can automate and keep this in sync with intellij. Otherwise, its just a pain. Right now, intellij does this differently from

[GitHub] [incubator-hudi] smarthi commented on issue #1465: [HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
smarthi commented on issue #1465: [HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605772848 > If we can automate and keep this in sync with intellij. Otherwise, its just a pain. Right now, intellij does this differently from how we

[GitHub] [incubator-hudi] vinothchandar commented on issue #1465: [HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
vinothchandar commented on issue #1465: [HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605772577 If we can automate and keep this in sync with intellij. Otherwise, its just a pain. Right now, intellij does this differently from ho

[GitHub] [incubator-hudi] smarthi commented on issue #1465: [HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
smarthi commented on issue #1465: [HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605772176 > @leesf quick clarification.. if we refactor / touch more classes, then the import order warning will keep recurring? I wonder, if we shou

[GitHub] [incubator-hudi] vinothchandar commented on issue #1465: [HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
vinothchandar commented on issue #1465: [HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605769686 @leesf quick clarification.. if we refactor / touch more classes, then the import order warning will keep recurring? I wonder, if we

[GitHub] [incubator-hudi] yanghua commented on issue #1100: [HUDI-289] Implement a test suite to support long running test for Hudi writing and querying end-end

2020-03-29 Thread GitBox
yanghua commented on issue #1100: [HUDI-289] Implement a test suite to support long running test for Hudi writing and querying end-end URL: https://github.com/apache/incubator-hudi/pull/1100#issuecomment-605769260 Will back to this PR and rebase it with master branch later. ---

[jira] [Closed] (HUDI-746) Reduce build warnings < 10

2020-03-29 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi closed HUDI-746. -- > Reduce build warnings < 10 > -- > > Key: HUDI-746 >

[jira] [Updated] (HUDI-746) Reduce build warnings < 10

2020-03-29 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-746: --- Status: Open (was: New) > Reduce build warnings < 10 > -- > >

[jira] [Updated] (HUDI-746) Reduce build warnings < 10

2020-03-29 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi updated HUDI-746: --- Status: In Progress (was: Open) > Reduce build warnings < 10 > -- > >

[jira] [Resolved] (HUDI-746) Reduce build warnings < 10

2020-03-29 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi resolved HUDI-746. Resolution: Fixed > Reduce build warnings < 10 > -- > > Key:

[GitHub] [incubator-hudi] leesf merged pull request #1465: [HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
leesf merged pull request #1465: [HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465 This is an automated message from the Apache Git Service. To respond to the message, please log o

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #232

2020-03-29 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.37 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml /home/jenkins/tools/maven/apache-maven-3.5.

[GitHub] [incubator-hudi] PhatakN1 commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

2020-03-29 Thread GitBox
PhatakN1 commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458#issuecomment-605765420 In the hudi-cli.sh, there is an explicit call to hudi-env.sh where it sets the v

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
yanghua commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399908175 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/TestUtilHelpers.java ## @@ -0,0 +1,101

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
yanghua commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399907865 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/TestUtilHelpers.java ## @@ -0,0 +1,101

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
yanghua commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399908243 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/transform/TestChainedTransformer.java #

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605707178 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1465?src=pr&el=h1) Report > Merging [#1465](https://codec

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605707178 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1465?src=pr&el=h1) Report > Merging [#1465](https://codec

[jira] [Assigned] (HUDI-735) Improve deltastreamer error message when case mismatch of commandline arguments.

2020-03-29 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-735: -- Assignee: Nicholas Jiang > Improve deltastreamer error message when case mismatch of commandline > arguments. >

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-605739120 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1466?src=pr&el=h1) Report > Merging [#1466](https://codecov.io/gh/a

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-605739120 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1466?src=pr&el=h1) Report > Merging [#1466](https://codecov.io/gh/a

[GitHub] [incubator-hudi] hddong commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command

2020-03-29 Thread GitBox
hddong commented on a change in pull request #1452: [HUDI-740]Fix can not specify the sparkMaster of cleans run command URL: https://github.com/apache/incubator-hudi/pull/1452#discussion_r399888754 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/SparkMain.java ###

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-605739120 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1466?src=pr&el=h1) Report > Merging [#1466](https://codecov.io/gh/a

[GitHub] [incubator-hudi] codecov-io commented on issue #1466: [HUDI-742] Fix Java Math Exception

2020-03-29 Thread GitBox
codecov-io commented on issue #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466#issuecomment-605739120 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1466?src=pr&el=h1) Report > Merging [#1466](https://codecov.io/gh/apache/i

[GitHub] [incubator-hudi] hddong commented on a change in pull request #1174: [HUDI-96]: Implemented command line options instead of positional arguments for CLI commands

2020-03-29 Thread GitBox
hddong commented on a change in pull request #1174: [HUDI-96]: Implemented command line options instead of positional arguments for CLI commands URL: https://github.com/apache/incubator-hudi/pull/1174#discussion_r399733999 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/co

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605707178 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1465?src=pr&el=h1) Report > Merging [#1465](https://codec

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605707178 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1465?src=pr&el=h1) Report > Merging [#1465](https://codec

[GitHub] [incubator-hudi] EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

2020-03-29 Thread GitBox
EdwinGuo commented on issue #1455: [SUPPORT] Hudi upsert run into exception: java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I URL: https://github.com/apache/incubator-hudi/issues/1455#issuecomment-605734683 pr had been create: https://github.com/apache/incubator-hudi/pull/1466. T

[jira] [Updated] (HUDI-742) Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

2020-03-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-742: Labels: pull-request-available (was: ) > Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI

[GitHub] [incubator-hudi] EdwinGuo opened a new pull request #1466: [HUDI-742] Fix Java Math Exception

2020-03-29 Thread GitBox
EdwinGuo opened a new pull request #1466: [HUDI-742] Fix Java Math Exception URL: https://github.com/apache/incubator-hudi/pull/1466 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull requ

[GitHub] [incubator-hudi] leesf commented on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
leesf commented on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605729423 > @leesf could you please review this? sure This is an automated

[GitHub] [incubator-hudi] vinothchandar commented on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
vinothchandar commented on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605729144 @leesf could you please review this? This is an automated mes

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605707178 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1465?src=pr&el=h1) Report > Merging [#1465](https://codec

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605707178 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1465?src=pr&el=h1) Report > Merging [#1465](https://codec

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605707178 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1465?src=pr&el=h1) Report > Merging [#1465](https://codec

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605707178 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1465?src=pr&el=h1) Report > Merging [#1465](https://codec

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605707178 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1465?src=pr&el=h1) Report > Merging [#1465](https://codec

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605707178 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1465?src=pr&el=h1) Report > Merging [#1465](https://codec

[GitHub] [incubator-hudi] codecov-io commented on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
codecov-io commented on issue #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465#issuecomment-605707178 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1465?src=pr&el=h1) Report > Merging [#1465](https://codecov.io/gh

[jira] [Updated] (HUDI-746) Reduce build warnings < 10

2020-03-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-746: Labels: pull-request-available (was: ) > Reduce build warnings < 10 > -- > >

[GitHub] [incubator-hudi] smarthi opened a new pull request #1465: [WIP][HUDI-746]: Reduce build warnings < 10

2020-03-29 Thread GitBox
smarthi opened a new pull request #1465: [WIP][HUDI-746]: Reduce build warnings < 10 URL: https://github.com/apache/incubator-hudi/pull/1465 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a

[jira] [Assigned] (HUDI-746) Reduce build warnings < 10

2020-03-29 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi reassigned HUDI-746: -- Assignee: Suneel Marthi > Reduce build warnings < 10 > -- > >

[jira] [Resolved] (HUDI-744) Redistribute files in hudi-common utils package

2020-03-29 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-744. - Resolution: Fixed > Redistribute files in hudi-common utils package > -

[jira] [Resolved] (HUDI-745) CI should fail PRs with unapproved license files

2020-03-29 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-745. - Resolution: Fixed > CI should fail PRs with unapproved license files >

[incubator-hudi] branch master updated: [HUDI-745] CI should fail PRs with unapproved license files (#1464)

2020-03-29 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new fad4bd3 [HUDI-745] CI should fail PRs w

[GitHub] [incubator-hudi] vinothchandar merged pull request #1464: [HUDI-745] CI should fail PRs with unapproved license files

2020-03-29 Thread GitBox
vinothchandar merged pull request #1464: [HUDI-745] CI should fail PRs with unapproved license files URL: https://github.com/apache/incubator-hudi/pull/1464 This is an automated message from the Apache Git Service. To respon

[jira] [Updated] (HUDI-745) CI should fail PRs with unapproved license files

2020-03-29 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-745: Status: Open (was: New) > CI should fail PRs with unapproved license files > ---

[GitHub] [incubator-hudi] vinothchandar merged pull request #1462: [HUDI-744] Restructure hudi-common and clean up files under util packages

2020-03-29 Thread GitBox
vinothchandar merged pull request #1462: [HUDI-744] Restructure hudi-common and clean up files under util packages URL: https://github.com/apache/incubator-hudi/pull/1462 This is an automated message from the Apache Git Serv

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1449: [HUDI-698]Add unit test for CleansCommand

2020-03-29 Thread GitBox
smarthi commented on a change in pull request #1449: [HUDI-698]Add unit test for CleansCommand URL: https://github.com/apache/incubator-hudi/pull/1449#discussion_r399828686 ## File path: hudi-cli/src/test/java/org/apache/hudi/cli/commands/TestCleansCommand.java ## @@ -0,0

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399821836 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ###

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
vinothchandar commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399823463 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
vinothchandar commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399823355 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/transform/TestChainedTransformer.java ###

[GitHub] [incubator-hudi] vinothchandar commented on issue #1464: [HUDI-745] CI should fail PRs with unapproved license files

2020-03-29 Thread GitBox
vinothchandar commented on issue #1464: [HUDI-745] CI should fail PRs with unapproved license files URL: https://github.com/apache/incubator-hudi/pull/1464#issuecomment-605665452 Should now pass.. This is an automated messag

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399821836 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ###

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399821836 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ###

[GitHub] [incubator-hudi] vinothchandar commented on issue #1464: [HUDI-745] CI should fail PRs with unapproved license files

2020-03-29 Thread GitBox
vinothchandar commented on issue #1464: [HUDI-745] CI should fail PRs with unapproved license files URL: https://github.com/apache/incubator-hudi/pull/1464#issuecomment-605663867 ``` [INFO] 685[ERROR] Failed to

[jira] [Updated] (HUDI-745) CI should fail PRs with unapproved license files

2020-03-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-745: Labels: pull-request-available (was: ) > CI should fail PRs with unapproved license files >

[GitHub] [incubator-hudi] vinothchandar opened a new pull request #1464: [HUDI-745] CI should fail PRs with unapproved license files

2020-03-29 Thread GitBox
vinothchandar opened a new pull request #1464: [HUDI-745] CI should fail PRs with unapproved license files URL: https://github.com/apache/incubator-hudi/pull/1464 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.h

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399821332 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ###

[jira] [Created] (HUDI-746) Reduce build warnings < 10

2020-03-29 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-746: --- Summary: Reduce build warnings < 10 Key: HUDI-746 URL: https://issues.apache.org/jira/browse/HUDI-746 Project: Apache Hudi (incubating) Issue Type: Improvement

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1462: [HUDI-744] Restructure hudi-common and clean up files under util packages

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1462: [HUDI-744] Restructure hudi-common and clean up files under util packages URL: https://github.com/apache/incubator-hudi/pull/1462#issuecomment-605662273 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1462?src=pr&el=h1) Report >

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1462: [HUDI-744] Restructure hudi-common and clean up files under util packages

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1462: [HUDI-744] Restructure hudi-common and clean up files under util packages URL: https://github.com/apache/incubator-hudi/pull/1462#issuecomment-605662273 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1462?src=pr&el=h1) Report >

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
xushiyan commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399820683 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/UtilHelpers.java ## @@ -102,11 +104,2

[jira] [Created] (HUDI-745) CI should fail PRs with unapproved license files

2020-03-29 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-745: --- Summary: CI should fail PRs with unapproved license files Key: HUDI-745 URL: https://issues.apache.org/jira/browse/HUDI-745 Project: Apache Hudi (incubating) I

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1462: [HUDI-744] Restructure hudi-common and clean up files under util packages

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1462: [HUDI-744] Restructure hudi-common and clean up files under util packages URL: https://github.com/apache/incubator-hudi/pull/1462#issuecomment-605662273 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1462?src=pr&el=h1) Report >

[GitHub] [incubator-hudi] codecov-io commented on issue #1462: [HUDI-744] Restructure hudi-common and clean up files under util packages

2020-03-29 Thread GitBox
codecov-io commented on issue #1462: [HUDI-744] Restructure hudi-common and clean up files under util packages URL: https://github.com/apache/incubator-hudi/pull/1462#issuecomment-605662273 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1462?src=pr&el=h1) Report > Merging

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
vinothchandar commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399820497 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/transform/TestChainedTransformer.java ###

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
vinothchandar commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399818801 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
vinothchandar commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399818837 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/UtilHelpers.java ## @@ -102,11 +

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
vinothchandar commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399818612 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/transform/TestChainedTransformer.java ###

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
yanghua commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399811247 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/transform/TestChainedTransformer.java #

[jira] [Resolved] (HUDI-732) Generate site to content folder

2020-03-29 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken resolved HUDI-732. - Resolution: Fixed > Generate site to content folder > --- > > K

[GitHub] [incubator-hudi] lamber-ken commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

2020-03-29 Thread GitBox
lamber-ken commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458#issuecomment-605646694 Good news 💯

[GitHub] [incubator-hudi] vinothchandar merged pull request #1463: [HUDI-732] Generate site to content folder

2020-03-29 Thread GitBox
vinothchandar merged pull request #1463: [HUDI-732] Generate site to content folder URL: https://github.com/apache/incubator-hudi/pull/1463 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (HUDI-744) Redistribute files in hudi-common utils package

2020-03-29 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-744: Fix Version/s: 0.6.0 > Redistribute files in hudi-common utils package >

[GitHub] [incubator-hudi] PhatakN1 commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

2020-03-29 Thread GitBox
PhatakN1 commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458#issuecomment-605643139 I tried and it works now once I manually copy the file.

[jira] [Updated] (HUDI-686) Implement BloomIndexV2 that does not depend on memory caching

2020-03-29 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-686: Status: Open (was: New) > Implement BloomIndexV2 that does not depend on memory caching > --

[jira] [Updated] (HUDI-742) Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

2020-03-29 Thread edwinguo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] edwinguo updated HUDI-742: -- Status: In Progress (was: Open) > Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I > --

[jira] [Assigned] (HUDI-742) Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I

2020-03-29 Thread edwinguo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] edwinguo reassigned HUDI-742: - Assignee: edwinguo > Fix java.lang.NoSuchMethodError: java.lang.Math.floorMod(JI)I > -

[GitHub] [incubator-hudi] lamber-ken commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

2020-03-29 Thread GitBox
lamber-ken commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458#issuecomment-605632223 right, let's try. : )

[GitHub] [incubator-hudi] PhatakN1 commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

2020-03-29 Thread GitBox
PhatakN1 commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458#issuecomment-605631866 Please find attached. If I just copy the hudi-spark*.jar to this lib folder, wou

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer

2020-03-29 Thread GitBox
leesf commented on a change in pull request #1440: [HUDI-731] Add ChainedTransformer URL: https://github.com/apache/incubator-hudi/pull/1440#discussion_r399793162 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/transform/TestChainedTransformer.java ##

[jira] [Closed] (HUDI-430) Design Inline FileSystem which supports embedding any file format (parquet/avro/etc)

2020-03-29 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-430. -- Resolution: Fixed Fixed via master: ac73bdcdc39e100d4082cf54359690490e5774f7 > Design Inline FileSystem which supports e

[jira] [Resolved] (HUDI-678) Make config package spark free

2020-03-29 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-678. Fix Version/s: 0.6.0 Resolution: Fixed Fixed via master: 8b0a4009a9c662f45a0b76f01c2b07c36809 > Make conf

[jira] [Resolved] (HUDI-663) Fix HoodieDeltaStreamer offset not handled correctly

2020-03-29 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-663. Fix Version/s: 0.6.0 Resolution: Fixed Fixed via master: 38c3ccc51a069dbccab718423055c0a708b44d63 > Fix Hoodi

[jira] [Updated] (HUDI-732) Generate site to content folder

2020-03-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-732: Labels: pull-request-available (was: ) > Generate site to content folder > -

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1463: [HUDI-732] Generate site to content folder

2020-03-29 Thread GitBox
lamber-ken opened a new pull request #1463: [HUDI-732] Generate site to content folder URL: https://github.com/apache/incubator-hudi/pull/1463 ## What is the purpose of the pull request Travis CI worked fine for the past week, we can landed it now. ## Brief change log

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2020-03-29 Thread GitBox
pratyakshsharma commented on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#issuecomment-605618890 @bvaradar Please take a pass.

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-29 Thread GitBox
pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r399780565 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/sources/checkpoint/TestCheckPoi

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider

2020-03-29 Thread GitBox
pratyakshsharma commented on a change in pull request #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#discussion_r399780302 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/checkpoint/KafkaConnect

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #1453: HUDI-644 kafka connect checkpoint provider

2020-03-29 Thread GitBox
pratyakshsharma commented on issue #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#issuecomment-605617670 Just wanted to check if the approach I mentioned in this comment (https://github.com/apache/incubator-hudi/pull/1362#issuecomm

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2020-03-29 Thread GitBox
codecov-io edited a comment on issue #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150#issuecomment-605617268 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1150?src

[GitHub] [incubator-hudi] lamber-ken commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

2020-03-29 Thread GitBox
lamber-ken commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458#issuecomment-605617263 right, as @vinothchandar mentioned, can you share the content of `lib` folder

  1   2   >