[GitHub] [incubator-hudi] PhatakN1 commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

2020-04-02 Thread GitBox
PhatakN1 commented on issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458#issuecomment-608237511 Closing this issue

[GitHub] [incubator-hudi] PhatakN1 closed issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload

2020-04-02 Thread GitBox
PhatakN1 closed issue #1458: Issue with running compaction on a MOR dataset with org.apache.hudi.payload.AWSDmsAvroPayload URL: https://github.com/apache/incubator-hudi/issues/1458 This is an automated message from the

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #236

2020-04-02 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.35 KB...] logging settings.xml toolchains.xml /home/jenkins/tools/maven/apache-maven-3.5.4/conf/logging: simplelogger.properties

[GitHub] [incubator-hudi] cdmikechen closed issue #1481: [SUPPORT] If using a spark session deal with many tables, hudi cache may report OOM

2020-04-02 Thread GitBox
cdmikechen closed issue #1481: [SUPPORT] If using a spark session deal with many tables, hudi cache may report OOM URL: https://github.com/apache/incubator-hudi/issues/1481 This is an automated message from the Apache Git

[GitHub] [incubator-hudi] cdmikechen opened a new issue #1481: [SUPPORT] If use a spark session deal with many tables, hudi cache may report `java.lang.OutOfMemoryError`

2020-04-02 Thread GitBox
cdmikechen opened a new issue #1481: [SUPPORT] If use a spark session deal with many tables, hudi cache may report `java.lang.OutOfMemoryError` URL: https://github.com/apache/incubator-hudi/issues/1481 **Describe the problem you faced** If use a spark session deal with many tables, hudi

[jira] [Resolved] (HUDI-689) Fix hudi cli commands with overlapping words

2020-04-02 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish resolved HUDI-689. - Resolution: Fixed > Fix hudi cli commands with overlapping words > >

[GitHub] [incubator-hudi] symfrog commented on issue #1480: [SUPPORT]

2020-04-02 Thread GitBox
symfrog commented on issue #1480: [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1480#issuecomment-608114543 @bvaradar the purpose would be in the case of an unavoidable schema evolution that is not backward compatible, we would maintain the original tables for some period

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports.

2020-04-02 Thread GitBox
bvaradar commented on a change in pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1468#discussion_r402596025 ## File path: .codecov.yml ## @@ -0,0 +1,46 @@ +# Licensed to

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports.

2020-04-02 Thread GitBox
bvaradar commented on a change in pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1468#discussion_r402598101 ## File path: .codecov.yml ## @@ -0,0 +1,46 @@ +# Licensed to

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports.

2020-04-02 Thread GitBox
bvaradar commented on a change in pull request #1468: [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports. URL: https://github.com/apache/incubator-hudi/pull/1468#discussion_r402593345 ## File path: .codecov.yml ## @@ -0,0 +1,46 @@ +# Licensed to

[GitHub] [incubator-hudi] bvaradar commented on issue #1480: [SUPPORT]

2020-04-02 Thread GitBox
bvaradar commented on issue #1480: [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1480#issuecomment-608081240 It is not clear what is the advantage of retaining instant timestamps between pipelines. Can you elaborate more on what the issue is when migrating tables ?

[jira] [Assigned] (HUDI-426) Implement Spark DataSource Support for querying bootstrapped tables

2020-04-02 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra reassigned HUDI-426: -- Assignee: Udit Mehrotra (was: Nicholas Jiang) > Implement Spark DataSource Support for

[GitHub] [incubator-hudi] symfrog opened a new issue #1480: [SUPPORT]

2020-04-02 Thread GitBox
symfrog opened a new issue #1480: [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1480 **Describe the problem you faced** Is there any way to retain the commit instant time for records when using delta streamer with a Hudi table source? I took a look at the

[GitHub] [incubator-hudi] prashantwason commented on a change in pull request #1476: [HUDI-757] Added hudi-cli command to export metadata of Instants.

2020-04-02 Thread GitBox
prashantwason commented on a change in pull request #1476: [HUDI-757] Added hudi-cli command to export metadata of Instants. URL: https://github.com/apache/incubator-hudi/pull/1476#discussion_r402532134 ## File path:

[jira] [Updated] (HUDI-758) Modify Integration test to include incremental queries on RO, RT views

2020-04-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-758: Labels: pull-request-available (was: ) > Modify Integration test to include incremental queries on

[GitHub] [incubator-hudi] satishkotha opened a new pull request #1479: [HUDI-758] Modify Integration test to include incremental queries on MOR tables

2020-04-02 Thread GitBox
satishkotha opened a new pull request #1479: [HUDI-758] Modify Integration test to include incremental queries on MOR tables URL: https://github.com/apache/incubator-hudi/pull/1479 ## What is the purpose of the pull request Extend IntegrationTest to do incremental reads on MOR

[GitHub] [incubator-hudi] n3nash merged pull request #1474: [HUDI-562] Enable testing at debug log level

2020-04-02 Thread GitBox
n3nash merged pull request #1474: [HUDI-562] Enable testing at debug log level URL: https://github.com/apache/incubator-hudi/pull/1474 This is an automated message from the Apache Git Service. To respond to the message,

[incubator-hudi] branch master updated: [HUDI-562] Enable testing at debug log level

2020-04-02 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 639ec20 [HUDI-562] Enable testing at

[jira] [Updated] (HUDI-758) Modify Integration test to include incremental queries on RO, RT views

2020-04-02 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish updated HUDI-758: Description: ITTestHoodieDemo does basic validation of docker demo. But it does not include incremental queries on

[jira] [Commented] (HUDI-733) presto query data error

2020-04-02 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073954#comment-17073954 ] Bhavani Sudha commented on HUDI-733: [~hj324545] Let me try to reproduce this and get back. Which

[jira] [Created] (HUDI-758) Modify Integration test to include incremental queries on RO, RT views

2020-04-02 Thread satish (Jira)
satish created HUDI-758: --- Summary: Modify Integration test to include incremental queries on RO, RT views Key: HUDI-758 URL: https://issues.apache.org/jira/browse/HUDI-758 Project: Apache Hudi (incubating)

[jira] [Assigned] (HUDI-758) Modify Integration test to include incremental queries on RO, RT views

2020-04-02 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish reassigned HUDI-758: --- Assignee: satish > Modify Integration test to include incremental queries on RO, RT views >

[jira] [Updated] (HUDI-758) Modify Integration test to include incremental queries on RO, RT views

2020-04-02 Thread satish (Jira)
[ https://issues.apache.org/jira/browse/HUDI-758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] satish updated HUDI-758: Priority: Trivial (was: Major) > Modify Integration test to include incremental queries on RO, RT views >

[jira] [Updated] (HUDI-733) presto query data error

2020-04-02 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-733: --- Status: Open (was: New) > presto query data error > --- > > Key:

[jira] [Assigned] (HUDI-733) presto query data error

2020-04-02 Thread Bhavani Sudha (Jira)
[ https://issues.apache.org/jira/browse/HUDI-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha reassigned HUDI-733: -- Assignee: Bhavani Sudha > presto query data error > --- > >

[GitHub] [incubator-hudi] ramachandranms commented on a change in pull request #1473: [HUDI-568] Improve unit test coverage

2020-04-02 Thread GitBox
ramachandranms commented on a change in pull request #1473: [HUDI-568] Improve unit test coverage URL: https://github.com/apache/incubator-hudi/pull/1473#discussion_r402460306 ## File path:

[GitHub] [incubator-hudi] ramachandranms commented on a change in pull request #1473: [HUDI-568] Improve unit test coverage

2020-04-02 Thread GitBox
ramachandranms commented on a change in pull request #1473: [HUDI-568] Improve unit test coverage URL: https://github.com/apache/incubator-hudi/pull/1473#discussion_r402449347 ## File path:

[GitHub] [incubator-hudi] ramachandranms commented on a change in pull request #1473: [HUDI-568] Improve unit test coverage

2020-04-02 Thread GitBox
ramachandranms commented on a change in pull request #1473: [HUDI-568] Improve unit test coverage URL: https://github.com/apache/incubator-hudi/pull/1473#discussion_r402449210 ## File path:

[GitHub] [incubator-hudi] ramachandranms commented on a change in pull request #1473: [HUDI-568] Improve unit test coverage

2020-04-02 Thread GitBox
ramachandranms commented on a change in pull request #1473: [HUDI-568] Improve unit test coverage URL: https://github.com/apache/incubator-hudi/pull/1473#discussion_r402449210 ## File path:

[GitHub] [incubator-hudi] ramachandranms commented on a change in pull request #1473: [HUDI-568] Improve unit test coverage

2020-04-02 Thread GitBox
ramachandranms commented on a change in pull request #1473: [HUDI-568] Improve unit test coverage URL: https://github.com/apache/incubator-hudi/pull/1473#discussion_r402445412 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/collection/RocksDBDAO.java

[GitHub] [incubator-hudi] hddong commented on issue #1242: [HUDI-544] Archived commits command code cleanup

2020-04-02 Thread GitBox
hddong commented on issue #1242: [HUDI-544] Archived commits command code cleanup URL: https://github.com/apache/incubator-hudi/pull/1242#issuecomment-607749987 @n3nash squashed all commits to 1. I had do something for `create another ticket for us`, but I am not sure if it is right.

[GitHub] [incubator-hudi] hddong commented on a change in pull request #1449: [WIP][HUDI-698]Add unit test for CleansCommand

2020-04-02 Thread GitBox
hddong commented on a change in pull request #1449: [WIP][HUDI-698]Add unit test for CleansCommand URL: https://github.com/apache/incubator-hudi/pull/1449#discussion_r402189178 ## File path: hudi-cli/src/test/java/org/apache/hudi/cli/commands/TestCleansCommand.java ## @@

[incubator-hudi] branch master updated: [MINIOR] Add license header for .asf.yaml and adjust labels

2020-04-02 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new bd716ec [MINIOR] Add license header

[GitHub] [incubator-hudi] yanghua merged pull request #1478: Fix label issue in .asf.yaml

2020-04-02 Thread GitBox
yanghua merged pull request #1478: Fix label issue in .asf.yaml URL: https://github.com/apache/incubator-hudi/pull/1478 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [incubator-hudi] yanghua opened a new pull request #1478: Fix label issue in .asf.yaml

2020-04-02 Thread GitBox
yanghua opened a new pull request #1478: Fix label issue in .asf.yaml URL: https://github.com/apache/incubator-hudi/pull/1478 ## What is the purpose of the pull request *This pull request fixes label issue in .asf.yaml* ## Brief change log - *Fix label issue