[GitHub] [hudi] garyli1019 commented on a change in pull request #1707: [HUDI-988] fix more unit tests flakiness

2020-06-07 Thread GitBox
garyli1019 commented on a change in pull request #1707: URL: https://github.com/apache/hudi/pull/1707#discussion_r436467598 ## File path: hudi-client/src/test/java/org/apache/hudi/client/TestMultiFS.java ## @@ -63,9 +63,7 @@ public void setUp() throws Exception {

[GitHub] [hudi] bvaradar commented on issue #1625: [SUPPORT] MOR upsert table grows in size when ingesting same records

2020-06-07 Thread GitBox
bvaradar commented on issue #1625: URL: https://github.com/apache/hudi/issues/1625#issuecomment-640382420 @rolandjohann : Any updates on this ? This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] bvaradar commented on issue #1705: Tracking Hudi Data along transaction time and buisness time

2020-06-07 Thread GitBox
bvaradar commented on issue #1705: URL: https://github.com/apache/hudi/issues/1705#issuecomment-640382104 I may not be following the problem completely but this sounds like event and arrival time to me (w.r.t database). Is it possible to have a different unique key and have separate

[GitHub] [hudi] sathyaprakashg commented on pull request #1664: HUDI-942 Increase default value number of delta commits for inline compaction

2020-06-07 Thread GitBox
sathyaprakashg commented on pull request #1664: URL: https://github.com/apache/hudi/pull/1664#issuecomment-640380397 @bvaradar I found the reason for integration test failure and updated compaction.commands file to fix it and now both unit test and integration tests are green. I am

[GitHub] [hudi] bvaradar closed issue #1709: [SUPPORT]

2020-06-07 Thread GitBox
bvaradar closed issue #1709: URL: https://github.com/apache/hudi/issues/1709 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] bvaradar commented on issue #1676: [SUPPORT] Updating all the records per key rather than the one with higher timestamp

2020-06-07 Thread GitBox
bvaradar commented on issue #1676: URL: https://github.com/apache/hudi/issues/1676#issuecomment-640377675 @abhibhat98 : Pinging to see if you can answer the above question ? This is an automated message from the Apache Git

[jira] [Updated] (HUDI-1005) NPE in HoodieWriteClient.clean

2020-06-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1005: - Labels: pull-request-available (was: ) > NPE in HoodieWriteClient.clean >

[GitHub] [hudi] shenh062326 opened a new pull request #1714: [HUDI-1005] fix NPE in HoodieWriteClient.clean

2020-06-07 Thread GitBox
shenh062326 opened a new pull request #1714: URL: https://github.com/apache/hudi/pull/1714 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[GitHub] [hudi] bvaradar commented on a change in pull request #1707: [HUDI-988] fix more unit tests flakiness

2020-06-07 Thread GitBox
bvaradar commented on a change in pull request #1707: URL: https://github.com/apache/hudi/pull/1707#discussion_r436456552 ## File path: hudi-client/src/test/java/org/apache/hudi/client/TestMultiFS.java ## @@ -63,9 +63,7 @@ public void setUp() throws Exception { @AfterEach

[GitHub] [hudi] bvaradar commented on pull request #1707: [HUDI-988] fix more unit tests flakiness

2020-06-07 Thread GitBox
bvaradar commented on pull request #1707: URL: https://github.com/apache/hudi/pull/1707#issuecomment-640360777 @garyli1019 : Will review the code and also rerun few more times before merging This is an automated message

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #302

2020-06-07 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.49 KB...] settings.xml toolchains.xml /home/jenkins/tools/maven/apache-maven-3.5.4/conf/logging: simplelogger.properties

[GitHub] [hudi] nikitap95 commented on issue #1550: Hudi 0.5.2 inability save complex type with nullable = true [SUPPORT]

2020-06-07 Thread GitBox
nikitap95 commented on issue #1550: URL: https://github.com/apache/hudi/issues/1550#issuecomment-640341692 Hi, any updates on when would this be released and rolled out? This is an automated message from the Apache Git

[jira] [Created] (HUDI-1005) NPE in HoodieWriteClient.clean

2020-06-07 Thread Hong Shen (Jira)
Hong Shen created HUDI-1005: --- Summary: NPE in HoodieWriteClient.clean Key: HUDI-1005 URL: https://issues.apache.org/jira/browse/HUDI-1005 Project: Apache Hudi Issue Type: Bug

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1711: [HUDI-974] fix fields out of order in MOR mode when using Hive

2020-06-07 Thread GitBox
codecov-commenter edited a comment on pull request #1711: URL: https://github.com/apache/hudi/pull/1711#issuecomment-640326551 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1711?src=pr=h1) Report > Merging [#1711](https://codecov.io/gh/apache/hudi/pull/1711?src=pr=desc) into

[GitHub] [hudi] codecov-commenter commented on pull request #1711: [HUDI-974] fix fields out of order in MOR mode when using Hive

2020-06-07 Thread GitBox
codecov-commenter commented on pull request #1711: URL: https://github.com/apache/hudi/pull/1711#issuecomment-640326551 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1711?src=pr=h1) Report > Merging [#1711](https://codecov.io/gh/apache/hudi/pull/1711?src=pr=desc) into

[jira] [Commented] (HUDI-1003) Handle partitions correctly when sync non-partitioned table to hive.

2020-06-07 Thread Yajun Luo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127821#comment-17127821 ] Yajun Luo commented on HUDI-1003: - [~xleesf] Hi, I'm going to work on this. > Handle partitions correctly

[GitHub] [hudi] hddong commented on pull request #1699: [HUDI-989]Support long options for prepare_integration_suite

2020-06-07 Thread GitBox
hddong commented on pull request #1699: URL: https://github.com/apache/hudi/pull/1699#issuecomment-640312814 @yanghua @n3nash please have a reivew when free. This is an automated message from the Apache Git Service. To

[jira] [Assigned] (HUDI-1003) Handle partitions correctly when sync non-partitioned table to hive.

2020-06-07 Thread Yajun Luo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yajun Luo reassigned HUDI-1003: --- Assignee: Yajun Luo > Handle partitions correctly when sync non-partitioned table to hive. >

[GitHub] [hudi] garyli1019 commented on pull request #1707: [HUDI-988] fix more unit tests flakiness

2020-06-07 Thread GitBox
garyli1019 commented on pull request #1707: URL: https://github.com/apache/hudi/pull/1707#issuecomment-640307790 @bvaradar @vinothchandar This PR fixes more tests on top of HUDI-988, but not completely fix the memory leak. Two consecutive builds were passed. The unit test structure

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1707: [HUDI-988] fix more unit tests flakiness

2020-06-07 Thread GitBox
codecov-commenter edited a comment on pull request #1707: URL: https://github.com/apache/hudi/pull/1707#issuecomment-639967452 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1707?src=pr=h1) Report > Merging [#1707](https://codecov.io/gh/apache/hudi/pull/1707?src=pr=desc) into

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1707: [WIP][MINOR] try to fix CI OOM

2020-06-07 Thread GitBox
codecov-commenter edited a comment on pull request #1707: URL: https://github.com/apache/hudi/pull/1707#issuecomment-639967452 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1707?src=pr=h1) Report > Merging [#1707](https://codecov.io/gh/apache/hudi/pull/1707?src=pr=desc) into

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1707: [WIP][MINOR] try to fix CI OOM

2020-06-07 Thread GitBox
codecov-commenter edited a comment on pull request #1707: URL: https://github.com/apache/hudi/pull/1707#issuecomment-639967452 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1707?src=pr=h1) Report > Merging [#1707](https://codecov.io/gh/apache/hudi/pull/1707?src=pr=desc) into

[GitHub] [hudi] zhedoubushishi opened a new pull request #1713: Add HIVE_STYLE_PARTITIONING_OPT_KEY to Config doc

2020-06-07 Thread GitBox
zhedoubushishi opened a new pull request #1713: URL: https://github.com/apache/hudi/pull/1713 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1664: HUDI-942 Increase default value number of delta commits for inline compaction

2020-06-07 Thread GitBox
codecov-commenter edited a comment on pull request #1664: URL: https://github.com/apache/hudi/pull/1664#issuecomment-640292029 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1664?src=pr=h1) Report > Merging [#1664](https://codecov.io/gh/apache/hudi/pull/1664?src=pr=desc) into

[GitHub] [hudi] codecov-commenter commented on pull request #1664: HUDI-942 Increase default value number of delta commits for inline compaction

2020-06-07 Thread GitBox
codecov-commenter commented on pull request #1664: URL: https://github.com/apache/hudi/pull/1664#issuecomment-640292029 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1664?src=pr=h1) Report > Merging [#1664](https://codecov.io/gh/apache/hudi/pull/1664?src=pr=desc) into

[GitHub] [hudi] bvaradar commented on pull request #1712: Cherry picking HUDI-988 and HUDI-990 to release-0.5.3

2020-06-07 Thread GitBox
bvaradar commented on pull request #1712: URL: https://github.com/apache/hudi/pull/1712#issuecomment-640265188 @nsivabalan : Lets wait for tests to pass before you can merge to 0.5.3 branch This is an automated message from

[GitHub] [hudi] bvaradar opened a new pull request #1712: Cherry picking HUDI-988 and HUDI-990 to release-0.5.3

2020-06-07 Thread GitBox
bvaradar opened a new pull request #1712: URL: https://github.com/apache/hudi/pull/1712 commit fb283934a33a0bc7b11f80e4149f7922fa4f0af5 (HEAD -> master, upstream/master) Author: Balaji Varadarajan Date: Wed Jun 3 00:35:14 2020 -0700 [HUDI-990] Timeline API :

[GitHub] [hudi] xushiyan commented on pull request #1647: [HUDI-867]: fixed IllegalArgumentException from graphite metrics in deltaStreamer continuous mode

2020-06-07 Thread GitBox
xushiyan commented on pull request #1647: URL: https://github.com/apache/hudi/pull/1647#issuecomment-640256360 > is it suitable to change to `...` @leesf This is also problematic as `_i` since the metric name is changed. Aggregation works on the same metric name.

[GitHub] [hudi] nandini57 edited a comment on issue #1705: Tracking Hudi Data along transaction time and buisness time

2020-06-07 Thread GitBox
nandini57 edited a comment on issue #1705: URL: https://github.com/apache/hudi/issues/1705#issuecomment-640243834 haha. Sharing a superb short version which i tried implementing from functional point of view. Check Chapter 10.

[GitHub] [hudi] nandini57 commented on issue #1705: Tracking Hudi Data along transaction time and buisness time

2020-06-07 Thread GitBox
nandini57 commented on issue #1705: URL: https://github.com/apache/hudi/issues/1705#issuecomment-640243834 haha. Sharing a superb short version which i tried implementing from functional point of view. Check Chapter 10.

[jira] [Updated] (HUDI-1004) Failed to send metrics when HoodieDeltaStreamer

2020-06-07 Thread Hong Shen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated HUDI-1004: Description: When I run HoodieDeltaStreamer with hoodie.metrics.on=true and

[jira] [Created] (HUDI-1004) Failed to send metrics when HoodieDeltaStreamer

2020-06-07 Thread Hong Shen (Jira)
Hong Shen created HUDI-1004: --- Summary: Failed to send metrics when HoodieDeltaStreamer Key: HUDI-1004 URL: https://issues.apache.org/jira/browse/HUDI-1004 Project: Apache Hudi Issue Type: Sub-task

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1690: [HUDI-908] Add decimals to HoodieTestDataGenerator

2020-06-07 Thread GitBox
codecov-commenter edited a comment on pull request #1690: URL: https://github.com/apache/hudi/pull/1690#issuecomment-637973048 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1690?src=pr=h1) Report > Merging [#1690](https://codecov.io/gh/apache/hudi/pull/1690?src=pr=desc) into

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1690: [HUDI-908] Add decimals to HoodieTestDataGenerator

2020-06-07 Thread GitBox
codecov-commenter edited a comment on pull request #1690: URL: https://github.com/apache/hudi/pull/1690#issuecomment-637973048 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1690?src=pr=h1) Report > Merging [#1690](https://codecov.io/gh/apache/hudi/pull/1690?src=pr=desc) into