[jira] [Created] (HUDI-987) Need integration tests for MOR table of decimal type

2020-06-02 Thread Yajun Luo (Jira)
Yajun Luo created HUDI-987: -- Summary: Need integration tests for MOR table of decimal type Key: HUDI-987 URL: https://issues.apache.org/jira/browse/HUDI-987 Project: Apache Hudi Issue Type: Test

[GitHub] [hudi] luoyajun526 commented on pull request #1677: [HUDI-934] Add processing logic for the decimal LogicalType

2020-06-02 Thread GitBox
luoyajun526 commented on pull request #1677: URL: https://github.com/apache/hudi/pull/1677#issuecomment-637340942 > @leesf @luoyajun526 The code LGTM. But I think we need to make sure existing integration tests for MOR cover this case. The integration tests use `HoodieTestDataGenerator`

[jira] [Updated] (HUDI-987) Need integration tests for MOR table of decimal type

2020-06-02 Thread Yajun Luo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yajun Luo updated HUDI-987: --- Description: This came up during review: [https://github.com/apache/hudi/pull/1677] It added a processing

[GitHub] [hudi] bvaradar commented on issue #1696: COW Error on existing Hive Table

2020-06-02 Thread GitBox
bvaradar commented on issue #1696: URL: https://github.com/apache/hudi/issues/1696#issuecomment-637365531 @selvarajperiyasamy : You can use the setting hoodie.datasource.write.hive_style_partitioning=true to enable hive style partitioning. (See

[GitHub] [hudi] luoyajun526 edited a comment on pull request #1677: [HUDI-934] Add processing logic for the decimal LogicalType

2020-06-02 Thread GitBox
luoyajun526 edited a comment on pull request #1677: URL: https://github.com/apache/hudi/pull/1677#issuecomment-637340942 > @leesf @luoyajun526 The code LGTM. But I think we need to make sure existing integration tests for MOR cover this case. The integration tests use

[jira] [Created] (HUDI-988) Fix unit test flakiness in Hudi

2020-06-02 Thread Balaji Varadarajan (Jira)
Balaji Varadarajan created HUDI-988: --- Summary: Fix unit test flakiness in Hudi Key: HUDI-988 URL: https://issues.apache.org/jira/browse/HUDI-988 Project: Apache Hudi Issue Type: Task

[jira] [Assigned] (HUDI-988) Fix unit test flakiness in Hudi

2020-06-02 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan reassigned HUDI-988: --- Assignee: Balaji Varadarajan > Fix unit test flakiness in Hudi >

[jira] [Updated] (HUDI-988) Fix unit test flakiness in Hudi

2020-06-02 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan updated HUDI-988: Status: Open (was: New) > Fix unit test flakiness in Hudi > ---

[jira] [Updated] (HUDI-988) Fix unit test flakiness in Hudi

2020-06-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-988: Labels: pull-request-available (was: ) > Fix unit test flakiness in Hudi >

[GitHub] [hudi] bvaradar opened a new pull request #1697: [HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly

2020-06-02 Thread GitBox
bvaradar opened a new pull request #1697: URL: https://github.com/apache/hudi/pull/1697 Going to use this PR to iterate on fixing flakiness. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] bvaradar commented on pull request #1697: [HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly

2020-06-02 Thread GitBox
bvaradar commented on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637397675 HoodieWriteClient is being initiated several times (more than one time per test in some cases) but they are not being closed. As we have enabled timeline-server, closing write is

[GitHub] [hudi] Raghvendradubey commented on issue #1694: Slow Write into Hudi Dataset(MOR)

2020-06-02 Thread GitBox
Raghvendradubey commented on issue #1694: URL: https://github.com/apache/hudi/issues/1694#issuecomment-637414299 Hello Vinoth, I was just playing with different combination of shuffle parallelism, I am able to reduce countByKey at WorkloadProfile.java through shuffle partition by

[GitHub] [hudi] Raghvendradubey edited a comment on issue #1694: Slow Write into Hudi Dataset(MOR)

2020-06-02 Thread GitBox
Raghvendradubey edited a comment on issue #1694: URL: https://github.com/apache/hudi/issues/1694#issuecomment-637414299 Hello Vinoth, I was just playing with different combination of shuffle parallelism, I am able to reduce countByKey at WorkloadProfile.java through shuffle

[hudi] branch release-0.5.3 updated: Bumping release candidate number 1

2020-06-02 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.5.3 in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/release-0.5.3 by this push: new 5fcc461 Bumping release

[hudi] branch master updated: [HUDI-934] Add processing logic for the decimal LogicalType (#1677)

2020-06-02 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a9a97d6 [HUDI-934] Add processing logic for the

[GitHub] [hudi] leesf merged pull request #1677: [HUDI-934] Add processing logic for the decimal LogicalType

2020-06-02 Thread GitBox
leesf merged pull request #1677: URL: https://github.com/apache/hudi/pull/1677 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] vinothchandar commented on a change in pull request #1592: [HUDI-822] decouple Hudi related logics from HoodieInputFormat

2020-06-02 Thread GitBox
vinothchandar commented on a change in pull request #1592: URL: https://github.com/apache/hudi/pull/1592#discussion_r433996472 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeRecordReaderUtils.java ## @@ -0,0 +1,261 @@ +/* + * Licensed to

[hudi] annotated tag release-0.5.3-rc1 updated (5fcc461 -> e940143)

2020-06-02 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to annotated tag release-0.5.3-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git. *** WARNING: tag release-0.5.3-rc1 was modified! *** from 5fcc461 (commit) to e940143 (tag)

[GitHub] [hudi] nsivabalan commented on issue #1695: [SUPPORT] : Global Bloom Index config issue

2020-06-02 Thread GitBox
nsivabalan commented on issue #1695: URL: https://github.com/apache/hudi/issues/1695#issuecomment-637639178 I can take a look at this This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] bvaradar commented on pull request #1697: [WIP][HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly

2020-06-02 Thread GitBox
bvaradar commented on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637657631 Will be re-triggering the tests few times This is an automated message from the Apache Git Service. To respond to

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1697: [WIP][HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly

2020-06-02 Thread GitBox
codecov-commenter edited a comment on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637484534 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=h1) Report > Merging [#1697](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=desc) into

[GitHub] [hudi] nandini57 closed issue #1629: [SUPPORT]Merge On Read HiveSync

2020-06-02 Thread GitBox
nandini57 closed issue #1629: URL: https://github.com/apache/hudi/issues/1629 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] codecov-commenter commented on pull request #1697: [WIP][HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly

2020-06-02 Thread GitBox
codecov-commenter commented on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637484534 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=h1) Report > Merging [#1697](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=desc) into

[GitHub] [hudi] nandini57 commented on issue #1629: [SUPPORT]Merge On Read HiveSync

2020-06-02 Thread GitBox
nandini57 commented on issue #1629: URL: https://github.com/apache/hudi/issues/1629#issuecomment-637512843 couldn't reproduce this again.We can close this one for now This is an automated message from the Apache Git Service.

svn commit: r39900 - in /dev/hudi/hudi-0.5.3-rc1: hudi-0.5.3-rc1.src.tgz hudi-0.5.3-rc1.src.tgz.asc hudi-0.5.3-rc1.src.tgz.sha512

2020-06-02 Thread sivabalan
Author: sivabalan Date: Tue Jun 2 16:43:46 2020 New Revision: 39900 Log: Staging source releases for release-0.5.3-rc1 Modified: dev/hudi/hudi-0.5.3-rc1/hudi-0.5.3-rc1.src.tgz dev/hudi/hudi-0.5.3-rc1/hudi-0.5.3-rc1.src.tgz.asc dev/hudi/hudi-0.5.3-rc1/hudi-0.5.3-rc1.src.tgz.sha512

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1697: [WIP][HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly

2020-06-02 Thread GitBox
codecov-commenter edited a comment on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637484534 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=h1) Report > Merging [#1697](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=desc) into

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1697: [WIP][HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly

2020-06-02 Thread GitBox
codecov-commenter edited a comment on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637484534 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=h1) Report > Merging [#1697](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=desc) into

[GitHub] [hudi] bvaradar closed issue #1670: Error opening Hive split: Unknown converted type TIMESTAMP_MICROS

2020-06-02 Thread GitBox
bvaradar closed issue #1670: URL: https://github.com/apache/hudi/issues/1670 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] lamber-ken opened a new pull request #1698: [HUDI-986] Support staging site for per pull request

2020-06-02 Thread GitBox
lamber-ken opened a new pull request #1698: URL: https://github.com/apache/hudi/pull/1698 ## What is the purpose of the pull request Support staging site for per pull request. ## Brief change log - Modify relative path - Add support staging site docs ##

[jira] [Updated] (HUDI-986) Support staging site for per pull request

2020-06-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-986: Labels: pull-request-available (was: ) > Support staging site for per pull request >

[GitHub] [hudi] lamber-ken commented on pull request #1698: [HUDI-986] Support staging site for per pull request

2020-06-02 Thread GitBox
lamber-ken commented on pull request #1698: URL: https://github.com/apache/hudi/pull/1698#issuecomment-637683589 ### Building staging docs When you submit a pull request for any changes on websites or docs, we recommend you generate staging site for review. You can refer to

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1697: [WIP][HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly

2020-06-02 Thread GitBox
codecov-commenter edited a comment on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637484534 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=h1) Report > Merging [#1697](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=desc) into

[GitHub] [hudi] anismiles commented on issue #1670: Error opening Hive split: Unknown converted type TIMESTAMP_MICROS

2020-06-02 Thread GitBox
anismiles commented on issue #1670: URL: https://github.com/apache/hudi/issues/1670#issuecomment-637723431 Is there a link to the hive bug mentioned above? This is an automated message from the Apache Git Service. To

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1602: [HUDI-494] fix incorrect record size estimation

2020-06-02 Thread GitBox
codecov-commenter edited a comment on pull request #1602: URL: https://github.com/apache/hudi/pull/1602#issuecomment-632410484 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1602?src=pr=h1) Report > Merging [#1602](https://codecov.io/gh/apache/hudi/pull/1602?src=pr=desc) into

[GitHub] [hudi] bvaradar commented on issue #1649: [SUPPORT] Not more than one spark.sql is working on Hoodie Parquet format

2020-06-02 Thread GitBox
bvaradar commented on issue #1649: URL: https://github.com/apache/hudi/issues/1649#issuecomment-637686168 @HariprasadAllaka1612 : Just pinging to see if you are still having issues This is an automated message from the

[GitHub] [hudi] bvaradar closed issue #1649: [SUPPORT] Not more than one spark.sql is working on Hoodie Parquet format

2020-06-02 Thread GitBox
bvaradar closed issue #1649: URL: https://github.com/apache/hudi/issues/1649 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] bvaradar commented on issue #1649: [SUPPORT] Not more than one spark.sql is working on Hoodie Parquet format

2020-06-02 Thread GitBox
bvaradar commented on issue #1649: URL: https://github.com/apache/hudi/issues/1649#issuecomment-637687664 Closing due to inactivity. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1602: [HUDI-494] fix incorrect record size estimation

2020-06-02 Thread GitBox
codecov-commenter edited a comment on pull request #1602: URL: https://github.com/apache/hudi/pull/1602#issuecomment-632410484 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1602?src=pr=h1) Report > Merging [#1602](https://codecov.io/gh/apache/hudi/pull/1602?src=pr=desc) into

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1697: [WIP][HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly

2020-06-02 Thread GitBox
codecov-commenter edited a comment on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637484534 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=h1) Report > Merging [#1697](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=desc) into

[jira] [Updated] (HUDI-959) HoodieTable abstraction with pluggable Base and Log formats

2020-06-02 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-959: Status: In Progress (was: Open) > HoodieTable abstraction with pluggable Base and Log formats >

[jira] [Updated] (HUDI-959) HoodieTable abstraction with pluggable Base and Log formats

2020-06-02 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-959: Status: Open (was: New) > HoodieTable abstraction with pluggable Base and Log formats >

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1697: [WIP][HUDI-988] Fix issues causing Unit Test Flakiness

2020-06-02 Thread GitBox
codecov-commenter edited a comment on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637484534 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=h1) Report > Merging [#1697](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=desc) into

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1697: [WIP][HUDI-988] Fix issues causing Unit Test Flakiness

2020-06-02 Thread GitBox
codecov-commenter edited a comment on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637484534 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=h1) Report > Merging [#1697](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=desc) into

[GitHub] [hudi] hddong commented on pull request #1697: [WIP][HUDI-988] Fix issues causing Unit Test Flakiness

2020-06-02 Thread GitBox
hddong commented on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637895660 > @hddong : FYI : There was a flaky test-case in TestRollbacks. Also, I have made changes to only compare outputs after removing rendering information to only validate useful

[GitHub] [hudi] bvaradar commented on pull request #1697: [WIP][HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly

2020-06-02 Thread GitBox
bvaradar commented on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637853066 @hddong : FYI : There was a flaky test-case in TestRollbacks. Also, I have made changes to only compare outputs after removing rendering information to only validate useful

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1697: [WIP][HUDI-988] Fix issues causing Unit Test Flakiness

2020-06-02 Thread GitBox
codecov-commenter edited a comment on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637484534 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=h1) Report > Merging [#1697](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=desc) into

[GitHub] [hudi] lamber-ken commented on pull request #1697: [WIP][HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly

2020-06-02 Thread GitBox
lamber-ken commented on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637817029 hi @bvaradar, you can use following command to retrigger, no need use `--force` option ``` git commit --allow-empty -m 'trigger rebuild' git push origin ```

[jira] [Updated] (HUDI-960) HFile Writer and HFile Reader and plugging them into the HoodieFileGroupIO

2020-06-02 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-960: Status: Open (was: New) > HFile Writer and HFile Reader and plugging them into the

[jira] [Updated] (HUDI-960) HFile Writer and HFile Reader and plugging them into the HoodieFileGroupIO

2020-06-02 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-960: Status: In Progress (was: Open) > HFile Writer and HFile Reader and plugging them into the

[GitHub] [hudi] lamber-ken edited a comment on pull request #1697: [WIP][HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly

2020-06-02 Thread GitBox
lamber-ken edited a comment on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637817029 hi @bvaradar, you can use following command to retrigger, no need use `--force` option ``` git commit --allow-empty -m 'trigger rebuild' git push origin ```

[GitHub] [hudi] bvaradar commented on pull request #1697: [WIP][HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly

2020-06-02 Thread GitBox
bvaradar commented on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637794330 Not seeing OOM errors for few runs now. But, the last run had a test failure. Investigating ``` ERROR] Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:

[jira] [Updated] (HUDI-962) HoodieLogFormatWriter and HoodieLogFileReader support for HoodieHFileDataBlock

2020-06-02 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-962: Status: In Progress (was: Open) > HoodieLogFormatWriter and HoodieLogFileReader support for

[jira] [Updated] (HUDI-961) Implement HoodieHFileDataBlock to allow for logging Hfile to log blocks

2020-06-02 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-961: Status: Open (was: New) > Implement HoodieHFileDataBlock to allow for logging Hfile to log blocks >

[jira] [Updated] (HUDI-961) Implement HoodieHFileDataBlock to allow for logging Hfile to log blocks

2020-06-02 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-961: Status: In Progress (was: Open) > Implement HoodieHFileDataBlock to allow for logging Hfile to log

[jira] [Updated] (HUDI-962) HoodieLogFormatWriter and HoodieLogFileReader support for HoodieHFileDataBlock

2020-06-02 Thread Prashant Wason (Jira)
[ https://issues.apache.org/jira/browse/HUDI-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Wason updated HUDI-962: Status: Open (was: New) > HoodieLogFormatWriter and HoodieLogFileReader support for

[GitHub] [hudi] codecov-commenter edited a comment on pull request #1697: [WIP][HUDI-988] Fix issues causing Unit Test Flakiness

2020-06-02 Thread GitBox
codecov-commenter edited a comment on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637484534 # [Codecov](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=h1) Report > Merging [#1697](https://codecov.io/gh/apache/hudi/pull/1697?src=pr=desc) into

[GitHub] [hudi] bvaradar commented on pull request #1697: [WIP][HUDI-988] Fix issues causing Unit Test Flakiness

2020-06-02 Thread GitBox
bvaradar commented on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637918789 After few successful runs, hitting upon the below issue. Investigating ``` [ERROR] org.apache.hudi.table.TestHoodieMergeOnReadTable [ERROR]

[jira] [Created] (HUDI-989) Support long options for prepare_integration_suite

2020-06-02 Thread hong dongdong (Jira)
hong dongdong created HUDI-989: -- Summary: Support long options for prepare_integration_suite Key: HUDI-989 URL: https://issues.apache.org/jira/browse/HUDI-989 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-989) Support long options for prepare_integration_suite

2020-06-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-989: Labels: pull-request-available (was: ) > Support long options for prepare_integration_suite >

[GitHub] [hudi] vinothchandar commented on pull request #1697: [WIP][HUDI-988] Fix issues causing Unit Test Flakiness

2020-06-02 Thread GitBox
vinothchandar commented on pull request #1697: URL: https://github.com/apache/hudi/pull/1697#issuecomment-637933713 Do these flaky tests exist on 0.5.3 Branch as well? This is an automated message from the Apache Git

[GitHub] [hudi] garyli1019 opened a new pull request #1700: [Draft]Hudi 69 draft

2020-06-02 Thread GitBox
garyli1019 opened a new pull request #1700: URL: https://github.com/apache/hudi/pull/1700 This PR is a draft to gather ideas. This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hudi] shenh062326 commented on pull request #1690: [HUDI-908] Add decimals to HoodieTestDataGenerator

2020-06-02 Thread GitBox
shenh062326 commented on pull request #1690: URL: https://github.com/apache/hudi/pull/1690#issuecomment-637961149 > @shenh062326 I think you might want to resolve the conflicts. done This is an automated message from

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #297

2020-06-02 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.42 KB...] settings.xml toolchains.xml /home/jenkins/tools/maven/apache-maven-3.5.4/conf/logging: simplelogger.properties

[GitHub] [hudi] vinothchandar commented on a change in pull request #1687: [WIP] [HUDI-684] Introduced abstraction for writing and reading different types of base file formats.

2020-06-02 Thread GitBox
vinothchandar commented on a change in pull request #1687: URL: https://github.com/apache/hudi/pull/1687#discussion_r434283607 ## File path: hudi-client/src/main/java/org/apache/hudi/table/action/rollback/RollbackHelper.java ## @@ -71,8 +71,9 @@ public

[GitHub] [hudi] garyli1019 commented on a change in pull request #1700: [Draft]Hudi 69 draft

2020-06-02 Thread GitBox
garyli1019 commented on a change in pull request #1700: URL: https://github.com/apache/hudi/pull/1700#discussion_r434301511 ## File path: hudi-spark/src/main/scala/org/apache/hudi/RealtimeRelation.scala ## @@ -0,0 +1,117 @@ +/* + * Licensed to the Apache Software Foundation

[hudi] annotated tag release-0.5.3-rc1 updated (5fcc461 -> 9b9bb8b)

2020-06-02 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to annotated tag release-0.5.3-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git. *** WARNING: tag release-0.5.3-rc1 was modified! *** from 5fcc461 (commit) to 9b9bb8b (tag)

[jira] [Closed] (HUDI-934) Hive query does not work with realtime table which contain decimal type

2020-06-02 Thread Yajun Luo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yajun Luo closed HUDI-934. -- Resolution: Fixed > Hive query does not work with realtime table which contain decimal type >

svn commit: r39907 - in /dev/hudi/hudi-0.5.3-rc1: hudi-0.5.3-rc1.src.tgz hudi-0.5.3-rc1.src.tgz.asc hudi-0.5.3-rc1.src.tgz.sha512

2020-06-02 Thread sivabalan
Author: sivabalan Date: Wed Jun 3 02:32:40 2020 New Revision: 39907 Log: Staging source releases for release-0.5.3-rc1 attempt2 Modified: dev/hudi/hudi-0.5.3-rc1/hudi-0.5.3-rc1.src.tgz dev/hudi/hudi-0.5.3-rc1/hudi-0.5.3-rc1.src.tgz.asc

[GitHub] [hudi] hddong opened a new pull request #1699: [HUDI-989]Support long options for prepare_integration_suite

2020-06-02 Thread GitBox
hddong opened a new pull request #1699: URL: https://github.com/apache/hudi/pull/1699 ## What is the purpose of the pull request *Support long options for prepare_integration_suite.sh* ## Brief change log - *Support long options for prepare_integration_suite.sh*

[jira] [Commented] (HUDI-890) Prepare for 0.5.3 patch release

2020-06-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124566#comment-17124566 ] sivabalan narayanan commented on HUDI-890: -- Here is a spread sheet that I used to compare master

[GitHub] [hudi] vinothchandar commented on pull request #1698: [HUDI-986] Support staging site for per pull request

2020-06-02 Thread GitBox
vinothchandar commented on pull request #1698: URL: https://github.com/apache/hudi/pull/1698#issuecomment-637938659 @xushiyan are you able to help review this This is an automated message from the Apache Git Service. To