Build failed in Jenkins: hudi-snapshot-deployment-0.5 #243

See Changes: -- [...truncated 2.34 KB...] logging settings.xml toolchains.xml /home/jenkins/tools/maven/apache-maven-3.5.4/conf/logging: simplelogger.properties

[jira] [Updated] (HUDI-782) Add support for aliyun OSS

[ https://issues.apache.org/jira/browse/HUDI-782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-782: --- Status: Open (was: New) > Add support for aliyun OSS > -- > > Key: HUDI-782 >

[jira] [Created] (HUDI-782) Add support for aliyun OSS

leesf created HUDI-782: -- Summary: Add support for aliyun OSS Key: HUDI-782 URL: https://issues.apache.org/jira/browse/HUDI-782 Project: Apache Hudi (incubating) Issue Type: Bug Reporter:

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer

garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer URL: https://github.com/apache/incubator-hudi/pull/1486#discussion_r406589335 ## File path:

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1504: [HUDI-780] Add junit 5

yanghua commented on a change in pull request #1504: [HUDI-780] Add junit 5 URL: https://github.com/apache/incubator-hudi/pull/1504#discussion_r406583034 ## File path: hudi-client/src/test/java/org/apache/hudi/metrics/TestHoodieMetrics.java ## @@ -22,22 +22,22 @@ import

[jira] [Updated] (HUDI-780) Make JUnit 5 co-exist in the project

[ https://issues.apache.org/jira/browse/HUDI-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-780: Status: Patch Available (was: In Progress) > Make JUnit 5 co-exist in the project >

[jira] [Updated] (HUDI-780) Make JUnit 5 co-exist in the project

[ https://issues.apache.org/jira/browse/HUDI-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-780: Status: In Progress (was: Open) > Make JUnit 5 co-exist in the project >

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1504: [HUDI-780] Add junit 5

xushiyan commented on a change in pull request #1504: [HUDI-780] Add junit 5 URL: https://github.com/apache/incubator-hudi/pull/1504#discussion_r406563616 ## File path: hudi-client/src/test/java/org/apache/hudi/metrics/TestHoodieMetrics.java ## @@ -22,22 +22,22 @@ import

[GitHub] [incubator-hudi] xushiyan opened a new pull request #1504: [HUDI-780] Add junit 5

xushiyan opened a new pull request #1504: [HUDI-780] Add junit 5 URL: https://github.com/apache/incubator-hudi/pull/1504 ## Committer checklist - [ ] Has a corresponding JIRA in PR title & commit - [ ] Commit message is descriptive of the change - [ ] CI is

[jira] [Updated] (HUDI-780) Make JUnit 5 co-exist in the project

[ https://issues.apache.org/jira/browse/HUDI-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-780: Labels: pull-request-available (was: ) > Make JUnit 5 co-exist in the project >

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer

garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer URL: https://github.com/apache/incubator-hudi/pull/1486#discussion_r406555444 ## File path:

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer

garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer URL: https://github.com/apache/incubator-hudi/pull/1486#discussion_r406555030 ## File path:

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer

garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer URL: https://github.com/apache/incubator-hudi/pull/1486#discussion_r406554063 ## File path:

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer

garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer URL: https://github.com/apache/incubator-hudi/pull/1486#discussion_r406553968 ## File path:

[GitHub] [incubator-hudi] garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer

garyli1019 commented on a change in pull request #1486: [HUDI-759] Integrate checkpoint privoder with delta streamer URL: https://github.com/apache/incubator-hudi/pull/1486#discussion_r406552799 ## File path:

[GitHub] [incubator-hudi] afilipchik commented on issue #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

afilipchik commented on issue #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#issuecomment-611819504 What will happen if there is incompatible message in Kafka? Will pipeline stall? What will be the way to fix

[jira] [Updated] (HUDI-738) Add error msg in DeltaStreamer if `filterDupes=true` is enabled for `operation=UPSERT`.

[ https://issues.apache.org/jira/browse/HUDI-738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-738: --- Status: In Progress (was: Open) > Add error msg in DeltaStreamer if `filterDupes=true` is enabled

[jira] [Updated] (HUDI-738) Add error msg in DeltaStreamer if `filterDupes=true` is enabled for `operation=UPSERT`.

[ https://issues.apache.org/jira/browse/HUDI-738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha updated HUDI-738: --- Status: Open (was: New) > Add error msg in DeltaStreamer if `filterDupes=true` is enabled for >

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction

codecov-io edited a comment on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction URL: https://github.com/apache/incubator-hudi/pull/1396#issuecomment-597430876 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1396?src=pr=h1) Report >

[jira] [Updated] (HUDI-780) Make JUnit 5 co-exist in the project

[ https://issues.apache.org/jira/browse/HUDI-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-780: Fix Version/s: 0.6.0 > Make JUnit 5 co-exist in the project > > >

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction

codecov-io edited a comment on issue #1396: [HUDI-687] Stop incremental reader on RO table before a pending compaction URL: https://github.com/apache/incubator-hudi/pull/1396#issuecomment-597430876 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1396?src=pr=h1) Report >

[jira] [Updated] (HUDI-780) Make JUnit 5 co-exist in the project

[ https://issues.apache.org/jira/browse/HUDI-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-780: Status: Open (was: New) > Make JUnit 5 co-exist in the project > > >

[jira] [Created] (HUDI-781) Re-design test utilities

Raymond Xu created HUDI-781: --- Summary: Re-design test utilities Key: HUDI-781 URL: https://issues.apache.org/jira/browse/HUDI-781 Project: Apache Hudi (incubating) Issue Type: Improvement

[jira] [Created] (HUDI-780) Make JUnit 5 co-exist in the project

Raymond Xu created HUDI-780: --- Summary: Make JUnit 5 co-exist in the project Key: HUDI-780 URL: https://issues.apache.org/jira/browse/HUDI-780 Project: Apache Hudi (incubating) Issue Type:

[jira] [Created] (HUDI-779) [Umbrella] Unit tests improvements

Raymond Xu created HUDI-779: --- Summary: [Umbrella] Unit tests improvements Key: HUDI-779 URL: https://issues.apache.org/jira/browse/HUDI-779 Project: Apache Hudi (incubating) Issue Type:

[GitHub] [incubator-hudi] vinothchandar commented on issue #1502: [HUDI-778] Adding codecov bagde to readme file

vinothchandar commented on issue #1502: [HUDI-778] Adding codecov bagde to readme file URL: https://github.com/apache/incubator-hudi/pull/1502#issuecomment-611704510 @ramachandranms lets park this before we can get it green

[GitHub] [incubator-hudi] n3nash opened a new pull request #1503: Supporting combine input format RT tables

n3nash opened a new pull request #1503: Supporting combine input format RT tables URL: https://github.com/apache/incubator-hudi/pull/1503 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a

[GitHub] [incubator-hudi] prashantwason commented on issue #1476: [HUDI-757] Added hudi-cli command to export metadata of Instants.

prashantwason commented on issue #1476: [HUDI-757] Added hudi-cli command to export metadata of Instants. URL: https://github.com/apache/incubator-hudi/pull/1476#issuecomment-611680765 Updated to write out instant metadata in json format so its easy to use CLI tools. Tested using a few

[jira] [Updated] (HUDI-778) Add code coverage badge to README file

[ https://issues.apache.org/jira/browse/HUDI-778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-778: Labels: pull-request-available test (was: test) > Add code coverage badge to README file >

[GitHub] [incubator-hudi] ramachandranms opened a new pull request #1502: [HUDI-778] Adding codecov bagde to readme file

ramachandranms opened a new pull request #1502: [HUDI-778] Adding codecov bagde to readme file URL: https://github.com/apache/incubator-hudi/pull/1502 ## What is the purpose of the pull request Add the following coverage badge to readme file

[jira] [Created] (HUDI-778) Add code coverage badge to README file

Ramachandran M S created HUDI-778: - Summary: Add code coverage badge to README file Key: HUDI-778 URL: https://issues.apache.org/jira/browse/HUDI-778 Project: Apache Hudi (incubating) Issue

[jira] [Resolved] (HUDI-755) Modify lo4j properties to allow execution of tests in debug log mode

[ https://issues.apache.org/jira/browse/HUDI-755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramachandran M S resolved HUDI-755. --- Fix Version/s: 0.6.0 Resolution: Fixed > Modify lo4j properties to allow execution of

[jira] [Resolved] (HUDI-568) Improve unit test coverage for HoodieTableMetaClient, RocksDBDAO & HoodieRealtimeFileSplit

[ https://issues.apache.org/jira/browse/HUDI-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramachandran M S resolved HUDI-568. --- Fix Version/s: 0.6.0 Resolution: Fixed > Improve unit test coverage for

[GitHub] [incubator-hudi] n3nash merged pull request #1473: [HUDI-568] Improve unit test coverage

n3nash merged pull request #1473: [HUDI-568] Improve unit test coverage URL: https://github.com/apache/incubator-hudi/pull/1473 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [incubator-hudi] tverdokhlebd commented on issue #1491: [SUPPORT] OutOfMemoryError during upsert 53M records

tverdokhlebd commented on issue #1491: [SUPPORT] OutOfMemoryError during upsert 53M records URL: https://github.com/apache/incubator-hudi/issues/1491#issuecomment-611636241 @lamber-ken , I have run on my local machine (Windows, WSL) without docker. But, I have also Jenkins (Linux) and

[GitHub] [incubator-hudi] lamber-ken commented on issue #1499: [SUPPORT] DeltaStreamer - NoClassDefFoundError for HiveDriver

lamber-ken commented on issue #1499: [SUPPORT] DeltaStreamer - NoClassDefFoundError for HiveDriver URL: https://github.com/apache/incubator-hudi/issues/1499#issuecomment-611627711 > It works with the way #1. Thank you so much @lamber-ken . You're welcome : )

[GitHub] [incubator-hudi] lamber-ken commented on issue #1491: [SUPPORT] OutOfMemoryError during upsert 53M records

lamber-ken commented on issue #1491: [SUPPORT] OutOfMemoryError during upsert 53M records URL: https://github.com/apache/incubator-hudi/issues/1491#issuecomment-611626685 I run those operations with `local[2]` and 6GB driver memory, still worked fine. I run those operations on

[GitHub] [incubator-hudi] n3nash commented on issue #1310: [HUDI-601] Improve unit test coverage for HoodieAvroWriteSupport, HoodieRealtimeRecordReader, RealtimeCompactedRecordReader

n3nash commented on issue #1310: [HUDI-601] Improve unit test coverage for HoodieAvroWriteSupport, HoodieRealtimeRecordReader, RealtimeCompactedRecordReader URL: https://github.com/apache/incubator-hudi/pull/1310#issuecomment-611586057 This PR has been moved to #1501

[GitHub] [incubator-hudi] n3nash closed pull request #1310: [HUDI-601] Improve unit test coverage for HoodieAvroWriteSupport, HoodieRealtimeRecordReader, RealtimeCompactedRecordReader

n3nash closed pull request #1310: [HUDI-601] Improve unit test coverage for HoodieAvroWriteSupport, HoodieRealtimeRecordReader, RealtimeCompactedRecordReader URL: https://github.com/apache/incubator-hudi/pull/1310 This is

[incubator-hudi] branch master updated: Trying git merge --squash

This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 996f761 Trying git merge --squash

[GitHub] [incubator-hudi] n3nash merged pull request #1501: [HUDI-601] Improve unit test coverage for HoodieAvroWriteSupport, HoodieRealtimeRecordReader, RealtimeCompactedRecordReader

n3nash merged pull request #1501: [HUDI-601] Improve unit test coverage for HoodieAvroWriteSupport, HoodieRealtimeRecordReader, RealtimeCompactedRecordReader URL: https://github.com/apache/incubator-hudi/pull/1501 This is

[jira] [Updated] (HUDI-777) Update Deltastreamer param description for --target-table

[ https://issues.apache.org/jira/browse/HUDI-777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iftach Schonbaum updated HUDI-777: -- Status: In Progress (was: Open) > Update Deltastreamer param description for --target-table >

[jira] [Updated] (HUDI-777) Update Deltastreamer param description for --target-table

[ https://issues.apache.org/jira/browse/HUDI-777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iftach Schonbaum updated HUDI-777: -- Status: Open (was: New) > Update Deltastreamer param description for --target-table >

[jira] [Created] (HUDI-777) Update Deltastreamer param description for --target-table

Iftach Schonbaum created HUDI-777: - Summary: Update Deltastreamer param description for --target-table Key: HUDI-777 URL: https://issues.apache.org/jira/browse/HUDI-777 Project: Apache Hudi

[jira] [Resolved] (HUDI-272) Move Prestodb Hudi integration to org.apache.hudi 's inputformat

[ https://issues.apache.org/jira/browse/HUDI-272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha resolved HUDI-272. Resolution: Fixed > Move Prestodb Hudi integration to org.apache.hudi 's inputformat >

[jira] [Closed] (HUDI-272) Move Prestodb Hudi integration to org.apache.hudi 's inputformat

[ https://issues.apache.org/jira/browse/HUDI-272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha closed HUDI-272. -- > Move Prestodb Hudi integration to org.apache.hudi 's inputformat >

[jira] [Commented] (HUDI-272) Move Prestodb Hudi integration to org.apache.hudi 's inputformat

[ https://issues.apache.org/jira/browse/HUDI-272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079234#comment-17079234 ] Bhavani Sudha commented on HUDI-272: This is done. Available from presto 0.233 version. > Move

[GitHub] [incubator-hudi] iftachsc commented on issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake

iftachsc commented on issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake URL: https://github.com/apache/incubator-hudi/issues/857#issuecomment-611468030 @leesf could you elaborate on Opensource Governance support? you mean the fact that it is part of

[GitHub] [incubator-hudi] iftachsc commented on issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake

iftachsc commented on issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake URL: https://github.com/apache/incubator-hudi/issues/857#issuecomment-611466622 > @firecast, would you please share the major reasons for choosing HUDI over Delta Lake? >

[GitHub] [incubator-hudi] tverdokhlebd commented on issue #1491: [SUPPORT] OutOfMemoryError during upsert 53M records

tverdokhlebd commented on issue #1491: [SUPPORT] OutOfMemoryError during upsert 53M records URL: https://github.com/apache/incubator-hudi/issues/1491#issuecomment-611462195 Hmm, this is strange :( I have tried with your parameters (parallelism and memory), but it does not help me

[GitHub] [incubator-hudi] hikiyoung commented on issue #1499: [SUPPORT] DeltaStreamer - NoClassDefFoundError for HiveDriver

hikiyoung commented on issue #1499: [SUPPORT] DeltaStreamer - NoClassDefFoundError for HiveDriver URL: https://github.com/apache/incubator-hudi/issues/1499#issuecomment-611452422 It works with the way #1. Thank you so much @lamber-ken .

[GitHub] [incubator-hudi] hddong commented on issue #1490: [HUDI-700]Add unit test for FileSystemViewCommand

hddong commented on issue #1490: [HUDI-700]Add unit test for FileSystemViewCommand URL: https://github.com/apache/incubator-hudi/pull/1490#issuecomment-611445641 @yanghua Thanks for your review, had address them. This is an

[GitHub] [incubator-hudi] vontman commented on issue #1498: Migrating parquet table to hudi issue [SUPPORT]

vontman commented on issue #1498: Migrating parquet table to hudi issue [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1498#issuecomment-611440958 These are some screenshots from the spark ui on the 25min job.

[GitHub] [incubator-hudi] ahmed-elfar commented on issue #1498: Migrating parquet table to hudi issue [SUPPORT]

ahmed-elfar commented on issue #1498: Migrating parquet table to hudi issue [SUPPORT] URL: https://github.com/apache/incubator-hudi/issues/1498#issuecomment-611383523 @bhasudha please consider that we have tested vs master build as well: Hudi and spark version: "**hudi-spark-bundle" %

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1490: [HUDI-700]Add unit test for FileSystemViewCommand

codecov-io edited a comment on issue #1490: [HUDI-700]Add unit test for FileSystemViewCommand URL: https://github.com/apache/incubator-hudi/pull/1490#issuecomment-610166379 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1490?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1490: [HUDI-700]Add unit test for FileSystemViewCommand

yanghua commented on a change in pull request #1490: [HUDI-700]Add unit test for FileSystemViewCommand URL: https://github.com/apache/incubator-hudi/pull/1490#discussion_r405986687 ## File path: hudi-cli/src/test/java/org/apache/hudi/cli/commands/TestFileSystemViewCommand.java

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1490: [HUDI-700]Add unit test for FileSystemViewCommand

yanghua commented on a change in pull request #1490: [HUDI-700]Add unit test for FileSystemViewCommand URL: https://github.com/apache/incubator-hudi/pull/1490#discussion_r405987783 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/HoodieTableHeaderConfig.java ##

[GitHub] [incubator-hudi] codecov-io commented on issue #1501: [HUDI-601] Improve unit test coverage for HoodieAvroWriteSupport, HoodieRealtimeRecordReader, RealtimeCompactedRecordReader

codecov-io commented on issue #1501: [HUDI-601] Improve unit test coverage for HoodieAvroWriteSupport, HoodieRealtimeRecordReader, RealtimeCompactedRecordReader URL: https://github.com/apache/incubator-hudi/pull/1501#issuecomment-611355603 #

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1490: [HUDI-700]Add unit test for FileSystemViewCommand

yanghua commented on a change in pull request #1490: [HUDI-700]Add unit test for FileSystemViewCommand URL: https://github.com/apache/incubator-hudi/pull/1490#discussion_r405983225 ## File path: hudi-cli/src/test/java/org/apache/hudi/cli/commands/TestFileSystemViewCommand.java

[jira] [Commented] (HUDI-210) Implement prometheus metrics reporter

[ https://issues.apache.org/jira/browse/HUDI-210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078973#comment-17078973 ] Forward Xu commented on HUDI-210: - hi, [~rxu] agrees with your opinion, we also use Prometheus as a unified

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution.

bvaradar commented on a change in pull request #1457: [HUDI-741] Added checks to validate Hoodie's schema evolution. URL: https://github.com/apache/incubator-hudi/pull/1457#discussion_r405979601 ## File path:

[GitHub] [incubator-hudi] hddong commented on issue #1449: [HUDI-698]Add unit test for CleansCommand

hddong commented on issue #1449: [HUDI-698]Add unit test for CleansCommand URL: https://github.com/apache/incubator-hudi/pull/1449#issuecomment-611350137 @yanghua this PR is green now, please have a review. This is an

[jira] [Created] (HUDI-776) Document community support triage process

Vinoth Chandar created HUDI-776: --- Summary: Document community support triage process Key: HUDI-776 URL: https://issues.apache.org/jira/browse/HUDI-776 Project: Apache Hudi (incubating) Issue

[jira] [Created] (HUDI-775) Mirror Slack general conversations into commits@ mailing list

Vinoth Chandar created HUDI-775: --- Summary: Mirror Slack general conversations into commits@ mailing list Key: HUDI-775 URL: https://issues.apache.org/jira/browse/HUDI-775 Project: Apache Hudi