[GitHub] [hudi] hudi-bot edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write
hudi-bot edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-864727710 ## CI report: * 0b48bd5b7dbf9fcd22d9e5730b1a660275ebcf54 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=467) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write
codecov-commenter edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-830002783 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2903?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#2903](https://codecov.io/gh/apache/hudi/pull/2903?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (0b48bd5) into [master](https://codecov.io/gh/apache/hudi/commit/f73bedd374952580c4d6bc9b2e30607c4efdd538?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (f73bedd) will **decrease** coverage by `15.77%`. > The diff coverage is `n/a`. [](https://codecov.io/gh/apache/hudi/pull/2903?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#2903 +/- ## = - Coverage 44.17% 28.40% -15.78% + Complexity 4574 1254 -3320 = Files 824 375 -449 Lines 3648814306-22182 Branches 3957 1459 -2498 = - Hits 16120 4063-12057 + Misses18624 9946 -8678 + Partials 1744 297 -1447 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `22.29% <ø> (+5.84%)` | :arrow_up: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <ø> (-48.67%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `58.25% <ø> (+2.13%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/2903?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | |
[GitHub] [hudi] codecov-commenter edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write
codecov-commenter edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-830002783 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2903?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#2903](https://codecov.io/gh/apache/hudi/pull/2903?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (0b48bd5) into [master](https://codecov.io/gh/apache/hudi/commit/f73bedd374952580c4d6bc9b2e30607c4efdd538?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (f73bedd) will **decrease** coverage by `28.00%`. > The diff coverage is `n/a`. [](https://codecov.io/gh/apache/hudi/pull/2903?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#2903 +/- ## = - Coverage 44.17% 16.17% -28.01% + Complexity 4574 466 -4108 = Files 824 279 -545 Lines 3648810855-25633 Branches 3957 1107 -2850 = - Hits 16120 1756-14364 + Misses18624 8939 -9685 + Partials 1744 160 -1584 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `0.00% <ø> (-16.46%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <ø> (-48.67%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `58.25% <ø> (+2.13%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/2903?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | |
[GitHub] [hudi] hudi-bot edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit
hudi-bot edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-862136673 ## CI report: * 3b02a03a355c85723b69c9d8b4557c5983c8914f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=461) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] veenaypatil commented on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit
veenaypatil commented on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-869102385 @hudi-bot run travis -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[hudi] branch master updated (f73bedd -> e99a6b0)
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from f73bedd [MINOR] Remove unused methods (#3152) add e99a6b0 [HUDI-2073] Fix the bug of hoodieClusteringJob never quit (#3157) No new revisions were added by this update. Summary of changes: .../apache/hudi/utilities/HoodieClusteringJob.java | 22 +++--- 1 file changed, 11 insertions(+), 11 deletions(-)
[GitHub] [hudi] vinothchandar merged pull request #3157: [HUDI-2073] Fix the bug of hoodieClusteringJob never quit
vinothchandar merged pull request #3157: URL: https://github.com/apache/hudi/pull/3157 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write
codecov-commenter edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-830002783 # [Codecov](https://codecov.io/gh/apache/hudi/pull/2903?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#2903](https://codecov.io/gh/apache/hudi/pull/2903?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (0b48bd5) into [master](https://codecov.io/gh/apache/hudi/commit/f73bedd374952580c4d6bc9b2e30607c4efdd538?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (f73bedd) will **decrease** coverage by `41.23%`. > The diff coverage is `n/a`. [](https://codecov.io/gh/apache/hudi/pull/2903?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master #2903 +/- ## - Coverage 44.31% 3.07% -41.24% + Complexity 4574 82 -4492 Files 824 279 -545 Lines 36375 10855-25520 Branches 39371107 -2830 - Hits 16120 334-15786 + Misses18511 10495 -8016 + Partials 1744 26 -1718 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `0.00% <ø> (-16.46%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <ø> (-48.67%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `9.52% <ø> (-48.77%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/2903?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...va/org/apache/hudi/utilities/IdentitySplitter.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0lkZW50aXR5U3BsaXR0ZXIuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...va/org/apache/hudi/utilities/schema/SchemaSet.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NjaGVtYS9TY2hlbWFTZXQuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...a/org/apache/hudi/utilities/sources/RowSource.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUm93U291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/utilities/sources/AvroSource.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/utilities/sources/JsonSource.java](https://codecov.io/gh/apache/hudi/pull/2903/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvblNvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | |
[GitHub] [hudi] vinothchandar commented on pull request #2963: [HUDI-1904] Introduce SchemaProviderInterface to make SchemaProvider unified
vinothchandar commented on pull request #2963: URL: https://github.com/apache/hudi/pull/2963#issuecomment-869100896 >Can we refactor all SchemaProviders without respecting compatibility? In general, I would love to not break compatibility esp for something like `SchemaProvider`, that I have seen many users customize and write their own. That said, if all it takes is using `HoodieEngineContext` instead of SparkContext, may be that is worth it, i.e breaking it once and calling it out. Let me take a pass at this. and list down some options. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write
hudi-bot edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-864727710 ## CI report: * f474fba1301a32298a4297f4a9dffc2bd99f518b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=295) * 0b48bd5b7dbf9fcd22d9e5730b1a660275ebcf54 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=467) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] veenaypatil closed pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit
veenaypatil closed pull request #3092: URL: https://github.com/apache/hudi/pull/3092 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #2903: [HUDI-1850] Fixing read of a empty table but with failed write
hudi-bot edited a comment on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-864727710 ## CI report: * f474fba1301a32298a4297f4a9dffc2bd99f518b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=295) * 0b48bd5b7dbf9fcd22d9e5730b1a660275ebcf54 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
hudi-bot edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868810948 ## CI report: * 3293dcf9b15091c3a5b41c6962a3cc8ca4ef90e2 UNKNOWN * 82ef082e92d7492a1055bfcfe2e8b5f230e7ef9e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=460) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=466) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Assigned] (HUDI-2081) Move TestHiveSyncTool to functional
[ https://issues.apache.org/jira/browse/HUDI-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2081: Assignee: Raymond Xu > Move TestHiveSyncTool to functional > --- > > Key: HUDI-2081 > URL: https://issues.apache.org/jira/browse/HUDI-2081 > Project: Apache Hudi > Issue Type: Sub-task > Components: Testing >Reporter: Raymond Xu >Assignee: Raymond Xu >Priority: Major > > Make it similar to TestHiveMetastoreBasedLockProvider, ran by > HiveSyncFunctionalTestSuite > Also clean up HiveTestUtil. > This is a follow-up task to https://github.com/apache/hudi/pull/3043 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HUDI-2081) Move TestHiveSyncTool to functional
Raymond Xu created HUDI-2081: Summary: Move TestHiveSyncTool to functional Key: HUDI-2081 URL: https://issues.apache.org/jira/browse/HUDI-2081 Project: Apache Hudi Issue Type: Sub-task Components: Testing Reporter: Raymond Xu Make it similar to TestHiveMetastoreBasedLockProvider, ran by HiveSyncFunctionalTestSuite Also clean up HiveTestUtil. This is a follow-up task to https://github.com/apache/hudi/pull/3043 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * d526a0f36f8a33f9f6fb75631bc05133dfdfa3ac Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=465) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (HUDI-2080) Migrate to ubuntu 20.04 for Azure pipeline builds
Raymond Xu created HUDI-2080: Summary: Migrate to ubuntu 20.04 for Azure pipeline builds Key: HUDI-2080 URL: https://issues.apache.org/jira/browse/HUDI-2080 Project: Apache Hudi Issue Type: Sub-task Components: Testing Reporter: Raymond Xu Ubuntu 16.04 is going to be removed in Azure by 2020/09. Need to make sure tests pass in the new OS -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-1251) [UMBRELLA] Migrate CI to azure
[ https://issues.apache.org/jira/browse/HUDI-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1251: - Status: In Progress (was: Open) > [UMBRELLA] Migrate CI to azure > --- > > Key: HUDI-1251 > URL: https://issues.apache.org/jira/browse/HUDI-1251 > Project: Apache Hudi > Issue Type: Improvement > Components: Testing >Reporter: sivabalan narayanan >Assignee: Raymond Xu >Priority: Blocker > Labels: hudi-umbrellas > Fix For: 0.9.0 > > > Stabilize CI on azure -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (HUDI-1055) Ensure hardcoded storage type ".parquet" is removed from tests
[ https://issues.apache.org/jira/browse/HUDI-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1055. > Ensure hardcoded storage type ".parquet" is removed from tests > -- > > Key: HUDI-1055 > URL: https://issues.apache.org/jira/browse/HUDI-1055 > Project: Apache Hudi > Issue Type: Task > Components: Testing >Affects Versions: 0.9.0 >Reporter: Balaji Varadarajan >Assignee: Prashant Wason >Priority: Major > Labels: pull-request-available > Fix For: 0.9.0 > > > Follow up : https://github.com/apache/hudi/pull/1687#issuecomment-649754943 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (HUDI-1055) Ensure hardcoded storage type ".parquet" is removed from tests
[ https://issues.apache.org/jira/browse/HUDI-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1055. -- Resolution: Fixed > Ensure hardcoded storage type ".parquet" is removed from tests > -- > > Key: HUDI-1055 > URL: https://issues.apache.org/jira/browse/HUDI-1055 > Project: Apache Hudi > Issue Type: Task > Components: Testing >Affects Versions: 0.9.0 >Reporter: Balaji Varadarajan >Assignee: Prashant Wason >Priority: Major > Labels: pull-request-available > Fix For: 0.9.0 > > > Follow up : https://github.com/apache/hudi/pull/1687#issuecomment-649754943 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-1055) Ensure hardcoded storage type ".parquet" is removed from tests
[ https://issues.apache.org/jira/browse/HUDI-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1055: - Status: In Progress (was: Open) > Ensure hardcoded storage type ".parquet" is removed from tests > -- > > Key: HUDI-1055 > URL: https://issues.apache.org/jira/browse/HUDI-1055 > Project: Apache Hudi > Issue Type: Task > Components: Testing >Affects Versions: 0.9.0 >Reporter: Balaji Varadarajan >Assignee: Prashant Wason >Priority: Major > Labels: pull-request-available > Fix For: 0.9.0 > > > Follow up : https://github.com/apache/hudi/pull/1687#issuecomment-649754943 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-1033) Remove redundant CLI tests
[ https://issues.apache.org/jira/browse/HUDI-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1033: - Parent: HUDI-1248 Issue Type: Sub-task (was: Task) > Remove redundant CLI tests > --- > > Key: HUDI-1033 > URL: https://issues.apache.org/jira/browse/HUDI-1033 > Project: Apache Hudi > Issue Type: Sub-task > Components: Testing >Affects Versions: 0.9.0 >Reporter: Balaji Varadarajan >Assignee: vinoyang >Priority: Major > Fix For: 0.9.0 > > > There are some tests like ITTestRepairsCommand vs TestRepairsCommand, > ITTestCleanerCommand vs TestCleanerCommand. Please consolidate if they are > redundant. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HUDI-2079) Move CLI integ tests to functional
Raymond Xu created HUDI-2079: Summary: Move CLI integ tests to functional Key: HUDI-2079 URL: https://issues.apache.org/jira/browse/HUDI-2079 Project: Apache Hudi Issue Type: Sub-task Components: Testing Reporter: Raymond Xu Define the boundary of integration test: only from hudi-integ-test module. Moving to functional tests makes sense for CLI command tests. Also balance testing jobs' running time: integ test job takes 40+ min while functional test job takes only 6 min. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hudi] hudi-bot edited a comment on pull request #2906: [HUDI-393] remove travis
hudi-bot edited a comment on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-830929050 ## CI report: * e96f2c03ab0f4fd6deb6803479fa6624eb21ed73 UNKNOWN * 0985b9b4a64b8015257eae8d85dfd899acf7a910 UNKNOWN * 7d6525d83a0fb964feb121e44fc617342778aff5 UNKNOWN * 16c0e688891750a52a903bef96f3c1d8b50553e2 UNKNOWN * 4b7188ab026b61b4f22bcf120e218d92d253 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=463) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Assigned] (HUDI-1939) Replace joda-time api to new jdk8 time api
[ https://issues.apache.org/jira/browse/HUDI-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1939: Assignee: Xuedong Luan > Replace joda-time api to new jdk8 time api > -- > > Key: HUDI-1939 > URL: https://issues.apache.org/jira/browse/HUDI-1939 > Project: Apache Hudi > Issue Type: Improvement >Reporter: Xuedong Luan >Assignee: Xuedong Luan >Priority: Minor > Labels: pull-request-available > Fix For: 0.9.0 > > > remove the usage of joda-time api and use the new jdk8 time api -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-1939) Replace joda-time api to new jdk8 time api
[ https://issues.apache.org/jira/browse/HUDI-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1939: - Status: In Progress (was: Open) > Replace joda-time api to new jdk8 time api > -- > > Key: HUDI-1939 > URL: https://issues.apache.org/jira/browse/HUDI-1939 > Project: Apache Hudi > Issue Type: Improvement >Reporter: Xuedong Luan >Assignee: Xuedong Luan >Priority: Minor > Labels: pull-request-available > Fix For: 0.9.0 > > > remove the usage of joda-time api and use the new jdk8 time api -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-1939) Replace joda-time api to new jdk8 time api
[ https://issues.apache.org/jira/browse/HUDI-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1939: - Fix Version/s: 0.9.0 > Replace joda-time api to new jdk8 time api > -- > > Key: HUDI-1939 > URL: https://issues.apache.org/jira/browse/HUDI-1939 > Project: Apache Hudi > Issue Type: Improvement >Reporter: Xuedong Luan >Priority: Minor > Labels: pull-request-available > Fix For: 0.9.0 > > > remove the usage of joda-time api and use the new jdk8 time api -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hudi] hudi-bot edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
hudi-bot edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868810948 ## CI report: * 3293dcf9b15091c3a5b41c6962a3cc8ca4ef90e2 UNKNOWN * 82ef082e92d7492a1055bfcfe2e8b5f230e7ef9e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=460) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=466) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
xushiyan commented on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-869092386 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 8d94a36500f3cf8b3a589e01817ecfa71ab149a6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=464) * d526a0f36f8a33f9f6fb75631bc05133dfdfa3ac Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=465) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api
codecov-commenter edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-849682114 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3003?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3003](https://codecov.io/gh/apache/hudi/pull/3003?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (d526a0f) into [master](https://codecov.io/gh/apache/hudi/commit/f73bedd374952580c4d6bc9b2e30607c4efdd538?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (f73bedd) will **decrease** coverage by `41.23%`. > The diff coverage is `0.00%`. [](https://codecov.io/gh/apache/hudi/pull/3003?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master #3003 +/- ## - Coverage 44.31% 3.07% -41.24% + Complexity 4574 82 -4492 Files 824 279 -545 Lines 36375 10854-25521 Branches 39371108 -2829 - Hits 16120 334-15786 + Misses18511 10494 -8017 + Partials 1744 26 -1718 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `0.00% <0.00%> (-16.46%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <0.00%> (-48.67%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `9.52% <ø> (-48.77%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3003?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...he/hudi/keygen/TimestampBasedAvroKeyGenerator.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9UaW1lc3RhbXBCYXNlZEF2cm9LZXlHZW5lcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-20.26%)` | :arrow_down: | | [...di/keygen/parser/AbstractHoodieDateTimeParser.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9wYXJzZXIvQWJzdHJhY3RIb29kaWVEYXRlVGltZVBhcnNlci5qYXZh) | `0.00% <0.00%> (-66.67%)` | :arrow_down: | | [...e/hudi/keygen/parser/HoodieDateTimeParserImpl.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9wYXJzZXIvSG9vZGllRGF0ZVRpbWVQYXJzZXJJbXBsLmphdmE=) | `0.00% <0.00%> (-20.00%)` | :arrow_down: | | [...i/hive/SlashEncodedDayPartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvU2xhc2hFbmNvZGVkRGF5UGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-50.00%)` | :arrow_down: | | [.../hive/SlashEncodedHourPartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvU2xhc2hFbmNvZGVkSG91clBhcnRpdGlvblZhbHVlRXh0cmFjdG9yLmphdmE=) | `0.00% <0.00%> (-66.67%)` | :arrow_down: | |
[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 8d94a36500f3cf8b3a589e01817ecfa71ab149a6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=464) * d526a0f36f8a33f9f6fb75631bc05133dfdfa3ac UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #2906: [HUDI-393] remove travis
hudi-bot edited a comment on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-830929050 ## CI report: * e96f2c03ab0f4fd6deb6803479fa6624eb21ed73 UNKNOWN * 0985b9b4a64b8015257eae8d85dfd899acf7a910 UNKNOWN * 7d6525d83a0fb964feb121e44fc617342778aff5 UNKNOWN * 16c0e688891750a52a903bef96f3c1d8b50553e2 UNKNOWN * f00ef32ffb3f3a4fc8ed7538b6432b76158706a4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=299) * 4b7188ab026b61b4f22bcf120e218d92d253 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=463) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 8d94a36500f3cf8b3a589e01817ecfa71ab149a6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=464) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #2906: [HUDI-393] remove travis
hudi-bot edited a comment on pull request #2906: URL: https://github.com/apache/hudi/pull/2906#issuecomment-830929050 ## CI report: * e96f2c03ab0f4fd6deb6803479fa6624eb21ed73 UNKNOWN * 0985b9b4a64b8015257eae8d85dfd899acf7a910 UNKNOWN * 7d6525d83a0fb964feb121e44fc617342778aff5 UNKNOWN * 16c0e688891750a52a903bef96f3c1d8b50553e2 UNKNOWN * f00ef32ffb3f3a4fc8ed7538b6432b76158706a4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=299) * 4b7188ab026b61b4f22bcf120e218d92d253 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 8d94a36500f3cf8b3a589e01817ecfa71ab149a6 UNKNOWN * Unknown: [CANCELED](TBD) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 78c45ef09aabeef4de3e604408a820382dd6a419 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=462) * Unknown: [CANCELED](TBD) * 8d94a36500f3cf8b3a589e01817ecfa71ab149a6 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] xushiyan commented on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api
xushiyan commented on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-869088072 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api
codecov-commenter edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-849682114 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3003?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3003](https://codecov.io/gh/apache/hudi/pull/3003?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (78c45ef) into [master](https://codecov.io/gh/apache/hudi/commit/f73bedd374952580c4d6bc9b2e30607c4efdd538?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (f73bedd) will **decrease** coverage by `28.12%`. > The diff coverage is `0.00%`. [](https://codecov.io/gh/apache/hudi/pull/3003?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#3003 +/- ## = - Coverage 44.31% 16.18% -28.13% + Complexity 4574 467 -4107 = Files 824 279 -545 Lines 3637510854-25521 Branches 3937 1108 -2829 = - Hits 16120 1757-14363 + Misses18511 8938 -9573 + Partials 1744 159 -1585 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `0.00% <0.00%> (-16.46%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <0.00%> (-48.67%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `58.29% <ø> (ø)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3003?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...he/hudi/keygen/TimestampBasedAvroKeyGenerator.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9UaW1lc3RhbXBCYXNlZEF2cm9LZXlHZW5lcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-20.26%)` | :arrow_down: | | [...di/keygen/parser/AbstractHoodieDateTimeParser.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9wYXJzZXIvQWJzdHJhY3RIb29kaWVEYXRlVGltZVBhcnNlci5qYXZh) | `0.00% <0.00%> (-66.67%)` | :arrow_down: | | [...e/hudi/keygen/parser/HoodieDateTimeParserImpl.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9wYXJzZXIvSG9vZGllRGF0ZVRpbWVQYXJzZXJJbXBsLmphdmE=) | `0.00% <0.00%> (-20.00%)` | :arrow_down: | | [...i/hive/SlashEncodedDayPartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvU2xhc2hFbmNvZGVkRGF5UGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-50.00%)` | :arrow_down: | | [.../hive/SlashEncodedHourPartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvU2xhc2hFbmNvZGVkSG91clBhcnRpdGlvblZhbHVlRXh0cmFjdG9yLmphdmE=) | `0.00% <0.00%> (-66.67%)` | :arrow_down: | |
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api
codecov-commenter edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-849682114 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3003?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3003](https://codecov.io/gh/apache/hudi/pull/3003?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (78c45ef) into [master](https://codecov.io/gh/apache/hudi/commit/f73bedd374952580c4d6bc9b2e30607c4efdd538?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (f73bedd) will **decrease** coverage by `41.23%`. > The diff coverage is `0.00%`. [](https://codecov.io/gh/apache/hudi/pull/3003?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master #3003 +/- ## - Coverage 44.31% 3.07% -41.24% + Complexity 4574 82 -4492 Files 824 279 -545 Lines 36375 10854-25521 Branches 39371108 -2829 - Hits 16120 334-15786 + Misses18511 10494 -8017 + Partials 1744 26 -1718 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `0.00% <0.00%> (-16.46%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <0.00%> (-48.67%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `9.52% <ø> (-48.77%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3003?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...he/hudi/keygen/TimestampBasedAvroKeyGenerator.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9UaW1lc3RhbXBCYXNlZEF2cm9LZXlHZW5lcmF0b3IuamF2YQ==) | `0.00% <0.00%> (-20.26%)` | :arrow_down: | | [...di/keygen/parser/AbstractHoodieDateTimeParser.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9wYXJzZXIvQWJzdHJhY3RIb29kaWVEYXRlVGltZVBhcnNlci5qYXZh) | `0.00% <0.00%> (-66.67%)` | :arrow_down: | | [...e/hudi/keygen/parser/HoodieDateTimeParserImpl.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2tleWdlbi9wYXJzZXIvSG9vZGllRGF0ZVRpbWVQYXJzZXJJbXBsLmphdmE=) | `0.00% <0.00%> (-20.00%)` | :arrow_down: | | [...i/hive/SlashEncodedDayPartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvU2xhc2hFbmNvZGVkRGF5UGFydGl0aW9uVmFsdWVFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-50.00%)` | :arrow_down: | | [.../hive/SlashEncodedHourPartitionValueExtractor.java](https://codecov.io/gh/apache/hudi/pull/3003/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvU2xhc2hFbmNvZGVkSG91clBhcnRpdGlvblZhbHVlRXh0cmFjdG9yLmphdmE=) | `0.00% <0.00%> (-66.67%)` | :arrow_down: | |
[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 99a9812f0b93aed1fe87aa1c7c8d27b6f03b003b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=230) * 78c45ef09aabeef4de3e604408a820382dd6a419 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=462) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3003: [HUDI-1939][WIP] Replace joda-time api with java8 new time api
hudi-bot edited a comment on pull request #3003: URL: https://github.com/apache/hudi/pull/3003#issuecomment-862614384 ## CI report: * 99a9812f0b93aed1fe87aa1c7c8d27b6f03b003b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=230) * 78c45ef09aabeef4de3e604408a820382dd6a419 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HUDI-1985) Website re-design implementation
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1985: - Description: To provide better navigation and organization of Hudi website's info, we have done a re-design of the web pages. Previous discussion [https://github.com/apache/hudi/issues/2905] See the wireframe and final design in [https://www.figma.com/file/tipod1JZRw7anZRWBI6sZh/Hudi.Apache?node-id=32%3A6] (login Figma to comment) The design is ready for implementation. was: To provide better navigation and organization of Hudi website's info, we have done a re-design of the web pages. See the wireframe and final design in [https://www.figma.com/file/tipod1JZRw7anZRWBI6sZh/Hudi.Apache?node-id=32%3A6] (login Figma to comment) The design is ready for implementation. > Website re-design implementation > > > Key: HUDI-1985 > URL: https://issues.apache.org/jira/browse/HUDI-1985 > Project: Apache Hudi > Issue Type: Improvement > Components: Docs >Reporter: Raymond Xu >Priority: Blocker > Labels: documentation > Fix For: 0.9.0 > > > To provide better navigation and organization of Hudi website's info, we have > done a re-design of the web pages. > Previous discussion > [https://github.com/apache/hudi/issues/2905] > > See the wireframe and final design in > [https://www.figma.com/file/tipod1JZRw7anZRWBI6sZh/Hudi.Apache?node-id=32%3A6] > (login Figma to comment) > The design is ready for implementation. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-1010) Fix the memory leak for hudi-client unit tests
[ https://issues.apache.org/jira/browse/HUDI-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1010: - Description: hudi-client unit test has a memory leak, which could be some resources are not properly released during the cleanup. The memory consumption was accumulating over time and lead to the Travis CI failure. By using the IntelliJ memory analysis tool, we can find the major leak was HoodieLogFormatWriter, HoodieWrapperFileSystem, HoodieLogFileReader, e.t.c Related PR: [https://github.com/apache/hudi/pull/1707] [https://github.com/apache/hudi/pull/1697] !image-2020-06-08-09-22-08-864.png! Some related info in HUDI-997 was: hudi-client unit test has a memory leak, which could be some resources are not properly released during the cleanup. The memory consumption was accumulating over time and lead to the Travis CI failure. By using the IntelliJ memory analysis tool, we can find the major leak was HoodieLogFormatWriter, HoodieWrapperFileSystem, HoodieLogFileReader, e.t.c Related PR: [https://github.com/apache/hudi/pull/1707] [https://github.com/apache/hudi/pull/1697] !image-2020-06-08-09-22-08-864.png! > Fix the memory leak for hudi-client unit tests > -- > > Key: HUDI-1010 > URL: https://issues.apache.org/jira/browse/HUDI-1010 > Project: Apache Hudi > Issue Type: Sub-task > Components: Testing >Affects Versions: 0.9.0 >Reporter: Yanjia Gary Li >Assignee: Nishith Agarwal >Priority: Major > Labels: help-wanted, user-support-issues > Fix For: 0.9.0 > > Attachments: image-2020-06-08-09-22-08-864.png > > > hudi-client unit test has a memory leak, which could be some resources are > not properly released during the cleanup. The memory consumption was > accumulating over time and lead to the Travis CI failure. > By using the IntelliJ memory analysis tool, we can find the major leak was > HoodieLogFormatWriter, HoodieWrapperFileSystem, HoodieLogFileReader, e.t.c > Related PR: [https://github.com/apache/hudi/pull/1707] > [https://github.com/apache/hudi/pull/1697] > !image-2020-06-08-09-22-08-864.png! > > Some related info in HUDI-997 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (HUDI-997) Debug possible memory leaks when running tests in hudi-client
[ https://issues.apache.org/jira/browse/HUDI-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-997. --- Assignee: (was: lamber-ken) Resolution: Duplicate Duplicate. Referencing this from HUDI-1010 > Debug possible memory leaks when running tests in hudi-client > - > > Key: HUDI-997 > URL: https://issues.apache.org/jira/browse/HUDI-997 > Project: Apache Hudi > Issue Type: Sub-task > Components: Testing >Reporter: Balaji Varadarajan >Priority: Major > > Using visualvm, noticed the memory leak pattern of gradual increase in > reachable memory (after GC) as the tests progress. > Some possible candidates where I noticed marked increase in memory while the > tests were running : > > [INFO] Running org.apache.hudi.table.TestCleaner > [INFO] Running org.apache.hudi.table.TestHoodieMergeOnReadTable > [INFO] Running > org.apache.hudi.table.action.commit.TestCopyOnWriteActionExecutor > [INFO] Running org.apache.hudi.table.action.compact.TestAsyncCompaction > [INFO] Running org.apache.hudi.index.hbase.TestHBaseIndex > [INFO] Running org.apache.hudi.index.TestHoodieIndex > [INFO] Running org.apache.hudi.client.TestHoodieClientOnCopyOnWriteStorage > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer
[
https://issues.apache.org/jira/browse/HUDI-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370132#comment-17370132
]
Raymond Xu commented on HUDI-2077:
--
[~codope] assigning to you since you made a PR to increase the timeout. will
continue to observe it.
> Flaky test: TestHoodieDeltaStreamer
> ---
>
> Key: HUDI-2077
> URL: https://issues.apache.org/jira/browse/HUDI-2077
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Testing
>Reporter: Raymond Xu
>Assignee: Sagar Sumit
>Priority: Major
>
> {code:java}
> [INFO] Results:8520[INFO] 8521[ERROR] Errors: 8522[ERROR]
> TestHoodieDeltaStreamer.testUpsertsMORContinuousModeWithMultipleWriters:716->testUpsertsContinuousModeWithMultipleWriters:831->runJobsInParallel:940
> » Execution{code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer
[
https://issues.apache.org/jira/browse/HUDI-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raymond Xu reassigned HUDI-2077:
Assignee: Sagar Sumit
> Flaky test: TestHoodieDeltaStreamer
> ---
>
> Key: HUDI-2077
> URL: https://issues.apache.org/jira/browse/HUDI-2077
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Testing
>Reporter: Raymond Xu
>Assignee: Sagar Sumit
>Priority: Major
>
> {code:java}
> [INFO] Results:8520[INFO] 8521[ERROR] Errors: 8522[ERROR]
> TestHoodieDeltaStreamer.testUpsertsMORContinuousModeWithMultipleWriters:716->testUpsertsContinuousModeWithMultipleWriters:831->runJobsInParallel:940
> » Execution{code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HUDI-2078) Flaky test: TestCleaner
Raymond Xu created HUDI-2078: Summary: Flaky test: TestCleaner Key: HUDI-2078 URL: https://issues.apache.org/jira/browse/HUDI-2078 Project: Apache Hudi Issue Type: Sub-task Components: Testing Reporter: Raymond Xu * TestCleaner.testKeepLatestCommits * TestCleaner.testKeepLatestFileVersions:673 Must clean at least 1 file ==> expected: <2> but was: <1> -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer
Raymond Xu created HUDI-2077:
Summary: Flaky test: TestHoodieDeltaStreamer
Key: HUDI-2077
URL: https://issues.apache.org/jira/browse/HUDI-2077
Project: Apache Hudi
Issue Type: Sub-task
Components: Testing
Reporter: Raymond Xu
{code:java}
[INFO] Results:8520[INFO] 8521[ERROR] Errors: 8522[ERROR]
TestHoodieDeltaStreamer.testUpsertsMORContinuousModeWithMultipleWriters:716->testUpsertsContinuousModeWithMultipleWriters:831->runJobsInParallel:940
» Execution{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HUDI-2076) Flaky test: TestHoodieMultiTableDeltaStreamer
Raymond Xu created HUDI-2076: Summary: Flaky test: TestHoodieMultiTableDeltaStreamer Key: HUDI-2076 URL: https://issues.apache.org/jira/browse/HUDI-2076 Project: Apache Hudi Issue Type: Sub-task Reporter: Raymond Xu At-least 4 occurrences [ERROR] Failures: [ERROR] TestHoodieMultiTableDeltaStreamer.testMultiTableExecutionWithKafkaSource:168 expected: but was: -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HUDI-2075) Flaky test: TestRowDataToHoodieFunction
Raymond Xu created HUDI-2075: Summary: Flaky test: TestRowDataToHoodieFunction Key: HUDI-2075 URL: https://issues.apache.org/jira/browse/HUDI-2075 Project: Apache Hudi Issue Type: Sub-task Components: Testing Reporter: Raymond Xu At-least 10 occurrences [ERROR] Failures: [ERROR] TestRowDataToHoodieFunction.testRateLimit:72 should process at least 5 seconds ==> expected: but was: -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HUDI-1989) Flaky test : TestHoodieMergeOnReadTable
[ https://issues.apache.org/jira/browse/HUDI-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370131#comment-17370131 ] Raymond Xu commented on HUDI-1989: -- Consolidated failed cases * TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingMarkers * TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingFileList * TestHoodieMergeOnReadTable.testCOWToMORConvertedTableRollbackUsingMarkers > Flaky test : TestHoodieMergeOnReadTable > --- > > Key: HUDI-1989 > URL: https://issues.apache.org/jira/browse/HUDI-1989 > Project: Apache Hudi > Issue Type: Sub-task >Reporter: sivabalan narayanan >Priority: Major > > [https://api.travis-ci.com/v3/job/512025273/log.txt] > > [ERROR] Tests run: 23, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: > 330.459 s <<< FAILURE! - in org.apache.hudi.table.TestHoodieMergeOnReadTable > [ERROR] > org.apache.hudi.table.TestHoodieMergeOnReadTable.testCOWToMORConvertedTableRollbackUsingMarkers > Time elapsed: 0.564 s <<< ERROR! java.lang.NullPointerException at > org.apache.hudi.table.TestHoodieMergeOnReadTable.init(TestHoodieMergeOnReadTable.java:118) > at > org.apache.hudi.table.TestHoodieMergeOnReadTable.init(TestHoodieMergeOnReadTable.java:135) > [INFO] [INFO] Results: [INFO] [ERROR] Errors: [ERROR] > TestHoodieMergeOnReadTable.init:135->init:118->HoodieClientTestHarness.initDFS:255 > » NullPointer > > > Couple of more failures > [https://api.travis-ci.com/v3/job/512584741/log.txt] > > [ERROR] Tests run: 23, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: > 321.634 s <<< FAILURE! - in org.apache.hudi.table.TestHoodieMergeOnReadTable > [ERROR] > org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingFileList > Time elapsed: 16.972 s <<< FAILURE! org.opentest4j.AssertionFailedError: > There files should have been rolled-back when rolling back commit 002 but are > still remaining. Files: > [hdfs://localhost:41724/tmp/junit6050583652872512516/dataset/2015/03/17/14423e02-307a-42e2-b76f-71f39241d002-0_2-20-26_001.parquet] > ==> expected: <0> but was: <1> at > org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommit(TestHoodieMergeOnReadTable.java:646) > at > org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingFileList(TestHoodieMergeOnReadTable.java:728) > [ERROR] > org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingMarkers > Time elapsed: 14.651 s <<< FAILURE! org.opentest4j.AssertionFailedError: > There files should have been rolled-back when rolling back commit 002 but are > still remaining. Files: > [hdfs://localhost:36524/tmp/junit7236068081383159369/dataset/2015/03/16/002a31b1-2c2d-470b-bf45-d19451a04630-0_1-20-25_001.parquet] > ==> expected: <0> but was: <1> at > org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommit(TestHoodieMergeOnReadTable.java:646) > at > org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingMarkers(TestHoodieMergeOnReadTable.java:733) > [INFO] [INFO] Results: [INFO] [ERROR] Failures: [ERROR] > TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingFileList:728->testRollbackWithDeltaAndCompactionCommit:646 > There files should have been rolled-back when rolling back commit 002 but > are still remaining. Files: > [hdfs://localhost:41724/tmp/junit6050583652872512516/dataset/2015/03/17/14423e02-307a-42e2-b76f-71f39241d002-0_2-20-26_001.parquet] > ==> expected: <0> but was: <1> [ERROR] > TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingMarkers:733->testRollbackWithDeltaAndCompactionCommit:646 > There files should have been rolled-back when rolling back commit 002 but > are still remaining. Files: > [hdfs://localhost:36524/tmp/junit7236068081383159369/dataset/2015/03/16/002a31b1-2c2d-470b-bf45-d19451a04630-0_1-20-25_001.parquet] > ==> expected: <0> but was: <1> [INFO] [ERROR] Tests run: 393, Failures: 2, > Errors: 0, Skipped: 1 > > > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-997) Debug possible memory leaks when running tests in hudi-client
[ https://issues.apache.org/jira/browse/HUDI-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-997: Parent: HUDI-1248 Issue Type: Sub-task (was: Task) > Debug possible memory leaks when running tests in hudi-client > - > > Key: HUDI-997 > URL: https://issues.apache.org/jira/browse/HUDI-997 > Project: Apache Hudi > Issue Type: Sub-task > Components: Testing >Reporter: Balaji Varadarajan >Assignee: lamber-ken >Priority: Major > > Using visualvm, noticed the memory leak pattern of gradual increase in > reachable memory (after GC) as the tests progress. > Some possible candidates where I noticed marked increase in memory while the > tests were running : > > [INFO] Running org.apache.hudi.table.TestCleaner > [INFO] Running org.apache.hudi.table.TestHoodieMergeOnReadTable > [INFO] Running > org.apache.hudi.table.action.commit.TestCopyOnWriteActionExecutor > [INFO] Running org.apache.hudi.table.action.compact.TestAsyncCompaction > [INFO] Running org.apache.hudi.index.hbase.TestHBaseIndex > [INFO] Running org.apache.hudi.index.TestHoodieIndex > [INFO] Running org.apache.hudi.client.TestHoodieClientOnCopyOnWriteStorage > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-1010) Fix the memory leak for hudi-client unit tests
[ https://issues.apache.org/jira/browse/HUDI-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1010: - Parent: HUDI-1248 Issue Type: Sub-task (was: Bug) > Fix the memory leak for hudi-client unit tests > -- > > Key: HUDI-1010 > URL: https://issues.apache.org/jira/browse/HUDI-1010 > Project: Apache Hudi > Issue Type: Sub-task > Components: Testing >Affects Versions: 0.9.0 >Reporter: Yanjia Gary Li >Assignee: Nishith Agarwal >Priority: Major > Labels: help-wanted, user-support-issues > Fix For: 0.9.0 > > Attachments: image-2020-06-08-09-22-08-864.png > > > hudi-client unit test has a memory leak, which could be some resources are > not properly released during the cleanup. The memory consumption was > accumulating over time and lead to the Travis CI failure. > By using the IntelliJ memory analysis tool, we can find the major leak was > HoodieLogFormatWriter, HoodieWrapperFileSystem, HoodieLogFileReader, e.t.c > Related PR: [https://github.com/apache/hudi/pull/1707] > [https://github.com/apache/hudi/pull/1697] > !image-2020-06-08-09-22-08-864.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-1989) Flaky test : TestHoodieMergeOnReadTable
[ https://issues.apache.org/jira/browse/HUDI-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1989: - Parent: HUDI-1248 Issue Type: Sub-task (was: Bug) > Flaky test : TestHoodieMergeOnReadTable > --- > > Key: HUDI-1989 > URL: https://issues.apache.org/jira/browse/HUDI-1989 > Project: Apache Hudi > Issue Type: Sub-task >Reporter: sivabalan narayanan >Priority: Major > > [https://api.travis-ci.com/v3/job/512025273/log.txt] > > [ERROR] Tests run: 23, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: > 330.459 s <<< FAILURE! - in org.apache.hudi.table.TestHoodieMergeOnReadTable > [ERROR] > org.apache.hudi.table.TestHoodieMergeOnReadTable.testCOWToMORConvertedTableRollbackUsingMarkers > Time elapsed: 0.564 s <<< ERROR! java.lang.NullPointerException at > org.apache.hudi.table.TestHoodieMergeOnReadTable.init(TestHoodieMergeOnReadTable.java:118) > at > org.apache.hudi.table.TestHoodieMergeOnReadTable.init(TestHoodieMergeOnReadTable.java:135) > [INFO] [INFO] Results: [INFO] [ERROR] Errors: [ERROR] > TestHoodieMergeOnReadTable.init:135->init:118->HoodieClientTestHarness.initDFS:255 > » NullPointer > > > Couple of more failures > [https://api.travis-ci.com/v3/job/512584741/log.txt] > > [ERROR] Tests run: 23, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: > 321.634 s <<< FAILURE! - in org.apache.hudi.table.TestHoodieMergeOnReadTable > [ERROR] > org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingFileList > Time elapsed: 16.972 s <<< FAILURE! org.opentest4j.AssertionFailedError: > There files should have been rolled-back when rolling back commit 002 but are > still remaining. Files: > [hdfs://localhost:41724/tmp/junit6050583652872512516/dataset/2015/03/17/14423e02-307a-42e2-b76f-71f39241d002-0_2-20-26_001.parquet] > ==> expected: <0> but was: <1> at > org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommit(TestHoodieMergeOnReadTable.java:646) > at > org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingFileList(TestHoodieMergeOnReadTable.java:728) > [ERROR] > org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingMarkers > Time elapsed: 14.651 s <<< FAILURE! org.opentest4j.AssertionFailedError: > There files should have been rolled-back when rolling back commit 002 but are > still remaining. Files: > [hdfs://localhost:36524/tmp/junit7236068081383159369/dataset/2015/03/16/002a31b1-2c2d-470b-bf45-d19451a04630-0_1-20-25_001.parquet] > ==> expected: <0> but was: <1> at > org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommit(TestHoodieMergeOnReadTable.java:646) > at > org.apache.hudi.table.TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingMarkers(TestHoodieMergeOnReadTable.java:733) > [INFO] [INFO] Results: [INFO] [ERROR] Failures: [ERROR] > TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingFileList:728->testRollbackWithDeltaAndCompactionCommit:646 > There files should have been rolled-back when rolling back commit 002 but > are still remaining. Files: > [hdfs://localhost:41724/tmp/junit6050583652872512516/dataset/2015/03/17/14423e02-307a-42e2-b76f-71f39241d002-0_2-20-26_001.parquet] > ==> expected: <0> but was: <1> [ERROR] > TestHoodieMergeOnReadTable.testRollbackWithDeltaAndCompactionCommitUsingMarkers:733->testRollbackWithDeltaAndCompactionCommit:646 > There files should have been rolled-back when rolling back commit 002 but > are still remaining. Files: > [hdfs://localhost:36524/tmp/junit7236068081383159369/dataset/2015/03/16/002a31b1-2c2d-470b-bf45-d19451a04630-0_1-20-25_001.parquet] > ==> expected: <0> but was: <1> [INFO] [ERROR] Tests run: 393, Failures: 2, > Errors: 0, Skipped: 1 > > > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hudi] hudi-bot edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit
hudi-bot edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-862136673 ## CI report: * 3b02a03a355c85723b69c9d8b4557c5983c8914f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=461) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit
codecov-commenter edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-864517429 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit
codecov-commenter edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-864517429 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3092?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3092](https://codecov.io/gh/apache/hudi/pull/3092?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (3b02a03) into [master](https://codecov.io/gh/apache/hudi/commit/f73bedd374952580c4d6bc9b2e30607c4efdd538?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (f73bedd) will **increase** coverage by `14.78%`. > The diff coverage is `75.00%`. [](https://codecov.io/gh/apache/hudi/pull/3092?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#3092 +/- ## = + Coverage 44.31% 59.09% +14.78% + Complexity 4574 1192 -3382 = Files 824 162 -662 Lines 36375 6398-29977 Branches 3937 670 -3267 = - Hits 16120 3781-12339 + Misses18511 2345-16166 + Partials 1744 272 -1472 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `66.85% <ø> (+50.39%)` | :arrow_up: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `?` | | | huditimelineservice | `?` | | | hudiutilities | `50.01% <75.00%> (-8.28%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3092?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...g/apache/hudi/utilities/sources/AvroDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3092/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb0RGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (ø)` | | | [...apache/hudi/utilities/sources/AvroKafkaSource.java](https://codecov.io/gh/apache/hudi/pull/3092/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb0thZmthU291cmNlLmphdmE=) | `0.00% <0.00%> (ø)` | | | [...che/hudi/utilities/sources/HiveIncrPullSource.java](https://codecov.io/gh/apache/hudi/pull/3092/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSGl2ZUluY3JQdWxsU291cmNlLmphdmE=) | `0.00% <0.00%> (ø)` | | | [...g/apache/hudi/utilities/sources/JsonDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3092/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkRGU1NvdXJjZS5qYXZh) | `90.00% <0.00%> (-10.00%)` | :arrow_down: | | [...java/org/apache/hudi/utilities/sources/Source.java](https://codecov.io/gh/apache/hudi/pull/3092/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvU291cmNlLmphdmE=) | `87.50% <ø> (ø)` | | | [...a/org/apache/hudi/utilities/sources/SqlSource.java](https://codecov.io/gh/apache/hudi/pull/3092/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvU3FsU291cmNlLmphdmE=) | `61.11% <0.00%> (-3.60%)` | :arrow_down: | |
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit
codecov-commenter edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-864517429 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3092?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3092](https://codecov.io/gh/apache/hudi/pull/3092?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (3b02a03) into [master](https://codecov.io/gh/apache/hudi/commit/f73bedd374952580c4d6bc9b2e30607c4efdd538?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (f73bedd) will **increase** coverage by `5.70%`. > The diff coverage is `75.00%`. [](https://codecov.io/gh/apache/hudi/pull/3092?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#3092 +/- ## + Coverage 44.31% 50.01% +5.70% + Complexity 4574 404-4170 Files 824 66 -758 Lines 36375 2947 -33428 Branches 3937 318-3619 - Hits 16120 1474 -14646 + Misses18511 1338 -17173 + Partials 1744 135-1609 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `?` | | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `?` | | | huditimelineservice | `?` | | | hudiutilities | `50.01% <75.00%> (-8.28%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3092?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...g/apache/hudi/utilities/sources/AvroDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3092/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb0RGU1NvdXJjZS5qYXZh) | `0.00% <0.00%> (ø)` | | | [...apache/hudi/utilities/sources/AvroKafkaSource.java](https://codecov.io/gh/apache/hudi/pull/3092/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb0thZmthU291cmNlLmphdmE=) | `0.00% <0.00%> (ø)` | | | [...che/hudi/utilities/sources/HiveIncrPullSource.java](https://codecov.io/gh/apache/hudi/pull/3092/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSGl2ZUluY3JQdWxsU291cmNlLmphdmE=) | `0.00% <0.00%> (ø)` | | | [...g/apache/hudi/utilities/sources/JsonDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3092/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvbkRGU1NvdXJjZS5qYXZh) | `90.00% <0.00%> (-10.00%)` | :arrow_down: | | [...java/org/apache/hudi/utilities/sources/Source.java](https://codecov.io/gh/apache/hudi/pull/3092/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvU291cmNlLmphdmE=) | `87.50% <ø> (ø)` | | | [...a/org/apache/hudi/utilities/sources/SqlSource.java](https://codecov.io/gh/apache/hudi/pull/3092/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvU3FsU291cmNlLmphdmE=) | `61.11% <0.00%> (-3.60%)` | :arrow_down: | |
[GitHub] [hudi] hudi-bot edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit
hudi-bot edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-862136673 ## CI report: * 2d5c2588f9088daef2800600558ebaa7d6d05212 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=443) * 3b02a03a355c85723b69c9d8b4557c5983c8914f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=461) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3092: [HUDI-1910] Commit Offset to Kafka after successful Hudi commit
hudi-bot edited a comment on pull request #3092: URL: https://github.com/apache/hudi/pull/3092#issuecomment-862136673 ## CI report: * 2d5c2588f9088daef2800600558ebaa7d6d05212 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=443) * 3b02a03a355c85723b69c9d8b4557c5983c8914f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] cb149 opened a new issue #3161: [SUPPORT] Spark Structured Streaming from Kafka to HoodieStreamingSink missing messages
cb149 opened a new issue #3161:
URL: https://github.com/apache/hudi/issues/3161
**Describe the problem you faced**
I have a Spark Structured Streaming application running on YARN which I
trigger once at the start of every hour. Now I have discovered missing messages
in my Hudi table, which is confusing since Structured Streaming proclaims _the
system ensures end-to-end exactly-once fault-tolerance guarantees_
Effectively the application runs:
```scala
spark
.readStream
.format("kafka")
.options(options) // the usual, bootstrapServers etc.
.load()
.selectExpr(s"CAST(key AS STRING) as $name", "CAST(value AS STRING)")
// multiple .withColumn("xyz", from_json(col("value"), struct)) and
explode()
.writeStream
.trigger(Trigger.Once())
.format("hudi")
.option("path", config.outputPath)
.option("checkpointLocation", config.checkpointPath)
.options(getHudiConfig())
.outputMode(OutputMode.Append)
.start()
```
Commit operation is `upsert` and my Hudi config settings include (among the
usual):
```scala
HoodieWriteConfig.FAIL_ON_TIMELINE_ARCHIVING_ENABLED_PROP -> "false",
DataSourceWriteOptions.PRECOMBINE_FIELD_OPT_KEY -> "ts",
DataSourceWriteOptions.STREAMING_IGNORE_FAILED_BATCH_OPT_KEY -> "false",
DataSourceWriteOptions.STREAMING_RETRY_CNT_OPT_KEY -> "0"
```
and my spark settings include
```
"spark.rdd.compress": "true",
"spark.serializer": "org.apache.spark.serializer.KryoSerializer",
"spark.unsafe.sorter.spill.read.ahead.enabled": "false",
```
I have rerun the exact same application for the Kafka offsets containing the
missing messages (about 2 days after the application ran for those offsets),
writing to a new Hudi table and the missing message was not missing from that
one, so it seems to me there is an issue with StructuredStreaming from Kafka to
Hudi in particular with running shortly after a message was ingested. Looking
into the log of the application that missed the message, I can see no errors,
but the following:
```
21/06/24 08:04:06 INFO hudi.HoodieStreamingSink: Micro batch id=322
succeeded for commit=20210624080101
21/06/24 08:04:06 INFO hudi.HoodieStreamingSink: Micro batch id=322 succeeded
21/06/24 08:04:06 INFO streaming.CheckpointFileManager: Writing atomically
to hdfs://{path}/checkpoint/commits/322 using temp file
hdfs://{path}/checkpoint/commits/.322.e7795a54-3ea1-435a-a5de-253f2e66d8fe.tmp
21/06/24 08:04:06 INFO streaming.CheckpointFileManager: Renamed temp file
hdfs://{path}/checkpoint/commits/.322.e7795a54-3ea1-435a-a5de-253f2e66d8fe.tmp
to hdfs://{path}/checkpoint/commits/322
21/06/24 08:04:06 INFO streaming.MicroBatchExecution: Streaming query made
progress: {
"id" : "85adfe77-fa91-4094-ba2a-1ac65dd193cc",
"runId" : "f1012bb4-0c38-4b99-9bb9-7f02ed3f3087",
"name" : null,
"timestamp" : "2021-06-24T06:00:56.265Z",
"batchId" : 322,
"numInputRows" : 2101,
"processedRowsPerSecond" : 11.066864721932513,
"durationMs" : {
"addBatch" : 184786,
"getBatch" : 8,
"getEndOffset" : 0,
"queryPlanning" : 256,
"setOffsetRange" : 3766,
"triggerExecution" : 189845,
"walCommit" : 716
},
"stateOperators" : [ ],
"sources" : [ {
"description" : "KafkaV2[Subscribe[topic]]",
"startOffset" : {
"topic" : {
"2" : 2354732,
"1" : 852378,
"0" : 4484872
}
},
"endOffset" : {
"topic" : {
"2" : 2355432,
"1" : 852507,
"0" : 4486272
}
},
"numInputRows" : 2101,
"processedRowsPerSecond" : 11.066864721932513
} ],
"sink" : {
"description" : "HoodieStreamingSink[table]"
}
}
```
The weird thing to me is that if I substract `startOffset` from the
`endOffset` I get **2229**. This should however match the **2101** of
`numInputRows` right? In the other runs of the application, I can see that the
difference between the offsets is always `numInputrows - 1`.
This would also be the case here if we only combine the differences for
partitions 2 and 0, resulting in 2100, which makes me assume the messages I am
missing are in partition 1, which shows a difference of 129.
Now since I effectively ran the code twice, and produced two different
outputs, I am wondering where the issue comes from and how to fix it. Is the
mismatch between the offsets and `numInputRows` from above the issue and
indicates I lost 128 messages? Would this issue originate from the Kafka input
or from the HoodieStreamingSink?
Sadly, I can't replicate the issue.
I've been thinking about getting the `numInputRows` and offsets from
`query.lastProgress` in my code, to compare and throw an error on mismatch, but
[jira] [Updated] (HUDI-1628) Improve data locality during ingestion
[ https://issues.apache.org/jira/browse/HUDI-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thirumalai Raj R updated HUDI-1628: --- Status: In Progress (was: Open) > Improve data locality during ingestion > -- > > Key: HUDI-1628 > URL: https://issues.apache.org/jira/browse/HUDI-1628 > Project: Apache Hudi > Issue Type: New Feature > Components: Writer Core >Reporter: satish >Assignee: Thirumalai Raj R >Priority: Major > Fix For: 0.10.0 > > > Today the upsert partitioner does the file sizing/bin-packing etc for > inserts and then sends some inserts over to existing file groups to > maintain file size. > We can abstract all of this into strategies and some kind of pipeline > abstractions and have it also consider "affinity" to an existing file group > based > on say information stored in the metadata table? > See http://mail-archives.apache.org/mod_mbox/hudi-dev/202102.mbox/browser > for more details -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HUDI-1630) Add partitioner strategy for improving data locality
[ https://issues.apache.org/jira/browse/HUDI-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thirumalai Raj R reassigned HUDI-1630: -- Assignee: Thirumalai Raj R > Add partitioner strategy for improving data locality > > > Key: HUDI-1630 > URL: https://issues.apache.org/jira/browse/HUDI-1630 > Project: Apache Hudi > Issue Type: Sub-task >Reporter: satish >Assignee: Thirumalai Raj R >Priority: Major > > We can use index/metadata information and co-locate records with same value > for specified column(s) in same fileId -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HUDI-1631) Sort data when creating a new version of file
[ https://issues.apache.org/jira/browse/HUDI-1631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thirumalai Raj R reassigned HUDI-1631: -- Assignee: Thirumalai Raj R > Sort data when creating a new version of file > - > > Key: HUDI-1631 > URL: https://issues.apache.org/jira/browse/HUDI-1631 > Project: Apache Hudi > Issue Type: Sub-task >Reporter: satish >Assignee: Thirumalai Raj R >Priority: Major > > Add option to sort data by specific file when creating new version of file. > Anytime we open a file and write data (whehther to apply updates/add new > records), we want to sort data in the file by specified column(s). -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HUDI-1629) Change partitioner abstraction to implement multiple strategies
[ https://issues.apache.org/jira/browse/HUDI-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thirumalai Raj R reassigned HUDI-1629: -- Assignee: Thirumalai Raj R > Change partitioner abstraction to implement multiple strategies > --- > > Key: HUDI-1629 > URL: https://issues.apache.org/jira/browse/HUDI-1629 > Project: Apache Hudi > Issue Type: Sub-task >Reporter: satish >Assignee: Thirumalai Raj R >Priority: Major > > Existing UpsertPartitioner only considers file sizing to assign > inserts/updates. We also want to consider data locality and other factors. So > change partitioner abstraction to make it easy to implement and plug in other > strategies. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HUDI-1628) Improve data locality during ingestion
[ https://issues.apache.org/jira/browse/HUDI-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17369897#comment-17369897 ] Thirumalai Raj R commented on HUDI-1628: [~vinoth], I am interested in taking up this task, will start working on this > Improve data locality during ingestion > -- > > Key: HUDI-1628 > URL: https://issues.apache.org/jira/browse/HUDI-1628 > Project: Apache Hudi > Issue Type: New Feature > Components: Writer Core >Reporter: satish >Priority: Major > Fix For: 0.10.0 > > > Today the upsert partitioner does the file sizing/bin-packing etc for > inserts and then sends some inserts over to existing file groups to > maintain file size. > We can abstract all of this into strategies and some kind of pipeline > abstractions and have it also consider "affinity" to an existing file group > based > on say information stored in the metadata table? > See http://mail-archives.apache.org/mod_mbox/hudi-dev/202102.mbox/browser > for more details -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HUDI-1628) Improve data locality during ingestion
[ https://issues.apache.org/jira/browse/HUDI-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thirumalai Raj R reassigned HUDI-1628: -- Assignee: Thirumalai Raj R > Improve data locality during ingestion > -- > > Key: HUDI-1628 > URL: https://issues.apache.org/jira/browse/HUDI-1628 > Project: Apache Hudi > Issue Type: New Feature > Components: Writer Core >Reporter: satish >Assignee: Thirumalai Raj R >Priority: Major > Fix For: 0.10.0 > > > Today the upsert partitioner does the file sizing/bin-packing etc for > inserts and then sends some inserts over to existing file groups to > maintain file size. > We can abstract all of this into strategies and some kind of pipeline > abstractions and have it also consider "affinity" to an existing file group > based > on say information stored in the metadata table? > See http://mail-archives.apache.org/mod_mbox/hudi-dev/202102.mbox/browser > for more details -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hudi] leesf commented on a change in pull request #3146: [HUDI-2057] CTAS Generate An External Table When Create Managed Table
leesf commented on a change in pull request #3146:
URL: https://github.com/apache/hudi/pull/3146#discussion_r659178041
##
File path:
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala
##
@@ -355,6 +355,8 @@ object DataSourceWriteOptions {
val HIVE_TABLE_PROPERTIES = "hoodie.datasource.hive_sync.table_properties"
val HIVE_TABLE_SERDE_PROPERTIES =
"hoodie.datasource.hive_sync.serde_properties"
val HIVE_SYNC_AS_DATA_SOURCE_TABLE =
"hoodie.datasource.hive_sync.sync_as_datasource"
+ val HIVE_CREATE_MANAGED_TABLE =
"hoodie.datasource.hive_sync_create_managed_table"
Review comment:
`hoodie.datasource.hive_sync.create_managed_table` is better?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hudi] leesf commented on a change in pull request #3154: [HUDI-1884] MergeInto Support Partial Update For COW
leesf commented on a change in pull request #3154:
URL: https://github.com/apache/hudi/pull/3154#discussion_r659177860
##
File path:
hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala
##
@@ -164,7 +165,47 @@ case class HoodieResolveReferences(sparkSession:
SparkSession) extends Rule[Logi
case UpdateAction(condition, assignments) =>
val (resolvedCondition, resolvedAssignments) =
resolveConditionAssignments(condition, assignments)
- UpdateAction(resolvedCondition, resolvedAssignments)
+
+ // Get the target table type and pre-combine field.
+ val targetTableId = getMergeIntoTargetTableId(mergeInto)
+ val targetTable =
+sparkSession.sessionState.catalog.getTableMetadata(targetTableId)
+ val targetTableType =
HoodieOptionConfig.getTableType(targetTable.storage.properties)
+ val preCombineField =
HoodieOptionConfig.getPreCombineField(targetTable.storage.properties)
+
+ // Get the map of target attribute to value of the update
assignments.
+ val target2Values = resolvedAssignments.map {
+ case Assignment(attr: AttributeReference, value) =>
+attr.name -> value
+ case o => throw new IllegalArgumentException(s"Assignment key
must be an attribute, current is: ${o.key}")
+ }.toMap
+
+ // Validate if there are incorrect target attributes.
+ val unKnowTargets = target2Values.keys
+.filterNot(removeMetaFields(target.output).map(_.name).contains(_))
+ if (unKnowTargets.nonEmpty) {
+throw new AnalysisException(s"Cannot find target attributes:
${unKnowTargets.mkString(",")}.")
+ }
+
+ // Fill the missing target attribute in the update action for COW
table to support partial update.
+ // e.g. If the update action missing 'id' attribute, we fill a "id =
target.id" to the update action.
+ val newAssignments = removeMetaFields(target.output)
+.map(attr => {
+ // TODO support partial update for MOR.
Review comment:
for partial update, do we need another payload like this?
https://github.com/apache/hudi/pull/2666?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3159: [HUDI-2074] Use while loop instead of recursive call in MergeOnReadIn…
codecov-commenter edited a comment on pull request #3159: URL: https://github.com/apache/hudi/pull/3159#issuecomment-868942332 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3159](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (a151da7) into [master](https://codecov.io/gh/apache/hudi/commit/ed1a5daa9a15e9123aa7fdba5ce8262d1cae0704?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (ed1a5da) will **increase** coverage by `0.03%`. > The diff coverage is `80.00%`. [](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#3159 +/- ## + Coverage 46.25% 46.28% +0.03% - Complexity 5362 5368 +6 Files 920 920 Lines 3984239895 +53 Branches 4291 4298 +7 + Hits 1842718464 +37 - Misses1953419549 +15 - Partials 1881 1882 +1 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `39.95% <ø> (ø)` | | | hudiclient | `30.45% <ø> (ø)` | | | hudicommon | `47.58% <ø> (ø)` | | | hudiflink | `61.36% <80.00%> (+0.11%)` | :arrow_up: | | hudihadoopmr | `51.29% <ø> (ø)` | | | hudisparkdatasource | `67.06% <ø> (ø)` | | | hudisync | `54.05% <ø> (ø)` | | | huditimelineservice | `64.36% <ø> (ø)` | | | hudiutilities | `58.29% <ø> (ø)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [.../hudi/table/format/mor/MergeOnReadInputFormat.java](https://codecov.io/gh/apache/hudi/pull/3159/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1mbGluay9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVkaS90YWJsZS9mb3JtYXQvbW9yL01lcmdlT25SZWFkSW5wdXRGb3JtYXQuamF2YQ==) | `65.14% <80.00%> (ø)` | | | [...c/main/java/org/apache/hudi/util/StreamerUtil.java](https://codecov.io/gh/apache/hudi/pull/3159/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1mbGluay9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVkaS91dGlsL1N0cmVhbWVyVXRpbC5qYXZh) | `59.53% <0.00%> (+4.53%)` | :arrow_up: | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=continue_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=footer_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation). Last update [ed1a5da...a151da7](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=lastupdated_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3159: [HUDI-2074] Use while loop instead of recursive call in MergeOnReadIn…
codecov-commenter edited a comment on pull request #3159: URL: https://github.com/apache/hudi/pull/3159#issuecomment-868942332 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3159](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (a151da7) into [master](https://codecov.io/gh/apache/hudi/commit/ed1a5daa9a15e9123aa7fdba5ce8262d1cae0704?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (ed1a5da) will **not change** coverage. > The diff coverage is `80.00%`. [](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@Coverage Diff@@ ## master#3159 +/- ## = Coverage 46.25% 46.25% Complexity 5362 5362 = Files 920 920 Lines 3984239842 Branches 4291 4291 = Hits 1842718427 Misses1953419534 Partials 1881 1881 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `39.95% <ø> (ø)` | | | hudiclient | `30.45% <ø> (ø)` | | | hudicommon | `47.58% <ø> (ø)` | | | hudiflink | `61.25% <80.00%> (ø)` | | | hudihadoopmr | `51.29% <ø> (ø)` | | | hudisparkdatasource | `67.06% <ø> (ø)` | | | hudisync | `54.05% <ø> (ø)` | | | huditimelineservice | `64.36% <ø> (ø)` | | | hudiutilities | `58.29% <ø> (ø)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [.../hudi/table/format/mor/MergeOnReadInputFormat.java](https://codecov.io/gh/apache/hudi/pull/3159/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1mbGluay9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVkaS90YWJsZS9mb3JtYXQvbW9yL01lcmdlT25SZWFkSW5wdXRGb3JtYXQuamF2YQ==) | `65.14% <80.00%> (ø)` | | -- [Continue to review full report at Codecov](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=continue_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation). > **Legend** - [Click here to learn more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) > `Δ = absolute (impact)`, `ø = not affected`, `? = missing data` > Powered by [Codecov](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=footer_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation). Last update [ed1a5da...a151da7](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=lastupdated_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation). Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] leesf commented on pull request #3145: [Docs] Improving Hudi Configurations docs
leesf commented on pull request #3145: URL: https://github.com/apache/hudi/pull/3145#issuecomment-869003484 @zhangyue19921010 thanks for your contribution, would you please generate the site in your local and paste the pic? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3159: [HUDI-2074] Use while loop instead of recursive call in MergeOnReadIn…
codecov-commenter edited a comment on pull request #3159: URL: https://github.com/apache/hudi/pull/3159#issuecomment-868942332 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3159](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (a151da7) into [master](https://codecov.io/gh/apache/hudi/commit/ed1a5daa9a15e9123aa7fdba5ce8262d1cae0704?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (ed1a5da) will **decrease** coverage by `1.95%`. > The diff coverage is `80.00%`. [](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#3159 +/- ## - Coverage 46.25% 44.29% -1.96% + Complexity 5362 4574 -788 Files 920 824 -96 Lines 3984236391-3451 Branches 4291 3939 -352 - Hits 1842716120-2307 + Misses1953418527-1007 + Partials 1881 1744 -137 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `39.95% <ø> (ø)` | | | hudiclient | `16.45% <ø> (-14.01%)` | :arrow_down: | | hudicommon | `47.58% <ø> (ø)` | | | hudiflink | `61.25% <80.00%> (ø)` | | | hudihadoopmr | `51.29% <ø> (ø)` | | | hudisparkdatasource | `67.06% <ø> (ø)` | | | hudisync | `54.05% <ø> (ø)` | | | huditimelineservice | `64.36% <ø> (ø)` | | | hudiutilities | `58.29% <ø> (ø)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [.../hudi/table/format/mor/MergeOnReadInputFormat.java](https://codecov.io/gh/apache/hudi/pull/3159/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1mbGluay9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVkaS90YWJsZS9mb3JtYXQvbW9yL01lcmdlT25SZWFkSW5wdXRGb3JtYXQuamF2YQ==) | `65.14% <80.00%> (ø)` | | | [...cution/bulkinsert/RDDPartitionSortPartitioner.java](https://codecov.io/gh/apache/hudi/pull/3159/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvZXhlY3V0aW9uL2J1bGtpbnNlcnQvUkREUGFydGl0aW9uU29ydFBhcnRpdGlvbmVyLmphdmE=) | | | | [...apache/hudi/io/storage/HoodieRowParquetConfig.java](https://codecov.io/gh/apache/hudi/pull/3159/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW8vc3RvcmFnZS9Ib29kaWVSb3dQYXJxdWV0Q29uZmlnLmphdmE=) | | | | [...udi/io/storage/HoodieInternalRowParquetWriter.java](https://codecov.io/gh/apache/hudi/pull/3159/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW8vc3RvcmFnZS9Ib29kaWVJbnRlcm5hbFJvd1BhcnF1ZXRXcml0ZXIuamF2YQ==) | | | | [...rg/apache/hudi/client/model/HoodieInternalRow.java](https://codecov.io/gh/apache/hudi/pull/3159/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY2xpZW50L21vZGVsL0hvb2RpZUludGVybmFsUm93LmphdmE=) | | | |
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3159: [HUDI-2074] Use while loop instead of recursive call in MergeOnReadIn…
codecov-commenter edited a comment on pull request #3159: URL: https://github.com/apache/hudi/pull/3159#issuecomment-868942332 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3159](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (a151da7) into [master](https://codecov.io/gh/apache/hudi/commit/ed1a5daa9a15e9123aa7fdba5ce8262d1cae0704?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (ed1a5da) will **decrease** coverage by `1.95%`. > The diff coverage is `80.00%`. [](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#3159 +/- ## - Coverage 46.25% 44.29% -1.96% + Complexity 5362 4573 -789 Files 920 824 -96 Lines 3984236391-3451 Branches 4291 3939 -352 - Hits 1842716119-2308 + Misses1953418527-1007 + Partials 1881 1745 -136 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `39.95% <ø> (ø)` | | | hudiclient | `16.45% <ø> (-14.01%)` | :arrow_down: | | hudicommon | `47.58% <ø> (ø)` | | | hudiflink | `61.25% <80.00%> (ø)` | | | hudihadoopmr | `51.29% <ø> (ø)` | | | hudisparkdatasource | `67.06% <ø> (ø)` | | | hudisync | `54.05% <ø> (ø)` | | | huditimelineservice | `64.36% <ø> (ø)` | | | hudiutilities | `58.25% <ø> (-0.04%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3159?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [.../hudi/table/format/mor/MergeOnReadInputFormat.java](https://codecov.io/gh/apache/hudi/pull/3159/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1mbGluay9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVkaS90YWJsZS9mb3JtYXQvbW9yL01lcmdlT25SZWFkSW5wdXRGb3JtYXQuamF2YQ==) | `65.14% <80.00%> (ø)` | | | [...apache/hudi/utilities/deltastreamer/DeltaSync.java](https://codecov.io/gh/apache/hudi/pull/3159/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvRGVsdGFTeW5jLmphdmE=) | `70.84% <0.00%> (-0.34%)` | :arrow_down: | | [...apache/hudi/io/storage/HoodieRowParquetConfig.java](https://codecov.io/gh/apache/hudi/pull/3159/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvaW8vc3RvcmFnZS9Ib29kaWVSb3dQYXJxdWV0Q29uZmlnLmphdmE=) | | | | [...action/commit/SparkDeleteCommitActionExecutor.java](https://codecov.io/gh/apache/hudi/pull/3159/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdGFibGUvYWN0aW9uL2NvbW1pdC9TcGFya0RlbGV0ZUNvbW1pdEFjdGlvbkV4ZWN1dG9yLmphdmE=) | | | | [...commit/SparkInsertPreppedCommitActionExecutor.java](https://codecov.io/gh/apache/hudi/pull/3159/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdGFibGUvYWN0aW9uL2NvbW1pdC9TcGFya0luc2VydFByZXBwZWRDb21taXRBY3Rpb25FeGVjdXRvci5qYXZh) | | | |
[GitHub] [hudi] danny0405 closed pull request #3159: [HUDI-2074] Use while loop instead of recursive call in MergeOnReadIn…
danny0405 closed pull request #3159: URL: https://github.com/apache/hudi/pull/3159 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
hudi-bot edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868810948 ## CI report: * 3293dcf9b15091c3a5b41c6962a3cc8ca4ef90e2 UNKNOWN * 82ef082e92d7492a1055bfcfe2e8b5f230e7ef9e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=460) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
hudi-bot edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868810948 ## CI report: * 3293dcf9b15091c3a5b41c6962a3cc8ca4ef90e2 UNKNOWN * 49e9bb35d22e4b4e7b2114733df056b55365cb0e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=455) * 82ef082e92d7492a1055bfcfe2e8b5f230e7ef9e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=460) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
codecov-commenter edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868866588 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3158?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3158](https://codecov.io/gh/apache/hudi/pull/3158?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (82ef082) into [master](https://codecov.io/gh/apache/hudi/commit/b32855545bb9dbc6f49c18d1586585a39abe5004?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (b328555) will **decrease** coverage by `17.71%`. > The diff coverage is `100.00%`. [](https://codecov.io/gh/apache/hudi/pull/3158?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#3158 +/- ## = - Coverage 46.13% 28.41% -17.72% + Complexity 5323 1254 -4069 = Files 915 375 -540 Lines 3963414307-25327 Branches 4275 1459 -2816 = - Hits 18284 4065-14219 + Misses19478 9945 -9533 + Partials 1872 297 -1575 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `22.31% <100.00%> (-8.15%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <ø> (-46.35%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `58.25% <ø> (-0.04%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3158?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | | | [...i/utilities/deltastreamer/HoodieDeltaStreamer.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvSG9vZGllRGVsdGFTdHJlYW1lci5qYXZh) | `72.83% <ø> (ø)` | | | [...va/org/apache/hudi/client/SparkRDDWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1zcGFyay1jbGllbnQvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvY2xpZW50L1NwYXJrUkREV3JpdGVDbGllbnQuamF2YQ==) | `72.19% <100.00%> (+0.13%)` | :arrow_up: | | [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | |
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
codecov-commenter edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868866588 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3158?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3158](https://codecov.io/gh/apache/hudi/pull/3158?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (82ef082) into [master](https://codecov.io/gh/apache/hudi/commit/b32855545bb9dbc6f49c18d1586585a39abe5004?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (b328555) will **decrease** coverage by `29.95%`. > The diff coverage is `n/a`. [](https://codecov.io/gh/apache/hudi/pull/3158?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#3158 +/- ## = - Coverage 46.13% 16.17% -29.96% + Complexity 5323 466 -4857 = Files 915 279 -636 Lines 3963410855-28779 Branches 4275 1107 -3168 = - Hits 18284 1756-16528 + Misses19478 8939-10539 + Partials 1872 160 -1712 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `0.00% <ø> (-30.46%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <ø> (-46.35%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `58.25% <ø> (-0.04%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3158?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | | | [...i/utilities/deltastreamer/HoodieDeltaStreamer.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvSG9vZGllRGVsdGFTdHJlYW1lci5qYXZh) | `72.83% <ø> (ø)` | | | [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | |
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
codecov-commenter edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868866588 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3158?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3158](https://codecov.io/gh/apache/hudi/pull/3158?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (82ef082) into [master](https://codecov.io/gh/apache/hudi/commit/b32855545bb9dbc6f49c18d1586585a39abe5004?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (b328555) will **decrease** coverage by `43.05%`. > The diff coverage is `n/a`. [](https://codecov.io/gh/apache/hudi/pull/3158?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master #3158 +/- ## - Coverage 46.13% 3.07% -43.06% + Complexity 5323 82 -5241 Files 915 279 -636 Lines 39634 10855-28779 Branches 42751107 -3168 - Hits 18284 334-17950 + Misses19478 10495 -8983 + Partials 1872 26 -1846 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `0.00% <ø> (-30.46%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <ø> (-46.35%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `9.52% <ø> (-48.77%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3158?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [.../apache/hudi/client/AbstractHoodieWriteClient.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9BYnN0cmFjdEhvb2RpZVdyaXRlQ2xpZW50LmphdmE=) | `0.00% <ø> (ø)` | | | [...i/utilities/deltastreamer/HoodieDeltaStreamer.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL2RlbHRhc3RyZWFtZXIvSG9vZGllRGVsdGFTdHJlYW1lci5qYXZh) | `0.00% <ø> (-72.84%)` | :arrow_down: | | [...va/org/apache/hudi/utilities/IdentitySplitter.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0lkZW50aXR5U3BsaXR0ZXIuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...va/org/apache/hudi/utilities/schema/SchemaSet.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NjaGVtYS9TY2hlbWFTZXQuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...a/org/apache/hudi/utilities/sources/RowSource.java](https://codecov.io/gh/apache/hudi/pull/3158/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUm93U291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | |
[GitHub] [hudi] codope commented on a change in pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry
codope commented on a change in pull request #3097:
URL: https://github.com/apache/hudi/pull/3097#discussion_r659151072
##
File path:
hudi-utilities/src/main/java/org/apache/hudi/utilities/schema/SchemaRegistryProvider.java
##
@@ -48,19 +54,40 @@
"hoodie.deltastreamer.schemaprovider.registry.targetUrl";
}
- private static String fetchSchemaFromRegistry(String registryUrl) throws
IOException {
-URL registry = new URL(registryUrl);
+ public String fetchSchemaFromRegistry(String registryUrl) throws IOException
{
+URL registry;
+HttpURLConnection connection;
+Matcher matcher = Pattern.compile("://(.*?)@").matcher(registryUrl);
+if (matcher.find()) {
+ String creds = matcher.group(1);
+ String urlWithoutCreds = registryUrl.replace(creds + "@", "");
+ registry = new URL(urlWithoutCreds);
+ connection = (HttpURLConnection) registry.openConnection();
+ setAuthorizationHeader(matcher.group(1), connection);
+} else {
+ registry = new URL(registryUrl);
+ connection = (HttpURLConnection) registry.openConnection();
+}
ObjectMapper mapper = new ObjectMapper();
-JsonNode node = mapper.readTree(registry.openStream());
+JsonNode node = mapper.readTree(getStream(connection));
return node.get("schema").asText();
}
+ public void setAuthorizationHeader(String creds, HttpURLConnection
connection) {
Review comment:
Probably because it's being used in tests. If that's the only reason
then maybe we can make the method package-private?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [hudi] codope edited a comment on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry
codope edited a comment on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-868981651 > @codope : I remember you had a local confluent set up right. Do you think you can test this patch out. Also, feel free to review the patch. @nsivabalan I tested this patch. It works. The current master does not work with basic auth. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codope commented on pull request #3097: [HUDI-1996] Adding functionality to allow the providing of basic auth creds for confluent cloud schema registry
codope commented on pull request #3097: URL: https://github.com/apache/hudi/pull/3097#issuecomment-868981651 > @codope : I remember you had a local confluent set up right. Do you think you can test this patch out. Also, feel free to review the patch. I tested this patch. It works. The current master does not work with basic auth. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3158: [WIP][HUDI-1860] Add INSERT_OVERWRITE support to DeltaStreamer
hudi-bot edited a comment on pull request #3158: URL: https://github.com/apache/hudi/pull/3158#issuecomment-868810948 ## CI report: * 3293dcf9b15091c3a5b41c6962a3cc8ca4ef90e2 UNKNOWN * 49e9bb35d22e4b4e7b2114733df056b55365cb0e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=455) * 82ef082e92d7492a1055bfcfe2e8b5f230e7ef9e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Assigned] (HUDI-1042) [Umbrella] Support clustering on filegroups
[ https://issues.apache.org/jira/browse/HUDI-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reassigned HUDI-1042: --- Assignee: liwei (was: leesf) > [Umbrella] Support clustering on filegroups > --- > > Key: HUDI-1042 > URL: https://issues.apache.org/jira/browse/HUDI-1042 > Project: Apache Hudi > Issue Type: Bug >Affects Versions: 0.9.0 >Reporter: leesf >Assignee: liwei >Priority: Major > Labels: hudi-umbrellas > Fix For: 0.9.0 > > > please see > [https://cwiki.apache.org/confluence/display/HUDI/RFC+-+19+Clustering+data+for+speed+and+query+performance] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HUDI-1043) Support clustering in CoW mode
[ https://issues.apache.org/jira/browse/HUDI-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liwei reassigned HUDI-1043: --- Assignee: liwei (was: leesf) > Support clustering in CoW mode > -- > > Key: HUDI-1043 > URL: https://issues.apache.org/jira/browse/HUDI-1043 > Project: Apache Hudi > Issue Type: Sub-task >Reporter: leesf >Assignee: liwei >Priority: Major > > updates are not allowed during clustering -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3160: [HUDI-1975] Exclude metrics-core 3.1.2 from Dropwizard
codecov-commenter edited a comment on pull request #3160: URL: https://github.com/apache/hudi/pull/3160#issuecomment-868959316 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3160: [HUDI-1975] Exclude metrics-core 3.1.2 from Dropwizard
codecov-commenter edited a comment on pull request #3160: URL: https://github.com/apache/hudi/pull/3160#issuecomment-868959316 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3160?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3160](https://codecov.io/gh/apache/hudi/pull/3160?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (242d880) into [master](https://codecov.io/gh/apache/hudi/commit/23dbc09a0d5d677ed3728dbd5357320590ca2833?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (23dbc09) will **decrease** coverage by `17.83%`. > The diff coverage is `n/a`. [](https://codecov.io/gh/apache/hudi/pull/3160?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#3160 +/- ## = - Coverage 46.24% 28.40% -17.84% + Complexity 5362 1255 -4107 = Files 920 375 -545 Lines 3984214306-25536 Branches 4291 1459 -2832 = - Hits 18425 4064-14361 + Misses19535 9946 -9589 + Partials 1882 296 -1586 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `22.29% <ø> (-8.17%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <ø> (-48.67%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `58.29% <ø> (ø)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3160?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | |
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3160: [HUDI-1975] Exclude metrics-core 3.1.2 from Dropwizard
codecov-commenter edited a comment on pull request #3160: URL: https://github.com/apache/hudi/pull/3160#issuecomment-868959316 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3160?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3160](https://codecov.io/gh/apache/hudi/pull/3160?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (242d880) into [master](https://codecov.io/gh/apache/hudi/commit/23dbc09a0d5d677ed3728dbd5357320590ca2833?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (23dbc09) will **decrease** coverage by `30.05%`. > The diff coverage is `n/a`. [](https://codecov.io/gh/apache/hudi/pull/3160?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#3160 +/- ## = - Coverage 46.24% 16.18% -30.06% + Complexity 5362 467 -4895 = Files 920 279 -641 Lines 3984210855-28987 Branches 4291 1107 -3184 = - Hits 18425 1757-16668 + Misses19535 8939-10596 + Partials 1882 159 -1723 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `0.00% <ø> (-30.46%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <ø> (-48.67%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `58.29% <ø> (ø)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3160?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | |
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3134?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3134](https://codecov.io/gh/apache/hudi/pull/3134?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (31d3303) into [master](https://codecov.io/gh/apache/hudi/commit/7bd517a82f9da3a6b42f6786da1d8a23151bdd94?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (7bd517a) will **decrease** coverage by `17.68%`. > The diff coverage is `n/a`. [](https://codecov.io/gh/apache/hudi/pull/3134?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#3134 +/- ## = - Coverage 46.08% 28.40% -17.69% + Complexity 5319 1254 -4065 = Files 914 375 -539 Lines 3959614306-25290 Branches 4269 1459 -2810 = - Hits 18249 4063-14186 + Misses19480 9946 -9534 + Partials 1867 297 -1570 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `22.29% <ø> (-8.15%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <ø> (-46.35%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `58.25% <ø> (-0.16%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3134?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | |
[GitHub] [hudi] codecov-commenter commented on pull request #3160: [HUDI-1975] Exclude metrics-core 3.1.2 from Dropwizard
codecov-commenter commented on pull request #3160: URL: https://github.com/apache/hudi/pull/3160#issuecomment-868959316 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3160?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3160](https://codecov.io/gh/apache/hudi/pull/3160?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (242d880) into [master](https://codecov.io/gh/apache/hudi/commit/23dbc09a0d5d677ed3728dbd5357320590ca2833?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (23dbc09) will **decrease** coverage by `43.16%`. > The diff coverage is `n/a`. [](https://codecov.io/gh/apache/hudi/pull/3160?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master #3160 +/- ## - Coverage 46.24% 3.07% -43.17% + Complexity 5362 82 -5280 Files 920 279 -641 Lines 39842 10855-28987 Branches 42911107 -3184 - Hits 18425 334-18091 + Misses19535 10495 -9040 + Partials 1882 26 -1856 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `0.00% <ø> (-30.46%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <ø> (-48.67%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `9.52% <ø> (-48.77%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3160?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...va/org/apache/hudi/utilities/IdentitySplitter.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0lkZW50aXR5U3BsaXR0ZXIuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...va/org/apache/hudi/utilities/schema/SchemaSet.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NjaGVtYS9TY2hlbWFTZXQuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...a/org/apache/hudi/utilities/sources/RowSource.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUm93U291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/utilities/sources/AvroSource.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/utilities/sources/JsonSource.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvblNvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...rg/apache/hudi/utilities/sources/CsvDFSSource.java](https://codecov.io/gh/apache/hudi/pull/3160/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQ3N2REZTU291cmNlLmphdmE=)
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3134?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3134](https://codecov.io/gh/apache/hudi/pull/3134?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (31d3303) into [master](https://codecov.io/gh/apache/hudi/commit/7bd517a82f9da3a6b42f6786da1d8a23151bdd94?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (7bd517a) will **decrease** coverage by `29.91%`. > The diff coverage is `n/a`. [](https://codecov.io/gh/apache/hudi/pull/3134?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master#3134 +/- ## = - Coverage 46.08% 16.17% -29.92% + Complexity 5319 466 -4853 = Files 914 279 -635 Lines 3959610855-28741 Branches 4269 1107 -3162 = - Hits 18249 1756-16493 + Misses19480 8939-10541 + Partials 1867 160 -1707 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `0.00% <ø> (-30.45%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <ø> (-46.35%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `58.25% <ø> (-0.16%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3134?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...main/java/org/apache/hudi/metrics/HoodieGauge.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvSG9vZGllR2F1Z2UuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/hive/NonPartitionedExtractor.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1zeW5jL2h1ZGktaGl2ZS1zeW5jL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2hpdmUvTm9uUGFydGl0aW9uZWRFeHRyYWN0b3IuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../java/org/apache/hudi/metrics/MetricsReporter.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...a/org/apache/hudi/metrics/MetricsReporterType.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL21ldHJpY3MvTWV0cmljc1JlcG9ydGVyVHlwZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...rg/apache/hudi/client/bootstrap/BootstrapMode.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS1jbGllbnQvaHVkaS1jbGllbnQtY29tbW9uL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9odWRpL2NsaWVudC9ib290c3RyYXAvQm9vdHN0cmFwTW9kZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | |
[GitHub] [hudi] codecov-commenter edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction
codecov-commenter edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-866110119 # [Codecov](https://codecov.io/gh/apache/hudi/pull/3134?src=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) Report > Merging [#3134](https://codecov.io/gh/apache/hudi/pull/3134?src=pr=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (31d3303) into [master](https://codecov.io/gh/apache/hudi/commit/7bd517a82f9da3a6b42f6786da1d8a23151bdd94?el=desc_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) (7bd517a) will **decrease** coverage by `43.01%`. > The diff coverage is `n/a`. [](https://codecov.io/gh/apache/hudi/pull/3134?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) ```diff @@ Coverage Diff @@ ## master #3134 +/- ## - Coverage 46.08% 3.07% -43.02% + Complexity 5319 82 -5237 Files 914 279 -635 Lines 39596 10855-28741 Branches 42691107 -3162 - Hits 18249 334-17915 + Misses19480 10495 -8985 + Partials 1867 26 -1841 ``` | Flag | Coverage Δ | | |---|---|---| | hudicli | `?` | | | hudiclient | `0.00% <ø> (-30.45%)` | :arrow_down: | | hudicommon | `?` | | | hudiflink | `?` | | | hudihadoopmr | `?` | | | hudisparkdatasource | `?` | | | hudisync | `5.38% <ø> (-46.35%)` | :arrow_down: | | huditimelineservice | `?` | | | hudiutilities | `9.52% <ø> (-48.89%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://codecov.io/gh/apache/hudi/pull/3134?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation) | Coverage Δ | | |---|---|---| | [...va/org/apache/hudi/utilities/IdentitySplitter.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL0lkZW50aXR5U3BsaXR0ZXIuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...va/org/apache/hudi/utilities/schema/SchemaSet.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NjaGVtYS9TY2hlbWFTZXQuamF2YQ==) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [...a/org/apache/hudi/utilities/sources/RowSource.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvUm93U291cmNlLmphdmE=) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/utilities/sources/AvroSource.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvQXZyb1NvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | | [.../org/apache/hudi/utilities/sources/JsonSource.java](https://codecov.io/gh/apache/hudi/pull/3134/diff?src=pr=tree_medium=referral_source=github_content=comment_campaign=pr+comments_term=The+Apache+Software+Foundation#diff-aHVkaS11dGlsaXRpZXMvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1ZGkvdXRpbGl0aWVzL3NvdXJjZXMvSnNvblNvdXJjZS5qYXZh) | `0.00% <0.00%> (-100.00%)` | :arrow_down: | |
[GitHub] [hudi] hudi-bot edited a comment on pull request #3160: [HUDI-1975] Exclude metrics-core 3.1.2 from Dropwizard
hudi-bot edited a comment on pull request #3160: URL: https://github.com/apache/hudi/pull/3160#issuecomment-868951565 ## CI report: * 242d880172062a2cb1a8e81934f33495a1d6a219 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=458) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] hudi-bot edited a comment on pull request #3134: [HUDI-2052] Support load logFile in BootstrapFunction
hudi-bot edited a comment on pull request #3134: URL: https://github.com/apache/hudi/pull/3134#issuecomment-865885733 ## CI report: * 31d330315aaf63e3cf0829fb9397cffbcb5e8fc9 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=457) Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis` re-run the last Travis build - `@hudi-bot run azure` re-run the last Azure build -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
