Build failed in Jenkins: hudi-snapshot-deployment-0.5 #48

See -- [...truncated 2.22 KB...] mvnDebug.cmd mvnyjp /home/jenkins/tools/maven/apache-maven-3.5.4/boot: plexus-classworlds-2.5.2.jar

[jira] [Created] (HUDI-278) Translate Administering page

leesf created HUDI-278: -- Summary: Translate Administering page Key: HUDI-278 URL: https://issues.apache.org/jira/browse/HUDI-278 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Commented] (HUDI-276) Translate Documentation -> Configurations page

[ https://issues.apache.org/jira/browse/HUDI-276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937375#comment-16937375 ] cdmikechen commented on HUDI-276: - 很高兴还有国内志同道合的同志使用hudi啊，你们目前已经在使用hudi了吗 > Translate Documentation ->

[GitHub] [incubator-hudi] bvaradar commented on issue #918: [HUDI-121] : Address comments during RC2 voting

bvaradar commented on issue #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#issuecomment-534836536 @lresende : Thanks a lot for reviewing This is an automated

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327918756 ## File path: pom.xml ## @@ -394,18 +369,18 @@ +

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327918030 ## File path: LICENSE ## @@ -175,32 +175,6 @@ of your accepting any such warranty or

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327919087 ## File path: pom.xml ## @@ -394,18 +369,18 @@ +

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327917638 ## File path: NOTICE ## @@ -1,120 +1,574 @@ Apache HUDI Copyright 2019 The Apache Software

[jira] [Commented] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937363#comment-16937363 ] Xing Pan commented on HUDI-269: --- [~vbalaji] ic, I was just trying to observe the request count change in a

[jira] [Comment Edited] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937360#comment-16937360 ] BALAJI VARADARAJAN edited comment on HUDI-269 at 9/25/19 3:12 AM: -- ok,

[jira] [Commented] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937360#comment-16937360 ] BALAJI VARADARAJAN commented on HUDI-269: - ok, looks like there is only one file and one partition

[jira] [Commented] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937358#comment-16937358 ] Xing Pan commented on HUDI-269: ---   [~vbalaji] yea, these strange 5K requests are mainly head requests, and

[jira] [Updated] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Pan updated HUDI-269: -- Attachment: hudi_request_test.tar.gz > Provide ability to throttle DeltaStreamer sync runs >

[jira] [Created] (HUDI-277) Translate Documentation -> Performance page

Ethan Guo created HUDI-277: -- Summary: Translate Documentation -> Performance page Key: HUDI-277 URL: https://issues.apache.org/jira/browse/HUDI-277 Project: Apache Hudi (incubating) Issue Type:

[jira] [Created] (HUDI-276) Translate Documentation -> Configurations page

Ethan Guo created HUDI-276: -- Summary: Translate Documentation -> Configurations page Key: HUDI-276 URL: https://issues.apache.org/jira/browse/HUDI-276 Project: Apache Hudi (incubating) Issue Type:

[jira] [Updated] (HUDI-273) Translate Documentation -> Writing Data page

[ https://issues.apache.org/jira/browse/HUDI-273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-273: --- Fix Version/s: 0.6.0 > Translate Documentation -> Writing Data page >

[jira] [Updated] (HUDI-275) Translate Documentation -> Querying Data page

[ https://issues.apache.org/jira/browse/HUDI-275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-275: --- Fix Version/s: 0.6.0 > Translate Documentation -> Querying Data page >

[GitHub] [incubator-hudi] lresende commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

lresende commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327911050 ## File path: pom.xml ## @@ -394,18 +369,18 @@ +

[GitHub] [incubator-hudi] lresende commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

lresende commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327909187 ## File path: NOTICE ## @@ -1,120 +1,574 @@ Apache HUDI Copyright 2019 The Apache Software

[GitHub] [incubator-hudi] lresende commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

lresende commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327908449 ## File path: LICENSE ## @@ -175,32 +175,6 @@ of your accepting any such warranty or

[GitHub] [incubator-hudi] lresende commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

lresende commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327910958 ## File path: pom.xml ## @@ -394,18 +369,18 @@ +

[jira] [Updated] (HUDI-275) Translate Documentation -> Querying Data page

[ https://issues.apache.org/jira/browse/HUDI-275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-275: --- Component/s: docs-chinese > Translate Documentation -> Querying Data page >

[jira] [Updated] (HUDI-273) Translate Documentation -> Writing Data page

[ https://issues.apache.org/jira/browse/HUDI-273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-273: --- Component/s: docs-chinese > Translate Documentation -> Writing Data page >

[jira] [Assigned] (HUDI-275) Translate Documentation -> Querying Data page

[ https://issues.apache.org/jira/browse/HUDI-275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-275: -- Assignee: Ethan Guo > Translate Documentation -> Querying Data page >

[jira] [Created] (HUDI-275) Translate Documentation -> Querying Data page

Ethan Guo created HUDI-275: -- Summary: Translate Documentation -> Querying Data page Key: HUDI-275 URL: https://issues.apache.org/jira/browse/HUDI-275 Project: Apache Hudi (incubating) Issue Type:

[jira] [Commented] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937346#comment-16937346 ] BALAJI VARADARAJAN commented on HUDI-269: - [~XingXPan]: I cannot understand why we are seeing close

[jira] [Created] (HUDI-274) Consolidate all scripts under top level scripts directory

BALAJI VARADARAJAN created HUDI-274: --- Summary: Consolidate all scripts under top level scripts directory Key: HUDI-274 URL: https://issues.apache.org/jira/browse/HUDI-274 Project: Apache Hudi

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327906437 ## File path: packaging/hudi-timeline-server-bundle/run_server.sh ## @@ -19,13 +19,35 @@

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327905454 ## File path: release/scripts/generate_notice.sh ## @@ -0,0 +1,36 @@ +#!/usr/bin/env bash

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327905487 ## File path: release/scripts/validate_staged_release.sh ## @@ -0,0 +1,125 @@ +#!/usr/bin/env

[jira] [Commented] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937336#comment-16937336 ] Xing Pan commented on HUDI-269: --- and I ran delta streamer like: {code:java} spark-submit --class

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327904862 ## File path: packaging/hudi-timeline-server-bundle/run_server.sh ## @@ -19,13 +19,35 @@

[jira] [Commented] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937334#comment-16937334 ] Xing Pan commented on HUDI-269: --- [~vbalaji] : yeah, this is just a single test hudi app in my sandbox emr, so

[jira] [Created] (HUDI-273) Translate Documentation -> Writing Data page

Ethan Guo created HUDI-273: -- Summary: Translate Documentation -> Writing Data page Key: HUDI-273 URL: https://issues.apache.org/jira/browse/HUDI-273 Project: Apache Hudi (incubating) Issue Type:

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

bvaradar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327904045 ## File path: release/scripts/preparation_before_release.sh ## @@ -22,9 +22,9 @@ set -e

[jira] [Commented] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937330#comment-16937330 ] BALAJI VARADARAJAN commented on HUDI-269: - [~XingXPan] : Thank you for sharing the S3 metrics Can

[GitHub] [incubator-hudi] yihua commented on a change in pull request #901: [HUDI-255] Translate Talks & Powered By page

yihua commented on a change in pull request #901: [HUDI-255] Translate Talks & Powered By page URL: https://github.com/apache/incubator-hudi/pull/901#discussion_r327894432 ## File path: docs/powered_by.cn.md ## @@ -6,28 +6,27 @@ permalink: powered_by.html toc: false ---

[GitHub] [incubator-hudi] yihua commented on a change in pull request #901: [HUDI-255] Translate Talks & Powered By page

yihua commented on a change in pull request #901: [HUDI-255] Translate Talks & Powered By page URL: https://github.com/apache/incubator-hudi/pull/901#discussion_r327901703 ## File path: docs/powered_by.cn.md ## @@ -6,28 +6,27 @@ permalink: powered_by.html toc: false ---

[jira] [Comment Edited] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937302#comment-16937302 ] Xing Pan edited comment on HUDI-269 at 9/25/19 1:05 AM: [~vbalaji] [~vinoth]  I

[jira] [Updated] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Pan updated HUDI-269: -- Attachment: (was: request_histogram.png) > Provide ability to throttle DeltaStreamer sync runs >

[jira] [Commented] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937302#comment-16937302 ] Xing Pan commented on HUDI-269: --- [~vbalaji] [~vinoth]  I just did some simple test on these configs.

[jira] [Commented] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937296#comment-16937296 ] Xing Pan commented on HUDI-269: --- !image-2019-09-25-08-51-19-686.png! > Provide ability to throttle

[jira] [Updated] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Pan updated HUDI-269: -- Attachment: image-2019-09-25-08-51-19-686.png > Provide ability to throttle DeltaStreamer sync runs >

[jira] [Updated] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xing Pan updated HUDI-269: -- Attachment: request_histogram.png > Provide ability to throttle DeltaStreamer sync runs >

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327884211 ## File path: pom.xml ## @@ -174,31 +174,6 @@ - -

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327884376 ## File path: pom.xml ## @@ -394,18 +369,18 @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327884558 ## File path: release/scripts/generate_notice.sh ## @@ -0,0 +1,36 @@ +#!/usr/bin/env bash

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327884674 ## File path: release/scripts/validate_staged_release.sh ## @@ -0,0 +1,125 @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327885178 ## File path: packaging/hudi-timeline-server-bundle/run_server.sh ## @@ -19,13 +19,35 @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327884124 ## File path: release/scripts/preparation_before_release.sh ## @@ -22,9 +22,9 @@ set -e

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting

vinothchandar commented on a change in pull request #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#discussion_r327884106 ## File path: release/scripts/preparation_before_release.sh ## @@ -22,9 +22,9 @@ set -e

[GitHub] [incubator-hudi] bvaradar commented on issue #918: [HUDI-121] : Address comments during RC2 voting

bvaradar commented on issue #918: [HUDI-121] : Address comments during RC2 voting URL: https://github.com/apache/incubator-hudi/pull/918#issuecomment-534786793 @vinothchandar : Updated. Please review when you get a chance

[GitHub] [incubator-hudi] umehrot2 commented on issue #915: [HUDI-268] Shade and relocate Avro dependency in hadoop-mr-bundle

umehrot2 commented on issue #915: [HUDI-268] Shade and relocate Avro dependency in hadoop-mr-bundle URL: https://github.com/apache/incubator-hudi/pull/915#issuecomment-534693879 @vinothchandar @bvaradar Thank you for providing the steps and implications of this change. I think on our

[jira] [Created] (HUDI-272) Move Prestodb Hudi integration to org.apache.hudi 's inputformat

Bhavani Sudha Saktheeswaran created HUDI-272: Summary: Move Prestodb Hudi integration to org.apache.hudi 's inputformat Key: HUDI-272 URL: https://issues.apache.org/jira/browse/HUDI-272

[GitHub] [incubator-hudi] vinothchandar commented on issue #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer

vinothchandar commented on issue #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/917#issuecomment-534684983 >So here is the kind of algorithm that I think of implementing steps 1 & 2 sound good to me. >>but

[GitHub] [incubator-hudi] jaimin-shah commented on a change in pull request #862: Add support for composite key

jaimin-shah commented on a change in pull request #862: Add support for composite key URL: https://github.com/apache/incubator-hudi/pull/862#discussion_r327747014 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/keygen/TimestampBasedKeyGenerator.java

[GitHub] [incubator-hudi] jaimin-shah commented on a change in pull request #862: Add support for composite key

jaimin-shah commented on a change in pull request #862: Add support for composite key URL: https://github.com/apache/incubator-hudi/pull/862#discussion_r327747014 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/keygen/TimestampBasedKeyGenerator.java

[jira] [Created] (HUDI-271) Simplify quickstart documentation

Bhavani Sudha Saktheeswaran created HUDI-271: Summary: Simplify quickstart documentation Key: HUDI-271 URL: https://issues.apache.org/jira/browse/HUDI-271 Project: Apache Hudi (incubating)

[jira] [Updated] (HUDI-219) Tabify hudi docker demo page

[ https://issues.apache.org/jira/browse/HUDI-219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavani Sudha Saktheeswaran updated HUDI-219: - Parent: HUDI-270 Issue Type: Sub-task (was: Improvement) > Tabify

[jira] [Created] (HUDI-270) Improve Hudi website documentation

Bhavani Sudha Saktheeswaran created HUDI-270: Summary: Improve Hudi website documentation Key: HUDI-270 URL: https://issues.apache.org/jira/browse/HUDI-270 Project: Apache Hudi

[GitHub] [incubator-hudi] afilipchik commented on a change in pull request #862: Add support for composite key

afilipchik commented on a change in pull request #862: Add support for composite key URL: https://github.com/apache/incubator-hudi/pull/862#discussion_r327735139 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/keygen/TimestampBasedKeyGenerator.java ##

[GitHub] [incubator-hudi] taherk77 commented on issue #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer

taherk77 commented on issue #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/917#issuecomment-534626027 > this can be implemented by passing `--checkpoint null` or `--full-load` flag? This is actually a general issue

[jira] [Commented] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936933#comment-16936933 ] BALAJI VARADARAJAN commented on HUDI-269: - Agree. [~XingXPan] : You should try the embedded

[GitHub] [incubator-hudi] taherk77 commented on a change in pull request #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer

taherk77 commented on a change in pull request #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/917#discussion_r327689045 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer

vinothchandar commented on a change in pull request #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/917#discussion_r327655605 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on issue #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer

vinothchandar commented on issue #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/917#issuecomment-534588368 That seems like a flaky test? ``` Failed tests:

[GitHub] [incubator-hudi] vinothchandar commented on issue #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer

vinothchandar commented on issue #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/917#issuecomment-534587329 >The other option is that when we set is_incremental as false then we pull all the data at once and then write

[GitHub] [incubator-hudi] vinothchandar edited a comment on issue #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer

vinothchandar edited a comment on issue #917: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/917#issuecomment-534587329 >The other option is that when we set is_incremental as false then we pull all the data at once and then

[GitHub] [incubator-hudi] vinothchandar commented on issue #915: [HUDI-268] Shade and relocate Avro dependency in hadoop-mr-bundle

vinothchandar commented on issue #915: [HUDI-268] Shade and relocate Avro dependency in hadoop-mr-bundle URL: https://github.com/apache/incubator-hudi/pull/915#issuecomment-534584283 @umehrot2 I am not sure if you want to spend a lot of time reproducing this. May be I can summarize the

[jira] [Commented] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936830#comment-16936830 ] Vinoth Chandar commented on HUDI-269: - I am thinking if [~XingXPan] can try this out and confirm. we

[jira] [Commented] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936827#comment-16936827 ] Vinoth Chandar commented on HUDI-269: - [~XingXPan] can you try turning on the embedded timeline service

[GitHub] [incubator-hudi] vinothchandar closed issue #922: too many s3 requests using emr

vinothchandar closed issue #922: too many s3 requests using emr URL: https://github.com/apache/incubator-hudi/issues/922 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [incubator-hudi] vinothchandar commented on issue #922: too many s3 requests using emr

vinothchandar commented on issue #922: too many s3 requests using emr URL: https://github.com/apache/incubator-hudi/issues/922#issuecomment-534572136 Closing this in favor of JIRA This is an automated message from the Apache

[GitHub] [incubator-hudi] bvaradar commented on issue #915: [HUDI-268] Shade and relocate Avro dependency in hadoop-mr-bundle

bvaradar commented on issue #915: [HUDI-268] Shade and relocate Avro dependency in hadoop-mr-bundle URL: https://github.com/apache/incubator-hudi/pull/915#issuecomment-534552878 @umehrot2 : Unfortunately, the examples that I mentioned is not in the open source world. If you want

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #862: Add support for composite key

bvaradar commented on a change in pull request #862: Add support for composite key URL: https://github.com/apache/incubator-hudi/pull/862#discussion_r327588386 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/keygen/TimestampBasedKeyGenerator.java ##

[jira] [Updated] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-269: Labels: pull-request-available (was: ) > Provide ability to throttle DeltaStreamer sync runs >

[GitHub] [incubator-hudi] bvaradar merged pull request #921: [HUDI-269] Limit sync frequency

bvaradar merged pull request #921: [HUDI-269] Limit sync frequency URL: https://github.com/apache/incubator-hudi/pull/921 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[incubator-hudi] branch master updated: [HUDI-269] Limit sync frequency (#921)

This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new bf05f95 [HUDI-269] Limit sync

[GitHub] [incubator-hudi] bvaradar commented on issue #921: [HUDI-269] Limit sync frequency

bvaradar commented on issue #921: [HUDI-269] Limit sync frequency URL: https://github.com/apache/incubator-hudi/pull/921#issuecomment-534533775 @Panxing4game : I will do the squash and merge option to merge this PR. FYI: Only committers have push requests

[jira] [Assigned] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN reassigned HUDI-269: --- Assignee: Xing Pan (was: BALAJI VARADARAJAN) > Provide ability to throttle

[GitHub] [incubator-hudi] bvaradar commented on issue #922: too many s3 requests using emr

bvaradar commented on issue #922: too many s3 requests using emr URL: https://github.com/apache/incubator-hudi/issues/922#issuecomment-534531194 @Panxing4game : Great. Assigned you the ticket. This is an automated message

[jira] [Assigned] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN reassigned HUDI-269: --- Assignee: BALAJI VARADARAJAN > Provide ability to throttle DeltaStreamer sync runs >

[jira] [Commented] (HUDI-233) Redo log statements using SLF4J

[ https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936670#comment-16936670 ] leesf commented on HUDI-233: Could I start the progress? For simplicity, I woluld like create an umbrella

[GitHub] [incubator-hudi] jainnidhi703 commented on issue #143: Tracking ticket for folks to be added to slack group

jainnidhi703 commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-534507216 Hi @vinothchandar, Please add jainnidhi...@gmail.com.

[GitHub] [incubator-hudi] umehrot2 commented on issue #915: [HUDI-268] Shade and relocate Avro dependency in hadoop-mr-bundle

umehrot2 commented on issue #915: [HUDI-268] Shade and relocate Avro dependency in hadoop-mr-bundle URL: https://github.com/apache/incubator-hudi/pull/915#issuecomment-534490805 @bvaradar @vinothchandar I can make changes to create another jar `hudi-hadoop-mr-bundle-with-avro-shaded`

[jira] [Closed] (HUDI-220) Translate root index page

[ https://issues.apache.org/jira/browse/HUDI-220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-220. -- Resolution: Fixed Fixed via asf-site: f92566d2bf75077b4b1a7d9004ddb025122c2141 > Translate root index page >

[GitHub] [incubator-hudi] Panxing4game edited a comment on issue #921: [HUDI-269] Limit sync frequency

Panxing4game edited a comment on issue #921: [HUDI-269] Limit sync frequency URL: https://github.com/apache/incubator-hudi/pull/921#issuecomment-53035 @bvaradar thanks for your comments, updated pr. and I think I can use "squash and merge" option to auto squash and control message

[GitHub] [incubator-hudi] jaimin-shah commented on a change in pull request #862: Add support for composite key

jaimin-shah commented on a change in pull request #862: Add support for composite key URL: https://github.com/apache/incubator-hudi/pull/862#discussion_r327502159 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/keygen/TimestampBasedKeyGenerator.java

[jira] [Comment Edited] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936542#comment-16936542 ] Xing Pan edited comment on HUDI-269 at 9/24/19 8:27 AM: just updated pull request

[jira] [Commented] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936542#comment-16936542 ] Xing Pan commented on HUDI-269: --- just update pull request > Provide ability to throttle DeltaStreamer sync

[GitHub] [incubator-hudi] Panxing4game commented on issue #921: [MINOR] Limit sync frequency

Panxing4game commented on issue #921: [MINOR] Limit sync frequency URL: https://github.com/apache/incubator-hudi/pull/921#issuecomment-53035 @bvaradar thanks for your comments, updated and squashed commit. This is an

[GitHub] [incubator-hudi] Panxing4game commented on issue #922: too many s3 requests using emr

Panxing4game commented on issue #922: too many s3 requests using emr URL: https://github.com/apache/incubator-hudi/issues/922#issuecomment-534439640 @bvaradar ic, my jira id is `XingXPan` This is an automated message from

[jira] [Updated] (HUDI-247) Unify the initialization of HoodieTableMetaClient in test for hoodie-client module

[ https://issues.apache.org/jira/browse/HUDI-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-247: Labels: pull-request-available (was: ) > Unify the initialization of HoodieTableMetaClient in test

[GitHub] [incubator-hudi] yanghua opened a new pull request #923: HUDI-247 Unify the initialization of HoodieTableMetaClient in test for hoodie-client module

yanghua opened a new pull request #923: HUDI-247 Unify the initialization of HoodieTableMetaClient in test for hoodie-client module URL: https://github.com/apache/incubator-hudi/pull/923 jira ref: https://issues.apache.org/jira/browse/HUDI-247