Build failed in Jenkins: hudi-snapshot-deployment-0.5 #273

2020-05-09 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.40 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml

[GitHub] [incubator-hudi] codecov-io edited a comment on pull request #1611: [HUDI-705]Add unit test for RollbacksCommand

2020-05-09 Thread GitBox
codecov-io edited a comment on pull request #1611: URL: https://github.com/apache/incubator-hudi/pull/1611#issuecomment-626265705 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1611?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] codecov-io commented on pull request #1611: [HUDI-705]Add unit test for RollbacksCommand

2020-05-09 Thread GitBox
codecov-io commented on pull request #1611: URL: https://github.com/apache/incubator-hudi/pull/1611#issuecomment-626265705 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1611?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] hddong commented on pull request #1574: [HUDI-701]Add unit test for HDFSParquetImportCommand

2020-05-09 Thread GitBox
hddong commented on pull request #1574: URL: https://github.com/apache/incubator-hudi/pull/1574#issuecomment-626263014 @yanghua : It's OK now. This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (HUDI-705) Add unit test for RollbacksCommand

2020-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-705: Labels: pull-request-available (was: ) > Add unit test for RollbacksCommand >

[GitHub] [incubator-hudi] hddong opened a new pull request #1611: [HUDI-705]Add unit test for RollbacksCommand

2020-05-09 Thread GitBox
hddong opened a new pull request #1611: URL: https://github.com/apache/incubator-hudi/pull/1611 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose

[GitHub] [incubator-hudi] lamber-ken edited a comment on pull request #1537: [HUDI-817] fixed building IndexFileFilter with a wrong condition in Hood…

2020-05-09 Thread GitBox
lamber-ken edited a comment on pull request #1537: URL: https://github.com/apache/incubator-hudi/pull/1537#issuecomment-626259879 Nice catch @Jecarm  This is an automated message from the Apache Git Service. To respond to

[incubator-hudi] branch master updated: [MINOR] fixed building IndexFileFilter with a wrong condition in HoodieGlobalBloomIndex class (#1537)

2020-05-09 Thread lamberken
This is an automated email from the ASF dual-hosted git repository. lamberken pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new fa6aba7 [MINOR] fixed building

[GitHub] [incubator-hudi] lamber-ken commented on pull request #1537: [HUDI-817] fixed building IndexFileFilter with a wrong condition in Hood…

2020-05-09 Thread GitBox
lamber-ken commented on pull request #1537: URL: https://github.com/apache/incubator-hudi/pull/1537#issuecomment-626259879 Nice cathc @Jecarm  This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] nandini57 commented on issue #1582: [SUPPORT] PreCombineAndUpdate in Payload

2020-05-09 Thread GitBox
nandini57 commented on issue #1582: URL: https://github.com/apache/incubator-hudi/issues/1582#issuecomment-626254046 Can i get a list of open issues with incremental query option to be aware if anything can hit my job? You can close this otherwise.Thanks in advance

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1572: [HUDI-836] Implement datadog metrics reporter

2020-05-09 Thread GitBox
xushiyan commented on a change in pull request #1572: URL: https://github.com/apache/incubator-hudi/pull/1572#discussion_r422528107 ## File path: hudi-client/src/test/java/org/apache/hudi/metrics/datadog/TestDatadogHttpClient.java ## @@ -0,0 +1,152 @@ +/* + * Licensed to the

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1572: [HUDI-836] Implement datadog metrics reporter

2020-05-09 Thread GitBox
xushiyan commented on a change in pull request #1572: URL: https://github.com/apache/incubator-hudi/pull/1572#discussion_r422527119 ## File path: pom.xml ## @@ -245,6 +245,7 @@ ${maven-surefire-plugin.version} ${skipUTs} + -Xms256m -Xmx2g

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1572: [HUDI-836] Implement datadog metrics reporter

2020-05-09 Thread GitBox
xushiyan commented on a change in pull request #1572: URL: https://github.com/apache/incubator-hudi/pull/1572#discussion_r422526952 ## File path: hudi-client/src/main/java/org/apache/hudi/metrics/datadog/DatadogMetricsReporter.java ## @@ -0,0 +1,90 @@ +/* + * Licensed to the

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1572: [HUDI-836] Implement datadog metrics reporter

2020-05-09 Thread GitBox
xushiyan commented on a change in pull request #1572: URL: https://github.com/apache/incubator-hudi/pull/1572#discussion_r422526655 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieMetricsConfig.java ## @@ -92,28 +103,63 @@ public Builder

[GitHub] [incubator-hudi] xushiyan commented on pull request #1607: [HUDI-811] Restructure packages

2020-05-09 Thread GitBox
xushiyan commented on pull request #1607: URL: https://github.com/apache/incubator-hudi/pull/1607#issuecomment-626212331 @yanghua this is ready for review. thank you. To note a few - `hudi-spark/src/test/java/HoodieJavaApp.java` and

[GitHub] [incubator-hudi] lamber-ken commented on issue #1610: [SUPPORT] docker demo avro version error

2020-05-09 Thread GitBox
lamber-ken commented on issue #1610: URL: https://github.com/apache/incubator-hudi/issues/1610#issuecomment-626204493 Thanks for reporting this issue, will check it. This is an automated message from the Apache Git Service.

[GitHub] [incubator-hudi] lamber-ken removed a comment on pull request #1469: [HUDI-686] Implement BloomIndexV2 that does not depend on memory caching

2020-05-09 Thread GitBox
lamber-ken removed a comment on pull request #1469: URL: https://github.com/apache/incubator-hudi/pull/1469#issuecomment-622469297 Hi @vinothchandar @nsivabalan thanks for you review, all review comments are addressed. ### SYNC | task | status | | | |

[GitHub] [incubator-hudi] lamber-ken commented on pull request #1469: [HUDI-686] Implement BloomIndexV2 that does not depend on memory caching

2020-05-09 Thread GitBox
lamber-ken commented on pull request #1469: URL: https://github.com/apache/incubator-hudi/pull/1469#issuecomment-626196481 Hi @vinothchandar @nsivabalan thanks for you review, all review comments are addressed. ### SYNC | task | status | | | | | fix

[GitHub] [incubator-hudi] lamber-ken edited a comment on pull request #1469: [HUDI-686] Implement BloomIndexV2 that does not depend on memory caching

2020-05-09 Thread GitBox
lamber-ken edited a comment on pull request #1469: URL: https://github.com/apache/incubator-hudi/pull/1469#issuecomment-626196481 Hi @vinothchandar @nsivabalan thanks for you review, all review comments are addressed. ### SYNC | task | status | | | | |

[GitHub] [incubator-hudi] lamber-ken edited a comment on pull request #1469: [HUDI-686] Implement BloomIndexV2 that does not depend on memory caching

2020-05-09 Thread GitBox
lamber-ken edited a comment on pull request #1469: URL: https://github.com/apache/incubator-hudi/pull/1469#issuecomment-622469297 Hi @vinothchandar @nsivabalan thanks for you review, all review comments are addressed. ### SYNC | task | status | | | | |

[jira] [Closed] (HUDI-787) Implement HoodieGlobalBloomIndexV2

2020-05-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken closed HUDI-787. --- Resolution: Fixed Finished [https://github.com/apache/incubator-hudi/pull/1469] > Implement

[GitHub] [incubator-hudi] lamber-ken edited a comment on pull request #1469: [HUDI-686] Implement BloomIndexV2 that does not depend on memory caching

2020-05-09 Thread GitBox
lamber-ken edited a comment on pull request #1469: URL: https://github.com/apache/incubator-hudi/pull/1469#issuecomment-622469297 Hi @vinothchandar @nsivabalan thanks for you review, all review comments are addressed. ### SYNC | task | status | | | | |

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1469: [HUDI-686] Implement BloomIndexV2 that does not depend on memory caching

2020-05-09 Thread GitBox
lamber-ken commented on a change in pull request #1469: URL: https://github.com/apache/incubator-hudi/pull/1469#discussion_r422503821 ## File path: hudi-client/src/main/java/org/apache/hudi/index/bloom/HoodieBloomIndexV2.java ## @@ -0,0 +1,321 @@ +/* + * Licensed to the

[jira] [Comment Edited] (HUDI-866) Some classes that rely on JavaSparkContext to obtain Configuration can make them Spark-free.

2020-05-09 Thread Hong Shen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103195#comment-17103195 ] Hong Shen edited comment on HUDI-866 at 5/9/20, 2:38 PM: - I sorted out the classes

[GitHub] [incubator-hudi] shenh062326 commented on pull request #1609: [HUDI-870] Remove spark context in ClientUtils and HoodieIndex

2020-05-09 Thread GitBox
shenh062326 commented on pull request #1609: URL: https://github.com/apache/incubator-hudi/pull/1609#issuecomment-626185655 @yanghua @vinothchandar @leesf This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-hudi] lamber-ken edited a comment on pull request #1469: [HUDI-686] Implement BloomIndexV2 that does not depend on memory caching

2020-05-09 Thread GitBox
lamber-ken edited a comment on pull request #1469: URL: https://github.com/apache/incubator-hudi/pull/1469#issuecomment-622469297 Hi @vinothchandar @nsivabalan thanks for you review, all review comments are addressed. ### SYNC | task | status | | | | |

[GitHub] [incubator-hudi] tooptoop4 edited a comment on issue #836: Query hang for Presto running on JDK 11

2020-05-09 Thread GitBox
tooptoop4 edited a comment on issue #836: URL: https://github.com/apache/incubator-hudi/issues/836#issuecomment-625480332 just posting this in case anyone else hits this. i had hive (v 2.3.4) tables using 'com.uber.hoodie.hadoop.HoodieInputFormat' and COW hoodie files (written by spark

[jira] [Commented] (HUDI-866) Some classes that rely on JavaSparkContext to obtain Configuration can make them Spark-free.

2020-05-09 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103242#comment-17103242 ] vinoyang commented on HUDI-866: --- [~shenhong] Thanks for sorting them. I will check it. > Some classes that

[GitHub] [incubator-hudi] i4late opened a new issue #1610: [SUPPORT] docker demo avro version error

2020-05-09 Thread GitBox
i4late opened a new issue #1610: URL: https://github.com/apache/incubator-hudi/issues/1610 when running /var/hoodie/ws/hudi-hive-sync/run_sync_tool.sh \ --jdbc-url jdbc:hive2://hiveserver:1 \ --user hive \ --pass hive \ --partitioned-by dt \ --base-path

[jira] [Updated] (HUDI-870) Remove spark context in ClientUtils and HoodieIndex

2020-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-870: Labels: pull-request-available (was: ) > Remove spark context in ClientUtils and HoodieIndex >

[GitHub] [incubator-hudi] shenh062326 opened a new pull request #1609: [HUDI-870] Remove spark context in ClientUtils and HoodieIndex

2020-05-09 Thread GitBox
shenh062326 opened a new pull request #1609: URL: https://github.com/apache/incubator-hudi/pull/1609 # What is the purpose of the pull request Sub task of HUDI-538 Restructuring hudi client module for multi engine support ## Brief change log Remove spark context in

[jira] [Comment Edited] (HUDI-866) Some classes that rely on JavaSparkContext to obtain Configuration can make them Spark-free.

2020-05-09 Thread Hong Shen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103195#comment-17103195 ] Hong Shen edited comment on HUDI-866 at 5/9/20, 8:36 AM: - I sorted out the classes

[jira] [Assigned] (HUDI-870) Remove spark context in ClientUtils and HoodieIndex

2020-05-09 Thread Hong Shen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen reassigned HUDI-870: -- Assignee: Hong Shen > Remove spark context in ClientUtils and HoodieIndex >

[jira] [Updated] (HUDI-870) Remove spark context in ClientUtils and HoodieIndex

2020-05-09 Thread Hong Shen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated HUDI-870: --- Summary: Remove spark context in ClientUtils and HoodieIndex (was: Replace spark context directly with hadoop

[jira] [Comment Edited] (HUDI-866) Some classes that rely on JavaSparkContext to obtain Configuration can make them Spark-free.

2020-05-09 Thread Hong Shen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103195#comment-17103195 ] Hong Shen edited comment on HUDI-866 at 5/9/20, 8:27 AM: - I sorted out the classes

[GitHub] [incubator-hudi] UZi5136225 edited a comment on pull request #1608: [HUDI-869] Add support for alluxio

2020-05-09 Thread GitBox
UZi5136225 edited a comment on pull request #1608: URL: https://github.com/apache/incubator-hudi/pull/1608#issuecomment-626128173 hi @yanghua, could you please take a look This is an automated message from the Apache Git

[jira] [Created] (HUDI-870) Replace spark context directly with hadoop configuration in ClientUtils and HoodieTimelineArchiveLog

2020-05-09 Thread Hong Shen (Jira)
Hong Shen created HUDI-870: -- Summary: Replace spark context directly with hadoop configuration in ClientUtils and HoodieTimelineArchiveLog Key: HUDI-870 URL: https://issues.apache.org/jira/browse/HUDI-870

[GitHub] [incubator-hudi] UZi5136225 commented on pull request #1608: [HUDI-869] Add support for alluxio

2020-05-09 Thread GitBox
UZi5136225 commented on pull request #1608: URL: https://github.com/apache/incubator-hudi/pull/1608#issuecomment-626128173 @yanghua This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Commented] (HUDI-866) Some classes that rely on JavaSparkContext to obtain Configuration can make them Spark-free.

2020-05-09 Thread Hong Shen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103195#comment-17103195 ] Hong Shen commented on HUDI-866: I sorted out the classes in hudi-client that can replace spark context

[GitHub] [incubator-hudi] UZi5136225 opened a new pull request #1608: [HUDI-869] Add support for alluxio

2020-05-09 Thread GitBox
UZi5136225 opened a new pull request #1608: URL: https://github.com/apache/incubator-hudi/pull/1608 ## What is the purpose of the pull request Add support for alluxio ## Brief change log Modify StorageSchemes add support for alluxio ## Committer checklist

[jira] [Updated] (HUDI-869) Add support for alluxio

2020-05-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-869: Labels: pull-request-available (was: ) > Add support for alluxio > > >

[jira] [Updated] (HUDI-561) hudi partition path config

2020-05-09 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-561: --- Status: Open (was: New) > hudi partition path config > -- > > Key:

[jira] [Updated] (HUDI-507) Support \ t split hdfs source

2020-05-09 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-507: --- Status: Open (was: New) > Support \ t split hdfs source > - > >

[jira] [Closed] (HUDI-561) hudi partition path config

2020-05-09 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui closed HUDI-561. -- Resolution: Duplicate > hudi partition path config > -- > > Key:

[jira] [Closed] (HUDI-507) Support \ t split hdfs source

2020-05-09 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui closed HUDI-507. -- Resolution: Duplicate > Support \ t split hdfs source > - > > Key: