[GitHub] [incubator-hudi] dengziming commented on issue #1151: Hudi-476: Add hudi-examples module

dengziming commented on issue #1151: Hudi-476: Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#issuecomment-569474270 @leesf Hi, PTAL. This is an automated message from the Apache Git Service.

[jira] [Commented] (HUDI-475) Add hudi-examples module and move example codes to it and also add some necessary codes

[ https://issues.apache.org/jira/browse/HUDI-475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004628#comment-17004628 ] dengziming commented on HUDI-475: - I will split it into small issues to be convenient to do code review >

[GitHub] [incubator-hudi] yanghua commented on issue #1151: [HUDI-476] Add hudi-examples module

yanghua commented on issue #1151: [HUDI-476] Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151#issuecomment-569479377 Hi @dengziming Thanks for your contribution! It would be better to follow the [new contribution

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #143

See Changes: -- [...truncated 2.18 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

bvaradar commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r352920319 ## File path: hudi-client/src/test/java/org/apache/hudi/common/HoodieTestDataGenerator.java

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

bvaradar commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r361825095 ## File path: hudi-client/src/test/java/org/apache/hudi/common/HoodieTestDataGenerator.java

[GitHub] [incubator-hudi] lamber-ken commented on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table

lamber-ken commented on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table URL: https://github.com/apache/incubator-hudi/pull/1128#issuecomment-569474638 > @lamber-ken : there is a bug in HoodieActiveTimeline.saveToCleanRequested(). It was

[jira] [Assigned] (HUDI-417) Refactor HoodieWriteClient so that commit logic can be shareable by both bootstrap and normal write operations

[ https://issues.apache.org/jira/browse/HUDI-417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan reassigned HUDI-417: --- Assignee: Balaji Varadarajan > Refactor HoodieWriteClient so that commit logic can be

[jira] [Commented] (HUDI-242) Support Efficient bootstrap of large parquet datasets to Hudi

[ https://issues.apache.org/jira/browse/HUDI-242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004625#comment-17004625 ] Balaji Varadarajan commented on HUDI-242: - sure [~Pratyaksh],  Does any of the unassigned tasks

[jira] [Commented] (HUDI-417) Refactor HoodieWriteClient so that commit logic can be shareable by both bootstrap and normal write operations

[ https://issues.apache.org/jira/browse/HUDI-417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004624#comment-17004624 ] Balaji Varadarajan commented on HUDI-417: - [~nicholasjiang]: Sorry, I didnt get a chance to respond

[jira] [Created] (HUDI-475) Add hudi-examples module and move example codes to it and also add some necessary codes

dengziming created HUDI-475: --- Summary: Add hudi-examples module and move example codes to it and also add some necessary codes Key: HUDI-475 URL: https://issues.apache.org/jira/browse/HUDI-475 Project:

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table

lamber-ken edited a comment on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table URL: https://github.com/apache/incubator-hudi/pull/1128#issuecomment-569474638 > @lamber-ken : there is a bug in HoodieActiveTimeline.saveToCleanRequested().

[GitHub] [incubator-hudi] bvaradar commented on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table

bvaradar commented on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table URL: https://github.com/apache/incubator-hudi/pull/1128#issuecomment-569469565 @lamber-ken : there is a bug in HoodieActiveTimeline.saveToCleanRequested(). It was

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table

lamber-ken edited a comment on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table URL: https://github.com/apache/incubator-hudi/pull/1128#issuecomment-569474638 > @lamber-ken : there is a bug in HoodieActiveTimeline.saveToCleanRequested().

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table

lamber-ken edited a comment on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table URL: https://github.com/apache/incubator-hudi/pull/1128#issuecomment-569474638 > @lamber-ken : there is a bug in HoodieActiveTimeline.saveToCleanRequested().

[jira] [Created] (HUDI-476) Add a hudi-examples module

dengziming created HUDI-476: --- Summary: Add a hudi-examples module Key: HUDI-476 URL: https://issues.apache.org/jira/browse/HUDI-476 Project: Apache Hudi (incubating) Issue Type: Sub-task

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1120: [HUDI-440] Rework the hudi web site

yanghua commented on a change in pull request #1120: [HUDI-440] Rework the hudi web site URL: https://github.com/apache/incubator-hudi/pull/1120#discussion_r361825874 ## File path: newui/docs/_docs/1_4_powered_by.md ## @@ -0,0 +1,63 @@ +--- +title: "Talks & Powered By"

[jira] [Created] (HUDI-477) Add HoodieClient Example code to hudi-examples

dengziming created HUDI-477: --- Summary: Add HoodieClient Example code to hudi-examples Key: HUDI-477 URL: https://issues.apache.org/jira/browse/HUDI-477 Project: Apache Hudi (incubating) Issue

[GitHub] [incubator-hudi] wangxianghu commented on issue #1148: [MINOR] Update the java doc of HoodieTableType

wangxianghu commented on issue #1148: [MINOR] Update the java doc of HoodieTableType URL: https://github.com/apache/incubator-hudi/pull/1148#issuecomment-569470817 ok, thinks This is an automated message from the Apache Git

[GitHub] [incubator-hudi] dengziming opened a new pull request #1151: Hudi-476: Add hudi-examples module

dengziming opened a new pull request #1151: Hudi-476: Add hudi-examples module URL: https://github.com/apache/incubator-hudi/pull/1151 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull

[jira] [Created] (HUDI-478) build_local_docker_images.sh

zhangpu created HUDI-478: Summary: build_local_docker_images.sh Key: HUDI-478 URL: https://issues.apache.org/jira/browse/HUDI-478 Project: Apache Hudi (incubating) Issue Type: Bug

[jira] [Commented] (HUDI-446) Refactor the codes based on scala codestyle PublicMethodsHaveTypeChecker rule

[ https://issues.apache.org/jira/browse/HUDI-446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004524#comment-17004524 ] lamber-ken commented on HUDI-446: - hi [~soundhearer], because of the checkstyle rules are under

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file

pratyakshsharma commented on issue #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file URL: https://github.com/apache/incubator-hudi/pull/1075#issuecomment-569436705 @cdmikechen Good catch! Have taken care of it now.

[jira] [Updated] (HUDI-402) Code clean up in DataSourceUtils class

[ https://issues.apache.org/jira/browse/HUDI-402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-402: -- Fix Version/s: 0.5.1 > Code clean up in DataSourceUtils class >

[jira] [Updated] (HUDI-406) Introduce Default partition path in TimestampBasedKeyGenerator

[ https://issues.apache.org/jira/browse/HUDI-406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-406: -- Fix Version/s: 0.5.1 > Introduce Default partition path in TimestampBasedKeyGenerator >

[jira] [Updated] (HUDI-114) Allow for clients to overwrite the payload implementation in hoodie.properties

[ https://issues.apache.org/jira/browse/HUDI-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-114: -- Fix Version/s: 0.5.1 > Allow for clients to overwrite the payload implementation in

[jira] [Updated] (HUDI-118) Hudi CLI : Provide options for passing properties to Compactor, Cleaner and ParquetImporter

[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-118: -- Fix Version/s: 0.5.1 > Hudi CLI : Provide options for passing properties to Compactor, Cleaner

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file

pratyakshsharma commented on a change in pull request #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file URL: https://github.com/apache/incubator-hudi/pull/1075#discussion_r361804460 ## File path:

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file

pratyakshsharma commented on issue #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file URL: https://github.com/apache/incubator-hudi/pull/1075#issuecomment-569434731 @n3nash Done with the changes.

[jira] [Assigned] (HUDI-310) DynamoDB/Kinesis Change Capture using Delta Streamer

[ https://issues.apache.org/jira/browse/HUDI-310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suneel Marthi reassigned HUDI-310: -- Assignee: Suneel Marthi > DynamoDB/Kinesis Change Capture using Delta Streamer >

[jira] [Commented] (HUDI-242) Support Efficient bootstrap of large parquet datasets to Hudi

[ https://issues.apache.org/jira/browse/HUDI-242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004552#comment-17004552 ] Pratyaksh Sharma commented on HUDI-242: --- Hi [~vbalaji], I would like to work with you on this. Please

[GitHub] [incubator-hudi] XuQianJin-Stars commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter

XuQianJin-Stars commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#discussion_r361799570 ## File path: hudi-client/src/main/java/org/apache/hudi/metrics/JmxMetricsReporter.java ##

[GitHub] [incubator-hudi] pratyakshsharma edited a comment on issue #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands

pratyakshsharma edited a comment on issue #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands URL: https://github.com/apache/incubator-hudi/pull/1080#issuecomment-569427142 @n3nash Sorry for the delay. Actually I was busy with HUDI-288.

[GitHub] [incubator-hudi] XuQianJin-Stars commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter

XuQianJin-Stars commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#discussion_r361799570 ## File path: hudi-client/src/main/java/org/apache/hudi/metrics/JmxMetricsReporter.java ##

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands

pratyakshsharma commented on a change in pull request #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands URL: https://github.com/apache/incubator-hudi/pull/1080#discussion_r361802264 ## File path:

[jira] [Created] (HUDI-473) QuickstartUtils

zhangpu created HUDI-473: Summary: QuickstartUtils Key: HUDI-473 URL: https://issues.apache.org/jira/browse/HUDI-473 Project: Apache Hudi (incubating) Issue Type: Improvement Components:

[GitHub] [incubator-hudi] wojustme closed pull request #1104: [HUDI-404] fix the error of compiling project.

wojustme closed pull request #1104: [HUDI-404] fix the error of compiling project. URL: https://github.com/apache/incubator-hudi/pull/1104 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] wojustme commented on issue #1104: [HUDI-404] fix the error of compiling project.

wojustme commented on issue #1104: [HUDI-404] fix the error of compiling project. URL: https://github.com/apache/incubator-hudi/pull/1104#issuecomment-569418057 @lamber-ken @leesf Sorry for replying later. I try again, maybe I set error config in 'setting.xml'. THX.

[jira] [Updated] (HUDI-322) DeltaSteamer should pick checkpoints off only deltacommits for MOR tables

[ https://issues.apache.org/jira/browse/HUDI-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shahida Khan updated HUDI-322: -- Component/s: newbie > DeltaSteamer should pick checkpoints off only deltacommits for MOR tables >

[GitHub] [incubator-hudi] pratyakshsharma opened a new pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

pratyakshsharma opened a new pull request #1150: [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment URL: https://github.com/apache/incubator-hudi/pull/1150 This is an automated

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands

pratyakshsharma commented on issue #1080: [HUDI-118]: Options provided for passing properties to Cleaner, compactor and importer commands URL: https://github.com/apache/incubator-hudi/pull/1080#issuecomment-569427142 @n3nash Sorry for the delay. Actually I was busy with HUDI-288. Wanted to

[jira] [Created] (HUDI-474) Delta Streamer is not able to read the commit files

Shahida Khan created HUDI-474: - Summary: Delta Streamer is not able to read the commit files Key: HUDI-474 URL: https://issues.apache.org/jira/browse/HUDI-474 Project: Apache Hudi (incubating)

[jira] [Assigned] (HUDI-446) Refactor the codes based on scala codestyle PublicMethodsHaveTypeChecker rule

[ https://issues.apache.org/jira/browse/HUDI-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leping Huang reassigned HUDI-446: - Assignee: Leping Huang > Refactor the codes based on scala codestyle PublicMethodsHaveTypeChecker

[jira] [Commented] (HUDI-474) Delta Streamer is not able to read the commit files

[ https://issues.apache.org/jira/browse/HUDI-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17004569#comment-17004569 ] Balaji Varadarajan commented on HUDI-474: - [~srkhan]  As per your comment in the email thread - 

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table

lamber-ken edited a comment on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table URL: https://github.com/apache/incubator-hudi/pull/1128#issuecomment-569461408 Hi @bvaradar, I went through the process again. There are three kinds of empty

[GitHub] [incubator-hudi] lamber-ken commented on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table

lamber-ken commented on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table URL: https://github.com/apache/incubator-hudi/pull/1128#issuecomment-569461408 Hi @bvaradar, I went through the process again. There are three kinds of empty

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table

lamber-ken edited a comment on issue #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table URL: https://github.com/apache/incubator-hudi/pull/1128#issuecomment-569461408 Hi @bvaradar, I went through the process again. There are three kinds of empty

[GitHub] [incubator-hudi] lamber-ken commented on a change in pull request #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table

lamber-ken commented on a change in pull request #1128: [HUDI-453] Fix throw failed to archive commits error when writing data to MOR/COW table URL: https://github.com/apache/incubator-hudi/pull/1128#discussion_r361819871 ## File path:

[GitHub] [incubator-hudi] yanghua merged pull request #1148: [MINOR] Update the java doc of HoodieTableType

yanghua merged pull request #1148: [MINOR] Update the java doc of HoodieTableType URL: https://github.com/apache/incubator-hudi/pull/1148 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] yanghua commented on issue #1148: [MINOR] Update the java doc of HoodieTableType

yanghua commented on issue #1148: [MINOR] Update the java doc of HoodieTableType URL: https://github.com/apache/incubator-hudi/pull/1148#issuecomment-569466545 Two additional tips: 1. Always uppercase the first letter of the commit message(and the first letter of the title of the

[incubator-hudi] branch master updated: [MINOR] Update the java doc of HoodieTableType (#1148)

This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 01c25d6 [MINOR] Update the java doc