[GitHub] [incubator-hudi] bvaradar commented on issue #1062: [HUDI-294] Delete Paths written in Cleaner plan needs to be relative to partition-path

2019-12-03 Thread GitBox
bvaradar commented on issue #1062: [HUDI-294] Delete Paths written in Cleaner plan needs to be relative to partition-path URL: https://github.com/apache/incubator-hudi/pull/1062#issuecomment-561057985 > > Thanks @leesf : This is a good starting point. You would need to make further changes

[incubator-hudi] branch hudi_test_suite created (now afe00ff)

2019-12-03 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch hudi_test_suite in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. at afe00ff Hudi Test Suite - Flexible schema payload generation - Different types of wo

[GitHub] [incubator-hudi] arw357 commented on issue #812: KryoException: Unable to find class

2019-12-03 Thread GitBox
arw357 commented on issue #812: KryoException: Unable to find class URL: https://github.com/apache/incubator-hudi/issues/812#issuecomment-561074111 I tried it and it does not crash - so it's ok to be cloesd This is an automate

[GitHub] [incubator-hudi] yanghua commented on issue #1057: Hudi Test Suite

2019-12-03 Thread GitBox
yanghua commented on issue #1057: Hudi Test Suite URL: https://github.com/apache/incubator-hudi/pull/1057#issuecomment-561077900 I have pushed a new branch named `hudi_test_suite` and will keep this PR syncing with the branch. This PR used to discuss. If there is no objection, will d

[GitHub] [incubator-hudi] yanghua edited a comment on issue #1057: Hudi Test Suite

2019-12-03 Thread GitBox
yanghua edited a comment on issue #1057: Hudi Test Suite URL: https://github.com/apache/incubator-hudi/pull/1057#issuecomment-561077900 I have pushed a new branch named `hudi_test_suite` and will keep this PR syncing with the branch. This PR uses to discuss. If there is no objection,

[incubator-hudi] branch master updated (89f0968 -> 845e261)

2019-12-03 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 89f0968 [DOCS] Update the build source link (#1071) add 845e261 [MINOR] Update some urls from http t

[GitHub] [incubator-hudi] yanghua merged pull request #1074: [MINOR] Update some url from http to https in the README file

2019-12-03 Thread GitBox
yanghua merged pull request #1074: [MINOR] Update some url from http to https in the README file URL: https://github.com/apache/incubator-hudi/pull/1074 This is an automated message from the Apache Git Service. To respond to

[jira] [Updated] (HUDI-114) Allow for clients to overwrite the payload implementation in hoodie.properties

2019-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-114: Labels: pull-request-available (was: ) > Allow for clients to overwrite the payload implementation i

[GitHub] [incubator-hudi] pratyakshsharma opened a new pull request #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file

2019-12-03 Thread GitBox
pratyakshsharma opened a new pull request #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file URL: https://github.com/apache/incubator-hudi/pull/1075 Key changes - 1. Updated the default payload class to OverwriteWithLatestAvroPayload in Ho

[jira] [Commented] (HUDI-114) Allow for clients to overwrite the payload implementation in hoodie.properties

2019-12-03 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986775#comment-16986775 ] Pratyaksh Sharma commented on HUDI-114: --- [~nishith29] Raised a PR for code changes, w

[GitHub] [incubator-hudi] lamber-ken commented on issue #1066: [checkstyle] Add ConstantName java checkstyle rule

2019-12-03 Thread GitBox
lamber-ken commented on issue #1066: [checkstyle] Add ConstantName java checkstyle rule URL: https://github.com/apache/incubator-hudi/pull/1066#issuecomment-561112197 hi, @leesf help to review, thanks 😃 This is an automated

[GitHub] [incubator-hudi] leesf commented on issue #1062: [HUDI-294] Delete Paths written in Cleaner plan needs to be relative to partition-path

2019-12-03 Thread GitBox
leesf commented on issue #1062: [HUDI-294] Delete Paths written in Cleaner plan needs to be relative to partition-path URL: https://github.com/apache/incubator-hudi/pull/1062#issuecomment-561115499 @bvaradar Thanks for the reminder and check. Updated the PR to address your comments.

[jira] [Commented] (HUDI-365) Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986793#comment-16986793 ] lamber-ken commented on HUDI-365: - hello, [~gurudatt], are you still working on this? the h

[jira] [Comment Edited] (HUDI-365) Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986793#comment-16986793 ] lamber-ken edited comment on HUDI-365 at 12/3/19 11:00 AM: --- hello

[jira] [Comment Edited] (HUDI-365) Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986793#comment-16986793 ] lamber-ken edited comment on HUDI-365 at 12/3/19 11:02 AM: --- hello

[incubator-hudi] branch hudi_test_suite updated: Rename module name from hudi-bench to hudi-end-to-end-tests

2019-12-03 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch hudi_test_suite in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/hudi_test_suite by this push: new 4ac72f4 Rename modu

[jira] [Commented] (HUDI-365) Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread Gurudatt Kulkarni (Jira)
[ https://issues.apache.org/jira/browse/HUDI-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986838#comment-16986838 ] Gurudatt Kulkarni commented on HUDI-365: [~lamber-ken] I will push it by tomorrow.

[jira] [Commented] (HUDI-365) Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986854#comment-16986854 ] lamber-ken commented on HUDI-365: - (y)(y)(y) > Refactor hudi-cli based on new ImportOrder

[jira] [Commented] (HUDI-233) Redo log statements using SLF4J

2019-12-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986863#comment-16986863 ] leesf commented on HUDI-233: Is the time to start the work? [~vinoth] > Redo log statements us

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1057: Hudi Test Suite

2019-12-03 Thread GitBox
yanghua commented on a change in pull request #1057: Hudi Test Suite URL: https://github.com/apache/incubator-hudi/pull/1057#discussion_r353159688 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/converter/Converter.java ## @@ -0,0 +1,33 @@ +/* + *

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1057: Hudi Test Suite

2019-12-03 Thread GitBox
yanghua commented on a change in pull request #1057: Hudi Test Suite URL: https://github.com/apache/incubator-hudi/pull/1057#discussion_r353159688 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/converter/Converter.java ## @@ -0,0 +1,33 @@ +/* + *

[GitHub] [incubator-hudi] Guru107 opened a new pull request #1076: [HUDI-365] Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread GitBox
Guru107 opened a new pull request #1076: [HUDI-365] Refactor hudi-cli based on new ImportOrder code style rule URL: https://github.com/apache/incubator-hudi/pull/1076 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributi

[jira] [Updated] (HUDI-365) Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-365: Labels: pull-request-available (was: ) > Refactor hudi-cli based on new ImportOrder code style rule

[jira] [Updated] (HUDI-365) Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-365: Attachment: image-2019-12-03-20-58-20-503.png > Refactor hudi-cli based on new ImportOrder code style rule >

[jira] [Commented] (HUDI-365) Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986873#comment-16986873 ] lamber-ken commented on HUDI-365: - hi, [~gurudatt], some tips may help you to work quickly.

[jira] [Commented] (HUDI-365) Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread Gurudatt Kulkarni (Jira)
[ https://issues.apache.org/jira/browse/HUDI-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986878#comment-16986878 ] Gurudatt Kulkarni commented on HUDI-365: [~lamber-ken] I have just raised a PR. Che

[jira] [Comment Edited] (HUDI-365) Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986873#comment-16986873 ] lamber-ken edited comment on HUDI-365 at 12/3/19 1:00 PM: -- hi, [~g

[jira] [Commented] (HUDI-365) Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986879#comment-16986879 ] lamber-ken commented on HUDI-365: - (y)(y) > Refactor hudi-cli based on new ImportOrder cod

[GitHub] [incubator-hudi] lamber-ken commented on issue #1076: [HUDI-365] Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread GitBox
lamber-ken commented on issue #1076: [HUDI-365] Refactor hudi-cli based on new ImportOrder code style rule URL: https://github.com/apache/incubator-hudi/pull/1076#issuecomment-561157290 👍 This is an automated message from th

[GitHub] [incubator-hudi] vinothchandar commented on issue #1076: [HUDI-365] Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread GitBox
vinothchandar commented on issue #1076: [HUDI-365] Refactor hudi-cli based on new ImportOrder code style rule URL: https://github.com/apache/incubator-hudi/pull/1076#issuecomment-561169370 @yanghua could you review this one please ---

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file URL: https://github.com/apache/incubator-hudi/pull/1075#discussion_r353185291 ## File path: hudi-utilities/src/main/java/org/apache/hudi

[GitHub] [incubator-hudi] pratyakshsharma commented on a change in pull request #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file

2019-12-03 Thread GitBox
pratyakshsharma commented on a change in pull request #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file URL: https://github.com/apache/incubator-hudi/pull/1075#discussion_r353191882 ## File path: hudi-utilities/src/main/java/org/apache/hu

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r353187976 ## File path: hudi-spark/src/main/java/org/apache/hudi/BaseAvroPayload.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r353190815 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/Sour

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r353187310 ## File path: hudi-client/src/test/java/org/apache/hudi/common/HoodieTestDataGenerator.

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r353188392 ## File path: hudi-spark/src/main/java/org/apache/hudi/OverwriteWithLatestAvroPayload.j

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r353190196 ## File path: hudi-spark/src/main/java/org/apache/hudi/OverwriteWithLatestAvroPayload.j

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r353190622 ## File path: hudi-spark/src/main/java/org/apache/hudi/OverwriteWithLatestAvroPayload.j

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r353186790 ## File path: hudi-client/src/test/java/org/apache/hudi/common/HoodieTestDataGenerator.

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1076: [HUDI-365] Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread GitBox
lamber-ken edited a comment on issue #1076: [HUDI-365] Refactor hudi-cli based on new ImportOrder code style rule URL: https://github.com/apache/incubator-hudi/pull/1076#issuecomment-561157290 👍 , checked `mvn -pl hudi-cli checkstyle:check` -

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r353195684 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r353205531 ## File path: hudi-common/src/main/java/org/apache/hudi/common/bloom/filter/BloomFilterUtils.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r353200854 ## File path: hudi-common/src/main/java/org/apache/hudi/common/bloom/filter/LocalFilter.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r353198094 ## File path: hudi-common/src/main/java/org/apache/hudi/common/bloom/filter/HoodieDynamicBoundedBl

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r353196338 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r353196810 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r353198779 ## File path: hudi-common/src/main/java/org/apache/hudi/common/bloom/filter/HoodieDynamicBoundedBl

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r353197790 ## File path: hudi-common/src/main/java/org/apache/hudi/common/bloom/filter/HoodieDynamicBoundedBl

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r353194946 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieIndexConfig.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r353202994 ## File path: hudi-common/src/main/java/org/apache/hudi/common/bloom/filter/LocalDynamicBloomFilte

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #976: [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#discussion_r353201825 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/ParquetUtils.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1068: [WIP] Parquet/HFile Log writer and reader

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #1068: [WIP] Parquet/HFile Log writer and reader URL: https://github.com/apache/incubator-hudi/pull/1068#discussion_r353220774 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/logger/InLineReader.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1068: [WIP] Parquet/HFile Log writer and reader

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #1068: [WIP] Parquet/HFile Log writer and reader URL: https://github.com/apache/incubator-hudi/pull/1068#discussion_r353220921 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/logger/InLineReader.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1068: [WIP] Parquet/HFile Log writer and reader

2019-12-03 Thread GitBox
vinothchandar commented on a change in pull request #1068: [WIP] Parquet/HFile Log writer and reader URL: https://github.com/apache/incubator-hudi/pull/1068#discussion_r353222499 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/logger/InLineHFileReader.java ###

[GitHub] [incubator-hudi] vinothchandar commented on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer

2019-12-03 Thread GitBox
vinothchandar commented on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/969#issuecomment-561213523 @pushpavanthar Great suggestion.. Let me see if we can structure this solution more,. Just supporting raw sql

[incubator-hudi] branch master updated (845e261 -> 98ab33b)

2019-12-03 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 845e261 [MINOR] Update some urls from http to https in the README file (#1074) add 98ab33b [HUDI-294

[GitHub] [incubator-hudi] bvaradar merged pull request #1062: [HUDI-294] Delete Paths written in Cleaner plan needs to be relative to partition-path

2019-12-03 Thread GitBox
bvaradar merged pull request #1062: [HUDI-294] Delete Paths written in Cleaner plan needs to be relative to partition-path URL: https://github.com/apache/incubator-hudi/pull/1062 This is an automated message from the Apache

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-03 Thread GitBox
nsivabalan commented on a change in pull request #1073: [WIP] [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r353349031 ## File path: hudi-spark/src/main/java/org/apache/hudi/OverwriteWithLatestAvroPayload.java

[GitHub] [incubator-hudi] pushpavanthar edited a comment on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer

2019-12-03 Thread GitBox
pushpavanthar edited a comment on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/969#issuecomment-559230742 Hi @vinothchandar and @taherk77 I would like to add 2 points to this feature to make this very generic

[GitHub] [incubator-hudi] pushpavanthar edited a comment on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer

2019-12-03 Thread GitBox
pushpavanthar edited a comment on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/969#issuecomment-559230742 Hi @vinothchandar and @taherk77 I would like to add 2 points to this feature to make this very generic

[GitHub] [incubator-hudi] pushpavanthar edited a comment on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer

2019-12-03 Thread GitBox
pushpavanthar edited a comment on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/969#issuecomment-559230742 Hi @vinothchandar and @taherk77 I would like to add 2 points to this feature to make this very generic

[GitHub] [incubator-hudi] pushpavanthar edited a comment on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer

2019-12-03 Thread GitBox
pushpavanthar edited a comment on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/969#issuecomment-559230742 Hi @vinothchandar and @taherk77 I would like to add 2 points to this feature to make this very generic

[GitHub] [incubator-hudi] pushpavanthar commented on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer

2019-12-03 Thread GitBox
pushpavanthar commented on issue #969: [HUDI-251] JDBC incremental load to HUDI DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/969#issuecomment-561331620 @vinothchandar Thanks. It would be great if we document this in design doc and proceed from there. I've been using

[jira] [Closed] (HUDI-294) Delete Paths written in Cleaner plan needs to be relative to partition-path

2019-12-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-294. -- Resolution: Fixed Fixed via master: 98ab33bb6e1637d18c8fab7a9ddd50daeaf56962 > Delete Paths written in Cleaner plan need

[GitHub] [incubator-hudi] nbalajee opened a new pull request #1077: Improvements to DiskbasedMap

2019-12-03 Thread GitBox
nbalajee opened a new pull request #1077: Improvements to DiskbasedMap URL: https://github.com/apache/incubator-hudi/pull/1077 ## What is the purpose of the pull request DiskBasedMap is used by ExternalSpillableMap for writing (K,V) pair to a file, keeping the (K, fileMetadata) in m

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1077: Improvements to DiskbasedMap

2019-12-03 Thread GitBox
bvaradar commented on a change in pull request #1077: Improvements to DiskbasedMap URL: https://github.com/apache/incubator-hudi/pull/1077#discussion_r353458484 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/BufferedRandomAccessFile.java ## @@ -0,0 +1

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1076: [HUDI-365] Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread GitBox
lamber-ken edited a comment on issue #1076: [HUDI-365] Refactor hudi-cli based on new ImportOrder code style rule URL: https://github.com/apache/incubator-hudi/pull/1076#issuecomment-561157290 👍 This is an automated message

[GitHub] [incubator-hudi] zhedoubushishi commented on a change in pull request #1036: [HUDI-353] Add hive style partitioning path

2019-12-03 Thread GitBox
zhedoubushishi commented on a change in pull request #1036: [HUDI-353] Add hive style partitioning path URL: https://github.com/apache/incubator-hudi/pull/1036#discussion_r353510140 ## File path: hudi-hive/src/main/java/org/apache/hudi/hive/HiveSyncTool.java ## @@ -163,6 +

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #118

2019-12-03 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.22 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp /home/jenkins/tools/maven/apach

[GitHub] [incubator-hudi] bvaradar merged pull request #1049: [HUDI-355] Refactor hudi-common based on new comment and code style rules

2019-12-03 Thread GitBox
bvaradar merged pull request #1049: [HUDI-355] Refactor hudi-common based on new comment and code style rules URL: https://github.com/apache/incubator-hudi/pull/1049 This is an automated message from the Apache Git Service.

[GitHub] [incubator-hudi] yanghua merged pull request #1076: [HUDI-365] Refactor hudi-cli based on new ImportOrder code style rule

2019-12-03 Thread GitBox
yanghua merged pull request #1076: [HUDI-365] Refactor hudi-cli based on new ImportOrder code style rule URL: https://github.com/apache/incubator-hudi/pull/1076 This is an automated message from the Apache Git Service. To re

[incubator-hudi] branch master updated: [HUDI-365] Refactor hudi-cli based on new ImportOrder code style rule (#1076)

2019-12-03 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new b2d9638 [HUDI-365] Refactor hudi-cli

[jira] [Assigned] (HUDI-378) Refactor the rest codes based on new ImportOrder code style rule

2019-12-03 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-378: --- Assignee: lamber-ken > Refactor the rest codes based on new ImportOrder code style rule >

[jira] [Created] (HUDI-378) Refactor the rest codes based on new ImportOrder code style rule

2019-12-03 Thread lamber-ken (Jira)
lamber-ken created HUDI-378: --- Summary: Refactor the rest codes based on new ImportOrder code style rule Key: HUDI-378 URL: https://issues.apache.org/jira/browse/HUDI-378 Project: Apache Hudi (incubating)