[jira] [Closed] (HUDI-265) Failed to delete tmp dirs created in unit tests

2019-10-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-265. -- Resolution: Fixed Fixed via master: 3dedc7e5fdd5f885915e81e47e110b845a905dbf > Failed to delete tmp dirs created in

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #937: [HUDI-291] Simplify quickstart documentation

2019-10-03 Thread GitBox
vinothchandar commented on a change in pull request #937: [HUDI-291] Simplify quickstart documentation URL: https://github.com/apache/incubator-hudi/pull/937#discussion_r331275748 ## File path: docs/quickstart.md ## @@ -3,196 +3,186 @@ title: Quickstart keywords: hudi,

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #937: [HUDI-291] Simplify quickstart documentation

2019-10-03 Thread GitBox
vinothchandar commented on a change in pull request #937: [HUDI-291] Simplify quickstart documentation URL: https://github.com/apache/incubator-hudi/pull/937#discussion_r331274747 ## File path: docs/quickstart.md ## @@ -3,196 +3,186 @@ title: Quickstart keywords: hudi,

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #937: [HUDI-291] Simplify quickstart documentation

2019-10-03 Thread GitBox
vinothchandar commented on a change in pull request #937: [HUDI-291] Simplify quickstart documentation URL: https://github.com/apache/incubator-hudi/pull/937#discussion_r331276260 ## File path: docs/quickstart.md ## @@ -3,196 +3,186 @@ title: Quickstart keywords: hudi,

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #937: [HUDI-291] Simplify quickstart documentation

2019-10-03 Thread GitBox
vinothchandar commented on a change in pull request #937: [HUDI-291] Simplify quickstart documentation URL: https://github.com/apache/incubator-hudi/pull/937#discussion_r331276441 ## File path: docs/quickstart.md ## @@ -3,196 +3,186 @@ title: Quickstart keywords: hudi,

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #937: [HUDI-291] Simplify quickstart documentation

2019-10-03 Thread GitBox
vinothchandar commented on a change in pull request #937: [HUDI-291] Simplify quickstart documentation URL: https://github.com/apache/incubator-hudi/pull/937#discussion_r331274347 ## File path: docs/quickstart.md ## @@ -3,196 +3,186 @@ title: Quickstart keywords: hudi,

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #937: [HUDI-291] Simplify quickstart documentation

2019-10-03 Thread GitBox
vinothchandar commented on a change in pull request #937: [HUDI-291] Simplify quickstart documentation URL: https://github.com/apache/incubator-hudi/pull/937#discussion_r331275909 ## File path: docs/quickstart.md ## @@ -3,196 +3,186 @@ title: Quickstart keywords: hudi,

[jira] [Updated] (HUDI-291) Simplify quickstart

2019-10-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-291: Labels: pull-request-available (was: ) > Simplify quickstart > --- > >

[GitHub] [incubator-hudi] bhasudha opened a new pull request #937: [HUDI-291] Simplify quickstart documentation

2019-10-03 Thread GitBox
bhasudha opened a new pull request #937: [HUDI-291] Simplify quickstart documentation URL: https://github.com/apache/incubator-hudi/pull/937 - Uses spark-shell based examples to showcase Hudi core features - Info related to hive sync, hive, presto, etc are removed

[incubator-hudi] tag 0.5.0-incubating-rc4 deleted (was fb053bf)

2019-10-03 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to tag 0.5.0-incubating-rc4 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. *** WARNING: tag 0.5.0-incubating-rc4 was deleted! *** was fb053bf [HUDI-121] Preparing for

[GitHub] [incubator-hudi] Guru107 commented on issue #143: Tracking ticket for folks to be added to slack group

2019-10-03 Thread GitBox
Guru107 commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-538180537 Hi @vinothchandar, please add guruak...@gmail.com. This

[GitHub] [incubator-hudi] leesf commented on issue #937: [HUDI-291] Simplify quickstart documentation

2019-10-03 Thread GitBox
leesf commented on issue #937: [HUDI-291] Simplify quickstart documentation URL: https://github.com/apache/incubator-hudi/pull/937#issuecomment-538180728 > @yanghua @leesf I am making these changes in the main quickstart.md. May need your help in changing the corresponding .cn.md files

[GitHub] [incubator-hudi] bhasudha commented on issue #937: [HUDI-291] Simplify quickstart documentation

2019-10-03 Thread GitBox
bhasudha commented on issue #937: [HUDI-291] Simplify quickstart documentation URL: https://github.com/apache/incubator-hudi/pull/937#issuecomment-538117831 Please review the contents of this quickstart and let me know if you want to see any changes. For a rough idea, the quickstart

[jira] [Created] (HUDI-291) Simplify quickstart

2019-10-03 Thread Bhavani Sudha Saktheeswaran (Jira)
Bhavani Sudha Saktheeswaran created HUDI-291: Summary: Simplify quickstart Key: HUDI-291 URL: https://issues.apache.org/jira/browse/HUDI-291 Project: Apache Hudi (incubating)

[jira] [Updated] (HUDI-232) Implement sealing/unsealing for HoodieRecord class

2019-10-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-232: Labels: pull-request-available (was: ) > Implement sealing/unsealing for HoodieRecord class >

[GitHub] [incubator-hudi] leesf opened a new pull request #938: [HUDI-232] Implement sealing/unsealing for HoodieRecord class

2019-10-03 Thread GitBox
leesf opened a new pull request #938: [HUDI-232] Implement sealing/unsealing for HoodieRecord class URL: https://github.com/apache/incubator-hudi/pull/938 see jira: https://jira.apache.org/jira/projects/HUDI/issues/HUDI-232 CC @vinothchandar Please review when you get a chance.

[jira] [Updated] (HUDI-265) Failed to delete tmp dirs created in unit tests

2019-10-03 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan updated HUDI-265: Fix Version/s: (was: 0.5.1) 0.5.0 > Failed to delete tmp dirs created

[GitHub] [incubator-hudi] vinothchandar commented on issue #937: [HUDI-291] Simplify quickstart documentation

2019-10-03 Thread GitBox
vinothchandar commented on issue #937: [HUDI-291] Simplify quickstart documentation URL: https://github.com/apache/incubator-hudi/pull/937#issuecomment-538150247 My bad .. saw the pdf now.. Can we remove the toc.. Its not very useful if we expect most users just follow the whole page

[GitHub] [incubator-hudi] bvaradar opened a new pull request #939: [HUDI-121] Remove leftover notice file and replace com.uber.hoodie with org.apache.hudi

2019-10-03 Thread GitBox
bvaradar opened a new pull request #939: [HUDI-121] Remove leftover notice file and replace com.uber.hoodie with org.apache.hudi URL: https://github.com/apache/incubator-hudi/pull/939 1. Checked for other leftover license/notice files 2. Exploded fat jars and checked LICENSE and

[GitHub] [incubator-hudi] bvaradar commented on issue #939: [HUDI-121] Remove leftover notice file and replace com.uber.hoodie with org.apache.hudi

2019-10-03 Thread GitBox
bvaradar commented on issue #939: [HUDI-121] Remove leftover notice file and replace com.uber.hoodie with org.apache.hudi URL: https://github.com/apache/incubator-hudi/pull/939#issuecomment-538235145 The unit-test logs looks fine. @vinothchandar : Can you review .

[jira] [Commented] (HUDI-290) Normalize Test class name of HoodieWriteConfigTest

2019-10-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943430#comment-16943430 ] vinoyang commented on HUDI-290: --- [~vinoth] WDYT? > Normalize Test class name of HoodieWriteConfigTest >

[jira] [Commented] (HUDI-253) DeltaStreamer should report nicer error messages for misconfigs

2019-10-03 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943363#comment-16943363 ] Pratyaksh Sharma commented on HUDI-253: --- [~vinoth] Actually got stuck with some other high priority

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-10-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943434#comment-16943434 ] vinoyang commented on HUDI-64: -- [~vinoth] I'd like to take this ticket. I am in China's National Day holiday,

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943435#comment-16943435 ] vinoyang commented on HUDI-289: --- [~vinoth] OK, I'd like to take this ticket. > Implement a long running test

[jira] [Closed] (HUDI-217) Provide a unified resource management class to standardize the resource allocation and release for hudi client test cases

2019-10-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-217. - Resolution: Done Done via master: 895d732a1423f3a113d9630aa3c56e4b0837effd > Provide a unified resource

[jira] [Created] (HUDI-290) Normalize Test class name of HoodieWriteConfigTest

2019-10-03 Thread vinoyang (Jira)
vinoyang created HUDI-290: - Summary: Normalize Test class name of HoodieWriteConfigTest Key: HUDI-290 URL: https://issues.apache.org/jira/browse/HUDI-290 Project: Apache Hudi (incubating) Issue

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #935: [HUDI-287] Remove LICENSE and NOTICE files in hoodie child modules.

2019-10-03 Thread GitBox
bvaradar commented on a change in pull request #935: [HUDI-287] Remove LICENSE and NOTICE files in hoodie child modules. URL: https://github.com/apache/incubator-hudi/pull/935#discussion_r330874769 ## File path: pom.xml ## @@ -166,9 +104,9 @@ -

[GitHub] [incubator-hudi] leesf commented on issue #928: [HUDI-265] Failed to delete tmp dirs created in unit tests

2019-10-03 Thread GitBox
leesf commented on issue #928: [HUDI-265] Failed to delete tmp dirs created in unit tests URL: https://github.com/apache/incubator-hudi/pull/928#issuecomment-537838407 Any other concerns to be merged? @vinothchandar This is

[jira] [Commented] (HUDI-286) Remove or hide tags from Hudi official web site

2019-10-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943415#comment-16943415 ] vinoyang commented on HUDI-286: --- [~vinoth] Yes, we do not actively use tags in the docs. However, a

[jira] [Commented] (HUDI-290) Normalize Test class name of HoodieWriteConfigTest

2019-10-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943558#comment-16943558 ] leesf commented on HUDI-290: +1 rename to TestHoodieWriteConfig, and i see many UTs start already start with

[jira] [Assigned] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2019-10-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-288: -- Assignee: leesf > Add support for ingesting multiple kafka streams in a single DeltaStreamer > deployment >

[jira] [Updated] (HUDI-285) Implement HoodieStorageWriter based on actual file type

2019-10-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-285: Labels: pull-request-available (was: ) > Implement HoodieStorageWriter based on actual file type >

[GitHub] [incubator-hudi] leesf opened a new pull request #936: [HUDI-285] Implement HoodieStorageWriter based on actual file type

2019-10-03 Thread GitBox
leesf opened a new pull request #936: [HUDI-285] Implement HoodieStorageWriter based on actual file type URL: https://github.com/apache/incubator-hudi/pull/936 see jira: https://jira.apache.org/jira/projects/HUDI/issues/HUDI-285 CC @vinothchandar

[GitHub] [incubator-hudi] tweise commented on issue #935: [HUDI-287] Remove LICENSE and NOTICE files in hoodie child modules.

2019-10-03 Thread GitBox
tweise commented on issue #935: [HUDI-287] Remove LICENSE and NOTICE files in hoodie child modules. URL: https://github.com/apache/incubator-hudi/pull/935#issuecomment-537975855 Did you verify that the files are automatically included into the jar?

[jira] [Comment Edited] (HUDI-290) Normalize Test class name of HoodieWriteConfigTest

2019-10-03 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943558#comment-16943558 ] leesf edited comment on HUDI-290 at 10/3/19 2:53 PM: - +1 rename to

[incubator-hudi] tag 0.5.0-incubating-rc4 created (now fb053bf)

2019-10-03 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to tag 0.5.0-incubating-rc4 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. at fb053bf (commit) No new revisions were added by this update.

[incubator-hudi] tag release-0.5.0-incubating-rc4 created (now fb053bf)

2019-10-03 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to tag release-0.5.0-incubating-rc4 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. at fb053bf (commit) No new revisions were added by this update.

[GitHub] [incubator-hudi] bvaradar commented on issue #935: [HUDI-287] Remove LICENSE and NOTICE files in hoodie child modules.

2019-10-03 Thread GitBox
bvaradar commented on issue #935: [HUDI-287] Remove LICENSE and NOTICE files in hoodie child modules. URL: https://github.com/apache/incubator-hudi/pull/935#issuecomment-538009259 > Did you verify that the files are automatically included into the jar? Yes, They are present in the

[GitHub] [incubator-hudi] bvaradar merged pull request #935: [HUDI-287] Remove LICENSE and NOTICE files in hoodie child modules.

2019-10-03 Thread GitBox
bvaradar merged pull request #935: [HUDI-287] Remove LICENSE and NOTICE files in hoodie child modules. URL: https://github.com/apache/incubator-hudi/pull/935 This is an automated message from the Apache Git Service. To

[jira] [Closed] (HUDI-287) Remove LICENSE and NOTICE files in hoodie child modules

2019-10-03 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan closed HUDI-287. --- > Remove LICENSE and NOTICE files in hoodie child modules >

[incubator-hudi] branch master updated: Update Release notes

2019-10-03 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new e78ba59 Update Release notes e78ba59

svn commit: r36186 - in /dev/incubator/hudi/hudi-0.5.0-incubating-rc4: ./ hudi-0.5.0-incubating-rc4.src.tgz hudi-0.5.0-incubating-rc4.src.tgz.asc hudi-0.5.0-incubating-rc4.src.tgz.sha512

2019-10-03 Thread vbalaji
Author: vbalaji Date: Thu Oct 3 16:40:15 2019 New Revision: 36186 Log: Adding source release of hudi-0.5.0-incubating-rc4 Added: dev/incubator/hudi/hudi-0.5.0-incubating-rc4/ dev/incubator/hudi/hudi-0.5.0-incubating-rc4/hudi-0.5.0-incubating-rc4.src.tgz (with props)

[incubator-hudi] branch master updated: [HUDI-121] Fix bug in validation in deploy_staging_jars.sh

2019-10-03 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new cef06c1 [HUDI-121] Fix bug in

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

2019-10-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943728#comment-16943728 ] Vinoth Chandar commented on HUDI-288: - Great! This will help larger companies with more topics easily

[incubator-hudi] branch master updated: [HUDI-265] Failed to delete tmp dirs created in unit tests (#928)

2019-10-03 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 3dedc7e [HUDI-265] Failed to delete

[GitHub] [incubator-hudi] vinothchandar merged pull request #928: [HUDI-265] Failed to delete tmp dirs created in unit tests

2019-10-03 Thread GitBox
vinothchandar merged pull request #928: [HUDI-265] Failed to delete tmp dirs created in unit tests URL: https://github.com/apache/incubator-hudi/pull/928 This is an automated message from the Apache Git Service. To respond

[jira] [Resolved] (HUDI-287) Remove LICENSE and NOTICE files in hoodie child modules

2019-10-03 Thread Balaji Varadarajan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Varadarajan resolved HUDI-287. - Resolution: Fixed > Remove LICENSE and NOTICE files in hoodie child modules >

[incubator-hudi] 03/03: [HUDI-121] Preparing for Release 0.5.0-incubating-rc4

2019-10-03 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch release-0.5.0 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit fb053bf44dc7ed862e86e63fa35de0e7e43aa234 Author: Balaji Varadarajan AuthorDate: Thu Oct 3 09:15:39 2019

[incubator-hudi] branch release-0.5.0 updated (789f91e -> fb053bf)

2019-10-03 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch release-0.5.0 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. omit 789f91e [HUDI-121] Fix issues found during release candidate builds omit dfe4784 [HUDI-121]

[incubator-hudi] 01/03: [HUDI-121] Preparing for Release 0.5.0-incubating-rc2

2019-10-03 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch release-0.5.0 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit e571e143d5420bc6de3601c89e66fd15cca94de0 Author: Balaji Varadarajan AuthorDate: Tue Sep 17 10:35:16

[incubator-hudi] 02/03: [HUDI-121] Preparing for Release 0.5.0-incubating-rc3

2019-10-03 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch release-0.5.0 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit e3db2d8d5d5b04705ef1bd845a8bc847748b4d0e Author: Balaji Varadarajan AuthorDate: Mon Sep 30 16:34:45

[incubator-hudi] branch master updated: [HUDI-121] Fix bug in validation in create_source_release.sh

2019-10-03 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new e75fa07 [HUDI-121] Fix bug in

[GitHub] [incubator-hudi] vinothchandar commented on issue #933: Support for multiple level partitioning in Hudi

2019-10-03 Thread GitBox
vinothchandar commented on issue #933: Support for multiple level partitioning in Hudi URL: https://github.com/apache/incubator-hudi/issues/933#issuecomment-538021110 @HariprasadAllaka1612 thanks! mind updating the FAQs? :)

[jira] [Commented] (HUDI-286) Remove or hide tags from Hudi official web site

2019-10-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943708#comment-16943708 ] Vinoth Chandar commented on HUDI-286: - +1 thanks for catching this > Remove or hide tags from Hudi

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-10-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943733#comment-16943733 ] Vinoth Chandar commented on HUDI-64: [~yanghua] absolutely no problem. take your time :) > Estimation

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-03 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943731#comment-16943731 ] Vinoth Chandar commented on HUDI-289: - Awesome! https://github.com/apache/incubator-hudi/pull/623 was