[jira] [Updated] (HUDI-652) Decouple HoodieReadClient and AbstractHoodieClient to break the inheritance chain

2020-03-04 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-652: -- Summary: Decouple HoodieReadClient and AbstractHoodieClient to break the inheritance chain (was: Decouple

[jira] [Created] (HUDI-658) Make ClientUtils spark-free

2020-03-05 Thread vinoyang (Jira)
vinoyang created HUDI-658: - Summary: Make ClientUtils spark-free Key: HUDI-658 URL: https://issues.apache.org/jira/browse/HUDI-658 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Updated] (HUDI-659) Make HoodieCommitArchiveLog spark free

2020-03-05 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-659: -- Description: Currently, {{HoodieCommitArchiveLog}} depends on {{JavaSparkContext}} in its two methods

[jira] [Created] (HUDI-659) Make HoodieCommitArchiveLog spark free

2020-03-05 Thread vinoyang (Jira)
vinoyang created HUDI-659: - Summary: Make HoodieCommitArchiveLog spark free Key: HUDI-659 URL: https://issues.apache.org/jira/browse/HUDI-659 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Commented] (HUDI-658) Make ClientUtils spark-free

2020-03-05 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051899#comment-17051899 ] vinoyang commented on HUDI-658: --- [~vinoth] WDYT? > Make ClientUtils spark-f

[jira] [Updated] (HUDI-538) Restructuring hudi client module for multi engine support

2020-03-05 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-538: -- Description: Hudi is currently tightly coupled with the Spark framework. It caused the integration with other

[jira] [Created] (HUDI-660) Make HoodieWriteConfig spark free

2020-03-05 Thread vinoyang (Jira)
vinoyang created HUDI-660: - Summary: Make HoodieWriteConfig spark free Key: HUDI-660 URL: https://issues.apache.org/jira/browse/HUDI-660 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Commented] (HUDI-652) Decouple HoodieReadClient and AbstractHoodieClient to brean the inheritance chain

2020-03-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050259#comment-17050259 ] vinoyang commented on HUDI-652: --- [~vinoth] WDYT? > Decouple HoodieReadClient and AbstractHoodieCli

[jira] [Created] (HUDI-652) Decouple HoodieReadClient and AbstractHoodieClient to brean the inheritance chain

2020-03-03 Thread vinoyang (Jira)
vinoyang created HUDI-652: - Summary: Decouple HoodieReadClient and AbstractHoodieClient to brean the inheritance chain Key: HUDI-652 URL: https://issues.apache.org/jira/browse/HUDI-652 Project: Apache Hudi

[jira] [Created] (HUDI-643) Check and write comment of all the rule items

2020-02-26 Thread vinoyang (Jira)
vinoyang created HUDI-643: - Summary: Check and write comment of all the rule items Key: HUDI-643 URL: https://issues.apache.org/jira/browse/HUDI-643 Project: Apache Hudi (incubating) Issue Type: Sub

[jira] [Updated] (HUDI-643) Check and write comment for all the rule items

2020-02-26 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-643: -- Summary: Check and write comment for all the rule items (was: Check and write comment of all the rule items

[jira] [Created] (HUDI-642) CO70: The project strives to answer user questions in a timely manner.

2020-02-26 Thread vinoyang (Jira)
vinoyang created HUDI-642: - Summary: CO70: The project strives to answer user questions in a timely manner. Key: HUDI-642 URL: https://issues.apache.org/jira/browse/HUDI-642 Project: Apache Hudi

[jira] [Created] (HUDI-639) QU20: The project puts a very high priority on producing secure software.

2020-02-26 Thread vinoyang (Jira)
vinoyang created HUDI-639: - Summary: QU20: The project puts a very high priority on producing secure software. Key: HUDI-639 URL: https://issues.apache.org/jira/browse/HUDI-639 Project: Apache Hudi

[jira] [Updated] (HUDI-638) Fix the asf compliant issues based on the maturity model

2020-02-26 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-638: -- Priority: Blocker (was: Major) > Fix the asf compliant issues based on the maturity mo

[jira] [Created] (HUDI-640) QU30: The project provides a well-documented channel to report security issues, along with a documented way of responding to them.

2020-02-26 Thread vinoyang (Jira)
vinoyang created HUDI-640: - Summary: QU30: The project provides a well-documented channel to report security issues, along with a documented way of responding to them. Key: HUDI-640 URL: https

[jira] [Created] (HUDI-638) Fix the asf compliant issues based on the maturity model

2020-02-26 Thread vinoyang (Jira)
vinoyang created HUDI-638: - Summary: Fix the asf compliant issues based on the maturity model Key: HUDI-638 URL: https://issues.apache.org/jira/browse/HUDI-638 Project: Apache Hudi (incubating

[jira] [Created] (HUDI-641) CO60: The community operates based on the consensus of its members (see CS10) who have decision power. Dictators, benevolent or not, are not welcome in Apache projects.

2020-02-26 Thread vinoyang (Jira)
vinoyang created HUDI-641: - Summary: CO60: The community operates based on the consensus of its members (see CS10) who have decision power. Dictators, benevolent or not, are not welcome in Apache projects. Key: HUDI-641

[jira] [Created] (HUDI-645) Provide a statement page to describe how to report security issues

2020-02-27 Thread vinoyang (Jira)
vinoyang created HUDI-645: - Summary: Provide a statement page to describe how to report security issues Key: HUDI-645 URL: https://issues.apache.org/jira/browse/HUDI-645 Project: Apache Hudi (incubating

[jira] [Updated] (HUDI-645) Provide a statement page to describe how to report security issues

2020-02-27 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-645: -- Status: Open (was: New) > Provide a statement page to describe how to report security iss

[jira] [Resolved] (HUDI-645) Provide a statement page to describe how to report security issues

2020-02-27 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-645. --- Resolution: Done Done via asf-site branch: 6d844cefaaab3c732e2440f880c2c44a6aeaa474 > Provide a statem

[jira] [Updated] (HUDI-401) Remove unnecessary use of spark in savepoint timeline

2020-03-06 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-401: -- Parent: HUDI-538 Issue Type: Sub-task (was: Improvement) > Remove unnecessary use of spark in savepo

[jira] [Resolved] (HUDI-503) Add hudi test suite documentation into the README file of the test suite module

2020-02-04 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-503. --- Resolution: Done Done via hudi_test_suite_refactor branch: 044759aa5070a0c6def8413ff25ec02370c30947 >

[jira] [Created] (HUDI-602) Add some guidance about how to judge the scope of MINOR to the contribution guidance

2020-02-05 Thread vinoyang (Jira)
vinoyang created HUDI-602: - Summary: Add some guidance about how to judge the scope of MINOR to the contribution guidance Key: HUDI-602 URL: https://issues.apache.org/jira/browse/HUDI-602 Project: Apache

[jira] [Created] (HUDI-591) Support Spark upgrade

2020-01-31 Thread vinoyang (Jira)
vinoyang created HUDI-591: - Summary: Support Spark upgrade Key: HUDI-591 URL: https://issues.apache.org/jira/browse/HUDI-591 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Commented] (HUDI-592) Remove duplicated dependencies in the pom file of test suite module

2020-01-31 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027538#comment-17027538 ] vinoyang commented on HUDI-592: --- [~nishith29] WDYT? > Remove duplicated dependencies in the pom file of t

[jira] [Created] (HUDI-593) Use scala_version placeholder to replace scala version hard code e.g. 2.11

2020-01-31 Thread vinoyang (Jira)
vinoyang created HUDI-593: - Summary: Use scala_version placeholder to replace scala version hard code e.g. 2.11 Key: HUDI-593 URL: https://issues.apache.org/jira/browse/HUDI-593 Project: Apache Hudi

[jira] [Updated] (HUDI-591) Support Spark version upgrade

2020-01-31 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-591: -- Summary: Support Spark version upgrade (was: Support Spark upgrade) > Support Spark version upgr

[jira] [Created] (HUDI-592) Remove duplicated dependencies in the pom file of test suite module

2020-01-31 Thread vinoyang (Jira)
vinoyang created HUDI-592: - Summary: Remove duplicated dependencies in the pom file of test suite module Key: HUDI-592 URL: https://issues.apache.org/jira/browse/HUDI-592 Project: Apache Hudi (incubating

[jira] [Commented] (HUDI-591) Support Spark version upgrade

2020-01-31 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027539#comment-17027539 ] vinoyang commented on HUDI-591: --- cc [~nishith29] > Support Spark version upgr

[jira] [Updated] (HUDI-602) Add some guidance about how to judge the scope of MINOR to the contribution guidance

2020-02-06 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-602: -- Status: Open (was: New) > Add some guidance about how to judge the scope of MINOR to the contribut

[jira] [Resolved] (HUDI-602) Add some guidance about how to judge the scope of MINOR to the contribution guidance

2020-02-06 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-602. --- Resolution: Done Done via asf-site branch: b1bb7b0e050b2d7acfb7c5bccdbc2a98e6a35743 > Add some guidance ab

[jira] [Commented] (HUDI-554) Restructure code/packages to move more code back into hudi-writer-common

2020-02-06 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032164#comment-17032164 ] vinoyang commented on HUDI-554: --- Got it! cc [~xleesf] > Restructure code/packages to move more code b

[jira] [Updated] (HUDI-538) Restructuring hudi client module for multi engine support

2020-02-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-538: -- Status: In Progress (was: Open) > Restructuring hudi client module for multi engine supp

[jira] [Updated] (HUDI-538) Restructuring hudi client module for multi engine support

2020-02-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-538: -- Issue Type: Improvement (was: Wish) > Restructuring hudi client module for multi engine supp

[jira] [Updated] (HUDI-538) Restructuring hudi client module for multi engine support

2020-02-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-538: -- Status: Open (was: New) > Restructuring hudi client module for multi engine supp

[jira] [Resolved] (HUDI-542) Introduce a new pom module named hudi-writer-common

2020-02-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-542. --- Resolution: Done Done via restructure-hudi-client branch: a1c2296d4e02baccd47155e341029df70604325c

[jira] [Updated] (HUDI-542) Introduce a new pom module named hudi-writer-common

2020-02-07 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-542: -- Status: Open (was: New) > Introduce a new pom module named hudi-writer-com

[jira] [Commented] (HUDI-554) Restructure code/packages to move more code back into hudi-writer-common

2020-02-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032843#comment-17032843 ] vinoyang commented on HUDI-554: --- [~vinoth] Do you want to move and refactor all the classes via this ticket

[jira] [Created] (HUDI-613) Refactor and enhance the Transformer component

2020-02-14 Thread vinoyang (Jira)
vinoyang created HUDI-613: - Summary: Refactor and enhance the Transformer component Key: HUDI-613 URL: https://issues.apache.org/jira/browse/HUDI-613 Project: Apache Hudi (incubating) Issue Type

[jira] [Assigned] (HUDI-409) Replace Log Magic header with a secure hash to avoid clashes with data

2020-02-18 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-409: - Assignee: Nishith Agarwal > Replace Log Magic header with a secure hash to avoid clashes with d

[jira] [Updated] (HUDI-409) Replace Log Magic header with a secure hash to avoid clashes with data

2020-02-18 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-409: -- Issue Type: Improvement (was: Bug) > Replace Log Magic header with a secure hash to avoid clashes with d

[jira] [Commented] (HUDI-624) Split some of the code from PR for HUDI-479

2020-02-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041584#comment-17041584 ] vinoyang commented on HUDI-624: --- Done via master branch: 8f6035de4a0486e996647e1246334123aed0c9d6 > Sp

[jira] [Updated] (HUDI-624) Split some of the code from PR for HUDI-479

2020-02-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-624: -- Status: Closed (was: Patch Available) > Split some of the code from PR for HUDI-

[jira] [Commented] (HUDI-623) Remove UpgradePayloadFromUberToApache

2020-02-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041440#comment-17041440 ] vinoyang commented on HUDI-623: --- OK, let wait for more release cycle. > Rem

[jira] [Commented] (HUDI-554) Restructure code/packages to move more code back into hudi-writer-common

2020-02-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033440#comment-17033440 ] vinoyang commented on HUDI-554: --- bq. Makes sense? Absolutely yes. In terms of core design, we should reduce

[jira] [Resolved] (HUDI-560) Remove legacy IdentityTransformer

2020-02-09 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-560. --- Resolution: Fixed Done via master branch: 91f47802ebead2259f1d05fc9dc3323a46b4be56 > Remove leg

[jira] [Updated] (HUDI-581) NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files

2020-02-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-581: -- Priority: Blocker (was: Major) > NOTICE need more work as it missing content form included 3rd party A

[jira] [Updated] (HUDI-289) Implement a test suite to support long running test for Hudi writing and querying end-end

2020-02-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-289: -- Fix Version/s: (was: 0.5.2) 0.6.0 > Implement a test suite to support long running t

[jira] [Resolved] (HUDI-622) Remove VisibleForTesting annotation and import from code

2020-02-19 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-622. --- Resolution: Done Done via master branch: f9d2f66dc16540e3e5c1cb1f7f23b4fca7c656c3 > Remove VisibleForTest

[jira] [Updated] (HUDI-622) Remove VisibleForTesting annotation and import from code

2020-02-19 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-622: -- Status: Closed (was: Patch Available) > Remove VisibleForTesting annotation and import from c

[jira] [Reopened] (HUDI-622) Remove VisibleForTesting annotation and import from code

2020-02-19 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reopened HUDI-622: --- > Remove VisibleForTesting annotation and import from c

[jira] [Updated] (HUDI-623) Remove UpgradePayloadFromUberToApache

2020-02-19 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-623: -- Priority: Trivial (was: Major) > Remove UpgradePayloadFromUberToApa

[jira] [Commented] (HUDI-623) Remove UpgradePayloadFromUberToApache

2020-02-19 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040710#comment-17040710 ] vinoyang commented on HUDI-623: --- [~vinoth] WDYT? > Remove UpgradePayloadFromUberToApa

[jira] [Created] (HUDI-623) Remove UpgradePayloadFromUberToApache

2020-02-19 Thread vinoyang (Jira)
vinoyang created HUDI-623: - Summary: Remove UpgradePayloadFromUberToApache Key: HUDI-623 URL: https://issues.apache.org/jira/browse/HUDI-623 Project: Apache Hudi (incubating) Issue Type: Wish

[jira] [Assigned] (HUDI-397) Normalize log print statement

2020-01-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-397: - Assignee: wangxianghu > Normalize log print statem

[jira] [Commented] (HUDI-397) Normalize log print statement

2020-01-09 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011786#comment-17011786 ] vinoyang commented on HUDI-397: --- Hi [~jotarada] Absolutely, you can. However, I have assigned this ticket

[jira] [Created] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-15 Thread vinoyang (Jira)
vinoyang created HUDI-538: - Summary: Restructuring hudi client module for multi engine support Key: HUDI-538 URL: https://issues.apache.org/jira/browse/HUDI-538 Project: Apache Hudi (incubating

[jira] [Commented] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-19 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019243#comment-17019243 ] vinoyang commented on HUDI-538: --- [~vinoth] Agree on both two core issues. About the second issue, especially

[jira] [Resolved] (HUDI-441) Rename WorkflowDagGenerator and some class names in test package

2020-01-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-441. --- Resolution: Done Done via hudi-test-suite-refactor branch: d68e911414986bc8df075ee72e6a7dfce29f6e8f > Ren

[jira] [Commented] (HUDI-560) Remove legacy IdentityTransformer

2020-01-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019314#comment-17019314 ] vinoyang commented on HUDI-560: --- [~vinoth] WDYT? > Remove legacy IdentityTransfor

[jira] [Created] (HUDI-560) Remove legacy IdentityTransformer

2020-01-20 Thread vinoyang (Jira)
vinoyang created HUDI-560: - Summary: Remove legacy IdentityTransformer Key: HUDI-560 URL: https://issues.apache.org/jira/browse/HUDI-560 Project: Apache Hudi (incubating) Issue Type: Wish

[jira] [Commented] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-16 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017682#comment-17017682 ] vinoyang commented on HUDI-538: --- [~alfredlu] (y) > Restructuring hudi client module for multi engine supp

[jira] [Commented] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-16 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017670#comment-17017670 ] vinoyang commented on HUDI-538: --- [~hongdongdong] Glad to hear this news. Welcome! > Restructuring h

[jira] [Updated] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-17 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-538: -- Description: Hudi is currently tightly coupled with the Spark framework. It caused the integration with other

[jira] [Commented] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-17 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017787#comment-17017787 ] vinoyang commented on HUDI-538: --- [~alfredlu] Actually, decoupling with Spark is the prior-condition

[jira] [Created] (HUDI-542) Introduce a new pom module named hudi-writer-common

2020-01-17 Thread vinoyang (Jira)
vinoyang created HUDI-542: - Summary: Introduce a new pom module named hudi-writer-common Key: HUDI-542 URL: https://issues.apache.org/jira/browse/HUDI-542 Project: Apache Hudi (incubating) Issue

[jira] [Updated] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-17 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-538: -- Description: Hudi is currently tightly coupled with the Spark framework. It caused the integration with other

[jira] [Commented] (HUDI-542) Introduce a new pom module named hudi-writer-common

2020-01-17 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017832#comment-17017832 ] vinoyang commented on HUDI-542: --- [~vinoth] if you do not against, I will init {{hudi-writer-common}} module

[jira] [Commented] (HUDI-560) Remove legacy IdentityTransformer

2020-01-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019839#comment-17019839 ] vinoyang commented on HUDI-560: --- [~vbalaji] OK, thanks. Now [~wangxianghu] you can start this work. Please go

[jira] [Commented] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019814#comment-17019814 ] vinoyang commented on HUDI-538: --- bg. Initially, the DeltaStreamer will not work over Flink, and that may

[jira] [Comment Edited] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019814#comment-17019814 ] vinoyang edited comment on HUDI-538 at 1/21/20 2:32 AM: bq. Initially

[jira] [Commented] (HUDI-538) Restructuring hudi client module for multi engine support

2020-01-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019821#comment-17019821 ] vinoyang commented on HUDI-538: --- bq. A good analogy is to think of the first integration with Flink

[jira] [Updated] (HUDI-503) Add hudi test suite documentation into the README file of the test suite module

2020-01-13 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-503: -- Status: Open (was: New) > Add hudi test suite documentation into the README file of the test suite >

[jira] [Created] (HUDI-531) Add java doc for hudi test suite general classes

2020-01-13 Thread vinoyang (Jira)
vinoyang created HUDI-531: - Summary: Add java doc for hudi test suite general classes Key: HUDI-531 URL: https://issues.apache.org/jira/browse/HUDI-531 Project: Apache Hudi (incubating) Issue Type

[jira] [Updated] (HUDI-503) Add hudi test suite documentation into the README file of the test suite module

2020-01-13 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-503: -- Status: In Progress (was: Open) > Add hudi test suite documentation into the README file of the test su

[jira] [Updated] (HUDI-531) Add java doc for hudi test suite general classes

2020-01-13 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-531: -- Description: Currently, the general classes (under src/main dir) has no java docs. We should add doc for those

[jira] [Created] (HUDI-532) Add java doc for hudi test suite test classes

2020-01-13 Thread vinoyang (Jira)
vinoyang created HUDI-532: - Summary: Add java doc for hudi test suite test classes Key: HUDI-532 URL: https://issues.apache.org/jira/browse/HUDI-532 Project: Apache Hudi (incubating) Issue Type: Sub

[jira] [Commented] (HUDI-492) show env all CLI command can not work in hudi-cli

2020-01-02 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17007167#comment-17007167 ] vinoyang commented on HUDI-492: --- {quote}Was this added recently.. IIRC it only works if a spark config

[jira] [Resolved] (HUDI-455) Redo hudi-client log statements using SLF4J

2019-12-30 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-455. --- Resolution: Done Done via master branch: e637d9ed26fea1a336f2fd6139cde0dd192c429d > Redo hudi-client

[jira] [Updated] (HUDI-455) Redo hudi-client log statements using SLF4J

2019-12-30 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-455: -- Fix Version/s: 0.5.1 > Redo hudi-client log statements using SL

[jira] [Created] (HUDI-492) show env all CLI command can not work in hudi-cli

2020-01-02 Thread vinoyang (Jira)
vinoyang created HUDI-492: - Summary: show env all CLI command can not work in hudi-cli Key: HUDI-492 URL: https://issues.apache.org/jira/browse/HUDI-492 Project: Apache Hudi (incubating) Issue Type

[jira] [Commented] (HUDI-492) show env all CLI command can not work in hudi-cli

2020-01-02 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17006772#comment-17006772 ] vinoyang commented on HUDI-492: --- cc [~vinoth] > show env all CLI command can not work in hudi-

[jira] [Closed] (HUDI-452) Create a hudi-ci github organizations to support hudi CI via azure pipeline

2019-12-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-452. - Resolution: Done > Create a hudi-ci github organizations to support hudi CI via azure pipel

[jira] [Updated] (HUDI-452) Create a hudi CI github organizations to support hudi CI via azure pipeline

2019-12-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-452: -- Summary: Create a hudi CI github organizations to support hudi CI via azure pipeline (was: Create a hudi-ci

[jira] [Updated] (HUDI-470) Fix NPE when print result via hudi-cli

2019-12-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-470: -- Fix Version/s: 0.5.1 > Fix NPE when print result via hudi-

[jira] [Resolved] (HUDI-470) Fix NPE when print result via hudi-cli

2019-12-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-470. --- Resolution: Fixed Fixed via master branch: a63bcc7c102e2a71bd63dac699a29d2ad92e9321 > Fix NPE when pr

[jira] [Commented] (HUDI-452) Create a hudi-ci github organizations to support hudi CI via azure pipeline

2019-12-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002587#comment-17002587 ] vinoyang commented on HUDI-452: --- [~vinoth] IMO, we can close this issue. WDYT? > Create a hudi-ci git

[jira] [Created] (HUDI-503) Add hudi test suite documentation into the README file of the test suite module

2020-01-05 Thread vinoyang (Jira)
vinoyang created HUDI-503: - Summary: Add hudi test suite documentation into the README file of the test suite module Key: HUDI-503 URL: https://issues.apache.org/jira/browse/HUDI-503 Project: Apache Hudi

[jira] [Updated] (HUDI-554) Restructure code/packages to move more code back into hudi-writer-common

2020-03-11 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-554: -- Fix Version/s: (was: 0.6.0) 0.5.2 > Restructure code/packages to move more code b

[jira] [Commented] (HUDI-617) Add support for data types convertible to String in TimestampBasedKeyGenerator

2020-03-09 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055560#comment-17055560 ] vinoyang commented on HUDI-617: --- [~amitds1997] Did you apply for contribution permission? Why I can

[jira] [Commented] (HUDI-688) Ensure NOTICE contains all notices for the dependencies called out in LICENSE

2020-03-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055639#comment-17055639 ] vinoyang commented on HUDI-688: --- [~vinoth] IMO, we can follow druid's solution, since it's graduate date

[jira] [Commented] (HUDI-587) Jacoco coverage report is not generated

2020-03-09 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055561#comment-17055561 ] vinoyang commented on HUDI-587: --- [~pwason] Did you apply the contribution permission? I can not assign

[jira] [Commented] (HUDI-634) Document breaking changes for 0.5.2 release

2020-03-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055623#comment-17055623 ] vinoyang commented on HUDI-634: --- [~vinoth] I am browsing the commit history and jira issues that involved

[jira] [Commented] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055615#comment-17055615 ] vinoyang commented on HUDI-662: --- {quote}Apache Singa [https://github.com/apache/singa] follows same model

[jira] [Commented] (HUDI-688) Ensure NOTICE contains all notices for the dependencies called out in LICENSE

2020-03-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055628#comment-17055628 ] vinoyang commented on HUDI-688: --- If we can make sure the recently graduated project also can verify our

[jira] [Updated] (HUDI-634) Cut 0.5.2 documentation and write release note

2020-03-11 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-634: -- Summary: Cut 0.5.2 documentation and write release note (was: Write release blog and document breaking changes

[jira] [Updated] (HUDI-688) Ensure NOTICE contains all notices for the dependencies called out in LICENSE

2020-03-11 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-688: -- Status: In Progress (was: Open) > Ensure NOTICE contains all notices for the dependencies called out in LICE

[jira] [Updated] (HUDI-634) Write release blog and document breaking changes for 0.5.2 release

2020-03-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-634: -- Summary: Write release blog and document breaking changes for 0.5.2 release (was: Document breaking changes

[jira] [Commented] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054622#comment-17054622 ] vinoyang commented on HUDI-662: --- +1 too > Attribute binary dependencies that are included in the bundle j

[jira] [Commented] (HUDI-640) QU30: The project provides a well-documented channel to report security issues, along with a documented way of responding to them.

2020-03-07 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17053933#comment-17053933 ] vinoyang commented on HUDI-640: --- After [~vinoth] republish the website, we will have a link about describing

<    1   2   3   4   5   6   7   8   9   10   >