[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-08-22 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913145#comment-16913145 ] vinoyang commented on HUDI-184: --- Hi [~grapebaba] I am still investigating the matching of features which used

[jira] [Commented] (HUDI-228) Add Jira Conventions to contributing/community pages of HUDI

2019-08-31 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920060#comment-16920060 ] vinoyang commented on HUDI-228: --- +1 for [~xleesf] 's suggestion > Add Jira Conventions to

[jira] [Commented] (HUDI-211) Maintain Chinese docs for Hudi

2019-08-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914823#comment-16914823 ] vinoyang commented on HUDI-211: --- [~vinoth] It would be better to create a Chinese Document component. >

[jira] [Created] (HUDI-220) Translate root index page

2019-08-23 Thread vinoyang (Jira)
vinoyang created HUDI-220: - Summary: Translate root index page Key: HUDI-220 URL: https://issues.apache.org/jira/browse/HUDI-220 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Assigned] (HUDI-220) Translate root index page

2019-08-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-220: - Assignee: vinoyang > Translate root index page > - > > Key:

[jira] [Assigned] (HUDI-221) Translate concept page

2019-08-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-221: - Assignee: vinoyang > Translate concept page > -- > > Key: HUDI-221 >

[jira] [Created] (HUDI-221) Translate concept page

2019-08-23 Thread vinoyang (Jira)
vinoyang created HUDI-221: - Summary: Translate concept page Key: HUDI-221 URL: https://issues.apache.org/jira/browse/HUDI-221 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Updated] (HUDI-220) Translate root index page

2019-08-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-220: -- Component/s: (was: Docs) docs-chinese > Translate root index page >

[jira] [Updated] (HUDI-221) Translate concept page

2019-08-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-221: -- Component/s: docs-chinese > Translate concept page > -- > > Key: HUDI-221 >

[jira] [Updated] (HUDI-211) Maintain Chinese docs for Hudi

2019-08-23 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-211: -- Component/s: (was: Docs) docs-chinese > Maintain Chinese docs for Hudi >

[jira] [Updated] (HUDI-211) Maintain Chinese docs for Hudi

2019-08-24 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-211: -- Description: All the translation of docs should be held under this umbrella issue. The best practice would be

[jira] [Updated] (HUDI-264) Ensure website for both english and chinese is rendered properly with styling scripts and images

2019-09-19 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-264: -- Attachment: Screen Shot 2019-09-19 at 11.14.09 PM.png > Ensure website for both english and chinese is rendered

[jira] [Updated] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType and

2019-09-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-267: -- Summary: Refactor bad method name HoodieTestUtils#initTableType and (was: Refactor bad method name

[jira] [Commented] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType

2019-09-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934894#comment-16934894 ] vinoyang commented on HUDI-267: --- +1 to rename {{HoodieTableMetaClient.initializePathAsHoodieDataset}} to

[jira] [Updated] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType and HoodieTableMetaClient#initializePathAsHoodieDataset

2019-09-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-267: -- Summary: Refactor bad method name HoodieTestUtils#initTableType and

[jira] [Resolved] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType and HoodieTableMetaClient#initializePathAsHoodieDataset

2019-09-21 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-267. --- Resolution: Done Done via f020d029c406008b7342f1117b95b68b4a90d401 > Refactor bad method name

[jira] [Commented] (HUDI-286) Remove or hide tags from Hudi official web site

2019-10-01 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16942059#comment-16942059 ] vinoyang commented on HUDI-286: --- [~vinoth] What do you think? > Remove or hide tags from Hudi official web

[jira] [Created] (HUDI-286) Remove or hide tags from Hudi official web site

2019-10-01 Thread vinoyang (Jira)
vinoyang created HUDI-286: - Summary: Remove or hide tags from Hudi official web site Key: HUDI-286 URL: https://issues.apache.org/jira/browse/HUDI-286 Project: Apache Hudi (incubating) Issue Type:

[jira] [Commented] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType

2019-09-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934162#comment-16934162 ] vinoyang commented on HUDI-267: --- [~vinoth] What do you think? > Refactor bad method name

[jira] [Updated] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType

2019-09-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-267: -- Description: There are some bad method name about {{HoodieTableMetaClient}}, e.g. (1)

[jira] [Created] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType

2019-09-20 Thread vinoyang (Jira)
vinoyang created HUDI-267: - Summary: Refactor bad method name HoodieTestUtils#initTableType Key: HUDI-267 URL: https://issues.apache.org/jira/browse/HUDI-267 Project: Apache Hudi (incubating) Issue

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-30 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962861#comment-16962861 ] vinoyang commented on HUDI-289: --- [~vinoth] Report my progress: I am refactoring the dag package. I am trying

[jira] [Commented] (HUDI-320) Keep docs on master instead of asf-site branch

2019-11-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965618#comment-16965618 ] vinoyang commented on HUDI-320: --- +1 to keep docs on the master branch. [~guoyihua] I have re-assigned

[jira] [Assigned] (HUDI-226) Hudi Website - Provide links to documentation corresponding to older release versions

2019-11-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-226: - Assignee: Ethan Guo (was: vinoyang) > Hudi Website - Provide links to documentation corresponding to

[jira] [Commented] (HUDI-226) Hudi Website - Provide links to documentation corresponding to older release versions

2019-11-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965617#comment-16965617 ] vinoyang commented on HUDI-226: --- [~guoyihua] one more question: Is vinoth your colleague? > Hudi Website -

[jira] [Commented] (HUDI-226) Hudi Website - Provide links to documentation corresponding to older release versions

2019-11-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965616#comment-16965616 ] vinoyang commented on HUDI-226: --- [~guoyihua] I have not planned to work on this ticket. I have other things

[jira] [Assigned] (HUDI-118) Provide CLI Option for passing properties to Compactor, Cleaner and ParquetImporter

2019-11-11 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-118: - Assignee: Pratyaksh Sharma (was: vinoyang) > Provide CLI Option for passing properties to Compactor,

[jira] [Commented] (HUDI-118) Provide CLI Option for passing properties to Compactor, Cleaner and ParquetImporter

2019-11-11 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971416#comment-16971416 ] vinoyang commented on HUDI-118: --- Hi [~Pratyaksh], Sorry for the late replay. I am not working on this ticket.

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-11-07 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969874#comment-16969874 ] vinoyang commented on HUDI-64: -- Start thinking and understand the details of the implementation. Any ideas will

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-11-01 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964697#comment-16964697 ] vinoyang commented on HUDI-64: -- Hi [~vinoth] can you provide more details? > Estimation of compression ratio &

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-30 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963621#comment-16963621 ] vinoyang commented on HUDI-289: --- [~vinoth] OK, let's work together and keep in touch quickly. > Implement a

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-30 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963619#comment-16963619 ] vinoyang commented on HUDI-289: --- [~vinoth] Yes, I think some part of that PR could be reused. Although, there

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-11-13 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973099#comment-16973099 ] vinoyang commented on HUDI-64: -- [~vinoth] I have tried to find an alternative solution to handle the third

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-11-18 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976473#comment-16976473 ] vinoyang commented on HUDI-64: -- [~thomasWeise] Since you have been Flink PMC for a long time, can you help me

[jira] [Comment Edited] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-11-18 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976473#comment-16976473 ] vinoyang edited comment on HUDI-64 at 11/18/19 11:39 AM: - [~thw] Since you have been

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-11-12 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16972319#comment-16972319 ] vinoyang commented on HUDI-64: -- Hi [~vinoth] IMO, we can refer to Flink's optimizer of batch processing. There

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-11-11 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971985#comment-16971985 ] vinoyang commented on HUDI-289: --- [~vinoth] IMO, [~nishith29] provided a good infrastructure to do this job.

[jira] [Commented] (HUDI-226) Hudi Website - Provide links to documentation corresponding to older release versions

2019-11-05 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967364#comment-16967364 ] vinoyang commented on HUDI-226: --- [~guoyihua] Got it. Can we chat on WeChat so that we can communicate

[jira] [Created] (HUDI-355) Refactor hudi-common based on new comment and code style rules

2019-11-20 Thread vinoyang (Jira)
vinoyang created HUDI-355: - Summary: Refactor hudi-common based on new comment and code style rules Key: HUDI-355 URL: https://issues.apache.org/jira/browse/HUDI-355 Project: Apache Hudi (incubating)

[jira] [Commented] (HUDI-354) Introduce stricter comment and code style validation rules

2019-11-21 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979108#comment-16979108 ] vinoyang commented on HUDI-354: --- [~lamber-ken] welcome to join the refactor work, if you want. It has a lot

[jira] [Assigned] (HUDI-355) Refactor hudi-common based on new comment and code style rules

2019-11-21 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-355: - Assignee: vinoyang > Refactor hudi-common based on new comment and code style rules >

[jira] [Updated] (HUDI-354) Introduce stricter comment and code style validation rules

2019-11-21 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-354: -- Description: This is an umbrella issue used to track apply some stricter comment and code style validation

[jira] [Updated] (HUDI-354) Introduce stricter comment and code style validation rules

2019-11-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-354: -- Description: This is an umbrella issue used to track apply some stricter comment and code style validation

[jira] [Updated] (HUDI-354) Introduce stricter comment and code style validation rules

2019-11-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-354: -- Description: This is an umbrella issue used to track apply some stricter comment and code style validation

[jira] [Commented] (HUDI-354) Introduce stricter comment and code style validation rules

2019-11-21 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979102#comment-16979102 ] vinoyang commented on HUDI-354: --- I thought about the idea. However, if we merge the rules before refactoring.

[jira] [Commented] (HUDI-354) Introduce stricter comment and code style validation rules

2019-11-21 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979142#comment-16979142 ] vinoyang commented on HUDI-354: --- [~lamber-ken] It's strange. It takes effect in my local env. Did you add the

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-22 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980247#comment-16980247 ] vinoyang commented on HUDI-184: --- [~vinoth] I have started to think about some questions and view the

[jira] [Updated] (HUDI-354) Introduce stricter comment and code style validation rules

2019-11-21 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-354: -- Description: This is an umbrella issue used to track apply some stricter comment and code style validation

[jira] [Commented] (HUDI-354) Introduce stricter comment and code style validation rules

2019-11-21 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979178#comment-16979178 ] vinoyang commented on HUDI-354: --- [~xleesf] Can you help to verify whether the check-style works fine? >

[jira] [Assigned] (HUDI-391) Rename module name from hudi-bench to hudi-test-suite

2019-12-09 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-391: - Assignee: vinoyang > Rename module name from hudi-bench to hudi-test-suite >

[jira] [Created] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2019-12-09 Thread vinoyang (Jira)
vinoyang created HUDI-393: - Summary: Integrate with Azure Pipeline run the end to end tests Key: HUDI-393 URL: https://issues.apache.org/jira/browse/HUDI-393 Project: Apache Hudi (incubating) Issue

[jira] [Created] (HUDI-394) Provide a basic implementation of test suite

2019-12-09 Thread vinoyang (Jira)
vinoyang created HUDI-394: - Summary: Provide a basic implementation of test suite Key: HUDI-394 URL: https://issues.apache.org/jira/browse/HUDI-394 Project: Apache Hudi (incubating) Issue Type:

[jira] [Created] (HUDI-392) Introduce DIstributedTestDataSource to generate test data

2019-12-09 Thread vinoyang (Jira)
vinoyang created HUDI-392: - Summary: Introduce DIstributedTestDataSource to generate test data Key: HUDI-392 URL: https://issues.apache.org/jira/browse/HUDI-392 Project: Apache Hudi (incubating)

[jira] [Assigned] (HUDI-289) Implement a test suite to support long running test for Hudi writing and querying end-end

2019-12-09 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-289: - Assignee: (was: vinoyang) > Implement a test suite to support long running test for Hudi writing and

[jira] [Updated] (HUDI-289) Implement a test suite to support long running test for Hudi writing and querying end-end

2019-12-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-289: -- Summary: Implement a test suite to support long running test for Hudi writing and querying end-end (was:

[jira] [Updated] (HUDI-289) Implement a test suite to support long running test for Hudi writing and querying end-end

2019-12-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-289: -- Description: We would need an equivalent of an end-end test which runs some workload for few hours atleast,

[jira] [Created] (HUDI-391) Rename module name from hudi-bench to hudi-test-suite

2019-12-08 Thread vinoyang (Jira)
vinoyang created HUDI-391: - Summary: Rename module name from hudi-bench to hudi-test-suite Key: HUDI-391 URL: https://issues.apache.org/jira/browse/HUDI-391 Project: Apache Hudi (incubating) Issue

[jira] [Assigned] (HUDI-394) Provide a basic implementation of test suite

2019-12-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-394: - Assignee: Nishith Agarwal > Provide a basic implementation of test suite >

[jira] [Updated] (HUDI-394) Provide a basic implementation of test suite

2019-12-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-394: -- Description: It provides: * Flexible schema payload generation * Different types of workload generation such

[jira] [Assigned] (HUDI-210) Implement prometheus metrics reporter

2019-12-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-210: - Assignee: Forward Xu (was: vinoyang) > Implement prometheus metrics reporter >

[jira] [Commented] (HUDI-399) Fix conflicts of test suite basic implementation based on master branch

2019-12-11 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993474#comment-16993474 ] vinoyang commented on HUDI-399: --- [~vinoth] [~nishith29] FYI. Will try to fix these conflicts. > Fix

[jira] [Assigned] (HUDI-399) Fix conflicts of test suite basic implementation based on master branch

2019-12-11 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-399: - Assignee: vinoyang > Fix conflicts of test suite basic implementation based on master branch >

[jira] [Resolved] (HUDI-394) Provide a basic implementation of test suite

2019-12-11 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-394. --- Resolution: Implemented Implemented via hudi_test_suite_refactor branch: 

[jira] [Created] (HUDI-399) Fix conflicts of test suite basic implementation based on master branch

2019-12-11 Thread vinoyang (Jira)
vinoyang created HUDI-399: - Summary: Fix conflicts of test suite basic implementation based on master branch Key: HUDI-399 URL: https://issues.apache.org/jira/browse/HUDI-399 Project: Apache Hudi

[jira] [Closed] (HUDI-399) Fix conflicts of test suite basic implementation based on master branch and fix checkstyle issues

2019-12-12 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-399. - Resolution: Won't Fix I have rebased HUDI-394 and fixed checkstyle error in that stage.  > Fix conflicts of test

[jira] [Comment Edited] (HUDI-394) Provide a basic implementation of test suite

2019-12-12 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993472#comment-16993472 ] vinoyang edited comment on HUDI-394 at 12/12/19 1:05 PM: - Implemented via

[jira] [Reopened] (HUDI-394) Provide a basic implementation of test suite

2019-12-12 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reopened HUDI-394: --- > Provide a basic implementation of test suite > > >

[jira] [Updated] (HUDI-399) Fix conflicts of test suite basic implementation based on master branch and fix checkstyle issues

2019-12-12 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-399: -- Summary: Fix conflicts of test suite basic implementation based on master branch and fix checkstyle issues

[jira] [Closed] (HUDI-394) Provide a basic implementation of test suite

2019-12-16 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-394. - Resolution: Implemented > Provide a basic implementation of test suite >

[jira] [Resolved] (HUDI-391) Rename module name from hudi-bench to hudi-test-suite

2019-12-15 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-391. --- Resolution: Done Done via hudi_test_suite_refactor branch :  80ca4ddf28a648ca3296d03f073f09eb559ebdac >

[jira] [Commented] (HUDI-392) Introduce DIstributedTestDataSource to generate test data

2019-12-16 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997254#comment-16997254 ] vinoyang commented on HUDI-392: --- Working on this issue. [~vinoth]  [~nishith29] FYI > Introduce

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-27 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960707#comment-16960707 ] vinoyang commented on HUDI-289: --- [~vinoth] I have started this work. If I have any questions, I will let you

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-14 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951456#comment-16951456 ] vinoyang commented on HUDI-289: --- [~vinoth] Yes, it's also my another question. Did not see the reason from PR

[jira] [Assigned] (HUDI-221) Translate concept page

2019-10-14 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-221: - Assignee: leesf (was: vinoyang) > Translate concept page > -- > >

[jira] [Commented] (HUDI-221) Translate concept page

2019-10-14 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951509#comment-16951509 ] vinoyang commented on HUDI-221: --- [~xleesf] assigned to you, thanks. > Translate concept page >

[jira] [Commented] (HUDI-221) Translate concept page

2019-10-14 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951467#comment-16951467 ] vinoyang commented on HUDI-221: --- [~xleesf] I am busy with other things. Do you want to take over this work?

[jira] [Commented] (HUDI-312) Investigate recent flaky CI runs

2019-10-24 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958656#comment-16958656 ] vinoyang commented on HUDI-312: --- Actually, based on my experience in the Flink community, Flink's Travis

[jira] [Commented] (HUDI-312) Investigate recent flaky CI runs

2019-10-24 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959380#comment-16959380 ] vinoyang commented on HUDI-312: --- [~vinoth] yes, agree. > Investigate recent flaky CI runs >

[jira] [Updated] (HUDI-286) Remove tags from Hudi official web site

2019-10-26 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-286: -- Summary: Remove tags from Hudi official web site (was: Remove or hide tags from Hudi official web site) >

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-18 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977090#comment-16977090 ] vinoyang commented on HUDI-184: --- bq. Also there are probably some bigger questions to answer first? e.g if we

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-18 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977141#comment-16977141 ] vinoyang commented on HUDI-184: --- [~taherk77] I know you have provided some thoughts before. Maybe we can pick

[jira] [Created] (HUDI-352) The official documentation about project structure missed hudi-timeline-service module

2019-11-20 Thread vinoyang (Jira)
vinoyang created HUDI-352: - Summary: The official documentation about project structure missed hudi-timeline-service module Key: HUDI-352 URL: https://issues.apache.org/jira/browse/HUDI-352 Project: Apache

[jira] [Assigned] (HUDI-209) Implement JMX metrics reporter

2019-11-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned HUDI-209: - Assignee: (was: vinoyang) > Implement JMX metrics reporter > -- > >

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-27 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983313#comment-16983313 ] vinoyang commented on HUDI-184: --- [~vinoth] I wrote more thought in a Google doc, please see here:

[jira] [Resolved] (HUDI-364) Refactor hudi-hive based on new ImportOrder code style rule

2019-11-27 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-364. --- Resolution: Done Done via b77fad39b53049279bba1ba367f43cce73f48bfa > Refactor hudi-hive based on new

[jira] [Commented] (HUDI-354) Introduce stricter comment and code style validation rules

2019-11-21 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979881#comment-16979881 ] vinoyang commented on HUDI-354: --- {quote}I think we also should add maven-enforcer-plugin to limit the maven

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-22 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979954#comment-16979954 ] vinoyang commented on HUDI-184: --- [~taherk77] Thanks for sharing your thought. I agree that we can start by

[jira] [Commented] (HUDI-358) Add Java-doc and importOrder checkstyle rule

2019-11-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982080#comment-16982080 ] vinoyang commented on HUDI-358: --- [~lamber-ken] I can not assign this ticket to you. You can specify to

[jira] [Commented] (HUDI-184) Integrate Hudi with Apache Flink

2019-11-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982081#comment-16982081 ] vinoyang commented on HUDI-184: --- {quote}In spark, we can run two spark jobs  (i.e the jobs tab you see in

[jira] [Commented] (HUDI-118) Provide CLI Option for passing properties to Compactor, Cleaner and ParquetImporter

2019-11-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982085#comment-16982085 ] vinoyang commented on HUDI-118: --- [~Pratyaksh] I have nothing to supply. Let [~vinoth] make the decision. >

[jira] [Updated] (HUDI-354) Introduce stricter comment and code style validation rules

2019-11-20 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-354: -- Description: This is an umbrella issue used to track apply some stricter comment and code style validation

[jira] [Created] (HUDI-354) Introduce stricter comment and code style validation rules

2019-11-20 Thread vinoyang (Jira)
vinoyang created HUDI-354: - Summary: Introduce stricter comment and code style validation rules Key: HUDI-354 URL: https://issues.apache.org/jira/browse/HUDI-354 Project: Apache Hudi (incubating)

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-11-14 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974197#comment-16974197 ] vinoyang commented on HUDI-64: -- [~vinoth] There is a JIRA issue HUDI-184 related to integrating with Flink. We

[jira] [Updated] (HUDI-290) Normalize test class name of all test classes

2019-10-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-290: -- Description: In general, a test case name start with {{Test}}. For example, it would be better to rename

[jira] [Updated] (HUDI-290) Normalize test class name of all test classes

2019-10-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-290: -- Summary: Normalize test class name of all test classes (was: Normalize Test class name of

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-10 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948543#comment-16948543 ] vinoyang commented on HUDI-289: --- [~vinoth] OK, Got it! > Implement a long running test for Hudi writing and

[jira] [Commented] (HUDI-290) Normalize Test class name of HoodieWriteConfigTest

2019-10-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943430#comment-16943430 ] vinoyang commented on HUDI-290: --- [~vinoth] WDYT? > Normalize Test class name of HoodieWriteConfigTest >

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-10-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943434#comment-16943434 ] vinoyang commented on HUDI-64: -- [~vinoth] I'd like to take this ticket. I am in China's National Day holiday,

[jira] [Commented] (HUDI-289) Implement a long running test for Hudi writing and querying end-end

2019-10-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943435#comment-16943435 ] vinoyang commented on HUDI-289: --- [~vinoth] OK, I'd like to take this ticket. > Implement a long running test

[jira] [Closed] (HUDI-217) Provide a unified resource management class to standardize the resource allocation and release for hudi client test cases

2019-10-03 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang closed HUDI-217. - Resolution: Done Done via master: 895d732a1423f3a113d9630aa3c56e4b0837effd > Provide a unified resource

  1   2   3   4   5   6   7   >