[jira] [Commented] (HUDI-1566) Typo in account request caused wrong name in Apache id

2021-02-01 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276787#comment-17276787 ] wangxianghu commented on HUDI-1566: --- [~clr] Yes ,I found it later can you help ping somebody to handle

[jira] [Commented] (HUDI-1566) Typo in account request caused wrong name in Apache id

2021-02-01 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276777#comment-17276777 ] wangxianghu commented on HUDI-1566: --- Hi [~clr],is there any progress on correcting the id ? > Typo in

[jira] [Commented] (HUDI-1566) Typo in account request caused wrong name in Apache id

2021-01-30 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275540#comment-17275540 ] wangxianghu commented on HUDI-1566: --- [~vinoth] can you help me correct the id > Typo in account request

[jira] [Assigned] (HUDI-1556) Add App Id and App name to HoodieDeltaStreamerMetrics

2021-01-28 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-1556: - Assignee: liujinhui > Add App Id and App name to HoodieDeltaStreamerMetrics >

[jira] [Created] (HUDI-1556) Add App Id and App name to HoodieDeltaStreamerMetrics

2021-01-28 Thread wangxianghu (Jira)
wangxianghu created HUDI-1556: - Summary: Add App Id and App name to HoodieDeltaStreamerMetrics Key: HUDI-1556 URL: https://issues.apache.org/jira/browse/HUDI-1556 Project: Apache Hudi Issue

[jira] [Commented] (HUDI-1547) CI intermittent failure: TestJsonStringToHoodieRecordMapFunction.testMapFunction

2021-01-25 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271766#comment-17271766 ] wangxianghu commented on HUDI-1547: --- [~vinoth] I can take it > CI intermittent failure: >

[jira] [Assigned] (HUDI-1547) CI intermittent failure: TestJsonStringToHoodieRecordMapFunction.testMapFunction

2021-01-25 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-1547: - Assignee: wangxianghu > CI intermittent failure: >

[jira] [Updated] (HUDI-1544) Add unit test against HoodieFlinkStreamer

2021-01-22 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1544: -- Summary: Add unit test against HoodieFlinkStreamer (was: Add HoodieFlinkStreamer unit test) > Add

[jira] [Assigned] (HUDI-1544) Add unit test against HoodieFlinkStreamer

2021-01-22 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-1544: - Assignee: wangxianghu > Add unit test against HoodieFlinkStreamer >

[jira] [Created] (HUDI-1544) Add HoodieFlinkStreamer unit test

2021-01-22 Thread wangxianghu (Jira)
wangxianghu created HUDI-1544: - Summary: Add HoodieFlinkStreamer unit test Key: HUDI-1544 URL: https://issues.apache.org/jira/browse/HUDI-1544 Project: Apache Hudi Issue Type: Test

[jira] [Updated] (HUDI-1543) Fix NPE using HoodieFlinkStreamer to etl data from kafka to hudi

2021-01-22 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1543: -- Summary: Fix NPE using HoodieFlinkStreamer to etl data from kafka to hudi (was: Fix

[jira] [Created] (HUDI-1543) Fix HoodieFlinkStreamer NPE after HUDI-1511 merged

2021-01-22 Thread wangxianghu (Jira)
wangxianghu created HUDI-1543: - Summary: Fix HoodieFlinkStreamer NPE after HUDI-1511 merged Key: HUDI-1543 URL: https://issues.apache.org/jira/browse/HUDI-1543 Project: Apache Hudi Issue Type:

[jira] [Assigned] (HUDI-1207) Add kafka implementation of write commit callback to Spark datasources

2021-01-18 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-1207: - Assignee: Trevorzhang (was: wangxianghu) > Add kafka implementation of write commit callback to

[jira] [Closed] (HUDI-1466) Migrate CI/CD from travis to Azure pipeline

2021-01-18 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu closed HUDI-1466. - Resolution: Duplicate > Migrate CI/CD from travis to Azure pipeline >

[jira] [Updated] (HUDI-1466) Migrate CI/CD from travis to Azure pipeline

2021-01-18 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1466: -- Status: Open (was: New) > Migrate CI/CD from travis to Azure pipeline >

[jira] [Created] (HUDI-1531) Introduce HoodiePartitionCleaner to delete specific partition

2021-01-15 Thread wangxianghu (Jira)
wangxianghu created HUDI-1531: - Summary: Introduce HoodiePartitionCleaner to delete specific partition Key: HUDI-1531 URL: https://issues.apache.org/jira/browse/HUDI-1531 Project: Apache Hudi

[jira] [Updated] (HUDI-1514) Avoid raw type use for parameter of interface

2021-01-07 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1514: -- Fix Version/s: (was: 0.6.1) 0.7.0 > Avoid raw type use for parameter of

[jira] [Assigned] (HUDI-1511) InstantGenerateOperator support multiple parallelism

2021-01-06 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-1511: - Assignee: loukey_j > InstantGenerateOperator support multiple parallelism >

[jira] [Reopened] (HUDI-1511) InstantGenerateOperator support multiple parallelism

2021-01-06 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reopened HUDI-1511: --- > InstantGenerateOperator support multiple parallelism >

[jira] [Closed] (HUDI-1511) InstantGenerateOperator support multiple parallelism

2021-01-06 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu closed HUDI-1511. - Resolution: Duplicate > InstantGenerateOperator support multiple parallelism >

[jira] [Created] (HUDI-1511) InstantGenerateOperator support multiple parallelism

2021-01-06 Thread wangxianghu (Jira)
wangxianghu created HUDI-1511: - Summary: InstantGenerateOperator support multiple parallelism Key: HUDI-1511 URL: https://issues.apache.org/jira/browse/HUDI-1511 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-1506) Fix wrong exception thrown in HoodieAvroUtils

2021-01-05 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1506: -- Description: {code:java} // Caused by: org.apache.spark.SparkException: Job aborted due to stage

[jira] [Created] (HUDI-1506) Fix wrong exception thrown in HoodieAvroUtils

2021-01-05 Thread wangxianghu (Jira)
wangxianghu created HUDI-1506: - Summary: Fix wrong exception thrown in HoodieAvroUtils Key: HUDI-1506 URL: https://issues.apache.org/jira/browse/HUDI-1506 Project: Apache Hudi Issue Type: Bug

[jira] [Updated] (HUDI-981) Use rocksDB as flink state backend

2020-12-30 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-981: - Status: Open (was: New) > Use rocksDB as flink state backend > -- > >

[jira] [Updated] (HUDI-1485) Fix Deletes issued without any prior commits exception

2020-12-21 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1485: -- Description: step to reproduce: just use the delete demo in the quickstart ``` // spark-shell //

[jira] [Created] (HUDI-1485) Fix Deletes issued without any prior commits exception

2020-12-21 Thread wangxianghu (Jira)
wangxianghu created HUDI-1485: - Summary: Fix Deletes issued without any prior commits exception Key: HUDI-1485 URL: https://issues.apache.org/jira/browse/HUDI-1485 Project: Apache Hudi Issue

[jira] [Created] (HUDI-1471) Make QuickStartUtils generate deletes according to specific ts

2020-12-18 Thread wangxianghu (Jira)
wangxianghu created HUDI-1471: - Summary: Make QuickStartUtils generate deletes according to specific ts Key: HUDI-1471 URL: https://issues.apache.org/jira/browse/HUDI-1471 Project: Apache Hudi

[jira] [Created] (HUDI-1467) Promote Powered by chapter to top level menu

2020-12-17 Thread wangxianghu (Jira)
wangxianghu created HUDI-1467: - Summary: Promote Powered by chapter to top level menu Key: HUDI-1467 URL: https://issues.apache.org/jira/browse/HUDI-1467 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-1466) Migrate CI/CD from travis to Azure pipeline

2020-12-17 Thread wangxianghu (Jira)
wangxianghu created HUDI-1466: - Summary: Migrate CI/CD from travis to Azure pipeline Key: HUDI-1466 URL: https://issues.apache.org/jira/browse/HUDI-1466 Project: Apache Hudi Issue Type: New

[jira] [Resolved] (HUDI-1439) Remove scala dependency from hudi-client-common

2020-12-11 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu resolved HUDI-1439. --- Resolution: Fixed Fixed via master branch : 236d1b0dec409efb9c7a9febd260b1060da6a9c1 > Remove scala

[jira] [Assigned] (HUDI-1447) DeltaStreamer kafka source supports consuming from specified timestamp

2020-12-09 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-1447: - Assignee: liujinhui (was: wangxianghu) > DeltaStreamer kafka source supports consuming from

[jira] [Created] (HUDI-1447) DeltaStreamer kafka source supports consuming from specified timestamp

2020-12-09 Thread wangxianghu (Jira)
wangxianghu created HUDI-1447: - Summary: DeltaStreamer kafka source supports consuming from specified timestamp Key: HUDI-1447 URL: https://issues.apache.org/jira/browse/HUDI-1447 Project: Apache Hudi

[jira] [Assigned] (HUDI-1438) Move DataSourceOptions to hudi-client-common to reuse more code

2020-12-09 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-1438: - Assignee: wangxianghu > Move DataSourceOptions to hudi-client-common to reuse more code >

[jira] [Assigned] (HUDI-1438) Move DataSourceOptions to hudi-client-common to reuse more code

2020-12-09 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-1438: - Assignee: liujinhui (was: wangxianghu) > Move DataSourceOptions to hudi-client-common to reuse

[jira] [Updated] (HUDI-1439) Remove scala dependency from hudi-client-common

2020-12-07 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1439: -- Summary: Remove scala dependency from hudi-client-common (was: Remove scala denpendency from

[jira] [Assigned] (HUDI-1439) Remove scala denpendency from hudi-client-common

2020-12-07 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-1439: - Assignee: shenh062326 > Remove scala denpendency from hudi-client-common >

[jira] [Created] (HUDI-1439) Remove scala denpendency from hudi-client-common

2020-12-07 Thread wangxianghu (Jira)
wangxianghu created HUDI-1439: - Summary: Remove scala denpendency from hudi-client-common Key: HUDI-1439 URL: https://issues.apache.org/jira/browse/HUDI-1439 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-1438) Move DataSourceOptions to hudi-client-common to reuse more code

2020-12-07 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1438: -- Summary: Move DataSourceOptions to hudi-client-common to reuse more code (was: Move DataSourceOptions

[jira] [Updated] (HUDI-1438) Move DataSourceOptions to hudi-client-common to reuse code

2020-12-07 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1438: -- Issue Type: Improvement (was: Bug) > Move DataSourceOptions to hudi-client-common to reuse code >

[jira] [Created] (HUDI-1438) Move DataSourceOptions to hudi-client-common to reuse code

2020-12-07 Thread wangxianghu (Jira)
wangxianghu created HUDI-1438: - Summary: Move DataSourceOptions to hudi-client-common to reuse code Key: HUDI-1438 URL: https://issues.apache.org/jira/browse/HUDI-1438 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-1402) Add example about how to use flink engine to quickstart

2020-12-06 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1402: -- Summary: Add example about how to use flink engine to quickstart (was: Add a blog about how to use

[jira] [Created] (HUDI-1433) Flink engine support sync data to hive table

2020-12-04 Thread wangxianghu (Jira)
wangxianghu created HUDI-1433: - Summary: Flink engine support sync data to hive table Key: HUDI-1433 URL: https://issues.apache.org/jira/browse/HUDI-1433 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-1421) Improvement of failure recovery for HoodieFlinkStreamer

2020-11-28 Thread wangxianghu (Jira)
wangxianghu created HUDI-1421: - Summary: Improvement of failure recovery for HoodieFlinkStreamer Key: HUDI-1421 URL: https://issues.apache.org/jira/browse/HUDI-1421 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-1335) Introduce FlinkHoodieSimpleIndex to hudi-flink-client

2020-11-26 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1335: -- Status: Open (was: New) > Introduce FlinkHoodieSimpleIndex to hudi-flink-client >

[jira] [Updated] (HUDI-1336) Introduce FlinkHoodieGlobalSimpleIndex to hudi-flink-client

2020-11-26 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1336: -- Status: Open (was: New) > Introduce FlinkHoodieGlobalSimpleIndex to hudi-flink-client >

[jira] [Updated] (HUDI-1333) Introduce FlinkHoodieGlobalBloomIndex to hudi-flink-client

2020-11-26 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1333: -- Status: Open (was: New) > Introduce FlinkHoodieGlobalBloomIndex to hudi-flink-client >

[jira] [Assigned] (HUDI-1333) Introduce FlinkHoodieGlobalBloomIndex to hudi-flink-client

2020-11-26 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-1333: - Assignee: Gary Li (was: wangxianghu) > Introduce FlinkHoodieGlobalBloomIndex to

[jira] [Commented] (HUDI-1332) Introduce FlinkHoodieBloomIndex to hudi-flink-client

2020-11-26 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239119#comment-17239119 ] wangxianghu commented on HUDI-1332: --- Hi [~garyli] , I have not started it yet, thanks for picking it up 

[jira] [Assigned] (HUDI-1332) Introduce FlinkHoodieBloomIndex to hudi-flink-client

2020-11-26 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-1332: - Assignee: Gary Li (was: wangxianghu) > Introduce FlinkHoodieBloomIndex to hudi-flink-client >

[jira] [Updated] (HUDI-1417) [DOCS] Qcon Landing practice of Apache Hudi in T3go added to site

2020-11-25 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1417: -- Status: Open (was: New) > [DOCS] Qcon Landing practice of Apache Hudi in T3go added to site >

[jira] [Resolved] (HUDI-1417) [DOCS] Qcon Landing practice of Apache Hudi in T3go added to site

2020-11-25 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu resolved HUDI-1417. --- Resolution: Fixed > [DOCS] Qcon Landing practice of Apache Hudi in T3go added to site >

[jira] [Commented] (HUDI-1417) [DOCS] Qcon Landing practice of Apache Hudi in T3go added to site

2020-11-25 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239043#comment-17239043 ] wangxianghu commented on HUDI-1417: --- done via asf-site branch : ce24323b0577d125405620c9a757e95709309c32

[jira] [Updated] (HUDI-1417) [DOCS] Qcon Landing practice of Apache Hudi in T3go added to site

2020-11-25 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1417: -- Summary: [DOCS] Qcon Landing practice of Apache Hudi in T3go added to site (was: [DOCS] Qcon Apache

[jira] [Created] (HUDI-1417) [DOCS] Qcon Apache Hudi's landing practice in T3go added to site

2020-11-25 Thread wangxianghu (Jira)
wangxianghu created HUDI-1417: - Summary: [DOCS] Qcon Apache Hudi's landing practice in T3go added to site Key: HUDI-1417 URL: https://issues.apache.org/jira/browse/HUDI-1417 Project: Apache Hudi

[jira] [Assigned] (HUDI-981) Use rocksDB as flink state backend

2020-11-24 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-981: Assignee: chijunqing (was: wangxianghu) > Use rocksDB as flink state backend >

[jira] [Updated] (HUDI-1412) Make HoodieWriteConfig support setting different default value according to engine type

2020-11-24 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1412: -- Description: Currently, `HoodieIndexConfig` set its default index type to bloom, which is suitable for

[jira] [Updated] (HUDI-1412) Make HoodieWriteConfig support setting different default value according to engine type

2020-11-24 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1412: -- Summary: Make HoodieWriteConfig support setting different default value according to engine type (was:

[jira] [Updated] (HUDI-1412) Make HoodieConfig support setting different default value according to engine type

2020-11-21 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1412: -- Summary: Make HoodieConfig support setting different default value according to engine type (was: Make

[jira] [Created] (HUDI-1412) Make HoodieIndexConfig support setting different default index type according to engine type

2020-11-21 Thread wangxianghu (Jira)
wangxianghu created HUDI-1412: - Summary: Make HoodieIndexConfig support setting different default index type according to engine type Key: HUDI-1412 URL: https://issues.apache.org/jira/browse/HUDI-1412

[jira] [Updated] (HUDI-1405) Make HoodieFlinkStreamer support read props from local fileSystem

2020-11-19 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1405: -- Summary: Make HoodieFlinkStreamer support read props from local fileSystem (was: Make

[jira] [Updated] (HUDI-1403) Decouple HoodieFlinkStreamer from Kafka to support more sources

2020-11-19 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1403: -- Description: currently, `HoodieFlinkStreamer` support read from kafka only. we should enhance it to

[jira] [Updated] (HUDI-1403) Decouple HoodieFlinkStreamer from Kafka to support more sources

2020-11-19 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1403: -- Summary: Decouple HoodieFlinkStreamer from Kafka to support more sources (was: Decouple

[jira] [Updated] (HUDI-1403) Decouple HoodieiFlinkStreamer from Kafka to support more sources

2020-11-19 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1403: -- Summary: Decouple HoodieiFlinkStreamer from Kafka to support more sources (was: Decouple

[jira] [Updated] (HUDI-909) Integrate hudi with flink engine

2020-11-18 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-909: - Description: Integrate hudi with flink engine (was: Introduce hudi-flink-client module to support flink

[jira] [Created] (HUDI-1405) Make HudiFlinkStreamer support read props from local fileSystem

2020-11-18 Thread wangxianghu (Jira)
wangxianghu created HUDI-1405: - Summary: Make HudiFlinkStreamer support read props from local fileSystem Key: HUDI-1405 URL: https://issues.apache.org/jira/browse/HUDI-1405 Project: Apache Hudi

[jira] [Updated] (HUDI-1403) Decouple HudiFlinkStreamer from Kafka to support more sources

2020-11-18 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1403: -- Description: currently, `HudiFlinkStreamer` support read from kafka only. we should enhance it to

[jira] [Assigned] (HUDI-1402) Add a blog about how to use flink engine

2020-11-18 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-1402: - Assignee: wangxianghu > Add a blog about how to use flink engine >

[jira] [Created] (HUDI-1404) Make flink engine support bulkinsert operation

2020-11-18 Thread wangxianghu (Jira)
wangxianghu created HUDI-1404: - Summary: Make flink engine support bulkinsert operation Key: HUDI-1404 URL: https://issues.apache.org/jira/browse/HUDI-1404 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-1403) Decouple HudiFlinkStreamer from Kafka to support more sources

2020-11-18 Thread wangxianghu (Jira)
wangxianghu created HUDI-1403: - Summary: Decouple HudiFlinkStreamer from Kafka to support more sources Key: HUDI-1403 URL: https://issues.apache.org/jira/browse/HUDI-1403 Project: Apache Hudi

[jira] [Created] (HUDI-1402) Add a blog about how to use flink engine

2020-11-18 Thread wangxianghu (Jira)
wangxianghu created HUDI-1402: - Summary: Add a blog about how to use flink engine Key: HUDI-1402 URL: https://issues.apache.org/jira/browse/HUDI-1402 Project: Apache Hudi Issue Type: Sub-task

[jira] [Updated] (HUDI-909) Integerate hudi with flink engine

2020-11-18 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-909: - Summary: Integerate hudi with flink engine (was: Introduce hudi-flink-client module to support flink

[jira] [Updated] (HUDI-909) Integrate hudi with flink engine

2020-11-18 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-909: - Summary: Integrate hudi with flink engine (was: Integerate hudi with flink engine) > Integrate hudi with

[jira] [Updated] (HUDI-1400) Replace Operation enum with WriteOperationType

2020-11-17 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1400: -- Description: currently, we use `org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.Operation`

[jira] [Updated] (HUDI-1400) Replace Operation enum with WriteOperationType

2020-11-17 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1400: -- Summary: Replace Operation enum with WriteOperationType (was: Replace Operation enum with

[jira] [Updated] (HUDI-1400) Replace Operation enum with WriteOperationType in hudi-utilities

2020-11-17 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1400: -- Description: currently, we use `org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.Operation`

[jira] [Assigned] (HUDI-1400) Replace Operation enum with WriteOperationType in hudi-utilities

2020-11-17 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-1400: - Assignee: wangxianghu > Replace Operation enum with WriteOperationType in hudi-utilities >

[jira] [Created] (HUDI-1400) Replace Operation enum with WriteOperationType in hudi-utilities

2020-11-17 Thread wangxianghu (Jira)
wangxianghu created HUDI-1400: - Summary: Replace Operation enum with WriteOperationType in hudi-utilities Key: HUDI-1400 URL: https://issues.apache.org/jira/browse/HUDI-1400 Project: Apache Hudi

[jira] [Updated] (HUDI-1337) Deduplicate data in one batch for flink engine

2020-11-17 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1337: -- Summary: Deduplicate data in one batch for flink engine (was: Introduce FlinkInMemoryHashIndex to

[jira] [Assigned] (HUDI-982) Make flink engine support MOR table

2020-11-17 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu reassigned HUDI-982: Assignee: liujinhui (was: wangxianghu) > Make flink engine support MOR table >

[jira] [Updated] (HUDI-982) Make flink engine support MOR table

2020-11-17 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-982: - Summary: Make flink engine support MOR table (was: Add commit action implemetation to hudi-flink-client)

[jira] [Updated] (HUDI-982) Make flink engine support MOR table

2020-11-17 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-982: - Description: Make flink engine support MOR table (was: Add commit action implemetation to

[jira] [Updated] (HUDI-981) Use rocksDB as flink state backend

2020-11-17 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-981: - Description: Use rocksDB as flink state backend  (was: Add async compact implemetation to

[jira] [Updated] (HUDI-981) Use rocksDB as flink state backend

2020-11-17 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-981: - Summary: Use rocksDB as flink state backend (was: Add async compact implemetation to hudi-flink-client)

[jira] [Commented] (HUDI-1377) clean duplicate code in HoodieSparkSqlWriter

2020-11-10 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229629#comment-17229629 ] wangxianghu commented on HUDI-1377: --- [~wangshikai] please assign this ticket to yourself,then we can

[jira] [Commented] (HUDI-1377) clean duplicate code in HoodieSparkSqlWriter

2020-11-10 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229626#comment-17229626 ] wangxianghu commented on HUDI-1377: --- done via master branch : 430d4b428e7c5b325c7414a187f9cda158c2758a

[jira] [Updated] (HUDI-1377) clean duplicate code in HoodieSparkSqlWriter

2020-11-10 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1377: -- Status: Open (was: New) > clean duplicate code in HoodieSparkSqlWriter >

[jira] [Commented] (HUDI-912) Refactor and relocate KeyGenerator to support more engines

2020-11-02 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17225041#comment-17225041 ] wangxianghu commented on HUDI-912: -- done via master branch : d160abb43740e0bcdf40458c345ecd2d74e6698c >

[jira] [Resolved] (HUDI-912) Refactor and relocate KeyGenerator to support more engines

2020-11-02 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu resolved HUDI-912. -- Resolution: Fixed > Refactor and relocate KeyGenerator to support more engines >

[jira] [Updated] (HUDI-912) Refactor and relocate KeyGenerator to support more engines

2020-11-02 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-912: - Status: Open (was: New) > Refactor and relocate KeyGenerator to support more engines >

[jira] [Updated] (HUDI-913) Update docs about KeyGenerator

2020-10-23 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-913: - Description: update default values about `KeyGenerator`       was: Add read client implemetation to

[jira] [Updated] (HUDI-913) Update docs about KeyGenerator

2020-10-23 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-913: - Summary: Update docs about KeyGenerator (was: Add read client implemetation to hudi-flink-client) >

[jira] [Updated] (HUDI-912) Refactor and relocate KeyGenerator to support more engines

2020-10-22 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-912: - Summary: Refactor and relocate KeyGenerator to support more engines (was: Refactor KeyGenerator and

[jira] [Updated] (HUDI-912) Refactor KeyGenerator and relocate them to support more engines

2020-10-22 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-912: - Description: Currently, `keyGenerator`s are implemented in `hudi-spark` module,  they can only be used by

[jira] [Updated] (HUDI-912) Refactor KeyGenerator and relocate them to support more engines

2020-10-22 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-912: - Description: Currently, `keyGenerator`s are implemented in `hudi-spark` module,  they can only be used by

[jira] [Updated] (HUDI-912) Refactor KeyGenerator and relocate them to support more engines

2020-10-22 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-912: - Summary: Refactor KeyGenerator and relocate them to support more engines (was: Add write client

[jira] [Updated] (HUDI-1327) Introduce base implementation of hudi-flink-client

2020-10-14 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-1327: -- Summary: Introduce base implementation of hudi-flink-client (was: Introduce base implemetation of

[jira] [Updated] (HUDI-911) Add Blog about Hudi-Spark decoupling and Flink integration design

2020-10-13 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-911: - Summary: Add Blog about Hudi-Spark decoupling and Flink integration design (was: Add table implemetation

[jira] [Updated] (HUDI-911) Add Blog about Hudi-Spark decoupling and Flink integration design

2020-10-13 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-911: - Description: Add a blog to Introduction Hudi-Spark decoupling and Flink integration design (was: Add

[jira] [Updated] (HUDI-910) Introduce HoodieWriteInput for hudi write client

2020-10-13 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-910: - Status: Open (was: New) > Introduce HoodieWriteInput for hudi write client >

[jira] [Updated] (HUDI-910) Add Blog about Hudi-Spark decoupling and Flink integration design

2020-10-13 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangxianghu updated HUDI-910: - Description: Intruduce  FlinkHoodieIndex to hudi-flink-client (was: Abstract implemetation of HoodieIndex

  1   2   3   4   >