[jira] [Closed] (HUDI-1062) Remove unnecessary maxEvent check and add some log in KafkaOffsetGen

2020-07-12 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-1062. --- > Remove unnecessary maxEvent check and add some log in KafkaOffsetGen >

[jira] [Resolved] (HUDI-1062) Remove unnecessary maxEvent check and add some log in KafkaOffsetGen

2020-07-12 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-1062. - Fix Version/s: 0.6.0 Resolution: Fixed > Remove unnecessary maxEvent check and add some log in

[jira] [Updated] (HUDI-1064) hoodie table name value trim ( value not trim,the code is not robust)

2020-07-12 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1064: Status: Open (was: New) > hoodie table name value trim ( value not trim,the code is not robust) >

[jira] [Resolved] (HUDI-1064) hoodie table name value trim ( value not trim,the code is not robust)

2020-07-12 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-1064. - Fix Version/s: 0.6.0 Resolution: Fixed > hoodie table name value trim ( value not trim,the code is

[jira] [Closed] (HUDI-1064) hoodie table name value trim ( value not trim,the code is not robust)

2020-07-12 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-1064. --- > hoodie table name value trim ( value not trim,the code is not robust) >

[jira] [Closed] (HUDI-1080) Fix backward compatiblity for com.uber input formats

2020-07-12 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-1080. --- > Fix backward compatiblity for com.uber input formats > > >

[jira] [Closed] (HUDI-678) Make config package spark free

2020-07-02 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-678. -- > Make config package spark free > -- > > Key: HUDI-678 > URL:

[jira] [Commented] (HUDI-86) Add indexing support to the log file format

2020-07-02 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-86?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150080#comment-17150080 ] leesf commented on HUDI-86: --- hi [~vinoth] what's the status here? > Add indexing support to the log file format >

[jira] [Assigned] (HUDI-1048) Support synchronize clustering in MoR mode

2020-06-26 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-1048: --- Assignee: leesf > Support synchronize clustering in MoR mode > -- >

[jira] [Assigned] (HUDI-1047) Support synchronize clustering in CoW mode

2020-06-26 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-1047: --- Assignee: leesf > Support synchronize clustering in CoW mode > -- >

[jira] [Closed] (HUDI-1023) Add validation error messages in delta sync

2020-06-20 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-1023. --- > Add validation error messages in delta sync > --- > > Key:

[jira] [Resolved] (HUDI-1023) Add validation error messages in delta sync

2020-06-20 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-1023. - Resolution: Fixed Fixed via master: 8a9fdd603e3e532ea5252b98205acfb8aa648795 > Add validation error messages in

[jira] [Resolved] (HUDI-696) Add unit test for CommitsCommand

2020-06-20 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-696. Fix Version/s: 0.6.0 Resolution: Fixed Fixed via master: f3a701757b9fb838acc4fb2975f378009d71f104 > Add unit

[jira] [Updated] (HUDI-696) Add unit test for CommitsCommand

2020-06-20 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-696: --- Status: Open (was: New) > Add unit test for CommitsCommand > > >

[jira] [Closed] (HUDI-696) Add unit test for CommitsCommand

2020-06-20 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-696. -- > Add unit test for CommitsCommand > > > Key: HUDI-696 >

[jira] [Commented] (HUDI-1028) Hudi write job stuck when start EmbeddedTimelineService failed

2020-06-17 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138937#comment-17138937 ] leesf commented on HUDI-1028: - [~garyli1019] yes, I encountered it in quickstart, and turned it to false. cc

[jira] [Updated] (HUDI-855) Run Auto Cleaner in parallel with ingestion

2020-06-28 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-855: --- Status: Closed (was: Patch Available) > Run Auto Cleaner in parallel with ingestion >

[jira] [Created] (HUDI-1044) Support Clustering in MoR mode

2020-06-23 Thread leesf (Jira)
leesf created HUDI-1044: --- Summary: Support Clustering in MoR mode Key: HUDI-1044 URL: https://issues.apache.org/jira/browse/HUDI-1044 Project: Apache Hudi Issue Type: Sub-task Reporter:

[jira] [Updated] (HUDI-1043) Support clustering in CoW mode

2020-06-23 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1043: Description: updates are not allowed during clustering > Support clustering in CoW mode >

[jira] [Assigned] (HUDI-1044) Support Clustering in MoR mode

2020-06-23 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-1044: --- Assignee: leesf > Support Clustering in MoR mode > -- > > Key:

[jira] [Updated] (HUDI-1042) [Umbrella] Support clustering on filegroups

2020-06-23 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1042: Summary: [Umbrella] Support clustering on filegroups (was: Support clustering on filegroups) > [Umbrella] Support

[jira] [Created] (HUDI-1042) Support clustering on filegroups

2020-06-23 Thread leesf (Jira)
leesf created HUDI-1042: --- Summary: Support clustering on filegroups Key: HUDI-1042 URL: https://issues.apache.org/jira/browse/HUDI-1042 Project: Apache Hudi Issue Type: Bug Reporter: leesf

[jira] [Created] (HUDI-1043) Support clustering in CoW mode

2020-06-23 Thread leesf (Jira)
leesf created HUDI-1043: --- Summary: Support clustering in CoW mode Key: HUDI-1043 URL: https://issues.apache.org/jira/browse/HUDI-1043 Project: Apache Hudi Issue Type: Sub-task Reporter:

[jira] [Created] (HUDI-1048) Support synchronize clustering in MoR mode

2020-06-23 Thread leesf (Jira)
leesf created HUDI-1048: --- Summary: Support synchronize clustering in MoR mode Key: HUDI-1048 URL: https://issues.apache.org/jira/browse/HUDI-1048 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-1046) Support updates during clustering in CoW mode

2020-06-23 Thread leesf (Jira)
leesf created HUDI-1046: --- Summary: Support updates during clustering in CoW mode Key: HUDI-1046 URL: https://issues.apache.org/jira/browse/HUDI-1046 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-1045) Support updates during clustering in MoR mode

2020-06-23 Thread leesf (Jira)
leesf created HUDI-1045: --- Summary: Support updates during clustering in MoR mode Key: HUDI-1045 URL: https://issues.apache.org/jira/browse/HUDI-1045 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-1047) Support synchronize clustering in CoW mode

2020-06-23 Thread leesf (Jira)
leesf created HUDI-1047: --- Summary: Support synchronize clustering in CoW mode Key: HUDI-1047 URL: https://issues.apache.org/jira/browse/HUDI-1047 Project: Apache Hudi Issue Type: Sub-task

[jira] [Updated] (HUDI-1044) Support Clustering in MoR mode

2020-06-23 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1044: Description: updates are not allowed during clustering > Support Clustering in MoR mode >

[jira] [Closed] (HUDI-990) Timeline API : filterCompletedAndCompactionInstants needs to handle requested state correctly

2020-06-06 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-990. -- > Timeline API : filterCompletedAndCompactionInstants needs to handle requested > state correctly >

[jira] [Resolved] (HUDI-988) Fix unit test flakiness in Hudi

2020-06-06 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-988. Fix Version/s: 0.6.0 Resolution: Fixed Fixed via master: a68180b179ae57f16ff0a8d74b72b43b501d36c6 > Fix unit

[jira] [Closed] (HUDI-988) Fix unit test flakiness in Hudi

2020-06-06 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-988. -- > Fix unit test flakiness in Hudi > --- > > Key: HUDI-988 > URL:

[jira] [Updated] (HUDI-1002) Ignore case when setting incremental mode in hive query

2020-06-06 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1002: Issue Type: Improvement (was: Bug) > Ignore case when setting incremental mode in hive query >

[jira] [Created] (HUDI-1002) Ignore case when setting incremental mode in hive query

2020-06-06 Thread leesf (Jira)
leesf created HUDI-1002: --- Summary: Ignore case when setting incremental mode in hive query Key: HUDI-1002 URL: https://issues.apache.org/jira/browse/HUDI-1002 Project: Apache Hudi Issue Type: Bug

[jira] [Resolved] (HUDI-990) Timeline API : filterCompletedAndCompactionInstants needs to handle requested state correctly

2020-06-06 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-990. Resolution: Fixed Fixed via master: fb283934a33a0bc7b11f80e4149f7922fa4f0af5 > Timeline API :

[jira] [Updated] (HUDI-1003) Handle partitions correctly when sync non-partitioned table to hive.

2020-06-06 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1003: Summary: Handle partitions correctly when sync non-partitioned table to hive. (was: Handle partitions when sync

[jira] [Created] (HUDI-1003) Handle partitions when sync non-partitioned table to hive.

2020-06-06 Thread leesf (Jira)
leesf created HUDI-1003: --- Summary: Handle partitions when sync non-partitioned table to hive. Key: HUDI-1003 URL: https://issues.apache.org/jira/browse/HUDI-1003 Project: Apache Hudi Issue Type: Bug

[jira] [Resolved] (HUDI-975) Add unit tests in TestHoodieTableFileSystemView to test view for non-partitioned table

2020-06-06 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-975. Resolution: Fixed Fxied via master: 7c59095314f5525590eea308084079a31bde3e17 > Add unit tests in

[jira] [Updated] (HUDI-934) Hive query does not work with realtime table which contain decimal type

2020-06-06 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-934: --- Fix Version/s: 0.6.0 > Hive query does not work with realtime table which contain decimal type >

[jira] [Closed] (HUDI-975) Add unit tests in TestHoodieTableFileSystemView to test view for non-partitioned table

2020-06-06 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-975. -- > Add unit tests in TestHoodieTableFileSystemView to test view for > non-partitioned table >

[jira] [Resolved] (HUDI-1000) incremental query for COW non-partitioned table no data

2020-06-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-1000. - Fix Version/s: 0.6.0 Resolution: Fixed Fixed via master: e0a5e0d3435acc5f01812aa46d96cc7d5eb65860 >

[jira] [Closed] (HUDI-1000) incremental query for COW non-partitioned table no data

2020-06-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-1000. --- > incremental query for COW non-partitioned table no data > --- > >

[jira] [Updated] (HUDI-1000) incremental query for COW non-partitioned table no data

2020-06-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1000: Status: Open (was: New) > incremental query for COW non-partitioned table no data >

[jira] [Closed] (HUDI-1002) Ignore case when setting incremental mode in hive query

2020-06-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-1002. --- Fixed via master: 2901f5423a08c8f0c5fe60c8a3f23acbd36c0aed > Ignore case when setting incremental mode in hive query >

[jira] [Closed] (HUDI-1005) NPE in HoodieWriteClient.clean

2020-06-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-1005. --- > NPE in HoodieWriteClient.clean > --- > > Key: HUDI-1005 >

[jira] [Updated] (HUDI-942) Increase minmum number of delta commits for inline compaction

2020-06-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-942: --- Status: Closed (was: Patch Available) > Increase minmum number of delta commits for inline compaction >

[jira] [Closed] (HUDI-515) Resolve API conflict for Hive 2 and Hive 3

2020-06-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-515. -- > Resolve API conflict for Hive 2 and Hive 3 > -- > > Key: HUDI-515

[jira] [Updated] (HUDI-515) Resolve API conflict for Hive 2 and Hive 3

2020-06-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-515: --- Status: Open (was: New) > Resolve API conflict for Hive 2 and Hive 3 > -- > >

[jira] [Resolved] (HUDI-515) Resolve API conflict for Hive 2 and Hive 3

2020-06-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-515. Resolution: Fixed Fixed via master: 7d40f19f395460bc78a12ac452831a9f0393ab49 > Resolve API conflict for Hive 2 and

[jira] [Updated] (HUDI-1019) Clean refresh command in CLI

2020-06-14 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1019: Status: Open (was: New) > Clean refresh command in CLI > > > Key:

[jira] [Resolved] (HUDI-1019) Clean refresh command in CLI

2020-06-14 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-1019. - Fix Version/s: 0.6.0 Resolution: Fixed Fixed via master: fcabc8fbca1670c9d50105495278ff147ccbdd4a > Clean

[jira] [Closed] (HUDI-1012) add test for snapshot reads

2020-06-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-1012. --- > add test for snapshot reads > --- > > Key: HUDI-1012 > URL:

[jira] [Resolved] (HUDI-1012) add test for snapshot reads

2020-06-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-1012. - Fix Version/s: 0.6.0 Resolution: Fixed Fixed via master: a7fd33162447b4c2816d1910bb166721cff1ed31 > add

[jira] [Updated] (HUDI-1012) add test for snapshot reads

2020-06-13 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1012: Status: Open (was: New) > add test for snapshot reads > --- > > Key:

[jira] [Resolved] (HUDI-1006) deltastreamer use kafkaSource with offset reset strategy: latest can't consume data

2020-06-14 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-1006. - Resolution: Fixed Fixed via master: ede6c9bda4dba8a9981252bd05f0725ff1024b95 > deltastreamer use kafkaSource

[jira] [Closed] (HUDI-1006) deltastreamer use kafkaSource with offset reset strategy: latest can't consume data

2020-06-14 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-1006. --- > deltastreamer use kafkaSource with offset reset strategy: latest can't > consume data >

[jira] [Created] (HUDI-1110) Support update partial fields

2020-07-17 Thread leesf (Jira)
leesf created HUDI-1110: --- Summary: Support update partial fields Key: HUDI-1110 URL: https://issues.apache.org/jira/browse/HUDI-1110 Project: Apache Hudi Issue Type: New Feature Reporter:

[jira] [Commented] (HUDI-1092) Hudi support from prestosql

2020-07-17 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159827#comment-17159827 ] leesf commented on HUDI-1092: - hi, [~bhavanisudha], I think perstosql would already support hudi similar to

[jira] [Created] (HUDI-1109) Support Spark Structured Streaming read from Hudi table

2020-07-17 Thread leesf (Jira)
leesf created HUDI-1109: --- Summary: Support Spark Structured Streaming read from Hudi table Key: HUDI-1109 URL: https://issues.apache.org/jira/browse/HUDI-1109 Project: Apache Hudi Issue Type: Bug

[jira] [Updated] (HUDI-1109) Support Spark Structured Streaming read from Hudi table

2020-07-17 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1109: Issue Type: New Feature (was: Bug) > Support Spark Structured Streaming read from Hudi table >

[jira] [Assigned] (HUDI-1110) Support update partial fields

2020-07-29 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-1110: --- Assignee: leesf > Support update partial fields > - > > Key:

[jira] [Updated] (HUDI-1102) Separate out Spark and Path detection utilities used in Bootstrap datasource work

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1102: Status: Open (was: New) > Separate out Spark and Path detection utilities used in Bootstrap datasource > work >

[jira] [Closed] (HUDI-92) Include custom names for spark HUDI spark DAG stages for easier understanding

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-92?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-92. - > Include custom names for spark HUDI spark DAG stages for easier understanding >

[jira] [Closed] (HUDI-1102) Separate out Spark and Path detection utilities used in Bootstrap datasource work

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-1102. --- > Separate out Spark and Path detection utilities used in Bootstrap datasource > work >

[jira] [Resolved] (HUDI-1102) Separate out Spark and Path detection utilities used in Bootstrap datasource work

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-1102. - Fix Version/s: 0.6.0 Resolution: Fixed > Separate out Spark and Path detection utilities used in Bootstrap

[jira] [Closed] (HUDI-839) Implement rollbacks using marker files instead of relying on commit metadata

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-839. -- > Implement rollbacks using marker files instead of relying on commit metadata >

[jira] [Resolved] (HUDI-871) Add support for Tencent cloud COS

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-871. Resolution: Fixed > Add support for Tencent cloud COS > - > > Key:

[jira] [Updated] (HUDI-871) Add support for Tencent cloud COS

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-871: --- Fix Version/s: 0.6.0 > Add support for Tencent cloud COS > - > > Key:

[jira] [Closed] (HUDI-871) Add support for Tencent cloud COS

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-871. -- > Add support for Tencent cloud COS > - > > Key: HUDI-871 >

[jira] [Updated] (HUDI-802) AWSDmsTransformer does not handle insert -> delete of a row in a single batch correctly

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-802: --- Status: Closed (was: Patch Available) > AWSDmsTransformer does not handle insert -> delete of a row in a single batch

[jira] [Closed] (HUDI-1082) Bug in deciding the upsert/insert buckets

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-1082. --- > Bug in deciding the upsert/insert buckets > - > > Key:

[jira] [Resolved] (HUDI-1082) Bug in deciding the upsert/insert buckets

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-1082. - Resolution: Fixed > Bug in deciding the upsert/insert buckets > - > >

[jira] [Updated] (HUDI-1082) Bug in deciding the upsert/insert buckets

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1082: Fix Version/s: (was: 0.6.1) 0.6.0 > Bug in deciding the upsert/insert buckets >

[jira] [Updated] (HUDI-1082) Bug in deciding the upsert/insert buckets

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1082: Status: Open (was: New) > Bug in deciding the upsert/insert buckets > - >

[jira] [Resolved] (HUDI-985) Introduce rerun ci bot

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-985. Fix Version/s: 0.6.0 Resolution: Fixed > Introduce rerun ci bot > -- > >

[jira] [Closed] (HUDI-985) Introduce rerun ci bot

2020-07-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-985. -- > Introduce rerun ci bot > -- > > Key: HUDI-985 > URL:

[jira] [Assigned] (HUDI-871) Add support for Tencent cloud COS

2020-07-20 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-871: -- Assignee: deyzhong > Add support for Tencent cloud COS > - > >

[jira] [Comment Edited] (HUDI-871) Add support for Tencent cloud COS

2020-07-20 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161718#comment-17161718 ] leesf edited comment on HUDI-871 at 7/21/20, 5:35 AM: -- [~meimile] Sure, assigned to

[jira] [Commented] (HUDI-871) Add support for Tencent cloud COS

2020-07-20 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161718#comment-17161718 ] leesf commented on HUDI-871: [~meimile] Sure, feel free to open a new PR. > Add support for Tencent cloud COS

[jira] [Closed] (HUDI-1113) Support user defined metrics reporter

2020-07-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-1113. --- > Support user defined metrics reporter > - > > Key: HUDI-1113 >

[jira] [Resolved] (HUDI-1113) Support user defined metrics reporter

2020-07-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-1113. - Resolution: Fixed > Support user defined metrics reporter > - > >

[jira] [Updated] (HUDI-1113) Support user defined metrics reporter

2020-07-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1113: Fix Version/s: (was: 0.5.3) 0.60 > Support user defined metrics reporter >

[jira] [Updated] (HUDI-1113) Support user defined metrics reporter

2020-07-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1113: Fix Version/s: (was: 0.60) 0.6.0 > Support user defined metrics reporter >

[jira] [Updated] (HUDI-1113) Support user defined metrics reporter

2020-07-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1113: Status: Open (was: New) > Support user defined metrics reporter > - > >

[jira] [Commented] (HUDI-1123) Document the usage of user define metrics reporter

2020-07-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164174#comment-17164174 ] leesf commented on HUDI-1123: - [~york831] . Assign the ticket to you and feel free to open a new PR, thanks >

[jira] [Created] (HUDI-1123) Document the usage of user define metrics reporter

2020-07-24 Thread leesf (Jira)
leesf created HUDI-1123: --- Summary: Document the usage of user define metrics reporter Key: HUDI-1123 URL: https://issues.apache.org/jira/browse/HUDI-1123 Project: Apache Hudi Issue Type: Improvement

[jira] [Assigned] (HUDI-1123) Document the usage of user define metrics reporter

2020-07-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-1123: --- Assignee: Zheren Yu > Document the usage of user define metrics reporter >

[jira] [Updated] (HUDI-1123) Document the usage of user define metrics reporter

2020-07-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-1123: Description: (was: [~york831] . Assign the ticket to you and feel free to open a new PR, thanks) > Document

[jira] [Commented] (HUDI-1124) Document the usage of Tencent COSN

2020-07-24 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164176#comment-17164176 ] leesf commented on HUDI-1124: - [~meimile] Assign the ticket to you and feel free to open a new PR, thanks >

[jira] [Created] (HUDI-1124) Document the usage of Tencent COSN

2020-07-24 Thread leesf (Jira)
leesf created HUDI-1124: --- Summary: Document the usage of Tencent COSN Key: HUDI-1124 URL: https://issues.apache.org/jira/browse/HUDI-1124 Project: Apache Hudi Issue Type: Improvement

[jira] [Updated] (HUDI-841) Abstract common meta sync module support multiple meta service

2020-07-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-841: --- Fix Version/s: 0.6.0 > Abstract common meta sync module support multiple meta service >

[jira] [Updated] (HUDI-841) Abstract common meta sync module support multiple meta service

2020-07-30 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-841: --- Priority: Blocker (was: Major) > Abstract common meta sync module support multiple meta service >

[jira] [Updated] (HUDI-635) MergeHandle's DiskBasedMap entries can be thinner

2020-07-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-635: --- Labels: help-requested newbie starter (was: help-requested) > MergeHandle's DiskBasedMap entries can be thinner >

[jira] [Commented] (HUDI-871) Add support for Tencent cloud COS

2020-07-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151576#comment-17151576 ] leesf commented on HUDI-871: hi [~felixzheng], do you have time to send a PR? > Add support for Tencent cloud

[jira] [Updated] (HUDI-871) Add support for Tencent cloud COS

2020-07-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-871: --- Labels: newbie starter (was: ) > Add support for Tencent cloud COS > - > >

[jira] [Updated] (HUDI-47) Revisit null checks in the Log Blocks, merge lazyreading with this null check #340

2020-07-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-47?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-47: -- Labels: help-requested newbie starter (was: help-requested) > Revisit null checks in the Log Blocks, merge lazyreading

[jira] [Updated] (HUDI-865) Improve Hive Syncing by directly translating avro schema to Hive types

2020-07-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-865: --- Labels: starter (was: ) > Improve Hive Syncing by directly translating avro schema to Hive types >

[jira] [Updated] (HUDI-274) Consolidate all scripts under top level scripts directory

2020-07-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-274: --- Labels: starter (was: ) > Consolidate all scripts under top level scripts directory >

[jira] [Updated] (HUDI-284) Need Tests for Hudi handling of schema evolution

2020-07-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-284: --- Labels: help-requested starter (was: help-requested) > Need Tests for Hudi handling of schema evolution >

[jira] [Updated] (HUDI-465) Make Hive Sync via Spark painless

2020-07-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-465: --- Labels: help-wanted starter (was: ) > Make Hive Sync via Spark painless > - > >

[jira] [Updated] (HUDI-323) Docker demo/integ-test stdout/stderr output only available on process exit

2020-07-05 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-323: --- Labels: help-wanted newbie (was: ) > Docker demo/integ-test stdout/stderr output only available on process exit >

<    2   3   4   5   6   7   8   >