[jira] [Updated] (HUDI-5112) Add presto query validation support for all tests in integ tests

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5112: -- Sprint: 2022/11/01 > Add presto query validation support for all tests in integ tests >

[jira] [Updated] (HUDI-5111) Add metadata on read support to integ tests

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5111: -- Priority: Critical (was: Major) > Add metadata on read support to integ tests >

[jira] [Updated] (HUDI-5111) Add metadata on read support to integ tests

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5111: -- Sprint: 2022/11/01 > Add metadata on read support to integ tests >

[jira] [Created] (HUDI-5111) Add metadata on read support to integ tests

2022-10-31 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-5111: - Summary: Add metadata on read support to integ tests Key: HUDI-5111 URL: https://issues.apache.org/jira/browse/HUDI-5111 Project: Apache Hudi

[jira] [Updated] (HUDI-5111) Add metadata on read support to integ tests

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5111: -- Fix Version/s: 0.12.2 > Add metadata on read support to integ tests >

[jira] [Created] (HUDI-5112) Add presto query validation support for all tests in integ tests

2022-10-31 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-5112: - Summary: Add presto query validation support for all tests in integ tests Key: HUDI-5112 URL: https://issues.apache.org/jira/browse/HUDI-5112 Project:

[jira] [Assigned] (HUDI-5111) Add metadata on read support to integ tests

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-5111: - Assignee: sivabalan narayanan > Add metadata on read support to integ tests >

[jira] [Commented] (HUDI-4859) Adding a blog on how to run Hudi on Serverless Platforms (AWS Glue)

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626837#comment-17626837 ] sivabalan narayanan commented on HUDI-4859: --- cool. do add me as reviewer once you have the blog

[jira] [Updated] (HUDI-5056) Add support to DELETE_PARTITIONS w/ wild card

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5056: -- Story Points: 4 (was: 3) > Add support to DELETE_PARTITIONS w/ wild card >

[jira] [Updated] (HUDI-4863) Deprecate `hoodie.compaction.payload.class` and re-use hoodie.datasource.write.payload.class

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4863: -- Story Points: 2 > Deprecate `hoodie.compaction.payload.class` and re-use >

[jira] [Updated] (HUDI-5056) Add support to DELETE_PARTITIONS w/ wild card

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5056: -- Story Points: 3 > Add support to DELETE_PARTITIONS w/ wild card >

[jira] [Updated] (HUDI-4863) Deprecate `hoodie.compaction.payload.class` and re-use hoodie.datasource.write.payload.class

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4863: -- Sprint: 2022/11/01 > Deprecate `hoodie.compaction.payload.class` and re-use >

[jira] [Assigned] (HUDI-4863) Deprecate `hoodie.compaction.payload.class` and re-use hoodie.datasource.write.payload.class

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-4863: - Assignee: Jonathan Vexler > Deprecate `hoodie.compaction.payload.class` and

[jira] [Updated] (HUDI-5032) Add Archiving to the CLI

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5032: -- Story Points: 2 > Add Archiving to the CLI > > >

[jira] [Updated] (HUDI-5099) Update stock data so that new records are added in batch_2

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5099: -- Sprint: 2022/10/18 > Update stock data so that new records are added in batch_2 >

[jira] [Updated] (HUDI-5032) Add Archiving to the CLI

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5032: -- Sprint: 2022/10/18 > Add Archiving to the CLI > > >

[jira] [Updated] (HUDI-5099) Update stock data so that new records are added in batch_2

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5099: -- Story Points: 2 > Update stock data so that new records are added in batch_2 >

[jira] [Updated] (HUDI-5065) HoodieCleaner does not exit after completion

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5065: -- Story Points: 1 > HoodieCleaner does not exit after completion >

[jira] [Updated] (HUDI-5074) Auto convert table names to lower case due to hive sync issues

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5074: -- Story Points: 1 > Auto convert table names to lower case due to hive sync issues >

[jira] [Updated] (HUDI-4967) Improve docs for meta sync with TimestampBasedKeyGenerator

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4967: -- Story Points: 1 > Improve docs for meta sync with TimestampBasedKeyGenerator >

[jira] [Updated] (HUDI-5018) Make user-provided copyOnWriteRecordSizeEstimate first precedence

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5018: -- Story Points: 2 > Make user-provided copyOnWriteRecordSizeEstimate first precedence >

[jira] [Updated] (HUDI-4888) Add validation to block COW table to use consistent hashing bucket index

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4888: -- Story Points: 1 > Add validation to block COW table to use consistent hashing bucket

[jira] [Updated] (HUDI-4990) Parallelize deduplication in CLI tool

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4990: -- Story Points: 2 > Parallelize deduplication in CLI tool >

[jira] [Updated] (HUDI-4886) Detect incompatible schema change during deltastreamer ingestion

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4886: -- Story Points: 3 > Detect incompatible schema change during deltastreamer ingestion >

[jira] [Updated] (HUDI-5036) Update contribution guide based on PR validation

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5036: -- Story Points: 0.5 > Update contribution guide based on PR validation >

[jira] [Updated] (HUDI-4886) Detect incompatible schema change during deltastreamer ingestion

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4886: -- Sprint: 2022/11/01 > Detect incompatible schema change during deltastreamer ingestion >

[jira] [Assigned] (HUDI-4886) Detect incompatible schema change during deltastreamer ingestion

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-4886: - Assignee: Jonathan Vexler > Detect incompatible schema change during

[jira] [Updated] (HUDI-4888) Add validation to block COW table to use consistent hashing bucket index

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4888: -- Sprint: 2022/11/01 > Add validation to block COW table to use consistent hashing bucket

[jira] [Assigned] (HUDI-4967) Improve docs for meta sync with TimestampBasedKeyGenerator

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-4967: - Assignee: Jonathan Vexler > Improve docs for meta sync with

[jira] [Assigned] (HUDI-4888) Add validation to block COW table to use consistent hashing bucket index

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-4888: - Assignee: Jonathan Vexler > Add validation to block COW table to use consistent

[jira] [Updated] (HUDI-4967) Improve docs for meta sync with TimestampBasedKeyGenerator

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4967: -- Sprint: 2022/11/01 > Improve docs for meta sync with TimestampBasedKeyGenerator >

[jira] [Assigned] (HUDI-5018) Make user-provided copyOnWriteRecordSizeEstimate first precedence

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-5018: - Assignee: Jonathan Vexler > Make user-provided copyOnWriteRecordSizeEstimate

[jira] [Assigned] (HUDI-4990) Parallelize deduplication in CLI tool

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-4990: - Assignee: Jonathan Vexler > Parallelize deduplication in CLI tool >

[jira] [Updated] (HUDI-5036) Update contribution guide based on PR validation

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5036: -- Sprint: 2022/11/01 > Update contribution guide based on PR validation >

[jira] [Updated] (HUDI-4990) Parallelize deduplication in CLI tool

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4990: -- Sprint: 2022/11/01 > Parallelize deduplication in CLI tool >

[jira] [Updated] (HUDI-5018) Make user-provided copyOnWriteRecordSizeEstimate first precedence

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5018: -- Sprint: 2022/11/01 > Make user-provided copyOnWriteRecordSizeEstimate first precedence

[jira] [Commented] (HUDI-4867) Fixed the issue that compaction is invalid when the last commit action is replace commit.

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626810#comment-17626810 ] sivabalan narayanan commented on HUDI-4867: --- is this a duplicate of

[jira] [Updated] (HUDI-4876) DT archival is blocked by MDT compaction

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4876: -- Fix Version/s: 0.12.2 > DT archival is blocked by MDT compaction >

[jira] [Commented] (HUDI-4876) DT archival is blocked by MDT compaction

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626806#comment-17626806 ] sivabalan narayanan commented on HUDI-4876: --- Duplicate

[jira] [Closed] (HUDI-4876) DT archival is blocked by MDT compaction

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4876. - Assignee: sivabalan narayanan Resolution: Duplicate

[jira] [Closed] (HUDI-4893) More than 1 splits are created for a single log file for MOR table

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4893. - Fix Version/s: 0.12.2 (was: 0.13.0) Resolution: Fixed >

[jira] [Updated] (HUDI-4893) More than 1 splits are created for a single log file for MOR table

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4893: -- Status: Open (was: In Progress) > More than 1 splits are created for a single log file

[jira] [Updated] (HUDI-4963) Extend InProcessLockProvider to support multiple table ingestion

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4963: -- Fix Version/s: 0.12.2 > Extend InProcessLockProvider to support multiple table

[jira] [Closed] (HUDI-4963) Extend InProcessLockProvider to support multiple table ingestion

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4963. - Resolution: Fixed > Extend InProcessLockProvider to support multiple table ingestion >

[jira] [Updated] (HUDI-5003) InLineFileSystem will throw NumberFormatException, cause the type of startOffset is int and out of bounds

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5003: -- Fix Version/s: 0.12.2 > InLineFileSystem will throw NumberFormatException, cause the

[jira] [Closed] (HUDI-5003) InLineFileSystem will throw NumberFormatException, cause the type of startOffset is int and out of bounds

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-5003. - Resolution: Fixed > InLineFileSystem will throw NumberFormatException, cause the type of

[jira] [Updated] (HUDI-5022) Add better error messages to pr compliance

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5022: -- Fix Version/s: 0.12.2 > Add better error messages to pr compliance >

[jira] [Closed] (HUDI-5022) Add better error messages to pr compliance

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-5022. - Resolution: Fixed > Add better error messages to pr compliance >

[jira] [Assigned] (HUDI-5028) Handle conficting writes for multi-writers with OCC enabled

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-5028: - Assignee: sivabalan narayanan > Handle conficting writes for multi-writers with

[jira] [Updated] (HUDI-5028) Handle conficting writes for multi-writers with OCC enabled

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5028: -- Sprint: 2022/10/18 > Handle conficting writes for multi-writers with OCC enabled >

[jira] [Updated] (HUDI-5041) lock metric register confict error

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5041: -- Fix Version/s: 0.12.2 > lock metric register confict error >

[jira] [Assigned] (HUDI-5036) Update contribution guide based on PR validation

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-5036: - Assignee: Jonathan Vexler > Update contribution guide based on PR validation >

[jira] [Closed] (HUDI-5041) lock metric register confict error

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-5041. - Resolution: Fixed > lock metric register confict error >

[jira] [Assigned] (HUDI-5056) Add support to DELETE_PARTITIONS w/ wild card

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-5056: - Assignee: Jonathan Vexler > Add support to DELETE_PARTITIONS w/ wild card >

[jira] [Updated] (HUDI-5056) Add support to DELETE_PARTITIONS w/ wild card

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5056: -- Sprint: 2022/11/01 > Add support to DELETE_PARTITIONS w/ wild card >

[jira] [Updated] (HUDI-5109) Source all metadata table instability issues

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5109: -- Summary: Source all metadata table instability issues (was: Source all metadata table

[jira] [Assigned] (HUDI-5109) Source all metadata table stability /corrupt scenarios

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-5109: - Epic Link: HUDI-1292 Story Points: 3 Assignee: Sagar Sumit >

[jira] [Updated] (HUDI-5109) Source all metadata table stability /corrupt scenarios

2022-10-31 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5109: -- Fix Version/s: 0.12.2 > Source all metadata table stability /corrupt scenarios >

[jira] [Created] (HUDI-5109) Source all metadata table stability /corrupt scenarios

2022-10-31 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-5109: - Summary: Source all metadata table stability /corrupt scenarios Key: HUDI-5109 URL: https://issues.apache.org/jira/browse/HUDI-5109 Project: Apache Hudi

[jira] [Updated] (HUDI-4852) Incremental sync not updating pending file groups under clustering

2022-10-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4852: -- Fix Version/s: 0.12.2 > Incremental sync not updating pending file groups under

[jira] [Assigned] (HUDI-4852) Incremental sync not updating pending file groups under clustering

2022-10-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-4852: - Assignee: Surya Prasanna Yalla > Incremental sync not updating pending file

[jira] [Updated] (HUDI-5101) Adding spark structured streaming tests to integ tests

2022-10-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5101: -- Status: Patch Available (was: In Progress) > Adding spark structured streaming tests

[jira] [Updated] (HUDI-5101) Adding spark structured streaming tests to integ tests

2022-10-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5101: -- Status: In Progress (was: Open) > Adding spark structured streaming tests to integ

[jira] [Updated] (HUDI-5101) Adding spark structured streaming tests to integ tests

2022-10-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5101: -- Fix Version/s: 0.12.2 > Adding spark structured streaming tests to integ tests >

[jira] [Updated] (HUDI-5101) Adding spark structured streaming tests to integ tests

2022-10-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5101: -- Story Points: 3 > Adding spark structured streaming tests to integ tests >

[jira] [Created] (HUDI-5101) Adding spark structured streaming tests to integ tests

2022-10-26 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-5101: - Summary: Adding spark structured streaming tests to integ tests Key: HUDI-5101 URL: https://issues.apache.org/jira/browse/HUDI-5101 Project: Apache Hudi

[jira] [Updated] (HUDI-5101) Adding spark structured streaming tests to integ tests

2022-10-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5101: -- Sprint: 2022/10/18 > Adding spark structured streaming tests to integ tests >

[jira] [Assigned] (HUDI-5101) Adding spark structured streaming tests to integ tests

2022-10-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-5101: - Assignee: sivabalan narayanan > Adding spark structured streaming tests to integ

[jira] [Closed] (HUDI-4998) Inference of META_SYNC_PARTITION_EXTRACTOR_CLASS does not work

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4998. - Fix Version/s: 0.12.2 Resolution: Fixed > Inference of

[jira] [Closed] (HUDI-5052) Update 0.12.0 docs for regression

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-5052. - Resolution: Fixed > Update 0.12.0 docs for regression > -

[jira] [Closed] (HUDI-4997) use jackson-v2 replace jackson-v1 import

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4997. - Resolution: Fixed > use jackson-v2 replace jackson-v1 import >

[jira] [Updated] (HUDI-4997) use jackson-v2 replace jackson-v1 import

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4997: -- Status: Open (was: In Progress) > use jackson-v2 replace jackson-v1 import >

[jira] [Closed] (HUDI-4901) Add avro version to Flink profiles

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4901. - Fix Version/s: 0.12.2 (was: 0.12.1) Resolution: Fixed > Add

[jira] [Assigned] (HUDI-4901) Add avro version to Flink profiles

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-4901: - Assignee: Shawn Chang > Add avro version to Flink profiles >

[jira] [Reopened] (HUDI-4901) Add avro version to Flink profiles

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-4901: --- > Add avro version to Flink profiles > -- > >

[jira] [Closed] (HUDI-4960) Upgrade Jetty version for Timeline server

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4960. - Fix Version/s: 0.12.2 Resolution: Fixed > Upgrade Jetty version for Timeline

[jira] [Closed] (HUDI-5063) totalScantime and other run time stats missing from commit metadata

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-5063. - Resolution: Fixed > totalScantime and other run time stats missing from commit metadata >

[jira] [Closed] (HUDI-4718) Hudi cli does not support Kerberized Hadoop cluster

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4718. - Resolution: Fixed > Hudi cli does not support Kerberized Hadoop cluster >

[jira] [Closed] (HUDI-5027) Replace hardcoded hbase config keys with HbaseConstants

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-5027. - Resolution: Fixed > Replace hardcoded hbase config keys with HbaseConstants >

[jira] [Updated] (HUDI-5027) Replace hardcoded hbase config keys with HbaseConstants

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5027: -- Status: Open (was: In Progress) > Replace hardcoded hbase config keys with

[jira] [Updated] (HUDI-5061) bulk insert operation don't throw other exception except IOE Exception

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5061: -- Fix Version/s: 0.12.2 > bulk insert operation don't throw other exception except IOE

[jira] [Closed] (HUDI-4281) Using hudi to build a large number of tables in spark on hive causes OOM

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4281. - Resolution: Fixed > Using hudi to build a large number of tables in spark on hive causes

[jira] [Closed] (HUDI-5061) bulk insert operation don't throw other exception except IOE Exception

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-5061. - Resolution: Fixed > bulk insert operation don't throw other exception except IOE

[jira] [Closed] (HUDI-4753) More accurate evaluation of log record during log writing or compaction

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4753. - Resolution: Fixed > More accurate evaluation of log record during log writing or

[jira] [Reopened] (HUDI-5042) Fix clustering schedule problem in flink when enable schedule clustering and disable async clustering

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-5042: --- > Fix clustering schedule problem in flink when enable schedule clustering and > disable

[jira] [Closed] (HUDI-4201) Add tooling to delete empty non-completed instants from timeline

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4201. - Resolution: Fixed > Add tooling to delete empty non-completed instants from timeline >

[jira] [Closed] (HUDI-5042) Fix clustering schedule problem in flink when enable schedule clustering and disable async clustering

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-5042. - Resolution: Fixed > Fix clustering schedule problem in flink when enable schedule

[jira] [Closed] (HUDI-5049) Supports dropPartition for Flink catalog

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-5049. - Resolution: Fixed > Supports dropPartition for Flink catalog >

[jira] [Updated] (HUDI-4201) Add tooling to delete empty non-completed instants from timeline

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4201: -- Status: Open (was: In Progress) > Add tooling to delete empty non-completed instants

[jira] [Reopened] (HUDI-5049) Supports dropPartition for Flink catalog

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-5049: --- > Supports dropPartition for Flink catalog > - >

[jira] [Closed] (HUDI-5038) Increase default num_instants to fetch for incremental source

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-5038. - Assignee: Ethan Guo Resolution: Fixed > Increase default num_instants to fetch for

[jira] [Closed] (HUDI-4809) Hudi Support AWS Glue DropPartitions

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4809. - Resolution: Fixed > Hudi Support AWS Glue DropPartitions >

[jira] [Updated] (HUDI-4809) Hudi Support AWS Glue DropPartitions

2022-10-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4809: -- Fix Version/s: 0.12.2 > Hudi Support AWS Glue DropPartitions >

[jira] [Updated] (HUDI-5065) HoodieCleaner does not exit after completion

2022-10-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5065: -- Sprint: 2022/10/18 > HoodieCleaner does not exit after completion >

[jira] [Assigned] (HUDI-5065) HoodieCleaner does not exit after completion

2022-10-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-5065: - Assignee: Jonathan Vexler (was: sivabalan narayanan) > HoodieCleaner does not

[jira] [Updated] (HUDI-5080) UnpersistRdds unpersist all rdds in the spark context

2022-10-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5080: -- Description: In SparkRDDWriteClient, we have a method to clean up persisted Rdds to

[jira] [Updated] (HUDI-5080) UnpersistRdds unpersist all rdds in the spark context

2022-10-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5080: -- Sprint: 2022/10/18 > UnpersistRdds unpersist all rdds in the spark context >

[jira] [Created] (HUDI-5080) UnpersistRdds unpersist all rdds in the spark context

2022-10-22 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-5080: - Summary: UnpersistRdds unpersist all rdds in the spark context Key: HUDI-5080 URL: https://issues.apache.org/jira/browse/HUDI-5080 Project: Apache Hudi

[jira] [Updated] (HUDI-5080) UnpersistRdds unpersist all rdds in the spark context

2022-10-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5080: -- Priority: Critical (was: Major) > UnpersistRdds unpersist all rdds in the spark

[jira] [Updated] (HUDI-5080) UnpersistRdds unpersist all rdds in the spark context

2022-10-22 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-5080: -- Fix Version/s: 0.12.2 > UnpersistRdds unpersist all rdds in the spark context >

<    7   8   9   10   11   12   13   14   15   16   >