[jira] [Updated] (HUDI-1290) Implement Debezium avro source for Delta Streamer

2021-06-11 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1290: - Priority: Blocker (was: Major) > Implement Debezium avro source for Delta Streamer >

[jira] [Comment Edited] (HUDI-818) Optimize the default value of hoodie.memory.merge.max.size option

2021-06-11 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361972#comment-17361972 ] Vinoth Chandar edited comment on HUDI-818 at 6/11/21, 7:12 PM: --- Benchmarks

[jira] [Comment Edited] (HUDI-818) Optimize the default value of hoodie.memory.merge.max.size option

2021-06-11 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357763#comment-17357763 ] Vinoth Chandar edited comment on HUDI-818 at 6/11/21, 7:31 PM: --- -Potentially

[jira] [Assigned] (HUDI-50) Use sort based merge for CompactedRecordScanner & MergeHandle #314

2021-06-11 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-50?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-50: -- Assignee: Rajesh Mahindra > Use sort based merge for CompactedRecordScanner & MergeHandle #314 >

[jira] [Updated] (HUDI-50) Use sort based merge for CompactedRecordScanner & MergeHandle #314

2021-06-11 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-50?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-50: --- Component/s: Performance > Use sort based merge for CompactedRecordScanner & MergeHandle #314 >

[jira] [Commented] (HUDI-818) Optimize the default value of hoodie.memory.merge.max.size option

2021-06-11 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361995#comment-17361995 ] Vinoth Chandar commented on HUDI-818: - Could we quickly try out the rocksDB map to see how that looks?

[jira] [Commented] (HUDI-818) Optimize the default value of hoodie.memory.merge.max.size option

2021-06-11 Thread Rajesh Mahindra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361972#comment-17361972 ] Rajesh Mahindra commented on HUDI-818: -- Benchmarks results across EMR node with both SDD and HDD

[jira] [Commented] (HUDI-818) Optimize the default value of hoodie.memory.merge.max.size option

2021-06-11 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361999#comment-17361999 ] Vinoth Chandar commented on HUDI-818: -

[jira] [Comment Edited] (HUDI-818) Optimize the default value of hoodie.memory.merge.max.size option

2021-06-11 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357763#comment-17357763 ] Vinoth Chandar edited comment on HUDI-818 at 6/11/21, 7:30 PM: --- -Potentially

[jira] [Created] (HUDI-1998) Provide a way to find list of commits through a pythonic API

2021-06-11 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-1998: - Summary: Provide a way to find list of commits through a pythonic API Key: HUDI-1998 URL: https://issues.apache.org/jira/browse/HUDI-1998 Project: Apache Hudi

[jira] [Created] (HUDI-1999) Refresh the base file view cache for WriteProfile

2021-06-11 Thread Danny Chen (Jira)
Danny Chen created HUDI-1999: Summary: Refresh the base file view cache for WriteProfile Key: HUDI-1999 URL: https://issues.apache.org/jira/browse/HUDI-1999 Project: Apache Hudi Issue Type: Bug

[jira] [Created] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-11 Thread Nishith Agarwal (Jira)
Nishith Agarwal created HUDI-1997: - Summary: Fix hoodie.datasource.hive_sync.auto_create_database documentation Key: HUDI-1997 URL: https://issues.apache.org/jira/browse/HUDI-1997 Project: Apache

[jira] [Updated] (HUDI-1909) Skip the commits with empty files for flink streaming reader

2021-06-11 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishith Agarwal updated HUDI-1909: -- Description: Log warnings instead of throwing to make the reader more robust.  

[jira] [Assigned] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-11 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HUDI-1997: --- Assignee: Vinay > Fix hoodie.datasource.hive_sync.auto_create_database documentation >

[jira] [Updated] (HUDI-1997) Fix hoodie.datasource.hive_sync.auto_create_database documentation

2021-06-11 Thread Vinay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HUDI-1997: Status: In Progress (was: Open) > Fix hoodie.datasource.hive_sync.auto_create_database documentation >

[jira] [Created] (HUDI-2000) Release the new records map for merge handle #close

2021-06-11 Thread yuzhaojing (Jira)
yuzhaojing created HUDI-2000: Summary: Release the new records map for merge handle #close Key: HUDI-2000 URL: https://issues.apache.org/jira/browse/HUDI-2000 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-2000) Release file writer for merge handle #close

2021-06-11 Thread yuzhaojing (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuzhaojing updated HUDI-2000: - Summary: Release file writer for merge handle #close (was: Release the new records map for merge handle

[jira] [Updated] (HUDI-2000) Release file writer for merge handle #close

2021-06-11 Thread yuzhaojing (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuzhaojing updated HUDI-2000: - Description: The file writer can be release eagerly to save the memory footprint. (was: The file writer