[jira] [Reopened] (HUDI-2913) Disable auto clean in writer task

2022-11-15 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu reopened HUDI-2913: --- > Disable auto clean in writer task > - > > Key:

[jira] [Resolved] (HUDI-2913) Disable auto clean in writer task

2022-11-15 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu resolved HUDI-2913. --- > Disable auto clean in writer task > - > > Key:

[jira] [Reopened] (HUDI-2913) Disable auto clean in writer task

2022-11-15 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu reopened HUDI-2913: --- > Disable auto clean in writer task > - > > Key:

[jira] [Closed] (HUDI-2913) Disable auto clean in writer task

2022-11-15 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu closed HUDI-2913. - Resolution: Fixed > Disable auto clean in writer task > - > >

[jira] [Closed] (HUDI-2913) Disable auto clean in writer task

2022-11-15 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu closed HUDI-2913. - Resolution: Fixed > Disable auto clean in writer task > - > >

[jira] [Updated] (HUDI-2913) Disable auto clean in writer task

2022-11-15 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2913: -- Fix Version/s: 0.12.2 > Disable auto clean in writer task > - > >

[jira] [Resolved] (HUDI-2913) Disable auto clean in writer task

2022-11-15 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu resolved HUDI-2913. --- > Disable auto clean in writer task > - > > Key:

[jira] [Created] (HUDI-5179) Optimized release guide document

2022-11-08 Thread Zhaojing Yu (Jira)
Zhaojing Yu created HUDI-5179: - Summary: Optimized release guide document Key: HUDI-5179 URL: https://issues.apache.org/jira/browse/HUDI-5179 Project: Apache Hudi Issue Type: Task

[jira] [Updated] (HUDI-5179) Optimized release guide document

2022-11-08 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-5179: -- Fix Version/s: 0.13.0 > Optimized release guide document > > >

[jira] [Updated] (HUDI-4462) Flink Sink cannot report metrics

2022-11-06 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4462: -- Epic Link: HUDI-5168 > Flink Sink cannot report metrics > - > >

[jira] [Updated] (HUDI-4719) metrics for flink

2022-11-06 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4719: -- Epic Link: HUDI-5168 > metrics for flink > - > > Key: HUDI-4719 >

[jira] [Created] (HUDI-5168) Flink metrics integration

2022-11-06 Thread Zhaojing Yu (Jira)
Zhaojing Yu created HUDI-5168: - Summary: Flink metrics integration Key: HUDI-5168 URL: https://issues.apache.org/jira/browse/HUDI-5168 Project: Apache Hudi Issue Type: Epic Components:

[jira] [Updated] (HUDI-5168) Flink metrics integration

2022-11-06 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-5168: -- Component/s: flink-sql > Flink metrics integration > - > > Key:

[jira] [Resolved] (HUDI-5050) Release note for version 0.12.1

2022-10-24 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu resolved HUDI-5050. --- > Release note for version 0.12.1 > --- > > Key: HUDI-5050 >

[jira] [Updated] (HUDI-5050) Release note for version 0.12.1

2022-10-18 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-5050: -- Summary: Release note for version 0.12.1 (was: Docs writing for 0.12.1) > Release note for version

[jira] [Created] (HUDI-5050) Docs writing for 0.12.1

2022-10-18 Thread Zhaojing Yu (Jira)
Zhaojing Yu created HUDI-5050: - Summary: Docs writing for 0.12.1 Key: HUDI-5050 URL: https://issues.apache.org/jira/browse/HUDI-5050 Project: Apache Hudi Issue Type: Task Components:

[jira] [Updated] (HUDI-4966) Meta sync throws exception if TimestampBasedKeyGenerator is used to generate partition path containing slashes

2022-10-17 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4966: -- Fix Version/s: 0.12.2 (was: 0.12.1) > Meta sync throws exception if

[jira] [Updated] (HUDI-4629) Create hive table from existing hoodie Table failed when the table schema is not defined

2022-10-17 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4629: -- Fix Version/s: 0.12.2 (was: 0.12.1) > Create hive table from existing hoodie

[jira] [Resolved] (HUDI-4010) DynamoDB lock configs for naming/docs could be improved

2022-10-17 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu resolved HUDI-4010. --- > DynamoDB lock configs for naming/docs could be improved >

[jira] [Updated] (HUDI-4613) Avoid the use of regex expressions when call hoodieFileGroup#addLogFile function

2022-10-17 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4613: -- Fix Version/s: 0.12.2 (was: 0.12.1) > Avoid the use of regex expressions when

[jira] [Updated] (HUDI-5012) Fix clean planning for very large partitions

2022-10-17 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-5012: -- Fix Version/s: 0.12.2 (was: 0.12.1) > Fix clean planning for very large

[jira] [Updated] (HUDI-3453) Metadata table throws NPE when scheduling compaction plan

2022-10-17 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3453: -- Fix Version/s: 0.12.2 (was: 0.12.1) > Metadata table throws NPE when scheduling

[jira] [Updated] (HUDI-4281) Using hudi to build a large number of tables in spark on hive causes OOM

2022-10-17 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4281: -- Fix Version/s: 0.12.2 > Using hudi to build a large number of tables in spark on hive causes OOM >

[jira] [Updated] (HUDI-4281) Using hudi to build a large number of tables in spark on hive causes OOM

2022-10-17 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4281: -- Fix Version/s: (was: 0.12.1) > Using hudi to build a large number of tables in spark on hive causes

[jira] [Updated] (HUDI-4526) improve spillableMapBasePath disk directory is full

2022-10-17 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4526: -- Fix Version/s: 0.12.2 (was: 0.12.1) > improve spillableMapBasePath disk

[jira] [Updated] (HUDI-4396) Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes

2022-10-17 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4396: -- Fix Version/s: 0.12.2 (was: 0.12.1) > Add a boolean parameter to decide whether

[jira] [Updated] (HUDI-2754) Performance improvement for IncrementalRelation

2022-10-17 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2754: -- Fix Version/s: 0.12.2 (was: 0.12.1) > Performance improvement for

[jira] [Updated] (HUDI-1380) Async cleaning does not work with Timeline Server

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-1380: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Async cleaning does not work with Timeline

[jira] [Updated] (HUDI-1574) Trim existing unit tests to finish in much shorter amount of time

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-1574: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Trim existing unit tests to finish in much

[jira] [Updated] (HUDI-2465) Fix merge, update for spark sql dml support to test suite infra

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2465: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Fix merge, update for spark sql dml

[jira] [Updated] (HUDI-1885) Support Delete/Update Non-Pk Table

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-1885: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Support Delete/Update Non-Pk Table >

[jira] [Updated] (HUDI-2528) Flaky test: MERGE_ON_READ testTableOperationsWithRestore

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2528: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Flaky test: MERGE_ON_READ

[jira] [Updated] (HUDI-2555) Fix flaky FlinkCompaction integration test

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2555: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Fix flaky FlinkCompaction integration test

[jira] [Updated] (HUDI-2768) Enable async timeline server by default

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2768: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Enable async timeline server by default >

[jira] [Updated] (HUDI-2928) Evaluate rebasing Hudi's default compression from Gzip to Zstd

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2928: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Evaluate rebasing Hudi's default

[jira] [Resolved] (HUDI-3054) Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu resolved HUDI-3054. --- > Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter >

[jira] [Updated] (HUDI-2860) Make timeline server work with concurrent/async table service

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2860: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Make timeline server work with

[jira] [Updated] (HUDI-3000) [UMBRELLA] Consistent Hashing Index

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3000: -- Fix Version/s: 0.13.0 (was: 0.12.1) > [UMBRELLA] Consistent Hashing Index >

[jira] [Updated] (HUDI-2873) Support optimize data layout by sql and make the build more fast

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2873: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Support optimize data layout by sql and

[jira] [Updated] (HUDI-3057) Instants should be generated strictly under locks

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3057: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Instants should be generated strictly

[jira] [Updated] (HUDI-3054) Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3054: -- Fix Version/s: 0.12.1 > Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter >

[jira] [Resolved] (HUDI-3204) Allow original partition column value to be retrieved when using TimestampBasedKeyGen

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu resolved HUDI-3204. --- > Allow original partition column value to be retrieved when using > TimestampBasedKeyGen >

[jira] [Updated] (HUDI-3210) [UMBRELLA] A new Presto connector for Hudi

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3210: -- Fix Version/s: 0.13.0 (was: 0.12.1) > [UMBRELLA] A new Presto connector for Hudi

[jira] [Updated] (HUDI-3067) "Table already exists" error with multiple writers and dynamodb

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3067: -- Fix Version/s: 0.13.0 (was: 0.12.1) > "Table already exists" error with multiple

[jira] [Updated] (HUDI-3054) Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3054: -- Fix Version/s: (was: 0.12.1) > Fix flaky TestHoodieClientMultiWriter.

[jira] [Updated] (HUDI-3055) Make sure that Compression Codec configuration is respected across the board

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3055: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Make sure that Compression Codec

[jira] [Updated] (HUDI-3214) Optimize auto partition in spark

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3214: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Optimize auto partition in spark >

[jira] [Updated] (HUDI-3249) Performance Improvements

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3249: -- Fix Version/s: (was: 0.12.1) > Performance Improvements > > >

[jira] [Updated] (HUDI-3300) Timeline server FSViewManager should avoid point lookup for metadata file partition

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3300: -- Fix Version/s: 0.13.0 > Timeline server FSViewManager should avoid point lookup for metadata file >

[jira] [Updated] (HUDI-3300) Timeline server FSViewManager should avoid point lookup for metadata file partition

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3300: -- Fix Version/s: (was: 0.12.1) > Timeline server FSViewManager should avoid point lookup for metadata

[jira] [Updated] (HUDI-3248) Improve Hudi table services

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3248: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Improve Hudi table services >

[jira] [Updated] (HUDI-3301) MergedLogRecordReader inline reading should be stateless and thread safe

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3301: -- Fix Version/s: 0.13.0 (was: 0.12.1) > MergedLogRecordReader inline reading

[jira] [Updated] (HUDI-3342) MOR Delta Block Rollbacks not applied if Lazy Block reading is disabled

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3342: -- Fix Version/s: 0.13.0 (was: 0.12.1) > MOR Delta Block Rollbacks not applied if

[jira] [Updated] (HUDI-3517) Unicode in partition path causes it to be resolved wrongly

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3517: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Unicode in partition path causes it to be

[jira] [Updated] (HUDI-3495) Reading keys in parallel from HoodieMetadataMergedLogRecordReader may lead to empty results even if key exists

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3495: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Reading keys in parallel from

[jira] [Updated] (HUDI-3407) Make sure Restore operation is Not Concurrent w/ Writes in Multi-Writer scenario

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3407: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Make sure Restore operation is Not

[jira] [Updated] (HUDI-3467) Check shutdown logic with async compaction in Spark Structured Streaming

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3467: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Check shutdown logic with async compaction

[jira] [Updated] (HUDI-3519) Make sure every public Hudi Client Method invokes necessary prologue

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3519: -- Fix Version/s: 0.13.0 > Make sure every public Hudi Client Method invokes necessary prologue >

[jira] [Updated] (HUDI-3519) Make sure every public Hudi Client Method invokes necessary prologue

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3519: -- Fix Version/s: (was: 0.12.1) > Make sure every public Hudi Client Method invokes necessary prologue

[jira] [Updated] (HUDI-3648) Failed to execute rollback due to HoodieIOException: Could not delete instant

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3648: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Failed to execute rollback due to

[jira] [Updated] (HUDI-3646) The Hudi update syntax should not modify the nullability attribute of a column

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3646: -- Fix Version/s: 0.13.0 (was: 0.12.1) > The Hudi update syntax should not modify

[jira] [Updated] (HUDI-3626) Refactor TableSchemaResolver to remove `includeMetadataFields` flags

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3626: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Refactor TableSchemaResolver to remove

[jira] [Updated] (HUDI-3649) Add HoodieTableConfig defaults to HoodieWriteConfig

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3649: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Add HoodieTableConfig defaults to

[jira] [Updated] (HUDI-3742) Enable parquet enableVectorizedReader for spark incremental read to prevent pef regression

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3742: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Enable parquet enableVectorizedReader for

[jira] [Updated] (HUDI-3717) Avoid double-listing w/in BaseHoodieTableFileIndex

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3717: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Avoid double-listing w/in

[jira] [Updated] (HUDI-3818) hudi doesn't support bytes column as primary key

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3818: -- Fix Version/s: 0.13.0 (was: 0.12.1) > hudi doesn't support bytes column as

[jira] [Updated] (HUDI-3775) Allow for offline compaction of MOR tables via spark streaming

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3775: -- Fix Version/s: 0.13.0 > Allow for offline compaction of MOR tables via spark streaming >

[jira] [Updated] (HUDI-3796) Implement layout to filter out uncommitted log files without reading the log blocks

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3796: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Implement layout to filter out uncommitted

[jira] [Updated] (HUDI-3775) Allow for offline compaction of MOR tables via spark streaming

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3775: -- Fix Version/s: (was: 0.12.1) > Allow for offline compaction of MOR tables via spark streaming >

[jira] [Updated] (HUDI-3881) Implement index syntax for spark sql

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3881: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Implement index syntax for spark sql >

[jira] [Updated] (HUDI-3882) Make sure Hudi Spark relations implementations provide similar file-scanning metrics

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3882: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Make sure Hudi Spark relations

[jira] [Updated] (HUDI-3956) Optimize hudi-presto-bundle size

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3956: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Optimize hudi-presto-bundle size >

[jira] [Updated] (HUDI-3919) Support out of order rollback blocks in AbstractHoodieLogRecordReader

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3919: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Support out of order rollback blocks in

[jira] [Updated] (HUDI-3892) Add HoodieReadClient with java

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3892: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Add HoodieReadClient with java >

[jira] [Updated] (HUDI-4021) Support deferring compaction when there is an inflight delta commit

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4021: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Support deferring compaction when there is

[jira] [Updated] (HUDI-4036) Investigate whether meta fields could be omitted completely

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4036: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Investigate whether meta fields could be

[jira] [Updated] (HUDI-4010) DynamoDB lock configs for naming/docs could be improved

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4010: -- Status: Patch Available (was: In Progress) > DynamoDB lock configs for naming/docs could be improved >

[jira] [Updated] (HUDI-4209) TestHoodieBulkInsertDataInternalWriter fails due to MiniDFSCluster class not found

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4209: -- Fix Version/s: 0.13.0 (was: 0.12.1) > TestHoodieBulkInsertDataInternalWriter

[jira] [Updated] (HUDI-4184) Creating external table in Spark SQL modifies "hoodie.properties"

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4184: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Creating external table in Spark SQL

[jira] [Updated] (HUDI-4123) HoodieDeltaStreamer throws exception due to SqlSource return null checkpoint

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4123: -- Fix Version/s: 0.13.0 (was: 0.12.1) > HoodieDeltaStreamer throws exception due

[jira] [Resolved] (HUDI-4237) spark.sql.sources.schema.partCol.0 is non-empty in HiveMetaStore when create non-partition hudi table in Spark

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu resolved HUDI-4237. --- > spark.sql.sources.schema.partCol.0 is non-empty in HiveMetaStore when create > non-partition hudi

[jira] [Updated] (HUDI-4330) NPE when trying to upsert into a dataset with no Meta Fields

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4330: -- Fix Version/s: 0.13.0 > NPE when trying to upsert into a dataset with no Meta Fields >

[jira] [Updated] (HUDI-4244) Support common Spark transformations w/in Spark SQL "partitioned by" clause

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4244: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Support common Spark transformations w/in

[jira] [Updated] (HUDI-4302) CI Instability / flaky tests

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4302: -- Fix Version/s: 0.13.0 (was: 0.12.1) > CI Instability / flaky tests >

[jira] [Updated] (HUDI-4457) Make sure IT docker test return code non-zero when failed

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4457: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Make sure IT docker test return code

[jira] [Updated] (HUDI-4542) Flink streaming query fails with ClassNotFoundException

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4542: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Flink streaming query fails with

[jira] [Resolved] (HUDI-4488) Improve S3 File listing efficiency

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu resolved HUDI-4488. --- > Improve S3 File listing efficiency > -- > > Key:

[jira] [Updated] (HUDI-4522) [DOCS] Set presto session prop to use parquet column names in case of type mismatch

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4522: -- Fix Version/s: 0.13.0 (was: 0.12.1) > [DOCS] Set presto session prop to use

[jira] [Updated] (HUDI-4330) NPE when trying to upsert into a dataset with no Meta Fields

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4330: -- Fix Version/s: (was: 0.12.1) > NPE when trying to upsert into a dataset with no Meta Fields >

[jira] [Updated] (HUDI-4454) Support hiveSync command based on Call Procedure Command

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4454: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Support hiveSync command based on Call

[jira] [Updated] (HUDI-4341) HoodieHFileReader is not compatible with Hadoop 3

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4341: -- Fix Version/s: 0.13.0 (was: 0.12.1) > HoodieHFileReader is not compatible with

[jira] [Updated] (HUDI-4369) Hudi Kafka Connect Sink writing to GCS bucket

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4369: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Hudi Kafka Connect Sink writing to GCS

[jira] [Updated] (HUDI-4573) Fix HoodieMultiTableDeltaStreamer to write all tables in continuous mode

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4573: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Fix HoodieMultiTableDeltaStreamer to write

[jira] [Updated] (HUDI-4624) Make sure all DeltaStreamer Sources are Closeable

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4624: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Make sure all DeltaStreamer Sources are

[jira] [Updated] (HUDI-4586) Address S3 timeouts in Bloom Index with metadata table

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4586: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Address S3 timeouts in Bloom Index with

[jira] [Updated] (HUDI-4602) Implement getScheme for PrestoS3FileSystem

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4602: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Implement getScheme for PrestoS3FileSystem

[jira] [Updated] (HUDI-4674) change the default value of inputFormat for the MOR table

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4674: -- Fix Version/s: 0.13.0 (was: 0.12.1) > change the default value of inputFormat

[jira] [Updated] (HUDI-4631) Enhance retries for failed writes w/ write conflicts in a multi writer scenarios

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4631: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Enhance retries for failed writes w/ write

[jira] [Updated] (HUDI-4688) Decouple lazy cleaning of failed writes from clean action in multi-writer

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4688: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Decouple lazy cleaning of failed writes

[jira] [Updated] (HUDI-4704) bulk insert overwrite table will delete the table and then recreate a table

2022-10-01 Thread Zhaojing Yu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4704: -- Fix Version/s: 0.13.0 (was: 0.12.1) > bulk insert overwrite table will delete

  1   2   >