[jira] [Created] (HUDI-6817) After enable speculation execution of spark compaction job, some broken parquet files might be generated

2023-09-04 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6817: Summary: After enable speculation execution of spark compaction job, some broken parquet files might be generated Key: HUDI-6817 URL: https://issues.apache.org/jira/browse/HUDI-6817

[jira] [Created] (HUDI-6828) After Insert overwrite into a non-empty partition/table with empty datasets, the subsequent query results are incorrect

2023-09-06 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6828: Summary: After Insert overwrite into a non-empty partition/table with empty datasets, the subsequent query results are incorrect Key: HUDI-6828 URL:

[jira] [Commented] (HUDI-6828) After Insert overwrite into a non-empty partition/table with empty datasets, the subsequent query results are incorrect

2023-09-06 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762559#comment-17762559 ] Jing Zhang commented on HUDI-6828: -- The root cause is currently HUDI insert does not distinguish dynamic

[jira] [Commented] (HUDI-6827) Exception would be thrown out if insert/insertOverWrite empty data into HUDI table using bulkInsert

2023-09-06 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762532#comment-17762532 ] Jing Zhang commented on HUDI-6827: -- The root cause is would partition by 0 when write status is empty.

[jira] [Updated] (HUDI-6827) Exception would be thrown out if insert/insertOverWrite empty data into HUDI table using bulkInsert

2023-09-06 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6827: - Attachment: screenshot-1.png > Exception would be thrown out if insert/insertOverWrite empty data into

[jira] [Assigned] (HUDI-6827) Exception would be thrown out if insert/insertOverWrite empty data into HUDI table using bulkInsert

2023-09-06 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-6827: Assignee: Jing Zhang > Exception would be thrown out if insert/insertOverWrite empty data into

[jira] [Updated] (HUDI-6828) After Insert overwrite into a non-empty partition/table with empty datasets, the subsequent query results are incorrect

2023-09-06 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6828: - Description: After Insert overwrite into a non-empty partition/table with empty datasets, the subsequent

[jira] [Assigned] (HUDI-6828) After Insert overwrite into a non-empty partition/table with empty datasets, the subsequent query results are incorrect

2023-09-07 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-6828: Assignee: Jing Zhang > After Insert overwrite into a non-empty partition/table with empty

[jira] [Created] (HUDI-6827) Exception would be thrown out if insert/insertOverWrite empty data into HUDI table using bulkInsert

2023-09-06 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6827: Summary: Exception would be thrown out if insert/insertOverWrite empty data into HUDI table using bulkInsert Key: HUDI-6827 URL: https://issues.apache.org/jira/browse/HUDI-6827

[jira] [Updated] (HUDI-6813) Support table name for meta sync in bootstrap

2023-09-01 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6813: - Description: Using bootstrap procedure to migrate an existing table into a Hudi table. {code:sql} call

[jira] [Created] (HUDI-6813) Support table name for meta sync in bootstrap

2023-09-01 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6813: Summary: Support table name for meta sync in bootstrap Key: HUDI-6813 URL: https://issues.apache.org/jira/browse/HUDI-6813 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-6813) Support table name for meta sync in bootstrap

2023-09-01 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6813: - Description: Using bootstrap procedure to migrate an existing table into a Hudi table. {code:sql} call

[jira] [Updated] (HUDI-6803) Create marker file for every log file

2023-08-29 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6803: - Fix Version/s: 1.0.0 > Create marker file for every log file > - > >

[jira] [Closed] (HUDI-6484) FileNotFoundException would happen occasionally during read latest snapshot of a MOR table

2023-08-29 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang closed HUDI-6484. Fix Version/s: (was: 1.0.0) Resolution: Workaround > FileNotFoundException would happen

[jira] [Comment Edited] (HUDI-6484) FileNotFoundException would happen occasionally during read latest snapshot of a MOR table

2023-08-29 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760200#comment-17760200 ] Jing Zhang edited comment on HUDI-6484 at 8/30/23 2:28 AM: --- The issue

[jira] [Comment Edited] (HUDI-6484) FileNotFoundException would happen occasionally during read latest snapshot of a MOR table

2023-08-29 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760200#comment-17760200 ] Jing Zhang edited comment on HUDI-6484 at 8/30/23 2:29 AM: --- The issue

[jira] [Commented] (HUDI-6484) FileNotFoundException would happen occasionally during read latest snapshot of a MOR table

2023-08-29 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760200#comment-17760200 ] Jing Zhang commented on HUDI-6484: -- The issue [HUDI-1517|https://issues.apache.org/jira/browse/HUDI-1517]

[jira] [Comment Edited] (HUDI-6484) FileNotFoundException would happen occasionally during read latest snapshot of a MOR table

2023-08-29 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760200#comment-17760200 ] Jing Zhang edited comment on HUDI-6484 at 8/30/23 2:27 AM: --- The issue

[jira] [Updated] (HUDI-1517) Create marker file for every log file

2023-08-29 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-1517: - Fix Version/s: 0.14.0 (was: 1.0.0) > Create marker file for every log file >

[jira] [Updated] (HUDI-6484) FileNotFoundException would happen occasionally during read latest snapshot of a MOR table

2023-08-29 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6484: - Fix Version/s: 1.0.0 (was: 0.14.0) > FileNotFoundException would happen

[jira] [Created] (HUDI-6803) Create marker file for every log file

2023-08-29 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6803: Summary: Create marker file for every log file Key: HUDI-6803 URL: https://issues.apache.org/jira/browse/HUDI-6803 Project: Apache Hudi Issue Type: Improvement

[jira] [Updated] (HUDI-1517) Create marker file for every log file

2023-08-29 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-1517: - Fix Version/s: 1.0.0 > Create marker file for every log file > - > >

[jira] [Updated] (HUDI-6803) Create marker file for every log file

2023-08-29 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6803: - Description: The issue aims to introduce marker file for log files , which is similar with

[jira] [Updated] (HUDI-6803) Create marker file for every log file

2023-08-29 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6803: - Description: The issue aims to introduce marker file for log files , which is similar with

[jira] [Commented] (HUDI-1517) Create marker file for every log file

2023-08-29 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760198#comment-17760198 ] Jing Zhang commented on HUDI-1517: -- The commit [#4913|https://github.com/apache/hudi/pull/4913] is

[jira] [Created] (HUDI-6949) Spark support non-blocking concurrency control

2023-10-16 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6949: Summary: Spark support non-blocking concurrency control Key: HUDI-6949 URL: https://issues.apache.org/jira/browse/HUDI-6949 Project: Apache Hudi Issue Type: New

[jira] [Assigned] (HUDI-6997) Create a new WriteConcurrencyMode type for non-blocking concurrency control

2023-10-26 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-6997: Assignee: Jing Zhang > Create a new WriteConcurrencyMode type for non-blocking concurrency control

[jira] [Created] (HUDI-6997) Create a new WriteConcurrencyMode type for non-blocking concurrency control

2023-10-26 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6997: Summary: Create a new WriteConcurrencyMode type for non-blocking concurrency control Key: HUDI-6997 URL: https://issues.apache.org/jira/browse/HUDI-6997 Project: Apache Hudi

[jira] [Commented] (HUDI-7024) Null Pointer Exception for a flink streaming pipeline for Consistent Hashing

2023-11-03 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782432#comment-17782432 ] Jing Zhang commented on HUDI-7024: -- [~adityagoenka] Could you please provide more information? for

[jira] [Comment Edited] (HUDI-7024) Null Pointer Exception for a flink streaming pipeline for Consistent Hashing

2023-11-03 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782432#comment-17782432 ] Jing Zhang edited comment on HUDI-7024 at 11/3/23 6:58 AM: --- [~adityagoenka]

[jira] [Closed] (HUDI-6968) remove block logical in BulkInsertWriteFunction#open

2023-10-24 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang closed HUDI-6968. Fix Version/s: 1.0.0 Resolution: Fixed > remove block logical in BulkInsertWriteFunction#open >

[jira] [Commented] (HUDI-6968) remove block logical in BulkInsertWriteFunction#open

2023-10-24 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779295#comment-17779295 ] Jing Zhang commented on HUDI-6968: -- Fixed via master branch: f05b5fc9db38e0bc4ccc2941cccf049991b67db2 >

[jira] [Resolved] (HUDI-6813) Support table name for meta sync in bootstrap

2023-09-27 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang resolved HUDI-6813. -- > Support table name for meta sync in bootstrap > - > >

[jira] [Updated] (HUDI-6813) Support table name for meta sync in bootstrap

2023-09-27 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6813: - Fix Version/s: 0.14.0 > Support table name for meta sync in bootstrap >

[jira] [Assigned] (HUDI-6949) Spark support non-blocking concurrency control

2023-10-17 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-6949: Assignee: Jing Zhang > Spark support non-blocking concurrency control >

[jira] [Created] (HUDI-6962) Correct the behavior of bulk insert for NB-CC

2023-10-19 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6962: Summary: Correct the behavior of bulk insert for NB-CC Key: HUDI-6962 URL: https://issues.apache.org/jira/browse/HUDI-6962 Project: Apache Hudi Issue Type: New

[jira] [Updated] (HUDI-6962) Correct the behavior of bulk insert for NB-CC

2023-10-19 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6962: - Description: How to handle the case if the multiple writer contains a job with bulk insert operation? 1.

[jira] [Updated] (HUDI-6962) Correct the behavior of bulk insert for NB-CC

2023-10-19 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6962: - Description: How to handle the case if the multiple writer contains a job with bulk insert operation? 1.

[jira] [Assigned] (HUDI-6962) Correct the behavior of bulk insert for NB-CC

2023-10-19 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-6962: Assignee: Jing Zhang > Correct the behavior of bulk insert for NB-CC >

[jira] [Updated] (HUDI-6962) Correct the behavior of bulk insert for NB-CC

2023-10-19 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6962: - Description: How to handle the case if the multiple writer contains a job with bulk insert operation? 1.

[jira] [Updated] (HUDI-6968) remove block logical in BulkInsertWriteFunction#open

2023-10-22 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6968: - Description: See more discussion in [PR9896|https://github.com/apache/hudi/pull/9896].

[jira] [Updated] (HUDI-6968) remove block logical in BulkInsertWriteFunction#open

2023-10-22 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6968: - Attachment: screenshot-1.png > remove block logical in BulkInsertWriteFunction#open >

[jira] [Created] (HUDI-6968) remove block logical in BulkInsertWriteFunction#open

2023-10-22 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6968: Summary: remove block logical in BulkInsertWriteFunction#open Key: HUDI-6968 URL: https://issues.apache.org/jira/browse/HUDI-6968 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-6968) remove block logical in BulkInsertWriteFunction#open

2023-10-22 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6968: - Priority: Trivial (was: Major) > remove block logical in BulkInsertWriteFunction#open >

[jira] [Updated] (HUDI-6968) remove block logical in BulkInsertWriteFunction#open

2023-10-22 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6968: - Description: See more discussion in [PR9896|https://github.com/apache/hudi/pull/9896]. (was: See more

[jira] [Updated] (HUDI-6968) remove block logical in BulkInsertWriteFunction#open

2023-10-22 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6968: - Issue Type: Improvement (was: New Feature) > remove block logical in BulkInsertWriteFunction#open >

[jira] [Updated] (HUDI-6968) remove block logical in BulkInsertWriteFunction#open

2023-10-22 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6968: - Attachment: (was: image-2023-10-23-11-16-01-233.png) > remove block logical in

[jira] [Updated] (HUDI-6968) remove block logical in BulkInsertWriteFunction#open

2023-10-22 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6968: - Attachment: (was: screenshot-1.png) > remove block logical in BulkInsertWriteFunction#open >

[jira] [Created] (HUDI-7072) remove Flink 1.13

2023-11-10 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-7072: Summary: remove Flink 1.13 Key: HUDI-7072 URL: https://issues.apache.org/jira/browse/HUDI-7072 Project: Apache Hudi Issue Type: New Feature Components:

[jira] [Created] (HUDI-5657) Fix NPE if filters condition contains null literal when using column stats data skipping for flink

2023-01-30 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-5657: Summary: Fix NPE if filters condition contains null literal when using column stats data skipping for flink Key: HUDI-5657 URL: https://issues.apache.org/jira/browse/HUDI-5657

[jira] [Assigned] (HUDI-5657) Fix NPE if filters condition contains null literal when using column stats data skipping for flink

2023-01-30 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-5657: Assignee: Jing Zhang > Fix NPE if filters condition contains null literal when using column stats

[jira] [Assigned] (HUDI-5888) Support data skipping for flink streaming source

2023-03-07 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-5888: Assignee: Jing Zhang > Support data skipping for flink streaming source >

[jira] [Created] (HUDI-5888) Support data skipping for flink streaming source

2023-03-07 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-5888: Summary: Support data skipping for flink streaming source Key: HUDI-5888 URL: https://issues.apache.org/jira/browse/HUDI-5888 Project: Apache Hudi Issue Type: New

[jira] [Updated] (HUDI-5851) Refactor ExpressionEvaluators to split into 2 phase: evaluator conversion and evaluator execution

2023-02-26 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-5851: - Component/s: flink flink-sql > Refactor ExpressionEvaluators to split into 2 phase:

[jira] [Updated] (HUDI-5851) Refactor ExpressionEvaluators to split into 2 phase: evaluator conversion and evaluator execution

2023-02-26 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-5851: - Summary: Refactor ExpressionEvaluators to split into 2 phase: evaluator conversion and evaluator

[jira] [Created] (HUDI-5857) Snapshot query result is wrong after apply insert overwrite to an existed table with simple bucket index

2023-02-26 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-5857: Summary: Snapshot query result is wrong after apply insert overwrite to an existed table with simple bucket index Key: HUDI-5857 URL: https://issues.apache.org/jira/browse/HUDI-5857

[jira] [Updated] (HUDI-5857) Snapshot query result is wrong after apply insert overwrite to an existed table with simple bucket index

2023-02-26 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-5857: - Attachment: image-2023-02-27-15-55-26-568.png > Snapshot query result is wrong after apply insert

[jira] [Commented] (HUDI-5857) Snapshot query result is wrong after apply insert overwrite to an existed table with simple bucket index

2023-02-27 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693840#comment-17693840 ] Jing Zhang commented on HUDI-5857: -- !image-2023-02-27-15-55-26-568.png! Snapshot query after insert

[jira] [Created] (HUDI-5851) Refactor ExpressionEvaluators to split evaluator conversion and evaluator execution

2023-02-26 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-5851: Summary: Refactor ExpressionEvaluators to split evaluator conversion and evaluator execution Key: HUDI-5851 URL: https://issues.apache.org/jira/browse/HUDI-5851 Project:

[jira] [Updated] (HUDI-5880) Support partition pruning for flink streaming source in runtime

2023-03-06 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-5880: - Component/s: flink flink-sql > Support partition pruning for flink streaming source in

[jira] [Created] (HUDI-5880) Support partition pruning for flink streaming source in runtime

2023-03-06 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-5880: Summary: Support partition pruning for flink streaming source in runtime Key: HUDI-5880 URL: https://issues.apache.org/jira/browse/HUDI-5880 Project: Apache Hudi

[jira] [Created] (HUDI-5879) Extends evaluators to support evaluate based on column values

2023-03-06 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-5879: Summary: Extends evaluators to support evaluate based on column values Key: HUDI-5879 URL: https://issues.apache.org/jira/browse/HUDI-5879 Project: Apache Hudi

[jira] [Updated] (HUDI-5857) Snapshot query result is wrong after apply insert overwrite to an existed table with simple bucket index

2023-02-28 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-5857: - Description: Snapshot query result is wrong after apply insert overwrite to an existed table with simple

[jira] [Assigned] (HUDI-5857) Snapshot query result is wrong after apply insert overwrite to an existed table with simple bucket index

2023-02-27 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-5857: Assignee: Jing Zhang > Snapshot query result is wrong after apply insert overwrite to an existed

[jira] [Updated] (HUDI-5691) Fix HoodiePruneFileSourcePartition missing to list non-partitioned tables

2023-02-03 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-5691: - Status: In Progress (was: Open) > Fix HoodiePruneFileSourcePartition missing to list non-partitioned

[jira] [Updated] (HUDI-5657) Fix NPE if filters condition contains null literal when using column stats data skipping for flink

2023-02-03 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-5657: - Status: In Progress (was: Open) > Fix NPE if filters condition contains null literal when using column

[jira] [Updated] (HUDI-5691) Fix HoodiePruneFileSourcePartition missing to list non-partitioned tables

2023-02-03 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-5691: - Status: Open (was: In Progress) > Fix HoodiePruneFileSourcePartition missing to list non-partitioned

[jira] [Commented] (HUDI-3217) RFC-46: Optimize Record Payload handling

2023-02-03 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17683818#comment-17683818 ] Jing Zhang commented on HUDI-3217: -- [~alexey.kudinkin] [~wzx] [~minihippo] Nice work! Is there any plan

[jira] [Updated] (HUDI-5491) Support partition push down for flink streaming source

2023-02-03 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-5491: - Status: In Progress (was: Open) > Support partition push down for flink streaming source >

[jira] [Created] (HUDI-5770) Plan error when partition column is timestamp type and SQL query contains filter condition which contains partition

2023-02-12 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-5770: Summary: Plan error when partition column is timestamp type and SQL query contains filter condition which contains partition Key: HUDI-5770 URL:

[jira] [Commented] (HUDI-5770) Plan error when partition column is timestamp type and SQL query contains filter condition which contains partition

2023-02-12 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687687#comment-17687687 ] Jing Zhang commented on HUDI-5770: -- The cause of this bug is similar with

[jira] [Assigned] (HUDI-5770) Plan error when partition column is timestamp type and SQL query contains filter condition which contains partition

2023-02-12 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-5770: Assignee: Jing Zhang > Plan error when partition column is timestamp type and SQL query contains

[jira] [Created] (HUDI-6512) Check whether there is write error before commit compaction and logCompaction when using Spark job

2023-07-07 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6512: Summary: Check whether there is write error before commit compaction and logCompaction when using Spark job Key: HUDI-6512 URL: https://issues.apache.org/jira/browse/HUDI-6512

[jira] [Created] (HUDI-6327) Flink bulk_insert support consistent bucket index

2023-06-07 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6327: Summary: Flink bulk_insert support consistent bucket index Key: HUDI-6327 URL: https://issues.apache.org/jira/browse/HUDI-6327 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-6326) Flink write supports consistent bucket index

2023-06-07 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6326: - Summary: Flink write supports consistent bucket index (was: Flink write progress supports consistent

[jira] [Created] (HUDI-6330) Update user document to introduce this feature

2023-06-07 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6330: Summary: Update user document to introduce this feature Key: HUDI-6330 URL: https://issues.apache.org/jira/browse/HUDI-6330 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-6327) Flink bulk_insert support consistent bucket index

2023-06-07 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-6327: - Component/s: flink index > Flink bulk_insert support consistent bucket index >

[jira] [Created] (HUDI-6329) Introduce UpdateStrategy for Flink to handle conflict between clustering/resize with update

2023-06-07 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6329: Summary: Introduce UpdateStrategy for Flink to handle conflict between clustering/resize with update Key: HUDI-6329 URL: https://issues.apache.org/jira/browse/HUDI-6329

[jira] [Assigned] (HUDI-4373) Consistent bucket index write path for Flink engine

2023-06-07 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-4373: Assignee: Jing Zhang (was: Yuwei Xiao) > Consistent bucket index write path for Flink engine >

[jira] [Created] (HUDI-6328) Flink support generate resize plan for consistent bucket index

2023-06-07 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6328: Summary: Flink support generate resize plan for consistent bucket index Key: HUDI-6328 URL: https://issues.apache.org/jira/browse/HUDI-6328 Project: Apache Hudi

[jira] [Created] (HUDI-6326) Flink write progress supports consistent bucket index

2023-06-07 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6326: Summary: Flink write progress supports consistent bucket index Key: HUDI-6326 URL: https://issues.apache.org/jira/browse/HUDI-6326 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-6331) Update user doc of partial update for MERGE INTO

2023-06-07 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6331: Summary: Update user doc of partial update for MERGE INTO Key: HUDI-6331 URL: https://issues.apache.org/jira/browse/HUDI-6331 Project: Apache Hudi Issue Type:

[jira] [Assigned] (HUDI-6331) Update user doc of partial update for MERGE INTO

2023-06-07 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-6331: Assignee: Jing Zhang > Update user doc of partial update for MERGE INTO >

[jira] [Assigned] (HUDI-6364) InsertOverwrite operation on consistent hashing resulting in wrong data

2023-06-12 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-6364: Assignee: Jing Zhang > InsertOverwrite operation on consistent hashing resulting in wrong data >

[jira] [Created] (HUDI-6364) InsertOverwrite operation on consistent hashing resulting in wrong data

2023-06-12 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6364: Summary: InsertOverwrite operation on consistent hashing resulting in wrong data Key: HUDI-6364 URL: https://issues.apache.org/jira/browse/HUDI-6364 Project: Apache Hudi

[jira] [Assigned] (HUDI-6328) Flink support generate resize plan for consistent bucket index

2023-06-21 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-6328: Assignee: Jing Zhang > Flink support generate resize plan for consistent bucket index >

[jira] [Created] (HUDI-6207) Files pruning for bucket index table pk filtering queries using Spark SQL

2023-05-12 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-6207: Summary: Files pruning for bucket index table pk filtering queries using Spark SQL Key: HUDI-6207 URL: https://issues.apache.org/jira/browse/HUDI-6207 Project: Apache Hudi

[jira] [Assigned] (HUDI-6207) Files pruning for bucket index table pk filtering queries using Spark SQL

2023-05-12 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-6207: Assignee: Jing Zhang > Files pruning for bucket index table pk filtering queries using Spark SQL

[jira] [Created] (HUDI-7241) spark sql choose broad cast has join for very large HUDI relation

2023-12-19 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-7241: Summary: spark sql choose broad cast has join for very large HUDI relation Key: HUDI-7241 URL: https://issues.apache.org/jira/browse/HUDI-7241 Project: Apache Hudi

[jira] [Created] (HUDI-7262) Fail to upgrade table created with 0.10 version to 0.14 version

2023-12-26 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-7262: Summary: Fail to upgrade table created with 0.10 version to 0.14 version Key: HUDI-7262 URL: https://issues.apache.org/jira/browse/HUDI-7262 Project: Apache Hudi

[jira] [Created] (HUDI-7265) Support schema evolution by Flink SQL using HoodieHiveCatalog

2023-12-27 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-7265: Summary: Support schema evolution by Flink SQL using HoodieHiveCatalog Key: HUDI-7265 URL: https://issues.apache.org/jira/browse/HUDI-7265 Project: Apache Hudi

[jira] [Updated] (HUDI-7265) Support schema evolution by Flink SQL using HoodieHiveCatalog

2023-12-27 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-7265: - Description: Since Flink 1.17, Flink SQL support more advanced alter table syntax. {code:sql} -- add a

[jira] [Created] (HUDI-7270) Support schema evolution by Flink SQL using HoodieCatalog

2024-01-02 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-7270: Summary: Support schema evolution by Flink SQL using HoodieCatalog Key: HUDI-7270 URL: https://issues.apache.org/jira/browse/HUDI-7270 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-7270) Support schema evolution by Flink SQL using HoodieCatalog

2024-01-02 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-7270: - Component/s: flink-sql > Support schema evolution by Flink SQL using HoodieCatalog >

[jira] [Updated] (HUDI-7265) Support schema evolution by Flink SQL using HoodieHiveCatalog

2024-01-02 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-7265: - Component/s: flink-sql > Support schema evolution by Flink SQL using HoodieHiveCatalog >

[jira] [Updated] (HUDI-7270) Support schema evolution by Flink SQL using HoodieCatalog

2024-01-02 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-7270: - Description: Since Flink 1.17, Flink SQL support more advanced alter table syntax. {code:sql} -- add a

[jira] [Created] (HUDI-7288) Fix ArrayIndexOutOfBoundsException when upgrade nonPartitionedTable created by 0.10/0.11 HUDI version

2024-01-10 Thread Jing Zhang (Jira)
Jing Zhang created HUDI-7288: Summary: Fix ArrayIndexOutOfBoundsException when upgrade nonPartitionedTable created by 0.10/0.11 HUDI version Key: HUDI-7288 URL: https://issues.apache.org/jira/browse/HUDI-7288

[jira] [Assigned] (HUDI-7288) Fix ArrayIndexOutOfBoundsException when upgrade nonPartitionedTable created by 0.10/0.11 HUDI version

2024-01-10 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang reassigned HUDI-7288: Assignee: Jing Zhang > Fix ArrayIndexOutOfBoundsException when upgrade nonPartitionedTable created

[jira] [Updated] (HUDI-7288) Fix ArrayIndexOutOfBoundsException when upgrade nonPartitionedTable created by 0.10/0.11 HUDI version

2024-01-10 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-7288: - Description: When upgrade a nonPartitionedTable which created by 0.10/0.11 HUDI version, an

[jira] [Updated] (HUDI-7288) Fix ArrayIndexOutOfBoundsException when upgrade nonPartitionedTable created by 0.10/0.11 HUDI version

2024-01-10 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated HUDI-7288: - Description: When upgrade a nonPartitionedTable which created by 0.10/0.11 HUDI version, an

  1   2   >