bithw1 opened a new issue, #17605:
URL: https://github.com/apache/hudi/issues/17605
### Describe the problem you faced
In one flink sql terminal:
```
CREATE TABLE test_flink_incremental_20251215_04 (
id int PRIMARY KEY NOT ENFORCED,
name string,
price int,
ts int,
dt string
)
PARTITIONED BY (dt)
WITH (
'connector' = 'hudi',
'path' = '/tmp/hudi/test_flink_incremental_20251215_04',
'table.type' = 'MERGE_ON_READ',
'hoodie.datasource.write.keygenerator.class' =
'org.apache.hudi.keygen.ComplexAvroKeyGenerator',
'hoodie.datasource.write.recordkey.field' = 'id',
'hoodie.datasource.write.hive_style_partitioning' = 'true',
'hive_sync.conf.dir'='/home/hadoop/software/hive-3.1.3/conf'
);
insert into test_flink_incremental_20251215_04 values (1,'a1', 10, 1000,
'2022-12-26');
insert into test_flink_incremental_20251215_04 values (2,'a2', 20, 2000,
'2022-12-26');
insert into test_flink_incremental_20251215_04 values (3,'a3', 30, 3000,
'2022-12-26');
insert into test_flink_incremental_20251215_04 values (4,'a4', 40, 4000,
'2022-12-26');
insert into test_flink_incremental_20251215_04 values (5,'a5', 40, 4000,
'2022-12-26');
```
After 5 insert into operation, there are 5 delta commits,
```
20251215134513092
20251215134520642
20251215134527179
20251215134533522
20251215134539654
20251215134539912
```
In another flink sql terminal
```
CREATE TABLE test_flink_incremental (
id int PRIMARY KEY NOT ENFORCED,
name string,
price int,
ts int,
dt string
)
PARTITIONED BY (dt)
WITH (
'connector' = 'hudi',
'path' = '/tmp/hudi/test_flink_incremental_20251215_04'
);
```
select * from test_flink_incremental
/*+
options(
'read.end-commit'='20251215134527179'
)
*/
I think I will get all the results until commit: 20251215134527179, that is
1,2,3
But, I only get 3, which is committed in 20251215134527179
So, I don't understand the behavior with read.end-commit and without
read.start-commit,
### To Reproduce
1.
2.
3.
4.
### Expected behavior
1
### Environment Description
* Hudi version:
* Spark version:
* Flink version:
* Hive version:
* Hadoop version:
* Storage (HDFS/S3/GCS..):
* Running on Docker? (yes/no):
### Additional context
1
### Stacktrace
```shell
1
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
