mincwang edited a comment on pull request #3703:
URL: https://github.com/apache/hudi/pull/3703#issuecomment-971599052
> > Hi，everyone，I have used this patch, i used flink sql execute batch query
and the results were as expected , but spark-sql still lost data when querying
rt table. I want it can as release blocker.
>
> Hi @mincwang , is that possible to reproduce the data lost in a unit test?
Are you using hive rt view or Spark MOR relation?
Thanks for @garyli1019 reply，I used the Spark MOR query, the Spark query
loses data when the Flink streaming writes to HUDi and the compression
scheduler is executed but the compression plan is not executed。
```sql
-- FLINK SQL with clause DDL
'compaction.schedule.enabled' = 'true',
'compaction.async.enabled' = 'false',
-- 'compaction.trigger.strategy' = 'time_elapsed',
-- 'compaction.delta_seconds' = '3600'
```
Hi @danny0405 ，Can you give we a more professional reply?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
