openinx commented on issue #2397: URL: https://github.com/apache/iceberg/issues/2397#issuecomment-810894095
@wuwangben In this lines: ```java FlinkSource.forRowData().env(bsEnv).filters(Collections.singletonList(filter)).project(flinkSchema) ``` The `filters` are used to push down filters to data files, then we don't have read all the data files from iceberg table. But those filters won't be applied in row-level, that means we may still read more rows from the filtered data files. In you case, I think we will still need to filter the unexpected rows in `DataStream` by: ```java dataStream.filter(FilterFunction func); ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
