JNSimba opened a new pull request, #66932:
URL: https://github.com/apache/doris/pull/66932
### What problem does this PR solve?
Issue Number: None
Related PR: None
Problem Summary:
The file-block cache assumes that a reader exposes stable, random-access
content. HTTP readers used by CDC TVF chunk responses instead expose a dynamic
streaming response. When file cache is enabled, wrapping such a reader with
`CachedRemoteFileReader` can make the stream appear empty or reuse invalid
cached content.
This change adds a reader capability check and skips the file-cache wrapper
for HTTP chunk-response readers. Other HTTP file readers continue using the
existing cache path. A unit test covers the bypass behavior.
### Release note
Fix CDC TVF reads when file cache is enabled.
### Check List (For Author)
- Test
- [ ] Regression test
- [ ] Unit Test (added `HttpFileReaderTest.ChunkResponseSkipsFileCache`;
not run locally)
- [ ] Manual test
- [ ] No need to test or manual test
- Behavior changed: Yes. HTTP chunk-response readers bypass file-block cache.
- Does this need documentation: No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
