platoneko commented on issue #9122: URL: https://github.com/apache/incubator-doris/issues/9122#issuecomment-1103470937
Currently, Doris IO related code dependencies: Rowset -> BlockManager -> ReadableBlock/WritableBlock -> Env Scanner -> FileReader -> Env/S3Client/HDFSFS FileResultWriter -> FileWriter -> Env/S3Client/HDFSFS Expected dependencies: Rowset -> FileSystem -> ReadStream/WriteStream (different Rowset may use different FileSystem backend) Scanner -> ReadStream FileResultWriter -> WriteStream FileSystem provides APIs for directory and file management, and manage the file cache in the future. ReadStream/WriteStream may contain buffer and prefetch data in parallel. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
