neuyilan opened a new pull request, #4891: URL: https://github.com/apache/paimon/pull/4891
<!-- Please specify the module before the PR name: [core] ... or [flink] ... --> ### Purpose Due to the introduction of an external path[1], we are unable to use the warehouse's `FileIO` to read and write files. So we introduced `HybirdFileIO`, which allows us to choose the appropriate fileio based on the prefix scheme of the path. This job is a part of this job[2] [1] https://github.com/apache/paimon/pull/4751 [2] https://cwiki.apache.org/confluence/display/PAIMON/PIP-29%3A+Introduce+Table+Multi-Location++Management ### Tests Add HybridFileIOTest.java UT ### API and Format no change ### Documentation Because the external path of the file is on the table options. So we don't know the specific file write path from the options in the catalog. So we don't know the underlying write path is an object store or not. So we need to modify the `write-buffer-spillable` parameter. Make it default to false -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
