hubgeter opened a new pull request, #70815: URL: https://github.com/apache/doris/pull/70815
### Background `SELECT INTO OUTFILE` writes query results to files. `EXPORT TABLE` runs a similar export as a background job. Both support remote storage, and clusters that enable `enable_outfile_to_local` can also write results to a BE host. ### What problem does this PR solve? Issue Number: None Related PR: #70813 (alternative that retains local exports for administrators) PR Type: Enhancement Problem Summary: Retire the native local destination for both statements. Existing jobs that write to a BE host must move to remote storage before upgrading. Most of the diff migrates regression suites that used a BE directory as a temporary test fixture. ### Details - **Change map:** 10 production files (+52/-136) cover FE destination validation, the old configuration setting and BE file writers. The remaining 49 files (+840/-2631) cover unit tests, regression suites, their fixtures and one test-client example. - **Before and after:** A configured cluster previously accepted native local exports. FE now requires a remote destination before registering an export job or starting an OUTFILE write. BE rejects the local storage type for result files and success markers. - **Configs and defaults:** `enable_outfile_to_local` remains readable for compatibility. Both values now have the same effect. - **Impact on existing users:** Move local exports to an object store, a remote Hadoop filesystem or a named broker with a remote destination. Direct Hadoop exports require a supported Hadoop URI. - **Behavior change:** Native local exports are retired for all users, including administrators. ### Testing Added FE cases for the legacy setting and destination validation, a BE unit case for file writer selection, and regression assertions for both SQL statements. Updated regression fixtures to read back exported objects. Java Checkstyle, FE metadata checks, clang-format 16, BE header hygiene, Groovy syntax checks and diff whitespace checks passed. Builds, unit tests and cluster regressions were not run locally. ### Notes for Reviewers Start with `BrokerDesc.getFileLocationForExport` for FE destination resolution and `FileFactory::outfile_file_type` for BE writer selection. The BE check also applies when an older FE submits a local result sink during a rolling upgrade. ### Release note `SELECT INTO OUTFILE` and `EXPORT TABLE` now require a remote destination. Clusters using `enable_outfile_to_local=true` must update local export jobs before upgrading. ### Check List (For Author) - Behavior changed: Yes (see Details). - Does this need documentation: Yes. Update the OUTFILE, EXPORT, FE configuration and upgrade references in the Doris website. - Pre-submission status: Partially verified: runtime tests are pending. ### AI Disclosure - Tool: OpenAI Codex (GPT-6) - Generated: Code, tests and PR description. - Human review: Pending. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
