hubgeter opened a new pull request, #70815:
URL: https://github.com/apache/doris/pull/70815

   ### Background
   
   `SELECT INTO OUTFILE` writes query results to files. `EXPORT TABLE` runs a 
similar export as a background job. Both support remote storage, and clusters 
that enable `enable_outfile_to_local` can also write results to a BE host.
   
   ### What problem does this PR solve?
   
   Issue Number: None
   
   Related PR: #70813 (alternative that retains local exports for 
administrators)
   
   PR Type: Enhancement
   
   Problem Summary: Retire the native local destination for both statements. 
Existing jobs that write to a BE host must move to remote storage before 
upgrading. Most of the diff migrates regression suites that used a BE directory 
as a temporary test fixture.
   
   ### Details
   
   - **Change map:** 10 production files (+52/-136) cover FE destination 
validation, the old configuration setting and BE file writers. The remaining 49 
files (+840/-2631) cover unit tests, regression suites, their fixtures and one 
test-client example.
   - **Before and after:** A configured cluster previously accepted native 
local exports. FE now requires a remote destination before registering an 
export job or starting an OUTFILE write. BE rejects the local storage type for 
result files and success markers.
   - **Configs and defaults:** `enable_outfile_to_local` remains readable for 
compatibility. Both values now have the same effect.
   - **Impact on existing users:** Move local exports to an object store, a 
remote Hadoop filesystem or a named broker with a remote destination. Direct 
Hadoop exports require a supported Hadoop URI.
   - **Behavior change:** Native local exports are retired for all users, 
including administrators.
   
   ### Testing
   
   Added FE cases for the legacy setting and destination validation, a BE unit 
case for file writer selection, and regression assertions for both SQL 
statements. Updated regression fixtures to read back exported objects. Java 
Checkstyle, FE metadata checks, clang-format 16, BE header hygiene, Groovy 
syntax checks and diff whitespace checks passed. Builds, unit tests and cluster 
regressions were not run locally.
   
   ### Notes for Reviewers
   
   Start with `BrokerDesc.getFileLocationForExport` for FE destination 
resolution and `FileFactory::outfile_file_type` for BE writer selection. The BE 
check also applies when an older FE submits a local result sink during a 
rolling upgrade.
   
   ### Release note
   
   `SELECT INTO OUTFILE` and `EXPORT TABLE` now require a remote destination. 
Clusters using `enable_outfile_to_local=true` must update local export jobs 
before upgrading.
   
   ### Check List (For Author)
   
   - Behavior changed: Yes (see Details).
   - Does this need documentation: Yes. Update the OUTFILE, EXPORT, FE 
configuration and upgrade references in the Doris website.
   - Pre-submission status: Partially verified: runtime tests are pending.
   
   ### AI Disclosure
   
   - Tool: OpenAI Codex (GPT-6)
   - Generated: Code, tests and PR description.
   - Human review: Pending.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to