morningman opened a new pull request, #70662:
URL: https://github.com/apache/doris/pull/70662

   ### Background
   
   FE, BE and MS runtime images share a base image and copy Doris release 
binaries into it. The base previously included development packages, two JDKs 
and prebuilt operator tools.
   
   ### What problem does this PR solve?
   
   Issue Number: #69975
   Related PR: None
   PR Type: Enhancement
   
   Problem Summary:
   
   Runtime images inherited outdated OS packages, an old JDK and Go 
dependencies, and unnecessary diagnostic and development software. Build a 
minimal patched base with one maintained JDK and rebuilt operator tools, verify 
release downloads, and remove Arthas and shared example private keys before the 
final FE image layer. Make component builds consume the base produced by the 
build script.
   
   ### Details
   
   - **Change map:** 402 changed lines in runtime Dockerfiles and shell 
scripts, 230 lines of tests and layer verification, and 198 changed 
documentation lines. No generated files or Doris application dependency changes.
   - **Before and after:** Replace base-6.0, jdk-latest and debug-latest with a 
minimal base built from pinned Ubuntu 22.04, Temurin 17.0.21+9 or 8u512-b09, 
and Go 1.27.4 images. Rebuild the pinned doris-operator tools with x/net 
v0.62.0 and edwards25519 v1.1.1. Apply available OS updates over HTTPS and 
retain runtime package and Go build inventories.
   - **Configs and defaults:** Use base-7.0-jdk17 or base-7.0-jdk8. The build 
script preserves its release-based Java selection, verifies SHA512 before 
extraction, and passes the newly built base to every component. Manual 
component builds default to Java 17; older releases require JAVA_VERSION=8 or 
an explicit Java 8 BASE_IMAGE. The slim Dockerfile aliases the minimal default 
base.
   - **Impact on existing users:** General profiling tools, development 
headers, Python 2 and Arthas are no longer bundled. MySQL SSL users must supply 
their own certificate stores and configure the existing certificate properties. 
Keep both operator commands and MySQL client TLS options.
   - **Behavior change:** Packaging and build defaults change as described 
above. Doris application code and dependencies, doris-compose and all-in-one 
build paths are unchanged.
   
   ### Testing
   
   - Six release-build tests pass, covering SHA512 success and failure, GNU/BSD 
checksum documents, ambiguous checksum rejection, invalid versions, 
architecture selection, Java 8 selection, optional MS and base-image handoff.
   - Bash syntax, ShellCheck with repository configuration, Python syntax and 
git diff --check pass.
   - Built and ran the Java 8 and Java 17 bases for both ARM64 and AMD64. Built 
the slim alias. Used mirrors with the same pinned digests where Docker Hub 
authentication is unavailable.
   - Repackaged the official ARM64 Doris 4.1.5 FE, BE and MS binaries using the 
modified component Dockerfiles. Ran FE/BE entry points, node registration, 
table creation, inserts and a Java UDF query through BE JNI.
   - Verified a MySQL connection with VERIFY_IDENTITY using runtime-provided 
PKCS12 stores and ran the Java UDF query through that connection.
   - Ran the MS entry point with a newly initialized FoundationDB 7.3.69 
instance and verified its health endpoint. Exercised the rebuilt operator debug 
mode and dorisctl node-tag lookup.
   - Inspected every saved image layer of FE, BE, MS and representative bases 
for removed default keys, Arthas and the unselected JDK.
   - Trivy 0.76.2 scans of all four base variants report zero Critical/High 
findings, zero Go findings and 48 OS Medium/Low findings, all without published 
fixed versions in the scan database.
   
   ### Notes for Reviewers
   
   Doris application jars and their shaded dependencies require separate 
updates. This change does not claim that all scanner findings disappear. Full 
AMD64 Doris cluster, cloud compute-group and external-catalog compatibility 
matrices have not been run.
   
   ### Release note
   
   Runtime images use updated OS packages, maintained OpenJDK builds and 
rebuilt operator tools, with fewer bundled tools and no shared example MySQL 
private keys. MySQL SSL deployments must provide their own certificate stores. 
Manual builds for older Java 8 releases must select the Java 8 base.
   
   ### Check List (For Author)
   
   - Behavior changed: Yes (see Details).
   - Does this need documentation: Yes, updated docker/runtime/README.md is 
included.
   - Pre-submission status: Partially verified: no full AMD64 Doris cluster or 
complete cloud/external-catalog test matrix.
   
   ### AI Disclosure
   
   - Tool: Codex (GPT-6).
   - Generated: Dockerfiles, scripts, tests, documentation and this description.
   - Human review: Pending author review.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to