mengw15 opened a new pull request, #4478:
URL: https://github.com/apache/texera/pull/4478
What changes were proposed in this PR?
When the active Iceberg catalog is rest, only REST credentials are
forwarded across process
boundaries; when it is postgres, only Postgres credentials are forwarded.
Previously both backends'
credentials were forwarded unconditionally, exposing dead-weight
credentials to consumers that never
use them.
Two transmission paths are gated:
1. K8s CU pod env vars — ComputingUnitManagingResource.scala: extract
icebergEnvironmentVariables def
that branches on StorageConfig.icebergCatalogType and only emits the
active backend's env keys
(STORAGE_ICEBERG_CATALOG_REST_* for rest;
STORAGE_ICEBERG_CATALOG_POSTGRES_* for postgres).
2. Python UDF subprocess argv — PythonWorkflowWorker.scala: the 6 iceberg
credential slots passed to
texera_run_python_worker.py are gated by catalog type. The inactive
backend's slots are passed as
empty strings to keep the positional-arg layout stable, so the Python
entrypoint needs no change (it
already only consumes the active backend's fields via
iceberg_catalog_instance.py).
Any related issues, documentation, discussions?
Closes #4477
How was this PR tested?
- sbt ComputingUnitManagingService/compile
WorkflowExecutionService/compile passes.
- Manual verification
Was this PR authored or co-authored using generative AI tooling?
Generated-by: Claude Code (Claude Opus 4.7)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
