rangareddy commented on issue #11085:
URL: https://github.com/apache/hudi/issues/11085#issuecomment-4855078749
This is a config-precedence gap in `HoodieMultiTableDeltaStreamer`
(different from the single-table `HoodieDeltaStreamer`, where `--hoodie-conf`
correctly overrides `--props`). The multi-table streamer builds a per-table
`TypedProperties` by merging the common `--props` with each table's
`configFile`, and the `--hoodie-conf` overrides aren't re-applied on top of
that per-table object — so the Kafka source reads `sasl.jaas.config` from the
file-derived props and your override never lands. That's why both "dummy value
in file" and "omit from file" fail. Since your goal is to keep the SASL creds
out of the ConfigMap, the robust fix is to render the props file at runtime
from a K8s Secret (template in ConfigMap with `${KAFKA_USER}`/`${KAFKA_PASS}`
placeholders, an initContainer runs `envsubst` into a shared volume, point
`--props` at the rendered file) — no reliance on `--hoodie-conf`. Otherwise,
set the value directly in the per-table `configFile` as the single source of
truth, o
r use single-table `HoodieDeltaStreamer` where `--hoodie-conf` override works.
Please confirm whether the multi-table override was fixed in a newer release
before depending on it; on 0.13.1 it doesn't override.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
