[
https://issues.apache.org/jira/browse/FLINK-39572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated FLINK-39572:
-----------------------------------
Labels: pull-request-available (was: )
> Hide sensitive information when pyflink's beam runner is closed
> ----------------------------------------------------------------
>
> Key: FLINK-39572
> URL: https://issues.apache.org/jira/browse/FLINK-39572
> Project: Flink
> Issue Type: Improvement
> Reporter: Biao Geng
> Priority: Major
> Labels: pull-request-available
>
> Currently when pyflink finishes a job execution,
> DefaultJobBundleFactory will be closed, which will unref underlying
> WrappedSdkHarnessClient.
> Given the current implementation, environment.getEnvironment() would be
> logged, we may need to use helper method like
> ConfigurationUtils.hideSensitiveValues to hide the sensitive information
> :
> {code:java}
> private int unref() {
> int refCount = bundleRefCount.decrementAndGet();
> Preconditions.checkState(refCount >= 0, "Reference count must not be
> negative.");
> if (refCount == 0) {
> // Close environment after it was removed from cache and all bundles
> finished.
> LOG.info("Closing environment {}", environment.getEnvironment());
> close();
> }
> return refCount;
> } {code}
>
> 2026-04-28 20:44:34,591 INFO
> org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory [] -
> Closing environment urn: "beam:env:process:v1"
> payload:
> "\032`/root/multi-modal-benchmark/.venv/lib/python3.11/site-packages/pyflink/bin/pyflink-udf-runner.sh\"\367\001\n\004PATH\022\356\001/usr/lib/jvm/java-11-openj
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
