yalindogusahin commented on PR #794: URL: https://github.com/apache/spark-kubernetes-operator/pull/794#issuecomment-5251133873
Pushed a redesign that addresses this directly: added an optional `workerSpec.metricsPort` field. When set, the generated `NetworkPolicy` opens ingress on *that specific port only* — not port 8081/the web UI. The idea is to pair this with a JMX-to-Prometheus exporter agent (`jmx_prometheus_javaagent`) attached to the worker JVM as a `-javaagent`, which serves metrics on its own dedicated port, fully decoupled from the web UI. Default behavior (no `metricsPort` set) is unchanged from before this PR — the web UI port is never touched. Added docs (`docs/operations.md`, new "Exposing SparkCluster Worker Metrics" section) and a runnable example (`examples/cluster-with-jmx-exporter.yaml`) showing the full setup. Let me know if this addresses your concern or if you'd prefer a different shape for the config. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
