Github user andrusha commented on the issue:
https://github.com/apache/spark/pull/19775
You can use Kubernetes service discovery with conjunction with Prometheus
to find all the available nodes for scraping. Then you just add in your
annotation the host and port.
https://prometheus.io/docs/prometheus/latest/configuration/configuration/#%3Ckubernetes_sd_config%3E
<https://prometheus.io/docs/prometheus/latest/configuration/configuration/#<kubernetes_sd_config>>
is a good place to start.
I think it requires a blog post, but not sure if will ever do it.
> On 16 May 2018, at 13:10, Goetz Epperlein <[email protected]>
wrote:
>
> @andrusha <https://github.com/andrusha> Do you have a tutorial how to set
this up. From my understanding if I have multiple executers pulling it is
harder, as prometheus has to have all the hostnames. Am I right or wrong?
>
> â
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
<https://github.com/apache/spark/pull/19775#issuecomment-389481586>, or mute
the thread
<https://github.com/notifications/unsubscribe-auth/AAXqz9edXdn5rSat4-m9464k3NM-c2NJks5tzAkSgaJpZM4QiEPC>.
>
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
