Re: how can i write spark addListener metric to kafka

[Tathagata Das]

https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#reporting-metrics-programmatically-using-asynchronous-apis

On Tue, Jun 9, 2020 at 4:42 PM a s  wrote:

> hi Guys,
>
> I am building a structured streaming  app for google analytics data
>
> i want to capture the number of rows read and processed
>
> i am able to see it in log how can i send it to kafka
>
>
> Thanks
> Alis
>

how can i write spark addListener metric to kafka

[a s]

hi Guys,

I am building a structured streaming  app for google analytics data

i want to capture the number of rows read and processed

i am able to see it in log how can i send it to kafka


Thanks
Alis