Give a look at this:
https://github.com/LucaCanali/sparkMeasure
On 2022/1/20 1:18, Prasad Bhalerao wrote:
Is there any way we can profile spark applications which will show no.
of invocations of spark api and their execution time etc etc just the
way jprofiler shows all the details?
-
You can take a look at jvm profiler that was open sourced by uber:
https://github.com/uber-common/jvm-profiler
On Thu, Jan 20, 2022 at 11:20 AM Prasad Bhalerao <
prasadbhalerao1...@gmail.com> wrote:
> Hi,
>
> It will require code changes and I am looking at some third party code , I
> am lookin
Hi,
It will require code changes and I am looking at some third party code , I
am looking for something which I can just hook to jvm and get the stats..
Thanks,
Prasad
On Thu, Jan 20, 2022 at 11:00 AM Sonal Goyal wrote:
> Hi Prasad,
>
> Have you checked the SparkListener -
> https://mallikarju
Hi Prasad,
Have you checked the SparkListener -
https://mallikarjuna_g.gitbooks.io/spark/content/spark-SparkListener.html ?
Cheers,
Sonal
https://github.com/zinggAI/zingg
On Thu, Jan 20, 2022 at 10:49 AM Prasad Bhalerao <
prasadbhalerao1...@gmail.com> wrote:
> Hello,
>
> Is there any way we c
Hello,
Is there any way we can profile spark applications which will show no. of
invocations of spark api and their execution time etc etc just the way
jprofiler shows all the details?
Thanks,
Prasad