What he meant is that look it up in the Spark UI, specifically in the Stage tab to see what is taking so long. And yes code snippet helps us debug.
TD On Fri, Apr 3, 2015 at 12:47 AM, Akhil Das <ak...@sigmoidanalytics.com> wrote: > You need open the Stage\'s page which is taking time, and see how long its > spending on GC etc. Also it will be good to post that Stage and its > previous transformation's code snippet to make us understand it better. > > Thanks > Best Regards > > On Fri, Apr 3, 2015 at 1:05 PM, Vijay Innamuri <vijay.innam...@gmail.com> > wrote: > >> >> When I run the Spark application (streaming) in local mode I could see >> the execution progress as below.. >> >> [Stage >> 0:========================================================================> >> (1817 + 1) / 3125] >> .... >> [Stage >> 2:=======================================> >> (740 + 1) / 3125] >> >> One of the stages is taking long time for execution. >> >> How to find the transformations/ actions associated with a particular >> stage? >> Is there anyway to find the execution DAG of a Spark Application? >> >> Regards >> Vijay >> > >
