Re: Skipped Jobs
Thanks for the correction Mark :) On Sun, Apr 19, 2015 at 3:45 PM Mark Hamstra wrote: > Almost. Jobs don't get skipped. Stages and Tasks do if the needed > results are already available. > > On Sun, Apr 19, 2015 at 3:18 PM, Denny Lee wrote: > >> The job is skipped because the results are available in memory from a >> prior run. More info at: >> http://mail-archives.apache.org/mod_mbox/spark-user/201501.mbox/%3ccakx7bf-u+jc6q_zm7gtsj1mihagd_4up4qxpd9jfdjrfjax...@mail.gmail.com%3E. >> HTH! >> >> On Sun, Apr 19, 2015 at 1:43 PM James King wrote: >> >>> In the web ui i can see some jobs as 'skipped' what does that mean? why >>> are these jobs skipped? do they ever get executed? >>> >>> Regards >>> jk >>> >> >
Re: Skipped Jobs
Almost. Jobs don't get skipped. Stages and Tasks do if the needed results are already available. On Sun, Apr 19, 2015 at 3:18 PM, Denny Lee wrote: > The job is skipped because the results are available in memory from a > prior run. More info at: > http://mail-archives.apache.org/mod_mbox/spark-user/201501.mbox/%3ccakx7bf-u+jc6q_zm7gtsj1mihagd_4up4qxpd9jfdjrfjax...@mail.gmail.com%3E. > HTH! > > On Sun, Apr 19, 2015 at 1:43 PM James King wrote: > >> In the web ui i can see some jobs as 'skipped' what does that mean? why >> are these jobs skipped? do they ever get executed? >> >> Regards >> jk >> >
Re: Skipped Jobs
The job is skipped because the results are available in memory from a prior run. More info at: http://mail-archives.apache.org/mod_mbox/spark-user/201501.mbox/%3ccakx7bf-u+jc6q_zm7gtsj1mihagd_4up4qxpd9jfdjrfjax...@mail.gmail.com%3E. HTH! On Sun, Apr 19, 2015 at 1:43 PM James King wrote: > In the web ui i can see some jobs as 'skipped' what does that mean? why > are these jobs skipped? do they ever get executed? > > Regards > jk >
Skipped Jobs
In the web ui i can see some jobs as 'skipped' what does that mean? why are these jobs skipped? do they ever get executed? Regards jk