Re: Skipped Jobs

2015-04-19 Thread Denny Lee
Thanks for the correction Mark :)

On Sun, Apr 19, 2015 at 3:45 PM Mark Hamstra 
wrote:

> Almost.  Jobs don't get skipped.  Stages and Tasks do if the needed
> results are already available.
>
> On Sun, Apr 19, 2015 at 3:18 PM, Denny Lee  wrote:
>
>> The job is skipped because the results are available in memory from a
>> prior run.  More info at:
>> http://mail-archives.apache.org/mod_mbox/spark-user/201501.mbox/%3ccakx7bf-u+jc6q_zm7gtsj1mihagd_4up4qxpd9jfdjrfjax...@mail.gmail.com%3E.
>> HTH!
>>
>> On Sun, Apr 19, 2015 at 1:43 PM James King  wrote:
>>
>>> In the web ui i can see some jobs as 'skipped' what does that mean? why
>>> are these jobs skipped? do they ever get executed?
>>>
>>> Regards
>>> jk
>>>
>>
>


Re: Skipped Jobs

2015-04-19 Thread Mark Hamstra
Almost.  Jobs don't get skipped.  Stages and Tasks do if the needed results
are already available.

On Sun, Apr 19, 2015 at 3:18 PM, Denny Lee  wrote:

> The job is skipped because the results are available in memory from a
> prior run.  More info at:
> http://mail-archives.apache.org/mod_mbox/spark-user/201501.mbox/%3ccakx7bf-u+jc6q_zm7gtsj1mihagd_4up4qxpd9jfdjrfjax...@mail.gmail.com%3E.
> HTH!
>
> On Sun, Apr 19, 2015 at 1:43 PM James King  wrote:
>
>> In the web ui i can see some jobs as 'skipped' what does that mean? why
>> are these jobs skipped? do they ever get executed?
>>
>> Regards
>> jk
>>
>


Re: Skipped Jobs

2015-04-19 Thread Denny Lee
The job is skipped because the results are available in memory from a prior
run.  More info at:
http://mail-archives.apache.org/mod_mbox/spark-user/201501.mbox/%3ccakx7bf-u+jc6q_zm7gtsj1mihagd_4up4qxpd9jfdjrfjax...@mail.gmail.com%3E.
HTH!

On Sun, Apr 19, 2015 at 1:43 PM James King  wrote:

> In the web ui i can see some jobs as 'skipped' what does that mean? why
> are these jobs skipped? do they ever get executed?
>
> Regards
> jk
>


Skipped Jobs

2015-04-19 Thread James King
In the web ui i can see some jobs as 'skipped' what does that mean? why are
these jobs skipped? do they ever get executed?

Regards
jk