About more succeeded tasks than total tasks: - This can happen if you have enabled speculative execution. Some partitions can get processed multiple times. - More commonly, the result of the stage may be used in a later calculation, and has to be recalculated. This happens if some of the results were evicted from cache.
On Wed, Jun 11, 2014 at 2:23 AM, Shuo Xiang <shuoxiang...@gmail.com> wrote: > Hi, > Came up with some confusion regarding the information on SparkUI. The > following info is gathered while factorizing a large matrix using ALS: > 1. some stages have more succeeded tasks than total tasks, which are > displayed in the 5th column. > 2. duplicate stages with exactly same stageID (stage 1/3/7) > 3. Clicking into some stages, some executors cannot be addressed. Does > that mean lost of executor or this does not matter? > > Any explanation are appreciated! > > >
