I believe it shows only the tasks that have actually being executed, if there were tasks with no data, they don't get reported.
I might be mistaken, if somebody has a good explanation, would also like to hear. On Fri, May 19, 2017 at 5:45 PM, Miles Crawford <mil...@allenai.org> wrote: > Hey ya'll, > > Trying to migrate from Spark 1.6.1 to 2.1.0. > > I use EMR, and launched a new cluster using EMR 5.5, which runs spark > 2.1.0. > > I updated my dependencies, and fixed a few API changes related to > accumulators, and presto! my application was running on the new cluster. > > But the application UI shows crazy output: > https://www.dropbox.com/s/egtj1056qeudswj/sparkwut.png?dl=0 > > The applications seem to complete successfully, but I was wondering if > anyone has an idea of what might be going wrong? > > Thanks, > -Miles >
