Re: Execution blocked when collect()ing some relatively big blocks on spark 0.9

[Guillaume Pitel]

runs till completion, but on occasion, it will just hang. The driver says, its sent all the tasks for the next stage. The executors, however, stop logging after sending back the results of the completed tasks from the previous stage. Do you know what's the size of the result sent back to the driver when it fails ? It should be logged -- Guillaume PITEL, Président +33(0)6 25 48 86 80 eXenSa S.A.S. 41, rue Périer - 92120 Montrouge - FRANCE Tel +33(0)1 84 16 36 77 / Fax +33(0)9 72 28 37 05