Re: welcoming Burak and Holden as committers

Congrats Buraj and Holden! On Tue, Jan 24, 2017 at 10:33 AM Dongjoon Hyun wrote: > Great! Congratulations, Burak and Holden. > > Bests, > Dongjoon. > > On 2017-01-24 10:29 (-0800), Nicholas Chammas > wrote: > >   > > > > Congratulations, Burak

Yarn Log aggregation for a killed spark streaming job

Hi! We are seeing an issue around log aggregation under Yarn with Spark streaming. The specific case below is a example - we had to kill a spark streaming job, and would like to see the logs of the consumer so as to find out what happened before we had to kill it. Yarn reports the status of a

Re: Spark driver and yarn behavior

br1...@gmail.com> wrote: > > On Thu, May 19, 2016 at 3:16 PM, Shankar Venkataraman < > shankarvenkataraman...@gmail.com> wrote: > >> Hi! >> >> We are running into an interesting behavior with the Spark driver. We >> Spark running under Yarn. The spark driver seem

Spark driver and yarn behavior

Hi! We are running into an interesting behavior with the Spark driver. We Spark running under Yarn. The spark driver seems to be sending work to a dead executor for 3 hours before it recognizes it. The workload seems to have been processed by other executors just fine and we see no loss in