Structured Streaming Broadcasts

2018-02-09 Thread Daniel van der Ende
practice for dealing with broadcasts in long running jobs?) Thanks! Daniel van der Ende

Re: GC limit exceed

2017-01-18 Thread Daniel van der Ende
Hi Marco, What kind of scheduler are you using on your cluster? Yarn? Also, are you running in client mode or cluster mode on the cluster? Daniel On Wed, Jan 18, 2017 at 3:22 PM, marco rocchi < rocchi.1407...@studenti.uniroma1.it> wrote: > I have a spark code that works well over a sample of d