Does it still hit the memory limit for the container?

An expensive transformation?

On Wed, Apr 22, 2015 at 8:45 AM, Ted Yu <[email protected]> wrote:

> In master branch, overhead is now 10%.
> That would be 500 MB
>
> FYI
>
>
>
> > On Apr 22, 2015, at 8:26 AM, nsalian <[email protected]> wrote:
> >
> > +1 to executor-memory to 5g.
> > Do check the overhead space for both the driver and the executor as per
> > Wilfred's suggestion.
> >
> > Typically, 384 MB should suffice.
> >
> >
> >
> > --
> > View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Performance-on-Yarn-tp21729p22610.html
> > Sent from the Apache Spark User List mailing list archive at Nabble.com.
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: [email protected]
> > For additional commands, e-mail: [email protected]
> >
>

Reply via email to