thus does not run a Spark executor), and
each can only run one executor. In other words, this could very well be why
you are only seeing two executors.
~ Jonathan
On Wed, Feb 17, 2016 at 5:02 PM <arun.bong...@cognizant.com> wrote:
> Hi All,
>
> I have been facing memory issues in spark. im us
May set "maximizeResourceAllocation", then EMR will do the best config for
you.
http://docs.aws.amazon.com/ElasticMapReduce/latest/ReleaseGuide/emr-spark-configure.html
Jingyu
On 18 February 2016 at 12:02, <arun.bong...@cognizant.com> wrote:
> Hi All,
>
> I have
you are setting.
Kuchekar, Nilesh
On Wed, Feb 17, 2016 at 8:02 PM, <arun.bong...@cognizant.com> wrote:
> Hi All,
>
> I have been facing memory issues in spark. im using spark-sql on AWS EMR.
> i have around 50GB file in AWS S3. I want to read this file in BI tool
> connecte
Hi All,
I have been facing memory issues in spark. im using spark-sql on AWS EMR. i
have around 50GB file in AWS S3. I want to read this file in BI tool connected
to spark-sql on thrift-server over OBDC. I'm executing select * from table in
BI tool(qlikview,tableau).
I run into OOM error
