Re: Problems in running spark on Yarn

2015-09-01 Thread Tsuyoshi Ozawa
Hi Matteo, It depends on configurations - yarn-site.xml (nodemanager's capacity of memory) and requests of containers by spark(spark.yarn.am.memory and executor's Memory) if you don't use Dominant Resource Fairness. Could you share them? Thanks, - Tsuyoshi On Wed, Sep 2, 2015 at 7:25 AM, Matteo

RE: Problems in running spark on Yarn

2015-09-01 Thread Kiran Kumar Reddy Govind
Guys, How does Hive work with MAPREDUCE , can someone clarify unable to understand this concept. Regards, From: Matteo Luzzi [mailto:matteo.lu...@gmail.com] Sent: Wednesday, September 02, 2015 2:26 AM To: user@hadoop.apache.org Subject: Problems in running spark on Yarn Hi all! I'm developing