ignition on yarn taking up all memory

[prasanth]

I started ignite on yarn and then tried to submit a sample spark job. The
ignition job took all available memory and so spark job was in "accepted"
state forever. Spark job never had enough resources to run. 

So, I copied the following file to hdfs path /tmp/ignite and gave
IGNITE_XML_CONFIG=/tmp/ignite/cache-settings.xml and then started ignite. It
still takes up all available cluster memory (which is less around 8.5 GB).

How can I manage the memory that Ignite takes up, so that I can start other
jobs?

<?xml version="1.0" encoding="UTF-8"?>

<beans xmlns="http://www.springframework.org/schema/beans";
       xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
       xsi:schemaLocation="
       http://www.springframework.org/schema/beans
       http://www.springframework.org/schema/beans/spring-beans.xsd";>
    
    <bean id="grid.cfg"
class="org.apache.ignite.configuration.IgniteConfiguration">
      <property name="cacheConfiguration">
            <list>
                
                <bean
class="org.apache.ignite.configuration.CacheConfiguration">
                    
                    <property name="startSize" value="#{2000 * 1024 *
1024}"/>
                    <property name="atomicityMode" value="ATOMIC"/>
                    <property name="backups" value="1"/>
                    <property name="affinity" ref="cacheAffinity"/>
                </bean>
            </list>
        </property>
    </bean>
</beans>




--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/ignition-on-yarn-taking-up-all-memory-tp7161.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.