Hi, Ignite which running over YARN should occupies memory how set in IGNITE_MEMORY_PER_NODE property. Could you please share your config file?
On Fri, Aug 19, 2016 at 9:24 AM, prasanth <[email protected]> wrote: > I started ignite on yarn and then tried to submit a sample spark job. The > ignition job took all available memory and so spark job was in "accepted" > state forever. Spark job never had enough resources to run. > > So, I copied the following file to hdfs path /tmp/ignite and gave > IGNITE_XML_CONFIG=/tmp/ignite/cache-settings.xml and then started ignite. > It > still takes up all available cluster memory (which is less around 8.5 GB). > > How can I manage the memory that Ignite takes up, so that I can start other > jobs? > > <?xml version="1.0" encoding="UTF-8"?> > > <beans xmlns="http://www.springframework.org/schema/beans"; > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; > xsi:schemaLocation=" > http://www.springframework.org/schema/beans > http://www.springframework.org/schema/beans/spring-beans.xsd";> > > <bean id="grid.cfg" > class="org.apache.ignite.configuration.IgniteConfiguration"> > <property name="cacheConfiguration"> > <list> > > <bean > class="org.apache.ignite.configuration.CacheConfiguration"> > > <property name="startSize" value="#{2000 * 1024 * > 1024}"/> > <property name="atomicityMode" value="ATOMIC"/> > <property name="backups" value="1"/> > <property name="affinity" ref="cacheAffinity"/> > </bean> > </list> > </property> > </bean> > </beans> > > > > > -- > View this message in context: http://apache-ignite-users. > 70518.x6.nabble.com/ignition-on-yarn-taking-up-all-memory-tp7161.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. >
