Hi
In Ignite's default-config.xml file I have the following cache configuration
define:
<bean class="org.apache.ignite.configuration.CacheConfiguration">
<property name="memoryMode" value="ONHEAP_TIERED"/>
<property name="offHeapMaxMemory" value="0"/>
<property name="evictionPolicy">
<bean
class="org.apache.ignite.cache.eviction.fifo.FifoEvictionPolicy">
<property name="maxSize" value="10000000"/>
</bean>
</property>
</bean>
I am storing one large chunk of data using Ignite Spark share RDD:
JavaIgniteRDD<String, MyData> myRdd =ic.fromCache("TestData");
:
myRdd.savePair(myPairRdd); // myPairRdd just have one pair with the large
data as value
When this is submitted to Spark execution, the Ignite server get the
following exception:
[12:21:06] Topology snapshot [ver=60, servers=1, clients=0, CPUs=8,
heap=1.0GB]
[12:21:34] Topology snapshot [ver=61, servers=1, clients=1, CPUs=8,
heap=16.0GB]
Exception in thread "ignite-#7%pub-null%" java.lang.OutOfMemoryError: Java
heap space
at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream$HandleTable.grow(OptimizedObjectInputStream.java:1074)
at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream$HandleTable.assign(OptimizedObjectInputStream.java:1032)
at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readString(OptimizedObjectInputStream.java:866)
at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readObjectOverride(OptimizedObjectInputStream.java:272)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:365)
at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readArray(OptimizedObjectInputStream.java:361)
at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readObjectOverride(OptimizedObjectInputStream.java:269)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:365)
at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readFields(OptimizedObjectInputStream.java:482)
at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readSerializable(OptimizedObjectInputStream.java:570)
at
org.apache.ignite.marshaller.optimized.OptimizedClassDescriptor.read(OptimizedClassDescriptor.java:808)
at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readObjectOverride(OptimizedObjectInputStream.java:315)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:365)
at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readFields(OptimizedObjectInputStream.java:482)
at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readSerializable(OptimizedObjectInputStream.java:570)
at
org.apache.ignite.marshaller.optimized.OptimizedClassDescriptor.read(OptimizedClassDescriptor.java:808)
at
org.apache.ignite.marshaller.optimized.OptimizedObjectInputStream.readObjectOverride(OptimizedObjectInputStream.java:315)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:365)
at
org.apache.ignite.marshaller.optimized.OptimizedMarshaller.unmarshal(OptimizedMarshaller.java:240)
at
org.apache.ignite.internal.processors.cacheobject.IgniteCacheObjectProcessorImpl.unmarshal(IgniteCacheObjectProcessorImpl.java:101)
at
org.apache.ignite.internal.processors.cache.portable.CacheObjectPortableProcessorImpl.unmarshal(CacheObjectPortableProcessorImpl.java:730)
at
org.apache.ignite.internal.processors.cache.CacheObjectImpl.finishUnmarshal(CacheObjectImpl.java:104)
at
org.apache.ignite.internal.processors.datastreamer.DataStreamerUpdateJob.call(DataStreamerUpdateJob.java:116)
at
org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor.processRequest(DataStreamProcessor.java:297)
at
org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor.access$000(DataStreamProcessor.java:49)
at
org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor$1.onMessage(DataStreamProcessor.java:76)
at
org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:811)
at
org.apache.ignite.internal.managers.communication.GridIoManager.access$1500(GridIoManager.java:106)
at
org.apache.ignite.internal.managers.communication.GridIoManager$5.run(GridIoManager.java:774)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
My question is how can I increase the Java heap memory when I run the
ignite.sh? Thanks.
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Increase-Java-heap-space-for-Ignite-tp1768.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
