Hi folks:
We are trying to migrate our application's cache from an external cache like
ehcache or memcached to ignite. We store some decently-sized objects in our
cache (e.g., an 8MB file is not atypical).
We have an abstraction layer with pluggable cache providers and can switch
between providers in our configuration. Ehcache and memcached work great,
but as soon as we switch to using our Ignite cluster we run into memory
problems (java heap space OOMEs). This even happens when the caches are
configured to use OFFHEAP_TIERED mode with swap enabled.
I read in the forum there is an issue where buffers can cause this, and to
limit the pool size in the marshaller to try and prevent this, if it is
indeed the cause.
We're seeing this error when we configure the marshaller with poolSize = 2
in our spring configuration, can anyone shed some light on what's happening?
Thanks!
Dan
Caused by: class
org.apache.ignite.internal.transactions.IgniteTxHeuristicCheckedException:
Failed to locally write to cache (all transaction entries will be
invalidated, however there was a window when entries for this transaction
were visible to others): GridNearTxLocal
[mappings=IgniteTxMappingsSingleImpl [mapping=GridDistributedTxMapping
[entries=[IgniteTxEntry [key=KeyCacheObjectImpl
[val=GridServiceDeploymentKey [name=distributedSchedulerService],
hasValBytes=true], cacheId=-2100569601, txKey=IgniteTxKey
[key=KeyCacheObjectImpl [val=GridServiceDeploymentKey
[name=distributedSchedulerService], hasValBytes=true], cacheId=-2100569601],
val=[op=CREATE, val=UserCacheObjectImpl [val=GridServiceDeployment
[nodeId=740a8842-94ff-4e47-85ee-c38ce010b9d5, cfg=ServiceConfiguration
[name=distributedSchedulerService, totalCnt=1, maxPerNodeCnt=1,
cacheName=null, svcCls=DistributedSchedulerServiceImpl,
nodeFilterCls=AttributeFilter]], hasValBytes=false]], prevVal=[op=NOOP,
val=null], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1,
conflictVer=null, explicitVer=null, dhtVer=GridCacheVersion
[topVer=67716190, nodeOrderDrId=1, globalTime=1456236189635,
order=1456236189025],
filters=[org.apache.ignite.internal.processors.cache.CacheEntrySerializablePredicate@f665465],
filtersPassed=false, filtersSet=true, entry=GridDhtColocatedCacheEntry
[super=GridDhtCacheEntry [rdrs=[], locPart=GridDhtLocalPartition [id=65,
mapPubSize=0, rmvQueue=GridCircularBuffer [sizeMask=127, idxGen=0], cntr=0,
state=OWNING, reservations=0, empty=false, createTime=02/23/2016 06:03:09,
mapPubSize=0], super=GridDistributedCacheEntry [super=GridCacheMapEntry
[key=KeyCacheObjectImpl [val=GridServiceDeploymentKey
[name=distributedSchedulerService], hasValBytes=true], val=null,
startVer=1456236189024, ver=GridCacheVersion [topVer=67716190,
nodeOrderDrId=1, globalTime=1456236189617, order=1456236189024],
hash=-1073135968, extras=GridCacheMvccEntryExtras [mvcc=GridCacheMvcc
[locs=[GridCacheMvccCandidate [nodeId=740a8842-94ff-4e47-85ee-c38ce010b9d5,
ver=GridCacheVersion [topVer=67716190, nodeOrderDrId=1,
globalTime=1456236189597, order=1456236189023], timeout=0, ts=1456236189622,
threadId=20, id=1, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0],
reentry=null, otherNodeId=740a8842-94ff-4e47-85ee-c38ce010b9d5,
otherVer=GridCacheVersion [topVer=67716190, nodeOrderDrId=1,
globalTime=1456236189597, order=1456236189023], mappedDhtNodes=null,
mappedNearNodes=null, ownerVer=null, serOrder=null, key=KeyCacheObjectImpl
[val=GridServiceDeploymentKey [name=distributedSchedulerService],
hasValBytes=true],
masks=local=1|owner=1|ready=1|reentry=0|used=0|tx=1|single_implicit=1|dht_local=1|near_local=0|removed=0,
prevVer=null, nextVer=null]], rmts=null]], flags=0]]]], prepared=true,
locked=false, nodeId=740a8842-94ff-4e47-85ee-c38ce010b9d5, locMapped=false,
expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=0,
serReadVer=null, xidVer=GridCacheVersion [topVer=67716190, nodeOrderDrId=1,
globalTime=1456236189597, order=1456236189023]]], explicitLock=false,
dhtVer=GridCacheVersion [topVer=67716190, nodeOrderDrId=1,
globalTime=1456236189597, order=1456236189023], last=false, near=false,
clientFirst=false, node=740a8842-94ff-4e47-85ee-c38ce010b9d5]],
nearLocallyMapped=false, colocatedLocallyMapped=true, needCheckBackup=null,
hasRemoteLocks=false, mappings=IgniteTxMappingsSingleImpl
[mapping=GridDistributedTxMapping [entries=[IgniteTxEntry
[key=KeyCacheObjectImpl [val=GridServiceDeploymentKey
[name=distributedSchedulerService], hasValBytes=true], cacheId=-2100569601,
txKey=IgniteTxKey [key=KeyCacheObjectImpl [val=GridServiceDeploymentKey
[name=distributedSchedulerService], hasValBytes=true], cacheId=-2100569601],
val=[op=CREATE, val=UserCacheObjectImpl [val=GridServiceDeployment
[nodeId=740a8842-94ff-4e47-85ee-c38ce010b9d5, cfg=ServiceConfiguration
[name=distributedSchedulerService, totalCnt=1, maxPerNodeCnt=1,
cacheName=null, svcCls=DistributedSchedulerServiceImpl,
nodeFilterCls=AttributeFilter]], hasValBytes=false]], prevVal=[op=NOOP,
val=null], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1,
conflictVer=null, explicitVer=null, dhtVer=GridCacheVersion
[topVer=67716190, nodeOrderDrId=1, globalTime=1456236189635,
order=1456236189025],
filters=[org.apache.ignite.internal.processors.cache.CacheEntrySerializablePredicate@f665465],
filtersPassed=false, filtersSet=true, entry=GridDhtColocatedCacheEntry
[super=GridDhtCacheEntry [rdrs=[], locPart=GridDhtLocalPartition [id=65,
mapPubSize=0, rmvQueue=GridCircularBuffer [sizeMask=127, idxGen=0], cntr=0,
state=OWNING, reservations=0, empty=false, createTime=02/23/2016 06:03:09,
mapPubSize=0], super=GridDistributedCacheEntry [super=GridCacheMapEntry
[key=KeyCacheObjectImpl [val=GridServiceDeploymentKey
[name=distributedSchedulerService], hasValBytes=true], val=null,
startVer=1456236189024, ver=GridCacheVersion [topVer=67716190,
nodeOrderDrId=1, globalTime=1456236189617, order=1456236189024],
hash=-1073135968, extras=GridCacheMvccEntryExtras [mvcc=GridCacheMvcc
[locs=[GridCacheMvccCandidate [nodeId=740a8842-94ff-4e47-85ee-c38ce010b9d5,
ver=GridCacheVersion [topVer=67716190, nodeOrderDrId=1,
globalTime=1456236189597, order=1456236189023], timeout=0, ts=1456236189622,
threadId=20, id=1, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0],
reentry=null, otherNodeId=740a8842-94ff-4e47-85ee-c38ce010b9d5,
otherVer=GridCacheVersion [topVer=67716190, nodeOrderDrId=1,
globalTime=1456236189597, order=1456236189023], mappedDhtNodes=null,
mappedNearNodes=null, ownerVer=null, serOrder=null, key=KeyCacheObjectImpl
[val=GridServiceDeploymentKey [name=distributedSchedulerService],
hasValBytes=true],
masks=local=1|owner=1|ready=1|reentry=0|used=0|tx=1|single_implicit=1|dht_local=1|near_local=0|removed=0,
prevVer=null, nextVer=null]], rmts=null]], flags=0]]]], prepared=true,
locked=false, nodeId=740a8842-94ff-4e47-85ee-c38ce010b9d5, locMapped=false,
expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=0,
serReadVer=null, xidVer=GridCacheVersion [topVer=67716190, nodeOrderDrId=1,
globalTime=1456236189597, order=1456236189023]]], explicitLock=false,
dhtVer=GridCacheVersion [topVer=67716190, nodeOrderDrId=1,
globalTime=1456236189597, order=1456236189023], last=false, near=false,
clientFirst=false, node=740a8842-94ff-4e47-85ee-c38ce010b9d5]],
super=GridDhtTxLocalAdapter [nearOnOriginatingNode=false, nearNodes=[],
dhtNodes=[], explicitLock=false, super=IgniteTxLocalAdapter
[completedBase=null, sndTransformedVals=false, depEnabled=true,
txState=IgniteTxImplicitSingleStateImpl [entry=IgniteTxEntry
[key=KeyCacheObjectImpl [val=GridServiceDeploymentKey
[name=distributedSchedulerService], hasValBytes=true], cacheId=-2100569601,
txKey=IgniteTxKey [key=KeyCacheObjectImpl [val=GridServiceDeploymentKey
[name=distributedSchedulerService], hasValBytes=true], cacheId=-2100569601],
val=[op=CREATE, val=UserCacheObjectImpl [val=GridServiceDeployment
[nodeId=740a8842-94ff-4e47-85ee-c38ce010b9d5, cfg=ServiceConfiguration
[name=distributedSchedulerService, totalCnt=1, maxPerNodeCnt=1,
cacheName=null, svcCls=DistributedSchedulerServiceImpl,
nodeFilterCls=AttributeFilter]], hasValBytes=false]], prevVal=[op=NOOP,
val=null], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1,
conflictVer=null, explicitVer=null, dhtVer=GridCacheVersion
[topVer=67716190, nodeOrderDrId=1, globalTime=1456236189635,
order=1456236189025],
filters=[org.apache.ignite.internal.processors.cache.CacheEntrySerializablePredicate@f665465],
filtersPassed=false, filtersSet=true, entry=GridDhtColocatedCacheEntry
[super=GridDhtCacheEntry [rdrs=[], locPart=GridDhtLocalPartition [id=65,
mapPubSize=0, rmvQueue=GridCircularBuffer [sizeMask=127, idxGen=0], cntr=0,
state=OWNING, reservations=0, empty=false, createTime=02/23/2016 06:03:09,
mapPubSize=0], super=GridDistributedCacheEntry [super=GridCacheMapEntry
[key=KeyCacheObjectImpl [val=GridServiceDeploymentKey
[name=distributedSchedulerService], hasValBytes=true], val=null,
startVer=1456236189024, ver=GridCacheVersion [topVer=67716190,
nodeOrderDrId=1, globalTime=1456236189617, order=1456236189024],
hash=-1073135968, extras=GridCacheMvccEntryExtras [mvcc=GridCacheMvcc
[locs=[GridCacheMvccCandidate [nodeId=740a8842-94ff-4e47-85ee-c38ce010b9d5,
ver=GridCacheVersion [topVer=67716190, nodeOrderDrId=1,
globalTime=1456236189597, order=1456236189023], timeout=0, ts=1456236189622,
threadId=20, id=1, topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0],
reentry=null, otherNodeId=740a8842-94ff-4e47-85ee-c38ce010b9d5,
otherVer=GridCacheVersion [topVer=67716190, nodeOrderDrId=1,
globalTime=1456236189597, order=1456236189023], mappedDhtNodes=null,
mappedNearNodes=null, ownerVer=null, serOrder=null, key=KeyCacheObjectImpl
[val=GridServiceDeploymentKey [name=distributedSchedulerService],
hasValBytes=true],
masks=local=1|owner=1|ready=1|reentry=0|used=0|tx=1|single_implicit=1|dht_local=1|near_local=0|removed=0,
prevVer=null, nextVer=null]], rmts=null]], flags=0]]]], prepared=true,
locked=false, nodeId=740a8842-94ff-4e47-85ee-c38ce010b9d5, locMapped=false,
expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=0,
serReadVer=null, xidVer=GridCacheVersion [topVer=67716190, nodeOrderDrId=1,
globalTime=1456236189597, order=1456236189023]], init=true],
super=IgniteTxAdapter [xidVer=GridCacheVersion [topVer=67716190,
nodeOrderDrId=1, globalTime=1456236189597, order=1456236189023],
writeVer=GridCacheVersion [topVer=67716190, nodeOrderDrId=1,
globalTime=1456236189635, order=1456236189025], implicit=true, loc=true,
threadId=20, startTime=1456236189590,
nodeId=740a8842-94ff-4e47-85ee-c38ce010b9d5, startVer=GridCacheVersion
[topVer=67716190, nodeOrderDrId=1, globalTime=1456236189597,
order=1456236189023], endVer=null, isolation=READ_COMMITTED,
concurrency=OPTIMISTIC, timeout=0, sysInvalidate=false, sys=true, plc=5,
commitVer=GridCacheVersion [topVer=67716190, nodeOrderDrId=1,
globalTime=1456236189597, order=1456236189023], finalizing=NONE,
preparing=false, invalidParts=null, state=COMMITTING, timedOut=false,
topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], duration=68ms,
onePhaseCommit=true], size=1]]]
at
org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.userCommit(IgniteTxLocalAdapter.java:1161)
at
org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxLocal.finish(GridNearTxLocal.java:738)
at
org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxFinishFuture.finish(GridNearTxFinishFuture.java:331)
at
org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxLocal$4.apply(GridNearTxLocal.java:838)
at
org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxLocal$4.apply(GridNearTxLocal.java:830)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:262)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.listen(GridFutureAdapter.java:225)
at
org.apache.ignite.internal.processors.cache.distributed.near.GridNearTxLocal.commitAsync(GridNearTxLocal.java:830)
at
org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.optimisticPutFuture(IgniteTxLocalAdapter.java:3230)
at
org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.putAsync0(IgniteTxLocalAdapter.java:3017)
at
org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.putAsync(IgniteTxLocalAdapter.java:1956)
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter$32.op(GridCacheAdapter.java:2375)
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter.syncOp(GridCacheAdapter.java:4073)
at
org.apache.ignite.internal.processors.cache.GridCacheAdapter.getAndPutIfAbsent(GridCacheAdapter.java:2373)
at
org.apache.ignite.internal.processors.service.GridServiceProcessor.deploy(GridServiceProcessor.java:411)
at
org.apache.ignite.internal.processors.service.GridServiceProcessor.deployMultiple(GridServiceProcessor.java:347)
at
org.apache.ignite.internal.processors.service.GridServiceProcessor.deployClusterSingleton(GridServiceProcessor.java:327)
at
org.apache.ignite.internal.IgniteServicesImpl.deployClusterSingleton(IgniteServicesImpl.java:101)
... 9 more
Caused by: java.lang.NullPointerException
at
org.apache.ignite.marshaller.optimized.OptimizedObjectStreamRegistry.closeOut(OptimizedObjectStreamRegistry.java:95)
at
org.apache.ignite.marshaller.optimized.OptimizedMarshaller.marshal(OptimizedMarshaller.java:201)
at
org.apache.ignite.internal.processors.cache.GridCacheUtils.marshal(GridCacheUtils.java:965)
at
org.apache.ignite.internal.processors.cacheobject.IgniteCacheObjectProcessorImpl.marshal(IgniteCacheObjectProcessorImpl.java:103)
at
org.apache.ignite.internal.processors.cache.binary.CacheObjectBinaryProcessorImpl.marshal(CacheObjectBinaryProcessorImpl.java:687)
at
org.apache.ignite.internal.processors.cacheobject.IgniteCacheObjectProcessorImpl$UserCacheObjectImpl.prepareForCache(IgniteCacheObjectProcessorImpl.java:352)
at
org.apache.ignite.internal.processors.cacheobject.IgniteCacheObjectProcessorImpl.prepareForCache(IgniteCacheObjectProcessorImpl.java:98)
at
org.apache.ignite.internal.processors.cache.GridCacheMapEntry.innerSet(GridCacheMapEntry.java:1167)
at
org.apache.ignite.internal.processors.cache.transactions.IgniteTxLocalAdapter.userCommit(IgniteTxLocalAdapter.java:1003)
... 26 more
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/NullPointerException-when-using-marshaller-poolSize-tp3154.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
