Hi,

Please properly subscribe to the user list so that we can see your questions
as soon as possible and provide answers on them quicker. All you need to do
is send an email to ì [email protected]î and follow simple
instructions in the reply.


Please provide the logs from all the nodes. There should be an exception
that moved the streamer in the hanging state.

Answering on your question.

1) Is DataStreamer cache level object..? should I not flush or close
Streamer until the entire load is complete from all databases..? 

There is no need to call flush() for every operation because performance
won't be good then. The streamer flushes data automatically basing on such
parameters as perNodeBufferSize, autoFlushFrequency,
perNodeParallelOperations.

--
Denis

--------------------

Hi, 

I am using DataStreamer to load data from multiple databases into cache.
Each node is responsible for loading data from one db and they are running
in parallel. 
I use dataStreamer.flush() after each load is done and looks like this is
hanging in Ignite1.6. 
Works fine, when we rolledback to 1.5. I am not sure why. 

1) Is DataStreamer cache level object..? should I not flush or close
Streamer until the entire load is complete from all databases..? 

Any help is greatly appreciated 


Here Stack Trace from where it is hanging : 

Name: pub-#6%DataGridServer-Staging% 
State: WAITING on
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$ConnectFuture@25d531b4
 
Total blocked: 0  Total waited: 1,808 

Stack trace: 
sun.misc.Unsafe.park(Native Method) 
java.util.concurrent.locks.LockSupport.park(Unknown Source) 
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(Unknown
Source) 
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(Unknown
Source) 
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(Unknown
Source) 
org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:159)
 
org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:117)
 
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.reserveClient(TcpCommunicationSpi.java:2070)
 
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage0(TcpCommunicationSpi.java:1967)
 
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.sendMessage(TcpCommunicationSpi.java:1933)
 
org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1285)
 
org.apache.ignite.internal.managers.communication.GridIoManager.send(GridIoManager.java:1354)
 
org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:694)
 
org.apache.ignite.internal.processors.cache.GridCacheIoManager.send(GridCacheIoManager.java:843)
 
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicUpdateFuture.doUpdate(GridNearAtomicUpdateFuture.java:601)
 
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicUpdateFuture.map(GridNearAtomicUpdateFuture.java:756)
 
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicUpdateFuture.mapOnTopology(GridNearAtomicUpdateFuture.java:544)
 
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridNearAtomicAbstractUpdateFuture.map(GridNearAtomicAbstractUpdateFuture.java:202)
 
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache$22.apply(GridDhtAtomicCache.java:1007)
 
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache$22.apply(GridDhtAtomicCache.java:1005)
 
org.apache.ignite.internal.processors.cache.distributed.dht.atomic.GridDhtAtomicCache.asyncOp(GridDhtAtomicCache.java:703)
 



--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/DataStreamer-hanging-tp5808p5953.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Reply via email to