Hi Rish, DataStreamer does not have any threads, DataStreamPool is used for incoming batches processing.
DataStreamer split you data into batches which size is equal to streamer perNodeBufferSize parameter. When batch become full, a task is send to a node the buffer belongs to. PerNodeParallelOperations parameter limits number of batches that can be processed on node at same time. As you have single thread, it looks like you fill batches slower that data put to cache. Seems, DataStreamer adds an overhead as it should map entries to certain node and due to failover feature support. DataStreamer is thread-safe, try to add data to dataStreamer from multiple threads. On Thu, Jun 29, 2017 at 1:02 PM, rishi007bansod <[email protected]> wrote: > I have tried writing while loop which continuously inserts data(same entry) > with increamenting cache key(so that there is unique key). Without > datastrmr.addData() while loop is generating data at 200K msgs/sec(Data > generation rate is much more than caching rate). Is there any blocking done > by datastreamer which limits CPU utilization? > > Thanks > > > > -- > View this message in context: http://apache-ignite-users. > 70518.x6.nabble.com/Ignite-Data-Streamer-Performance-is- > not-improving-with-increase-in-threads-tp14151p14162.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. > -- Best regards, Andrey V. Mashenkov
