Hello! Do you use FULL_SYNC for a chance? Can you provide thread dumps during slowdown?
Regards, -- Ilya Kasnacheev пт, 1 мар. 2019 г. в 12:53, BinaryTree <[email protected]>: > Hi Igniters - > > I know backups will impact the performance of the cluster: > > If you use a PARTITIONED cache and the data loss is not critical for you > (for example, when you have a backing cache store), consider disabling > backups for the cache. When backups are enabled, the cache engine has to > maintain a remote copy of each entry, which requires network exchange and > is time-consuming. > > Because the data is important and can not lose, so the backup is necessary. > > But the backup make DataStreamer performance decreased a lot, if backups > are disabled, 40 million records can be loaded in 4 minutes, but when set > backup = 1, after loading 20 million records, the speed decreased a lot, > sometimes, it will cost more 20 seconds to load 10 thousands records. > > Are there any configurations or methods can improve the performace of > DataStreamer? > > Related post: > > > http://apache-ignite-users.70518.x6.nabble.com/Ignite-Data-Streamer-Hung-after-a-period-tp21161.html > > I attached the thread dumps in this post. > > I also create a project to reproduce the problem, you can refer to : > > https://github.com/RedBlackTreei/streamer.git > >
