Hello I've come up with the code that 1. the write in parallel works great with the parameters below
<property name="writeBehindFlushSize" value="1000"></property> <property name="writeBehindFlushThreadCount" value="10"></property> <property name="writeBehindBatchSize" value="100"></property> BUT, when I start to add deletes in the process, for example 1 remove every 19 puts, I start to the write behind performance deteriorates. And log looks like below: You see the delete are almost always executed with only 1 records, even though a deleteAll method was called. Tue May 09 10:49:38 PDT 2017Write w Delete start ---------------------------------------------------------- [1494352178763]-----------Datebase BATCH upsert:87 entries successful ---------------- [1494352178763]-----------Datebase BATCH upsert:35 entries successful ---------------- [1494352178780]-----------Datebase BATCH upsert:100 entries successful ---------------- [1494352178782]-----------Datebase BATCH upsert:100 entries successful ---------------- [1494352178784]-----------Datebase BATCH upsert:100 entries successful ---------------- [1494352178884]-----------Datebase BATCH upsert:100 entries successful ---------------- [1494352178902]-----------Datebase BATCH upsert:39 entries successful ---------------- [1494352178902]-----------Datebase BATCH upsert:100 entries successful ---------------- [1494352178903]-----------Datebase BATCH upsert:39 entries successful ---------------- [1494352178903]-----------Datebase BATCH upsert:29 entries successful ---------------- [1494352178906]-----------Datebase BATCH upsert:100 entries successful ---------------- [1494352178906]-----------Datebase BATCH upsert:39 entries successful ---------------- [1494352178910]-----------Datebase BATCH upsert:100 entries successful ---------------- [1494352178910]-----------Datebase BATCH upsert:39 entries successful ---------------- [1494352178923]-----------Datebase BATCH upsert:39 entries successful ---------------- [1494352178960]-----------Datebase BATCH upsert:1 entries successful ---------------- [1494352179009]-----------Datebase BATCH upsert:38 entries successful ---------------- [1494352179023]-----------Datebase BATCH DELETE:1 entries successful ---------------- [1494352179023]-----------Datebase BATCH DELETE:1 entries successful ---------------- [1494352179024]-----------Datebase BATCH DELETE:1 entries successful ---------------- [1494352179038]-----------Datebase BATCH upsert:39 entries successful ---------------- [1494352179039]-----------Datebase BATCH DELETE:1 entries successful ---------------- [1494352179039]-----------Datebase BATCH DELETE:1 entries successful ---------------- [1494352179039]-----------Datebase BATCH upsert:36 entries successful ---------------- [1494352179043]-----------Datebase BATCH DELETE:1 entries successful ---------------- [1494352179095]-----------Datebase BATCH upsert:36 entries successful ---------------- [1494352179135]-----------Datebase BATCH upsert:1 entries successful ---------------- [1494352179139]-----------Datebase BATCH DELETE:1 entries successful ---------------- [1494352179143]-----------Datebase BATCH upsert:1 entries successful ---------------- [1494352179143]-----------Datebase BATCH upsert:39 entries successful ---------------- [1494352179149]-----------Datebase BATCH DELETE:1 entries successful ---------------- [1494352179150]-----------Datebase BATCH upsert:30 entries successful ---------------- [1494352179150]-----------Datebase BATCH upsert:11 entries successful ---------------- [1494352179156]-----------Datebase BATCH DELETE:1 entries successful ---------------- [1494352179162]-----------Datebase BATCH upsert:40 entries successful ---------------- [1494352179166]-----------Datebase BATCH upsert:40 entries successful ---------------- [1494352179237]-----------Datebase BATCH DELETE:1 entries successful ---------------- [1494352179277]-----------Datebase BATCH upsert:38 entries successful ---------------- [1494352179287]-----------Datebase BATCH DELETE:1 entries successful ---------------- I've also tried with parameters below. Same writeAll methold called with only 1 records. <property name="writeBehindFlushSize" value="10240"></property> <property name="writeBehindFlushThreadCount" value="11"></property> <property name="writeBehindBatchSize" value="1024"></property> Does someone have similar observation? Or explanation of why this is happening? Thanks a lot! Jessie -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Write-Behind-with-delete-performance-tp12580.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.
