Re: what does remaps mean in DataStreamerImpl.java

2017-05-04 Thread vdpyatkov
Hi, I have see that your grid suffer from long running operations: [19:20:19,285][WARNING][grid-timeout-worker-#63%null%][GridCachePartitionExchangeManager] Found long running cache future [startTime=19:18:55.302, curTime=19:20:19.280, fut=GridDhtAtomicSingleUpdateFuture [key=MyProject.TokenSecon

Re: what does remaps mean in DataStreamerImpl.java

2017-05-04 Thread rishi007bansod
Hi, I have attached log file for one ignite node ignite-b6321e0a.zip Thanks -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/what-does-remaps-mean-in-DataStreamerImpl-java-tp

Re: what does remaps mean in DataStreamerImpl.java

2017-04-25 Thread vdpyatkov
At first if you are having only one backup you surely data lose when kill 3 nodes (you can to do that when only kill one by one and waiting rebalancing complete after each). Could you please attache a full log file at leas one node where the remap failed messages are present? -- View this mess

Re: what does remaps mean in DataStreamerImpl.java

2017-04-24 Thread rishi007bansod
Hi, In our case we killed 3 ignite nodes among the 30 nodes we have started in grid to check fault tolerance of ignite i.e. whether remaining 27 nodes remap to kafka consumers or not. fe6409cb-88a2-43da-9eb7-9b17cf5debcb node is one of the nodes we have killed to check fault tolerance. Anoth

Re: what does remaps mean in DataStreamerImpl.java

2017-04-24 Thread vdpyatkov
How often sessions are timedouted? Is it node have been alive fe6409cb-88a2-43da-9eb7-9b17cf5debcb when message are appear? This seem as topology are breaks down. Please provide all logs from each nodes. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/what-does

Re: what does remaps mean in DataStreamerImpl.java

2017-04-24 Thread rishi007bansod
*Hi, In our initial setting we have kept allowoverwrite to default i.e false. Now we tried setting allowoverwrite property of ignitedatastreamer to "true". Initially when we killed ignite instances we got following error. Due to this error some of ignite nodes/instances got disconnected. * [17:4

Re: what does remaps mean in DataStreamerImpl.java

2017-04-20 Thread Vladislav Pyatkov
What is the value IgniteDataStreamer#allowOverwrite(boolean)? The property changes of algorithm of work DataStreamer, in particular order of remap node. Try to set it true. On Wed, Apr 19, 2017 at 7:29 PM, rishi007bansod wrote: > Hi Below is our architecture, > > 1. Ignite receives data via Kafk

Re: what does remaps mean in DataStreamerImpl.java

2017-04-19 Thread rishi007bansod
Hi Below is our architecture, 1. Ignite receives data via Kafka Streamer 2. Tuple Extractor is implemented in ignite code Everything works fine till this step. 3. We stop kafka. No error yet. 4. We kill 2 instance (out of n instance) of ignite. 5. Kafka Consumer remapping also happens without any

Re: what does remaps mean in DataStreamerImpl.java

2017-04-19 Thread rishi007bansod
Hi, the backup is in our case is 1. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/what-does-remaps-mean-in-DataStreamerImpl-java-tp12033p12083.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: what does remaps mean in DataStreamerImpl.java

2017-04-19 Thread vdpyatkov
Although, I'm not right (it should by remaper). Could you provide reproducer? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/what-does-remaps-mean-in-DataStreamerImpl-java-tp12033p12079.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: what does remaps mean in DataStreamerImpl.java

2017-04-19 Thread vdpyatkov
Hi, How many backups (o.a.i.configuration.CacheConfiguration#setBackups) do you use? If your cluster does not contain backups, a batch will not remaped, until rebalance finished. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/what-does-remaps-mean-in-DataStream

Re: what does remaps mean in DataStreamerImpl.java

2017-04-19 Thread rushi_rashi
1. So considering example from post 1, does it mean that when an ignite instance was killed, Data streamer had some data which it was going to put in to cache but that cache's instance was killed and hence the error might have occurred. 2. If not, than can you throw some light on the remap error fr

Re: what does remaps mean in DataStreamerImpl.java

2017-04-18 Thread vdpyatkov
Hi, DataStreamer packs all cache operations to batch request to grid server node. If this batch was not executed correct in particular node, it will by remapped to other. Maximum of remaps cunt is 32 (DFLT_MAX_REMAP_CNT). -- View this message in context: http://apache-ignite-users.70518.x6.na

Re: what does remaps mean in DataStreamerImpl.java

2017-04-18 Thread rushi_rashi
I had subscribed to mailing list as per the mail I have received but still the query has not accepted by mailing list. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/what-does-remaps-mean-in-DataStreamerImpl-java-tp12033p12034.html Sent from the Apache Ignite Us