Re: Async operations in IA C# client appear dangeroud

2021-03-10 Thread Raymond Wilson
Hi Pavel, Thanks for the quick response. We have trialled the ContinueWith() suggestion which has resolved the issue in testing so far. I suspect this will have only a very minor performance impact. Thanks, Raymond. On Wed, Mar 10, 2021 at 10:33 PM Pavel Tupitsyn wrote: > Raymond, > > You

Re: Cluster keeps crashing with SEVERE message

2021-03-10 Thread Stephen Darlington
More heap-space. See the documentation for memory tuning: memory-tuning You might also want to check that your query is iterating over the records in your cache rather than trying to read the

Re: Using AsCacheQueryable in LINQ to access the cache

2021-03-10 Thread Pavel Tupitsyn
Yes, ScanQuery does not have those limitations, you can use any key and value types also there is no need to configure QueryEntity at all. However, ScanQuery can't have indexes like SQL, and always performs a full table scan which can affect performance, depending on the use case. On Wed, Mar

RE: Cluster keeps crashing with SEVERE message

2021-03-10 Thread Josh Katz
Please see the log, it seems to be OutOfMemory from JVM on Windows Server 2016. How can we address this issue? ^-- System thread pool [active=0, idle=7, qSize=0]

RE: Using AsCacheQueryable in LINQ to access the cache

2021-03-10 Thread Josh Katz
It seems that populating and using a scan query works with this setup. Everything except LINQ works with this List as Value. Thanks, Josh Katz Dodge & Cox | 415-262-7520 From: Pavel Tupitsyn Sent: Wednesday, March 10, 2021 9:15 AM To: user Subject: Re: Using AsCacheQueryable in LINQ to

Re: Cluster keeps crashing with SEVERE message

2021-03-10 Thread Stephen Darlington
We’d need to see more of the stack trace and see your configuration before this could be diagnosed. It looks like a node abruptly left the cluster. If you’re losing data it seems like you’ve not configured any backups. > On 10 Mar 2021, at 16:53, Josh Katz > wrote: > > After we load 35

Re: Using AsCacheQueryable in LINQ to access the cache

2021-03-10 Thread Pavel Tupitsyn
> List I think this is the problem. Think of every cache entry as a row in a table. List of custom classes can't be represented as a row, please use a single value instead. On Wed, Mar 10, 2021 at 8:03 PM Josh Katz < josh.katz.contrac...@dodgeandcox.com> wrote: > I have it configured as the

RE: Using AsCacheQueryable in LINQ to access the cache

2021-03-10 Thread Josh Katz
I have it configured as the following: CacheConfiguration config = new CacheConfiguration(cacheName, new QueryEntity(typeof(HoldingsCacheKey), typeof(List))) Is it setup correctly for LINQ to work? Thanks, Josh From: Pavel Tupitsyn Sent: Wednesday, March 10,

Cluster keeps crashing with SEVERE message

2021-03-10 Thread Josh Katz
After we load 35 million records from the database into the cluster. When we query it using a scan query we get the following SEVERE error, After that the node are restarting and the caches all show 0 keys and we have to restart the initial load. Is there a way to salvage the data so we don't

Re: Loading data to cache using a data streamer

2021-03-10 Thread Pelado
Take a look at the data node. If the data node has restarted you might see a client disconnected exception. On Tue, Mar 9, 2021 at 1:12 PM Ilya Kasnacheev wrote: > Hello! > > Does it work with a smaller batch? My guess is that you end up consuming > too much resources and then the cluster falls

Re: Initialise properties at implemented CacheEntryUpdatedListener

2021-03-10 Thread Ilya Kasnacheev
Hello! Just declare the field as transient, and then apply if (f == null) f = initialValue() pattern. Regards, -- Ilya Kasnacheev чт, 4 мар. 2021 г. в 17:34, mvolkomorov <2201...@gmail.com>: > Hi, guys! > > Is it possible to initialize my property with an injected resource at inner > static

Re: Failed to process selector key (Connection reset by peer)

2021-03-10 Thread Ilya Kasnacheev
Hello! "Connection reset by peer" usually means that remote host went away or in other way could no longer serve the connection. Nothing that we can help. I'm not sure why you're getting an OOM. Maybe you're writing a very large response to some query, which causes remote client to exhaust its

Re: DC replication via Kafka Connect for Apache Ignite

2021-03-10 Thread zxcware
What's current kafka version supported in Kafka Connect? From https://www.gridgain.com/docs/8.8.2/integrations/kafka/kc-ggvai, it said the IgniteSinkConnector just support kafka version 0.1, which is quite old. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Cache group setting not taking effect

2021-03-10 Thread Ilya Kasnacheev
Hello! Are you sure that you have recreated your tables after setting group name in their configuration? Do you have a reproducer code where you specify grpName on a fresh cluster but it is not applied? PME on cache create/destroy operation is blocking: it has to wait for all operations to stop,

Re: ContinuousQuery and injected bean

2021-03-10 Thread Ilya Kasnacheev
Hello! It is recommended to use inner static classes as remote filters or runnables/callables, precisely because they don't bring parent class instance with them, which will otherwise consume bandwidth and may cause serialization issues. Regards, -- Ilya Kasnacheev пт, 5 мар. 2021 г. в 12:10,

Re: [2.9.1]Failed to find DHT update future for deferred update response

2021-03-10 Thread Ilya Kasnacheev
Hello! I believe that DataStreamer has limited failover support, such as: when you do streamer.close(), either it will return normally, in which case the data was written to caches, or it will throw an exception, in which case only an unknown subset of data were written, and you need to repeat

Re: Async operations in IA C# client appear dangeroud

2021-03-10 Thread Pavel Tupitsyn
Raymond, You are right, there is no efficient AND easy way to solve this. Basically, user code has to append ContinueWith to every async Ignite API call manually: await cache.GetAsync(1).ContinueWith( t => t.Result, CancellationToken.None,

Re: Using AsCacheQueryable in LINQ to access the cache

2021-03-10 Thread Pavel Tupitsyn
Have you configured the QueryEntities [1]? [1] https://ignite.apache.org/docs/latest/SQL/indexes#configuring-indexes-using-query-entities On Wed, Mar 10, 2021 at 2:48 AM Josh Katz < josh.katz.contrac...@dodgeandcox.com> wrote: > > > We are trying to query the cache using Ignite.LINQ NUGET

Re: Apache-ignite cluster taking too long to start , its taking around one hour to start

2021-03-10 Thread Ilya Kasnacheev
Hello! Please provide the complete verbose log from all nodes! Regards, -- Ilya Kasnacheev ср, 10 мар. 2021 г. в 09:22, mohammed.afzal : > i configured ignite cluster using 3 nodes , to form cluster its taking 1 > hour > for all nodes to form. > i have this setup : > node -1 : os - windows