Events and selective marshalling between nodes?

2019-10-10 Thread KJQ
Hello everyone, I am not even sure how to phrase this so I will try to describe the environment... We have numerous embedded Ignite instances (server mode) that deploy into a K8S cluster. Between those instances we have Ignite events being raised for PUT and EXPIRED. We have at least one

RE: REST API: passing custom POJOs

2019-10-10 Thread alexanderkor12
Hi REST can accommodate the following types: https://apacheignite.readme.io/docs/rest-api#section-data-types You can use a ConnectorMessageIntercetor to intercept all incoming/outgoing rest requests : https://apacheignite.readme.io/docs/rest-api#section-general-configuration

Re: Issue with adding nested index dynamically

2019-10-10 Thread Hemambara
Hello Ivan, to be more specific, if I want add field "Users.userName" - current ignite version 2.7.6 is setting the field name as "Users.userName" and default alias name as "userName" with which makes it non-queryable, non -indexable and issues during restart due to mismatch in configuration .

Re: DataLoad using IgniteDataStreamer

2019-10-10 Thread ravichandra
I Will look into it and get back. Thanks Saikat. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Issue with adding nested index dynamically

2019-10-10 Thread Hemambara
Thank you. One more thing to add - it is able to add index dynamically only thing is, when I restart the client it is not able join the cluster due to incorrect alias -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: DataLoad using IgniteDataStreamer

2019-10-10 Thread Saikat Maitra
Hello Ravichandra, Here are the docs for Data streamers https://apacheignite.readme.io/docs/streaming--cep Also, a sample implementation for data streaming using Apache Flink. https://dzone.com/articles/data-streaming-using-apache-flink-and-apache-ignit Please review and let us know if you

Re: Exception - Method rawReader can be called only once

2019-10-10 Thread javastuff....@gmail.com
The interface does not have 2 sets of methods, so second method with "raw" reader is extra code with special programmatic changes in extending class to call "raw" method from superclass. This is how I am using it for now, however it needs extra code and special handling in extended class which

DataLoad using IgniteDataStreamer

2019-10-10 Thread ravichandra
Hi, I am working on a POC to preload the data into database with IgniteDataStreamer using client node and do rest of the functionalities using server node. Is there any sample code for reference? I am using spring boot, extending IgniteRepository for repository layer Instead of using

REST API: passing custom POJOs

2019-10-10 Thread captcha
Hi Ignite Users, For the REST API, is that possible to pass custom POJO objects? An example use case: Let's say I have a Person class: class Person { String name; UUID id; Location location; } Class Location { long lat; long long; } Let's say I cache some Person objects in the

REST API: passing custom POJOs

2019-10-10 Thread captcha
Hi Ignite Users, For the REST API, is that possible to pass custom POJO objects? An example use case: Let's say I have a Person class: class Person { String name; UUID id; Location location; } Class Location { long lat; long long; } Let's say I cache some Person objects in the

Re: Partition loss due to node segmentation

2019-10-10 Thread Denis Magda
Akash, Network segmentation is one of the causes of the partition loss. The latter can also be triggered if two or more nodes go down at the same time. This page explains how to process the partition loss events and available remediation techniques:

Re: Ignite SQL table ALTER COLUMN and RENAME COLUMN

2019-10-10 Thread Denis Magda
Please check out this note: https://www.gridgain.com/docs/8.7.6/perf-troubleshooting-guide/troubleshooting#cluster-doesnt-start-after-field-type-changes There is a hacky way to change the type if you're in development but if you're in prod then you need to add new columns instead. - Denis On

Re: Issue with adding nested index dynamically

2019-10-10 Thread Denis Magda
Ivan, As a member of the Ignite SQL group, could you please check this thread and help Hemambara with a proper fix? - Denis On Thu, Oct 10, 2019 at 11:50 AM Hemambara wrote: > Sorry for the push. This is a major blocker for us. We have coherence > clients > where they can add indexes

Re: Issue with adding nested index dynamically

2019-10-10 Thread Hemambara
Sorry for the push. This is a major blocker for us. We have coherence clients where they can add indexes dynamically and we want to move them to ignite in next 3 months. Coherence has a way to add indexes dynamically and ignite also does supporting it. This issue exists event with QuerySqlField.

Re: Apache Ignite Change data capture functionality

2019-10-10 Thread ravichandra
Thanks Denis. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Node stopped.

2019-10-10 Thread Denis Mekhanikov
Unfortunately, I don’t. You can ask the VM vendor or the cloud provider (if you use any) for a proper tooling or logs. Make sure, that there is no such step in the VM’s lifecycle that makes it freeze for a minute. Also make sure that the physical CPU is not overutilized and no VMs that run on

Re: Freeing up RAM/cache

2019-10-10 Thread Denis Mekhanikov
There is no manual way to evict data from memory. You can limit the size of your data region, so that if this limit is reached, then some pages will be dropped from memory automatically and replaced with new ones. This process is called page replacement. You can read about it here: 

Re: Issue with adding nested index dynamically

2019-10-10 Thread Ilya Kasnacheev
Hello! Currently we do not support altering tables which are created with indexedTypes/queryEntities. There are plans to implement it, but your fix, while solving your particular problem, isn't fit in this scheme IMHO. Regards, -- Ilya Kasnacheev ср, 9 окт. 2019 г. в 22:45, Hemambara : > My

Re: Starvation in striped pool

2019-10-10 Thread Ilya Kasnacheev
Hello! I'm almost certain is that problem is that server node cannot open connection to client node (and while it tries, it will reject connection attempts from client node) clientReconnectDisabled=true will only concern discovery. In your case, there's no problems with discovery, the problem is

Re: Cluster went down after "Unable to await partitions release latch within timeout" WARN

2019-10-10 Thread Pavel Kovalenko
Ibrahim, Could you please also share the cache configuration that is used for dynamic creation? чт, 10 окт. 2019 г. в 19:09, Pavel Kovalenko : > Hi Ibrahim, > > I see that one node didn't send acknowledgment during cache creation: > [2019-09-27T15:00:17,727][WARN >

Re: Cluster went down after "Unable to await partitions release latch within timeout" WARN

2019-10-10 Thread Pavel Kovalenko
Hi Ibrahim, I see that one node didn't send acknowledgment during cache creation: [2019-09-27T15:00:17,727][WARN ][exchange-worker-#219][GridDhtPartitionsExchangeFuture] Unable to await partitions release latch within timeout: ServerLatch [permits=1,

Re: Node stopped.

2019-10-10 Thread John Smith
Do you know of any good tools I can use to check the VM? On Thu, 10 Oct 2019 at 11:38, Denis Mekhanikov wrote: > > Hi Dennis, so are you saying I should enable GC logs + the safe point > logs as well? > > Having safepoint statistics in your GC logs may be useful, so I recommend > enabling them

Freeing up RAM/cache

2019-10-10 Thread Kamlesh Joshi
Hi Igniters, Is there any way, to release main memory? I just want to remove few entries from RAM (and not from the persistence). If I need data again I should be able to retrieve it from persistence. I have already gone through the Expiration policy for the same. But, can we set Expiration

Re: Node stopped.

2019-10-10 Thread Denis Mekhanikov
> Hi Dennis, so are you saying I should enable GC logs + the safe point logs as > well? Having safepoint statistics in your GC logs may be useful, so I recommend enabling them for troubleshooting purposes. Check the lifecycle of your virtual machines. There is a high chance that the whole

Re: Node stopped.

2019-10-10 Thread John Smith
You are correct, it is running in a VM. On Thu, 10 Oct 2019 at 10:11, Denis Mekhanikov wrote: > Hi! > > There are the following messages in the logs: > > [22:26:21,816][WARNING][jvm-pause-detector-worker][IgniteKernal%xx] > Possible too long JVM pause: *55705 milliseconds*. > ... >

Re: Node stopped.

2019-10-10 Thread John Smith
Hi Dennis, so are you saying I should enable GC logs + the safe point logs as well? On Thu, 10 Oct 2019 at 11:22, John Smith wrote: > You are correct, it is running in a VM. > > On Thu, 10 Oct 2019 at 10:11, Denis Mekhanikov > wrote: > >> Hi! >> >> There are the following messages in the logs:

Re: Apache Ignite Change data capture functionality

2019-10-10 Thread Denis Mekhanikov
Ravichandra, There is no integration for Striim in Apache Ignite codebase, so you need to check with the Striim documentation if it’s possible to configure it for Ignite. If you want to use Ignite as a target, then a JDBC adapter should work, if there is any available. If Ignite should work as

Re: Node stopped.

2019-10-10 Thread Denis Mekhanikov
Hi! There are the following messages in the logs: [22:26:21,816][WARNING][jvm-pause-detector-worker][IgniteKernal%xx] Possible too long JVM pause: 55705 milliseconds. ... [22:26:21,847][SEVERE][ttl-cleanup-worker-#48%xx%][G] Blocked system-critical thread has been detected. This can

Re: Ignite SQL table ALTER COLUMN and RENAME COLUMN

2019-10-10 Thread Denis Mekhanikov
Favas, It’s possible to remove a column and add another one using ALTER COMAND SQL statement, but currently you can't change a column’s type. Note, that removing a column and adding another one with the same name but with a different type can lead to data corruption. Denis On 10 Oct 2019,

Re: Authenticating communication between nodes using Ignite.Net

2019-10-10 Thread Pavel Tupitsyn
1. Thick client/server nodes use a different communication mechanism than Thin client nodes, and network ports are different. Security mechanism is also different. E.g. you can have a cluster of server nodes running in a controlled environment, with only 10800 port open to the outside. This way

Ignite SQL table ALTER COLUMN and RENAME COLUMN

2019-10-10 Thread Muhammed Favas
Hi, Is there a way in ignite to ALTER the column to change the data type/nullable property and also RENAME of column? I saw in ignite documentation that it will add in upcoming releases. Which release it is planning for? Regards, Favas