Re: OOM

2023-07-12 Thread Ilya Korol
What kind of OOM you've faced? Lack of free memory in data region or in Java Heap? Consider to share some logs. On 12.07.2023 18:19, Arunima Barik wrote: I have enabled Page eviction to Random-2-LRU for default region Still whenever I write a big Spark DataFrame to Ignite Like

Re: How to set -DIGNITE_QUIET=false in service.sh?

2023-02-01 Thread Ilya Korol
As a workaroud you can try to add *-v* option to ignite.sh, this should enable verbose logging (e.g. non quiet logging) 01.02.2023 17:38, Jeremy McMillan пишет: This seems to be at the level of a high quality bug report, and has enough detail that a fix could probably be implemented and

Re: How to Create a Case-Insensitive Index

2023-01-13 Thread Ilya Korol
)); but getting SQLException. Basically I want to configure the index in my Ignite XML Configuration. referenceId customerId In above in have define one index and now need to create one more index on name field which should be case-insensitive On Thu, Jan 12, 2023 at 9:46 PM Ilya Korol

Re: How to Create a Case-Insensitive Index

2023-01-12 Thread Ilya Korol
Hi, usually this can be achieved by using lower() function in index definition. I guess it should be something like: CREATE INDEX title_idx ON books (lower(title)); I'm not sure whether Ignite supports such feature, but you can give it a try. Btw, to exploit this index  you also would have to

Re: Multiple key mapping to same bean

2022-10-19 Thread Ilya Korol
also it is confirmed . Problem with the two cache approach you suggested is , it requires 2 GET requests , if avg GET latency is 10 ms , for 2 cache gets doubled to 20 ms . either we will require some sort of server side function or mapping like On Tue, 18 Oct 2022 at 21:49, Ilya Korol wrote

RE: Multiple key mapping to same bean

2022-10-18 Thread Ilya Korol
Hi, do you use multinode cluster? What do you mean by 'beans', is it simple POJO or Spring bean? I don't think that this is a good idea to store Spring beans in ignite cache, because all data that goes to cache would be transformed to so called BinaryObjects (However you can give it a try

RE: Ignite node is down

2022-08-24 Thread Ilya Korol
Hi, According to logs you have the following: [17:02:04,774][INFO][grid-nio-worker-tcp-comm-0-#40%MATCHERWORKER%][TcpCommunicationSpi] Accepted incoming communication connection [locAddr=/xx.xx.xxx.IP2:47100, rmtAddr=/xx.xx.xxx.IP1:52166]

RE: ignite client can not reconnect to ignite Kubernetes cluster,after pod restart

2022-06-21 Thread Ilya Korol
Hi, Please take look to https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/client/ClientAddressFinder.html, according to this ThinClientKubernetesAddressFinder should refresh address list on client connection failure, or you can try to set *paritionAwareness = true* in

RE: Replicated cache in C++

2022-06-21 Thread Ilya Korol
Hi, Asterisk (*) in cache name is just a flag for Ignite to not initiate this cache but instead register it as a template, that for example can be used further for SQL table creations: CREATE TABLE IF NOT EXISTS Person (   id int,   city_id int,   name varchar,   age int,   company varchar,  

Re: Disable SIGTERM processing in Ignite

2022-06-21 Thread Ilya Korol
Hi, try to set java property IGNITE_NO_SHUTDOWN_HOOK=true. https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/IgniteSystemProperties.html#IGNITE_NO_SHUTDOWN_HOOK 21.06.2022 17:27, Yuriy Ivkin пишет: Greetings! I am using embedded Apache Ignite in my project and syncronyze

Re: Analyze table query failing with syntax error from sqlline

2022-06-01 Thread Ilya Korol
Hi, are you able to run simple DML query like: SELECT * FROM PRODUCT_TABLE; ? 02.06.2022 00:13, Sachin janani пишет: Hi, I am trying to run Analyze table command from sqlline to collect the statistics of a table but its failing with parsing error. Following is the error that i am getting.

Re: Checkpointing is taking long time

2022-04-17 Thread Ilya Korol
lication writes inversely. Currently checkpointing > frequency and threads are default > > > On Sun, Apr 17, 2022 at 6:33 AM Ilya Korol wrote: > > > Hi, From my perspective this looks like your physical storage is not > > fast enough to handle incoming writes. ma

RE: Checkpointing is taking long time

2022-04-16 Thread Ilya Korol
Hi, From my perspective this looks like your physical storage is not fast enough to handle incoming writes. markDirty speed is 2x times faster that checkpointWrite even in the presence of throttling. You've mentioned that ignite work folder stored on SSD, but what about PDS folder

Re: B+Tree exception causing node to crash

2022-04-16 Thread Ilya Korol
Hi, There is some issue related to B+tree corruption that would be included in next release 2.13: https://issues.apache.org/jira/browse/IGNITE-15990 Does this scenario looks similar to your case? If you have a working reproducer feel free to submit a new Jira ticket. 15.04.2022 22:04,

RE: Re: Apache Ignite H2 Vulnerabilities

2022-04-12 Thread Ilya Korol
Hi Lokesh, Updates for running Ignite over Java 17 is already in master. Please take a look: https://github.com/apache/ignite/blob/master/bin/include/jvmdefaults.sh On 2022/04/12 10:11:57 Lokesh Bandaru wrote: > You are fast. :) Was just typing a reply on top of the last one and yours > is

Re: Unable to change maxWalArchiveSize in ignite 2.11.1

2022-03-22 Thread Ilya Korol
Hi Surinder, I guess that there was Integer overflow in expression #{2 * 1024 * 1024 * 1024} so it was evaluated as -2147483648. Try to add 'L' to one of multipliers like: #{2 * 1024 * 1024 * 1024L} 22.03.2022 23:14, Surinder Mehra пишет: Hi, We noticed that WalArchive size is going beyond

Re: interactive shell

2022-01-18 Thread Ilya Korol
Hi. What about sqlline that is available out of the box? Is it not enough for you? 18.01.2022 17:57, Adriel Peng пишет: Hi Can Ignite have an interactive shell (like pyspark) for SQL similar operations in the future version? Thanks

RE: HASH_JOIN: Index "HASH_JOIN_IDX" not found

2022-01-10 Thread Ilya Korol
I've checked latest master and didn't find any mentions of HASH_JOIN_IDX in it (except documentation sources). Meanwhile in gridgain community repository you can find HashJoinIndex class

Re: IgniteBiPredicate in ThinClient ScanQuery:java.lang.ClassNotFoundException

2021-12-10 Thread Ilya Korol
PeerDeploymentClassLoading should help to work around this issue, shouldn't it? 10.12.2021 20:56, Pavel Tupitsyn пишет: Yes, the problem is that the predicate class "ThinClient$1" is not deployed on the server. On Fri, Dec 10, 2021 at 1:24 PM 18624049226 <18624049...@163.com

RE: CVE-2021-2816[3,4,5] vulnerabilities and Ignite 2.8.1

2021-11-03 Thread Ilya Korol
I guess so. If vulnerability present in particular JAR by excluding this JAR from classpath, CVE should not affect you environment. On 2021/10/27 12:58:12 Dana Milan wrote: > Hi, > . > Can anyone provide a clarification of how jetty is being used by Ignite > 2.8.1 and whether there is another

RE: frequent "Failed to shutdown socket" warnings in 2.11.0

2021-11-02 Thread Ilya Korol
Hi MJ. This is a bug, i've created a jira for it: https://issues.apache.org/jira/browse/IGNITE-15867 However this should not affect ignite workflow, since it just produces excessive stack traces and nothing more. On 2021/11/03 03:27:42 "MJ" wrote: > Hi, > > > > > > > I experienced

RE: Not able to set off heap max memory for Ignite queues

2021-11-02 Thread Ilya Korol
Hi Bharath. I've checked the sources and looks like method CollectionConfiguration.getOffHeapMaxMemory() is never called, so the only way to restrict queue capacity is to use capacity parameter of ignite.queue(). One can argue about it, but this looks quite natural to restrict queue by

RE: Ignite Cache operations get stuck when multiple thin clients try to perform CRUD operations in parallel with partition map exchange

2021-11-02 Thread Ilya Korol
Hi Sumit, What is Ignite version that you use? AFAIK partition map exchange is a king of "stop the world" actiity for the cluster, so any other actions with cluster (like cache creation) would be suspended until PME end. If all of your clients concurrently try to create same cache it's OK

Re: apache ignite 2.10.0 heap starvation

2021-09-27 Thread Ilya Korol
Actually Query interface doesn't define close() method, but QueryCursor does. In your snippets you're using try-with-resource construction for SELECT queries which is good, but when you run MERGE INTO query you would also get an QueryCursor as a result of igniteCacheService.getCache(ID,

Re: Questions about baseline auto-just

2021-09-27 Thread Ilya Korol
Hi, It looks like baseline topology auto-adjustment is in process. Did you checked cluster state later? Also to track auto-adjustment events please check your logs for messages like: Baseline auto-adjust will be executed right now ... Baseline auto-adjust will be executed in ... Baseline

Re: SqlOnheapCache failure

2021-09-24 Thread Ilya Korol
AFAIK there were not any significant changes related to this feature. Also note that but default there is no restriction for size of on-heap memory that would be used for sql caching, so try to add some tunings like increasing heap memory or specifying number of cached rows via

Re: node not detecting other nodes in baseline topology

2021-08-13 Thread Ilya Korol
Hi, Are you running ignite every of nodes on dedicated machines? When you restart ignite node do you also restart whole machine? Is there any kind of DHCP? Could you also share more logs from 11th node and from other server node. On 2021/08/12 05:57:31, BEELA GAYATRI wrote: > Dear Team,> >

Re: On-demand replication

2021-08-11 Thread Ilya Korol
I guess that you have an option to move whole PDS (if you enable it) via SSH from one cluster to another, but this approach could be tricky because caches partitions distribution may not be the same on different clusters. On 2021/07/29 16:55:28, wrote: > Hello,> > > What's the best way to

Re: Apache Ignite Repo 403 Forbidden

2021-08-11 Thread Ilya Korol
Hi, Apache moved Ignite's repositories here: https://apache.jfrog.io/artifactory/ignite-deb/ https://apache.jfrog.io/artifactory/ignite-rpm/ https://stackoverflow.com/questions/68493785/ignite-deb-package-mirrors On 2021/07/22 20:53:55, Mustafa Sunka wrote: > looking more into this, it

Re: "Failed to update keys" error

2021-08-10 Thread Ilya Korol
Hi, Looks like following lines of error stack trace says that the issue really may be related to class loader: Suppressed: class org.apache.ignite.IgniteCheckedException: Failed to deploy class for local deployment

Re: CacheInvalidStateException | all partition owners have left the grid, partition data has been lost

2021-08-10 Thread Ilya Korol
Hi, Which Ignite version do you use? Have you enabled any optional ignite libs? Am I right that you're trying to call Ignite REST API? Do you know call to which endpoint produces described error? Which client do you use for calling this endpoint? Can you repeat this call via other tools like

Re: CacheInvalidStateException | all partition owners have left the grid, partition data has been lost

2021-08-10 Thread Ilya Korol
Hi, Which Ignite version do you use? Have you enabled any optional ignite libs? Am I right that you're trying to call Ignite REST API? Do you know call to which endpoint produces described error? Which client do you use for calling this endpoint? Can you repeat this call via other tools like

Re: Ignite Sink Connector in Apache Ignite 2.10.0

2021-08-10 Thread Ilya Korol
Hi Shubham Shirur, Afaik kafka module was moved to separate repo https://github.com/apache/ignite-extensions, and now it released independently. Concerning missing kafka optional module in ignite distribution: Looks like existing docs is a bit outdated and should be fixed. Because neither

Re: java.lang.IllegalStateException: Cache doesn't exist

2021-06-17 Thread Ilya Korol
Hi, Vladislav. Did you also deployed appropriate cache configuration along with ignite server? See examples in ignite docs or ignite repo about how to define/configure caches. 17.06.2021 02:21, Vladislav Shipugin пишет: I started the ignite-server in Kubernetes and am trying to connect the

Re: Intermittent Error

2021-06-15 Thread Ilya Korol
Is there any logs on server side when you face this issue? 16.06.2021 11:19, Moshe Rosten пишет: Greetings, I'm attempting to retrieve a list of values from this query line: List>res =conn.sqlQuery("select * from TWSources"); It works sometimes perfectly fine, and at other times it gives me

Re: Bug in GridCacheWriteBehindStore

2021-06-11 Thread Ilya Korol
I've created a Jira for this issue https://issues.apache.org/jira/browse/IGNITE-14898 10.06.2021 18:56, Ilya Kasnacheev пишет: Hello! I guess so. I think you should file a ticket against Ignite JIRA. Regards, -- Ilya Kasnacheev ср, 9 июн. 2021 г. в 20:26, gigabot

Re: Write Behind slowing down performance greatly

2021-06-07 Thread Ilya Korol
Yes, you're right. There is no remote listeners. I mean do you use only local listener or also configured remote filters? (Excuse me for being not clear enough). Did you configure backups for cache partitions? If so at which node you are listening for event (primary or backup)? Try to

Re: Write Behind slowing down performance greatly

2021-06-07 Thread Ilya Korol
What kind of listener you used? Could you share your configuration or link to a reproducer? I've checked write behind feature with mysql instance and don't find any performance loss (i receive cache put events instantly via registered listener but they appear in DB with configured time

Re: How to deal with data expiration time flexibly

2021-05-18 Thread Ilya Korol
Hi, afaik unfortunately there is no opportunity to implement custom ExpiryPolicy that will rely on cache entry value field for expiry calculation because there is no any hook for intercepting value during expiry policy creation or calls. But you can use a little hacky trick with cache proxy