Problems are enabling Ignite Persistence

I enabled Ignite Persistence. Following is my configuration: //New Data Region > DataStorageConfiguration storageCfgPersistence = new > DataStorageConfiguration(); > DataRegionConfiguration regionCfg = new DataRegionConfiguration(); >

Re: How much heap to allocate

Hi Mikhail, Can you explain how is lazy loading working when I use this sql "select * from table" to query a big table which don't fit in on heap memory? Does Ignite send part of the result set to the client? If Ignite is still sending whole result set back to the client, how can lazy load avoid

ttl-cleanup-worker got "Critical system error detected"

Hi all, Some time i got this exception and service crash after that. I think that Ignite got exception during remove expired records. I have few Caches with expiry but only this Cache got exception. Anyone know how to sort this issue? Here are exception details and configuration: StackTrace:

Re: SQL SELECT with AffinityKeyMapped - no results

I ran into the same issue. if we can not use @AffinityKeyMapped without any workaround. then Can I use AffinityKey as the document address Object personKey1 = new AffinityKey("myPersonId1", "myCompanyId"); Object personKey2 = new AffinityKey("myPersonId2", "myCompanyId"); Person p1 = new

Re: IgniteUtils enables strictPostRedirect in a static block

Hi, Does anyone have information about this? Thanks. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Message grid failure due to userVersion setting

Thanks Ilya, As I understand this a bit more, it seems like IGNITE-7905 is really the same basic flaw in user version not working as documented. Ignite-7905 reproduction is simply to set a non-zero userVersion in a ignite.xml (

How does lazy load work internally in Ignite?

>From this document https://apacheignite-sql.readme.io/docs/performance-and-debugging#section-result-set-lazy-load, it mentioned that when setting lazy load flag on the query it can avoid prolonged GC pauses and even OutOfMemoryError. But it confuses me how does lazy load work internally in

Re: Configurations precedence and consistency across the cluster

Hello, What is the use-case that are you trying to achieve? What does "to sync cache configs" mean? IgniteCache.withX returns you cache with a given CacheOperationContext

.net decimal being stored as Other in ignite.

i have the following class [QuerySqlField] public int vd { get; set; } [QuerySqlField] public long sharesinindex { get; set; } [QuerySqlField] public string name { get; set; } [QuerySqlField] public string isin { get; set; }

Re: IGNITE-8386 question (composite pKeys)

So how should we work around it now? Just create a new index for (customer_id, date)? Cheers, Eugene On Mon, Sep 17, 2018 at 10:52 AM Stanislav Lukyanov wrote: > Hi, > > > > The thing is that the PK index is currently created roughly as > > CREATE INDEX T(_key) > > and not > > CREATE

Re: Query 3x slower with index

Hello! I can see you try to use _key_PK as index. If your primary key is composite, it won't work properly for you. I recommend creating an explicit (category_id, customer_id) index. Regards, -- Ilya Kasnacheev вт, 18 сент. 2018 г. в 17:47, eugene miretsky : > Hi Ilya, > > The different

Re: Query 3x slower with index

Hi Ilya, The different query result was my mistake - one of the categoy_ids was duplicate, so in the query that used join, it counted rows for that category twice. My apologies. However, we are still having an issue with query time, and the index not being applied to category_id. Would

Re: How much heap to allocate

My understanding is that lazy loading doesn't work with group_by. On Tue, Sep 18, 2018 at 10:11 AM Mikhail wrote: > Hi Eugene, > > >For #2: wouldn't H2 need to bring the data into the heap to make the > queries? > > Or at least some of the date to do the group_by and sum operation? > > yes,

Re: Configurations precedence and consistency across the cluster

Thanks! A few clarifications: 1) The first configuration with given cache name will be applied to all nodes" - what do you mean by the first configuration? The configuration of the first node that was started? Is there a gossip/consensus protocol that syncs the cache configs across the 2) We are

Re: How much heap to allocate

Hi Eugene, >For #2: wouldn't H2 need to bring the data into the heap to make the queries? > Or at least some of the date to do the group_by and sum operation? yes, ignite will bring data from off-heap to heap, sometimes if data set is too big for heap memory you need to set lazy flag for your

Re: Configurations precedence and consistency across the cluster

Hello Eugene, 1. Dynamic cache configuration changes are not supported, except properties that may be overridden with IgniteCache.withX. 2. The first configuration with given cache name will be applied to all nodes. You can use the same IgniteCache.withX to put with different expiry policies per

Re: Error while loading data to cache

Your suggestion is working.Thank you. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Too Many open files (native persistence bin files)

Hi, How many caches do you have? Evgenii вт, 18 сент. 2018 г. в 15:38, kvenkatramtreddy : > one correction: lsof showing the information for threads as well, so that > is > why it is showing number of Threads * file descriptor. > > My current ulimit is 32635, open files in 6000 but still we

Re: ScanQuery throwing Exception for java Thin client while peerclassloading is enabled

Hello! Have you tried to do cache.withKeepBinary().query(yourScanQuery)? This will avoid demarshalling of binary objects in predicate. Regards, -- Ilya Kasnacheev вт, 18 сент. 2018 г. в 13:29, Saby : > Hi Ilya, > I tested it with nightly build of 17/09/2018(ver. >

Re: Message grid failure due to userVersion setting

Hello! I'm not familiar with these areas very much, but if you had a reproducer project I could take a look. Regards, -- Ilya Kasnacheev пн, 17 сент. 2018 г. в 19:32, Dave Harvey : > I probably did not explain this clearly. When sending a message from > server to client using the message

Re: Too Many open files (native persistence bin files)

one correction: lsof showing the information for threads as well, so that is why it is showing number of Threads * file descriptor. My current ulimit is 32635, open files in 6000 but still we are receiving too many files open. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How to use Affinity Function to Map a set of Keys to a particular node in a cluster?

Hi You can gather your data by @AffinityKeyMapped in one partition, but you can not force partition to be stored on some particular node. So you can use the same @AffinityKeyMapped for all data related to a particular city and this means all data about this city and/or related to this city would

Re: Error while loading data to cache

Hello! Alternatively, you can set `storeKeepBinary' cache configuration setting to false. Regards, -- Ilya Kasnacheev пн, 17 сент. 2018 г. в 19:59, Skollur : > I am trying to load data to cache using below code and seeing an error. > > >

Re: Hibernate spring XML file to connect ignite database

Hello! You need to add ignite-core-VERSION.jar to class path. If that fails, specify org.apache.ignite.IgniteJdbcThinDriver as driver class explicitly. Regards, -- Ilya Kasnacheev вт, 18 сент. 2018 г. в 13:48, Malashree : > Hibernate spring XML file to connect Apache ignite database using

Re: what is the Apache Ignite Dialect

Hello! Please take a look at this SO post (top answer): https://stackoverflow.com/questions/2085368/difference-between-database-drivers-and-database-dialects Basically, it's a set of do-s and dont-s for Hibernate to mind when querying Ignite. Regards, -- Ilya Kasnacheev вт, 18 сент. 2018 г.

Too Many open files (native persistence bin files)

Hi Team, We have got one production issue using Ignite. as per the lsof (File descriptors ) it is around a 1 million open files with given process and all used by ignite. I am running ignite as emebedding into my web application with native persistence enabled with 3 nodes as Cache Replicated

what is the Apache Ignite Dialect

what is the Apache Ignite Hibernate Dialect to be used in a Java Spring MVC Application. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Hibernate spring XML file to connect ignite database

Hibernate spring XML file to connect Apache ignite database using jdbc Driver when i am connecting first time from the maven Application the connection is loosing getting error has No suitable driver found for jdbc:ignite:thin://127.0.0.1/ Please help me resolving these issues. -- Sent from:

Re: ScanQuery throwing Exception for java Thin client while peerclassloading is enabled

Hi Ilya, I tested it with nightly build of 17/09/2018(ver. 2.7.0.20180917#19700101-sha1:DEV), but getting the same exception. Getting the following exception while trying to fetch the data from cache using ScanQuery from Java Thin client, but SqlQuery giving the correct result. ScanQuery

Re: Performance of SQL query by partial primary key

Hi Ray, You are right, currently complex PK can't be used as index and performance for your query are bad due to full scan. After IGNITE-8386 will be merged the same query start use PK index. вт, 18 сент. 2018 г. в 8:16, Ray : > To answer my

Is there a way to use Ignite optimization and Spark optimization together when using Spark Dataframe API?

Currently, OPTION_DISABLE_SPARK_SQL_OPTIMIZATION option can only be set on spark session level. It means I can only have Ignite optimization or Spark optimization for one Spark job. Let's say I want to load data into spark memory with pushdown filters using Ignite optimization. For example, I

Re: How to start an Ignite cluster with fixed number of servers?

Ray, You can use SSL authentication to prevent nodes, that don't have a corresponding certificate, from connecting to the cluster. https://apacheignite.readme.io/docs/ssltls Denis вт, 18 сент. 2018 г. в 7:49, Ray : > Let's say I want to start an Ignite cluster of three server nodes with >

Re: YCSB Benchmark

Thanks for your reply. I was comparing to the results published here: https://www.gridgain.com/resources/blog/apacher-ignitetm-and-apacher-cassandratm-benchmarks-power-in-memory-computing I run the benchmark on very powered machine with 72 cpu and 500G RAM. I used 32 threads. On Tue, Sep 18,