Re: [External]Re: unable to start node

2020-09-03 Thread Denis Mekhanikov
table connected to that cache (we don’t update anything > though SQL though) but its not created via CREATE TABLE command. We use > XMLs to create caches. > > > > > > *Thanks and Regards,* > > *Kamlesh Joshi* > > > > *From:* Denis Mekhanikov > *Sent:* 03 S

Re: [External]Re: unable to start node

2020-09-03 Thread Denis Mekhanikov
t; around 3 months back. > > > > Please, let me know is there anything we should try to recover the node ? > > > > *Thanks and Regards,* > > *Kamlesh Joshi* > > > > *From:* Denis Mekhanikov > *Sent:* 03 September 2020 14:08 > *To:* user > *Subject:*

Re: NullPointerException when destroying cache

2020-09-03 Thread Denis Mekhanikov
Thanks for the report! I created a JIRA issue for that: https://issues.apache.org/jira/browse/IGNITE-13398 This bug doesn't seem to have any impact in your case. The following case is affected though: If you have multiple services, one of which has ServiceConfiguration#cacheName specified:

Re: How to persist data only on selected nodes but not all nodes in cluster

2020-09-03 Thread Denis Mekhanikov
When you have persistence configured in your cluster, some set of nodes form a baseline topology (BLT). Those are the nodes that store the data and persist it on their disks. Nodes outside of the BLT can query the data stored on other nodes that are in the BLT. Normally nodes are not added to the

Re: Issue in Alter Table - Drop Column functionality

2020-09-03 Thread Denis Mekhanikov
I mean, DROP COLUMN, not DROP TABLE. Denis чт, 3 сент. 2020 г. в 11:46, Denis Mekhanikov : > Does the DROP TABLE statement work if you specify the schema name > explicitly? > For example, if the table is in the PUBLIC schema, try running the > following query: ALTER TABLE PUBLIC

Re: Issue in Alter Table - Drop Column functionality

2020-09-03 Thread Denis Mekhanikov
Does the DROP TABLE statement work if you specify the schema name explicitly? For example, if the table is in the PUBLIC schema, try running the following query: ALTER TABLE PUBLIC.person DROP COLUMN (age) Denis ср, 2 сент. 2020 г. в 20:27, Shravya Nethula <

Re: [External]Re: unable to start node

2020-09-03 Thread Denis Mekhanikov
It seems that there is a String value in the CustomerCharsCache cache that is being rebalanced to the new node, where it tries to be indexed. Kamlesh, do you have an SQL table that stores data in the CustomerCharsCache? Did you put any data to this cache using cache API directly? Denis чт, 3

Re: Ignite Webconsole (console.gridgain.com) login not not working

2020-06-17 Thread Denis Mekhanikov
Tarun, Thanks for the report! We've had an issue with the service. It's back on now. Denis ср, 17 июн. 2020 г. в 16:17, tarunk : > Hi All, > > I have been using ignite webconsole with my login hosted at > https://console.gridgain.com/signin. > I remember using it till ~a month back, while

Re: Server Node comes down when a thick client node comes down and an update is issued within the failuredetectiontimeout

2020-03-26 Thread Denis Mekhanikov
Please find my reply in the following thread: http://apache-ignite-developers.2346864.n4.nabble.com/Server-Node-comes-down-with-err-Failed-to-notify-listener-GridDhtTxPrepareFuture-Error-td46413.html Denis -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Service grid webinar

2019-12-23 Thread Denis Mekhanikov
ave it? > > > On Wed 6 Nov, 2019, 3:30 AM Denis Mekhanikov > > Hi Igniters! > > > > > > I’ve been working on the Service Grid functionality in Apache Ignite for > > > a while, and at some point I've decided to make a webinar with a > > > high-level overvie

Service grid webinar

2019-11-05 Thread Denis Mekhanikov
Hi Igniters! I’ve been working on the Service Grid functionality in Apache Ignite for a while, and at some point I've decided to make a webinar with a high-level overview of this part of the project. If you want to learn more about services, look at some use-cases or just ask a few questions

RE: Issue querying id column only

2019-10-21 Thread Denis Mekhanikov
bc:ignite:thin://127.0.0.1> select _key from account.cacheddomainnode; > ++ > |  _KEY  | > ++ > | ---- | > | 99488ecd-4cae-4ecc-8306-c3b4215452c2 | > |

Re: Node stopped.

2019-10-18 Thread Denis Mekhanikov
> On Thu, 17 Oct 2019 at 05:09, Denis Mekhanikov > > wrote: > > > There are no long pauses in the GC logs, so it must be the whole VM pause. > > > > > > Denis > > > On 16 Oct 2019, 23:07 +0300, John Smith , wrote: > > > > Sorry here is

Re: Striim support for Ignite

2019-10-17 Thread Denis Mekhanikov
I’m not aware of any activity towards supporting Striim. Try asking the same in the Striim community. Hopefully, somebody will help you with that there. Denis On 16 Oct 2019, 21:51 +0300, niamin , wrote: > Is there any plan to add Ignite connector for Striim to facilitate CDC? > > > > -- > Sent

Re: Unable to find the ml.inference package

2019-10-17 Thread Denis Mekhanikov
This package hasn’t  been released yet. It’s planned to be released in Apache Ignite 2.8. Here is the ticket under which this package was created:  https://issues.apache.org/jira/browse/IGNITE-10234 Till then you can try using a nightly build: 

Re: Issue querying id column only

2019-10-17 Thread Denis Mekhanikov
Are you able to reproduce this issue using SQL only? Could you share the DDL, insert and select statements that lead to the described issue? I tried the following queries, but they work as expected. CREATE TABLE people (id int PRIMARY key, first_name varchar, last_name varchar); INSERT INTO

Re: Ignite Node Connection Issue

2019-10-17 Thread Denis Mekhanikov
I answered to you on stackoverflow:  https://stackoverflow.com/questions/58422096/failing-to-connect-apache-ignite-cluster You need to use the port 10800 for thin clients instead of 47xxx Denis On 17 Oct 2019, 00:08 +0300, sri hari kali charan Tummala , wrote: > I even tried with simple scala

Re: Node stopped.

2019-10-17 Thread Denis Mekhanikov
ing, > > > the CPU usage looked normal at the time. > > > > > > > On Thu, 10 Oct 2019 at 13:05, Denis Mekhanikov > > > > wrote: > > > > > Unfortunately, I don’t. > > > > > You can ask the VM vendor or the cloud provider (if

Re: Cache Preload from database using IgniteDatastreamer

2019-10-15 Thread Denis Mekhanikov
It’s worth mentioning, that best performance is usually achieved when adding data to the same IgniteDataStreamer instance from multiple threads. Denis On 12 Oct 2019, 06:46 +0300, ravichandra , wrote: > Hi Om Thacker, > > I am trying to implement / follow the same approach for my POC to

RE: [External]Re: Freeing up RAM/cache

2019-10-14 Thread Denis Mekhanikov
Joshi , wrote: > Thanks for the response Denis ! That answers my one question. Could you > please suggest on below question regarding expiration policy ? > > Thanks and Regards, > Kamlesh Joshi > > From: Denis Mekhanikov > Sent: Thursday, October 10, 2019 10:31 PM > To: u

Re: Fault tolerance with IgniteCallable and IgniteRunnable on user errors

2019-10-11 Thread Denis Mekhanikov
Prasad, User errors are propagated to the calling site, so you can implement failover outside of the task’s logic. Denis On 11 Oct 2019, 17:33 +0300, Prasad Bhalerao , wrote: > Hi, > > How to define custom failover behavior when executing IgniteRunnable or > IgniteCallable tasks executed with

Re: Node stopped.

2019-10-10 Thread Denis Mekhanikov
on it are starving. Denis On 10 Oct 2019, 19:03 +0300, John Smith , wrote: > Do you know of any good tools I can use to check the VM? > > > On Thu, 10 Oct 2019 at 11:38, Denis Mekhanikov > > wrote: > > > > Hi Dennis, so are you saying I should enable GC logs + the sa

Re: Freeing up RAM/cache

2019-10-10 Thread Denis Mekhanikov
There is no manual way to evict data from memory. You can limit the size of your data region, so that if this limit is reached, then some pages will be dropped from memory automatically and replaced with new ones. This process is called page replacement. You can read about it here: 

Re: Node stopped.

2019-10-10 Thread Denis Mekhanikov
correct, it is running in a VM. > > > > > > > On Thu, 10 Oct 2019 at 10:11, Denis Mekhanikov > > > > wrote: > > > > > Hi! > > > > > > > > > > There are the following messages in the logs: > > > > > > > > &g

Re: Apache Ignite Change data capture functionality

2019-10-10 Thread Denis Mekhanikov
Ravichandra, There is no integration for Striim in Apache Ignite codebase, so you need to check with the Striim documentation if it’s possible to configure it for Ignite. If you want to use Ignite as a target, then a JDBC adapter should work, if there is any available. If Ignite should work as

Re: Node stopped.

2019-10-10 Thread Denis Mekhanikov
Hi! There are the following messages in the logs: [22:26:21,816][WARNING][jvm-pause-detector-worker][IgniteKernal%xx] Possible too long JVM pause: 55705 milliseconds. ... [22:26:21,847][SEVERE][ttl-cleanup-worker-#48%xx%][G] Blocked system-critical thread has been detected. This can

Re: Ignite SQL table ALTER COLUMN and RENAME COLUMN

2019-10-10 Thread Denis Mekhanikov
Favas, It’s possible to remove a column and add another one using ALTER COMAND SQL statement, but currently you can't change a column’s type. Note, that removing a column and adding another one with the same name but with a different type can lead to data corruption. Denis On 10 Oct 2019,

Re: Gracefully shutting down the data grid

2019-10-08 Thread Denis Mekhanikov
Shiva, What version of Ignite do you use and do you have security configured in the cluster? There was a bug in Ignite before version 2.7, that has similar symptoms:  https://issues.apache.org/jira/browse/IGNITE-7624 It’s fixed under the following ticket: 

Re: nodes are restarting when i try to drop a table created with persistence enabled

2019-09-25 Thread Denis Mekhanikov
I think, the issue is that Ignite can't recover from IgniteOutOfMemory, even by removing data. Shiva, did IgniteOutOfMemory occur for the first time when you did the DROP TABLE, or before that? Denis ср, 25 сент. 2019 г. в 02:30, Denis Magda : > > Shiva, > > Does this issue still exist? Ignite

Re: Ignition Start - Timeout if connection is unsuccessful

2019-09-11 Thread Denis Mekhanikov
Mahesh, There is a TcpDiscoverySpi property, that defines this behaviour: TcpDiscoverySpi#joinTimeout [1]. So, instead of calling Ignition.start() with a special property, you can specify this timeout in the configuration. If a join attempt is failed and joinTimeout is already exceeded, then the

Re: Using Persistent ignite queues

2019-09-03 Thread Denis Mekhanikov
Hi! IgniteQueue is stored in the atomics cache, which is called ignite-sys-atomic-cache@default-ds-group by default. This cache is stored in the default data region, so in order to make it persisted, you need to make the default data region persisted using

Re: Exception handling for asynchronous backup

2019-08-30 Thread Denis Mekhanikov
Hi! If the cache is transactional, then no inconsistencies are possible, since two-phase commit guarantees, that all nodes have data records of the same version. In case of an atomic cache, primary node failure can indeed lead to an inconsistency between different versions of the same

Re: Replicated cache partition size

2019-08-26 Thread Denis Mekhanikov
Niels, I believe, that the reason is performance of an affinity function and a size of GridDhtPartitionsFullMessage. An affinity function needs to assign partitions to nodes. In case of a replicated cache, there are (number of partitions) x (number of nodes) pairs of (node, partition) that

Re: IgniteCache.destroy() taking long time

2019-08-26 Thread Denis Mekhanikov
Partition map exchange is an absolutely necessary procedure, that cannot be disabled. Functionality of all caches depend on it. I checked, and a cache destruction is performed as a part of a partition map exchange, and not the opposite. If you see, that nodes join the cluster fast, but cache

Re: Capacity planning for production deployment on kubernetes

2019-08-23 Thread Denis Mekhanikov
error message in ignite node: > > > > > > "ERROR","JVM will be halted immediately due to the failure: > > > [failureCtx=FailureContext [type=SYSTEM_WORKER_TERMINATION, err=class > > > o.a.i.IgniteCheckedException: Failed to archive WAL segment >

Re: Capacity planning for production deployment on kubernetes

2019-08-22 Thread Denis Mekhanikov
Shivakumar, Such allocation doesn’t allow full memory utilization, so it’s possible, that nodes will crash because of out of memory errors. So, it’s better to follow the given recommendation. If you want us to investigate reasons of the failures, please provide logs and configuration of the

Re: Does IgniteCache.containsKey lock the key in a Transaction?

2019-08-22 Thread Denis Mekhanikov
Yohan, IgniteCache#containsKey(...) locks a key under pessimistic transactions with REPEATABLE_READ isolation level, just like a get(). And it doesn’t make servers send values back to a

Re: Cache spreading to new nodes

2019-08-22 Thread Denis Mekhanikov
nodes or was that a typo? I thought it was a filter for all the nodes for a cache. On Wed, 14 Aug 2019 at 17:58, Denis Mekhanikov wrote: > Marco, > > Rebalance mode set to NONE means that your cache won’t be rebalanced at > all unless you trigger it manually. > I think, it’s bett

Re: Cache spreading to new nodes

2019-08-14 Thread Denis Mekhanikov
Marco, Rebalance mode set to NONE means that your cache won’t be rebalanced at all unless you trigger it manually. I think, it’s better not to set it, because otherwise if you don’t trigger the rebalance, then only one node will store the cache. Also the backup filter specified in the affinity

Re: IgniteCache.destroy() taking long time

2019-08-14 Thread Denis Mekhanikov
Folks, Partition map exchange (PME) will actually happen in both cases: PARTITIONED and REPLICATED. We need to understand, which part of the destroy is the longest. If you enable INFO logs, then you’ll see messages about partition map exchange happening when you destroy caches. Check, whether

Re: about single service redistribution after node restart

2019-07-03 Thread Denis Mekhanikov
Hi! Currently services don't get redistributed if new nodes join a topology. So, if you have all services deployed on one node, then they won't be moved to newly joined ones. This is a known issue. The following ticket mentions it: https://issues.apache.org/jira/browse/IGNITE-7667 Currently even

Re: Connect external application to Ignite cluster via REST

2019-06-17 Thread Denis Mekhanikov
Kushan, I would recommend using one of thin clients, since they have better performance comparing to REST. They work over a binary protocol, while REST needs data to be serialized as strings. Connectors for thin clients are enabled on all nodes by default, so you can any one to connect. Find

Re: loading a cache into memory after startup

2019-06-13 Thread Denis Mekhanikov
Hi! You can use a scan query, that will iterate over the whole dataset and bring it to memory. You don't need to perform any specific processing. Just touching it is enough for it to appear in memory. In version 2.8 there will be a new API, allowing preloading partitions.

Re: Re:Re:RE: Re: Node can not join cluster

2019-05-22 Thread Denis Mekhanikov
Vishalan, Please create a new thread and provide information about your setup and logs. The OP doesn't seem to be getting your questions. Denis пн, 20 мая 2019 г. в 12:44, Vishalan : > What was the solution to above problem.I am facing the same issue > > > > -- > Sent from:

Re: Trouble with continuous queries

2019-05-22 Thread Denis Mekhanikov
r to work for this scenario. It is using a simple for > cache. I have tried but it does not appear to ever be > notified of events > > On Tue, May 14, 2019 at 10:55 AM Denis Mekhanikov > wrote: > >> Mike, >> >> First of all, it's recommended to have a separat

Re: Integrity of write behind

2019-05-17 Thread Denis Mekhanikov
John, Entries are queued for persisting only on primary nodes, so if it fails before writing all updates to the underlying database, then it will result in some entries not being written to the database at all. This is the price for a better performance, that write behind provides. Take a look

Re: Store raw binary value in Apache Ignite through thin python client

2019-05-16 Thread Denis Mekhanikov
Hi! Thanks for the report! Seems like the implementation of serialization of primitive arrays is not optimal. I created a JIRA ticket for this issue: https://issues.apache.org/jira/browse/IGNITE-11854 Denis вт, 14 мая 2019 г. в 13:53, kulinskyvs : > I'm trying to save some raw binary data into

Re: java.lang.NoSuchMethodError: org.apache.ignite.IgniteCache.getName()Ljava/lang/String;

2019-05-16 Thread Denis Mekhanikov
Tomasz, There is no such Ignite version as 2.8.0. The latest one is 2.7.0. Please make sure that all dependencies are resolved correctly. Denis пн, 13 мая 2019 г. в 12:50, Tomasz Prus : > Hi, > i'm trying to set up Ignite 2.8.0 in our application but i get such error: > >

Re: Ignite WebSessionFilter client threads eating up CPU usage

2019-05-16 Thread Denis Mekhanikov
Patrick, Could you explain a bit more, why do you think that striped pool is the reason? Striped pool is where cache operations happen. So, if you see, that it consumes a lot of CPU, then it probably means, that a lot of cache operations are coming to the cluster. You can record a JFR and see,

Re: Metrics to get size of cache in memory

2019-05-15 Thread Denis Mekhanikov
Gupabhi, Memory-related metrics are available on data region level. You can see, how much space is occupied by each data region on every node. You can find available metrics here: https://apacheignite.readme.io/docs/memory-metrics Denis ср, 15 мая 2019 г. в 01:21, gupabhi : > Hello, > I'm

Re: Timestamp with Python thin client

2019-05-14 Thread Denis Mekhanikov
Stéphane, Could you provide the code, that results in this exception? Do you try to insert the tuple as a single field via SQL? There is no such primitive as a tuple in SQL, so you should probably split timestamp into datetime and nanoseconds columns and store them separately as two different

Re: Two DataStreamer pods for load balancing on Kubernetes

2019-05-14 Thread Denis Mekhanikov
Sheshananda, > we are not getting any logs for the 2nd pod Do you mean that the client node with the data streamer doesn't join the cluster? Or the node joins, but just doesn't receive any data from Kafka? Denis пт, 3 мая 2019 г. в 06:26, sheshananda : > HI, > > I am using DataStreamer to load

Re: Trouble with continuous queries

2019-05-14 Thread Denis Mekhanikov
Mike, First of all, it's recommended to have a separate cache per table to avoid storing of objects of different types in the same cache. Continuous query receives all updates on the cache regardless of their type. Local listener is invoked when new events happen. Existing records can be

Re: sizing

2019-05-14 Thread Denis Mekhanikov
Clay, If you want to store plain strings without any schema or markup, then use varchar. But if you plan to store POJOs, then binary objects should certainly be used instead of varchar. Binary types contain meta information, improving type safety of stored data. Binary objects don't apply any

Re: Error in running wordcount hadoop example in ignite

2019-04-02 Thread Denis Mekhanikov
Hi! As far as I can see, you tried running examples from Hadoop 2.7.7 But Ignite uses Hadoop version 2.4.1 internally. So, I would start from checking the same examples for the matching version of Hadoop (2.4.1). Denis чт, 28 февр. 2019 г. в 08:58, mehdi sey : > hi > i want to execute

Re: What's the difference between client node, jdbc driver and thin client

2019-03-25 Thread Denis Mekhanikov
In general client nodes have better performance than thin clients, but they require more resources and have stronger coupling with the rest of the cluster. Thin client and thin JDBC driver have about the same performance, so everything depends on a use-case. So, your understanding is quite

Re: Question about SQL query when persistence enabled

2019-03-25 Thread Denis Mekhanikov
Justin, You can think of your dataset as if there was no separation between disk and memory. So, all data is always available for all SQL operations. Data, which is available in memory will be used right away. Data, which is present on disk only will be loaded into memory first, and after that

Re: InvalidClassException local class incompatible for custom cache store factory

2019-03-20 Thread Denis Mekhanikov
Ken, Cache store factory is a part of a cache configuration. So, if a cache configuration is stored somewhere, and it's deserialized using a new class, then this exception is thrown. It's possible if you have native persistence enabled, for example. The cache configuration is read from disk when

Re: cache.removeAll cache operation is slow

2019-01-22 Thread Denis Mekhanikov
Prasad, When you run a transaction, that involves many entries, the whole key set is sent between nodes multiple times. It also generates a lot of garbage, which cannot be released until the transaction is committed. It's better to remove values in small batches. So, try changing the batch size.

Re: ignite zk: Possible starvation in striped pool

2019-01-22 Thread Denis Mekhanikov
This message is printed, when a thread in striped pool doesn't have any progress for some time. As far as I can see from the thread dump, a TCP connection with another node cannot be established for some reason. It's probably caused by network problems or long GC on one of the nodes. This is about

Re: Is there Ignite Eviction low water mark

2019-01-22 Thread Denis Mekhanikov
gnite literally delete the entry, or can they be remain > for certain period and later get wiped out. > > > > The implementation of eviction from 1.x to 2.x is a different, new one? > > > > > > *From:* Denis Mekhanikov [mailto:dmekhani...@gmail.com] > *Sent:* Monday

Re: Ignite Data streamer optimization

2018-12-28 Thread Denis Mekhanikov
To achieve the best data streaming performance, you should aim at highest utilization of resources on data nodes. There is no silver bullet for data streamer tuning, unfortunately. Try changing parameters and see, how they affect the utilization and overall performance. For me default data

Re: Multithreading in Compute Task

2018-12-28 Thread Denis Mekhanikov
Both approaches are valid, so you may use whatever works better for you. Just make sure not to run tasks, that may end up in the same thread pool, if you depend on their results. Otherwise thread pool starvation is possible. Custom thread pools are designed for executing tasks from other tasks:

Re: Is Apache planning to release support for table joins with updates .

2018-12-28 Thread Denis Mekhanikov
Try substituting personalDetails.F_id with a value from the record, that you expect to be updated, and try running the subquery on its own. Make sure, that the result is not empty. Denis пт, 28 дек. 2018 г. в 13:14, DS : > Denis Mekhanikov wrote > > Is it a single query? Why no

Re: Can Ignite code throw any RuntimeExceptions ?

2018-12-28 Thread Denis Mekhanikov
Usually Ignite methods throw exceptions with some general description and a cause exception wrapped into them. I can't remember, if there is any place, where a non-Ignite exception is thrown from Ignite method. Let us know, if you find one. Denis чт, 27 дек. 2018 г. в 09:59, userx : > Hi > >

Re: Can we put a timeout on Ignite.close ?

2018-12-28 Thread Denis Mekhanikov
Ignite.close() effectively does exactly what you described. It tries to stop all threads as fast as possible by interrupting them. But some threads may be doing some blocking operations at the moment, so they are not killed instantaneously. For example, if you try to stop a node in the middle of a

Re: Is Apache planning to release support for table joins with updates .

2018-12-28 Thread Denis Mekhanikov
Is it a single query? Why not execute these two updates separately? I don't see any problems in the first one. The second one needs some refactoring though. Ignite uses an SQL query engine of H2, which doesn't support JOINs in UPDATE statements. But you may change it in the following way: UPDATE

Re: Index inline size

2018-12-27 Thread Denis Mekhanikov
Prasad, By default *QuerySqlField#inlineSize *is equal to -1, which means, that it will be chosen automatically. *CacheConfiguration#setSqlIndexMaxInlineSize *specifies the maximal automatically calculated inline size for a cache. But if *QuerySqlField#inlineSize *is not -1, then it will be used

Re: Java Thin Client support to deploy services on a cluster

2018-12-20 Thread Denis Mekhanikov
Zaheer, Currently thin client doesn't support service-related operations. Regular client or server node should be used for service deployment. Denis чт, 20 дек. 2018 г. в 11:03, Zaheer : > Hi, > > I saw from documentation about Thin clients used to create, destroy caches. > I wanted to know if

Re: How to Write and Read a Nested JSON Into and From Apache Ignite Table

2018-12-17 Thread Denis Mekhanikov
Hareesh, Are the object supposed to have the same schema? If yes, then JSONs may be converted to BinaryObjects. If no, then you'll have to store them as blobs or text. If you want to access such data from SQL, your tables should have a flat structure. You may have nested binary objects, but in

Re: Expose service deployed on service node in ignite via REST

2018-12-13 Thread Denis Mekhanikov
Zaheer, There is an embedded REST processor in Ignite. It doesn't have a direct way to call service methods. But you can execute compute tasks via REST, and you may use it to call services. Another option is to write a custom REST controller and write your custom logic in it. That's what you

Re: Expose service deployed on service node in ignite via REST

2018-12-13 Thread Denis Mekhanikov
Zaheer, Does it have to be a service? Won't a compute task be enough? You can use an execute REST command to run a compute task on a grid. You may either modify the cache or call a service from this task. Denis чт, 13 дек. 2018 г. в

Re: SQL Index Payload size?

2018-12-11 Thread Denis Mekhanikov
Jose, There is no such metric currently. The only way to understand it now is to try loading data with and without indices, and compare results. There is an enhancement proposal, that covers this functionality:

Re: Spring ThreadPoolTaskScheduler default behaviour changed

2018-12-11 Thread Denis Mekhanikov
Andrey, Thanks for the info! Denis вт, 11 дек. 2018 г. в 14:02, Andrey Davydov : > Hello, > > When I update Ignite from 2.6 to 2.7, I have to update Spring to > corresponding version too (from 4.16 to 4.18). And I got some exceptions on > application stop (org.apache.ignite.internal. >

Re: Cluster High-Availability

2018-12-11 Thread Denis Mekhanikov
Johe, You can configure a corresponding backup filter for your cache affinity function. Use the following method to specify it in a cache config: RendezvousAffinityFunction.html#setAffinityBackupFilter

Re: control.sh --baseline do not work after update to 2.7

2018-12-11 Thread Denis Mekhanikov
Yuriy, Do you see any exceptions in log of control.sh script or cluster nodes, when you run the baseline command? Try specifying --host and --port parameters explicitly. Denis вт, 11 дек. 2018 г. в 12:56, Yuriy : > Hello. > > After updating from 2.6 to 2.7 control.sh --baseline can not

Re: Long activation times with Ignite persistence enabled

2018-11-05 Thread Denis Mekhanikov
Naveen, 40 caches is quite a lot. It means, that Ignite needs to handle 40 * (number of partitions) files. By default each cache has 1024 partitions. This is quite a lot, and a disk is the bottleneck here. Changing of thread pool sizes won't save you. If you divide your caches into cache groups,

Re: Is there Ignite Eviction low water mark

2018-11-05 Thread Denis Mekhanikov
Hi! Ignite 2.x has a mechanism called page eviction . It's configured using DataRegion#pageEvictionMode

Re: Apache Ignite - Near Cache consistency

2018-11-05 Thread Denis Mekhanikov
Correct. Strong consistency is guaranteed for atomic caches as well, including near cache entries. Denis пн, 5 нояб. 2018 г. в 11:21, ales : > Thanks Denis for the answer. > > Actually i am using "ATOMIC" atomicity mode (ie no transaction). > I have been told that it may be linked to the backup

Re: Apache Ignite - Near Cache consistency

2018-11-02 Thread Denis Mekhanikov
Arnaud, There is a short note on the following page about near cache consistency: https://apacheignite.readme.io/docs/near-caches Here is its text: > Near caches are fully transactional and get updated or invalidated automatically whenever the data changes on the servers. Near cache entries take

Re: Distributed Priority QUEUE

2018-11-02 Thread Denis Mekhanikov
You can take an implementation of a regular heap data structure and replace an array with an Ignite cache. There are a few point to take into account though: - The cache should be transactional and each operation should happen inside a

Re: IGNITE_EXCHANGE_HISTORY_SIZE value for Ignite client

2018-11-01 Thread Denis Mekhanikov
Cristian, I don't see any critical consequences, if you set IGNITE_EXCHANGE_HISTORY_SIZE to 0 on clients. Exchange futures just will be removed after each exchange. By default they are removed only once in a while. Don't do it on server nodes though. Coordinator needs exchange history. Your

Re: What is the username of ignite web console

2018-11-01 Thread Denis Mekhanikov
Justin, The first registered user becomes an admin. And he/she may grant admin rights to other users after they register. Denis чт, 1 нояб. 2018 г. в 15:03, wt : > click register and enter your details and it will let you in > > > > -- > Sent from:

Re: An error occured when recreate cache

2018-11-01 Thread Denis Mekhanikov
Could you describe steps to reproduce the issue in more details? What is the cluster topology and sequence of operations? Denis чт, 25 окт. 2018 г. в 6:50, Justin Ji : > The following is the stack: > > 2018-10-25 03:47:02:992 [exchange-worker-#42] ERROR >

Re: Long activation times with Ignite persistence enabled

2018-11-01 Thread Denis Mekhanikov
Naveen, How many caches do you have? As Alexey mentioned, usage of cache groups could reduce the number of created partitions and improve the startup time. Denis сб, 27 окт. 2018 г. в 11:12, Naveen : > Do we have any update long activation

Re: Durable memory with native persistence isssue

2018-11-01 Thread Denis Mekhanikov
What version of Ignite do you use? Did you try checking the number of loaded entries using a cache API, but not SQL? For example, you can iterate over all stored entries using a scan query . Denis пт, 26 окт. 2018 г. в 5:02,

Re: spring XML configuration to connect ignite database using org.apache.ignite.IgniteJdbcThinDriver

2018-11-01 Thread Denis Mekhanikov
Malashree, Refer to the following page for information about Ignite thin JDBC driver: https://apacheignite-sql.readme.io/docs/jdbc-driver If you need information on how to use JDBC from Spring, refer to Spring documentation:

Re: Ignite Cache Memory Size Information

2018-10-30 Thread Denis Mekhanikov
Take a look at the following documentation page: https://apacheignite.readme.io/docs/memory-metrics You can use DataRegionMetrics#getPhysicalMemorySize metric to approximate the

Re: How to start an Ignite cluster with fixed number of servers?

2018-09-18 Thread Denis Mekhanikov
Ray, You can use SSL authentication to prevent nodes, that don't have a corresponding certificate, from connecting to the cluster. https://apacheignite.readme.io/docs/ssltls Denis вт, 18 сент. 2018 г. в 7:49, Ray : > Let's say I want to start an Ignite cluster of three server nodes with >

Re: Service not found for a deployed service

2018-09-14 Thread Denis Mekhanikov
eproduce it. > > > > Thanks, > > Calvin > > > > *From:* Denis Mekhanikov [mailto:dmekhani...@gmail.com] > *Sent:* Friday, August 03, 2018 8:08 PM > > > *To:* user@ignite.apache.org > *Subject:* Re: Service not found for a deployed service > > > &g

Re: Need help for setting offheap memory

2018-09-14 Thread Denis Mekhanikov
So, Amol, Did you look at the heap dump? Denis пн, 6 авг. 2018 г. в 18:46, Amol Zambare : > Hi Alex, > > Here is the full stack trace > > [INFO][tcp-disco-sock-reader-#130][TcpDiscoverySpi] Finished serving > remote node connection > [INFO][tcp-disco-sock-reader-#653][TcpDiscoverySpi] Started

Re: ScanQuery throwing Exception for java Thin client while peerclassloading is enabled

2018-08-30 Thread Denis Mekhanikov
The client protocol doesn't imply P2P class loading. So, you need to provide the implementation of the scan query on the server side. P2P class loading works only for regular nodes, server or client as well. Denis чт, 30 авг. 2018 г. в 9:14, Saby : > ScanQuery is reporting the following

Re: Can Ignite.getOrCreateCache(CacheConfiguration) return null ?

2018-08-29 Thread Denis Mekhanikov
What does the *getOrCreateCache* method do internally? Denis ср, 29 авг. 2018 г. в 5:52, HEWA WIDANA GAMAGE, SUBASH < subash.hewawidanagam...@fmr.com>: > Hi all, > > Is there any possibility for this to happen ? We’re using Ignite 1.9.0 > > > > Following is the code we use to obtain the cache.

Re: keep old cache value than new value

2018-08-29 Thread Denis Mekhanikov
If you use a cache store, and change values in the underlying database, then they won't be propagated to Ignite, and old values will be used. There is no mechanism, that can notify the cache about updates on the 3rd-party DB. But if you didn't have this value in the cache, and read-through

Re: Ignite memory leak

2018-08-17 Thread Denis Mekhanikov
авг. 2018 г. в 15:01, Denis Mekhanikov : > Igor, > > There really is a memory leak in this place. > Thank you for the analysis! This is very cool! > > I filed a JIRA ticket for it: > https://issues.apache.org/jira/browse/IGNITE-9196 > Feel free to assign it to yourself and f

Re: taking more time while reading records.

2018-08-13 Thread Denis Mekhanikov
Shuvendu, What is your cluster configuration? How many nodes do you have? Do you use persistence or 3rd party storage? How do you read data? Denis пн, 13 авг. 2018 г. в 7:43, Shuvendu Das : > Hi, > > We came across a situation where it is taking 10 time more time while > reading records. >

Re: Running Spark Job in Background

2018-08-13 Thread Denis Mekhanikov
This is not really an Ignite question. Try asking it on Spark userlist: http://apache-spark-user-list.1001560.n3.nabble.com/ Running commands with & is a valid approach though. You can also try using nohup . Denis вс, 12 авг. 2018 г. в 5:12, ApacheUser : >

Re: OOM on connecting to Ignite via JDBC

2018-08-07 Thread Denis Mekhanikov
I've >>> added the MySQL JDBC driver to the (web-console generated) pom.xml's >>> dependencies, but I still can't connect to Ignite via DBeaver. >>> >>> On 6 August 2018 at 11:17, Denis Mekhanikov >>> wrote: >>> >>>> Orel, >

Re: Need help for setting offheap memory

2018-08-06 Thread Denis Mekhanikov
Amol, Data is pulled onto heap every time you use it. So, if your Spark jobs operate over big amount of data, then heap memory utilization will be high. Take a heap dump next time you encounter OutOfMemoryError. You can make Java take a heap dump every time it fails with OOME:

Re: Ignite memory leak

2018-08-06 Thread Denis Mekhanikov
Igor, There really is a memory leak in this place. Thank you for the analysis! This is very cool! I filed a JIRA ticket for it: https://issues.apache.org/jira/browse/IGNITE-9196 Feel free to assign it to yourself and fix it, since you already debugged through it. If not, then I think, it will be

  1   2   3   4   >