Re: Expected serialization performance of Ignite .NET

It seems a combination of a better spec machine and a parallel for loop has improved performance, although it still takes 8 seconds to run through all the cache items. Here is some basic test code...would appreciate any tips on how to improve access in this type of usage pattern:

Alter table issue

Hi, I added a new column in an existing table using the following query: ALTER TABLE person ADD COLUMN (order_id LONG) Now, I am trying to change the datatype of the new column, so I tried executing the following queries: ALTER TABLE person DROP COLUMN (order_id) ALTER TABLE person ADD COLUMN

Re: Kafka to Ignite

Hi, Probably you can use Kafka streamer: https://apacheignite-mix.readme.io/docs/kafka-streamer Evgenii пн, 2 дек. 2019 г. в 05:29, ashishb888 : > What are better ways to stream data from Kafka to Ignite cache? > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >

Re: How to identify if re-balancing completed

Hi Akash, Here is the doc for such monitoring: https://www.gridgain.com/docs/latest/administrators-guide/monitoring-metrics/metrics#monitoring-rebalancing Also, org.apache.ignite.internal.processors.cache.CacheLocalMetricsMXBeanImpl contains more metrics related to the rebalance. Evgenii пн, 2

Re: [Webinar] How to Migrate Your Data Schema to Apache Ignite

Having trouble registering. Link to apply for the webinar not active/working. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

[Webinar] How to Migrate Your Data Schema to Apache Ignite

Folks, On Wednesday evening I'll present a talk on how to adopt Ignite SQL for your real-world cases. The following topics will be discussed: - What Ignite SQL is good / bad for - Known (from my perspective) scenarios when using Ignite SQL might be successful - Pitfalls and surprises of

Re: Improving Get operation performance

As you have 4 nodes on the same machine now, you have a lot of context switching, probably all the nodes just competing for CPU resources with each other. Evgenii -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite native persistence

Tried with appending cache name as schema with no success. Attach is a link to my project: https://drive.google.com/open?id=1F53um8TeUK45U3SOW0_Vlj04S8DWyjKI Please take a look. I suspect it is something in my code. Thanks, Naushad -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Cache data not being stored on server nodes

Hi Andrei, Thank you for the response. I do see expiration listener being called on the server node. What I don’t see is the value attached with Event. The key is present but the value is null. I would have expected the expired value to be present in the event as well. I think i am puzzled over

Re: Server Nodes Stopped Unexpectedly

I'm not sure if this would help. We used to have also trouble when a node (client or server) don't have the following property set: 'java.net.preferIPv4Stack'. Make sure all nodes have this property set correctly. 2019-07-22 09:22:47,269 19417663 [disco-event-worker-#61%springDataNode%] WARN

Re: Server Nodes Stopped Unexpectedly

Hi, Answers to questions from the previous message will be based on the provided logs, since it's not clear what happened there yet. IgniteConfiguration.setNetworkTimeout: It is a global timeout for high-level operations where a network is involved. Evgenii -- Sent from:

RE: Ignite bulk data load issue

This message: Blocked system-critical thread has been detected. This can lead to cluster-wide undefined behaviour [threadName=data-streamer-stripe-0, blockedFor=34s] is being printed in case if you're loading data to Ignite much faster than it can write to the disk. The disk is a bottleneck here,

Re: Ignite AI learning resources

Awesome - Thanks (have just started looking through the tutorial examples) Will look through the links to resources too. Being new to AI, it is difficult to know where to start, but am committed to Ignite for other reasons, so would like to learn by using the Ignite ML features... Looking

Re: Ignite AI learning resources

Hi, we are going to release new AI next 2 months with new really cool ML and TensorFlow integration. No documentation and papers released and written yet, but I hope to publish them next 2-3 months too. Also I could recommend to learn this code tutorial

Re: Ignite + Spark installation

thank.. will try and revert back -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

How to identify if re-balancing completed

Hi, If there are multiple nodes in cluster and if one of the node/nodes goes down or a new node/nodes is added how to make sure that re-balancing of all cache partitions has been completed successfully? I need this to implement rolling restart. Thanks, Aksah

Fwd: Local node terminated after segmentation

Can someone please advise on this? -- Forwarded message - From: Prasad Bhalerao Date: Fri, Nov 29, 2019 at 7:53 AM Subject: Re: Local node terminated after segmentation To: I had checked the resource you mentioned, but I was confused with grid-gain doc describing it as

Re: Expected serialization performance of Ignite .NET

Can you please attach a working project to reproduce those numbers? It is hard to say without the code: a class with 21 properties can vary in size a lot. There are many other things at play - JVM options, RAM size, benchmark method, etc. On Mon, Dec 2, 2019 at 2:08 PM camer314 wrote: > I have

Deadlock on concurrent calls to getAll and invokeAll on cache with read-through

Hi We have recently started to encounter what appears to be deadlocks on one of our new clusters. We believe it may be due to "data patterns" being slightly different and more dense than our other existing (working) production clusters. We have some workarounds, but we think this might be an

Kafka to Ignite

What are better ways to stream data from Kafka to Ignite cache? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Transaction operations using the Ignite Thin Client Protocol

Ivan, You are right. Though now we have transactions support in thin client protocol, It is only now implemented for Java. Also, C++ thin client yet to support SQL. Best Regards, Igor On Sat, Nov 30, 2019 at 9:35 AM Ivan Pavlukhin wrote: > Igor, > > Could you please elaborate whether C++

Re: Ignite on-heap & off-heap caches

Thank you Andrei. So for on-heap cache I need set Xms and -Xmx option to allocate the memory. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

java.lang.AssertionError : 0

Hello, when I do some integration test with spring, at the end of the test, my code is calling Ignite.close(). I also had this stack trace under some loads with multi threads and putall on caches. I see this stacktrace : java.lang.AssertionError: 0 at

Re: Does Ignite support nested joins for partitioned cache?

Hi, Thankyou for replying. *cache configration for all 4 tables : * SQL_PUBLIC_PERSON.SQL_PUBLIC_PERSON SQL_PUBLIC_CITY.SQL_PUBLIC_CITY

Expected serialization performance of Ignite .NET

I have a 21 property C# class (mix of int and string) and am using IBinarizable interface as suggested in the documentation. My cache is configured such that each cache entry is a collection of these objects, lets say each cache item is a List. I have 10 million instance of this class. For

Re: node down after Caught unhandled exception in NIO worker thread (restart the node) log

Hello! Well, you have an awful lot of pool starvation messages in your server logs. This may suggest problems with network or the load. You also hit a long GC: [2019-11-22T21:19:45,964][WARN ][jvm-pause-detector-worker][IgniteKernal] Possible too long JVM pause: 15252 milliseconds. Which was

Re: Ignite on-heap & off-heap caches

Hi, No, heap and off-heap memory are different features. *Heap *memory uses -Xms and -Xmx option to allocate the memory used for different operations and generally can't be used for data storing (in case of you don't set on-heap caching). Java GC will work with current memory. *Off-heap*

Re: can't use "cache -a "command , warn info is " the cluster is inactive"

Hello! I think the restart of your nodes is what fixed it for you. Regards, -- Ilya Kasnacheev пн, 2 дек. 2019 г. в 13:25, ?青春狂-^ : > Hi >I used bin/control.sh --host 172.17.122.126 --activate > > But it still did not work properly， it print “ [WARN ] Can not perform > the operation

Re: Issue while using transactions in sql apache ignite console grid gain

Hi, Thank you for the confirmation. Thanks, Harinath -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite AI learning resources

Hi, I don't think that exists some special resources. You can try to ask your questions on mail lists and read existed documentation: 1)Ignite user list - http://apache-ignite-users.70518.x6.nabble.com/ 2)Ignite developers list - http://apache-ignite-developers.2346864.n4.nabble.com/

?????? can't use "cache -a "command , warn info is " the cluster is inactive"

Hi I used bin/control.sh --host 172.17.122.126 --activate But it still did not work properly?? it print ?? [WARN ] Can not perform the operation because the cluster is inactive.?? I changed the config file by added ports, I found this config can use "top " or other commands ??it seem

Re: Cache data not being stored on server nodes

Hi, Please read about expiration here: https://apacheignite.readme.io/docs/expiry-policies Expiry Policy specifies the amount of time that must pass before an entry is considered expired * In-Memory Mode (data is stored solely in RAM): expired entries are *purged *from RAM completely.

Re: When jconsole is used to access the cluster, the heap memory usage increases gradually

Hello! No, JVM will likely perform more thorough GC sometime in the future to regain more heap. Until that time it is free to grow. Regards, -- Ilya Kasnacheev пн, 2 дек. 2019 г. в 13:03, 李玉珏@163 <18624049...@163.com>: > Hi, > > Use the default configuration to start a node through

Re: Does Ignite support nested joins for partitioned cache?

Hello! Ignite supports nested queries, but only as map queries (there is just one reduce query). What does this mean for your query I know not. Can you show cache configurations for your queries, some data and expected/actual result for that data? Maybe you are getting an error of some kind?

Re: Primary Entry Count are not correct in cache

Hello! Unfortunately there is too few information. How does your loader work? How large is the difference between expected and actual? How does it change with time? Have you tried other means of checking cache size? Regards, -- Ilya Kasnacheev пт, 29 нояб. 2019 г. в 21:35, Akash Shinde : >

Does Ignite support nested joins for partitioned cache?

I have been trying to implement nested joins with or without subquery but unable get right results. My caches are partitioned ,so enabling Allow non-collocated joins check. P.S. It has been observed that if i am tyring to join 3 tables,i get expected result but for more than 3 tables worries me.

When jconsole is used to access the cluster, the heap memory usage increases gradually

Hi, Use the default configuration to start a node through ignite.sh, then access the node through jconsole tool, and then you will find that the heap memory usage is increasing. Is this a potential problem?

Ignite AI learning resources

Hi, Can anyone recommend some resources to learn the fundamentals of ML and DL, and how to use these techniques in practical ways with the Apache Ignite AI platform? Thanks, Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/