Re: Query search performance and scalability

Here's the cache configuration. We were expecting to see positive scalability. What would be reasons to prevent from that? Btw, the cache has 300K entries in total. Thank you!

Re: OOME on 2-node cluster with visor running repeatedly, Ignite 1.9

"nc - Total number of nodes in the grid" count server + client nodes. I can't find metrics for server nodes. I tried to check the heap dump in "mat" and found a large size of TcpCommunicationSpi#recoveryDescs. Does anyone have an idea why this happened? -- View this message in context:

Re: OOME on 2-node cluster with visor running repeatedly, Ignite 1.9

Thanks Andrey, is there an option to monitor the number of server nodes in the grid? I found "nc - Total number of nodes in the grid.", seems counting server + client nodes, correct? -- View this message in context:

Re: OOME on 2-node cluster with visor running repeatedly, Ignite 1.9

Thank Evgenii! By running the `${IGNITE_HOME}/bin/ignitevisorcmd.sh -e="'open -cpath=${IGNITE_HOME}/config/default-config.xml;node'"`, it shows "Ignite node stopped OK" at the end. Is it an indicator of visor stopped properly? We use the visor output to check the number of Ignite servers

Re: CacheStore's Performance Drops Dramatically - Why?

Thank you for opening the ticket. On Thu, May 4, 2017 at 4:43 PM, Denis Magda wrote: > Looks like the naming of ‘getWriteBehindFlushSize’ method is totally > wrong. It confuses so many people. However, if we refer to the > documentation of this method or look into the source

Cache Node Concept

Hi, Can we refer a cache instance running on a Ignite server as a node or cache node ? Say, a cache is distributed over various Ignite servers, so can we call each instance in a server as node or cache node ? Regards Abhishek

Re: Volatile Kubernetes Node Discovery

Hi, This seems to be a networking related issue. The Kubernetes IP finder did his job pretty well - all the nodes could share assigned IP addresses with each other and form a cluster by connecting via 47500 port properly defined in your config. But right after that the nodes attempted to

Re: what does remaps mean in DataStreamerImpl.java

Hi, I have see that your grid suffer from long running operations: [19:20:19,285][WARNING][grid-timeout-worker-#63%null%][GridCachePartitionExchangeManager] Found long running cache future [startTime=19:18:55.302, curTime=19:20:19.280, fut=GridDhtAtomicSingleUpdateFuture

Re: CacheStore's Performance Drops Dramatically - Why?

Looks like the naming of ‘getWriteBehindFlushSize’ method is totally wrong. It confuses so many people. However, if we refer to the documentation of this method or look into the source code we will find out that it sets the maximum size of the write-behind queue/buffer on a single node. Once

Re: Write behind and eventual consistency

If it's this kind of batch processing, and if you're still waiting for a batch to be processed completely before the next one can be processed, why do you want to use write-behind? What is wrong with sync write-through in this case? -Val -- View this message in context:

Re: Ignite TLS with TrustStore

Hi, You have to set either trustManagers or trustStoreFilePath. Do you see any other errors on node start? Can Ignite find trustStore? Does trustStore contains Root cert and all CA certificates, so certificate path validation can be performed? Store with root certificates locates in

Re: Network Discovery inside docker containers

Hi, Yes, addressResolver should be helpful, but seems, there is a bug [1] [1] https://issues.apache.org/jira/browse/IGNITE-5117 On Thu, Apr 27, 2017 at 10:15 AM, Lukas Lentner wrote: > Ok, > > > > I heard from chat that I should use an https://ignite.apache.org/ >

Re: Nodes hanging when accessing queue

Hi, 1. Yes, adding backups for datastructures cache (via AtomicConfiguration) shoud help. 2. Seems, one or more of your nodes register with ipv6 address. Try to use JVM option for all nodes: either -Djava.net.preferIPv4Stack=true or -Djava.net.preferIPv6Stack=true. On Tue, May 2, 2017 at 5:17

Re: Combined off heap size?

Hi, 1. Ignite will throw GridOffHeapOutOfMemoryException if you try to allocate more than 10G, and will remove entries from cache if it number exceeds 10k (according to eviction policy). If you want Ignite remove entries when its occupy more than 10G, then you need to configure eviction policy

Re: embedded mode vs standalone mode

In this case you need to use standalone mode. In first job you need to store data to IgniteRDD by IgniteRDD#saveValues. In second job you shoud create RDD from the same cache and result of first job will be avaliable threre. On Mon, May 1, 2017 at 1:33 PM, Nikolai Tikhonov

Re: Query search performance and scalability

Alex, thanks for reply. The query is fairly simple, colA =? colA is String. For 1 server 1 client scenario, they are the same server. For 2 server 1 client scenario, one server and client are on one server, the other server node is on another server. Working on a simplified code to reproduce the

Re: HDP, Hive + Ignite

Hi, Alena, 3. Looks like we have an answer why the initial topology version is so high: you possibly do not restart the Visor process, is that true? If so, please start next experiment with all nodes stopped, as well as the Visor process . After that initial topology version should start with 1,

Re: Binary serialization with multiple classloaders

Hi Sergei, I have a similar use-case and as you've noticed you can write to the cache just fine, but reading throws a ClassNotFoundException. At the moment you have to switch to binary mode for the cache in order to do reads and then do the deserialization directly. I started a thread on this

Re: What is the mechanism of Ignite distributed messaging?

For this Ignite uses semaphore. You can configure count of permits by TcpCommunicationSpi#setMessageQueueLimit. On Tue, May 2, 2017 at 4:53 AM, ght230 wrote: > I understand that this mechanism is similar to Kafka. > > Is there alse a place to keep the messages that have been

Re: Lots of cache creation become slow

Well, that was a new design assumption for the architecture of our PoC. At the beginning, we wanted some "multi-tenant" caches with 1 continuous query for each. Then, we've tried to switch with one cache and 1 continous query for each key. But, you're right. We have already started to challenge

Re: Failed to send datagram message to remote node

Michaell, Yes, sure. This is right place. ;) Did this problem gone when you disable firewall? On Tue, May 2, 2017 at 9:06 PM, Nikolai Tikhonov wrote: > Hi, > > Seems that you did correct rules. Did you try disable firewall, is it > works? Can you check the ports by iperf?

Re: Resource Injection in .NET

There is no peer class loading in .NET (yet). I'm working on this feature right now, hopefully it will be released in 2.1: https://issues.apache.org/jira/browse/IGNITE-2492 On Thu, May 4, 2017 at 4:35 PM, Humphrey wrote: > Thanks. > > I can't seem to find the

Re: Resource Injection in .NET

Thanks. I can't seem to find the PeerClassLoading method in IgniteConfiguration. Is there one? Humphrey -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Resource-Injection-in-NET-tp12420p12424.html Sent from the Apache Ignite Users mailing list archive at

Re: Resource Injection in .NET

Alternatively, you can just call Ignition.GetIgnite(). On Thu, May 4, 2017 at 4:27 PM, Pavel Tupitsyn wrote: > It is similar to Java, use [InstanceResource] attribute: > > class MyJob : IComputeJob > { > [InstanceResource] private IIgnite _ignite; > >

Re: Resource Injection in .NET

It is similar to Java, use [InstanceResource] attribute: class MyJob : IComputeJob { [InstanceResource] private IIgnite _ignite; public object Execute() { Console.WriteLine(_ignite.Name); ... } } On Thu, May 4,

Re: getting a basic error while running ignite

Caused by: java.lang.ClassNotFoundException: test.ignite.BasicTask The ignite server started with bin/ignite.sh doesn't have the BasicTask class on it's classpath. If you disable peerclassloading it won't work. See:

Resource Injection in .NET

This question is related to .NET with C#. I have a class that implements IComputeJob, which prints out a line in the console. How can I inlcude the IgniteInstanceName in the Console.WriteLine method? I know in Java you can inject the Ignite instace in the method, but I don't know how I should do

Re: HDP, Hive + Ignite

Hi Ivan, 1. Need more time for experiments... 3. Yes, logs are full. I started every node with this command: $IGNITE_HOME/bin/ignite.sh -v -J"-Xms10g -Xmx10g -XX:MaxMetaspaceSize=4g" 2>&1 | tee /home/ignite/apache-ignite-hadoop-1.9.0-bin/work/log/ignite-node-dnX.log I thought ver=72

getting a basic error while running ignite

Hi, I am trying to run ignite server from the command line and client from the java code(the way it would happen for us). So, ignite server is started by bin/ignite.sh The Java code for the client is package test.ignite; import org.apache.ignite.Ignite; import

Re: OOME on 2-node cluster with visor running repeatedly, Ignite 1.9

Hi tysli2016, You can run connected to cluster visorcmd in background and register an alert. When this alert is triggered, it may call custom user script. More info can be found here: https://apacheignite-tools.readme.io/docs/alerts-configuration -- View this message in context:

Re: OOME on 2-node cluster with visor running repeatedly, Ignite 1.9

Hi, As i see, you run visor in internal mode, so, it creates a node each time. Are you sure that you stop them properly? Why do you need to start new visor each time? Just use already started visor. Evgenii 2017-05-04 11:57 GMT+03:00 tysli2016 : > Got

Re: Apache Flink meets Apache Ignite next week in London

Is it going to be live streamed or maybe recorded to see later? > On May 4, 2017, at 06:01, Christos Erotocritou wrote: > > Hello Igniters of London, > > I know this has be shared already, the fellas at Apache Flink will be hosting > us this coming Wednesday, 10th of

Re: what does remaps mean in DataStreamerImpl.java

Hi, I have attached log file for one ignite node ignite-b6321e0a.zip Thanks -- View this message in context:

Re: Continuous Query remote listener misses some events or respond really late

Can you share you log files? 2017-05-03 19:05 GMT+07:00 begineer : > 1) How you use ContinuousQuery: with initialQuery or without? : with > initial > query having same predicate > 2) Did some nodes disconnect when you loose updates? no > 3) Did you log entries in

Re: HDP, Hive + Ignite

Alena, I suppose, incorrect results in your environment may be a consequence of topology troubles. In any way, to have some stable and reproducible results you need to have stable Ignite cluster topology. To achieve that I would recommend the following steps: 1) kill all the Ignite processes on

Re: Grid is in invalid state to perform this operation

Sam, Please attach logs from your node. -Dmitry -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Grid-is-in-invalid-state-to-perform-this-operation-tp12360p12411.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Apache Flink meets Apache Ignite next week in London

Hello Igniters of London, I know this has be shared already, the fellas at Apache Flink will be hosting us this coming Wednesday, 10th of May, where we will dive into Ignite/Flink Integration. Speaker Bio: Akmal B. Chaudhri is a Technical Evangelist for GridGain, specializing in Big Data,

OOME on 2-node cluster with visor running repeatedly, Ignite 1.9

Got "OutOfMemoryError: Java heap space" with 2-node cluster with a `visor` running repeatedly. The server nodes are running on CentOS 7 inside Oracle VirtualBox VM with the same config: - 2 vCPUs - 3.5GB memory - Oracle JDK 2.8.0_121 `default-config.xml` was modified to use non-default multicast

Binary serialization with multiple classloaders

Hi! I have a pluggable system where every plugin has its own classloader. I want to save an object to the cache, and this object contains some other objects from other classloaders. Right now it fails with ClassNotFoundException during unwrapBinary -> doReadObject -> IgniteUtils.forName Is it

Re: Query search performance and scalability

That should be because of the overhead of network roundtrips between the client and the servers. Are servers and client located on the same physical machine? Please provide the query and cache config. Kind regards, Alex 4 мая 2017 г. 3:36 AM пользователь "waterg [via Apache Ignite Users]" <