RE: Specifying location of persistent storage location

2017-09-04 Thread Raymond Wilson
Thanks. I get the utility of specifying the network address to bind to; I’m not convinced using that to derive the name of the internal data store is a good idea! J For instance, what if you have to move a persistent data store to a different server? Or are you saying everybody sets

Re: Specifying location of persistent storage location

2017-09-04 Thread Dmitriy Setrakyan
On Mon, Sep 4, 2017 at 6:07 PM, Raymond Wilson wrote: > Dmitriy, > > > > I set up an XML file based on the default one and added the two elements > you noted. > > > > However, this has brought up an issue in that the XML file and an > IgniteConfiguration instance

RE: Specifying location of persistent storage location

2017-09-04 Thread Raymond Wilson
Dmitriy, I set up an XML file based on the default one and added the two elements you noted. However, this has brought up an issue in that the XML file and an IgniteConfiguration instance can’t both be provided to the Ignition.Start() call. So I changed it to use the DiscoverSPI aspect of

Re: Specifying location of persistent storage location

2017-09-04 Thread Dmitriy Setrakyan
On Mon, Sep 4, 2017 at 4:28 PM, Raymond Wilson wrote: > Hi, > > > > It’s possible this could cause change in the folder name, though I do not > think this is an issue in my case. Below are three different folder names I > have seen. All use the same port number, but

Re: Specifying location of persistent storage location

2017-09-04 Thread Dmitriy Setrakyan
On Mon, Sep 4, 2017 at 3:37 PM, Raymond Wilson wrote: > Hi, > > > > I definitely have not had more than one server node running at the same > time (though there have been more than one client node running on the same > machine). > > > > I suspect what is happening is

RE: Specifying location of persistent storage location

2017-09-04 Thread Raymond Wilson
Hi, I definitely have not had more than one server node running at the same time (though there have been more than one client node running on the same machine). I suspect what is happening is that one or more of the network interfaces on the machine can have their address change dynamically.

Re: Specifying location of persistent storage location

2017-09-04 Thread Dmitriy Setrakyan
Hi Raymond, Sorry for the initial confusion. The consistent ID is the combination of the local IP and port. You DO NOT need to do anything special to configure it. If you had different folders created under the work folder, you probably had more than one node running at the same time. Can you

RE: Specifying location of persistent storage location

2017-09-04 Thread Raymond Wilson
Hi Dmitry, I looked at IgniteConfiguration in the C# client, but it does not have consistentID in its namespace. I pulled the C# client source code and searched in there and was not able to find it. Perhaps this is not exposed in the C# client at all? If that is that case, how would I

Re: Specifying location of persistent storage location

2017-09-04 Thread Dmitry Pavlov
Hi Ramond, Node.Consistent ID by default is the sorted set of local IP addresses and ports. This field value survives during node restart. At the same time consistent ID may be set using IgniteConfiguration.setConsistentId() if you need to specify it manually. I'm not sure how to write in C#

RE: Specifying location of persistent storage location

2017-09-04 Thread Raymond Wilson
… also, the documentation for ClusterNode here ( https://www.gridgain.com/sdk/pe/latest/javadoc/org/apache/ignite/cluster/ClusterNode.html) only describes a getter for the consistent ID, I need to be able to set it. *From:* Raymond Wilson [mailto:raymond_wil...@trimble.com] *Sent:* Tuesday,

Data Page Locking

2017-09-04 Thread John Wilson
Hi, Ignite documentation describes how and when entry-based locks are obtained, both in atomic and transactional atomicity modes. I was wondering why and when locks on data pages are required/requested -- PageMemoryImp.java shows that data pages have 8 bytes reserved for LOCK:

Re: client thread dumps

2017-09-04 Thread Evgenii Zhuravlev
>I am also seeing frequent GC in GC monitor, wondering what it can relate to >that is with CPU spike ? I think these spikes could be related to the GC, yes. But they also could be related to the work that happens on this node. Could you describe how you use this node? Which operation do you

Re: memory increases on heap

2017-09-04 Thread Evgenii Zhuravlev
Hi, answered you here: http://apache-ignite-users.70518.x6.nabble.com/client-thread-dumps-tc16658.html Evgenii 2017-09-04 17:09 GMT+03:00 ignite_user2016 : > Hello Igniters, > > We have 2 instances on ignite ( 2.0) in production, we mostly used ignite > for spring cache.

Re: client thread dumps

2017-09-04 Thread ezhuravlev
Hi, Here is a description of all thread pools: https://apacheignite.readme.io/v2.1/docs/thread-pools You can try to reduce their size, but do it carefully, these changes could lead to performance degradation. If you will never use visor or rest-api you can also set ConnectorConfiguration to

Re: copyOnRead to false

2017-09-04 Thread ezhuravlev
Hi, Could you describe your benchmarks? So we can understand whats could be wrong here. If the value is fetched from a remote node, you will always get a copy. If you get the value locally, you can force Ignite to return the stored instance by setting CacheConfiguration.setCopyOnRead(false)

Re: Quick questions on Evictions

2017-09-04 Thread John Wilson
I appreciate the nice explanation. I got a few more questions: 1. For the case where on-heap caching and persistent are both disabled, why does Ignite throw out out-dated pages from off-heap? Why not throw OOM error since the out-dated pages are not backed by persistent store and

Re: Specifying location of persistent storage location

2017-09-04 Thread Raymond Wilson
Thank you Dmitry! Sent from my iPhone > On 5/09/2017, at 1:12 AM, Dmitry Pavlov wrote: > > Hi Raymond, > > Ignite Persistent Store includes consistentID parameter of cluster node into > folders name. It is required because there is possible that 2 nodes would be >

Re: About Apache Ignite Partitioned Cache

2017-09-04 Thread ezhuravlev
>The backups which is mentioned in the documentation, how do I define which node is the primary node and >which node is the backup node. It defined by Affinity Function, you can read about it here: https://apacheignite.readme.io/docs/affinity-collocation#section-affinity-function >I will have a

Re: Quick questions on Evictions

2017-09-04 Thread Dmitry Karachentsev
Hi, Assume you have disabled onheapCahe and disabled persistence. In that case you may configure only datapage eviction mode, then outdated pages will be thrown away, when no free memory will be available for Ignite. Also you cannot configure per-entry eviction. OK, if you enable

About Apache Ignite Partitioned Cache

2017-09-04 Thread Sabyasachi Biswas
Hi, I am using Apache Ignite 1.9 in the embedded mode, I am using it as an inmemory data grid. I want to use the mode Partitioned Mode cache and I am trying to gather usage information. - The backups which is mentioned in the documentation, how do I define which node is the primary node

Re: client thread dumps

2017-09-04 Thread ignite_user2016
I took a heap dump and it all points to following class - One instance of "org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager" loaded by "sun.misc.Launcher$AppClassLoader @ 0x88003d40" occupies 375,647,072 (83.93%) bytes. The memory is accumulated in one instance of

Re: UPDATE SQL for nested BinaryObject throws exception.

2017-09-04 Thread afedotov
Hi, Actually, flattening the nested properties with aliases works only for one level as for now. Looks like it's a bug. I'll file a JIRA ticket for this. Kind regards, Alex -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: client thread dumps

2017-09-04 Thread ignite_user2016
I am also seeing frequent GC in GC monitor, wondering what it can relate to that is with CPU spike ? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Retrieving multiple keys with filtering

2017-09-04 Thread Semyon Boikov
Yes, read can be executed without acquiring entry lock. But you need take into account that request for cache.get operation can be processed in the same stripe as cache.invoke. Semyon On Mon, Sep 4, 2017 at 6:39 AM, Dmitriy Setrakyan wrote: > Semyon, > > Can you please

client thread dumps

2017-09-04 Thread ignite_user2016
Hello Igniters, curious about client thread dumps, I see so many ignite threads on client side, wondering what are there and how can I reduce the size of threads ? we run ignite 2.0 in production on SB instances. see the attached image for more information.

memory increases on heap

2017-09-04 Thread ignite_user2016
Hello Igniters, We have 2 instances on ignite ( 2.0) in production, we mostly used ignite for spring cache. Seeing so many Ignite threads on client heap dumps, wondering what are these and can we reduce the thread size on client side ? with that can we reduce the memory foot print ? please see

Re: Specifying location of persistent storage location

2017-09-04 Thread Dmitry Pavlov
Hi Raymond, Ignite Persistent Store includes consistentID parameter of cluster node into folders name. It is required because there is possible that 2 nodes would be started at same physical machine. Consistency of using same folder each time is provided by this property,

Re: Apache ignite transaction issue: Failed to enlist entry

2017-09-04 Thread Вячеслав Коптилин
Hi, I tried the following code and it works as expected (without any exceptions) Ignite ignite = Ignition.start(); CacheConfiguration cfg = new CacheConfiguration() .setName("test-transactional-cache") .setAtomicityMode(CacheAtomicityMode.TRANSACTIONAL);

Re: ignit2.1 start h2 debug console error

2017-09-04 Thread ilya.kasnacheev
Hello Lucky, It should be -DIGNITE_H2_DEBUG_CONSOLE=true note the "D" after dash, that means "define property" and the absense of whitespace before equals sign (and anywhere else) which will otherwise split your parameter into two. Hope it helps, Ilya. -- Sent from:

Re: Confused about QueryEntity configuration

2017-09-04 Thread franck102
Hi Val, I am able to use _key sucessfully, that is acceptable. I tried defining an alias, using all combinations of _key/DB name and all orders, and I couldn't get that to work. Looking through the code it seems to me that aliases are only used to map result column names to binary object field

Re: Custom SecurityCredentialsProvider and SecurityCredentials

2017-09-04 Thread franck102
I can implement my own flavor of SecurityCredentialsProvider yes. But the Ignite code will not use it no matter what I do - unless I missed something. Franck -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: SQL query is slow

2017-09-04 Thread Vladimir Ozerov
Hi Mihaela, Index is not used in your case because you specify function-based condition. Usually this is resolved by adding functional index, but Ignite doesn't support it at the moment unfortunately. Is it possible to "materialize" the condition "POSITION ('Z',manufacturerCode)>0" as additional