Re: Affinity Key column to be always part of the Primary Key

Hi Stan If I do not have the affinity key column as part of the primary key, it does not allow me to create the table itself. If I want to execute a join query on both the tables, I had to use affinity key to collocate the data select p.party_id, a.party_id, first_name, A.SERVICE_ID_LIST from

Re: .Net ICacheEntryFilter

I see during filtration next callstack If we open UnmanagedCallbacks we will see next: I see the reference to _ignite instance are valid here but it is

Re: Ignite Expiry Inconsistency with Native Persistence

Hi, I'm not sure I understand what high watermark for persistence mean. Could you please explain? пн, 12 мар. 2018 г. в 19:43, Subash Chaturanga : > Thank you very much for the responses. > > Will keep an eye on when it will be released. Any estimated release for > the fix ? > > One more question

Re: Disk Persistence Performance

Thanks Stanislav. I didnt know we could define multiple data regions and attach them to different cache region. Can you give a short an example for it or perhaps link for Document/blog which does the same ? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Topic based messaging

With Regards to "Topic Based Messaging" mentioned in official doc here https://apacheignite.readme.io/docs/messaging Can it be a distributed alternative to Apache Kafka ? Can it have extra backup copies ? Can it use disk persistence with extra backup copies on another node just like tables ?

Documentation Ignite 2.3.0

Something I noticed when going through the java doc which is slightly incorrect: https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/IgniteSystemProperties.html#IGNITE_LOCAL_HOST IGNITE_LOCAL_HOST public static final String IGNITE_LOCAL_HOST Name of system property to set system-w

POSIX compliant NFS storage

Is Apache ignite tested with any POSIX compliant Network File System Storage ? For example, AWS has EFS: https://docs.aws.amazon.com/efs/latest/ug/whatisefs.html If we mount NFS disk for each node in Ignite cluster, will data have to be replicated or we can have single copy on NFS ? -- Sent fr

Forcing indexes on heap

How can we configure Ignite to force indexes on heap (for performance) as well as on disk(for reliability) Also when JVM process crash and restarted again can we fill on heap storage with indexes again from disk ? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Graph Query Integration

Apache Ignite has SQL layer using H2 parser. is there any library which facilitates Graph Layer over Ignite's KV store. For example in java community we have Gremlin and Tinkerpop. Is the integration of such libraries exist or planned in future ? -- Sent from: http://apache-ignite-users.70518.

Re: Forcing indexes on heap

With native persistence turned on data and index will be saved on disk, and with native persistence enabled it will be reloaded on startup when needed, but if you use some 3rd party persistence you may have some hickups if you try to use it together with native persistence (normally index is no

Re: Forcing indexes on heap

Thanks Mikael. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Custom aggregate SQL function

https://apacheignite-sql.readme.io/docs/custom-sql-functions We can define the custom sql function as mentioned in the doc. Is it possible to define custom aggregate function ? An example would be great if possible. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Graph Query Integration

Hi, Ignite supports geo-spatial indices. Is it what you a looking for? However, geo-spatial indices are not persistent for now. Here is a ticket for this [1]. [1] https://issues.apache.org/jira/browse/IGNITE-5891 On Tue, Mar 13, 2018 at 2:22 PM, piyush wrote: > Apache Ignite has SQL layer us

Re: Graph Query Integration

Thanks Andrew. Yes for my project I need both. Geo Spatial and Graph querying capability. By graph query capability i mean something like OpenCypher or Gremlin which are based Graph Theory Ref: https://www.youtube.com/watch?v=t9pJJhzZKOE https://www.opencypher.org https://en.wikipedia.org/wiki/Gra

Re: Graph Query Integration

Not exactly sure if this is planned. However using a key value store as a graph storage should be avoided (it will not perform, because graph structures need to be stored differently) Why not use a graph database ? The best performance you get by using the right data structure for the right pr

Re: Graph Query Integration

Native Graph Db like Neo4J etc. are not distributed. All distributed Graph DBs like DGraph (with Badger), JanusGraph (with Cassandra/HBase) are all based on Key Value Database for a good reason that its a Key Value structure which provides best scaling Capabilities. I would go to the extent saying

Re: Understanding data store and partitioning

Hi, 1) How does one know that cache pre-loading is already in process and now its time to call localLoadCache? 2) When a cache on all existing nodes is pre-loaded with all the data and if any new nodes joins a cluster then only some partitions are moved to newly joined node as a part of data reba

Re: storing blob from 1 mb to 1 gb in apache ignite as persistent cache

Hi, I don't see any limitations from Ignite point of view, I think it will fit your requirements. However if were you, I would build some sample app to check this. So if you will do this, my advice is to deliver code to data and do processing locally: https://apacheignite.readme.io/docs/jcache#en

Re: Node failed to join cluster with error related to : Memory configuration mismatch (fix configuration or set -DIGNITE_SKIP_CONFIGURATION_CONSISTENCY_CHECK=true system property) [rmtNodeId=47e76683-

Hi Try to explicitly configure page size in your memPolicy/DataRegion configuration: https://apacheignite.readme.io/docs/memory-configuration you need to set it to 2k to make it work with your data. thanks, Mike. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Custom aggregate SQL function

Hi, No, custom aggregation functions are not supported. Thanks, Mike. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Custom aggregate SQL function

Hi again, I found a ticket for this feature: https://issues.apache.org/jira/browse/IGNITE-2177 could you please re-open it with a description of your use case? Thanks, Mike. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Liquibase with Ignite?

Is anyone using Liquibase with Apache Ignite native SQL persistence? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Partition Id for a Data key in case of data colocation

Hi, With affinity key ignite locates the partition and from partition it locates the node using partition to node mapping. Now in this partition (I believe that partition is nothing but a Map like data structure) to store the data in appropriate bucket ignite must be using some thing apart from af

Re: Ignite Expiry Inconsistency with Native Persistence

I mean, for example; we provide max value 500MB for durable memory under eviction policy, that will make sure Ignite will only use 500MB from the RAM no matter what. When native persistence comes into the picture, Ignite store entries in disk. So if we run on production, we want to make sure we don

Re: Ignite Expiry Inconsistency with Native Persistence

Thank you for explanation. Currently Ignite does not have any settings which allow to limit used disk space in persistent storage. вт, 13 мар. 2018 г. в 21:06, Subash Chaturanga : > I mean, for example; we provide max value 500MB for durable memory under > eviction policy, that will make sure Ign

Parallel execution in replicated mode

My understanding is that parallel execution (on multiple nodes) only happens when in partitioned mode. >From a performance point of view it would be nice if queries running on fully replicated records can be, optionally, executed by all nodes to improve performance. Basically the query could be s

Re: Ignite Expiry Inconsistency with Native Persistence

I was actually not correct here. Although there are some known issues, expiration is supposed to work with both memory and persistence. Subash, can you provide more details on how you reproduce the issue? I'm getting null even after I restart the node. Are you doing anything else there? -Val -

Error while Ignite integration with Tableau

Hi Am using Ignite 2.3, trying to integrate with Tableau, getting this error while adding below ODBC details to the Ignite confg error I am getting class org.apache.ignite.IgniteException: Failed to instantiate Spring XML application context [