Re: Does Ignite message support C++?

2019-01-21 Thread Igor Sapego
Yes, thick client always sends requests to the "right" node that actually contains data. Best Regards, Igor On Mon, Jan 21, 2019 at 9:20 AM summasumma wrote: > Thanks Igor. > > One more clarification: > > Does Ignite client perform sharding by itself by selecting the > node/partition across

Re: Failed to wait for partition map exchange on cluster activation

2019-01-21 Thread Ilya Kasnacheev
Hello! It's not a deadlock it's just a (warning) timeout: It is expected that all work is to be done by this moment, but due to slow I/O cluster is still busy. Regards, -- Ilya Kasnacheev сб, 19 янв. 2019 г. в 21:51, Andrey Davydov : > Yes. It seems like safe to use. Seems like some race

Re: about https://github.com/amsokol/ignite-go-client

2019-01-21 Thread Andrey Mashenkov
Hi, Ignite has no module ignite-go-client. Client you mentioned is not maintained by Apache Ignite community. AFAIK, we have no plans to add GO client support for now. Feel free to contribute. Usually, Apache Ignite is released twice a year. The latest version has been released at December

Re: Creating Dataset classNotFound exception

2019-01-21 Thread Ilya Kasnacheev
Hello! - BLAS is not related to Apache Ignite so it is hard to say how it should function, class loading wise. - Yes, sometimes lambda will capture extra scope and sometimes they don't, making them generally unreliable. Regards, -- Ilya Kasnacheev сб, 19 янв. 2019 г. в 00:58, mahesh76private

Re: Search on a composite key

2019-01-21 Thread ihorps
hello to just sum it up here... I've found a page which describes some queering techniques (although it was under indexes section) - https://apacheignite-sql.readme.io/docs/schema-and-indexes. To make it run I needed to annotate my Key class like: public class Key { @QuerySqlField(index =

Re: update Object type value of entry in EntryProcessor within transaction does not work

2019-01-21 Thread Ilya Kasnacheev
Hello! I was able to run your first & second fragments with expected behavior: Entity{id='hello3', value='v3', date=2019-01-21} Note that I'm using 2.7. Regards, -- Ilya Kasnacheev пн, 21 янв. 2019 г. в 08:43, c c : > Hi, > I work on ignite 2.7.0 > > I have a value type as below > >

Ignite with Spring cache

2019-01-21 Thread AndrewV
Hi everyone, I integrated Ignite with my Spring application cache manager. Everything works fine, but I need to implement custom cache revalidation logic. Actually, my question is how to find something in a particular cache using Spring Cache manager? Thank you. -- Sent from:

Re: Ignite 2.7 REST API returning escape characters

2019-01-21 Thread Ilya Kasnacheev
Hello! Can you show an example of such output? Note that Ignite will use JSON, which in turn will escape some characters in strings. Regards, -- Ilya Kasnacheev пн, 21 янв. 2019 г. в 17:04, eric...@outlook.com : > To all, > > I'm using Ignite 2.7 with the REST API enabled. When retrieving

Native persistence and 3rd party persistence on one cluster?

2019-01-21 Thread michal23849
Hi, Can we have 2 sets of caches configured - with 1 set of caches having the native persistence in files and the second set with disabled native persistence with only 3rd party persistence in SQL (using custom CacheStore classes implementation)? If yes - how can this be achieved in

Re: Ignite ML withKeepBinary cache

2019-01-21 Thread Yuriy Babak
Hi all, Ticket 10700 [1] is resolved, this ticked added support of training models over a cache with binary objects(cache with enabled keepBinary flag) for more details please take a look the mentioned ticked or added example [2]. [1] - https://issues.apache.org/jira/browse/IGNITE-10700 [2] -

Re: 3rd party persistence with hive not updating hive with all records/entries in ignite

2019-01-21 Thread Ilya Kasnacheev
Hello! What Cache Store implementation are you using, and which are its settings? Regards, -- Ilya Kasnacheev ср, 16 янв. 2019 г. в 21:43, shivakumar : > Hi > i am trying to use hive as 3rd party persistence store and enabled write > behind and i set these cache configurations using spring

Re: Failed to wait for initial partition map exchange

2019-01-21 Thread Ilya Kasnacheev
Hello! It seems that the only way is making checkpoints more often by decreasing checkpointFrequency value (specified in msec). Smaller WAL - faster startup. Regards, -- Ilya Kasnacheev сб, 19 янв. 2019 г. в 09:42, Justin Ji : > Ilya - > > Thank for your reply. > > Is there any

Ignite 2.7 REST API returning escape characters

2019-01-21 Thread eric...@outlook.com
To all, I'm using Ignite 2.7 with the REST API enabled. When retrieving using the GET method the API returns \ escape characters. Am I doing something wrong with the ADD or am I doing something wrong with the GET? The examples on the Apache Ignite pages don't show any escape characters or

Re: 3rd party persistence with hive not updating hive with all records/entries in ignite

2019-01-21 Thread shivakumar
Hi here is my cache store configuration http://www.springframework.org/schema/beans; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; xmlns:util="http://www.springframework.org/schema/util; xsi:schemaLocation="http://www.springframework.org/schema/beans

Re: update Object type value of entry in EntryProcessor within transaction does not work

2019-01-21 Thread c c
thanks for your reply. i use below configuration for the cache. partitioned, 2 backup, transactional. Do these matter? Ilya Kasnacheev 于2019年1月21日周一 下午7:42写道: > Hello! > > I was able to run your first & second fragments with expected behavior: > > Entity{id='hello3', value='v3',

Re: update Object type value of entry in EntryProcessor within transaction does not work

2019-01-21 Thread Ilya Kasnacheev
Hello! How many nodes in topology? Note that cache protocol usually works irrespective of those things. Regards, -- Ilya Kasnacheev пн, 21 янв. 2019 г. в 15:55, c c : > thanks for your reply. > i use below configuration for the cache. > partitioned, 2 backup, transactional. > Do these

Apache Ignite: not able to cache Dataframe using Python thin client

2019-01-21 Thread Balakumar
Hi,I'm trying to put a *Dataframe *after reading from a Parquet file into Ignite cache, throwing error. I have tried with all kind of Complex object types, no luck.Is it possible to put Dataframe using Python ? is it supported?Is there any better way I can replace Livy with Ignite?Thanks,Bala

Re: Apache Ignite: not able to cache Dataframe using Python thin client

2019-01-21 Thread Stephen Darlington
Can you share some code and the actual errors you’re getting? It’s not entirely clear to me what you’re trying to do? Are you using the new Python thin-client? Or are you using Spark's Python support along with Ignite’s support for DataFrames? And what do you mean by “complex object type”?

Ignite Client getting OOM, GridAffinityProcessor grows in size

2019-01-21 Thread Vincent
Hi, When running for some time handling a constant load of 1.5K or more my application blows up with a OOM. org.apache.ignite.internal.processors.affinity.GridAffinityProcessor is taking up 96+% of memory in my application. It's a client so i do not undrestand why the application accumulates

Re: Native persistence and 3rd party persistence on one cluster?

2019-01-21 Thread Ilya Kasnacheev
Hello! Yes, it is possible. There should be a persistent non-default data region, first cache should have this region specified and no cache store, while second cache should not have this region specified (default one is ok?) but have cache store configured. Straightforward if you ask me.

Re: Ignite 2.7 REST API returning escape characters

2019-01-21 Thread EMCox
Add request: Date →Mon, 21 Jan 2019 16:40:09 GMT Content-Type →application/json;charset=utf-8 Content-Length →124 Server →Jetty(9.4.11.v20180605) POST http://abcdef9d15:8080/ignite?cmd=add=107={"name":"Ceasar"}=default=8b13ac15-f503-4f4a-ab1f-a7fc3ce93596

Re: Ignite 2.7 REST API returning escape characters

2019-01-21 Thread EMCox
Ilya, Thanks for helping me. I am trying to store the JSON as a string using the REST API Add method. For instance, i want to store {"name":"Jamie"} in the cache and when I do a get return the same JSON data structure. Of course, in real life the JSON data structure could be much more complex

Re: Ignite 2.7 REST API returning escape characters

2019-01-21 Thread Glenn Wiebe
Eric, Just to be clear, the full REST response is legitimate and valid JSON, in fact the escape characters around the quotes in the response element (COMPARE REST Response to the Response element INSIDE the REST Response) are there precisely to keep it valid. Unfortunately, what you would like is

Re: Ignite 2.7 REST API returning escape characters

2019-01-21 Thread EMCox
Glenn and Ilya, Can I take this string response and parse it as a JSON object using the Ignite REST API? Or am I forced into a programming language such as C# or Java to perform parse as JSON Object? I'm trying to use the Ignite REST API out of the box and have it return valid JSON. The string

Re: Ignite 2.7 REST API returning escape characters

2019-01-21 Thread Ilya Kasnacheev
Hello! I guess this means you store JSON as String in cache. Is this the case? If you want data to be output as JSON you will have to store it structured (such as with POJOs or Binary Objects). Regards, -- Ilya Kasnacheev пн, 21 янв. 2019 г. в 19:47, EMCox : > Add request: > Date →Mon, 21

Re: Ignite 2.7 REST API returning escape characters

2019-01-21 Thread EMCox
Glenn, I don't want to or need to interogate the JSON being stored. I just need it to be returned as valid JSON. If you try to parse a simple response as i show with the escape characters it will fail JSON validation and does. I just need the dynamic JSON to be valid in the response, stored in

Re: Transactional cache in Atomic mode

2019-01-21 Thread msuh
Hi Mikhail, Thank you for your response. 1) From my testing, a ScanQuery of 1 million entries in an explicit transaction (with PESSIMISTIC, SERIALIZABLE) took 10 minutes single-threaded, whereas implicit transaction took 1 minute with the same environment and single-threaded. If we assume that

Re: Ignite 2.7 REST API returning escape characters

2019-01-21 Thread Glenn Wiebe
On the topic of the actual return, if you look at the documentation, I believe the Cache Get returns a single level JSON structure that includes a simple string "existing value" as below: Get and put Get and put command stores

Re: Ignite 2.7 REST API returning escape characters

2019-01-21 Thread Ilya Kasnacheev
Hello again! You will also have to supply an interceptor to do this transformation. Ignite doesn't have native support for JSON so this step is necessary. Regards, -- Ilya

Re: Ignite 2.7 REST API returning escape characters

2019-01-21 Thread Glenn Wiebe
Eric, I might be misunderstand you, but the example you provided is: A full REST/HTTP response which has request and response payloads, and the response itself should have three constituent parts: - Start Line, - Headers, and - Body Now, I cannot see your actual output and it is client

Re: Ignite ML withKeepBinary cache

2019-01-21 Thread otorreno
Thanks Ilya, I got the link to the JIRA ticket in the Ignite Devs mailing list. In fact I already included a comment in the ticket. I got a response from Alexey Zinoviev in the Dev list too, and I am now waiting to receive a further update from him on this matter. Regards, -- Sent from: