Re: Are stored in apache ignite cache in random order

Hello, Ignite can be thought as any other db where sequence of write doesn't guarantee sequence of read. In case of querying data via sql, you can make sure data is returned in sequence by using order by query of particular column. In Ignite cache, data is stored across partition and which

Re: Help with possible advanced Ignite questions during a meetup

Dear Denis, Does that mean only "open source/community" version of webconsole will be discontinued? Thanks, Gaurav On Wed, May 27, 2020, 10:32 AM Denis Magda wrote: > Hi Zaar, > > Congratulations and thanks for spreading the word about Ignite in > Australia! I truly liked the style and flow

Re: Ignite native persistence

Please send exception/error message you are getting and the query you are trying to execute. On Tue, Nov 26, 2019, 8:04 PM niamin wrote: > I found what I was doing wrong. I can now load/pre-fetch from 3rd party > store > to cache. It looks like the data is present in in-memory cache but also >

Re: Partition loss due to node segmentation

Hello Akash, Yes of course. As cluster is segmented, it is very well possible that cluster segment doesn't have all partitions in that segment. If you have backup partitions in the same segment, then only you have complete partitions. Best Regards, Gaurav On Wed, Oct 9, 2019 at 7:20 AM Akash

Re: Re: Can Ignite transaction manage cached and non-cached data writes?

Hello Uwe, Why don't you create separate cache corresponding to each table in rdbms? Best Regards, Gaurav On Tue, Sep 3, 2019, 8:31 PM Uwe Geercken wrote: > > Hello, > > my first post here for Apache Ignite... > > I have a question and looking for some advice. I have data from a > relational

Re: Ignite Data streamer optimization

I agree with Ilya, That's the silver bullet may be :) On Fri, Dec 28, 2018 at 3:16 PM Ilya Kasnacheev wrote: > Hello! > > Maybe times have changed but it used to be that the best optimization was > to feed DataStreamer's addData() from multiple threads in parallel. > > Can you try that? > >

Re: Article about Ignite Caching

Thanks Denis !! On Sun 6 Jan, 2019, 2:41 AM Denis Magda, wrote: > Gaurav, thanks for spreading the word! Keep up the good work! > > -- > Denis > > On Sat, Jan 5, 2019 at 3:16 AM Gaurav Bajaj > wrote: > >> Hello Igniters, >> >> I have wr

Article about Ignite Caching

Hello Igniters, I have written my first article about Apache Ignite. It is introductory article about basics of creating caches. Please find below the link : “Introduction to Distributed Caching using Apache Ignite”

Re: Snapshotting and Restore in Ignite

Hello, If cache backups are zero, ofcourse there will be data loss when node is removed from BLT. Number of replicas (assuming you mean number of backups) depends upon how resilient you want your cluster to be but ofcourse having more replicas can affect cache write performance. Best, Gaurav

Re: Setting performance expectations

It means ehCache is better than ignite performance atleast in LOCAL mode :) On 22-Sep-2018 3:33 AM, "Daryl Stultz" wrote: > I've discovered that "partitioned" is the default Cache Mode. I set it to > "local". Things run faster now. Still not as fast as expected. > > 2018-09-21 20:54:41.733

Re: SQL query and Indexes architecture

Hello, Please find below link to SQL documentation : https://apacheignite-sql.readme.io/docs/overview You will find answers to most of your queries here. 1. H2 is only used as SQL query parsing engine and for generating execution plans. Data was/is always stored in Caches. 3. All kind of

Re: Backup failover with persistence

Hello, After step 4 above, Ignite will detect that original primary Node A is up, so all the updates happened while Node A was down will be applied to Node A so thay it is latest and it will marked as Primary again. Till the time this process is completed, Node B will still be considered as

Re: Handling split brain with Zookeeper and persistence

Hello, For second question above, you can have listener to listen AFTER_NODE_STOP event and take action as per your logic (in your case changing BLT). Regards, Gaurav On 14-Sep-2018 9:33 PM, "eugene miretsky" wrote: Hi, What are best practices for handling split brain with persistence? 1)

Re: Ignite Thin Client Continuous Query

Guys, Just wondering how does webconsole receievs updates from server continuously? Regards, Gaurav On 11-Sep-2018 10:31 PM, "Valentin Kulichenko" < valentin.kuliche...@gmail.com> wrote: > Igor, > > I just think that we're dealing with a trade off here, and that if we > implement CQ for thin

Re: POC with DataStreamer (Kafka or Ignite - security question)

Also I don't think ignite provides any kind encryption for these db files. Best Regards, Gaurav On 06-Apr-2018 8:23 PM, "David Harvey" wrote: > Assuming Ignite Persistence, you can create a cache in a specific Data > Regions, but I'm unclear whether this properties can be

Re: Usage of DataStreamer for bulk loading

Hi Naveen, In our case biggest performance gain happened when we started adding data to IgniteStreamer in parallel. Earlier we are doing : entryMapToBeStreamed.entrySet().*stream*().forEach(dataStreamer::addData); Perf improved tremendously when we did something like this :

RE: Is backup copy always stored on different host - is it host-awarereplication

Hi Naveen, Also there is a way you control on which exact host backup be will be created using Backupfilter :

Re: Partition eviction failed, this can cause grid hang. (Caused by: java.lang.IllegalStateException: Failed to get page IO instance (page content is corrupted))

alchuk mobile: +375 (29) 666-16-16 <+375%2029%20666-16-16> ​LinkedIn Profile <http://www.linkedin.com/in/arsenykovalchuk/en>​ On 16 March 2018 at 22:40, Gaurav Bajaj <gauravhba...@gmail.com> wrote: > Hi, > > We also got exact same error. Ours is setup without kubernetes

Re: Partition eviction failed, this can cause grid hang. (Caused by: java.lang.IllegalStateException: Failed to get page IO instance (page content is corrupted))

Hi, We also got exact same error. Ours is setup without kubernetes. We are using ignite data streamer to put data into caches. After streaming aroung 500k records streamer failed with exception mentioned in original email. Thanks, Gaurav On 16-Mar-2018 4:44 PM, "Arseny Kovalchuk"

Re: Usage of DataStreamer for bulk loading

Hi Naveen, I had similar situation. Two things you can do : 1. Decouple file reading from cache streaming, so that both can be handled in separate threads asynchronously. 2. Once you have data from csv in collection, use use parallelStreams to add data in streamer with multiple threads. Thanks,

Re: AffinityKey question

Hi, You have to alwaya use affinity key to access the Cache for any get, put, remove operation you do. Key should be exactly same as you used to put value else it won't be able to find it. Thanks, Gaurav On 26-Nov-2017 3:19 PM, "Mikael" wrote: Hi! If I do a

Re: Ignite Web Console login?

Hi, I was able successfully create account using docker image itself. Haven't faced any issue. Yes you are right, there is no documentation regarding account creation. Thanks, Gaurav On Oct 7, 2017 6:12 PM, "Pim D" wrote: > Hi, > > Unfortunately, creating a new account

Re: REST API should be exposed on https

Check below thread : *http://apache-ignite-users.70518.x6.nabble.com/REST-API-authentication-td11299.html * On Wed, Oct 11, 2017 at 8:04 AM, Ankit Singhai wrote: > Any inputs ? > > > > --

Re: Ignite Web Console login?

No it doesn't need outbound connection. Not sure why you get authorization exception but similar thing worked for me. I too have standalone setup. Once registration is done, i think secret token is generated which needs to be added in default config file. On Oct 5, 2017 2:59 PM, "Pim D"

Re: Very low performance

Hello Dmitry, Try using data streamer to add data in cache using parallel threads. It will give huge performance boost. Also make sure you understand walSetting=BACKGROUND implications before relaying on it. Thanks, Gaurav On Wed, Oct 4, 2017 at 3:43 PM, Dmitry Pryakhin

Re: Cache size in Memory

Adding to the same question, can I see the off heap memory usage in Visor or Web console? I see on-heap memory size in Web console. On Tue, Oct 3, 2017 at 8:28 AM, Alexey Kuznetsov wrote: > Hi, > > Take a look at documentation: https://apacheignite.readme.io/docs/ >

Re: Write behind and eventual consistency

Any updates on the two use cases mentioned above? On Apr 27, 2017 10:53 AM, "Gaurav Bajaj" <gauravhba...@gmail.com> wrote: > Hi Val, > > Our use case : > > 1. Read records from file > 2. Do computations on each record > 3. Put them in the cache and persiste

Re: Write behind and eventual consistency

Hi Val, Our use case : 1. Read records from file 2. Do computations on each record 3. Put them in the cache and persistence using write behind. 4. When all the records from file are processed, updated in Cache and also persisted to DB, we want to trigger some other process which will do next

Re: Node hangs while accessing cache from Compute Task

Hi Dmitry, Thanks for the detailed explanation. Do you know if this behavior "It's not allowed to use cache API in CacheEntryProcessor, query listeners, interceptors and so forth, because it leads to deadlocks" is documented somewhere? Thanks, Gaurav On Thu, Feb 16, 2017 at 12:16 PM,

Re: Jetty configuration for adding new Handler

Hello Andrey/Saurabh, I could get it working with following additions in the jetty configuration : / Access-Control-Allow-Origin * / Access-Control-Allow-Methods GET,POST Basically had to add "Access-Control-Allow-Methods" too. Thanks, Gaurav On Mon, Jan 23,

Max limit for Jobs submission to Compute task

Hello, I was going through various documentation and example of Compute Task to find out if there is any limit to number Jobs which can be submitted to the Compute task? My use case is, I have 200,000 Jobs which I want to submit and do the aggregation (reduce) on the result of the Job execution.

Put Vs Datastreamer

Hi, I was using below initially to populate 200,000 records in data grid. Then I switched to IgniteDataStreamer (snippet 2) but didn't see performance improvement, in both cases it was around 12 secs. Am I missing something here? Snippet 1: for (Employee emp: emps) {

Re: Error with ignite-rest-http

Hi, Update : I checked and it libs/connector-layer is not standard ignite folder. It was created for something internal. So basically it was Jetty Server version mismatch. Thanks Nikolai and dkarachentsev for your help. Regards, Gaurav On Tue, Jan 3, 2017 at 1:47 PM, Gaurav Bajaj <gaurav

Re: Error with ignite-rest-http

dependency in your > project but running it how standalone server. Could you please show which > modules in your C:\Users\D-NX29AE\Project\Software\shielding-gridgain- > enterprise-fabric-7.5.26\libs folder? (output dir commond in console) > > On Tue, Jan 3, 2017 at 3:34 PM, G

Re: Error with ignite-rest-http

Hello Nikolai, Sorry I am confused, where do I run this command? On my IntelliJ workspace? On Tue, Jan 3, 2017 at 1:22 PM, Nikolai Tikhonov wrote: > Hi, > > It's really like on jar hell. You can use maven dependency tree which > allows to find conflict: > > *mvn

Re: Error with ignite-rest-http

Hi, Thanks for quick reply. I don't have IGNITE_HOME setup in my environment variables. Please not I am using ignite.bat to start IGNITE instance. I am using Windows 7. Also I don't have another Jetty instance which I have installed or configured. On Tue, Jan 3, 2017 at 12:30 PM, dkarachentsev

Re: Querying over fields in the object inside Cache value

Perfect Thanks for prompt reply. On Wed, Dec 7, 2016 at 10:32 AM, Sergi Vladykin <sergi.vlady...@gmail.com> wrote: > Yes, in QueryEntity you have to define it using a dot notation. > > Sergi > > 2016-12-07 12:22 GMT+03:00 Gaurav Bajaj <gauravhba...@gmail.com>: > >

Re: Querying over fields in the object inside Cache value

possible. > > If you have QuerySqlField annotation on Employee.address and the same > annotation on Address.city, then the field CITY must be available for SQL > queries. > > Sergi > > 2016-12-07 11:04 GMT+03:00 Gaurav Bajaj <gauravhba...@gmail.com>: > >> Hi, >

Querying over fields in the object inside Cache value

Hi, Is is possible to query (Scan, Sql etc) cache on the fields inside object in the Cache value? For example : Employee has a Address Address has fields like Street, Zip code, City Cache Key : Emp Id Cache Value : Employee Is it possible to Index or Query on field "City" in the above