Questions about H2 / Calcite limitations

Hello, I encountered some errors while trying to build an SQL request and I would appreciate your input on it. Using H2 engine, I tried to have a subquery inside a subquery and there is an exception about unique alias being null. Something like: select ... from ( select ... from ( select ...

Re: Apache Ignite 3.0 Questions

of great engineers that improve and support > Ignite 2. Support of Ignite 2 will not be terminated in the foreseeable > future. > > On Fri, May 26, 2023 at 1:04 PM David Bucek wrote: > >> Hello, >> >> we are considering to use Apache Ignite for our softwar

Re: Apache Ignite 3.0 Questions

; > we are considering to use Apache Ignite for our software and we have > couple of questions: > > 1) When will Apache Ignite 3.0 be the stable version? > 2) What is the end of life matrix or end of support of 2.0? > 3) Will the 3.0 version still be embeddable to the Java applicatio

Fwd: Apache Ignite 3.0 Questions

Hello, we are considering to use Apache Ignite for our software and we have couple of questions: 1) When will Apache Ignite 3.0 be the stable version? 2) What is the end of life matrix or end of support of 2.0? 3) Will the 3.0 version still be embeddable to the Java application? (very useful

Re: Please help: several questions for Ignite

‌That clarity some questions for me too. thanks.   De : "Pavel Tupitsyn" A : "user" Envoyé: mercredi 1 Décembre 2021 21:05 Objet : Re: Please help: several questions for Ignite   Hi Jon,   #1 Probably yes, K/V and SQL are among the most used features.      Yes, Ignite

Re: Please help: several questions for Ignite

. > I have several questions that: > > #1, Is the most used feature of Ignite the distributed K/V storage? Can I > treat it as the distributed Redis? > #2, It says it supports streaming, distributed computing, ML Lib. Are they > affected by Apache Spark? Are these three features production

Please help: several questions for Ignite

Hi community Today I spent a whole day reading the docs: https://ignite.apache.org/docs/latest/ This is a well-written documentation for Ignite, thanks for the work. I have several questions that: #1, Is the most used feature of Ignite the distributed K/V storage? Can I treat

Re: Questions about baseline auto-just

Hi, It looks like baseline topology auto-adjustment is in process. Did you checked cluster state later? Also to track auto-adjustment events please check your logs for messages like: Baseline auto-adjust will be executed right now ... Baseline auto-adjust will be executed in ... Baseline

Re[2]: Questions related to check pointing

n appears >>>>>to be 0.1 (10%), via this entry in GridCacheDatabaseSharedManager.java: >>>>>  >>>>>/** >>>>> * Threshold to calculate limit for pages list on-heap caches. >>>>> *  >>>>> * Note

Re: Questions related to check pointing

cached page list buckets, > > * assuming that checkpoint will be triggered if no more then 3/4 of > pages will be marked as dirty (there will be > > * at least 1/4 of clean pages) and each cached page list bucket can be > stored to up to 2 pages (this value is not > > * stati

Re: Questions related to check pointing

t;Zhenya Stanilovsky" < arzamas...@mail.ru >> >Cc: >Subject: Re: Re[4]: Questions related to check pointing >Date: Thu, 31 Dec 2020 01:46:20 +0300 >  >Hi Zhenya, >  >The matching checkpoint finished log is this: >  >2020-12-15 19:07:39,253 [106] INF [MutableCa

Re: Re[4]: Questions related to check pointing

ulate limit for pages list on-heap caches. >>>> * >>>> >>>> * Note: When a checkpoint is triggered, we need some amount of page >>>> memory to store pages list on-heap cache. >>>> >>>> * If a checkpoint is trigge

Re: Re[4]: Questions related to check pointing

al amount of cached page list buckets, >>> >>> * assuming that checkpoint will be triggered if no more then 3/4 of >>> pages will be marked as dirty (there will be >>> >>> * at least 1/4 of clean pages) and each cached page

Re: Re[4]: Questions related to check pointing

ming that checkpoint will be triggered if no more then 3/4 of >> pages will be marked as dirty (there will be >> >> * at least 1/4 of clean pages) and each cached page list bucket can be >> stored to up to 2 pages (this value is not >> >> * static,

Re: Re[4]: Questions related to check pointing

s value is not > > * static, but depends on PagesCache.MAX_SIZE, so if PagesCache.MAX_SIZE > > PagesListNodeIO#getCapacity it can take > > * more than 2 pages). Also some amount of page memory needed to store > page list metadata. > */ > private

Re: Re[4]: Questions related to check pointing

not > > * static, but depends on PagesCache.MAX_SIZE, so if PagesCache.MAX_SIZE > > PagesListNodeIO#getCapacity it can take > > * more than 2 pages). Also some amount of page memory needed to store > page list metadata. > */ > private static final doubl

Re[4]: Questions related to check pointing

ot > * static, but depends on PagesCache.MAX_SIZE, so if PagesCache.MAX_SIZE >  >PagesListNodeIO#getCapacity it can take > * more than 2 pages). Also some amount of page memory needed to store  >page list metadata. > */ > private   static   final   double   PAGE_L

Re[4]: Questions related to check pointing

Also some amount of page memory needed to store  >page list metadata. > */ > private   static   final   double   PAGE_LIST_CACHE_LIMIT_THRESHOLD  =  >0.1 ; >  >This raises two questions:  >  >1. The data region where most writes are occurring has 4Gb alloca

Re: Re[2]: Questions related to check pointing

T_CACHE_LIMIT_THRESHOLD = 0.1; This raises two questions: 1. The data region where most writes are occurring has 4Gb allocated to it, though it is permitted to start at a much lower level. 4Gb should be 1,000,000 pages, 10% of which should be 100,000 dirty pages. The 'limit hol

Re: Re[2]: Questions related to check pointing

I'm working on getting automatic JVM thread stack dumping occurring if we detect long delays in put (PutIfAbsent) operations. Hopefully this will provide more information. On Wed, Dec 30, 2020 at 7:48 PM Zhenya Stanilovsky wrote: > > Don`t think so, checkpointing work perfectly well already

Re[2]: Questions related to check pointing

Don`t think so, checkpointing work perfectly well already before this fix. Need additional info for start digging your problem, can you share ignite logs somewhere?   >I noticed an entry in the Ignite 2.9.1 changelog: >* Improved checkpoint concurrent behaviour >I am having trouble finding the

Re: Questions related to check pointing

I noticed an entry in the Ignite 2.9.1 changelog: - Improved checkpoint concurrent behaviour I am having trouble finding the relevant Jira ticket for this in the 2.9.1 Jira area at

Re: Questions related to check pointing

Hi Zhenya, 1. We currently use AWS EFS for primary storage, with provisioned IOPS to provide sufficient IO. Our Ignite cluster currently tops out at ~10% usage (with at least 5 nodes writing to it, including WAL and WAL archive), so we are not saturating the EFS interface. We use the default page

Re: Questions related to check pointing

* Additionally to Ilya reply you can check vendors page for additional info, all in this page are applicable for ignite too [1]. Increasing threads number leads to concurrent io usage, thus if your have something like nvme — it`s up to you but in case of sas possibly better would be to reduce

Re: Questions related to check pointing

As another detail, we have the WriteThrottlingEnabled property left at its default value of 'false', so I would not ordinarily expect throttling, correct? On Tue, Dec 29, 2020 at 10:04 AM Raymond Wilson wrote: > Hi Ilya, > > Regarding the throttling question, I have not yet looked at thread

Re: Questions related to check pointing

Hi Ilya, Regarding the throttling question, I have not yet looked at thread dumps - the observed behaviour has been seen in production metrics and logging. What would you expect a thread dump to show in this case? Given my description of the sizes of the data regions and the numbers of pages

Re: Questions related to check pointing

Hello! 1. If we knew the specific circumstances in which a specific setting value will yield the most benefit, we would've already set it to that value. A setting means that you may tune it and get better results, or not. But in general we can't promise you anything. I did see improvements from

Questions related to check pointing

Hi, We have been investigating some issues which appear to be related to checkpointing. We currently use the IA 2.8.1 with the C# client. I have been trying to gain clarity on how certain aspects of the Ignite configuration relate to the checkpointing process: 1. Number of check pointing

Re: Ignite ML random forest questions

Hi, The model(s) learn a correlation between the label(s) and the features. In the Random Forest Classification example the Labeled feature represents the class that a wine belongs to based on a given set of features. see: The labeled feature is defined here:

Ignite ML random forest questions

Hello everyone, I am currently experimenting with Ignite machine learning (random forest regression / classifier) and have come up with a couple of questions that I can't seem to answer using docs or sample code. I am rather new to ML as well as Ignite, so I hope that answers aren't too obvious

Re: Questions Regarding Critical Workkers Health Check

Hi, Question-1: Does the above log mean that the thread is really blocked? or is it just busy doing something else? The thread in question might be busy doing something else and did not update its heartbeat timestamp. See:

Questions Regarding Critical Workkers Health Check

it only after I have added 1 server and 5 clients and the communication started between them). I did some research and found that this is related to the Critical Workers Health Check feature which I think is a great addition to ignite but I have a few questions regarding the same. Question-1: Do

Re: Questions on the mechanics of activated on-heap in ignite 2.x.x

rformance > we > are thinking about activating on-heap. While there are already quite many > questions/answers on that topic in this forum we are still missing some > points. I would like to use the following scenario for our questions: Say > we > have one ignite-server-instance

Questions on the mechanics of activated on-heap in ignite 2.x.x

many questions/answers on that topic in this forum we are still missing some points. I would like to use the following scenario for our questions: Say we have one ignite-server-instance living on a *kubernetes-pod of 32 GiB memory request/limit size* with the following "hypothetical" con

Re: Help with possible advanced Ignite questions during a meetup

lk are here: >>> https://www.slideshare.net/ZaarHai/apache-ignite-a-doitall-keyvalue-db >>> And the recording is here: https://www.youtube.com/watch?v=kYSF5-AlV_0 >>> >>> Special thanks to Denis for jumping in and providing valuable comments! >>> >>> Best, &

Re: Help with possible advanced Ignite questions during a meetup

is here: https://www.youtube.com/watch?v=kYSF5-AlV_0 >> >> Special thanks to Denis for jumping in and providing valuable comments! >> >> Best, >> Zaar >> >> >> On Sat, 16 May 2020 at 04:19, Kseniya Romanova >> wrote: >> >>> Hi Zaar! S

Re: Help with possible advanced Ignite questions during a meetup

com/watch?v=kYSF5-AlV_0 > > Special thanks to Denis for jumping in and providing valuable comments! > > Best, > Zaar > > > On Sat, 16 May 2020 at 04:19, Kseniya Romanova > wrote: > >> Hi Zaar! Sounds cool! >> Please meet Denis (in CC). He is ready to help you wi

Re: Help with possible advanced Ignite questions during a meetup

/watch?v=kYSF5-AlV_0 Special thanks to Denis for jumping in and providing valuable comments! Best, Zaar On Sat, 16 May 2020 at 04:19, Kseniya Romanova wrote: > Hi Zaar! Sounds cool! > Please meet Denis (in CC). He is ready to help you with questions. > > > пт, 15 мая 2020 г. в

Re: Help with possible advanced Ignite questions during a meetup

o help you with questions. > > > пт, 15 мая 2020 г. в 10:17, Zaar Hai : > >> Hi there Ignite gurus, >> >> I started to work with Ignite lately, mainly from DevOps perspective and >> this project looks so interesting that I decided to give a talk to share my &g

Re: Help with possible advanced Ignite questions during a meetup

Hi Zaar! Sounds cool! Please meet Denis (in CC). He is ready to help you with questions. пт, 15 мая 2020 г. в 10:17, Zaar Hai : > Hi there Ignite gurus, > > I started to work with Ignite lately, mainly from DevOps perspective and > this project looks so interesting that I decided to

Help with possible advanced Ignite questions during a meetup

join as well, in case the audience will have advanced questions that I'll not be able to answer. It's on May 26th, 18:00 UTC+1000 (I'm in Australia), but again, it's an online event: https://www.meetup.com/multi-cloud-australia/events/270625697 Hope to see you there, and thanks! Zaar

Re: Schema Questions

y next two questions are, assuming I go with option 1.1: > 1) How do I define these nested addresses via query entities, assuming, > I'd use binaryobjects when inserting. There can be multiple primary > addresses and secondary addresses. E.g., {john,{primary-address:[addr1, > addr2], secon

Re: Schema Questions

Thanks Evgenii. My next two questions are, assuming I go with option 1.1: 1) How do I define these nested addresses via query entities, assuming, I'd use binaryobjects when inserting. There can be multiple primary addresses and secondary addresses. E.g., {john,{primary-address:[addr1, addr2

Re: Schema Questions

Hi, The main question here is how you want to use this data. Do you use SQL? 1) It depends on the use case. If you plan to access only a person object without any filtering by addresses and you will always need the entire object, it makes sense to have one big object. But in this case, you won't

Schema Questions

Hi All, I would appreciate your feedback, for the following, in terms of performance for both inserts and queries. 1) Which one of these patterns is preferable for the table design? A- Have a fat table/cache with nested objects, e.g. person table with a hashmap of addresses. B- Have person and

Re: Continuous Query Questions

So, if I define the CQ as a service, and the node crashes, wouldn't ignite start a new service with CQ already registered, say if the CQ registration is in service init? I can do initial query at the as well. On Wed, Apr 1, 2020 at 7:33 PM Evgenii Zhuravlev wrote: > Well, with this use case,

Re: Continuous Query Questions

Well, with this use case, if one of the nodes goes down, there is always a chance to lost notifications. I don't think that it's possible to recover lost notifications with out of the box solution, but if you will be able to track the last processed notification and store update time in entries,

Re: Continuous Query Questions

Thanks Evgenii for the recommendation and the heads up. Is there a way to recover the lost notifications or even know if a notification is lost? On Wed, Apr 1, 2020 at 12:15 PM Evgenii Zhuravlev wrote: > Hi, > > 1) I would recommend checking ContinouousQuery.setLocal: >

Re: Continuous Query Questions

Hi, 1) I would recommend checking ContinouousQuery.setLocal: https://www.gridgain.com/sdk/ce/latest/javadoc/org/apache/ignite/cache/query/Query.html#setLocal-boolean-. Please check if it fits your requirements. 2) You will need to do this in a separate thread, because cache operations shouldn't

Continuous Query Questions

Hi All, I'd like to get your feedback regarding the following pattern. 1) CQ setup that listens to the changes to a cache on the local node only. 2) Upon receiving notification on a change, the listener makes additions to two other caches, one being on the local node (partitioned) and the other

Re: Continuous Query Questions

c, 2004, 2, 1 >>> 2- pete, rd, 2004, 3,1 >>> 3- jim,hr,2004, 5,2 >>> 4- jerry,math,2005,2,1 >>> 5- betty,park,2005,3,2 >>> 6- carry,acc,2006,1,1 >>> >>> I want to get notification for the first occurrence of a particular >>> value. So

Re: Continuous Query Questions

1 >> >> I want to get notification for the first occurrence of a particular >> value. So, I want to get notifications when I get records 1, 4 and 6, and >> in this case, I want to get the fields, org, and year back only. >> >> Questions: >> 1) Is CQ overkil

Re: Continuous Query Questions

6, and in this > case, I want to get the fields, org, and year back only. > > Questions: > 1) Is CQ overkill in this case? If yes, what's a better alternative? > 2) If not, how can I set up CQ to get only one record per occurrence? > 3) How would I return only org and year back wi

Re: baseline topology questions

the “old” PV, yes. > On 11 Feb 2020, at 03:56, narges saleh wrote: > > Hi All, > Sorry if these questions are too basic. > > 1) How does cache replication work in context of native persistence, > especially in context of WAL files? Do the primary and replication node have

baseline topology questions

Hi All, Sorry if these questions are too basic. 1) How does cache replication work in context of native persistence, especially in context of WAL files? Do the primary and replication node have separate WAL files? 2) How does baseline topology work in context of kubernetes, with persistent

Re: Questions regarding Data Availability/Replication. @Ignite Team, please answer as it's important for us.

Hi, The easiest solution that can be used here is just to have 2 server nodes in one cluster, make sure that all primary partitions will be on the SN1 only(it can be done using affinity function). Caches should be configured as Replicated and SN2 will have backups for everything. However, if you

Questions regarding Data Availability/Replication. @Ignite Team, please answer as it's important for us.

Scenario: Datacenter 1 (Main) -> One Application Server (Client Node CN1) and One DB Server (Server Node SN1). Datacenter 2 (Recovery) -> One Application Server (Client Node CN2) and One DB Server (Server Node SN2). Usually all the user requests go to CN1 but not CN2. So, technically we will

Re: Embedded ignite and baseline upgrade questions

Thanks, its definitely clear now that rebalancing should be triggered from code if node removal detected. Assuming that number of backups > 0 and only one node removed it looks like safe case. But what if backup count = 0 (bad idea but the risk may be acceptable in some cases) and we need to

Re: Embedded ignite and baseline upgrade questions

Hi, Your summary looks correct. It should be possible to manage your baseline topology using a config file, provided you follow the steps outlined. more info here: https://apacheignite.readme.io/docs/baseline-topology#section-triggering-rebalancing-programmatically You can use

Re: Embedded ignite and baseline upgrade questions

!= in kotlin uses equals() under the hood so it works here as expected. I can't use control.sh to manage topology (becase ignite is embedded) and trying to implement it in code. So the actual initialization sequence is: 1) Start all fresh nodes, wait for all specified persistence nodes to be

Re: Machine Learning questions

and another examples https://github.com/apache/ignite/tree/master/examples/src/main/java/org/apache/ignite/examples/ml Also a few videos are available in my channel https://www.youtube.com/watch?v=3CmnV6IQtTw https://www.youtube.com/watch?v=DmoMBsiHxf8 Jose, great questions, hope to share more docs

Re: Embedded ignite and baseline upgrade questions

Hello! First of all, I really hope you're not using != to compare collections :) Second, cluster will auto-activate when all baseline nodes have joined. For the first time you have to manually activate the cluster. The algorithm looks OK and nodes should auto-activate once they are all up.

Machine Learning questions

Hi Guys, A few questions as I progress through my ML learning journey with Ignite... - I assume that I would start by extracting features from my JSON records in a cache into a vectorizer - how does this impact memory usage? Will origin cache records be moved to disk, as more memory is required

Re: Embedded ignite and baseline upgrade questions

Also when starting second node I am getting this: 2019/12/27 23:39:36.665 [disco-pool-#55] WARN BaselineTopology of joining node (dev-1) is not compatible with BaselineTopology in the cluster. Branching history of cluster BlT ([95475834]) doesn't contain branching point hash of joining node BlT

Embedded ignite and baseline upgrade questions

Hi, I am implementing distributed crawler engine using ignite in embedded mode. Each crawler node have persistence enabled and assigned predefined consistentId (dev-1, dev-2, dev-3, etc). Baseline topology (nodes which store data) can change and configured using config file like this: #

RE: custom java classes and ignite node questions

d delete message and any attachments from your system. From: Ilya Kasnacheev Sent: Tuesday, December 17, 2019 6:47 AM To: user@ignite.apache.org Subject: Re: custom java classes and ignite node questions Hello! Did you try it to check if it works? For one thing, we do not recommend going to p

Re: custom java classes and ignite node questions

Hello! Did you try it to check if it works? For one thing, we do not recommend going to production with solutions which are theoretically sound, but were not tried in staging. Regards, -- Ilya Kasnacheev пн, 16 дек. 2019 г. в 20:29, Scott Cote : > Igniters, > > > > Request: we want to

custom java classes and ignite node questions

Igniters, Request: we want to segregate our caches so that they are no longer sharing a common jar in the libs folder. Background: We currently deploy our custom java classes in a jar to the lib folder of the config directory of Apache Ignite (three nodes operating as data servers, and

Re: questions

gt;>> 2) I am not sure what you mean by confining half of cache to one >>>>>>> cluster and another half to another node. If my affinity key is >>>>>>> department >>>>>>> id, why can't I have department A on a partitioned cache

Re: questions

e on another >>>>>> cluster. >>>>>> >>>>>> I might be misunderstanding the whole, and I'd appreciate >>>>>> clarification. >>>>>> >>>>>> On Thu, Aug 22, 2019 at 6:52 AM Ilya Kasnacheev <

Re: questions

;>> >>>>> On Thu, Aug 22, 2019 at 6:52 AM Ilya Kasnacheev < >>>>> ilya.kasnach...@gmail.com> wrote: >>>>> >>>>>> Hello! >>>>>> >>>>>> 1) When there is an overflow, either page eviction kicks i

Re: questions

> >>>>> 1) When there is an overflow, either page eviction kicks in, or, if it >>>>> is disabled, you get an IgniteOOM, after which the node is no longer >>>>> usable. Please avoid overflowing any data regions since there's no >>>>> gra

Re: questions

o graceful >>>> handling currently. >>>> 2) I don't think so. You can't easily confine half of cache's data to >>>> one cluster group and another half to other group. >>>> >>>> Such scenarios are not recommended. We expect that all partitions have &g

Re: questions

nk so. You can't easily confine half of cache's data to >>> one cluster group and another half to other group. >>> >>> Such scenarios are not recommended. We expect that all partitions have >>> same amount of data. Not that there are a few gargantuan partitions tha

Re: questions

We expect that all partitions have >> same amount of data. Not that there are a few gargantuan partitions that >> don't fit in a single node. >> >> Regards, >> -- >> Ilya Kasnacheev >> >> >> вт, 20 авг. 2019 г. в 06:29, narges saleh : >> >>>

Re: questions

t that there are a few gargantuan partitions that > don't fit in a single node. > > Regards, > -- > Ilya Kasnacheev > > > вт, 20 авг. 2019 г. в 06:29, narges saleh : > >> Hello All, >> >> I'd appreciate your answers to my questions. >> >> 1)

questions

Hello All, I'd appreciate your answers to my questions. 1) Assuming I use affinity key among 4 caches, and they all end up on the same ignite node. What happens where is an overflow? Does the overflow data end up on a joined node? How do I keep the related data from all the caches close to each

Re: Ignite Client Affinity Questions

3) Each server node has two caches which use AffinityKey for pinning >> entries >> in the two caches to one node for a given key. >> >> Questions: >> 1) Will the client have up to date access to the AffinityFunction for the >> two caches? >> 2) What sort of o

Ignite Client Affinity Questions

AffinityKey for pinning entries in the two caches to one node for a given key. Questions: 1) Will the client have up to date access to the AffinityFunction for the two caches? 2) What sort of overhead is associated with running as client mode? I want to make it as dumb as possible, so it would

Re: Questions on IgniteDataStreamer

Hello! Can you please at least share the exceptions you are getting? Regards, -- Ilya Kasnacheev сб, 1 июн. 2019 г. в 13:55, Om Thacker : > Hello vbm, > > I am working on the exact same problem. Did you find the solution for the > same. > I am using following code in my client application

Re: Questions on IgniteDataStreamer

Hello vbm, I am working on the exact same problem. Did you find the solution for the same. I am using following code in my client application which will listen to kafka connect (confluent). I have one to one mapping for kafka topic and ignite cache. When there is an insert into db, the kafka

Re: waiting for partition map exchange questions

Hi Andrei, have you had a chance to check out these logs? Thanks On Sun, Apr 14, 2019 at 17:18 scottmf wrote: > ignite.tgz > > (attached file) > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >

Re: waiting for partition map exchange questions

ignite.tgz (attached file) -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: waiting for partition map exchange questions

thanks Andrei, I've attached the files. The outage occurred at approximately 2019-04-08T19:43Z the host ending in 958sw is the host that went down at the start of the outage. Host ending in dldh2 came up after 958sw went down. hwgpf and zq8j8 were up the entire time. These are the server

Re: waiting for partition map exchange questions

Hi, Yes without logs it's not easy to understand what is the reason. Could you please attach them? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

waiting for partition map exchange questions

hi All, I just encountered a situation in my k8s cluster where I'm running a 3 node ignite setup, with 2 client nodes. The server nodes have 8GB of off-heap per node, 8GB JVM (with g1gc) and 4GB of OS memory without persistence. I'm using Ignite 2.7. One of the ignite nodes got killed due to

Re: Memory related questions

AM newigniter wrote: > Greetings all. > I have a few questions regarding memory. > > 1.) I am running ignite inside docker container. How can I increase heap > memory to ignite node when started? > I tried with passing -Xmx (I pass it to docker run command like this: -e &

Memory related questions

Greetings all. I have a few questions regarding memory. 1.) I am running ignite inside docker container. How can I increase heap memory to ignite node when started? I tried with passing -Xmx (I pass it to docker run command like this: -e "JAVA_OPTS=-Xmx3g") parameter but when n

Re: Some questions about store and distributed processing

Hello! You can also use Continuous Queries for that. They will execute where the data is modified, when it is modified. https://apacheignite.readme.io/docs/continuous-queries Regards, -- Ilya Kasnacheev сб, 26 янв. 2019 г. в 13:41, yann Blazart : > Hello all ! > > I will have to use Ignite

Re: Some questions about store and distributed processing

Hi Yann, Event listeners in Ignite can be helpful to you - https://apacheignite.readme.io/docs/events You can listen for specific types of events (like cache put, cache read) on a local node or remote events on a group of cluster nodes and then perform whatever actions you want. All the different

Some questions about store and distributed processing

Hello all ! I will have to use Ignite because I think it's the best solution to all my concerns, but I have a few question. I have to process very big json files (200GB), with lot of objects of different type generated from it. These objects, I will have to do multiple controls on it (with a

part 3 - dead in the water now - notes and questions on configuration and installation of web console for ignite

Part 3 of notes and questions about web console for ignite Restarted attempt inside BDD (https://apacheignite-tools.readme.io/docs/build-and-deploy) of the section titled: Run Ignite Web Console In Development Mode https://apacheignite-tools.readme.io/docs/build-and-deploy#section-run-ignite

part 2 - notes and questions on configuration and installation of web console for ignite

Part 2 of notes and questions about web console for ignite = Items = Item 1. Found more npm issues while performing "Run Ignite Web Console In Development Mode" of BDD referenced in Part 1 Item 2. <<>>> It seems that the latest version of community mongodb i

notes and questions on configuration and installation of web console for ignite

Am going through the manual installation and implementation of the Ignite Web Console. This is Part 1 of a series of notes that I’m making…. Throughout this set of items (questions and notes), I’m referencing the “Build and Deploy“ document (BDD) https://apacheignite-tools.readme.io/docs/build

Re: ignite questions

on capacity) is the potential solution as suggested. Naveen -- I will keep in mind your suggestion as well, regarding partitioning the huge data sets. thanks. Any feedback regarding my other questions: Data pin to cache: How do I make sure certain data never gets evicted (with native persistence enabled

Re: ignite questions

Regarding your question on capacity planning Not sure we have any work around to have data equally getting distributed to fulfill your requirement technically and do the sizing. But non-technically, you can change your design to include state as well as part of your affinity key along with the

Re: ignite questions

Yes, a custom affinity function is what you need to control entries distribution across physical machines. It's feasible to do. Worked with one of Ignite customers who did something similar for their needs - the code is not open sourced. -- Denis On Wed, Jan 2, 2019 at 10:17 AM Mikael wrote: >

Re: ignite questions

Hi! By default you cannot assign a specific affinity key to a specific node but I think that could be done with a custom affinity function, you can do pretty much whatever you want with that, for example set an attribute in the XML file and use that to match with a specific affinity key

Re: ignite questions

Thanks Mikael. I did come across that link before, but I am not sure it addresses my concern. I want to see how I need I size my physical VMs based on affinity keys. How would I say for India affinity key use this super size VM and for others use the other smaller ones, so the data doesn't get

Re: ignite questions

You can find some information about capacity planning here: https://apacheignite.readme.io/docs/capacity-planning About your India example you can use affinity keys to keep data together in groups to avoid network traffic. https://apacheignite.readme.io/docs/affinity-collocation Mikael Den

  1   2   3   >