Hello Ivan Many thanks for great news. We start to prototype ☺ jaro
From: Ivan Veselovskiy [mailto:[email protected]] Sent: Thursday, October 15, 2015 7:47 PM To: [email protected] Subject: Re: ? Hi, Jaroslav, In my understanding, with Ignite the answers to all the questions are in general positive. Possibly one of the most challenging tasks there is to adjust cache affinity function to achieve best data/data & data/compute collocation to gain the best performance. Documentation on affinity collocation can be found there: https://apacheignite.readme.io/docs/affinity-collocation . On Thu, Oct 15, 2015 at 7:30 PM, <[email protected]<mailto:[email protected]>> wrote: Hello Ignite users, Let me share my exaltation from things you’re doing. Let me explain my problem/challenge – sorry I had not time to deeply dive into prototyping yet and I have to make decision very quickly so I use this way to ask general questions which could help me to decide whether to include Ignite into short list for following prototyping of Poc for our solution. I really appreciate if anybody could respond to my maybe un-competent queries (Q). Our challenge: • We have files “BLOBs” which represents binary vectors. • We’d like to load them into Ignite data grid as distributed key values c • We are up to implement capability where the service [cid:[email protected]] (our service layer) is getting binary vector (in the same format as stored in file system -> Ignite data grid) and we need to o perform “search” in our gallery which vector is most close to vector on the input. To calculate the distance (or probability of match) between 2 vectors we have encapsulated in external lib(jar) which basically expose 1:1 match (vector1, vector2) capability. So we need to perform 1:1 match over all vectors we have stored. As the number of vectors in the galley is huge and number of requests to compare is also impressive – this is tack for memory computing. • What’s more, there is service [cid:[email protected]] which continuously adds new records into our gallery Can you please confirm that following setup/approach with Ignite would work? • Will we be able to load distributed data [cid:[email protected]] from file storage into grid nodes in distributed manner? • Will we be able to from service [cid:[email protected]] trigger on every grid node computation function [cid:[email protected]] which will : o Go over all data (vectors) which are distributed on the current node [cid:[email protected]] ? o Call external lib be called from computation function [cid:[email protected]] o Can we pass parameter to computation function [cid:[email protected]] o Can computation function be deployed on nodes w/o needing to broadcast it from service (computation trigger) ? o Is there any support from ignite to run computation function [cid:[email protected]] in parallel on certain node? • We will be able to update data on computation nodes from service [cid:[email protected]] (add new records), so new requests from service [cid:[email protected]] will be able to process updated gallery of vectors in memory Thank you so MUCH jaro [cid:[email protected]] Jaroslav Saxa Accenture – Technology Architecture Plynarenska 7/C, 829 01 Bratislava Mobile: +421-904-706113 Email: [email protected]<mailto:[email protected]> ________________________________ This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security and assessment of internal compliance with Accenture policy. ______________________________________________________________________________________ www.accenture.com<http://www.accenture.com>
