Re: [akka-user] Can I use in-memory Actor state as a search engine ?

Hi Chelios, I didn't mean to use any external engine or Riak, I meant that you should learn what they do so that you can get ideas from these frameworks/engines. The thing with map reduce is the ability to split data sets among nodes where a query is the sum of the filtered dataset per node,

Re: [akka-user] Can I use in-memory Actor state as a search engine ?

Hi Cherios, I didn't mean to use any external engine or Riak, I meant that you should learn what they do so that you can get ideas from these frameworks/engines. The thing with map reduce is the ability to split data sets among nodes where a query is the sum of the filtered dataset per node,

Re: [akka-user] Can I use in-memory Actor state as a search engine ?

You may also want to take a look at Akka Distributed Data http://doc.akka.io/docs/akka/2.4.2/scala/distributed-data.html for replicating the search index (small enough amount of data I guess). /Patrik tors 31 mars 2016 kl. 04:35 skrev Chelios : > Hey Guido, > > Thanks

Re: [akka-user] Can I use in-memory Actor state as a search engine ?

Hey Guido, Thanks heaps for this info. I only have small theoretical experience with map reduce. I will have to study on the info you gave me. The reason I thought of not using any external database is because I'm trying to get every small Actor (Customer, Product etc) manage it's on small

Re: [akka-user] Can I use in-memory Actor state as a search engine ?

Even if you want to do it yourself you still have to reduce data from a map, there are papers if you want to create your own implementation of a "map reduce engine" You won't escape that fact if you want your implementation to be competitive, take a look at Riak, they do the same in Erlang,

Re: [akka-user] Can I use in-memory Actor state as a search engine ?

Hi Chelios, The problem you are solving is divided in two and I think it has been resolved before though it is quite complex but if you divide and conquer it might turn out to be easy. IMHO here are the main aspects of your problem: - Your data is distributed, each node with data will

Re: [akka-user] Can I use in-memory Actor state as a search engine ?

Hi Konrad, Your reply gave me the confidence to continue with implementing the Actor based search. Thank You :D ... I'm doing this just for research purposes, I'm just trying to see if I can get a high performant, distributed, in-memory system by just using Eventsourcing with Akka Actors

Re: [akka-user] Can I use in-memory Actor state as a search engine ?

Technically it's doable , but I'm not sure if that'll reduce complexity :-) Search really has to be "good" in order to be useful, just "fast but bad results" often won't satisfy anyone, thus I'm not sure implementing your own custom search engine is a good idea (unless that is exactly the goal

[akka-user] Can I use in-memory Actor state as a search engine ?

Hey guys I've got an Eventsource based application (Not CQRS - Read and write are both on the write side). The state of all the entities/aggregates/actor are stored in memory because the data is not going to go above 120GB and I've have a machine with 265GB RAM. *Problem:* Suppose I have a