I'm trying to optimize the setup for a new system we've built using akka. We have a batching application that is used to feed documents into a Solr index.
It supports different jobs running concurrently, such as A) a bulk re-index of every document in the system, which can take 24 hours or more, plus B) normal periodic re-indexing of material that is responsive to User events, such as adding a tag or comment etc. Jobs in B) don't need to be instantaneous, we just don't want them waiting at the back of really long queues. My assumption is that I need to seperate the actors into two dispatchers so that all jobs with 'lite' workloads that respond to User events are in their own dispatcher, then flag that dispatcher as higher priority... but I haven't found a way to achieve that. So my questions were: 1) Is there a mechanism for allocating the thread priorities in the underlying dispatcher? I've given up on this one at this point, but I thought I'd ask whilst here. I fully understand that thread priorities have many caveats attached to them, but I'm comfortable (perhaps foolishly) that they are still a good idea in this context, since I'm not trying to guarantee absolute order of processing messages, just help the high priority gravitate to the top in a vaguely timely fashion. 2) In the absence of thread priorities I'm fairly certain that simply having two dispatchers will help, but I'm not certain on what the impact of setting 'throughput' is. I don't want to cripple throughput of the large batch jobs by setting throughput too low... but I keep wondering if I'm over-thinking it as well. Would having both dispatchers set to something like 10 sound reasonable? We'd have to benchmark to find a specific number (if it even makes a difference). Thanks for reading this, and I'm really enjoying using akka. Ta, Greg -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: http://akka.io/faq/ >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/groups/opt_out.
