Re: [akka-user] [akka-stream] Decrease buffer size for some stages

2015-01-22 Thread Endre Varga
Hi Alexey, On Thu, Jan 22, 2015 at 12:31 PM, Alexey Romanchuk alexey.romanc...@gmail.com wrote: It is exactly what I have tried to achieve! You guys did amazing work with all akka streams. Thanks! :) You might be also interested in this ticket: https://github.com/akka/akka/issues/16610 It

Re: [akka-user] Cluster unreachable and a lot of cluster connections

2015-01-22 Thread Viktor Klang
Endre, could it be due to pending-to-send system message overflow? On Thu, Jan 22, 2015 at 11:45 AM, Johannes Berg jberg...@gmail.com wrote: Okay, I increased the load further and now I see the same problem again. It seems to just have gotten a bit better in that it doesn't happen as fast,

Re: [akka-user] received Supervise from unregistered child ... this will not end well

2015-01-22 Thread Viktor Klang
Hi Marco, you'll need to update all Akka dependencies to the 2.3.9 version and make sure that your dependencies that depend on akka transitively are built for Akka 2.3.x On Thu, Jan 22, 2015 at 11:57 AM, Marco Luca Sbodio marco.sbo...@gmail.com wrote: Hi Viktor, after upgrading to akka 2.3.9

Re: [akka-user] Cluster unreachable and a lot of cluster connections

2015-01-22 Thread Endre Varga
Without detailed logs I cannot say. If there would be a system message buffer overflow then it would cry loudly in the logs. Also it says that an unreachable node is being removed, so there should be events happening before unreachability. This might be something completely else. The full config

Re: [akka-user] Cluster unreachable and a lot of cluster connections

2015-01-22 Thread Patrik Nordwall
If it's quarantined it will be removed from cluster. Please include the log entry that says that it is quarantined, if any. /Patrik 22 jan 2015 kl. 14:56 skrev Viktor Klang viktor.kl...@gmail.com: Endre, could it be due to pending-to-send system message overflow? On Thu, Jan 22, 2015 at

Re: [akka-user] [akka-stream] Decrease buffer size for some stages

2015-01-22 Thread Alexey Romanchuk
It is exactly what I have tried to achieve! You guys did amazing work with all akka streams. Thanks! :) четверг, 22 января 2015 г., 14:43:52 UTC+6 пользователь drewhk написал: Hi Alexey, On Thu, Jan 22, 2015 at 4:15 AM, Alexey Romanchuk alexey.r...@gmail.com javascript: wrote: Hey! I

Re: [akka-user] BalancingPool versus RoundRobinPool + BalancingDispatcher

2015-01-22 Thread Roland Kuhn
Hi Jean, 20 jan 2015 kl. 15:26 skrev Jean Helou jean.he...@gmail.com: Hello Roland, thanks for taking the time to answer. your description very much sounds like an Actor should be handling the pool, not a router. Alright, however I am still curious as to why the BalancingPool

Re: [akka-user] Dispatcher assignment issue for Http Server

2015-01-22 Thread Roland Kuhn
Hi Randy, without setting max-pool-size-max (which defaults to 64) you will not be able to see more than 64 threads. May I ask why you want to create 100 threads for handling a single stream of incoming connections? I would expect at least 99 of them to be idle at all times. If you want to

Re: [akka-user] Handling boundary data in chunked requests

2015-01-22 Thread Roland Kuhn
If I understand correctly then you’ll want to use akka-http which has support for handling multipart/formdata. This has the downside that akka-http is still being developed, but you can try out milestone 1.0-M2 to see if that works for you. Regards, Roland 21 jan 2015 kl. 01:52 skrev Yogesh

Re: [akka-user] [akka-stream] Decrease buffer size for some stages

2015-01-22 Thread Endre Varga
Hi Alexey, On Thu, Jan 22, 2015 at 4:15 AM, Alexey Romanchuk alexey.romanc...@gmail.com wrote: Hey! I have a stream that process incoming messages, assemble big message pack and send it to other system via network. Incoming messages are relatively small and I use big buffers to improve

Re: [akka-user] [akka streams] question on some time related use cases

2015-01-22 Thread Endre Varga
Hi Frank, On Thu, Jan 22, 2015 at 2:51 AM, Frank Sauer fsaue...@gmail.com wrote: Thanks, I came up with the following, but I have some questions: /** * Holds elements of type A for a given finite duration after a predicate p first yields true and as long as subsequent * elements

Re: [akka-user] [akka streams] question on some time related use cases

2015-01-22 Thread Endre Varga
On Thu, Jan 22, 2015 at 5:07 AM, Frank Sauer fsaue...@gmail.com wrote: Update, in a simple test scenario like so val ticks = Source(1 second, 1 second, () = Hello) val flow = ticks.transform(() = new FilterFor[String](10 seconds)(x = true)).to(Sink.foreach(println(_))) flow.run()

Re: [akka-user] Cluster unreachable and a lot of cluster connections

2015-01-22 Thread Johannes Berg
Okay, I increased the load further and now I see the same problem again. It seems to just have gotten a bit better in that it doesn't happen as fast, but with enough load it happens. To re-iterate, I have Akka 2.3.9 on all (8) nodes and auto-down-unreachable-after = off on all nodes and I

[akka-user] Running with akka-remote: ClassNotFound

2015-01-22 Thread Ashesh Ambasta
The setup is quite basic: Here's my application.conf akka { actor { provider = akka.remote.RemoteActorRefProvider } remote { enabled-transports = [akka.remote.netty.tcp] netty.tcp { hostname = 127.0.0.1 port = 2552 } } } And my build.sbt; name := random-app

Re: [akka-user] received Supervise from unregistered child ... this will not end well

2015-01-22 Thread Marco Luca Sbodio
Hi Viktor, after upgrading to akka 2.3.9 my multi-jvm-test crashes with this error: 10:49:07.654UTC ERROR [MySystemMultiNodeTest-akka.actor.default-dispatcher-21] [akka.actor.ActorSystemImpl] [ActorSystem(MySystemMultiNodeTest)] - Uncaught error from thread

Re: [akka-user] Cluster unreachable and a lot of cluster connections

2015-01-22 Thread Johannes Berg
I will try that but it seems that will only help to a certain point and when I push the load further it will hit it again. I hit this within a minute after I put on the load which is a bit annoying to me. I'm fine with it becoming unreachable as long as I can get it back to reachable when it

[akka-user] Akka persistence (ES) - unique persistenceId design

2015-01-22 Thread Sebastian Bach
Hi! How do you generate your persistenceIds? One common approach is UUID.randomUUID().toString(). But in my opinion it could be worth it to choose a smarter generation strategy. Some use cases based on key segments are: - Akka cluster sharding - NoSQL DB sharding - Lexicographical

Re: [akka-user] Cluster unreachable and a lot of cluster connections

2015-01-22 Thread Endre Varga
Hi Johannes, On Thu, Jan 22, 2015 at 4:53 PM, Johannes Berg jberg...@gmail.com wrote: I will try that but it seems that will only help to a certain point and when I push the load further it will hit it again. There is no system message traffic between two Akka systems by default, to have a

[akka-user] Creating custom source materializations

2015-01-22 Thread Jeremy Stone
Is there any way at the moment to create custom sources with specific custom materializations? Essentially we want to be able to create custom flexible scheduling Sources (similar to TickSource) that materialize to Cancellable so that we can stop them. I can see how to create an

Re: [akka-user] Re: sent/received messages excluding the deathwatch heartbeats?

2015-01-22 Thread Sam Halliday
Thanks Martynas, It's a shame that this would be needed. It feels very much like the heartbeats should be considered part of the system layer when it comes to logging, and therefore already filtered. Seeing heartbeats when debugging makes it incredibly difficult to see anything. My concern

[akka-user] How to serialize an Any?

2015-01-22 Thread Kevin Esler
I am puzzled by something: Akka messages can be of type Any, yet akka.seriailziation.Serialization.serialize() required an AnyRef as the type of the object to be serialized. So how does Akka serialize a message that is not an AnyRef? (Reason for asking: I plan to use Akka serialization and

[akka-user] Re: Inability to route through a proxy.

2015-01-22 Thread jay vyas
To add some color. 1) When we run w/ -Dakka.remote.untrusted-mode=on, we see dropping message [class akka.actor.ActorSelectionMessage] for *unknown* recipient [Actor[akka.tcp://sparkMaster@10.254.230.67:7077/]] arriving at [akka.tcp://sparkMaster@10.254.230.67:7077] inbound addresses are

Re: [akka-user] Akka-Http: How to connect a Route with an IncomingConnection?

2015-01-22 Thread Philippe Milot
Thank you! Works like a charm. I love the module so far, looks very promising! On Thursday, January 22, 2015 at 12:31:59 PM UTC-5, drewhk wrote: Hi, Philippe, On Thu, Jan 22, 2015 at 6:28 PM, Philippe Milot pmi...@turbulent.ca javascript: wrote: So I'm following the documentation on the

Re: [akka-user] Handling boundary data in chunked requests

2015-01-22 Thread Roland Kuhn
AFAICS that would have nothing to do with spray itself: you get some ByteStrings and you want to remove some parts of them. What you need is an implementation of RFC 2388 https://www.ietf.org/rfc/rfc2388.txt, and akka-http includes one out of the box while spray does not. Regards, Roland 22

Re: [akka-user] Cluster unreachable and a lot of cluster connections

2015-01-22 Thread Johannes Berg
Thanks for the tip for what to look for, my logs are huge so it's a bit of a jungle. Anyway I found this: 10:34:23.701UTC ERROR[system-akka.actor.default-dispatcher-2] Remoting - Association to [akka.tcp://system@ip2:port2] with UID [-1637388952] irrecoverably failed. Quarantining address.

Re: [akka-user] Cluster unreachable and a lot of cluster connections

2015-01-22 Thread Patrik Nordwall
You can try to increase akka.remote.system-message-buffer-size config setting. Default is 1000. /Patrik On Thu, Jan 22, 2015 at 3:41 PM, Johannes Berg jberg...@gmail.com wrote: Thanks for the tip for what to look for, my logs are huge so it's a bit of a jungle. Anyway I found this:

Re: [akka-user] Re: Distributed cache with Akka

2015-01-22 Thread Kane Rogers
Patrik, you can do no wrong. On Tuesday, 20 January 2015 22:15:39 UTC+11, Patrik Nordwall wrote: Another alternative is to use akka-data-replication https://github.com/patriknw/akka-data-replication. /Patrik On Tue, Jan 20, 2015 at 3:16 AM, Soumya Simanta soumya@gmail.com

[akka-user] What is the best practice enforce Type Check for Actor during compilation

2015-01-22 Thread Sean Zhong
Suppose we have a servie actor: class Service extends Actor { def receive: Receive = { case RequestA(args) = doSomething() case RequestB(args) = doAnotherThing() } } // Some client is using RequestA indirectly, like this: class Source(request: RequestA) A client is trying to

Re: [akka-user] Feedback on Akka Streams 1.0-M2 Documentation

2015-01-22 Thread Sam Halliday
On Wednesday, 21 January 2015 08:21:15 UTC, drewhk wrote: I believe it may be possible to use the current 1.0-M2 to address my bugbear by using the Actor integration to write an actor that has N instances behind a router, but it feels hacky to have to use an Actor at all. What is really

Re: [akka-user] Re: sent/received messages excluding the deathwatch heartbeats?

2015-01-22 Thread Sam Halliday
Thanks Patrik, That's always an option with logback, but I'd rather not have to go there. Grep in this case is not an option as the logs are coming through in a Jenkins console and very noisy. I'd like to be able to just read it off. The custom event handler sounds like it might be a good option

Re: [akka-user] [akka streams] question on some time related use cases

2015-01-22 Thread Frank Sauer
Thanks for the pointers Endre, I’ll explore those ideas. Frank On Jan 22, 2015, at 4:02 AM, Endre Varga endre.va...@typesafe.com wrote: On Thu, Jan 22, 2015 at 5:07 AM, Frank Sauer fsaue...@gmail.com mailto:fsaue...@gmail.com wrote: Update, in a simple test scenario like so val

[akka-user] Re: How to identify that akka cluster has formed?

2015-01-22 Thread Ngoc Dao
You can try Glokka: https://github.com/xitrum-framework/glokka It let you name your actors in a cluster, then get the actors back by name. On Monday, January 5, 2015 at 7:36:58 PM UTC+9, Krishna Kadam wrote: Hi patrik, I am doing a masters project in which I have streaming data and want to

[akka-user] Re: [akka-stream] Junctions documentation and specs

2015-01-22 Thread Alexey Romanchuk
Hey! Also there is not straightforward how backpressure works with Broadcast. What if one of the outputs is busy and another one is requesting for for new elements? As far as I understand from sources (Broadcast and outputBunch.AllOfMarkedOutputs) broadcast will emit new elements to

[akka-user] [akka-stream] Periodic source of sources

2015-01-22 Thread Boris Lopukhov
Hi all! How can i do a Source[Source[String]] that periodically emit the Source[String] with the specified interval, but only if the previous Source[String] is complete? -- Read the docs: http://akka.io/docs/ Check the FAQ:

Re: [akka-user] Akka-Http: How to connect a Route with an IncomingConnection?

2015-01-22 Thread Endre Varga
Hi, Philippe, On Thu, Jan 22, 2015 at 6:28 PM, Philippe Milot pmi...@turbulent.ca wrote: So I'm following the documentation on the new Akka-Http experimental modules, and I'm trying to get a basic Hello World using the Routing DSL. I've defined my route as follows: val route: Route = {

Re: [akka-user] Dispatcher assignment issue for Http Server

2015-01-22 Thread Randy Fox
Hi Roland, Thanks for the response. The 100 threads was just to verify that I could control the # threads. I didn’t realize it was using a bounded task queue. How do I configure a dedicated dispatcher for the operations in the flows that handle each connection as opposed to inheriting it

Re: [akka-user] akka persistence and need for intercept of persisted messages

2015-01-22 Thread Roland Kuhn
Hi Ketil, This is a decision that you can make according to your operational requirements. I expect that it will typically be a mixture of the two since switching to a new application version is quicker of no journal rewrite is needed while long term you want to prune the old formats where

[akka-user] Akka-Http: How to connect a Route with an IncomingConnection?

2015-01-22 Thread Philippe Milot
So I'm following the documentation on the new Akka-Http experimental modules, and I'm trying to get a basic Hello World using the Routing DSL. I've defined my route as follows: val route: Route = { complete(HttpResponse(entity = Hello, world!)) } I can bind and accept HTTP

[akka-user] Inability to route through a proxy.

2015-01-22 Thread Tim St. Clair
Greetings folks - I'm currently trying to run Spark master through a proxy and receiving an error that I can't seem to bypass. ERROR EndpointWriter: dropping message [class akka.actor.ActorSelectionMessage] for non-local recipient [Actor[akka.tcp://sparkMaster@10.254.118.158:7077/]]

Re: [akka-user] Handling boundary data in chunked requests

2015-01-22 Thread Yogesh
Not sure if I can use akka-http, but will definitely take a look. Thank you. I basically need to strip those few header and boundary lines from my content. Is there some way I can do it with spray? On Thu, Jan 22, 2015 at 4:10 AM, Roland Kuhn goo...@rkuhn.info wrote: If I understand correctly

[akka-user] ClusterClient load balancing

2015-01-22 Thread Hengky Sucanda
Hi Guys, I'm currently developing an application using Play and Akka, and currently is deploying one frontend nodes with multiple backend nodes. The frontend node connects to the backend using ClusterClient. My question is, does ClusterClient have load balancing mechanism so it can properly

Re: [akka-user] Cluster unreachable and a lot of cluster connections

2015-01-22 Thread Johannes Berg
Thanks for the answers, this really explains a lot. I will go back to my abyss and rethink some things. See below some answers/comments. On Thursday, January 22, 2015 at 6:31:01 PM UTC+2, drewhk wrote: Hi Johannes, On Thu, Jan 22, 2015 at 4:53 PM, Johannes Berg jber...@gmail.com

[akka-user] Can not get distributed pub-sub extension to work...

2015-01-22 Thread Thiago Souza
Hello all, I'm getting a hard time trying to get the samples at http://doc.akka.io/docs/akka/snapshot/contrib/distributed-pub-sub.html to work. I've implemented the Subscriber and the Publisher as described in the article and created 2 systems with the following configurations: *seed