Re: [akka-user] Re: ANNOUNCE: New Remoting Milestone 2

2016-06-12 Thread Guido Medina
Hi Patrik, About performance, it seems to perform worse than the old akka remote, I usually get averages of 1ms and peaks between 10-20ms: INFO 07:43:01,539 PriceDistributor - Price stats: avg 2.5896ms, max 75ms INFO 07:43:01,540 PriceDistributor - Price stats: avg 2.6026ms, max 75ms INFO 07:

Re: [akka-user] Restarting a stream with a bursty Source

2016-06-12 Thread Brian Topping
Ah, I think I have the answer that I need, it’s to use getAsyncCallback which allows unrestricted entry to the graph. I didn’t see the connection looking through the source and the docs catch my eye for some reason to start with. Cheers, Brian > On Jun 12, 2016, at 2:04 AM, Brian Topping wrote

[akka-user] Re: Runtime issue with Cluster Sharding.

2016-06-12 Thread Ryan Tanner
The mention of VPN has me tingling. Are you trying to join to a cluster across a WAN? On Sunday, June 12, 2016 at 12:20:08 PM UTC-6, kraythe wrote: > > cluster { >> // FIXME cant use static seed nodes config! >> seed-nodes = [ >> *"akka.tcp://application@**w.x.y.z* >> *:2551"*

[akka-user] Re: Runtime issue with Cluster Sharding.

2016-06-12 Thread kraythe
For the next person with this problem, the resolution is that if you even run with one node you have to either configure seed nodes, manually or programmatically join the cluster for the sharding system to work. My error was not specifying the host name exactly in my remoting settings and match

Re: [akka-user] Re: Runtime issue with Cluster Sharding.

2016-06-12 Thread Patrik Nordwall
application is the default ActorSystem name in Play. You can join programatically val cluster = Cluster(system) cluster.join(cluster.selfAddress) /Patrik sön 12 juni 2016 kl. 20:20 skrev kraythe : > cluster { >> // FIXME cant use static seed nodes config! >> seed-nodes = [ >> *"

[akka-user] Re: Runtime issue with Cluster Sharding.

2016-06-12 Thread kraythe
> > cluster { > // FIXME cant use static seed nodes config! > seed-nodes = [ > *"akka.tcp://application@**w.x.y.z* > *:2551"* "akka.tcp://application@localhost:2551" > ] > > So the first line for the seed nodes works but the second doesn't. The problem is that IPs of our

Re: [akka-user] Subclassing Shard Region Actor a good idea?

2016-06-12 Thread Guido Medina
Not really, host one supervisor per shard, have each supervisor hold a compressed list of IDs (so that it knows what IDs is hosting) and just ask on each local cache which shard has some ID, then build a Map supervisors, and for each key send a message, you send one message to each supervisor an

Re: [akka-user] Re: Runtime issue with Cluster Sharding.

2016-06-12 Thread kraythe
There is a joke in there somewhere. :) I just have to figure out how to do that. I have not had luck so far. On Sunday, June 12, 2016 at 12:22:40 PM UTC-5, Patrik Nordwall wrote: > > You can use it on a single node, but you must still join that node to > itself. > > /Patrik > sön 12 juni 2016 k

Re: [akka-user] Subclassing Shard Region Actor a good idea?

2016-06-12 Thread kraythe
Yeah that occurred, the question is that their supervisor is the cluster sharding system so that makes it complicated. On Sunday, June 12, 2016 at 12:36:57 PM UTC-5, Guido Medina wrote: > > You could create a compressed list of Integers and send the message to > their supervisor, that way the c

Re: [akka-user] Subclassing Shard Region Actor a good idea?

2016-06-12 Thread Guido Medina
You could create a compressed list of Integers and send the message to their supervisor, that way the children's supervisor pass that message to each actor ID, assuming your IDs come from a sequence, if you have from 1 to 1m, that can be expressed as [1,20], [25,50], [52], [55..100] where each a

Re: [akka-user] Re: Runtime issue with Cluster Sharding.

2016-06-12 Thread Patrik Nordwall
You can use it on a single node, but you must still join that node to itself. /Patrik sön 12 juni 2016 kl. 18:42 skrev kraythe : > I am wondering if there is some problem since I am running Akka inside of > play 2.5 as an integrated environment. It would suck if thats a problem for > cluster conf

Re: [akka-user] Subclassing Shard Region Actor a good idea?

2016-06-12 Thread kraythe
I don't necessarily want to drop location transparency. I am just concerned because I have millions of actors across the cluster and they have to be started at some point in order to get messages. Also I need to send the same message at times to a ton of them, potentially in the millions. I am

[akka-user] Re: Runtime issue with Cluster Sharding.

2016-06-12 Thread kraythe
I am wondering if there is some problem since I am running Akka inside of play 2.5 as an integrated environment. It would suck if thats a problem for cluster config because that means I would have to separate the systems and that just isnt happening any time soon, if at all. On Friday, June 10

Re: [akka-user] Re: Runtime issue with Cluster Sharding.

2016-06-12 Thread kraythe
Damn the previous reply cut off my config, here it is, Ive cut out everything commented out. I just want to start ONE node for now. Here is my config actually... come on google you can do this! akka { log-dead-letters-during-shutdown = off extensions = [ "com.romix.akka.serialization.kry

Re: [akka-user] Re: Runtime issue with Cluster Sharding.

2016-06-12 Thread kraythe
Can you run cluster Sharding on a single node? Is that not possible? I even tried to use the LevelDB default plugin for journaling and no dice. My Most recent akka config is below. Thanks a bunch for your reply, this one really has me stumped. I have tried 3 dozen things and read every doc and g

Re: [akka-user] Subclassing Shard Region Actor a good idea?

2016-06-12 Thread Guido Medina
And with the new akka remote it might be pointless, you could control some association by for example, deploying children actors of a shard actor, in that matter such children are local to their parent and to their siblings, but that's the end of it, anything else because it will be you against

Re: [akka-user] Subclassing Shard Region Actor a good idea?

2016-06-12 Thread Justin du coeur
On Sat, Jun 11, 2016 at 2:14 PM, kraythe wrote: > It doesnt seem very specific to my problem scope so I am wondering if > there is a better way to do this that I have missed. > The crux of the problem here is that you're fighting one of the central design tenets of Akka: location transparency.

Re: [akka-user] Re: Runtime issue with Cluster Sharding.

2016-06-12 Thread Justin du coeur
Well, the problem *looks* to me like the cluster isn't joining up at all. So if you don't do auto join, then you need to set that up programmatically. (Don't recall offhand how that works -- the seed-node approach is usual.) On Sat, Jun 11, 2016 at 5:38 PM, kraythe wrote: > What if I dont want

Re: [akka-user] Re: ANNOUNCE: New Remoting Milestone 2

2016-06-12 Thread Patrik Nordwall
I have seen this, and the reason is full disk as you found. We have not yet figured out why its not allways removing all files on shutdown. We try to remove on shutdown. I saw that it left directories that did not correspond to the directory of the embedded media driver. Need further investigation.

Re: [akka-user] Re: ANNOUNCE: New Remoting Milestone 2

2016-06-12 Thread Guido Medina
I read that if you start the driver you have to stop it in order to delete the sampling folder which for Linux is usually at /dev/shm (shared memory) so, a bug? On Sunday, June 12, 2016 at 12:52:59 PM UTC+1, Guido Medina wrote: > > I fixed this on Linux by deleting the folders created by aeron: >

Re: [akka-user] Re: ANNOUNCE: New Remoting Milestone 2

2016-06-12 Thread Guido Medina
I fixed this on Linux by deleting the folders created by aeron: rm -Rf /dev/shm/aeron-* Linux shared memory get's full after restarting micro-services few times, maybe this is some cleanup that needs to be done as part of ActorSystem shutdown? Or maybe an aeron option I'm missing that should mar

Re: [akka-user] Re: ANNOUNCE: New Remoting Milestone 2

2016-06-12 Thread Guido Medina
Ignore, it is part of Aeron troubleshooting, a shared memory issue, need to adjust stuff... On Sunday, June 12, 2016 at 11:14:16 AM UTC+1, Guido Medina wrote: > > Hi Patrik, > > Have you seen this before? It is happening on one PC but not in the other, > I changed *advanced.idle-cpu-level* to 3,

Re: [akka-user] Re: ANNOUNCE: New Remoting Milestone 2

2016-06-12 Thread Guido Medina
Hi Patrik, Have you seen this before? It is happening on one PC but not in the other, I changed *advanced.idle-cpu-level* to 3, got that error, then removed that setting and recompiled but still getting the following exception: ERROR 11:05:07,979 ArteryTransport(akka://DevCluster) - Aeron error

[akka-user] Restarting a stream with a bursty Source

2016-06-12 Thread Brian Topping
Hi all, I have a very small stream that takes data from a GraphStage and pushes it to a file: val (killSwitch, flow) = dataSource .viaMat(KillSwitches.single)(Keep.right) .toMat(FileIO.toPath(Paths.get("/home/brian/test")))(Keep.both) .run() The dataSource is a GraphStage that takes data