Re: [akka-user] Akka stream element meta data

2018-02-18 Thread Christopher Hunt
> On 18 Feb 2018, at 3:18 pm, Christopher Hunt wrote: > > It just occurred to me that compound types might be the way to solve this eg > `new Element with OOB[Span]`. I shall experiment further... and then PR the > Akka stream doco with a section on OOB/instrumentation if

[akka-user] How to build the Akka API documentation for offline use?

2018-02-18 Thread Thai
Hi All, I noticed that the Akka API doc is unavailable to download like Scala, so I git-cloned the akka and ran `doc` in sbt. However the API docs were separated like this: ./akka/akka-cluster-sharding/target/api ./akka/akka-contrib/target/api ./akka/akka-cluster-tools/target/api

Re: [akka-user] Akka Actor usage in Apache Spark and Apache Flink

2018-02-18 Thread Unmesh Joshi
Thanks Konrad. What I was interested in was what use cases both Spark and Flink used Actors for specifically. Are there any notes/docs around those that anyone knows of? On Monday, 19 February 2018 07:33:43 UTC+5:30, Konrad Malawski wrote: > > Hi there, > There's been some confusion about how

Re: [akka-user] Getting a timeout error when testing a stream with mapAsync stage

2018-02-18 Thread Jakub Kahovec
I had another thought about this behaviour and two things came to my mind. First, it might be worth mentioning this somewhere in the documentation about testing as other users might also experience this and I think didn't see this mentioned anywhere in the docs. And second, is it safe to use

Re: [akka-user] Akka Actor usage in Apache Spark and Apache Flink

2018-02-18 Thread Unmesh Joshi
Thanks for sharing. Trying to find and understand the use cases where Actors are used in other open source projects. On Mon, Feb 19, 2018 at 11:04 AM, Konrad Malawski < konrad.malaw...@lightbend.com> wrote: > Another pretty big Akka based project (as in, really using Akka a lot) is > Apache

Re: [akka-user] Akka Actor usage in Apache Spark and Apache Flink

2018-02-18 Thread Konrad Malawski
Hi there, There's been some confusion about how Spark used Akka, so let's clear that up first: It wasn't really core to any of the operations or core of Spark, and was used only to orchestrate some things, it was using raw Akka Remoting (which is discouraged, use Cluster instead due to the

Re: [akka-user] Akka stream out of band data

2018-02-18 Thread Viktor Klang
How do you deal with M:N ports or X:Y element permutations? -- Cheers, √ On Feb 18, 2018 01:53, "Christopher Hunt" wrote: > Hi there, > > I’ve been wondering recently if there’s been any thought around carrying > out of band data through an Akka Stream in the spirit of

Re: [akka-user] Akka stream out of band data

2018-02-18 Thread Christopher Hunt
> On 18 Feb 2018, at 21:10, Viktor Klang wrote: > > How do you deal with M:N ports or X:Y element permutations? No idea. :-) My main question is, has there been any thinking around associating metadata with elements in the past? Thanks. Cheers C -- >>

Re: [akka-user] Akka stream out of band data

2018-02-18 Thread 'Roland Kuhn' via Akka User List
Sent from my iPhone > On 18. Feb 2018, at 11:53, Christopher Hunt wrote: > > > >> On 18 Feb 2018, at 21:10, Viktor Klang wrote: >> >> How do you deal with M:N ports or X:Y element permutations? > > No idea. :-) My main question is, has there

[akka-user] Akka Actor usage in Apache Spark and Apache Flink

2018-02-18 Thread Unmesh Joshi
Hi, Apache Spark used to use Akka Actors (which is replaced by Netty now) and Apache Flink uses Actors. I am trying to understand the use case of Actor usage in both these frameworks. Any pointers for help? Thanks, Unmesh -- >> Read the docs: http://akka.io/docs/ >>

Re: [akka-user] Akka stream out of band data

2018-02-18 Thread Christopher Hunt
Hey Roland > On 18 Feb 2018, at 22:45, 'Roland Kuhn' via Akka User List > wrote: > > Yes, we considered it with varying depth on multiple occasions and never > found a satisfactory solution. Since graph stages are free to transform not > only individual elements