[akka-user] Re: Cassandra persistence - with Cassandra 2.2.7 + akka-persistence-cassandra-0.7 + akka 2.4.8 - not working

2016-08-02 Thread Muthukumaran Kothandaraman
Just to unblock myself I had moved ahead with Cassandra 3.7. I do have some 
constraints in not moving to 3.x yet and have to stick to 2.x for an 
upcoming work. Will definitely try out the compat flag. 


Regards
Muthu


-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.


Re: [akka-user] Re: Performant SequenceID Generation

2016-08-02 Thread Patrik Nordwall
You're welcome

tis 2 aug. 2016 kl. 19:40 skrev Dagny T :

>
> Thank you, Jim and Patrik for your responses!
>
> Looking into the VersionVector.scala.
> Always amazed at what a good source of learning it is to see
> well-structured, code-reviewed Open Source(!)
>
> THANKS again!
> D
>
> On Thursday, July 28, 2016 at 11:23:46 AM UTC-7, Dagny T wrote:
>>
>>
>> So, in the context of async messaging systems where you can't predict the
>> sequencing of incoming messages.
>>
>> Typically, you have in the message (or event) payload:
>> - an Originating Entity Unique ID
>> - then a Version or Sequence ID for each incremental state-change event
>> on that originating entity
>>
>> So, if I need to initialize EntityID Generation, as well as its sub
>> VersionID Generation across a distributed cluster;
>>
>> Does AKKA provide an out-of-box configurable Sequence ID Generator
>> service cluster?
>> Otherwise, how is this typically handled in AKKA, and where can I get
>> sample code which demonstrates this?
>>
>> THANKS!
>> D
>>
> --
> >> Read the docs: http://akka.io/docs/
> >> Check the FAQ:
> http://doc.akka.io/docs/akka/current/additional/faq.html
> >> Search the archives: https://groups.google.com/group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to akka-user+unsubscr...@googlegroups.com.
> To post to this group, send email to akka-user@googlegroups.com.
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.


[akka-user] Re: from akka.persistence.journal.ReplayFilter Invalid replayed event [1] in buffer from old writer

2016-08-02 Thread Eric Swenson
I'm getting this error consistently now, and don't know why this is 
happening nor what to do about it.  I form the persistentId this way:

override def persistenceId: String = self.path.parent.parent.name + "-" 
+ self.path.name

So I don't see how I could have two persisters with the same id.  I'm 
unable to bring up my akka cluster due to this error.

Any suggestions?  I'm running akka 2.4.8 with akka.persistence:

journal.plugin = "cassandra-journal"
snapshot-store.plugin = "cassandra-snapshot-store"


On Monday, April 25, 2016 at 3:34:21 AM UTC-7, Tim Pigden wrote:
>
> Hi
> I'm getting this message. I'm probably doing something wrong but any idea 
> what that might be? I know what messages I'm persisting and this particular 
> test is one in which I kill off my persistor and restart it.
> Or does it indicate the message is failing to deserialize or something 
> like that
>
> 2016-04-25 10:33:47,570 - ERROR - from 
> com.optrak.opkakka.ddd.persistence.SimplePersistor Persistence failure when 
> replaying events for persistenceId [shd-matrix-testId]. Last known sequence 
> number [0] 
> java.lang.IllegalStateException: Invalid replayed event [1] in buffer from 
> old writer [f6bd09c4-1f1c-4710-8cf6-c6f0776f39d3] with persistenceId 
> [shd-matrix-testId]
>at 
> akka.persistence.journal.ReplayFilter$$anonfun$receive$1.applyOrElse(ReplayFilter.scala:125)
>at akka.actor.Actor$class.aroundReceive(Actor.scala:480)
>at 
> akka.persistence.journal.ReplayFilter.aroundReceive(ReplayFilter.scala:50)
>
>
>
> Any suggests much appreciated!
>
>
>
>
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.


[akka-user] [ANNOUNCE] Akka 2.4.9-RC1 Released! (Akka HTTP Performance and Entity Streaming)

2016-08-02 Thread Konrad 'ktoso' Malawski


Dear hAkkers,

We—the Akka committers—are pleased to be able to announce the availability 
of Akka 2.4.9-RC1. 

This version is focused on Akka HTTP performance improvements as well as 
introducing the entity streaming feature which we’ll discuss below. 

Highlights of the performance improvements include:


   - 
   
   Overall Akka HTTP throughput and transfer rate has been improved by 
   30-40%
   - 
   
   Performance is on-par or better than Spray. 
   - 
  
  Matching it both in raw throughput as well as latency distribution 
  across a spectrum of request rates.
  - 
  
  We measured an overall improvement of ~14% over Spray
  - 
   
   Short lived connections throughput, which remains to be the worst-case 
   scenario for Akka HTTP thought remains rare in the real world (due to 
   connection pooling), has been doubled.
   - 
   
   Given our EC2 infrastructure (m4.2xlarge instances) the server currently 
   reaches a maximum of ~160.000 “ping / pong” requests per second (measured 
   using 100 concurrent connections).
   

While we did not have the chance to benchmark using dedicated boxes this 
time, based on experience from previous Spray benchmark rounds we expect 
the top throughput to be much higher on actual hardware than it is on EC2. 

One might want to remind remind oneself the good old post about Spray’s 
benchmarking results  
back in 2013 when it won a benchmarking round, achieving 30k reqs/sec on 
EC2 (m1.large) and 197k reqs/sec on dedicated i7 machines (using 256 
connections).

This release also features a new feature that we think Streaming API 
authors will be delighted to see: EntityStreamingSupport. 

It makes marshalling of Akka Streams into/from HTTP requests and responses 
as simple as adding enabling streaming and calling complete(tweets), given 
tweets was a Source[Tweet, _]. 

Learn more about it in the Entity Streaming section of the documentation 

.

We would like to encourage Akka HTTP users to try out this Release 
Candidate and provide feedback or report regressions if you find any. 

API has remained largely unchanged, though the usual experimental module 
incompatibility caveat still remains so upgrading should be simple. 

You may want to refer to the migration guide 
,
 
as some classes moved to more appropriate places. A stable 2.4.9 should 
follow shortly after we’ve gathered some community feedback.
Next steps for Akka HTTP

Having that said, we’ll want to officially announce the end-of-life of 
Spray and confidently request users to upgrade to Akka HTTP. 

Yes, this means we’ll soon be lifting the experimental flag from Akka HTTP. 

The exact timeline for this is yet to be decided, as we want to discuss 
with the community about the best way to go about this.

The other question that is on everyone’s minds is one about HTTP/2.

We’d like to announce that we’ll spend some time working on an HTTP/2 
Proof-of-Content within a few months. 

You can follow our sprint plans on akka-meta be up to date about our sprint 
plans and progress.


Credits:

commits added removed

  3957531748 Konrad `ktoso` Malawski

  11 693 239 Johan Andrén

   7 828 295 Endre Sándor Varga

   6 776 410 Hawstein

   5 171  81 Nafer Sanabria

   2   4   4 kenji yoshida

   2  55  22 Alexander Golubev

   2 111   3 Stefano Bonetti

   2  41  12 Richard Imaoka

   1  25   0 Lev Khomich

   1  41  15 Łukasz Dubiel

   1  54  22 Ian Clegg

   1  37  22 priyanka

   1  53  18 Nikolay Donets

   1 202   1 Richard S. Imaoka

   1   2   3 Jacek Kunicki

   1   2   2 abesanderson

   1   7   2 Alexei

   1   6   6 Thomas Szymanski

   1   1   0 Vadim Semenov

   1 246   7 Peter Barron

   1  16   7 Tim Harper

   1  40   0 Ivan Lorenz

   1   1   1 Morton Fox

   1   1   1 Yaroslav Klymko

   1   2   2 Alexandre Tamborrino

   1  20   0 Harit Himanshu



In this patch release we closed 43 tickets, and got the help from 24 
contributors, thanks a lot! 

The complete list of closed tickets can be found in the 2.4.9-RC1 milestone 
 on GitHub. 

Happy hakking!

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to 

[akka-user] RoundRobinPool with remote routees

2016-08-02 Thread Gabor Kolok
Hi,

I am creating a router with the following code in an Actor:

  val router: ActorRef = {
val addresses = Seq(
  Address("akka.tcp", "workersSystem", "localhost", 2555)
)
context.actorOf(
  RemoteRouterConfig(RoundRobinPool(1), addresses).props(Props[
WorkerActor]))
  }

The workers are created locally (in the same system where the parent Actor 
is created) without error message.
It seems that addresses are ignored.
What could be the problem?

Thanks
Gabor



-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.


[akka-user] Re: Performant SequenceID Generation

2016-08-02 Thread Dagny T

Thank you, Jim and Patrik for your responses!

Looking into the VersionVector.scala.  
Always amazed at what a good source of learning it is to see 
well-structured, code-reviewed Open Source(!)

THANKS again!
D

On Thursday, July 28, 2016 at 11:23:46 AM UTC-7, Dagny T wrote:
>
>
> So, in the context of async messaging systems where you can't predict the 
> sequencing of incoming messages.
>
> Typically, you have in the message (or event) payload:
> - an Originating Entity Unique ID
> - then a Version or Sequence ID for each incremental state-change event on 
> that originating entity
>
> So, if I need to initialize EntityID Generation, as well as its sub 
> VersionID Generation across a distributed cluster; 
>
> Does AKKA provide an out-of-box configurable Sequence ID Generator service 
> cluster?
> Otherwise, how is this typically handled in AKKA, and where can I get 
> sample code which demonstrates this?
>
> THANKS!
> D
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.


Re: [akka-user] Re: How to read XML inputstream (with SAX parser) received by akka-http?

2016-08-02 Thread JY
I forgot to specify that flow I have to analyze weigh between 1 and 5 GB, 
and I have to extract the value of a dozen tags, which is why we can't load 
all data into memory, and that we've choose SAX :)



Le mardi 2 août 2016 11:23:18 UTC+2, JY a écrit :
>
> In fact, (I will try to be both more specific and more generic):
>
> I have to read (via InputStream because of SAX parser) the data when the 
> first bits are received.
>
> I'm not able to wait and load all data into memory before to use it.
>
> I can not yet find the way to do it.
>
> I need a little help :)
>
>
>
> Le mardi 2 août 2016 10:31:01 UTC+2, Konrad Malawski a écrit :
>>
>> Yeah, that'd be good to collect usecases and demadn there.
>> Though with SAX it won't be automagical ever, they always require 
>> manually writing the parsing AFAIR
>>
>> -- 
>> Konrad `ktoso` Malawski
>> Akka  @ Lightbend 
>>
>> On 2 August 2016 at 10:29:21, André (andre.r...@gmail.com) wrote:
>>
>> Maybe you can add your use case to 
>> https://github.com/akka/akka/issues/16210.
>>
>> On Tuesday, August 2, 2016 at 10:12:13 AM UTC+2, JY wrote: 
>>>
>>> I am new with AKKA and AKKA HTTP.
>>>
>>> I have to write a HTTP server application that reads a lot very big XML 
>>> data flows (via HTTP PUT method) and parses this Data with a SAX parser.
>>>
>>> How can I do that with akka-http?
>>>
>>> Thanx in advance for your help.
>>>
>> --
>> >> Read the docs: http://akka.io/docs/
>> >> Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>> >> Search the archives: https://groups.google.com/group/akka-user
>> ---
>> You received this message because you are subscribed to the Google Groups 
>> "Akka User List" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to akka-user+...@googlegroups.com.
>> To post to this group, send email to akka...@googlegroups.com.
>> Visit this group at https://groups.google.com/group/akka-user.
>> For more options, visit https://groups.google.com/d/optout.
>>
>>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.


Re: [akka-user] Re: Performant SequenceID Generation

2016-08-02 Thread Patrik Nordwall
There is a public version vector implementation in akka-distributed-data,
if that is what you are looking for.
https://github.com/akka/akka/blob/master/akka-distributed-data/src/main/scala/akka/cluster/ddata/VersionVector.scala

/Patrik
fre 29 juli 2016 kl. 05:08 skrev Jim Hazen :

> I think what you're looking for here is called a vector clock.  Akka uses
> them internally within its clustering implementation, however the
> implementation isn't public.
>
> There are some open source scala/java implementations you might want to
> evaluate (Google).  I don't have experience with any of them.
>
> The problem is more annoying than it sounds.  You need a causal sequence
> of events (ie, this mutation happened from observation of state x), not
> just an increasing ID.  Vclocks help with that.  But then your app needs to
> deal with merge conflicts and resolution.  Plus your clients need to be
> vclock aware since you pass the current vclock along with your update.
> There are additional issues with vector clocks as well, but you're asking
> to solve a very complex distributed problem.
>
> The Basho guys (developers of the distributed Riak DB) have some good
> material on vclocks.  They've also apparently moved from vclocks to Dotted
> Version Vectors.
>
> If you want to start down the rabbit hole start here:
>
> http://docs.basho.com/riak/kv/2.1.4/learn/concepts/causal-context/#dotted-version-vectors
>
> If you want to take a look at an implementation (and detailed description
> of how it works) start here (the code is in Erlang, but the conceptual
> diagrams of the algorithm are portable to any lang):
> https://github.com/ricardobcl/Dotted-Version-Vectors
>
> --
> >> Read the docs: http://akka.io/docs/
> >> Check the FAQ:
> http://doc.akka.io/docs/akka/current/additional/faq.html
> >> Search the archives: https://groups.google.com/group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to akka-user+unsubscr...@googlegroups.com.
> To post to this group, send email to akka-user@googlegroups.com.
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.


Re: [akka-user] Cassandra persistence - with Cassandra 2.2.7 + akka-persistence-cassandra-0.7 + akka 2.4.8 - not working

2016-08-02 Thread Patrik Nordwall
Have you tried version 0.17 with the compat flag described in the readme?
https://github.com/akka/akka-persistence-cassandra/blob/master/README.md

/Patrik
lör 30 juli 2016 kl. 16:56 skrev Justin du coeur :

> I see you got things working, which is great.  I just wanted to caution:
>
> On Sat, Jul 30, 2016 at 8:29 AM, Muthukumaran Kothandaraman <
> muthu.kmk2...@gmail.com> wrote:
>
>> I assume my application.conf below is fine because I do not see any
>> exceptions.
>>
>
> As a rule of thumb, this isn't a safe assumption.  Config-file format is
> weakly typed, remember -- it's just strings -- and it does *not*
> automatically detect errors.  Some mistakes will get caught by the relevant
> libraries, but in general if you make a typo in the name, and the library
> has a default value for that config key, the error will be silently
> ignored...
>
> --
> >> Read the docs: http://akka.io/docs/
> >> Check the FAQ:
> http://doc.akka.io/docs/akka/current/additional/faq.html
> >> Search the archives: https://groups.google.com/group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to akka-user+unsubscr...@googlegroups.com.
> To post to this group, send email to akka-user@googlegroups.com.
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.


Re: [akka-user] Re: How to read XML inputstream (with SAX parser) received by akka-http?

2016-08-02 Thread Konrad Malawski
Yeah, that'd be good to collect usecases and demadn there.
Though with SAX it won't be automagical ever, they always require manually
writing the parsing AFAIR

-- 
Konrad `ktoso` Malawski
Akka  @ Lightbend 

On 2 August 2016 at 10:29:21, André (andre.ruedi...@gmail.com) wrote:

Maybe you can add your use case to https://github.com/akka/akka/issues/16210
.

On Tuesday, August 2, 2016 at 10:12:13 AM UTC+2, JY wrote:
>
> I am new with AKKA and AKKA HTTP.
>
> I have to write a HTTP server application that reads a lot very big XML
> data flows (via HTTP PUT method) and parses this Data with a SAX parser.
>
> How can I do that with akka-http?
>
> Thanx in advance for your help.
>
--
>> Read the docs: http://akka.io/docs/
>> Check the FAQ:
http://doc.akka.io/docs/akka/current/additional/faq.html
>> Search the archives: https://groups.google.com/group/akka-user
---
You received this message because you are subscribed to the Google Groups
"Akka User List" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.


[akka-user] Re: How to read XML inputstream (with SAX parser) received by akka-http?

2016-08-02 Thread André
Maybe you can add your use case 
to https://github.com/akka/akka/issues/16210.

On Tuesday, August 2, 2016 at 10:12:13 AM UTC+2, JY wrote:
>
> I am new with AKKA and AKKA HTTP.
>
> I have to write a HTTP server application that reads a lot very big XML 
> data flows (via HTTP PUT method) and parses this Data with a SAX parser.
>
> How can I do that with akka-http?
>
> Thanx in advance for your help.
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.


[akka-user] How to read XML inputstream (with SAX parser) received by akka-http?

2016-08-02 Thread JY
I am new with AKKA and AKKA HTTP.

I have to write a HTTP server application that reads a lot very big XML 
data flows (via HTTP PUT method) and parses this Data with a SAX parser.

How can I do that with akka-http?

Thanx in advance for your help.

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.