Re: [akka-user] Max number of cluster nodes

2017-06-29 Thread Eduardo Fernandes 
Correct, I'm talking about JVM's. Today we use 2 JVM's per machine (for 
actor hot backup).

Thanks.


El jueves, 29 de junio de 2017, 21:18:13 (UTC+2), Patrik Nordwall escribió:
>
> Are we talking about the same thing. When we say nodes we mean JVMs 
> (ActorSystem instances) and typically you would run one or a few JVMs on 
> one machine (EC2/GCE instance).
>
> Do you mean nodes in that sense, or do you mean actors?
>
> On Thu, Jun 29, 2017 at 8:15 PM, Eduardo Fernandes  > wrote:
>
>> Hi again.
>>
>> I'm talking about multiple data-centers, so reducing the chattiness will 
>> be very welcome.
>>
>> The logic unit question is a bit open yet from our side. We're 
>> considering different scenarios. I can talk to you more privately later.
>>
>> Anyway, do you consider that numbers from 20.000 to 50.000 could arise 
>> from your test? Do you expect number from this size more or less? (some 
>> positivism will be welcome :) )
>>
>> Regards.
>>
>>
>>
>> El jueves, 29 de junio de 2017, 20:06:44 (UTC+2), Konrad Malawski 
>> escribió:
>>>
>>> Are those in different data centers or one?
>>> We’re also working on multi-dc features, which limit the chatty-ness 
>>> between datacenters, allowing for even greater scalability.
>>>
>>> The interesting question to ask if they are indeed one logical unit and 
>>> clustering them all indeed is the thing to do or not.
>>> I would be interested in understanding your use case in more detail, can 
>>> you talk about it openly or would you prefer to talk in private, 
>>> if so please ping me on kt...@lightbend.com, thanks!
>>>
>>> — Konrad
>>>
>>>
>>> On 30 June 2017 at 02:59:12, Eduardo Fernandes (edu...@gmail.com) wrote:
>>>
>>> Hi Konrad. Thanks for the quick answer. 
>>>
>>> We're managing from 20.000 up to 50.000 nodes with 8 to 16 Gigs of RAM. 
>>> In fact we could adapt the architecture depending of Akka capacity but the 
>>> upper limiter in a cluster could oblige us to develop a kind of 
>>> inter-cluster communication channel or similar. 
>>>
>>> Thanks again.
>>>
>>> El jueves, 29 de junio de 2017, 19:45:45 (UTC+2), Konrad Malawski 
>>> escribió: 

 We’re currently preparing for such large-scale scalability test on the 
 new remoting.
 How many nodes are you expecting more or less from memory per user 
 estimates etc?

 — Konrad


 On 30 June 2017 at 02:43:43, Eduardo Fernandes (edu...@gmail.com) 
 wrote:

 Hi all. 

 I'm starting a new project and I'm wondering about what is the 
 recommended max number of nodes in an Akka cluster. I've read numbers 
 around 2400 in this test 
 
  but 
 with the new Artery architecture, based on UDP, I suppose that such limit 
 should change. 
 If we manage standard machines on a cloud environment it would be nice 
 to have an idea of about how many nodes we could manage in a single Akka 
 cluster.

 Many thanks in advance for any help on this.

 Regards.

 --
 >> Read the docs: http://akka.io/docs/
 >> Check the FAQ: 
 http://doc.akka.io/docs/akka/current/additional/faq.html
 >> Search the archives: 
 https://groups.google.com/group/akka-user
 ---
 You received this message because you are subscribed to the Google 
 Groups "Akka User List" group.
 To unsubscribe from this group and stop receiving emails from it, send 
 an email to akka-user+...@googlegroups.com.
 To post to this group, send email to akka...@googlegroups.com.
 Visit this group at https://groups.google.com/group/akka-user.
 For more options, visit https://groups.google.com/d/optout.

 --
>>> >> Read the docs: http://akka.io/docs/
>>> >> Check the FAQ: 
>>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>> >> Search the archives: 
>>> https://groups.google.com/group/akka-user
>>> ---
>>> You received this message because you are subscribed to the Google 
>>> Groups "Akka User List" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to akka-user+...@googlegroups.com.
>>> To post to this group, send email to akka...@googlegroups.com.
>>> Visit this group at https://groups.google.com/group/akka-user.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>> -- 
>> >> Read the docs: http://akka.io/docs/
>> >> Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>> >> Search the archives: https://groups.google.com/group/akka-user
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "Akka User List" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to akka-user+...@googlegroups.com .
>> To post to this group, send email to akka...@googlegroups.com

Re: [akka-user] Max number of cluster nodes

2017-06-29 Thread Patrik Nordwall 
Are we talking about the same thing. When we say nodes we mean JVMs
(ActorSystem instances) and typically you would run one or a few JVMs on
one machine (EC2/GCE instance).

Do you mean nodes in that sense, or do you mean actors?

On Thu, Jun 29, 2017 at 8:15 PM, Eduardo Fernandes  wrote:

> Hi again.
>
> I'm talking about multiple data-centers, so reducing the chattiness will
> be very welcome.
>
> The logic unit question is a bit open yet from our side. We're considering
> different scenarios. I can talk to you more privately later.
>
> Anyway, do you consider that numbers from 20.000 to 50.000 could arise
> from your test? Do you expect number from this size more or less? (some
> positivism will be welcome :) )
>
> Regards.
>
>
>
> El jueves, 29 de junio de 2017, 20:06:44 (UTC+2), Konrad Malawski escribió:
>>
>> Are those in different data centers or one?
>> We’re also working on multi-dc features, which limit the chatty-ness
>> between datacenters, allowing for even greater scalability.
>>
>> The interesting question to ask if they are indeed one logical unit and
>> clustering them all indeed is the thing to do or not.
>> I would be interested in understanding your use case in more detail, can
>> you talk about it openly or would you prefer to talk in private,
>> if so please ping me on kt...@lightbend.com, thanks!
>>
>> — Konrad
>>
>>
>> On 30 June 2017 at 02:59:12, Eduardo Fernandes (edu...@gmail.com) wrote:
>>
>> Hi Konrad. Thanks for the quick answer.
>>
>> We're managing from 20.000 up to 50.000 nodes with 8 to 16 Gigs of RAM.
>> In fact we could adapt the architecture depending of Akka capacity but the
>> upper limiter in a cluster could oblige us to develop a kind of
>> inter-cluster communication channel or similar.
>>
>> Thanks again.
>>
>> El jueves, 29 de junio de 2017, 19:45:45 (UTC+2), Konrad Malawski
>> escribió:
>>>
>>> We’re currently preparing for such large-scale scalability test on the
>>> new remoting.
>>> How many nodes are you expecting more or less from memory per user
>>> estimates etc?
>>>
>>> — Konrad
>>>
>>>
>>> On 30 June 2017 at 02:43:43, Eduardo Fernandes (edu...@gmail.com) wrote:
>>>
>>> Hi all.
>>>
>>> I'm starting a new project and I'm wondering about what is the
>>> recommended max number of nodes in an Akka cluster. I've read numbers
>>> around 2400 in this test
>>> 
>>>  but
>>> with the new Artery architecture, based on UDP, I suppose that such limit
>>> should change.
>>> If we manage standard machines on a cloud environment it would be nice
>>> to have an idea of about how many nodes we could manage in a single Akka
>>> cluster.
>>>
>>> Many thanks in advance for any help on this.
>>>
>>> Regards.
>>>
>>> --
>>> >> Read the docs: http://akka.io/docs/
>>> >> Check the FAQ: http://doc.akka.io/docs/akka/c
>>> urrent/additional/faq.html
>>> >> Search the archives: https://groups.google.com/grou
>>> p/akka-user
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "Akka User List" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to akka-user+...@googlegroups.com.
>>> To post to this group, send email to akka...@googlegroups.com.
>>> Visit this group at https://groups.google.com/group/akka-user.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>> --
>> >> Read the docs: http://akka.io/docs/
>> >> Check the FAQ: http://doc.akka.io/docs/akka/c
>> urrent/additional/faq.html
>> >> Search the archives: https://groups.google.com/group/akka-user
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "Akka User List" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to akka-user+...@googlegroups.com.
>> To post to this group, send email to akka...@googlegroups.com.
>> Visit this group at https://groups.google.com/group/akka-user.
>> For more options, visit https://groups.google.com/d/optout.
>>
>> --
> >> Read the docs: http://akka.io/docs/
> >> Check the FAQ: http://doc.akka.io/docs/akka/
> current/additional/faq.html
> >> Search the archives: https://groups.google.com/group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to akka-user+unsubscr...@googlegroups.com.
> To post to this group, send email to akka-user@googlegroups.com.
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>



-- 

Patrik Nordwall
Akka Tech Lead
Lightbend  -  Reactive apps on the JVM
Twitter: @patriknw

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ:

Re: [akka-user] Max number of cluster nodes

2017-06-29 Thread Eduardo Fernandes 
Hi again.

I'm talking about multiple data-centers, so reducing the chattiness will be 
very welcome.

The logic unit question is a bit open yet from our side. We're considering 
different scenarios. I can talk to you more privately later.

Anyway, do you consider that numbers from 20.000 to 50.000 could arise from 
your test? Do you expect number from this size more or less? (some 
positivism will be welcome :) )

Regards.



El jueves, 29 de junio de 2017, 20:06:44 (UTC+2), Konrad Malawski escribió:
>
> Are those in different data centers or one?
> We’re also working on multi-dc features, which limit the chatty-ness 
> between datacenters, allowing for even greater scalability.
>
> The interesting question to ask if they are indeed one logical unit and 
> clustering them all indeed is the thing to do or not.
> I would be interested in understanding your use case in more detail, can 
> you talk about it openly or would you prefer to talk in private, 
> if so please ping me on kt...@lightbend.com , thanks!
>
> — Konrad
>
>
> On 30 June 2017 at 02:59:12, Eduardo Fernandes (edu...@gmail.com 
> ) wrote:
>
> Hi Konrad. Thanks for the quick answer. 
>
> We're managing from 20.000 up to 50.000 nodes with 8 to 16 Gigs of RAM. In 
> fact we could adapt the architecture depending of Akka capacity but the 
> upper limiter in a cluster could oblige us to develop a kind of 
> inter-cluster communication channel or similar. 
>
> Thanks again.
>
> El jueves, 29 de junio de 2017, 19:45:45 (UTC+2), Konrad Malawski 
> escribió: 
>>
>> We’re currently preparing for such large-scale scalability test on the 
>> new remoting.
>> How many nodes are you expecting more or less from memory per user 
>> estimates etc?
>>
>> — Konrad
>>
>>
>> On 30 June 2017 at 02:43:43, Eduardo Fernandes (edu...@gmail.com) wrote:
>>
>> Hi all. 
>>
>> I'm starting a new project and I'm wondering about what is the 
>> recommended max number of nodes in an Akka cluster. I've read numbers 
>> around 2400 in this test 
>> 
>>  but 
>> with the new Artery architecture, based on UDP, I suppose that such limit 
>> should change. 
>> If we manage standard machines on a cloud environment it would be nice to 
>> have an idea of about how many nodes we could manage in a single Akka 
>> cluster.
>>
>> Many thanks in advance for any help on this.
>>
>> Regards.
>>
>> --
>> >> Read the docs: http://akka.io/docs/
>> >> Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>> >> Search the archives: https://groups.google.com/group/akka-user
>> ---
>> You received this message because you are subscribed to the Google Groups 
>> "Akka User List" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to akka-user+...@googlegroups.com.
>> To post to this group, send email to akka...@googlegroups.com.
>> Visit this group at https://groups.google.com/group/akka-user.
>> For more options, visit https://groups.google.com/d/optout.
>>
>> --
> >> Read the docs: http://akka.io/docs/
> >> Check the FAQ: 
> http://doc.akka.io/docs/akka/current/additional/faq.html
> >> Search the archives: https://groups.google.com/group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups 
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to akka-user+...@googlegroups.com .
> To post to this group, send email to akka...@googlegroups.com 
> .
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

Re: [akka-user] Max number of cluster nodes

2017-06-29 Thread Konrad “ktoso” Malawski 
Are those in different data centers or one?
We’re also working on multi-dc features, which limit the chatty-ness
between datacenters, allowing for even greater scalability.

The interesting question to ask if they are indeed one logical unit and
clustering them all indeed is the thing to do or not.
I would be interested in understanding your use case in more detail, can
you talk about it openly or would you prefer to talk in private,
if so please ping me on kt...@lightbend.com, thanks!

— Konrad


On 30 June 2017 at 02:59:12, Eduardo Fernandes (edu...@gmail.com) wrote:

Hi Konrad. Thanks for the quick answer.

We're managing from 20.000 up to 50.000 nodes with 8 to 16 Gigs of RAM. In
fact we could adapt the architecture depending of Akka capacity but the
upper limiter in a cluster could oblige us to develop a kind of
inter-cluster communication channel or similar.

Thanks again.

El jueves, 29 de junio de 2017, 19:45:45 (UTC+2), Konrad Malawski escribió:
>
> We’re currently preparing for such large-scale scalability test on the new
> remoting.
> How many nodes are you expecting more or less from memory per user
> estimates etc?
>
> — Konrad
>
>
> On 30 June 2017 at 02:43:43, Eduardo Fernandes (edu...@gmail.com) wrote:
>
> Hi all.
>
> I'm starting a new project and I'm wondering about what is the recommended
> max number of nodes in an Akka cluster. I've read numbers around 2400 in this
> test
> 
>  but
> with the new Artery architecture, based on UDP, I suppose that such limit
> should change.
> If we manage standard machines on a cloud environment it would be nice to
> have an idea of about how many nodes we could manage in a single Akka
> cluster.
>
> Many thanks in advance for any help on this.
>
> Regards.
>
> --
> >> Read the docs: http://akka.io/docs/
> >> Check the FAQ: http://doc.akka.io/docs/akka/
> current/additional/faq.html
> >> Search the archives: https://groups.google.com/group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to akka-user+...@googlegroups.com.
> To post to this group, send email to akka...@googlegroups.com.
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>
> --
>> Read the docs: http://akka.io/docs/
>> Check the FAQ:
http://doc.akka.io/docs/akka/current/additional/faq.html
>> Search the archives: https://groups.google.com/group/akka-user
---
You received this message because you are subscribed to the Google Groups
"Akka User List" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

Re: [akka-user] Max number of cluster nodes

2017-06-29 Thread Eduardo Fernandes 
Hi Konrad. Thanks for the quick answer.

We're managing from 20.000 up to 50.000 nodes with 8 to 16 Gigs of RAM. In 
fact we could adapt the architecture depending of Akka capacity but the 
upper limiter in a cluster could oblige us to develop a kind of 
inter-cluster communication channel or similar. 

Thanks again.

El jueves, 29 de junio de 2017, 19:45:45 (UTC+2), Konrad Malawski escribió:
>
> We’re currently preparing for such large-scale scalability test on the new 
> remoting.
> How many nodes are you expecting more or less from memory per user 
> estimates etc?
>
> — Konrad
>
>
> On 30 June 2017 at 02:43:43, Eduardo Fernandes (edu...@gmail.com 
> ) wrote:
>
> Hi all. 
>
> I'm starting a new project and I'm wondering about what is the recommended 
> max number of nodes in an Akka cluster. I've read numbers around 2400 in this 
> test 
> 
>  but 
> with the new Artery architecture, based on UDP, I suppose that such limit 
> should change. 
> If we manage standard machines on a cloud environment it would be nice to 
> have an idea of about how many nodes we could manage in a single Akka 
> cluster.
>
> Many thanks in advance for any help on this.
>
> Regards.
>
> --
> >> Read the docs: http://akka.io/docs/
> >> Check the FAQ: 
> http://doc.akka.io/docs/akka/current/additional/faq.html
> >> Search the archives: https://groups.google.com/group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups 
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to akka-user+...@googlegroups.com .
> To post to this group, send email to akka...@googlegroups.com 
> .
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

Re: [akka-user] Max number of cluster nodes

2017-06-29 Thread Konrad “ktoso” Malawski 
We’re currently preparing for such large-scale scalability test on the new
remoting.
How many nodes are you expecting more or less from memory per user
estimates etc?

— Konrad


On 30 June 2017 at 02:43:43, Eduardo Fernandes (edu...@gmail.com) wrote:

Hi all.

I'm starting a new project and I'm wondering about what is the recommended
max number of nodes in an Akka cluster. I've read numbers around 2400 in this
test

but
with the new Artery architecture, based on UDP, I suppose that such limit
should change.
If we manage standard machines on a cloud environment it would be nice to
have an idea of about how many nodes we could manage in a single Akka
cluster.

Many thanks in advance for any help on this.

Regards.

--
>> Read the docs: http://akka.io/docs/
>> Check the FAQ:
http://doc.akka.io/docs/akka/current/additional/faq.html
>> Search the archives: https://groups.google.com/group/akka-user
---
You received this message because you are subscribed to the Google Groups
"Akka User List" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

[akka-user] Max number of cluster nodes

2017-06-29 Thread Eduardo Fernandes 
Hi all.

I'm starting a new project and I'm wondering about what is the recommended 
max number of nodes in an Akka cluster. I've read numbers around 2400 in this 
test 

 but 
with the new Artery architecture, based on UDP, I suppose that such limit 
should change. 
If we manage standard machines on a cloud environment it would be nice to 
have an idea of about how many nodes we could manage in a single Akka 
cluster.

Many thanks in advance for any help on this.

Regards.

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.