Re: Livy Scalability Data

2021-04-18 Thread Akshat Bordia 
Hi,

Thanks for sharing the details. Would you be able to share the result from
your Jmeter experiment? Did you run it for both interactive and batch
sessions?

Regarding scaling with K8S, is it still a single node based HA or are you
scaling horizontally somehow? If you are scaling horizontally, could you
please share some details on how you are achieving this? Appreciate your
help.

Thanks,
Akshat

On Sun, Apr 18, 2021 at 9:12 PM Jean-Baptiste Onofre 
wrote:

> Hi,
>
> Some months ago I did some performance benchmark with jmeter on the REST
> layer.
> About HA, I wrapped my Livy setup in docker and scale with k8s (still the
> REST API).
>
> Regards
> JB
>
> > Le 17 avr. 2021 à 19:18, Akshat Bordia  a
> écrit :
> >
> > Hi,
> >
> > I have a few queries regarding Livy scalability. Do we have any
> experiments
> > run which addresses the following question? Appreciate any help.
> >
> >
> > 1. How many sessions can a Livy server handle at a time (and with what
> > configuration)?
> > 2. In particular, how many interactive sessions can be running at a time?
> > (Given that the driver will be launched on Livy machine in case of client
> > mode.)
> > 3. Given that the JIRA for multi-active HA in Livy
> >  is open, are there any
> > other recommendations to scale it horizontally?
> >
> > Thanks,
> > Akshat
> >
> > --
> > Regards,
> > Akshat Bordia
> > Email id : [email protected]
> > Contact No.:+91-8011228476
> >+91-9461054710
>
>

-- 
Regards,
Akshat Bordia
Email id : [email protected]
Contact No.:+91-8011228476
+91-9461054710

Re: Livy Scalability Data

2021-04-18 Thread Jean-Baptiste Onofre 
Hi,

Some months ago I did some performance benchmark with jmeter on the REST layer.
About HA, I wrapped my Livy setup in docker and scale with k8s (still the REST 
API).

Regards
JB

> Le 17 avr. 2021 à 19:18, Akshat Bordia  a écrit :
> 
> Hi,
> 
> I have a few queries regarding Livy scalability. Do we have any experiments
> run which addresses the following question? Appreciate any help.
> 
> 
> 1. How many sessions can a Livy server handle at a time (and with what
> configuration)?
> 2. In particular, how many interactive sessions can be running at a time?
> (Given that the driver will be launched on Livy machine in case of client
> mode.)
> 3. Given that the JIRA for multi-active HA in Livy
>  is open, are there any
> other recommendations to scale it horizontally?
> 
> Thanks,
> Akshat
> 
> -- 
> Regards,
> Akshat Bordia
> Email id : [email protected]
> Contact No.:+91-8011228476
>+91-9461054710

Livy Scalability Data

2021-04-17 Thread Akshat Bordia 
Hi,

I have a few queries regarding Livy scalability. Do we have any experiments
run which addresses the following question? Appreciate any help.


1. How many sessions can a Livy server handle at a time (and with what
configuration)?
2. In particular, how many interactive sessions can be running at a time?
(Given that the driver will be launched on Livy machine in case of client
mode.)
3. Given that the JIRA for multi-active HA in Livy
 is open, are there any
other recommendations to scale it horizontally?

Thanks,
Akshat

-- 
Regards,
Akshat Bordia
Email id : [email protected]
Contact No.:+91-8011228476
+91-9461054710