Re: Processing multiple request in cluster

2014-09-25 Thread Akhil Das
You can try spark on Mesos or Yarn since they have lot more support for scheduling and all Thanks Best Regards On Thu, Sep 25, 2014 at 4:50 AM, Subacini B subac...@gmail.com wrote: hi All, How to run concurrently multiple requests on same cluster. I have a program using *spark streaming

Re: Processing multiple request in cluster

2014-09-25 Thread Mayur Rustagi
There are two problems you may be facing. 1. your application is taking all resources 2. inside your application task submission is not scheduling properly. for 1 you can either configure your app to take less resources or use mesos/yarn types scheduler to dynamically change or juggle resources

Processing multiple request in cluster

2014-09-24 Thread Subacini B
hi All, How to run concurrently multiple requests on same cluster. I have a program using *spark streaming context *which reads* streaming data* and writes it to HBase. It works fine, the problem is when multiple requests are submitted to cluster, only first request is processed as the entire