Re: Best practices to call small spark jobs as part of REST api

2015-10-12 Thread Xiao Li
The design majorly depends on your use cases. You have to think about the requirements and rank them. For example, if your application cares the response time and is ok to read the stale data, using a nosql database as a middleware is a good option. Good Luck, Xiao Li 2015-10-11 21:00

RE: Best practices to call small spark jobs as part of REST api

2015-10-11 Thread Nuthan Kumar
If the data is also on-demand, spark as back end is also good option.. Sent from Outlook Mail for Windows 10 phone From: Akhil Das Sent: Sunday, October 11, 2015 1:32 AM To: unk1102 Cc: user@spark.apache.org Subject: Re: Best practices to call small spark jobs as part of REST api One

Best practices to call small spark jobs as part of REST api

2015-09-29 Thread unk1102
Hi I would like to know any best practices to call spark jobs in rest api. My Spark jobs returns results as json and that json can be used by UI application. Should we even have direct HDFS/Spark backend layer in UI for on demand queries? Please guide. Thanks much. -- View this message in