The design majorly depends on your use cases. You have to think about the
requirements and rank them.
For example, if your application cares the response time and is ok to read
the stale data, using a nosql database as a middleware is a good option.
Good Luck,
Xiao Li
2015-10-11 21:00
If the data is also on-demand, spark as back end is also good option..
Sent from Outlook Mail for Windows 10 phone
From: Akhil Das
Sent: Sunday, October 11, 2015 1:32 AM
To: unk1102
Cc: user@spark.apache.org
Subject: Re: Best practices to call small spark jobs as part of REST api
One
Hi I would like to know any best practices to call spark jobs in rest api. My
Spark jobs returns results as json and that json can be used by UI
application.
Should we even have direct HDFS/Spark backend layer in UI for on demand
queries? Please guide. Thanks much.
--
View this message in