I would say that the first three are all used pretty heavily. Mesos
was the first one supported (long ago), the standalone is the
simplest and most popular today, and YARN is newer but growing a lot
in activity.
SIMR is not used as much... it was designed mostly for environments
where users had access to Hadoop and couldn't easily install Spark.
Now most Hadoop vendors bundle Spark anyways, so it's not needed.
On Sun, Sep 7, 2014 at 6:29 PM, Otis Gospodnetic
otis.gospodne...@gmail.com wrote:
Hi,
I'm trying to determine which Spark deployment models are the most popular -
Standalone, YARN, Mesos, or SIMR. Anyone knows?
I thought I'm use search-hadoop.com to help me figure this out and this is
what I found:
1) Standalone
http://search-hadoop.com/?q=standalonefc_project=Sparkfc_type=mail+_hash_+user
(seems the most popular?)
2) YARN
http://search-hadoop.com/?q=yarnfc_project=Sparkfc_type=mail+_hash_+user
(almost as popular as standalone?)
3) Mesos
http://search-hadoop.com/?q=mesosfc_project=Sparkfc_type=mail+_hash_+user
(less popular than yarn or standalone)
4) SIMR
http://search-hadoop.com/?q=simrfc_project=Sparkfc_type=mail+_hash_+user
(no mentions?)
This is obviously not very accurate but is the order right?
Thanks,
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr Elasticsearch Support * http://sematext.com/
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
