Re: Best practice for multi-user web controller in front of Spark

Hi, also there is Spindle which was introduced on this list some time ago. I haven't looked into it deeply, but you might gain some valuable insights from their architecture, they are also using Spark to fulfill requests coming from the web. Tobias

RE: Best practice for multi-user web controller in front of Spark

he context of subsequent jobs? Or does something like memcache have to be used? Thanks! David -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Best-practice-for-multi-user-web-controller-in-front-of-Spark-tp1858

Re: Best practice for multi-user web controller in front of Spark

;> every >> job is always comparing some little data structure to the same HDFS corpus >> of data, what is the best pattern to use to cache the RDD's from HDFS so >> they don't have to always be re-constituted from disk? I.e. how can RDD's >> be "s

Re: Best practice for multi-user web controller in front of Spark

to always be re-constituted from disk? I.e. how can RDD's > be "shared" from the context of one job to the context of subsequent jobs? > Or does something like memcache have to be used? > > Thanks! > David > > > > -- > View this message in context: >

Best practice for multi-user web controller in front of Spark

ser-list.1001560.n3.nabble.com/Best-practice-for-multi-user-web-controller-in-front-of-Spark-tp18581.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apac