Re: Revisiting Online serving of Spark models?

2018-07-12 Thread Maximiliano Felice
> All details are in the meetup link above… > > >>>>>> > > >>>>>> @holden/felix/nick/joseph/maximiliano/saikat/leif: you’re more > than > > >>>>>> welcome to give a talk. I can move things around to make room. > > >&g

Re: Revisiting Online serving of Spark models?

2018-07-03 Thread Matei Zaharia
ate on the direction of the > >>>>>> Databricks proprietary ML Serving export format which is similar to > >>>>>> PMML > >>>>>> but not a standard in any way. > >>>>>> > >>>>>> Also, the Databricks ML Serving Runtime is

Re: Revisiting Online serving of Spark models?

2018-06-12 Thread Vadim Chelyshov
I've almost completed a library for speeding up current spark models serving - https://github.com/Hydrospheredata/fastserving. It depends on spark, but it provides a way to turn spark logical plan from dataframe sample, that was passed into pipeline/transformer, into an alternative transformer that

Re: Revisiting Online serving of Spark models?

2018-06-11 Thread Holden Karau
;>>>>> <https://www.meetup.com/Advanced-Spark-and-TensorFlow-Meetup/> > ; > >>>>>> (85,000 > >>>>>> Global Members) > >>>>>> > >>>>>> > >>>>>> > >>>>&g

Re: Revisiting Online serving of Spark models?

2018-06-11 Thread Liang-Chi Hsieh
seldorf * >>>>>> *Try our PipelineAI Community Edition with GPUs and TPUs!! >>>>>> <http://community.pipeline.ai/>* >>>>>> >>>>>> >>>>>> On May 30, 2018, at 9:32 AM, Felix Cheung < > felixcheung_m@ > &

Re: Revisiting Online serving of Spark models?

2018-06-06 Thread Holden Karau
; — >>>>> >>>>> >>>>> *Chris Fregly *Founder @ *PipelineAI* <https://pipeline.ai/> (100,000 >>>>> Users) >>>>> Organizer @ *Advanced Spark and TensorFlow Meetup* >>>>> <https://www.meetup.com/Adv

Re: Revisiting Online serving of Spark models?

2018-06-06 Thread Maximiliano Felice
-and-TensorFlow-Meetup/> (85,000 >>>> Global Members) >>>> >>>> >>>> >>>> *San Francisco - Chicago - Austin - >>>> Washington DC - London - Dusseldorf * >>>> *Try our PipelineAI Community Edition with GPUs and TPUs!! >>&g

Re: Revisiting Online serving of Spark models?

2018-06-05 Thread Nick Pentreath
dorf >>> * >>> *Try our PipelineAI Community Edition with GPUs and TPUs!! >>> <http://community.pipeline.ai/>* >>> >>> >>> On May 30, 2018, at 9:32 AM, Felix Cheung >>> wrote: >>> >>> Hi! >>> >>&g

Re: Revisiting Online serving of Spark models?

2018-06-03 Thread Holden Karau
>> >> Hi! >> >> Thank you! Let’s meet then >> >> June 6 4pm >> >> Moscone West Convention Center >> 800 Howard Street, San Francisco, CA 94103 >> <https://maps.google.com/?q=800+Howard+Street,+San+Francisco,+CA+94103&entry=gmail&a

Re: Revisiting Online serving of Spark models?

2018-06-02 Thread Maximiliano Felice
much noise for dev@) > > To paraphrase Joseph, we will use this to kick off the discusssion and > post notes after and follow up online. As for Seattle, I would be very > interested to meet in person lateen and discuss ;) > > > _ > From: Saikat Kan

Re: Revisiting Online serving of Spark models?

2018-06-01 Thread Saikat Kanjilal
ssion and post notes after and follow up online. As for Seattle, I would be very interested to meet in person lateen and discuss ;) _ From: Saikat Kanjilal mailto:sxk1...@hotmail.com>> Sent: Tuesday, May 29, 2018 11:46 AM Subject: Re: Revisiting Online

Re: Revisiting Online serving of Spark models?

2018-05-31 Thread Chris Fregly
nline. As for Seattle, I would be very interested > to meet in person lateen and discuss ;) > > > _________ > From: Saikat Kanjilal > Sent: Tuesday, May 29, 2018 11:46 AM > Subject: Re: Revisiting Online serving of Spark models? > To: Maximiliano Felice > Cc: Felix Cheung , Hold

Re: Revisiting Online serving of Spark models?

2018-05-30 Thread Denny Lee
> From: Saikat Kanjilal > Sent: Tuesday, May 29, 2018 11:46 AM > > Subject: Re: Revisiting Online serving of Spark models? > To: Maximiliano Felice > Cc: Felix Cheung , Holden Karau < > hol...@pigscanfly.ca>, Joseph Bradley , Leif Walsh > ,

Re: Revisiting Online serving of Spark models?

2018-05-30 Thread Felix Cheung
: Re: Revisiting Online serving of Spark models? To: Maximiliano Felice Cc: Felix Cheung , Holden Karau , Joseph Bradley , Leif Walsh , dev Would love to join but am in Seattle, thoughts on how to make this work? Regards Sent from my iPhone On May 29, 2018, at 10:35 AM, Maximiliano Felice

Re: Revisiting Online serving of Spark models?

2018-05-29 Thread Saikat Kanjilal
otmail.com>> wrote: Bump. From: Felix Cheung mailto:felixcheun...@hotmail.com>> Sent: Saturday, May 26, 2018 1:05:29 PM To: Saikat Kanjilal; Maximiliano Felice; Joseph Bradley Cc: Leif Walsh; Holden Karau; dev Subject: Re: Revisiting Online serving of Spa

Re: Revisiting Online serving of Spark models?

2018-05-29 Thread Maximiliano Felice
May 29, 2018 9:47 AM > Subject: Re: Revisiting Online serving of Spark models? > To: Felix Cheung > Cc: Saikat Kanjilal , Maximiliano Felice < > maximilianofel...@gmail.com>, Joseph Bradley , > Leif Walsh , dev > > > > I'm down for that, we could all go

Re: Revisiting Online serving of Spark models?

2018-05-29 Thread Felix Cheung
You had me at blue bottle! _ From: Holden Karau Sent: Tuesday, May 29, 2018 9:47 AM Subject: Re: Revisiting Online serving of Spark models? To: Felix Cheung Cc: Saikat Kanjilal , Maximiliano Felice , Joseph Bradley , Leif Walsh , dev I'm down for that, we

Re: Revisiting Online serving of Spark models?

2018-05-29 Thread Holden Karau
x Cheung > *Sent:* Saturday, May 26, 2018 1:05:29 PM > *To:* Saikat Kanjilal; Maximiliano Felice; Joseph Bradley > *Cc:* Leif Walsh; Holden Karau; dev > > *Subject:* Re: Revisiting Online serving of Spark models? > > Hi! How about we meet the community and discuss on June 6 4pm at (near

Re: Revisiting Online serving of Spark models?

2018-05-29 Thread Felix Cheung
Bump. From: Felix Cheung Sent: Saturday, May 26, 2018 1:05:29 PM To: Saikat Kanjilal; Maximiliano Felice; Joseph Bradley Cc: Leif Walsh; Holden Karau; dev Subject: Re: Revisiting Online serving of Spark models? Hi! How about we meet the community and discuss on

Re: Revisiting Online serving of Spark models?

2018-05-26 Thread Felix Cheung
: Maximiliano Felice Cc: Leif Walsh; Felix Cheung; Holden Karau; Joseph Bradley; dev Subject: Re: Revisiting Online serving of Spark models? I’m in the same exact boat as Maximiliano and have use cases as well for model serving and would love to join this discussion. Sent from my iPhone On May 22, 2018

Re: Revisiting Online serving of Spark models?

2018-05-22 Thread Saikat Kanjilal
a big blocker on reusing trained models outside of Spark for online serving. What’s the next step? Would folks be interested in getting together to discuss/get some feedback? _ From: Felix Cheung mailto:felixcheun...@hotmail.com>> Sent: Thursday, May 10, 201

Re: Revisiting Online serving of Spark models?

2018-05-22 Thread Maximiliano Felice
gt;> To: Holden Karau , Joseph Bradley < >>> jos...@databricks.com> >>> Cc: dev >>> >>> >>> >>> Huge +1 on this! >>> >>> -- >>> *From:* holden.ka...@gmail.com on behalf of >>>

Re: Revisiting Online serving of Spark models?

2018-05-22 Thread Leif Walsh
hat’s the next step? Would folks be interested in getting together to >> discuss/get some feedback? >> >> >> _____________ >> From: Felix Cheung >> Sent: Thursday, May 10, 2018 10:10 AM >> Subject: Re: Revisiting Online serving of Spark models? >> To: Holden Karau , Joseph Bradl

Re: Revisiting Online serving of Spark models?

2018-05-21 Thread Felix Cheung
+1 on meeting up! From: Holden Karau Sent: Monday, May 21, 2018 2:52:20 PM To: Joseph Bradley Cc: Felix Cheung; dev Subject: Re: Revisiting Online serving of Spark models? (Oh also the write API has already been extended to take formats). On Mon, May 21, 2018

Re: Revisiting Online serving of Spark models?

2018-05-21 Thread Holden Karau
t;> outside of Spark for online serving. >> >> What’s the next step? Would folks be interested in getting together to >> discuss/get some feedback? >> >> >> _____________ >> From: Felix Cheung >> Sent: Thursday, May 10, 2018 10:1

Re: Revisiting Online serving of Spark models?

2018-05-21 Thread Holden Karau
t; What’s the next step? Would folks be interested in getting together to >>> discuss/get some feedback? >>> >>> >>> _ >>> From: Felix Cheung >>> Sent: Thursday, May 10, 2018 10:10 AM >>> Subject: Re: Revisiting O

Re: Revisiting Online serving of Spark models?

2018-05-21 Thread Joseph Bradley
_ > From: Felix Cheung > Sent: Thursday, May 10, 2018 10:10 AM > Subject: Re: Revisiting Online serving of Spark models? > To: Holden Karau , Joseph Bradley < > jos...@databricks.com> > Cc: dev > > > > Huge +1 on this! > > --

Re: Revisiting Online serving of Spark models?

2018-05-20 Thread Felix Cheung
interested in getting together to discuss/get some feedback? _ From: Felix Cheung Sent: Thursday, May 10, 2018 10:10 AM Subject: Re: Revisiting Online serving of Spark models? To: Holden Karau , Joseph Bradley Cc: dev Huge +1 on this

Re: Revisiting Online serving of Spark models?

2018-05-10 Thread Felix Cheung
Huge +1 on this! From: holden.ka...@gmail.com on behalf of Holden Karau Sent: Thursday, May 10, 2018 9:39:26 AM To: Joseph Bradley Cc: dev Subject: Re: Revisiting Online serving of Spark models? On Thu, May 10, 2018 at 9:25 AM, Joseph Bradley mailto:jos

Re: Revisiting Online serving of Spark models?

2018-05-10 Thread Holden Karau
On Thu, May 10, 2018 at 9:25 AM, Joseph Bradley wrote: > Thanks for bringing this up Holden! I'm a strong supporter of this. > > Awesome! I'm glad other folks think something like this belongs in Spark. > This was one of the original goals for mllib-local: to have local versions > of MLlib mode

Re: Revisiting Online serving of Spark models?

2018-05-10 Thread Joseph Bradley
Thanks for bringing this up Holden! I'm a strong supporter of this. This was one of the original goals for mllib-local: to have local versions of MLlib models which could be deployed without the big Spark JARs and without a SparkContext or SparkSession. There are related commercial offerings lik

Revisiting Online serving of Spark models?

2018-05-09 Thread Holden Karau
Hi y'all, With the renewed interest in ML in Apache Spark now seems like a good a time as any to revisit the online serving situation in Spark ML. DB & other's have done some excellent working moving a lot of the necessary tools into a local linear algebra package that doesn't depend on having a S