Re: What are using Spark for

2016-08-02 Thread Daniel Siegmann
Yes, you can use Spark for ETL, as well as feature engineering, training, and scoring. ~Daniel Siegmann On Tue, Aug 2, 2016 at 3:29 PM, Mich Talebzadeh wrote: > Hi, > > If I may say, if you spend sometime going through this mailing list in > this forum and see the

Re: What are using Spark for

2016-08-02 Thread Mich Talebzadeh
Hi, If I may say, if you spend sometime going through this mailing list in this forum and see the variety of topics that users are discussing, then you may get plenty of ideas about Spark application in real life.. HTH Dr Mich Talebzadeh LinkedIn *

Re: What are using Spark for

2016-08-02 Thread Karthik Ramakrishnan
We used Storm for ETL, now currently thinking Spark might be advantageous since some ML also is coming our way. - Karthik On Tue, Aug 2, 2016 at 1:10 PM, Rohit L wrote: > Does anyone use Spark for ETL? > > On Tue, Aug 2, 2016 at 1:24 PM, Sonal Goyal

Re: What are using Spark for

2016-08-02 Thread Deepak Sharma
Yes.I am using spark for ETL and I am sure there are lot of other companies who are using spark for ETL. Thanks Deepak On 2 Aug 2016 11:40 pm, "Rohit L" wrote: > Does anyone use Spark for ETL? > > On Tue, Aug 2, 2016 at 1:24 PM, Sonal Goyal wrote:

Re: What are using Spark for

2016-08-02 Thread Rohit L
Does anyone use Spark for ETL? On Tue, Aug 2, 2016 at 1:24 PM, Sonal Goyal wrote: > Hi Rohit, > > You can check the powered by spark page for some real usage of Spark. > > https://cwiki.apache.org/confluence/display/SPARK/Powered+By+Spark > > > On Tuesday, August 2, 2016,

Re: What are using Spark for

2016-08-02 Thread Sonal Goyal
Hi Rohit, You can check the powered by spark page for some real usage of Spark. https://cwiki.apache.org/confluence/display/SPARK/Powered+By+Spark On Tuesday, August 2, 2016, Rohit L wrote: > Hi Everyone, > > I want to know the real world uses cases for which

Re: What are using Spark for

2016-08-01 Thread Rodrick Brown
Each of our micro services logs events to Kafka topic, we then use spark to consume messages from that queue and write it into elastic search. The data from ES is used by a number of support applications graphs, monitoring, reports, dash boards for client services teams etc.. --

Re: What are using Spark for

2016-08-01 Thread Xiao Li
Hi, Rohit, The Spark summit has many interesting use cases. Hopefully, it can answer your question. https://spark-summit.org/2015/schedule/ https://spark-summit.org/2016/schedule/ Thanks, Xiao 2016-08-01 22:48 GMT-07:00 Rohit L : > Hi Everyone, > > I want to know