Re: Spark as a service

2015-03-25 Thread Irfan Ahmad 
You're welcome. How did it go?


*Irfan Ahmad*
CTO | Co-Founder | *CloudPhysics* 
Best of VMworld Finalist
Best Cloud Management Award
NetworkWorld 10 Startups to Watch
EMA Most Notable Vendor

On Wed, Mar 25, 2015 at 7:53 AM, Ashish Mukherjee <
ashish.mukher...@gmail.com> wrote:

> Thank you
>
> On Tue, Mar 24, 2015 at 8:40 PM, Irfan Ahmad 
> wrote:
>
>> Also look at the spark-kernel and spark job server projects.
>>
>> Irfan
>> On Mar 24, 2015 5:03 AM, "Todd Nist"  wrote:
>>
>>> Perhaps this project, https://github.com/calrissian/spark-jetty-server,
>>> could help with your requirements.
>>>
>>> On Tue, Mar 24, 2015 at 7:12 AM, Jeffrey Jedele <
>>> jeffrey.jed...@gmail.com> wrote:
>>>
 I don't think there's are general approach to that - the usecases are
 just to different. If you really need it, you probably will have to
 implement yourself in the driver of your application.

 PS: Make sure to use the reply to all button so that the mailing list
 is included in your reply. Otherwise only I will get your mail.

 Regards,
 Jeff

 2015-03-24 12:01 GMT+01:00 Ashish Mukherjee >>> >:

> Hi Jeffrey,
>
> Thanks. Yes, this resolves the SQL problem. My bad - I was looking for
> something which would work for Spark Streaming and other Spark jobs too,
> not just SQL.
>
> Regards,
> Ashish
>
> On Tue, Mar 24, 2015 at 4:07 PM, Jeffrey Jedele <
> jeffrey.jed...@gmail.com> wrote:
>
>> Hi Ashish,
>> this might be what you're looking for:
>>
>>
>> https://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server
>>
>> Regards,
>> Jeff
>>
>> 2015-03-24 11:28 GMT+01:00 Ashish Mukherjee <
>> ashish.mukher...@gmail.com>:
>>
>>> Hello,
>>>
>>> As of now, if I have to execute a Spark job, I need to create a jar
>>> and deploy it.  If I need to run a dynamically formed SQL from a Web
>>> application, is there any way of using SparkSQL in this manner? Perhaps,
>>> through a Web Service or something similar.
>>>
>>> Regards,
>>> Ashish
>>>
>>
>>
>

>>>
>

Re: Spark as a service

2015-03-24 Thread Irfan Ahmad 
Also look at the spark-kernel and spark job server projects.

Irfan
On Mar 24, 2015 5:03 AM, "Todd Nist"  wrote:

> Perhaps this project, https://github.com/calrissian/spark-jetty-server,
> could help with your requirements.
>
> On Tue, Mar 24, 2015 at 7:12 AM, Jeffrey Jedele 
> wrote:
>
>> I don't think there's are general approach to that - the usecases are
>> just to different. If you really need it, you probably will have to
>> implement yourself in the driver of your application.
>>
>> PS: Make sure to use the reply to all button so that the mailing list is
>> included in your reply. Otherwise only I will get your mail.
>>
>> Regards,
>> Jeff
>>
>> 2015-03-24 12:01 GMT+01:00 Ashish Mukherjee :
>>
>>> Hi Jeffrey,
>>>
>>> Thanks. Yes, this resolves the SQL problem. My bad - I was looking for
>>> something which would work for Spark Streaming and other Spark jobs too,
>>> not just SQL.
>>>
>>> Regards,
>>> Ashish
>>>
>>> On Tue, Mar 24, 2015 at 4:07 PM, Jeffrey Jedele <
>>> jeffrey.jed...@gmail.com> wrote:
>>>
 Hi Ashish,
 this might be what you're looking for:


 https://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server

 Regards,
 Jeff

 2015-03-24 11:28 GMT+01:00 Ashish Mukherjee >>> >:

> Hello,
>
> As of now, if I have to execute a Spark job, I need to create a jar
> and deploy it.  If I need to run a dynamically formed SQL from a Web
> application, is there any way of using SparkSQL in this manner? Perhaps,
> through a Web Service or something similar.
>
> Regards,
> Ashish
>


>>>
>>
>

Re: Spark as a service

2015-03-24 Thread Todd Nist 
Perhaps this project, https://github.com/calrissian/spark-jetty-server,
could help with your requirements.

On Tue, Mar 24, 2015 at 7:12 AM, Jeffrey Jedele 
wrote:

> I don't think there's are general approach to that - the usecases are just
> to different. If you really need it, you probably will have to implement
> yourself in the driver of your application.
>
> PS: Make sure to use the reply to all button so that the mailing list is
> included in your reply. Otherwise only I will get your mail.
>
> Regards,
> Jeff
>
> 2015-03-24 12:01 GMT+01:00 Ashish Mukherjee :
>
>> Hi Jeffrey,
>>
>> Thanks. Yes, this resolves the SQL problem. My bad - I was looking for
>> something which would work for Spark Streaming and other Spark jobs too,
>> not just SQL.
>>
>> Regards,
>> Ashish
>>
>> On Tue, Mar 24, 2015 at 4:07 PM, Jeffrey Jedele > > wrote:
>>
>>> Hi Ashish,
>>> this might be what you're looking for:
>>>
>>>
>>> https://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server
>>>
>>> Regards,
>>> Jeff
>>>
>>> 2015-03-24 11:28 GMT+01:00 Ashish Mukherjee 
>>> :
>>>
 Hello,

 As of now, if I have to execute a Spark job, I need to create a jar and
 deploy it.  If I need to run a dynamically formed SQL from a Web
 application, is there any way of using SparkSQL in this manner? Perhaps,
 through a Web Service or something similar.

 Regards,
 Ashish

>>>
>>>
>>
>

Re: Spark as a service

2015-03-24 Thread Jeffrey Jedele 
I don't think there's are general approach to that - the usecases are just
to different. If you really need it, you probably will have to implement
yourself in the driver of your application.

PS: Make sure to use the reply to all button so that the mailing list is
included in your reply. Otherwise only I will get your mail.

Regards,
Jeff

2015-03-24 12:01 GMT+01:00 Ashish Mukherjee :

> Hi Jeffrey,
>
> Thanks. Yes, this resolves the SQL problem. My bad - I was looking for
> something which would work for Spark Streaming and other Spark jobs too,
> not just SQL.
>
> Regards,
> Ashish
>
> On Tue, Mar 24, 2015 at 4:07 PM, Jeffrey Jedele 
> wrote:
>
>> Hi Ashish,
>> this might be what you're looking for:
>>
>>
>> https://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server
>>
>> Regards,
>> Jeff
>>
>> 2015-03-24 11:28 GMT+01:00 Ashish Mukherjee :
>>
>>> Hello,
>>>
>>> As of now, if I have to execute a Spark job, I need to create a jar and
>>> deploy it.  If I need to run a dynamically formed SQL from a Web
>>> application, is there any way of using SparkSQL in this manner? Perhaps,
>>> through a Web Service or something similar.
>>>
>>> Regards,
>>> Ashish
>>>
>>
>>
>

Re: Spark as a service

2015-03-24 Thread Jeffrey Jedele 
Hi Ashish,
this might be what you're looking for:

https://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server

Regards,
Jeff

2015-03-24 11:28 GMT+01:00 Ashish Mukherjee :

> Hello,
>
> As of now, if I have to execute a Spark job, I need to create a jar and
> deploy it.  If I need to run a dynamically formed SQL from a Web
> application, is there any way of using SparkSQL in this manner? Perhaps,
> through a Web Service or something similar.
>
> Regards,
> Ashish
>