Re: How to connect to spark remotely from java

2015-08-10 Thread Simon Elliston Ball
You don't connect to spark exactly. The spark client (running on your remote 
machine) submits jobs to the YARN cluster running on HDP. What you probably 
need is yarn-cluster or yarn-client with the yarn client configs as downloaded 
from the Ambari actions menu.

Simon

 On 10 Aug 2015, at 12:44, Zsombor Egyed egye...@starschema.net wrote:
 
 Hi!
 
 I want to know how can I connect to hortonworks spark from an other machine. 
 
 So there is a HDP 2.2 and I want to connect to this, from remotely via java 
 api. 
 Do you have any suggestion? 
 
 Thanks!
 Regards,
 
 -- 
 
 
 Egyed Zsombor 
 Junior Big Data Engineer
 
 
 Mobile: +36 70 320 65 81 | Twitter:@starschemaltd
 Email: egye...@starschema.net | Web: www.starschema.net


How to connect to spark remotely from java

2015-08-10 Thread Zsombor Egyed
Hi!

I want to know how can I connect to hortonworks spark from an other
machine.

So there is a HDP 2.2 and I want to connect to this, from remotely via java
api.
Do you have any suggestion?

Thanks!
Regards,

-- 


*Egyed Zsombor *
Junior Big Data Engineer



Mobile: +36 70 320 65 81 | Twitter:@starschemaltd

Email: egye...@starschema.net bali...@starschema.net | Web:
www.starschema.net


Re: How to connect to spark remotely from java

2015-08-10 Thread Zsombor Egyed
Thank you for your respond!

If I understand well I should get YARN cluster on server/HDP. I should
start the yarn services, nodemanager, resourcemanager etc. and I also need
to install a spark on my machine, write a java code, make a jar file, and
submit it to the server? Am I right?



On Mon, Aug 10, 2015 at 2:10 PM, Simon Elliston Ball 
si...@simonellistonball.com wrote:

 You don't connect to spark exactly. The spark client (running on your
 remote machine) submits jobs to the YARN cluster running on HDP. What you
 probably need is yarn-cluster or yarn-client with the yarn client configs
 as downloaded from the Ambari actions menu.

 Simon

 On 10 Aug 2015, at 12:44, Zsombor Egyed egye...@starschema.net wrote:

 Hi!

 I want to know how can I connect to hortonworks spark from an other
 machine.

 So there is a HDP 2.2 and I want to connect to this, from remotely via
 java api.
 Do you have any suggestion?

 Thanks!
 Regards,

 --


 *Egyed Zsombor *
 Junior Big Data Engineer



 Mobile: +36 70 320 65 81 | Twitter:@starschemaltd

 Email: egye...@starschema.net bali...@starschema.net | Web:
 www.starschema.net




-- 


*Egyed Zsombor *
Junior Big Data Engineer



Mobile: +36 70 320 65 81 | Twitter:@starschemaltd

Email: egye...@starschema.net bali...@starschema.net | Web:
www.starschema.net