Have you tried to give spark the namenode explicitely hdfs://namenode_ip:8020/hdfs/ .... as address?
On Mon, Sep 14, 2015 at 11:09 PM, Rodrick Brown <[email protected]> wrote: > I have separate systems for the following services > > — Mesos (3 masters + 3 slaves) > — Hadoop (2 NN + 8 slaves) > — ZooKeeper (3 nodes) > > I would like to run my spark jobs on Mesos currently its being executed by > Yarn via spark-submit. > > > I’ve copied spark to each of the slaves however I’m running into issues > with my spark job is trying to connect to hadoop via localhost and not via > hfs:// url > Is there a good intro guide on gluing everything together I found the > initial documentation on apache.org very lacking when it comes to > integratiing spark & Mesos. > > Thanks. > > > -- > > [image: Orchard Platform] <http://www.orchardplatform.com/> > > Rodrick Brown / DevOPs Engineer > +1 917 445 6839 / [email protected] > <[email protected]> > > Orchard Platform > 101 5th Avenue, 4th Floor, New York, NY 10003 > http://www.orchardplatform.com > > Orchard Blog <http://www.orchardplatform.com/blog/> | Marketplace Lending > Meetup <http://www.meetup.com/Peer-to-Peer-Lending-P2P/> > > > *NOTICE TO RECIPIENTS*: This communication is confidential and intended > for the use of the addressee only. If you are not an intended recipient of > this communication, please delete it immediately and notify the sender by > return email. Unauthorized reading, dissemination, distribution or copying > of this communication is prohibited. This communication does not constitute > an offer to sell or a solicitation of an indication of interest to purchase > any loan, security or any other financial product or instrument, nor is it > an offer to sell or a solicitation of an indication of interest to purchase > any products or services to any persons who are prohibited from receiving > such information under applicable law. The contents of this communication > may not be accurate or complete and are subject to change without notice. > As such, Orchard App, Inc. (including its subsidiaries and affiliates, > "Orchard") makes no representation regarding the accuracy or completeness > of the information contained herein. The intended recipient is advised to > consult its own professional advisors, including those specializing in > legal, tax and accounting matters. Orchard does not provide legal, tax or > accounting advice. >
