Hi, @Rodrick Sorry for could not understand your problem here. Do you mean your job depends on files on hdfs and it could not download in slaves after you execute spark-submit?
On Sat, Oct 3, 2015 at 5:07 AM, Rodrick Brown <[email protected]> wrote: > For some reason my jobs are not being copied to all the slaves when > they’re download from hdfs am I missing something obvious? > They only seem to be copied to the node where the job is submitted. > > -- > > [image: Orchard Platform] <http://www.orchardplatform.com/> > > Rodrick Brown / DevOPs Engineer > +1 917 445 6839 / [email protected] > <[email protected]> > > Orchard Platform > 101 5th Avenue, 4th Floor, New York, NY 10003 > http://www.orchardplatform.com > > Orchard Blog <http://www.orchardplatform.com/blog/> | Marketplace Lending > Meetup <http://www.meetup.com/Peer-to-Peer-Lending-P2P/> > > > *NOTICE TO RECIPIENTS*: This communication is confidential and intended > for the use of the addressee only. If you are not an intended recipient of > this communication, please delete it immediately and notify the sender by > return email. Unauthorized reading, dissemination, distribution or copying > of this communication is prohibited. This communication does not constitute > an offer to sell or a solicitation of an indication of interest to purchase > any loan, security or any other financial product or instrument, nor is it > an offer to sell or a solicitation of an indication of interest to purchase > any products or services to any persons who are prohibited from receiving > such information under applicable law. The contents of this communication > may not be accurate or complete and are subject to change without notice. > As such, Orchard App, Inc. (including its subsidiaries and affiliates, > "Orchard") makes no representation regarding the accuracy or completeness > of the information contained herein. The intended recipient is advised to > consult its own professional advisors, including those specializing in > legal, tax and accounting matters. Orchard does not provide legal, tax or > accounting advice. > -- Best Regards, Haosdent Huang
