It downloads but only onto 1 slave how do others get around this? I would think the files would be placed on all slaves.
Sent from Outlook On Sat, Oct 3, 2015 at 4:43 AM -0700, "haosdent" <[email protected]> wrote: Hi, @Rodrick Sorry for could not understand your problem here. Do you mean your job depends on files on hdfs and it could not download in slaves after you execute spark-submit? On Sat, Oct 3, 2015 at 5:07 AM, Rodrick Brown <[email protected]> wrote: For some reason my jobs are not being copied to all the slaves when they’re download from hdfs am I missing something obvious? They only seem to be copied to the node where the job is submitted. -- Rodrick Brown / DevOPs Engineer +1 917 445 6839 / [email protected] Orchard Platform 101 5th Avenue, 4th Floor, New York, NY 10003 http://www.orchardplatform.com Orchard Blog | Marketplace Lending Meetup NOTICE TO RECIPIENTS: This communication is confidential and intended for the use of the addressee only. If you are not an intended recipient of this communication, please delete it immediately and notify the sender by return email. Unauthorized reading, dissemination, distribution or copying of this communication is prohibited. This communication does not constitute an offer to sell or a solicitation of an indication of interest to purchase any loan, security or any other financial product or instrument, nor is it an offer to sell or a solicitation of an indication of interest to purchase any products or services to any persons who are prohibited from receiving such information under applicable law. The contents of this communication may not be accurate or complete and are subject to change without notice. As such, Orchard App, Inc. (including its subsidiaries and affiliates, "Orchard") makes no representation regarding the accuracy or completeness of the information contained herein. The intended recipient is advised to consult its own professional advisors, including those specializing in legal, tax and accounting matters. Orchard does not provide legal, tax or accounting advice. -- Best Regards, Haosdent Huang -- *NOTICE TO RECIPIENTS*: This communication is confidential and intended for the use of the addressee only. If you are not an intended recipient of this communication, please delete it immediately and notify the sender by return email. Unauthorized reading, dissemination, distribution or copying of this communication is prohibited. This communication does not constitute an offer to sell or a solicitation of an indication of interest to purchase any loan, security or any other financial product or instrument, nor is it an offer to sell or a solicitation of an indication of interest to purchase any products or services to any persons who are prohibited from receiving such information under applicable law. The contents of this communication may not be accurate or complete and are subject to change without notice. As such, Orchard App, Inc. (including its subsidiaries and affiliates, "Orchard") makes no representation regarding the accuracy or completeness of the information contained herein. The intended recipient is advised to consult its own professional advisors, including those specializing in legal, tax and accounting matters. Orchard does not provide legal, tax or accounting advice.
