: Wednesday, March 11, 2015 2:40 AM
To: Wang, Ningjun (LNG-NPV)
Cc: java8964; user@spark.apache.org
Subject: Re: sc.textFile() on windows cannot access UNC path
I don't have a complete example for your usecase, but you can see a lot of
codes showing how to use new APIHadoopFile from
herehttps
[mailto:ak...@sigmoidanalytics.com]
*Sent:* Wednesday, March 11, 2015 2:40 AM
*To:* Wang, Ningjun (LNG-NPV)
*Cc:* java8964; user@spark.apache.org
*Subject:* Re: sc.textFile() on windows cannot access UNC path
I don't have a complete example for your usecase, but you can see a lot of
codes
...@sigmoidanalytics.com]
*Sent:* Tuesday, March 10, 2015 9:14 AM
*To:* java8964
*Cc:* Wang, Ningjun (LNG-NPV); user@spark.apache.org
*Subject:* Re: sc.textFile() on windows cannot access UNC path
You can create your own Input Reader (using java.nio.*) and pass it to the
sc.newAPIHadoopFile while reading
I think the work around is clear.
Using JDK 7, and implement your own saveAsRemoteWinText() using java.nio.path.
Yong
From: ningjun.w...@lexisnexis.com
To: java8...@hotmail.com; user@spark.apache.org
Subject: RE: sc.textFile() on windows cannot access UNC path
Date: Tue, 10 Mar 2015 03:02:37
of java.nio.
You need to manually mount your windows remote share a local driver, like Z:,
then it should work.
Yong
From: ningjun.w...@lexisnexis.com
To: user@spark.apache.org
Subject: sc.textFile() on windows cannot access UNC path
Date: Mon, 9 Mar 2015 21:09:38 +
I am running Spark
I am running Spark on windows 2008 R2. I use sc.textFile() to load text file
using UNC path, it does not work.
sc.textFile(rawfile:10.196.119.230/folder1/abc.txt, 4).count()
Input path does not exist: file:/10.196.119.230/folder1/abc.txt
org.apache.hadoop.mapred.InvalidInputException:
(...)?
Ningjun
From: java8964 [mailto:java8...@hotmail.com]
Sent: Monday, March 09, 2015 5:33 PM
To: Wang, Ningjun (LNG-NPV); user@spark.apache.org
Subject: RE: sc.textFile() on windows cannot access UNC path
This is a Java problem, not really Spark.
From this page:
http://stackoverflow.com/questions
