[ http://issues.apache.org/jira/browse/HADOOP-836?page=all ]
Owen O'Malley updated HADOOP-836:
---------------------------------
Attachment: dos-dfs.patch
Paths without schemes were being used in MapTask.java. So the local split file
was being written into dfs by mistake. This patch fixes that problem, makes the
dfs client reject illegal names immediately, and adds a new static method to
get the local file system.
> unit tests fail on windows (/C:/cygwin/... is invalid)
> ------------------------------------------------------
>
> Key: HADOOP-836
> URL: http://issues.apache.org/jira/browse/HADOOP-836
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.10.0
> Reporter: Owen O'Malley
> Assigned To: Owen O'Malley
> Fix For: 0.10.0
>
> Attachments: dos-dfs.patch
>
>
> Under windows, I get the following exception from some of the unit tests:
> java.io.IOException: Invalid file name:
> /C:/cygwin/home/hadoopwin/owen/hadoop/build/test/mapre
> d/local/50062_0/taskTracker/jobcache/job_0001/task_0001_m_000002_0/.split.dta.crc
> at org.apache.hadoop.dfs.FSNamesystem.startFile(FSNamesystem.java:416)
> at org.apache.hadoop.dfs.NameNode.create(NameNode.java:238)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:585)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:337)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:538)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
