Sun Rui created SPARK-10347:
-------------------------------
Summary: Investigate the usage of normalizePath()
Key: SPARK-10347
URL: https://issues.apache.org/jira/browse/SPARK-10347
Project: Spark
Issue Type: Bug
Components: SparkR
Reporter: Sun Rui
Priority: Minor
Currently normalizePath() is used in several places allowing users to specify
paths via the use of tilde expansion, or to normalize a relative path to an
absolute path. However, normalizePath() is used for paths which are actually
expected to be a URI. normalizePath() may display warning messages when it does
not recognize a URI as a local file path. So suppressWarnings() is used to
suppress the possible warnings.
Worse than warnings, call normalizePath() on a URI may cause error. Because it
may turn a user specified relative path to an absolute path using the local
current directory, but this may not be true because the path is actually
relative to the working directory of the default file system instead of the
local file system (depends on the Hadoop configuration of Spark).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
