[
https://issues.apache.org/jira/browse/SPARK-25918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25918:
----------------------------------
Description:
Unfortunately, it seems that we missed this in 2.4.0. In Spark 2.4, if the
default file system is not the local file system, LOAD DATA LOCAL INPATH only
works in case of absolute paths. This PR aims to fix it to support relative
paths. This is a regression in 2.4.0.
{code}
$ ls kv1.txt
kv1.txt
scala> spark.sql("LOAD DATA LOCAL INPATH 'kv1.txt' INTO TABLE t")
org.apache.spark.sql.AnalysisException: LOAD DATA input path does not exist:
kv1.txt;
{code}
was:
Unfortunately, it seems that we missed this in 2.4.0.
LOAD DATA LOCAL INPATH only works in case of absolute paths.
This is a regression in 2.4.0.
> LOAD DATA LOCAL INPATH should handle a relative path
> ----------------------------------------------------
>
> Key: SPARK-25918
> URL: https://issues.apache.org/jira/browse/SPARK-25918
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.4.0
> Reporter: Dongjoon Hyun
> Priority: Major
>
> Unfortunately, it seems that we missed this in 2.4.0. In Spark 2.4, if the
> default file system is not the local file system, LOAD DATA LOCAL INPATH only
> works in case of absolute paths. This PR aims to fix it to support relative
> paths. This is a regression in 2.4.0.
> {code}
> $ ls kv1.txt
> kv1.txt
> scala> spark.sql("LOAD DATA LOCAL INPATH 'kv1.txt' INTO TABLE t")
> org.apache.spark.sql.AnalysisException: LOAD DATA input path does not exist:
> kv1.txt;
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
