Terry Kim created SPARK-32516:
---------------------------------
Summary: path option is treated differently for
'format("parquet").load(path)' vs. 'parquet(path)'
Key: SPARK-32516
URL: https://issues.apache.org/jira/browse/SPARK-32516
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.0.0, 2.4.6
Reporter: Terry Kim
When data is read, "path" option is treated differently depending on how
dataframe is created:
{code:java}
scala> Seq(1).toDF.write.mode("overwrite").parquet("/tmp/test")
scala> spark.read.option("path",
"/tmp/test").format("parquet").load("/tmp/test").show
+-----+
|value|
+-----+
| 1|
+-----+
scala> spark.read.option("path", "/tmp/test").parquet("/tmp/test").show
+-----+
|value|
+-----+
| 1|
| 1|
+-----+
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
