Github user wangyum commented on a diff in the pull request:
https://github.com/apache/spark/pull/22435#discussion_r217934875
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/DataSourceScanExecRedactionSuite.scala
---
@@ -83,4 +83,20 @@ class DataSourceScanExecRedactionSuite extends QueryTest
with SharedSQLContext {
}
}
+ test("FileSourceScanExec metadata") {
+ withTempDir { dir =>
+ val basePath = dir.getCanonicalPath
+ spark.range(0, 10).toDF("a").write.parquet(new Path(basePath,
"foo=1").toString)
+ val df = spark.read.parquet(basePath).filter("a = 1")
--- End diff --
Thanks @dongjoon-hyun I fixed it.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
