Github user mikkokupsu commented on a diff in the pull request:
https://github.com/apache/spark/pull/17973#discussion_r116354610
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVSuite.scala
---
@@ -622,6 +622,31 @@ class CSVSuite extends QueryTest with SharedSQLContext
with SQLTestUtils {
}
}
+ test("save tsv with tsv suffix") {
+ withTempDir { dir =>
+ val csvDir = new File(dir, "csv").getCanonicalPath
+ val cars = spark.read
+ .format("csv")
+ .option("header", "true")
+ .load(testFile(carsFile))
+
+ cars.coalesce(1).write
+ .option("header", "true")
+ .option("fileExtension", ".tsv")
+ .option("delimiter", "\t")
--- End diff --
@srowen and @gatorsmile, the reason why I pushed this pull request is
actually to omit the file extension completely. I guess we can discuss the
semantics of different delimiters and file formats but the whole point of this
pull request was to give users the option to change a hard coded value.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
