Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22379#discussion_r224648638
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVUtils.scala
---
@@ -40,16 +40,6 @@ object CSVUtils {
}
}
- /**
- * Filter ignorable rows for CSV iterator (lines empty and starting with
`comment`).
- * This is currently being used in CSV reading path and CSV schema
inference.
- */
- def filterCommentAndEmpty(iter: Iterator[String], options: CSVOptions):
Iterator[String] = {
--- End diff --
nope. It's under execution package.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
