Github user MaxGekk commented on a diff in the pull request:
https://github.com/apache/spark/pull/20894#discussion_r188618430
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVDataSource.scala
---
@@ -202,28 +263,33 @@ object TextInputCSVDataSource extends CSVDataSource {
object MultiLineCSVDataSource extends CSVDataSource {
override val isSplitable: Boolean = false
- override def readFile(
- conf: Configuration,
- file: PartitionedFile,
- parser: UnivocityParser,
- schema: StructType): Iterator[InternalRow] = {
+ override def readFile(conf: Configuration, file: PartitionedFile,
parser: UnivocityParser,
--- End diff --
ah. You probably mean this:
```scala
override def readFile(
conf: Configuration,
file: PartitionedFile,
parser: UnivocityParser,
schema: StructType,
dataSchema: StructType,
caseSensitive: Boolean): Iterator[InternalRow] = {
```
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
