Github user jose-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/21189#discussion_r185167182
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/sources/memoryV2.scala
---
@@ -178,7 +179,7 @@ class MemoryDataWriter(partition: Int, outputMode:
OutputMode)
* Used to query the data that has been written into a [[MemorySinkV2]].
*/
case class MemoryPlanV2(sink: MemorySinkV2, override val output:
Seq[Attribute]) extends LeafNode {
- private val sizePerRow = output.map(_.dataType.defaultSize).sum
--- End diff --
I wouldn't think it's possible.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
