Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/21189#discussion_r185041473
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/sources/memoryV2.scala
---
@@ -178,7 +179,7 @@ class MemoryDataWriter(partition: Int, outputMode:
OutputMode)
* Used to query the data that has been written into a [[MemorySinkV2]].
*/
case class MemoryPlanV2(sink: MemorySinkV2, override val output:
Seq[Attribute]) extends LeafNode {
- private val sizePerRow = output.map(_.dataType.defaultSize).sum
--- End diff --
@tdas @jose-torres Is that possible this can be zero?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
