Github user BryanCutler commented on a diff in the pull request:
https://github.com/apache/spark/pull/21546#discussion_r194898976
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/arrow/ArrowConvertersSuite.scala
---
@@ -51,11 +51,11 @@ class ArrowConvertersSuite extends SharedSQLContext
with BeforeAndAfterAll {
test("collect to arrow record batch") {
val indexData = (1 to 6).toDF("i")
- val arrowPayloads = indexData.toArrowPayload.collect()
- assert(arrowPayloads.nonEmpty)
- assert(arrowPayloads.length == indexData.rdd.getNumPartitions)
+ val arrowBatches = indexData.getArrowBatchRdd.collect()
+ assert(arrowBatches.nonEmpty)
+ assert(arrowBatches.length == indexData.rdd.getNumPartitions)
--- End diff --
Most of these changes are just renames to be consistent
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
