Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/21007#discussion_r180337840
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -3312,10 +3313,15 @@ class Dataset[T] private[sql](
/** Convert to an RDD of ArrowPayload byte arrays */
private[sql] def toArrowPayload: RDD[ArrowPayload] = {
+ // This is only used in tests, for now.
--- End diff --
Should this comment be moved above on `def toArrowPayload:
RDD[ArrowPayload]`?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
