Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/10809#discussion_r50174584
--- Diff:
sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeRowWriter.java
---
@@ -26,36 +26,44 @@
import org.apache.spark.unsafe.types.UTF8String;
/**
- * A helper class to write data into global row buffer using `UnsafeRow`
format,
- * used by {@link
org.apache.spark.sql.catalyst.expressions.codegen.GenerateUnsafeProjection}.
+ * A helper class to write data into global row buffer using `UnsafeRow`
format.
+ *
+ * It will remember the offset of row buffer which it starts to write, and
move the cursor of row
+ * buffer while writing. If a new record comes, the cursor of row buffer
will be reset, so we need
--- End diff --
the record that this writer is responsible to write, it can be the whole
row record, or a nested struct, or even a struct type element in array.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
