Github user marmbrus commented on a diff in the pull request:
https://github.com/apache/spark/pull/5744#discussion_r29897197
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Column.scala ---
@@ -68,6 +68,16 @@ class Column(protected[sql] val expr: Expression)
extends Logging {
override def hashCode: Int = this.expr.hashCode
/**
+ * An expression that gets an item at a position out of an [[ArrayType]],
--- End diff --
Extracts a value or values from a complex type. The following types of
extraction are supported:
- Given an `Array`, an integer ordinal can be used to retrieve a single
value.
- Given a `Struct`, a string fieldname can be used to extract that field.
- Given an `Array` of `Struct`s, a string can be used to "map" the array
to a new array containing only the specified field from each `Struct`.
- Given a `Map`, a key of the correct type can be used to retrieve an
individual value.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
