Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/23054#discussion_r234477289
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/KeyValueGroupedDataset.scala ---
@@ -459,7 +460,11 @@ class KeyValueGroupedDataset[K, V] private[sql](
columns.map(_.withInputType(vExprEnc, dataAttributes).named)
val keyColumn = if (!kExprEnc.isSerializedAsStruct) {
assert(groupingAttributes.length == 1)
- groupingAttributes.head
+ if (SQLConf.get.aliasNonStructGroupingKey) {
--- End diff --
hmm, don't we want to have "key" attribute and only have old "value"
attribute when we turn on legacy config?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
