Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/18732#discussion_r142579512
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/object.scala
---
@@ -519,3 +519,18 @@ case class CoGroup(
outputObjAttr: Attribute,
left: LogicalPlan,
right: LogicalPlan) extends BinaryNode with ObjectProducer
+
+case class FlatMapGroupsInPandas(
+ groupingAttributes: Seq[Attribute],
+ functionExpr: Expression,
+ output: Seq[Attribute],
+ child: LogicalPlan) extends UnaryNode {
+ /**
+ * This is needed because output attributes is considered `reference`
when
+ * passed through the constructor.
+ *
+ * Without this, catalyst will complain that output attributes are
missing
+ * from the input.
+ */
+ override val producedAttributes = AttributeSet(output)
--- End diff --
Not quite sure I understand this correctly. Why `output` is considered into
`references`?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
