Hyukjin Kwon created SPARK-35381:
------------------------------------
Summary: Fix lambda variable name issues in nested DataFrame
functions in R APIs
Key: SPARK-35381
URL: https://issues.apache.org/jira/browse/SPARK-35381
Project: Spark
Issue Type: Bug
Components: SparkR
Affects Versions: 3.1.1
Reporter: Hyukjin Kwon
R's higher order functions also have the same problem with SPARK-34794:
{code}
df <- sql("SELECT array(1, 2, 3) as numbers, array('a', 'b', 'c') as letters")
collect(select(
df,
array_transform("numbers", function(number) {
array_transform("letters", function(latter) {
struct(alias(number, "n"), alias(latter, "l"))
})
})
))
{code}
{code}
transform(numbers, lambdafunction(transform(letters,
lambdafunction(struct(namedlambdavariable() AS n, namedlambdavariable() AS l),
namedlambdavariable())), namedlambdavariable()))
1
a, a, b, b, c, c, a, a, b, b,
c, c, a, a, b, b, c, c
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
