GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/10418
[SPARK-12457] [SQL] Add ExpressionDescription to collection functions.
Feeling a little bit guilty to pick the one with the least functions. : )
One question to @yhuai : when users describe these functions, I think it
might be nice to provide them multiple useful examples. For example, for the
function `sort_array`, I am wondering how to put the following example in
`extended`?
```
> val df = Seq((Array(2, 1, 3), Array("b", "c", "a"))).toDF("col1", "col2")
> df.select(sort_array($"col1", false), sort_array($"col2",
false)).collect()
Array[org.apache.spark.sql.Row] = Array([WrappedArray(3, 2,
1),WrappedArray(c, b, a)])
```
So far, the example in `Upper` is not very clear when we adding the complex
use cases. Could you show us more examples?
Thank you!
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gatorsmile/spark ExpDesc4C
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10418.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10418
----
commit e49b03649981688a60076489bd52a5232f4c2f0d
Author: gatorsmile <[email protected]>
Date: 2015-12-21T19:53:38Z
Add ExpressionDescription to collection functions.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
