GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/10184
[SPARK-12188] [SQL] Code refactoring and comment correction in Dataset APIs
This PR contains the following updates:
- Created a new private variable `boundTEncoder` that can be shared by
multiple functions, `RDD`, `select` and `collect`.
- Replaced all the `queryExecution.analyzed` by the function call
`logicalPlan`
- A few API comments are using wrong class names (e.g., `DataFrame`) or
parameter names (e.g., `n`)
- A few API descriptions are wrong. (e.g., `mapPartitions`)
@marmbrus @rxin @cloud-fan Could you take a look and check if they are
appropriate? Thank you!
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gatorsmile/spark datasetClean
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10184.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10184
----
commit abe55fffe514a3064a5935ccd63b747769fb5f67
Author: gatorsmile <[email protected]>
Date: 2015-12-07T04:27:11Z
Merge remote-tracking branch 'upstream/master' into encoder
commit c615d8f46b2528b1be431c8d29f9f227305dbce0
Author: gatorsmile <[email protected]>
Date: 2015-12-07T22:31:14Z
comment updates.
commit e97fa7709d1257314000ff01984123ffba1bf75d
Author: gatorsmile <[email protected]>
Date: 2015-12-07T23:24:14Z
comment updates and code cleaning
commit d510d6aed40896dea5e0b60ac09f3dab73d3c857
Author: gatorsmile <[email protected]>
Date: 2015-12-07T23:55:58Z
comment style fix.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
