GitHub user felixcheung opened a pull request:
https://github.com/apache/spark/pull/9785
[SPARK-11339][SPARKR] Document the list of functions in R base package that
are masked by functions with same name in SparkR
Added tests for function that are reported as masked, to make sure the
base:: or stats:: function can be called.
For those we can't call, added them to SparkR programming guide.
It would seem to me `table, sample, subset, filter, cov` not working are
not actually expected - I investigated/experimented with them but couldn't get
them to work. It looks like as they are defined in base or stats they are
missing the S3 generic, eg.
```
> methods("transform")
[1] transform,ANY-method transform.data.frame
[3] transform,DataFrame-method transform.default
see '?methods' for accessing help and source code
> methods("subset")
[1] subset.data.frame subset,DataFrame-method subset.default
[4] subset.matrix
see '?methods' for accessing help and source code
Warning message:
In .S3methods(generic.function, class, parent.frame()) :
function 'subset' appears not to be S3 generic; found functions that look
like S3 methods
```
Any idea?
More information on masking:
http://www.ats.ucla.edu/stat/r/faq/referencing_objects.htm
http://www.sfu.ca/~sweldon/howTo/guide4.pdf
This is what the output doc looks like (minus css):
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/felixcheung/spark rmasked
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9785.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9785
----
commit b4480833017a5f9814e0d173deb570d512643e3e
Author: felixcheung <[email protected]>
Date: 2015-11-14T02:15:46Z
Add masked method tests for table, sample, lag, summary
commit 747cafd3efda4cddc9def347dc3fb64206b4a545
Author: felixcheung <[email protected]>
Date: 2015-11-14T05:23:30Z
Add tests for bind, intersect, cov
commit 3551ad75b18796cd158020b20c5756b63f1b8607
Author: felixcheung <[email protected]>
Date: 2015-11-14T05:37:05Z
Add test for subset, filter, na.omit
commit a02d3d9a487d077c24214bc1077cbb85b2aede0e
Author: felixcheung <[email protected]>
Date: 2015-11-15T05:21:22Z
update tests
commit a7b02fa9f904ecb97959a8427151a49ad72900f5
Author: felixcheung <[email protected]>
Date: 2015-11-18T00:33:33Z
doc update
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
