Github user shivaram commented on the pull request:
https://github.com/apache/spark/pull/6743#issuecomment-112119135
The tests pass because the `createDataFrame` call only fails in the YARN
cluster mode and we don't have tests for SparkR in the YarnSuite (Actually this
deserves a new JIRA).
BTW the change needed for `createDataFrame` to work should be minimal -- I
think we can just set the variable `SPARKR_PACKAGE_DIR` for all modes and then
set the default value of `sparkRLibDir`[1] to be
`Sys.getenv(SPARKR_PACKAGE_DIR)`.
[1] https://github.com/apache/spark/blob/master/R/pkg/R/sparkR.R#L103
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
