Github user jkbradley commented on the pull request:
https://github.com/apache/spark/pull/3099#issuecomment-61932391
@mengxr @shivaram Adding to the conversation...
> In addition to the SchemaRDD based transformer API, it would be good to
have a single Row transformation API too.
I agree, but per-Row transformations may need to be kept to subclasses of
Transformer. E.g., a Transformer which filters out outlier instances might
only be able to transform a full RDD, whereas most Classifier/Regressor
concepts can operate per-Row. I plan to do a PR for some of these abstractions
after Pipelines are merged in.
I think @mengxr covered the other answers so far.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
