[
https://issues.apache.org/jira/browse/SPARK-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854661#comment-17854661
]
Chhavi Bansal edited comment on SPARK-15041 at 6/13/24 7:43 AM:
----------------------------------------------------------------
Are there plans to have imputers for Categorical string type columns? What is
the recommended way to handle such scenarios?
was (Author: JIRAUSER304338):
Are there plans to have imputations for Categorical string type columns? What
is the recommended way to handle such scenarios?
> adding mode strategy for ml.feature.Imputer for categorical features
> --------------------------------------------------------------------
>
> Key: SPARK-15041
> URL: https://issues.apache.org/jira/browse/SPARK-15041
> Project: Spark
> Issue Type: New Feature
> Components: ML
> Reporter: yuhao yang
> Priority: Minor
> Labels: bulk-closed
>
> Adding mode strategy for ml.feature.Imputer for categorical features. This
> need to wait until PR for SPARK-13568 gets merged.
> https://github.com/apache/spark/pull/11601
> From comments of jkbradley and Nick Pentreath in the PR
> {quote}
> Investigate efficiency of approaches using DataFrame/Dataset and/or approx
> approaches such as frequentItems or Count-Min Sketch (will require an update
> to CMS to return "heavy-hitters").
> investigate if we can use metadata to only allow mode for categorical
> features (or perhaps as an easier alternative, allow mode for only Int/Long
> columns)
> {quote}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
