[
https://issues.apache.org/jira/browse/SPARK-6160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15173163#comment-15173163
]
Gayathri Murali edited comment on SPARK-6160 at 3/1/16 3:57 AM:
----------------------------------------------------------------
[~josephkb] How should the test stat results be persisted?
Option 1 : is to persist the test stats as data member of ChiSqSelectorModel
class, in which case it needs to be initialized using the constructor.This
would mean modifying the code where the object of the class is being
instantiated.
Option 2 : To create an auxiliary class which would just store the test stat
results.
was (Author: gayathrimurali):
[~josephkb] Should the test statistics result be stored as a text/parquet file?
or Can it just be stored in a local array?
> ChiSqSelector should keep test statistic info
> ---------------------------------------------
>
> Key: SPARK-6160
> URL: https://issues.apache.org/jira/browse/SPARK-6160
> Project: Spark
> Issue Type: Improvement
> Components: MLlib
> Affects Versions: 1.3.0
> Reporter: Joseph K. Bradley
> Priority: Minor
>
> It is useful to have the test statistics explaining selected features, but
> these data are thrown out when constructing the ChiSqSelectorModel. The data
> are expensive to recompute, so the ChiSqSelectorModel should store and expose
> them.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]