[
https://issues.apache.org/jira/browse/SPARK-14671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joseph K. Bradley updated SPARK-14671:
--------------------------------------
Target Version/s: 2.0.0 (was: 1.6.2, 2.0.0)
> Pipeline.setStages needs to handle Array non-covariance
> -------------------------------------------------------
>
> Key: SPARK-14671
> URL: https://issues.apache.org/jira/browse/SPARK-14671
> Project: Spark
> Issue Type: Bug
> Components: ML
> Affects Versions: 1.6.1, 2.0.0
> Reporter: Joseph K. Bradley
> Assignee: Joseph K. Bradley
> Priority: Minor
>
> The following code worked for Spark 1.5 but fails for 1.6 (using the
> {{WritableStage, UnWritableStage}} classes in PipelineSuite):
> {code}
> val stages0 = Array(new UnWritableStage("b"))
> val stages1 = Array(new WritableStage("a"))
> val steps = stages0 ++ stages1
> val p = new Pipeline().setStages(steps)
> p.stages.w(steps)
> new ParamPair(p.stages, steps)
> {code}
> This also occurs with a mix of transformers from ml.feature. It is because
> Java Arrays are non-covariant and the addition of MLWritable to some
> transformers means the {{stages0/1}} arrays above are not of type
> {{Array[PipelineStage]}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
