[ 
https://issues.apache.org/jira/browse/SPARK-61228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruifeng Zheng reassigned SPARK-61228:
-------------------------------------

    Assignee: Ruifeng Zheng

> [SQL][ML] Add a SparseVectorToArray Catalyst expression
> -------------------------------------------------------
>
>                 Key: SPARK-61228
>                 URL: https://issues.apache.org/jira/browse/SPARK-61228
>             Project: Spark
>          Issue Type: Improvement
>          Components: ML, SQL
>    Affects Versions: 5.0.0
>            Reporter: Ruifeng Zheng
>            Assignee: Ruifeng Zheng
>            Priority: Major
>              Labels: pull-request-available
>
> Add SparseVectorToArray, an internal Catalyst ML expression that accepts the 
> standard four-field SQL struct representation of a sparse MLlib vector and 
> expands its size, indices, and values into a dense array of doubles or floats.
> Require the vector SQL schema, including field nullability and 
> containsNull=false for the indices and values arrays. Fill missing positions 
> with zero and propagate null structs or null size, indices, or values fields. 
> Implement interpreted and generated evaluation, allocating the requested 
> output type directly.
> The struct input allows composition with UnwrapUDT. Test this composition 
> along with schema nullability and conversion behavior. This change adds only 
> the sparse expansion expression and its tests; existing vector_to_array 
> behavior and registration remain unchanged.
> Pull request: https://github.com/apache/spark/pull/60224



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to