[
https://issues.apache.org/jira/browse/SPARK-47032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel resolved SPARK-47032.
----------------------------
Resolution: Won't Fix
After investigating this, we found that any performance benefits from skipping
sending column values from the JVM to the Python worker were obviated by extra
manipulation of values on the JVM side to forward them to the output table. As
a result, we are closing this.
> Create API for 'analyze' method to send input column(s) to output table
> unchanged
> ---------------------------------------------------------------------------------
>
> Key: SPARK-47032
> URL: https://issues.apache.org/jira/browse/SPARK-47032
> Project: Spark
> Issue Type: Sub-task
> Components: PySpark
> Affects Versions: 4.0.0
> Reporter: Daniel
> Priority: Major
> Labels: pull-request-available
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
