[
https://issues.apache.org/jira/browse/SPARK-28783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-28783.
----------------------------------
Resolution: Won't Fix
> Support plus + operator as concatenation for StringType columns in pyspark
> --------------------------------------------------------------------------
>
> Key: SPARK-28783
> URL: https://issues.apache.org/jira/browse/SPARK-28783
> Project: Spark
> Issue Type: Wish
> Components: PySpark
> Affects Versions: 2.4.3
> Reporter: Louis Yang
> Priority: Trivial
>
> Right now if one try to use plus operator for two columns in pyspark like
> `F.col('a') + F.col('b')`, pyspark always try to treat it as arithmetic
> addition like `2+3=5`. If the columns are `StringType`, pyspark try to
> convert them to number then do the addition. However, in python and pandas
> world, the plus operation for string type means concatenation not arithmetic
> addition. So it will be great that pyspark also support the same logic that
> `F.col('str1') + F.col('str2') + F.col('str3')` yields
> `F.concat(F.col('str1'), F.col('str2'), F.col('str3'))`.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
