[
https://issues.apache.org/jira/browse/SPARK-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449425#comment-15449425
]
Dongjoon Hyun commented on SPARK-17299:
---------------------------------------
Hi, [~jbeard] and [~srowen].
For the compatibility, it seems we had better fix this in SQL.
Could you make a PR for this, [~jbeard]?
> TRIM/LTRIM/RTRIM strips characters other than spaces
> ----------------------------------------------------
>
> Key: SPARK-17299
> URL: https://issues.apache.org/jira/browse/SPARK-17299
> Project: Spark
> Issue Type: Bug
> Components: Documentation, SQL
> Affects Versions: 2.0.0
> Reporter: Jeremy Beard
> Priority: Minor
>
> TRIM/LTRIM/RTRIM docs state that they only strip spaces:
> http://spark.apache.org/docs/2.0.0/api/java/org/apache/spark/sql/functions.html#trim(org.apache.spark.sql.Column)
> But the implementation strips all characters of ASCII value 20 or less:
> https://github.com/apache/spark/blob/v2.0.0/common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java#L468-L470
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
