[
https://issues.apache.org/jira/browse/SPARK-17299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15446930#comment-15446930
]
Sean Owen commented on SPARK-17299:
-----------------------------------
That's probably the intent yeah. If that's how the other engines treat TRIM
then this is a bug. I can see it is indeed implemented internally with
String.trim().
CC [~chenghao] for
https://github.com/apache/spark/commit/0b0b9ceaf73de472198c9804fb7ae61fa2a2e097
> TRIM/LTRIM/RTRIM strips characters other than spaces
> ----------------------------------------------------
>
> Key: SPARK-17299
> URL: https://issues.apache.org/jira/browse/SPARK-17299
> Project: Spark
> Issue Type: Bug
> Components: Documentation, SQL
> Affects Versions: 2.0.0
> Reporter: Jeremy Beard
> Priority: Minor
>
> TRIM/LTRIM/RTRIM docs state that they only strip spaces:
> http://spark.apache.org/docs/2.0.0/api/java/org/apache/spark/sql/functions.html#trim(org.apache.spark.sql.Column)
> But the implementation strips all characters of ASCII value 20 or less:
> https://github.com/apache/spark/blob/v2.0.0/common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java#L468-L470
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
