Jeremy Beard created SPARK-17299:
------------------------------------
Summary: TRIM/LTRIM/RTRIM strips characters other than spaces
Key: SPARK-17299
URL: https://issues.apache.org/jira/browse/SPARK-17299
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.0.0
Reporter: Jeremy Beard
TRIM/LTRIM/RTRIM docs state that they only strip spaces:
http://spark.apache.org/docs/2.0.0/api/java/org/apache/spark/sql/functions.html#trim(org.apache.spark.sql.Column)
But the implementation strips all characters of ASCII value 20 or less:
https://github.com/apache/spark/blob/v2.0.0/common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java#L468-L470
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
