Hyukjin Kwon created SPARK-16971:
------------------------------------
Summary: Strip trailing zeros for decimals when using show() API
in Dataset
Key: SPARK-16971
URL: https://issues.apache.org/jira/browse/SPARK-16971
Project: Spark
Issue Type: Improvement
Components: SQL
Reporter: Hyukjin Kwon
Currently, `Dataset.show()` prints all the trailing zeros for decimals. For
example,
{code}
spark.range(11).toDF("a").select('a.cast(DecimalType(30, 20))).show()
{code}
prints below:
{code}
+--------------------+
| a|
+--------------------+
| 0E-20|
|1.000000000000000...|
|2.000000000000000...|
|3.000000000000000...|
|4.000000000000000...|
|5.000000000000000...|
|6.000000000000000...|
|7.000000000000000...|
|8.000000000000000...|
|9.000000000000000...|
|10.00000000000000...|
+--------------------+
{code}
It might be confusing, in particualr, for {{0E-20}}. Also, I think we can strip
the trailing zeros.
So, the desired output might be as below:
{code}
+---+
| a|
+---+
| 0|
| 1|
| 2|
| 3|
| 4|
| 5|
| 6|
| 7|
| 8|
| 9|
| 10|
+---+
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
