Daniel Pazeto Jr created SPARK-49616:
----------------------------------------
Summary: Spark reading data in scientific notation in String field
Key: SPARK-49616
URL: https://issues.apache.org/jira/browse/SPARK-49616
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.3.4, 2.4.8, 3.1.0
Reporter: Daniel Pazeto Jr
File is having below data
DAta
1200404151072.121111111111
1200404151073
1200404151074.1232323
1200404151075.124344
1200404151076.12
1200404151077.123433333
1200404151078.12
1200404151079.12544545454554
1251080.1234444444444444444444
10000000000000000000000000000
Spark is reading with scientific notation as we wanted to read data as it is
available in file with accurate datatype not with string datatype.
+--------------------+
| DAta|
+--------------------+
|1.200404151072121E12|
| 1.200404151073E12|
|1.200404151074123...|
|1.200404151075124...|
| 1.20040415107612E12|
|1.200404151077123...|
| 1.20040415107812E12|
|1.200404151079125...|
| 1251080.1234444445|
| 1.0E28|
+--------------------
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
