[
https://issues.apache.org/jira/browse/SPARK-49616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Pazeto Jr updated SPARK-49616:
-------------------------------------
Affects Version/s: 3.3.0
(was: 2.3.4)
(was: 2.4.8)
> Spark reading data in scientific notation in String field
> ---------------------------------------------------------
>
> Key: SPARK-49616
> URL: https://issues.apache.org/jira/browse/SPARK-49616
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.1.0, 3.3.0
> Reporter: Daniel Pazeto Jr
> Priority: Major
>
> File is having below data
> DAta
> 1200404151072.121111111111
> 1200404151073
> 1200404151074.1232323
> 1200404151075.124344
> 1200404151076.12
> 1200404151077.123433333
> 1200404151078.12
> 1200404151079.12544545454554
> 1251080.1234444444444444444444
> 10000000000000000000000000000
>
> Spark is reading with scientific notation as we wanted to read data as it is
> available in file with accurate datatype not with string datatype.
> +--------------------+
> | DAta|
> +--------------------+
> |1.200404151072121E12|
> | 1.200404151073E12|
> |1.200404151074123...|
> |1.200404151075124...|
> | 1.20040415107612E12|
> |1.200404151077123...|
> | 1.20040415107812E12|
> |1.200404151079125...|
> | 1251080.1234444445|
> | 1.0E28|
> +--------------------
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
