[ https://issues.apache.org/jira/browse/SPARK-33395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233276#comment-17233276 ]
Takeshi Yamamuro commented on SPARK-33395: ------------------------------------------ How about using a decimal type instead? > Spark reading data in scientific notation > ----------------------------------------- > > Key: SPARK-33395 > URL: https://issues.apache.org/jira/browse/SPARK-33395 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 2.3.4, 2.4.8, 3.1.0 > Reporter: Nilesh Patil > Priority: Major > > File is having below data > DAta > 1200404151072.121111111111 > 1200404151073 > 1200404151074.1232323 > 1200404151075.124344 > 1200404151076.12 > 1200404151077.123433333 > 1200404151078.12 > 1200404151079.12544545454554 > 1251080.1234444444444444444444 > 10000000000000000000000000000 > > Spark is reading with scientific notation as we wanted to read data as it is > available in file with accurate datatype not with string datatype. > +--------------------+ > | DAta| > +--------------------+ > |1.200404151072121E12| > | 1.200404151073E12| > |1.200404151074123...| > |1.200404151075124...| > | 1.20040415107612E12| > |1.200404151077123...| > | 1.20040415107812E12| > |1.200404151079125...| > | 1251080.1234444445| > | 1.0E28| > +-------------------- > > > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org