[ https://issues.apache.org/jira/browse/SPARK-33395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233264#comment-17233264 ]
Nilesh Patil commented on SPARK-33395: -------------------------------------- Yes inferred type is double, but we want the data as it is as it have in file not in the scientific notation also not in the form rounding. > Spark reading data in scientific notation > ----------------------------------------- > > Key: SPARK-33395 > URL: https://issues.apache.org/jira/browse/SPARK-33395 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 2.3.4, 2.4.8, 3.1.0 > Reporter: Nilesh Patil > Priority: Critical > > File is having below data > DAta > 1200404151072.121111111111 > 1200404151073 > 1200404151074.1232323 > 1200404151075.124344 > 1200404151076.12 > 1200404151077.123433333 > 1200404151078.12 > 1200404151079.12544545454554 > 1251080.1234444444444444444444 > 10000000000000000000000000000 > > Spark is reading with scientific notation as we wanted to read data as it is > available in file with accurate datatype not with string datatype. > +--------------------+ > | DAta| > +--------------------+ > |1.200404151072121E12| > | 1.200404151073E12| > |1.200404151074123...| > |1.200404151075124...| > | 1.20040415107612E12| > |1.200404151077123...| > | 1.20040415107812E12| > |1.200404151079125...| > | 1251080.1234444445| > | 1.0E28| > +-------------------- > > > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org