R created SPARK-23576:

             Summary: SparkSQL - Decimal data missing decimal point
                 Key: SPARK-23576
                 URL: https://issues.apache.org/jira/browse/SPARK-23576
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.3.0
         Environment: spark 2.3.0

            Reporter: R

Integers like 3 stored as a decimal display in sparksql as 30000000000 with no 
decimal point. But hive displays fine as 3.

Repro steps:
 # Create a .csv with the value 3
 # Use spark to read the csv, cast it as decimal(31,8) and output to an ORC file
 # Use spark to read the ORC, infer the schema (it will infer 38,18 precision) 
and output to a Parquet file
 # Create external hive table to read the parquet ( define the hive type as 
 # Use spark-sql to select from the external hive table.
 # Notice how sparksql shows 30000000000    !!!


This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to