Ken Geis created SPARK-7299:
-------------------------------
Summary: saving Oracle-source DataFrame to Hive changes scale
Key: SPARK-7299
URL: https://issues.apache.org/jira/browse/SPARK-7299
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 1.3.1
Reporter: Ken Geis
When I load data from Oracle, save it to a table, then select from it, the
scale is changed.
For example, I have a column defined as NUMBER(12, 2). I insert 19999 into the
column. When I write that to a table and select from it, the result is 199.99.
Some databases (e.g. H2) will return this as 19999.00, but Oracle returns it as
19999. I believe that when the file is written out to parquet, the scale
information is taken from the schema, not the value. In an Oracle (at least)
JDBC DataFrame, the scale may be different from row to row.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
