Gwen Shapira created SQOOP-1453:
-----------------------------------
Summary: Sqoop2: Suport export of null from hdfs text files to
RDBMS numeric columns
Key: SQOOP-1453
URL: https://issues.apache.org/jira/browse/SQOOP-1453
Project: Sqoop
Issue Type: Bug
Components: sqoop2-framework
Reporter: Gwen Shapira
Suppose you have an RDBMS table with number column containing nulls.
When you Sqoop the data to HDFS text file, you get:
,null,
When you try to Sqoop this file back to RDBMS, you get:
2014-08-19 15:12:42,552 [OutputFormatLoader-consumer] ERROR
org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor - Error while loading
data out of MR job.
java.lang.NumberFormatException
at java.math.BigDecimal.<init>(BigDecimal.java:470)
at java.math.BigDecimal.<init>(BigDecimal.java:739)
at
org.apache.sqoop.connector.idf.CSVIntermediateDataFormat.getObjectData(CSVIntermediateDataFormat.java:219)
at
org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$OutputFormatDataReader.readArrayRecord(SqoopOutputFormatLoadExecutor.java:157)
at
org.apache.sqoop.connector.jdbc.GenericJdbcLoader.load(GenericJdbcLoader.java:48)
at
org.apache.sqoop.connector.jdbc.GenericJdbcLoader.load(GenericJdbcLoader.java:25)
at
org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$ConsumerThread.run(SqoopOutputFormatLoadExecutor.java:248)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Because "null" doesn't convert to BigDecimal.
We need to detect handle these cases.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
