[jira] [Comment Edited] (SQOOP-1995) Allow nulls only if the column for that field has IsNullable to be true

[Veena Basavaraj (JIRA)]

    [ 
https://issues.apache.org/jira/browse/SQOOP-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274120#comment-14274120
 ] 

Veena Basavaraj edited comment on SQOOP-1995 at 1/12/15 9:00 PM:
-----------------------------------------------------------------

the issue is with 
https://issues.apache.org/jira/browse/SQOOP-2003
{code}
at 
org.apache.sqoop.connector.idf.CSVIntermediateDataFormat.getCSVTextData(CSVIntermediateDataFormat.java:61)
        at org.apache.sqoop.job.io.SqoopWritable.toString(SqoopWritable.java:76)
        at 
org.apache.sqoop.job.io.SqoopWritable.compareTo(SqoopWritable.java:71)
        at 
org.apache.sqoop.job.io.SqoopWritable.compareTo(SqoopWritable.java:38)
        at 
org.apache.hadoop.io.WritableComparator.compare(WritableComparator.java:176)
        at 
org.apache.hadoop.io.WritableComparator.compare(WritableComparator.java:167)
        at 
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.compare(MapTask.java:1265)
        at org.apache.hadoop.util.QuickSort.sortInternal(QuickSort.java:74)
        at org.apache.hadoop.util.QuickSort.sort(QuickSort.java:63)
        at 
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1593)
        at 
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1482)
        at 
org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:720)
{code}

So it looks like the schema is null at some point, even though initially the 
IDF has been set with a valid schema


was (Author: vybs):
the issue is with 

{code}
at 
org.apache.sqoop.connector.idf.CSVIntermediateDataFormat.getCSVTextData(CSVIntermediateDataFormat.java:61)
        at org.apache.sqoop.job.io.SqoopWritable.toString(SqoopWritable.java:76)
        at 
org.apache.sqoop.job.io.SqoopWritable.compareTo(SqoopWritable.java:71)
        at 
org.apache.sqoop.job.io.SqoopWritable.compareTo(SqoopWritable.java:38)
        at 
org.apache.hadoop.io.WritableComparator.compare(WritableComparator.java:176)
        at 
org.apache.hadoop.io.WritableComparator.compare(WritableComparator.java:167)
        at 
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.compare(MapTask.java:1265)
        at org.apache.hadoop.util.QuickSort.sortInternal(QuickSort.java:74)
        at org.apache.hadoop.util.QuickSort.sort(QuickSort.java:63)
        at 
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1593)
        at 
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1482)
        at 
org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:720)
{code}

So it looks like the schema is null at some point, even though initially the 
IDF has been set with a valid schema

> Allow nulls only if the column for that field has IsNullable to be true 
> ------------------------------------------------------------------------
>
>                 Key: SQOOP-1995
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1995
>             Project: Sqoop
>          Issue Type: Sub-task
>            Reporter: Veena Basavaraj
>             Fix For: 2.0.0
>
>         Attachments: SQOOP-1995.patch
>
>
> the title is self descriptive.
> the change will be done to validate it in the IDF implementations. We should 
> throw an exception if a null value is found on a column that cannot be 
> nullable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)