[
https://issues.apache.org/jira/browse/SQOOP-520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422384#comment-13422384
]
Jarek Jarcec Cecho commented on SQOOP-520:
------------------------------------------
Hi sir,
this is unfortunately general issue in Sqoop. We already fix some of the
problems in SQOOP-430.
I'll look into this shortly.
Jarcec
> Avro Import fails on due to collision between column names starting with
> numbers and prefixed underscore
> ---------------------------------------------------------------------------------------------------------
>
> Key: SQOOP-520
> URL: https://issues.apache.org/jira/browse/SQOOP-520
> Project: Sqoop
> Issue Type: Bug
> Components: codegen
> Affects Versions: 1.3.0
> Reporter: Glyton Camilleri
>
> When performing an import as avro datafile, Sqoop fails with the following
> exception:
> {code}
> 12/07/24 15:59:20 ERROR sqoop.Sqoop: Got exception running Sqoop:
> java.lang.IllegalArgumentException: Duplicate Column identifier specified:
> '_1D'
> java.lang.IllegalArgumentException: Duplicate Column identifier specified:
> '_1D'
> at com.cloudera.sqoop.orm.ClassWriter.generate(ClassWriter.java:1072)
> at com.cloudera.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:84)
> at com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:370)
> at
> com.cloudera.sqoop.tool.ImportAllTablesTool.run(ImportAllTablesTool.java:66)
> at com.cloudera.sqoop.Sqoop.run(Sqoop.java:146)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:182)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:221)
> at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:230)
> at com.cloudera.sqoop.Sqoop.main(Sqoop.java:239)
> {code}
> The problem seems to be when generating avro schemas and java classes -
> column and table names starting with illegal identifiers are prefixed with an
> underscore, so for a table such as the following, a duplicate column name is
> generated.
> {code}
> +-------+---------+------+-----+---------+-------+
> | Field | Type | Null | Key | Default | Extra |
> +-------+---------+------+-----+---------+-------+
> | 1D | int(11) | YES | | NULL | |
> | _1D | int(11) | YES | | NULL | |
> +-------+---------+------+-----+---------+-------+
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
