Lars Francke created SQOOP-1369:
-----------------------------------
Summary: Avro export ignores --columns option
Key: SQOOP-1369
URL: https://issues.apache.org/jira/browse/SQOOP-1369
Project: Sqoop
Issue Type: Bug
Reporter: Lars Francke
In JdbcExportJob AVRO_COLUMN_TYPES_MAP is being set with the full schema of the
output table. This causes the AvroExportMapper to fail with unknown fields if
--columns was used to restrict the columns to export (it then tries to set a
value on the generated class which doesn't exist).
There are multiple ways I can see to solve this.
* Filter the columnTypes passed on to the Mapper in
JdbcExportJob.configureInputFormat
* Pass the --columns value on to the AvroExportMapper and let it ignore things
that are not in there
* Let AvroExportMapper not fail when it can't set a field.
I might be able to provide a patch and I'd go with the simplest (the first one
probably) if there are no objections.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
