[
https://issues.apache.org/jira/browse/SQOOP-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Henrique Alves Junqueira Nogueira Branco updated SQOOP-3476:
------------------------------------------------------------
Summary: Allow table choose in --map-column-hive parameter while importing
to MySQL (was: Allow table choose in --map-column-hive parameter.)
> Allow table choose in --map-column-hive parameter while importing to MySQL
> --------------------------------------------------------------------------
>
> Key: SQOOP-3476
> URL: https://issues.apache.org/jira/browse/SQOOP-3476
> Project: Sqoop
> Issue Type: Improvement
> Components: connectors/mysql
> Affects Versions: 1.4.7
> Environment: MySQL 8.0, Sqoop 1.4.7, Hive 3.1.1
> Reporter: Henrique Alves Junqueira Nogueira Branco
> Priority: Major
> Labels: features
>
> Hi there,
> o achieve that I've used first the following command line:
> sqoop-import-all-tables
> --connect jdbc:mysql://IP:porta/mydatabase
> --username myusername
> -p
> --hive-import
> --direct
> But there are some incompatibility between data type in MySQL and Hive, and I
> received the following error message:
> ERROR tool.ImportAllTablesTool: Encountered IOException running import job:
> java.io.IOException: Hive does not support the SQL type for column rowguid.
> So, looking at [Sqoop 1.4.7
> documentation|https://sqoop.apache.org/docs/1.4.7/SqoopUserGuide.html], I
> noticed that there is a parameter
> {{--map-column-hive <name-of-column-to-map>}}.
> So, I added it to my command line:
> {{--map-column-hive rowguid=binary}}
> and got this new error:
> ERROR sqoop.Sqoop: Got exception running Sqoop:
> java.lang.IllegalArgumentException: No column by the name rowguid found while
> importing data
> java.lang.IllegalArgumentException: No column by the name rowguid found while
> importing data
> This error happens when Sqoop is importing the next table after the one
> containing rowguid column.
> My database has several tables and tons of columns. When I execute the above
> command line, it goes normal until it throws me an error related to missing
> column rowguid. Of course, this mapping should be done just on the specific
> table where this column exists, not in all tables.
> Is there a way to define {{table-name + column-name}} in
> {{--map-column-hive}}
> parameter? Or another way to step over this issue? Maybe importing all tables
> changing automatically the data types?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
