Hi, I'm trying to run a hive import from sqoop using: http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
It seems to run and complete the job but I get some weird messages and no tables show up in hive. Any ideas? I'm using this query: sqoop-create-hive-table --connect jdbc:oracle:thin:@brsusdv.merck.com:25553:DEV066 --username user -P --verbose --hive-overwrite --hive-table hello --table BIODATA.CMPD_PHASE_VIEW and here is the output I get: 13/08/01 17:38:53 DEBUG tool.BaseSqoopTool: Enabled debug logging. 13/08/01 17:38:53 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead. 13/08/01 17:38:53 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override 13/08/01 17:38:53 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc. 13/08/01 17:38:53 WARN tool.BaseSqoopTool: It seems that you've specified at least one of following: 13/08/01 17:38:53 WARN tool.BaseSqoopTool: --hive-home 13/08/01 17:38:53 WARN tool.BaseSqoopTool: --hive-overwrite 13/08/01 17:38:53 WARN tool.BaseSqoopTool: --create-hive-table 13/08/01 17:38:53 WARN tool.BaseSqoopTool: --hive-table 13/08/01 17:38:53 WARN tool.BaseSqoopTool: --hive-partition-key 13/08/01 17:38:53 WARN tool.BaseSqoopTool: --hive-partition-value 13/08/01 17:38:53 WARN tool.BaseSqoopTool: --map-column-hive 13/08/01 17:38:53 WARN tool.BaseSqoopTool: Without specifying parameter --hive-import. Please note that 13/08/01 17:38:53 WARN tool.BaseSqoopTool: those arguments will not be used in this session. Either 13/08/01 17:38:53 WARN tool.BaseSqoopTool: specify --hive-import to apply them correctly or remove them 13/08/01 17:38:53 WARN tool.BaseSqoopTool: from command line to remove this warning. 13/08/01 17:38:53 INFO tool.BaseSqoopTool: Please note that --hive-home, --hive-partition-key, 13/08/01 17:38:53 INFO tool.BaseSqoopTool: hive-partition-value and --map-column-hive options are 13/08/01 17:38:53 INFO tool.BaseSqoopTool: are also valid for HCatalog imports and exports 13/08/01 17:38:53 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cloudera.sqoop.manager.DefaultManagerFactory 13/08/01 17:38:53 DEBUG sqoop.ConnFactory: Trying ManagerFactory: com.cloudera.sqoop.manager.DefaultManagerFactory 13/08/01 17:38:53 DEBUG manager.DefaultManagerFactory: Trying with scheme: jdbc:oracle:thin:@brsusdv.merck.com:25553 13/08/01 17:38:53 DEBUG manager.OracleManager$ConnCache: Instantiated new connection cache. 13/08/01 17:38:53 INFO manager.SqlManager: Using default fetchSize of 1000 13/08/01 17:38:53 DEBUG sqoop.ConnFactory: Instantiated ConnManager org.apache.sqoop.manager.OracleManager@35285701 13/08/01 17:38:53 DEBUG hive.HiveImport: Hive.inputTable: BIODATA.CMPD_PHASE_VIEW 13/08/01 17:38:53 DEBUG hive.HiveImport: Hive.outputTable: hello 13/08/01 17:38:53 DEBUG manager.OracleManager: Using column names query: SELECT t.* FROM BIODATA.CMPD_PHASE_VIEW t WHERE 1=0 13/08/01 17:38:53 DEBUG manager.OracleManager: Creating a new connection for jdbc:oracle:thin:@brsusdv.merck.com:25553:DEV066, using username: huron 13/08/01 17:38:53 DEBUG manager.OracleManager: No connection paramenters specified. Using regular API for making connection. 13/08/01 17:38:54 INFO manager.OracleManager: Time zone has been set to GMT 13/08/01 17:38:54 DEBUG manager.SqlManager: Using fetchSize for next query: 1000 13/08/01 17:38:54 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM BIODATA.CMPD_PHASE_VIEW t WHERE 1=0 13/08/01 17:38:54 DEBUG manager.OracleManager$ConnCache: Caching released connection for jdbc:oracle:thin:@brsusdv.merck.com:25553:DEV066/huron 13/08/01 17:38:54 WARN hive.TableDefWriter: Column PROTOCOL_VERSION had to be cast to a less precise type in Hive 13/08/01 17:38:54 WARN hive.TableDefWriter: Column NOTEBOOK_NUMBER had to be cast to a less precise type in Hive 13/08/01 17:38:54 WARN hive.TableDefWriter: Column EVENT_DATE had to be cast to a less precise type in Hive 13/08/01 17:38:54 WARN hive.TableDefWriter: Column QA_REFERENCE_GROUP had to be cast to a less precise type in Hive 13/08/01 17:38:54 WARN hive.TableDefWriter: Column RESULT_ID had to be cast to a less precise type in Hive 13/08/01 17:38:54 WARN hive.TableDefWriter: Column GROUP_ID had to be cast to a less precise type in Hive 13/08/01 17:38:54 WARN hive.TableDefWriter: Column TESTED_CONCENTRATION had to be cast to a less precise type in Hive 13/08/01 17:38:54 WARN hive.TableDefWriter: Column MODIFIED_DATE had to be cast to a less precise type in Hive 13/08/01 17:38:54 WARN hive.TableDefWriter: Column CMPD_PHASE had to be cast to a less precise type in Hive 13/08/01 17:38:54 DEBUG hive.TableDefWriter: Create statement: CREATE TABLE IF NOT EXISTS `hello` ( `SAMPLE_ID` STRING, `COMPOUND_ID` STRING, `PARENT_ID` STRING, `LOAD_JOB_NUMBER` STRING, `PROTOCOL_VERSION` DOUBLE, `NOTEBOOK_NUMBER` DOUBLE, `NOTEBOOK_PAGE_REFERENCE` STRING, `EVENT_DATE` STRING, `QA_REFERENCE_RESULT` STRING, `QA_REFERENCE_GROUP` DOUBLE, `EXPERIMENT_DESCRIPTION` STRING, `RESULT_ID` DOUBLE, `GROUP_ID` DOUBLE, `MASKED_RESULT` STRING, `TESTED_CONCENTRATION` DOUBLE, `TESTED_CONCENTRATION_UNITS` STRING, `INVESTIGATOR` STRING, `PRODUCED_BY` STRING, `MODIFIED_DATE` STRING, `ANNOTATION` STRING, `COMPOUND_STATE` STRING, `CMPD_PHASE_QUAL` STRING, `CMPD_PHASE` DOUBLE, `VALUE_UNIT` STRING) COMMENT 'Imported by sqoop on 2013/08/01 17:38:54' ROW FORMAT DELIMITED FIELDS TERMINATED BY '\001' LINES TERMINATED BY '\012' STORED AS TEXTFILE SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 13/08/01 17:38:55 DEBUG hive.TableDefWriter: Load statement: LOAD DATA INPATH 'hdfs://ip-54-40-237-75:17020/user/mapred/BIODATA.CMPD_PHASE_VIEW' OVERWRITE INTO TABLE `hello` 13/08/01 17:38:55 INFO hive.HiveImport: Loading uploaded data into Hive 13/08/01 17:38:55 DEBUG hive.HiveImport: Using in-process Hive instance. 13/08/01 17:38:55 DEBUG util.SubprocessSecurityManager: Installing subprocess security manager 13/08/01 17:38:56 WARN conf.Configuration: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize 13/08/01 17:38:56 WARN conf.Configuration: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize 13/08/01 17:38:56 WARN conf.Configuration: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack 13/08/01 17:38:56 WARN conf.Configuration: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node 13/08/01 17:38:56 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces 13/08/01 17:38:56 WARN conf.Configuration: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative 13/08/01 17:38:56 WARN conf.Configuration: org.apache.hadoop.hive.conf.LoopingByteArrayInputStream@385ec662:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. 13/08/01 17:38:56 WARN conf.Configuration: org.apache.hadoop.hive.conf.LoopingByteArrayInputStream@385ec662:an attempt to override final parameter: yarn.nodemanager.local-dirs; Ignoring. 13/08/01 17:38:56 WARN conf.Configuration: org.apache.hadoop.hive.conf.LoopingByteArrayInputStream@385ec662:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.11.0.2.0.4.0-38.jar!/hive-log4j.properties
