Hi, Suresh hive-metastore seems to have no info about sqoop trying to do anything. Found nothing.
when using just hive command to create table - hive-metastore has all logs, SQL statement, usernames and etc. Kirill On Tue, Jun 4, 2019 at 2:57 PM Suresh Kumar Sethuramaswamy < rock...@gmail.com> wrote: > Couple of things to check > > 1. Check if there is a hive-site.xml placed mistakenly in the current > working directory, if so remove it, else it might overwrite system config > > 2. Get the hive-metastore log for any clues while sqoop import happens > > Regards > Suresh > > On Tue, Jun 4, 2019, 7:16 AM K Makeev <k.mak...@gmail.com wrote: > >> Hi >> >> Trying to import simple test table from oracle to hive using sqoop. >> >> Sqoop successfully fetches oracle data, puts them to HDFS, but when it >> comes to hive it doesn't seem to work. Sqoop writes no errors or warnings >> to output. It jus quits. >> >> Here is my command line >> >> sqoop import --connect jdbc:oracle:thin:@host:1521:SID --username >> username --password password --delete-target-dir --table TEST_SQOOP >> --hive-import --hive-database db -m 1 -verbose >> >> Here is the end of verbose output >> >> 19/06/03 18:28:02 DEBUG hive.TableDefWriter: Create statement: CREATE >> TABLE IF NOT EXISTS `db`.`TEST_SQOOP` ( `A` DOUBLE, `B` STRING, `D` STRING) >> COMMENT 'Imported by sqoop on 2019/06/03 18:28:02' ROW FORMAT DELIMITED >> FIELDS TERMINATED BY '\001' LINES TERMINATED BY '\012' STORED AS TEXTFILE >> 19/06/03 18:28:02 DEBUG hive.TableDefWriter: Load statement: LOAD DATA >> INPATH 'hdfs://hadoop/user/airflow/TEST_SQOOP' INTO TABLE `db`.`TEST_SQOOP` >> 19/06/03 18:28:02 DEBUG ipc.Client: The ping interval is 60000 ms. >> 19/06/03 18:28:02 DEBUG ipc.Client: Connecting to hadoop-m1/ip:8020 >> 19/06/03 18:28:02 DEBUG ipc.Client: IPC Client (2071364564) connection to >> hadoop-m1/ip:8020 from airflow: starting, having connections 2 >> 19/06/03 18:28:02 DEBUG ipc.Client: IPC Client (2071364564) connection to >> hadoop-m1/ip:8020 from airflow sending #779 >> 19/06/03 18:28:02 DEBUG ipc.Client: IPC Client (2071364564) connection to >> hadoop-m1/ip:8020 from airflow got value #779 >> 19/06/03 18:28:02 DEBUG ipc.ProtobufRpcEngine: Call: getFileInfo took 69ms >> 19/06/03 18:28:02 INFO hive.HiveImport: Loading uploaded data into Hive >> 19/06/03 18:28:02 DEBUG hive.HiveImport: Using in-process Hive instance. >> 19/06/03 18:28:02 DEBUG util.SubprocessSecurityManager: Installing >> subprocess security manager >> >> Logging initialized using configuration in >> jar:file:/usr/hdp/2.5.3.0-37/hive/lib/hive-common-1.2.1000.2.5.3.0-37.jar!/hive-log4j.properties >> >> Nothing happens in hive >> >> If i run hive manually through hive command i'm able to execute Create >> Table/LOAD DATA INPATH statements without problems. >> >> Why sqoop doesn't do its hive job? >> >>
