Hello, I'm working on a HDP-2.6.5.0 cluster with kerberos enabled and I have a problem with hive as any DDL statement that I run takes minutes to execute but any DML run in normal limits. I checked the logs but I didn't find anything that seems related with this problem and I would appreciate any help to debug this issue.
Please find bellow some examples with DDL&DML queries and their durations: ------------------------------------ 0: jdbc:hive2://hdpx03:10000/> CREATE EXTERNAL TABLE IF NOT EXISTS agenti1 (...) STORED AS ORC LOCATION '/staging/core/agenti/2019-03-18/29d52a54eecae3731b31a3d6ef45d012'; No rows affected (184.191 seconds) ------------------------------------ 0: jdbc:hive2://hdpx03:10000/> show tables; +-----------+--+ | tab_name | +-----------+--+ | agenti1 | +-----------+--+ 1 row selected (0.358 seconds) --------------------------------- 0: jdbc:hive2://hdpx03:10000/> select count(*) as total from agenti1 where 1; INFO : Tez session hasn't been created yet. Opening session INFO : Dag name: select count(*) as total from agenti1 wh...1(Stage-1) INFO : Status: Running (Executing on YARN cluster with App id application_1552674174918_0002) -------------------------------------------------------------------------------- VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED -------------------------------------------------------------------------------- Map 1 .......... SUCCEEDED 1 1 0 0 0 0 Reducer 2 ...... SUCCEEDED 1 1 0 0 0 0 -------------------------------------------------------------------------------- VERTICES: 02/02 [==========================>>] 100% ELAPSED TIME: 5.48 s -------------------------------------------------------------------------------- +--------+--+ | total | +--------+--+ | 1960 | +--------+--+ 1 row selected (15.853 seconds) ------------------------------------------------------- 0: jdbc:hive2://hdpx03:10000/> drop table agenti1; No rows affected (184.164 seconds) -------------------------------------------------------- 0: jdbc:hive2://hdpx03:10000/> CREATE EXTERNAL TABLE IF NOT EXISTS agenti1 (...) STORED AS ORC LOCATION '/staging/core/agenti/2019-03-18/29d52a54eecae3731b31a3d6ef45d012'; No rows affected (190.288 seconds) Thanks, Iulian
