[
https://issues.apache.org/jira/browse/HIVE-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897353#comment-17897353
]
dailong commented on HIVE-28509:
--------------------------------
It may be that the increment of Hive metadata in MySQL is too large，What is the
current approximate number of hive partitions?
> Hive component Mysql metadata database exception
> --------------------------------------------------
>
> Key: HIVE-28509
> URL: https://issues.apache.org/jira/browse/HIVE-28509
> Project: Hive
> Issue Type: Bug
> Components: Database/Schema
> Affects Versions: 3.1.0
> Reporter: hanlei
> Priority: Critical
>
> we found that the Hive metastore was encountering connection exceptions,
> leading to slow Hive job execution. Furthermore, the MySQL workload showed
> unusual activity, with a 1/3 decrease in QPS. The CPU load exceeded 3100%.
> The slow log in the MySQL backend is primarily for the following two types of
> statements
> Creating sort index
> SELECT 'AO'.'PART_NAME','A0'.'PART_NAME' AS 'NUCORDER0' FROM 'PARTITIONS' A0
> LEFT OUTER JOIN 'TBLS' 'B0' ON 'A0'.'TBL ID' = 'B0'.'TBL_ID' LEFT OUTER JOIN
> 'DBS' 'C0' ON 'B0'.'DB_ID' = 'C0'.'DB_ID' WHERE 'C0'.'NAME' = 'XXXXX' AND
> 'B0'.'TBL_NAME' = 'XXXXXXXXXXXXXXXX' AND 'C0'.'CTLG_NAME' = 'XXXXXXX' ORDER
> BY 'NUCORDER0'
> Sending data
> SELECT 'A0'.'TBL_NAME' FROM 'TBLS' 'A0' LEFT OUTER JOIN 'DBS' 'B0' ON
> 'A0'.'DB_ID'='B0'.'DB_ID' WHERE 'B0'.'NAME' = 'XXXXXXX' AND 'B0'.'CTLG_NAME'
> = 'XXXXXX' AND 'A0'.'TABLE_TYPE' = 'MATERIALIZED_VIEW' AND
> 'A0'.'IS_REWRITE_ENABLED' = 1;
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
