Rajeshbabu Chintaguntla created PHOENIX-6694:
------------------------------------------------
Summary: Share the query plan generated in data source reader in
partition readers to avoid the unnecessary touch basing system tables and meta
table in all the workers.
Key: PHOENIX-6694
URL: https://issues.apache.org/jira/browse/PHOENIX-6694
Project: Phoenix
Issue Type: Bug
Components: spark-connector
Reporter: Rajeshbabu Chintaguntla
Assignee: Rajeshbabu Chintaguntla
Currently we are preparing the query plan in both data source and partition
readers which is creating new connection in each worker and job initialisation
which unnecessarily touch basing all both system catalog table, system stats
table as well as meta. When there are jobs with millions of parallel workers
hotspot the region servers holding the meta and system catalog as well system
stats table. So if we share the same query plan between the workers which can
avoid the hotspot.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
