Mohammad Arshad created AMBARI-25977:
----------------------------------------
Summary: Increase default value of phoenix.mutate.maxSizeBytes
from 100 MB to 255 MB
Key: AMBARI-25977
URL: https://issues.apache.org/jira/browse/AMBARI-25977
Project: Ambari
Issue Type: Bug
Components: ambari-metrics
Affects Versions: metrics-3.0.0
Reporter: Mohammad Arshad
Assignee: Mohammad Arshad
Default value of phoenix.mutate.maxSizeBytes is 104857600(100 MB). As number of
records in a batch by default are set to 10000, some times this value is not
sufficient and collector fails, to store aggregated data, with following error
{code:java}
2023-07-25 11:21:21,500 WARN
org.apache.ambari.metrics.core.timeline.PhoenixHBaseAccessor: Failed on insert
records to store : ERROR 730 (LIM02): MutationState size is bigger than maximum
allowed number of bytes, try upserting rows in smaller batches or using
autocommit on for deletes. maxMutationSizeBytes=104857600
mutationSizeBytes=104858209
2023-07-25 11:21:21,500 WARN
org.apache.ambari.metrics.core.timeline.PhoenixHBaseAccessor: Metric that
cannot be stored :
[regionserver.Server.rpcScanRequestCount,hbase]{1690284077957=162.7735639506746,
1690284092957=105.90141339016705, 1690284107957=171.52342993691653,
1690284122957=133.09041926456285}
2023-07-25 11:21:21,597 WARN
org.apache.ambari.metrics.core.timeline.PhoenixHBaseAccessor: Failed on insert
records to store : ERROR 730 (LIM02): MutationState size is bigger than maximum
allowed number of bytes, try upserting rows in smaller batches or using
autocommit on for deletes. maxMutationSizeBytes=104857600
mutationSizeBytes=104858964
2023-07-25 11:21:21,598 WARN
org.apache.ambari.metrics.core.timeline.PhoenixHBaseAccessor: Metric that
cannot be stored :
[regionserver.WAL.SyncTime_median,hbase]{1690284077957=188.0381529206563,
1690284092957=154.30748048226928, 1690284107957=190.57156509009513,
1690284122957=195.3577965382318}
{code}
lets set phoenix.mutate.maxSizeBytes value to 267386880 (255 MB) to make it
more reasonable with batch size.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
