Revolyssup commented on code in PR #12518:
URL: https://github.com/apache/apisix/pull/12518#discussion_r2281336584
##########
docs/en/latest/plugins/prometheus.md:
##########
@@ -150,6 +152,56 @@ The following labels are used to differentiate
`apisix_bandwidth` metrics.
| service | ID of the Service that bandwidth corresponds to when
`prefer_name` is `false` (default), and name of the Service when `prefer_name`
to `true`. Default to the configured value of host on the Route if the matched
Route does not belong to any Service. |
| consumer | Name of the Consumer associated with a request. Default to an
empty string if no Consumer is associated with the request.
|
| node | IP address of the upstream node.
|
+| request_type | traditional_http / ai_chat / ai_stream
|
+| llm_model | For non-traditional_http requests, name of the llm_model
|
+
+### Labels for `apisix_llm_latency`
+
+| Name | Description
|
+| ---------- |
-----------------------------------------------------------------------------------------------------------------------------
|
|
+| route_id | ID of the Route that bandwidth corresponds to when
`prefer_name` is `false` (default), and name of the Route when `prefer_name` to
`true`. Default to an empty string if a request does not match any Route.
|
+| service_id | ID of the Service that bandwidth corresponds to when
`prefer_name` is `false` (default), and name of the Service when `prefer_name`
to `true`. Default to the configured value of host on the Route if the matched
Route does not belong to any Service. |
+| consumer | Name of the Consumer associated with a request. Default to an
empty string if no Consumer is associated with the request.
|
+| node | IP address of the upstream node.
|
+| request_type | traditional_http / ai_chat / ai_stream
|
+| llm_model | For non-traditional_http requests, name of the llm_model
|
+
+### Labels for `apisix_llm_active_connections`
+
+| Name | Description
|
+| ---------- |
-----------------------------------------------------------------------------------------------------------------------------
|
+| route | Name of the Route that bandwidth corresponds to. Default to an
empty string if a request does not match any Route.
|
+| route_id | ID of the Route that bandwidth corresponds to when
`prefer_name` is `false` (default), and name of the Route when `prefer_name` to
`true`. Default to an empty string if a request does not match any Route.
|
+| matched_uri | URI of the Route that matches the request. Default to an
empty string if a request does not match any Route.
|
+| matched_host | Host of the Route that matches the request. Default to an
empty string if a request does not match any Route, or host is not configured
on the Route. |
+| service | Name of the Service that bandwidth corresponds to. Default to
the configured value of host on the Route if the matched Route does not belong
to any Service. |
+| service_id | ID of the Service that bandwidth corresponds to when
`prefer_name` is `false` (default), and name of the Service when `prefer_name`
to `true`. Default to the configured value of host on the Route if the matched
Route does not belong to any Service. |
+| consumer | Name of the Consumer associated with a request. Default to an
empty string if no Consumer is associated with the request.
|
+| node | IP address of the upstream node.
|
+| request_type | traditional_http / ai_chat / ai_stream
|
+| llm_model | For non-traditional_http requests, name of the llm_model
|
+
+### Labels for `apisix_llm_completion_tokens`
+
+| Name | Description
|
+| ---------- |
-----------------------------------------------------------------------------------------------------------------------------
|
|
+| route_id | ID of the Route that bandwidth corresponds to when
`prefer_name` is `false` (default), and name of the Route when `prefer_name` to
`true`. Default to an empty string if a request does not match any Route.
|
+| service_id | ID of the Service that bandwidth corresponds to when
`prefer_name` is `false` (default), and name of the Service when `prefer_name`
to `true`. Default to the configured value of host on the Route if the matched
Route does not belong to any Service. |
+| consumer | Name of the Consumer associated with a request. Default to an
empty string if no Consumer is associated with the request.
|
+| node | IP address of the upstream node.
|
+| request_type | traditional_http / ai_chat / ai_stream
|
+| llm_model | For non-traditional_http requests, name of the llm_model
|
Review Comment:
The `_` because this will be shown like this in the prometheus metrics.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscr...@apisix.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
