Hi,
You can check incidents (
https://phabricator.wikimedia.org/project/profile/2143/) and as you can
see, there was an incident due to hardware failure of primary database of
es7 cluster which got fixed in twenty minutes (
https://phabricator.wikimedia.org/T430764)

Best

Am Mi., 1. Juli 2026 um 11:23 Uhr schrieb Martin Domdey via Wikitech-l <
[email protected]>:

> Hi!
>
> While editing dewiki last night I got many 
> internal_api_error_DBConnectionErrors
> 200 last night.
>
> With this I send you the headers.
>
> What was or is the problem?
>
> Solution maybe: Isn't it possible, to catch such errors on your side and
> repeat the api action?
>
> Thanks, Martin aka Doc Taxon
>
>
> headers(age)                       = 12
> headers(cache-control)             = private, must-revalidate, max-age=0
> headers(content-disposition)       = inline; filename=api-result.json
> headers(content-encoding)          = gzip
> headers(content-length)            = 200
> headers(content-security-policy)   = default-src 'self'; script-src
> 'none'; object-src 'none'
> headers(content-type)              = application/json; charset=utf-8
> headers(date)                      = Wed, 01 Jul 2026 00:26:34 GMT
> headers(http)                      = HTTP/2 200
> headers(mediawiki-api-error)       = internal_api_error_DBConnectionError
> headers(nel)                       = { "report_to": "wm_nel", "max_age":
> 604800, "failure_fraction": 0.0
> 5, "success_fraction": 0.0}
> headers(report-to)                 = { "group": "wm_nel", "max_age":
> 604800, "endpoints": [{ "url": "htt
> ps://
> intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report
> ingapi/network_error/1.0.0" }] }
> headers(server)                    = mw-api-ext.eqiad.main-694cc968b-j589w
> headers(server-timing)             = cache;desc="pass", host;desc="cp1100"
> headers(strict-transport-security) = max-age=106384710; includeSubDomains;
> preload
> headers(vary)                      = Accept-Encoding,User-Agent
> headers(x-cache)                   = cp1100 pass, cp1100 pass
> headers(x-cache-status)            = pass
> headers(x-client-ip)               = 2a02:ec80:a000:1::2ff
> headers(x-content-type-options)    = nosniff
> headers(x-frame-options)           = DENY
> headers(x-request-id)              = 224a2e3b-1c58-449f-998b-69eadd20f3c5
>
> headers(age)                       = 8
> headers(cache-control)             = private, must-revalidate, max-age=0
> headers(content-disposition)       = inline; filename=api-result.json
> headers(content-encoding)          = gzip
> headers(content-length)            = 200
> headers(content-security-policy)   = default-src 'self'; script-src
> 'none'; object-src 'none'
> headers(content-type)              = application/json; charset=utf-8
> headers(date)                      = Wed, 01 Jul 2026 00:26:44 GMT
> headers(http)                      = HTTP/2 200
> headers(mediawiki-api-error)       = internal_api_error_DBConnectionError
> headers(nel)                       = { "report_to": "wm_nel", "max_age":
> 604800, "failure_fraction": 0.0
> 5, "success_fraction": 0.0}
> headers(report-to)                 = { "group": "wm_nel", "max_age":
> 604800, "endpoints": [{ "url": "htt
> ps://
> intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report
> ingapi/network_error/1.0.0" }] }
> headers(server)                    = mw-api-ext.eqiad.main-694cc968b-g64jn
> headers(server-timing)             = cache;desc="pass", host;desc="cp1100"
> headers(strict-transport-security) = max-age=106384710; includeSubDomains;
> preload
> headers(vary)                      = Accept-Encoding,User-Agent
> headers(x-cache)                   = cp1100 pass, cp1100 pass
> headers(x-cache-status)            = pass
> headers(x-client-ip)               = 2a02:ec80:a000:1::2ff
> headers(x-content-type-options)    = nosniff
> headers(x-frame-options)           = DENY
> headers(x-request-id)              = a166a3d0-5bf1-4254-aa04-ef0df74be70e
>
> headers(age)                       = 6
> headers(cache-control)             = private, must-revalidate, max-age=0
> headers(content-disposition)       = inline; filename=api-result.json
> headers(content-encoding)          = gzip
> headers(content-length)            = 199
> headers(content-security-policy)   = default-src 'self'; script-src
> 'none'; object-src 'none'
> headers(content-type)              = application/json; charset=utf-8
> headers(date)                      = Wed, 01 Jul 2026 00:26:54 GMT
> headers(http)                      = HTTP/2 200
> headers(mediawiki-api-error)       = internal_api_error_DBConnectionError
> headers(nel)                       = { "report_to": "wm_nel", "max_age":
> 604800, "failure_fraction": 0.0
> 5, "success_fraction": 0.0}
> headers(report-to)                 = { "group": "wm_nel", "max_age":
> 604800, "endpoints": [{ "url": "htt
> ps://
> intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report
> ingapi/network_error/1.0.0" }] }
> headers(server)                    = mw-api-ext.eqiad.main-694cc968b-256kl
> headers(server-timing)             = cache;desc="pass", host;desc="cp1100"
> headers(strict-transport-security) = max-age=106384710; includeSubDomains;
> preload
> headers(vary)                      = Accept-Encoding,User-Agent
> headers(x-cache)                   = cp1100 pass, cp1100 pass
> headers(x-cache-status)            = pass
> headers(x-client-ip)               = 2a02:ec80:a000:1::2ff
> headers(x-content-type-options)    = nosniff
> headers(x-frame-options)           = DENY
> headers(x-request-id)              = 309edfc8-bdf1-431f-804a-8830208cbe32
>
> headers(age)                       = 6
> headers(cache-control)             = private, must-revalidate, max-age=0
> headers(content-disposition)       = inline; filename=api-result.json
> headers(content-encoding)          = gzip
> headers(content-length)            = 200
> headers(content-security-policy)   = default-src 'self'; script-src
> 'none'; object-src 'none'
> headers(content-type)              = application/json; charset=utf-8
> headers(date)                      = Wed, 01 Jul 2026 00:29:14 GMT
> headers(http)                      = HTTP/2 200
> headers(mediawiki-api-error)       = internal_api_error_DBConnectionError
> headers(nel)                       = { "report_to": "wm_nel", "max_age":
> 604800, "failure_fraction": 0.0
> 5, "success_fraction": 0.0}
> headers(report-to)                 = { "group": "wm_nel", "max_age":
> 604800, "endpoints": [{ "url": "htt
> ps://
> intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report
> ingapi/network_error/1.0.0" }] }
> headers(server)                    = mw-api-ext.eqiad.main-694cc968b-mqqdw
> headers(server-timing)             = cache;desc="pass", host;desc="cp1100"
> headers(strict-transport-security) = max-age=106384710; includeSubDomains;
> preload
> headers(vary)                      = Accept-Encoding,User-Agent
> headers(x-cache)                   = cp1100 pass, cp1100 pass
> headers(x-cache-status)            = pass
> headers(x-client-ip)               = 2a02:ec80:a000:1::2ff
> headers(x-content-type-options)    = nosniff
> headers(x-frame-options)           = DENY
> headers(x-request-id)              = e2bd9fbb-995b-4c57-9281-8a91b7dd8202
>
> headers(age)                       = 0
> headers(cache-control)             = private, must-revalidate, max-age=0
> headers(content-disposition)       = inline; filename=api-result.json
> headers(content-encoding)          = gzip
> headers(content-length)            = 200
> headers(content-security-policy)   = default-src 'self'; script-src
> 'none'; object-src 'none'
> headers(content-type)              = application/json; charset=utf-8
> headers(date)                      = Wed, 01 Jul 2026 00:30:31 GMT
> headers(http)                      = HTTP/2 200
> headers(mediawiki-api-error)       = internal_api_error_DBConnectionError
> headers(nel)                       = { "report_to": "wm_nel", "max_age":
> 604800, "failure_fraction": 0.0
> 5, "success_fraction": 0.0}
> headers(report-to)                 = { "group": "wm_nel", "max_age":
> 604800, "endpoints": [{ "url": "htt
> ps://
> intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report
> ingapi/network_error/1.0.0" }] }
> headers(server)                    = mw-api-ext.eqiad.main-694cc968b-cxl2x
> headers(server-timing)             = cache;desc="pass", host;desc="cp1100"
> headers(strict-transport-security) = max-age=106384710; includeSubDomains;
> preload
> headers(vary)                      = Accept-Encoding,User-Agent
> headers(x-cache)                   = cp1100 pass, cp1100 pass
> headers(x-cache-status)            = pass
> headers(x-client-ip)               = 2a02:ec80:a000:1::2ff
> headers(x-content-type-options)    = nosniff
> headers(x-frame-options)           = DENY
> headers(x-request-id)              = 0bfa35a3-e17f-42e1-8acc-67197f0ed381
>
> headers(age)                       = 0
> headers(cache-control)             = private, must-revalidate, max-age=0
> headers(content-disposition)       = inline; filename=api-result.json
> headers(content-encoding)          = gzip
> headers(content-length)            = 200
> headers(content-security-policy)   = default-src 'self'; script-src
> 'none'; object-src 'none'
> headers(content-type)              = application/json; charset=utf-8
> headers(date)                      = Wed, 01 Jul 2026 00:31:31 GMT
> headers(http)                      = HTTP/2 200
> headers(mediawiki-api-error)       = internal_api_error_DBConnectionError
> headers(nel)                       = { "report_to": "wm_nel", "max_age":
> 604800, "failure_fraction": 0.0
> 5, "success_fraction": 0.0}
> headers(report-to)                 = { "group": "wm_nel", "max_age":
> 604800, "endpoints": [{ "url": "htt
> ps://
> intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report
> ingapi/network_error/1.0.0" }] }
> headers(server)                    = mw-api-ext.eqiad.main-694cc968b-w98b9
> headers(server-timing)             = cache;desc="pass", host;desc="cp1100"
> headers(strict-transport-security) = max-age=106384710; includeSubDomains;
> preload
> headers(vary)                      = Accept-Encoding,User-Agent
> headers(x-cache)                   = cp1100 pass, cp1100 pass
> headers(x-cache-status)            = pass
> headers(x-client-ip)               = 2a02:ec80:a000:1::2ff
> headers(x-content-type-options)    = nosniff
> headers(x-frame-options)           = DENY
> headers(x-request-id)              = 96cb2aa8-e00f-4895-bcb1-37d93d0d7333
>
> headers(age)                       = 0
> headers(cache-control)             = private, must-revalidate, max-age=0
> headers(content-disposition)       = inline; filename=api-result.json
> headers(content-encoding)          = gzip
> headers(content-length)            = 200
> headers(content-security-policy)   = default-src 'self'; script-src
> 'none'; object-src 'none'
> headers(content-type)              = application/json; charset=utf-8
> headers(date)                      = Wed, 01 Jul 2026 00:32:22 GMT
> headers(http)                      = HTTP/2 200
> headers(mediawiki-api-error)       = internal_api_error_DBConnectionError
> headers(nel)                       = { "report_to": "wm_nel", "max_age":
> 604800, "failure_fraction": 0.0
> 5, "success_fraction": 0.0}
> headers(report-to)                 = { "group": "wm_nel", "max_age":
> 604800, "endpoints": [{ "url": "htt
> ps://
> intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report
> ingapi/network_error/1.0.0" }] }
> headers(server)                    = mw-api-ext.eqiad.main-694cc968b-qk4s7
> headers(server-timing)             = cache;desc="pass", host;desc="cp1100"
> headers(strict-transport-security) = max-age=106384710; includeSubDomains;
> preload
> headers(vary)                      = Accept-Encoding,User-Agent
> headers(x-cache)                   = cp1100 pass, cp1100 pass
> headers(x-cache-status)            = pass
> headers(x-client-ip)               = 2a02:ec80:a000:1::2ff
> headers(x-content-type-options)    = nosniff
> headers(x-frame-options)           = DENY
> headers(x-request-id)              = 25f90b29-cae6-4436-a696-9314f8e467b8
>
> headers(age)                       = 0
> headers(cache-control)             = private, must-revalidate, max-age=0
> headers(content-disposition)       = inline; filename=api-result.json
> headers(content-encoding)          = gzip
> headers(content-length)            = 200
> headers(content-security-policy)   = default-src 'self'; script-src
> 'none'; object-src 'none'
> headers(content-type)              = application/json; charset=utf-8
> headers(date)                      = Wed, 01 Jul 2026 00:35:04 GMT
> headers(http)                      = HTTP/2 200
> headers(mediawiki-api-error)       = internal_api_error_DBConnectionError
> headers(nel)                       = { "report_to": "wm_nel", "max_age":
> 604800, "failure_fraction": 0.0
> 5, "success_fraction": 0.0}
> headers(report-to)                 = { "group": "wm_nel", "max_age":
> 604800, "endpoints": [{ "url": "htt
> ps://
> intake-logging.wikimedia.org/v1/events?stream=w3c.reportingapi.network_error&schema_uri=/w3c/report
> ingapi/network_error/1.0.0" }] }
> headers(server)                    = mw-api-ext.eqiad.main-694cc968b-zp7bk
> headers(server-timing)             = cache;desc="pass", host;desc="cp1100"
> headers(strict-transport-security) = max-age=106384710; includeSubDomains;
> preload
> headers(vary)                      = Accept-Encoding,User-Agent
> headers(x-cache)                   = cp1100 pass, cp1100 pass
> headers(x-cache-status)            = pass
> headers(x-client-ip)               = 2a02:ec80:a000:1::2ff
> headers(x-content-type-options)    = nosniff
> headers(x-frame-options)           = DENY
> headers(x-request-id)              = d7e8eb8c-04c8-486a-a84a-32acd653e581
> _______________________________________________
> Wikitech-l mailing list -- [email protected]
> To unsubscribe send an email to [email protected]
> https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/



-- 
Amir (he/him)
_______________________________________________
Wikitech-l mailing list -- [email protected]
To unsubscribe send an email to [email protected]
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/

Reply via email to