hashar added a comment.
`$wgLocalisationCacheConf['store'] = 'array';` that is the format used to
store the cache. Looking at the `mw-debug-www.log` generated by a Selenium, it
gets the localization cache from Memcached:
[MessageCache] MessageCache using store MemcachedPhpBagOStuff
[memcached] MemCache: got WANCache:wikidb:messages:en:hash:v1|#|v
[memcached] MemCache: got WANCache:wikidb:messages:en|#|t
[memcached] get(wikidb:messages:en)
[memcached] MemCache: sock i:0; got wikidb:messages:en
[MessageCache] MessageCache::loadUnguarded: Loading en... local cache is
empty, got from global cache
If I look at the `GET /` originating from Cypress (which is the first in the
debug log), I don't see anything suspicious beside the `recentChangesUpdate`
job, but maybe that is the one taking a lot of memory.
Start request GET /
IP: 127.0.0.1
HTTP HEADERS:
ACCEPT-ENCODING: gzip, deflate
HOST: 127.0.0.1:9413
ACCEPT: */*
USER-AGENT: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like
Gecko) Cypress/13.6.4 Chrome/114.0.5735.289 Electron/25.8.4 Safari/537.36
CONNECTION: keep-alive
(end headers)
[Wikibase] Wikibase\Lib\SettingsArray::getSetting: setting entitySources
was given as a closure, resolve it to array (
'local' =>
array (
'entityNamespaces' =>
array (
'item' => 120,
'property' => 122,
'lexeme' => 146,
'mediainfo' => '6/mediainfo',
),
'repoDatabase' => false,
'baseUri' => 'http://127.0.0.1:9413/entity/',
'rdfNodeNamespacePrefix' => 'wd',
'rdfPredicateNamespacePrefix' => '',
'interwikiPrefix' => '',
),
)
[session] SessionManager using store MemcachedPhpBagOStuff
[localisation] LocalisationCache using store LCStoreStaticArray
[memcached] MainWANObjectCache using store MemcachedPhpBagOStuff
[memcached] MicroStash using store MemcachedPhpBagOStuff
[SQLBagOStuff] MainObjectStash using store SqlBagOStuff
[session] CentralAuthSessionProvider::provideSessionInfo: Not enabled,
falling back to core sessions
[session] SessionBackend "791jiahib6s5edn2jaompkac276h33e0" is unsaved,
marking dirty in constructor
[session] SessionBackend "791jiahib6s5edn2jaompkac276h33e0" save:
dataDirty=1 metaDirty=1 forcePersist=0
[cookie] already deleted setcookie: "wikidb_session", "", "1676021349",
"/", "", "", "1", ""
[cookie] already deleted setcookie: "wikidbUserID", "", "1676021349", "/",
"", "", "1", ""
[cookie] already deleted setcookie: "wikidbToken", "", "1676021349", "/",
"", "", "1", ""
[session] SessionBackend "791jiahib6s5edn2jaompkac276h33e0" data dirty due
to dirty():
MediaWiki\Session\SessionManager->getSessionForRequest/MediaWiki\Session\SessionManager->getInitialSession/MediaWiki\Session\Session->getToken/MediaWiki\Session\Session->set/MediaWiki\Session\SessionBackend->dirty
[session] SessionBackend "791jiahib6s5edn2jaompkac276h33e0" save:
dataDirty=1 metaDirty=0 forcePersist=0
[EventLogging] wgEventLoggingBaseUri has not been configured.
[MessageCache] MessageCache using store MemcachedPhpBagOStuff
ParserFactory: using default preprocessor
[memcached] MemCache: got WANCache:wikidb:messages:en:hash:v1|#|v
[memcached] MemCache: got WANCache:wikidb:messages:en|#|t
[memcached] get(wikidb:messages:en)
[memcached] MemCache: sock i:0; got wikidb:messages:en
[MessageCache] MessageCache::loadUnguarded: Loading en... local cache is
empty, got from global cache
MediaWiki\MediaWikiEntryPoint::commitMainTransaction: primary transaction
round committed
MediaWiki\MediaWikiEntryPoint::commitMainTransaction: pre-send deferred
updates completed
MediaWiki\MediaWikiEntryPoint::commitMainTransaction: session changes
committed
[rdbms]
Wikimedia\Rdbms\ChronologyProtector::persistSessionReplicationPositions: no
primary positions data to save
[rdbms] Wikimedia\Rdbms\LBFactory::shutdown: finished ChronologyProtector
shutdown
[rdbms] LBFactory shutdown completed
MediaWiki\Output\OutputPage::haveCacheVaryCookies: no cache-varying cookies
found
[memcached] add
WANCache:global:rdbms-server-readonly:localhost%3A/workspace/db/quibble-mysql-wa62l0ku/socket|#|m
(STORED)
[rdbms] Wikimedia\Rdbms\DatabaseMySQL::open [0.436ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SET group_concat_max_len
= 262144, `sql_mode` = 'STRICT_ALL_TABLES,ONLY_FULL_GROUP_BY'
[rdbms] Wikimedia\Rdbms\LoadBalancer::reallyOpenConnection: opened new
connection for 0/
[memcached] add
WANCache:global:rdbms-server-readonly:localhost%3A/workspace/db/quibble-mysql-wa62l0ku/socket|#|m
(NOT_STORED)
[memcached]
fetchOrRegenerate(global:rdbms-server-readonly:localhost%3A/workspace/db/quibble-mysql-wa62l0ku/socket):
busy miss
[rdbms] Wikimedia\Rdbms\DatabaseMySQL::serverIsReadOnly [1.186ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SELECT
@@GLOBAL.read_only AS Value
[memcached] client: serializing data as it is not scalar
[memcached] add
WANCache:global:rdbms-server-readonly:localhost%3A/workspace/db/quibble-mysql-wa62l0ku/socket|#|v
(STORED)
[memcached] MemCache: delete
WANCache:global:rdbms-server-readonly:localhost%3A/workspace/db/quibble-mysql-wa62l0ku/socket|#|m
(DELETED)
[memcached]
fetchOrRegenerate(global:rdbms-server-readonly:localhost%3A/workspace/db/quibble-mysql-wa62l0ku/socket):
miss, new value computed
[rdbms] Wikimedia\Rdbms\DatabaseMySQL::doSelectDomain [0.418ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: USE `wikidb`
[rdbms] Wikimedia\Rdbms\LoadBalancer::reuseOrOpenConnectionForNewRef:
reusing connection for 0/wikidb
[rdbms] Wikimedia\Rdbms\Database::beginIfImplied
(MediaWiki\Page\PageStore::getPageByNameViaLinkCache) [0.139ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: BEGIN
[rdbms] MediaWiki\Page\PageStore::getPageByNameViaLinkCache [0.996ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SELECT
page_id,page_namespace,page_title,page_is_redirect,page_is_new,page_touched,page_links_updated,page_latest,page_len,page_content_model
FROM `page` WHERE page_namespace = 0 AND page_title = 'Main_Page' LIMIT 1
[ContentHandler] Registered handler for wikitext: WikitextContentHandler
MediaWiki\Output\OutputPage::sendCacheControl: private caching (config);
Sat, 10 Feb 2024 09:29:09 GMT **
[rdbms] MediaWiki\MediaWikiEntryPoint::restInPeace [0.411ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: COMMIT
[DeferredUpdates] DeferredUpdates::run: started
MediaWiki\Deferred\TransactionRoundDefiningUpdate_MediaWiki\MediaWikiEntryPoint::schedulePostSendJobs
#1305
[memcached]
getWithSetCallback(global:rdbms-server-readonly:localhost%3A/workspace/db/quibble-mysql-wa62l0ku/socket):
process cache hit
[rdbms] Wikimedia\Rdbms\DatabaseMySQL::open [0.213ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SET group_concat_max_len
= 262144, `sql_mode` = 'STRICT_ALL_TABLES,ONLY_FULL_GROUP_BY'
[rdbms] Wikimedia\Rdbms\LoadBalancer::reallyOpenConnection: opened new
connection for 0/wikidb
[memcached]
getWithSetCallback(global:rdbms-server-readonly:localhost%3A/workspace/db/quibble-mysql-wa62l0ku/socket):
process cache hit
[rdbms] JobQueueDB::doGetSiblingQueuesWithJobs [3.164ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SELECT DISTINCT job_cmd
FROM `job` WHERE job_cmd IN
('updateBetaFeaturesUserCounts','crosswikiSuppressUser','LocalRenameUserJob','LocalPageMoveJob','CentralAuthCreateLocalAccountJob','CentralAuthUnattachUserJob','checkuserLogTemporaryAccountAccess','checkuserPruneCheckUserDataJob','cirrusSearchDeletePages','cirrusSearchIncomingLinkCount','cirrusSearchLinksUpdate','cirrusSearchLinksUpdatePrioritized','cirrusSearchMassIndex','cirrusSearchOtherIndex','cirrusSearchElasticaWrite','cirrusSearchCheckerJob','cirrusSearchDeleteArchive','EchoNotificationJob','EchoNotificationDeleteJob','EchoPushNotificationRequest','flaggedrevs_CacheUpdate','RecordLintJob','securePollPopulateVoterList','securePollTallyElection','securePollLogAdminAction','securePollArchiveElection','securePollUnarchiveElection','webVideoTranscode','webVideoTranscodePrioritized','CleanTermsIfUnused','PurgeEntityData','UpdateRepoOnMove','UpdateRepoOnDelete','DispatchChanges','DispatchChangeDeletionNotification','DispatchChangeVisibilityNotification','wikibase-addUsagesForPage','EntityChangeNotification','ChangeVisibilityNotification','ChangeDeletionNotification','wikibase-InjectRCRecords','constraintsTableUpdate','constraintsRunCheck','deletePage','refreshLinks','deleteLinks','htmlCacheUpdate','sendMail','enotifNotify','fixDoubleRedirect','AssembleUploadChunks','PublishStashedFile','ThumbnailRender','recentChangesUpdate','refreshLinksPrioritized','refreshLinksDynamic','activityUpdateJob','categoryMembershipChange','clearUserWatchlist','watchlistExpiry','cdnPurge','userGroupExpiry','clearWatchlistNotifications','userOptionsUpdate','revertedTagUpdate','null','userEditCountInit','parsoidCachePrewarm','renameUser')
[rdbms] Wikimedia\Rdbms\LoadBalancer::reuseOrOpenConnectionForNewRef:
reusing connection for 0/wikidb
[rdbms] Wikimedia\Rdbms\LoadBalancer::reuseOrOpenConnectionForNewRef:
reusing connection for 0/wikidb
[rdbms] JobQueueDB::claimRandom [0.653ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SELECT
job_id,job_cmd,job_namespace,job_title,job_timestamp,job_params,job_random,job_attempts,job_token,job_token_timestamp,job_sha1
FROM `job` WHERE job_cmd = 'recentChangesUpdate' AND job_token = '' LIMIT
205,1
[memcached]
get(WANCache:global:jobqueue:wikidb:main:recentChangesUpdate:small|#|v)
[memcached] client: serializing data as it is not scalar
[memcached] add
WANCache:global:jobqueue:wikidb:main:recentChangesUpdate:small|#|v (STORED)
[rdbms] JobQueueDB::claimRandom [0.669ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SELECT
job_id,job_cmd,job_namespace,job_title,job_timestamp,job_params,job_random,job_attempts,job_token,job_token_timestamp,job_sha1
FROM `job` WHERE job_cmd = 'recentChangesUpdate' AND job_token = '' AND
(job_random >= 1611712207) ORDER BY job_random ASC LIMIT 1
[rdbms] JobQueueDB::claimRandom [0.584ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SELECT
job_id,job_cmd,job_namespace,job_title,job_timestamp,job_params,job_random,job_attempts,job_token,job_token_timestamp,job_sha1
FROM `job` WHERE job_cmd = 'recentChangesUpdate' AND job_token = '' AND
(job_random <= 1611712207) ORDER BY job_random DESC LIMIT 1
[rdbms] JobQueueDB::claimRandom [0.823ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: UPDATE `job` SET
job_token = '1c323f030c8fd7bd4f612ef55bfbee82',job_token_timestamp =
'20240210092909',job_attempts = job_attempts+1 WHERE job_cmd =
'recentChangesUpdate' AND job_id = '1' AND job_token = ''
[runJobs] recentChangesUpdate Special:RecentChanges type=cacheUpdate
namespace=-1 title=RecentChanges requestId=10ae3e5465dbdd29dfc90672
(id=1,timestamp=20240210092834) STARTING
[rdbms] Wikimedia\Rdbms\LoadBalancer::reuseOrOpenConnectionForNewRef:
reusing connection for 0/wikidb
[rdbms] RecentChangesUpdateJob::updateActiveUsers [0.405ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SELECT
IF(GET_LOCK('wikidb-activeusers',0),UNIX_TIMESTAMP(SYSDATE(6)),NULL) AS acquired
[rdbms] Wikimedia\Rdbms\DatabaseMySQL::setSessionOptions [0.165ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SET
net_read_timeout=900, net_write_timeout=900
[rdbms] Wikimedia\Rdbms\Database::beginIfImplied
(RecentChangesUpdateJob::updateActiveUsers) [0.084ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: BEGIN
[rdbms] RecentChangesUpdateJob::updateActiveUsers [0.825ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SELECT qci_timestamp
FROM `querycache_info` WHERE qci_type = 'activeusers' LIMIT 1
[rdbms] RecentChangesUpdateJob::updateActiveUsers [1.089ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SELECT
actor_name,MAX(rc_timestamp) AS `lastedittime` FROM `recentchanges` JOIN
`actor` ON ((actor_id=rc_actor)) WHERE (actor_user IS NOT NULL) AND (rc_type
!= 5) AND ((rc_log_type IS NULL OR rc_log_type != 'newusers')) AND
(rc_timestamp >= '20240111092909') AND (rc_timestamp <= '20240210092909')
GROUP BY actor_name ORDER BY NULL
[rdbms] RecentChangesUpdateJob::updateActiveUsers [0.429ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SELECT qcc_title AS
`user_name` FROM `querycachetwo` WHERE qcc_type = 'activeusers' AND
qcc_namespace = 2 AND qcc_title = 'MediaWiki default' AND (qcc_value >=
1704965349)
[rdbms] RecentChangesUpdateJob::updateActiveUsers [0.834ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: INSERT INTO
`querycachetwo`
(qcc_type,qcc_namespace,qcc_title,qcc_value,qcc_namespacetwo,qcc_titletwo)
VALUES ('activeusers',2,'MediaWiki default',1707557314,0,'')
[rdbms] RecentChangesUpdateJob::updateActiveUsers [0.716ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: COMMIT
[rdbms] Wikimedia\Rdbms\LoadBalancer::getAnyOpenConnection: found 'round'
connection to #0.
[rdbms] Wikimedia\Rdbms\Database::beginIfImplied
(RecentChangesUpdateJob::updateActiveUsers) [0.073ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: BEGIN
[rdbms] RecentChangesUpdateJob::updateActiveUsers [0.168ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: REPLACE INTO
`querycache_info` (qci_type,qci_timestamp) VALUES
('activeusers','20240210092909')
[rdbms] RecentChangesUpdateJob::updateActiveUsers [0.228ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: DELETE FROM
`querycachetwo` WHERE qcc_type = 'activeusers' AND (qcc_value < 1704965349)
[rdbms] Wikimedia\Rdbms\LoadBalancer::reuseOrOpenConnectionForNewRef:
reusing connection for 0/wikidb
[rdbms] MediaWiki\Deferred\SiteStatsUpdate::cacheUpdate [0.557ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SELECT COUNT(DISTINCT
rc_actor) FROM `recentchanges` JOIN `actor` ON ((actor_id=rc_actor)) WHERE
(rc_type != 5) AND (actor_user IS NOT NULL) AND (rc_bot = 0) AND ((rc_log_type
!= 'newusers' OR rc_log_type IS NULL)) AND (rc_timestamp >= '20240111092909')
LIMIT 1
[rdbms] MediaWiki\Deferred\SiteStatsUpdate::cacheUpdate [0.232ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: UPDATE `site_stats` SET
ss_active_users = 1 WHERE ss_row_id = 1
[rdbms] RecentChangesUpdateJob::updateActiveUsers [0.155ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: SELECT
RELEASE_LOCK('wikidb-activeusers') AS released
[rdbms] RecentChangesUpdateJob::run [0.284ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: COMMIT
[runJobs] recentChangesUpdate Special:RecentChanges type=cacheUpdate
namespace=-1 title=RecentChanges requestId=10ae3e5465dbdd29dfc90672
(id=1,timestamp=20240210092834) t=12 good
[rdbms] Wikimedia\Rdbms\LoadBalancer::reuseOrOpenConnectionForNewRef:
reusing connection for 0/wikidb
[rdbms] JobQueueDB::doAck [0.718ms]
localhost:/workspace/db/quibble-mysql-wa62l0ku/socket: DELETE FROM `job` WHERE
job_cmd = 'recentChangesUpdate' AND job_id = '1'
[DeferredUpdates] DeferredUpdates::run: ended
MediaWiki\Deferred\TransactionRoundDefiningUpdate_MediaWiki\MediaWikiEntryPoint::schedulePostSendJobs
#1305, processing time: 0.032116174697876
[rdbms] LBFactory shutdown completed
Request ended normally
[session] Saving all sessions on shutdown
TASK DETAIL
https://phabricator.wikimedia.org/T356402
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: hashar
Cc: hashar, Michael, Aklapper, ArthurTaylor, Danny_Benjafield_WMDE,
Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz,
pdehaye, Nandana, Lahi, Gq86, Andrawaag, GoranSMilovanovic, QZanden,
YULdigitalpreservation, KimKelting, LawExplorer, Salgo60, _jensen, rosalieper,
Scott_WUaS, MisterSynergy, thcipriani, abian, Wikidata-bugs, aude,
Lydia_Pintscher, Mbch331, Jay8g
_______________________________________________
Wikidata-bugs mailing list -- [email protected]
To unsubscribe send an email to [email protected]
