thcipriani added a comment.
In T145819#2650834, @greg wrote:
We're back to wmf.18 now.
explanation on the wmf.19 blockers task T143328#2651001 the rollback was not due to the problems outlined in this task; although, I was not able to confirm that this task was resolved.TASK
greg added a comment.
We're back to wmf.18 now.TASK DETAILhttps://phabricator.wikimedia.org/T145819EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gregCc: thcipriani, Anomie, aaron, MZMcBride, Tobi_WMDE_SW, FastLizard4, JJMC89, zeljkofilipin, Lydia_Pintscher,
Esc3300 added a comment.
For projects using talk pages for maintenance templates and categories, this could be helpful.TASK DETAILhttps://phabricator.wikimedia.org/T123196EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Esc3300Cc: Esc3300, hoo, matej_suchanek,
thcipriani added a comment.
In T145819#2649573, @aaron wrote:
The backport should get the maintenance script call rate back to the old status quo (rare), so re-deploy is worth attempting.
Trying the redeploy now.
wmf.19 is on group0 wikis currently.
Plan is to move group1 at 21:45, and all
aaron added a comment.
Does addUsages() get called when no other writes are pending commit? If so, you can do the usual getEmptyTransactionTicket/commitAndWaitForReplication dance. If not, you'd have to pass the ticked down from above...TASK DETAILhttps://phabricator.wikimedia.org/T146079EMAIL
chelsyx added a comment.
3rd draft: F4487819: report.pdfTASK DETAILhttps://phabricator.wikimedia.org/T143762EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: chelsyxCc: Addshore, Aklapper, mpopov, Smalyshev, debt, mschwarzer, Avner, Gehel, D3r1ck01, Jonas,
hoo added subscribers: aude, daniel, Lydia_Pintscher.hoo added a comment.
Since 98bd2437ae38f395a8b47e6895793e88ca3ae6b4 we use larger transactions in EntityUsageTable (one for the whole set (up to 400(?)), not one per batch (up to 100 rows).
If this is indeed the cause for this, we presumably
gerritbot added a comment.
Change 310957 merged by jenkins-bot:
Replace WikiPage::doEdit() usage
https://gerrit.wikimedia.org/r/310957TASK DETAILhttps://phabricator.wikimedia.org/T145743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot,
daniel closed this task as "Invalid".daniel added a comment.
Closing as per Stas, the revision info is already in the dumps. Quote from the relevant mail:
So the revision info should already be in the dump. Can you confirm it is? I
don't have a dump handy, and just broke my test install >_<
I
Smalyshev added a comment.
PRODUCE_VERSION_INFO seems to be wrong one - this one adds cc:license and schema:softwareVersion. addEntityRevisionInfo adds version and dateModified unconditionally. In fact, looking at the dump right now, I see:
wdata:Q1 a schema:Dataset ;
schema:about wd:Q1 ;
daniel created this task.daniel added projects: Wikidata, MediaWiki-extensions-WikibaseRepository.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONRDF dumps should provide revision ID and timestamp for each entity page. This allows consumers to check whether an entity they imported from a dump
jcrespo changed the title from "s5-master contention caused (?) by refreshlinksprioritized job running for all wikis" to "s5-master contention caused (?) by refreshlinksprioritized/addUsagesForPage jobs running for all wikis".
TASK DETAILhttps://phabricator.wikimedia.org/T146079EMAIL
jcrespo created this task.jcrespo added projects: Wikimedia-log-errors, Wikidata, DBA, MediaWiki-JobRunner.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONThere is high number of connection errors to 10.64.16.144 (db1049, or s5-master) caused probably by high number of connections such as:
{
thalhamm claimed this task.thalhamm added a comment.
We were recently discussing a Wikipedia PageRank solution (or a combination of that ranking with other features). I could contribute these scores and get ready also to implement some integration (with some help).TASK
hashar added a comment.
T111441 is most probably a beast too large to get rid of in a short time, and I don't even know who could be diverted to work on it.
I would at least clear out the HHVM bytecode caches for to be safe. A server that failed had a 202MBytes file:
In T145819#2643463,
Strainu added subscribers: Andrei_Stroe, Strainu.Strainu added a comment.
@Andrei_Stroe has done some tremendously useful things on the Romanian Wikipedia using wikidata and LUATASK DETAILhttps://phabricator.wikimedia.org/T76229EMAIL
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T145189EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: WMDE-leszek, Aklapper, Liuxinyu970226, Ricordisamoa, Edgars2007, Ainali, gerritbot,
gerritbot added a comment.
Change 311483 had a related patch set uploaded (by Ladsgroup):
[WIP] Add InfoAction handler in repo for tracking subscriptions
https://gerrit.wikimedia.org/r/311483TASK DETAILhttps://phabricator.wikimedia.org/T145189EMAIL
Sjoerddebruin edited the task description. (Show Details)
EDIT DETAILS...4. Check the _javascript_ console and see "TypeError: undefined is not an object (evaluating 'mw.util.addPortletLink')"addPortletLink')"
This doesn't seems to happen when I'm not logged in and only when using gadgets that
aaron added a comment.
The backport should get the maintenance script call rate back to the old status quo (rare), so re-deploy is worth attempting.TASK DETAILhttps://phabricator.wikimedia.org/T145819EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: aaronCc:
Sjoerddebruin created this task.Sjoerddebruin added projects: Browser-Support-Apple-Safari, MediaWiki-extensions-WikibaseRepository.Herald added a subscriber: Aklapper.Herald added a project: Wikidata.
TASK DESCRIPTION
Open
thcipriani raised the priority of this task from "Normal" to "High".
TASK DETAILhttps://phabricator.wikimedia.org/T145819EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thciprianiCc: thcipriani, Anomie, aaron, MZMcBride, Tobi_WMDE_SW, FastLizard4, JJMC89,
thcipriani added a comment.
There seems to be a larger underlying issue (captured in T111441).
Since @aaron and @Anomie merged and back-ported https://gerrit.wikimedia.org/r/311172, is that sufficient to try wmf.19 again this Tuesday? Or should T111441 block the train until it is resolved?
It
hoo added a comment.
In T145138#2648493, @aude wrote:
looks like we will need to cherry pick https://gerrit.wikimedia.org/r/#/c/309477/ when we make a new deployment branch
Yes, please.
I'm going to start working as usual again from Thursday on. I'll pick this up then ASAP.TASK
Smalyshev added a comment.
It seems like we need an update strategy before we can deploy this
I don't think we need it before we deploy it - we'll only need to update once we deploy second iteration - but I agree we certainly do need one. The easiest way to do it though would be to enable .nt
gerritbot added a comment.
Change 311206 had a related patch set uploaded (by Smalyshev):
Add config for units on Wikidata
https://gerrit.wikimedia.org/r/311206TASK DETAILhttps://phabricator.wikimedia.org/T117032EMAIL
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T117032EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Lydia_Pintscher, TomT0m, gerritbot, Smalyshev, Aklapper, daniel, aude, mschwarzer, Avner, Lewizho99,
gerritbot added a comment.
Change 311443 merged by jenkins-bot:
Fix undefined rc_new index during ChangeNotification jobs
https://gerrit.wikimedia.org/r/311443TASK DETAILhttps://phabricator.wikimedia.org/T145624EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:
daniel added a subscriber: aaron.daniel added a comment.
If I remember correctly, @aaron recently changed WikiPage to push secondary data updates to the job queue instead of merely referring them to the post-send stage of the request. This greatly increases the risk of race conditions for tools
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T145624EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: aude, gerritbotCc: gerritbot, aude, Aklapper, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs,
gerritbot added a comment.
Change 311443 had a related patch set uploaded (by Aude):
Fix undefined rc_new index during ChangeNotification jobs
https://gerrit.wikimedia.org/r/311443TASK DETAILhttps://phabricator.wikimedia.org/T145624EMAIL
aude added a comment.
looks like we will need to cherry pick https://gerrit.wikimedia.org/r/#/c/309477/ when we make a new deployment branchTASK DETAILhttps://phabricator.wikimedia.org/T145138EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: audeCc: aude,
aude merged a task: T146016: mw.wikibase.label is now appending the language code when returning the label.
TASK DETAILhttps://phabricator.wikimedia.org/T145138EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: audeCc: aude, Lucie, IKhitron, Stashbot, greg,
aude closed this task as a duplicate of T145138: Wikibase Lua API have breaking change.
TASK DETAILhttps://phabricator.wikimedia.org/T146016EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: audeCc: aude, Aklapper, D3r1ck01, Izno, Wikidata-bugs,
daniel added a project: TLA Team.
TASK DETAILhttps://phabricator.wikimedia.org/T107595EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: brion, danielCc: Pppery, Florian, Liuxinyu970226, WMDE-leszek, Mholloway, Scott_WUaS, Niharika, MGChecker, LikeLifer, Elitre,
daniel added a project: TLA Team.
TASK DETAILhttps://phabricator.wikimedia.org/T113034EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Jakob_WMDE, WMDE-leszek, Lydia_Pintscher, Liuxinyu970226, MarcoAurelio, RobLa-WMF, gerritbot, Quiddity, Bene, hoo,
aude added a comment.
with set env MALLOC_CHECK_=3 in gdb, I get:
Wikibase\Test\StoreTest::testRebuild with data set #0 (Wikibase\SqlStore Object (...))
Cannot use a scalar value as an array
/var/www/wiki/w/includes/site/SiteList.php:89
/var/www/wiki/w/includes/libs/GenericArrayObject.php:155
daniel created this task.daniel added projects: Wikidata, Wikidata-Sprint-2016-04-26, TLA Team.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONDispatchingEntityIdParser finds the correct type of EntityId to construct by matchign a given ID serialization against regular expressions managed by
daniel added a project: TLA Team.
TASK DETAILhttps://phabricator.wikimedia.org/T76007EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: DannyH, Ricordisamoa, Aklapper, Micru, Daniel_Mietchen, Wikidata-bugs, Bene, Legoktm, JanZerebecki, wikibugs-l-list,
daniel assigned this task to WMDE-leszek.
TASK DETAILhttps://phabricator.wikimedia.org/T146030EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, danielCc: WMDE-leszek, Jakob_WMDE, Aklapper, daniel, D3r1ck01, Izno, Wikidata-bugs, aude,
daniel claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T133381EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Jakob_WMDE, WMDE-leszek, Ricordisamoa, jayvdb, aude, JeroenDeDauw, Jonas, JanZerebecki, adrianheine, thiemowmde, Aklapper,
daniel assigned this task to Ladsgroup.
TASK DETAILhttps://phabricator.wikimedia.org/T145189EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, danielCc: WMDE-leszek, Aklapper, Liuxinyu970226, Ricordisamoa, Edgars2007, Ainali, gerritbot,
daniel created subtask T146030: Add support for repo prefixes to DispatchingEntityIdParser.
TASK DETAILhttps://phabricator.wikimedia.org/T133381EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Jakob_WMDE, WMDE-leszek, Ricordisamoa, jayvdb, aude,
Addshore added a comment.
In T145412#2629460, @daniel wrote:
For the record, some concerns that came up:
Performance and scalability. We need a way to efficiently track and query page names across all Wiktionaries.
Right now it looks like this is a central DB table that contains a mapping of
Esc3300 added a comment.
Properties and whatever new types of entities we will be getting should probably be included as well.
Most items without any statements do include sitelinks: https://www.wikidata.org/wiki/Wikidata:Database_reports/without_claims_by_siteTASK
daniel added a project: TLA Team.
TASK DETAILhttps://phabricator.wikimedia.org/T145516EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jakob_WMDE, danielCc: Aklapper, Jakob_WMDE, D3r1ck01, Izno, Wikidata-bugs, aude,
daniel added a project: TLA Team.
TASK DETAILhttps://phabricator.wikimedia.org/T133381EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Jakob_WMDE, WMDE-leszek, Ricordisamoa, jayvdb, aude, JeroenDeDauw, Jonas, JanZerebecki, adrianheine, thiemowmde,
daniel added a project: TLA Team.
TASK DETAILhttps://phabricator.wikimedia.org/T144923EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, danielCc: WMDE-leszek, Aklapper, Ricordisamoa, Edgars2007, Ainali, gerritbot, Lydia_Pintscher, thiemowmde,
daniel added a project: TLA Team.
TASK DETAILhttps://phabricator.wikimedia.org/T143148EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, danielCc: Aklapper, Ricordisamoa, Edgars2007, Ainali, gerritbot, Lydia_Pintscher, thiemowmde, Jan_Dittrich,
daniel added a project: TLA Team.
TASK DETAILhttps://phabricator.wikimedia.org/T145189EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: WMDE-leszek, Aklapper, Liuxinyu970226, Ricordisamoa, Edgars2007, Ainali, gerritbot, Lydia_Pintscher, thiemowmde,
daniel added a project: TLA Team.
TASK DETAILhttps://phabricator.wikimedia.org/T145965EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: Lydia_Pintscher, Ladsgroup, Aklapper, hoo, D3r1ck01, Izno, Wikidata-bugs, aude,
aude added a comment.
seems I am able to reproduce only when running the tests on a fresh checkout of a branch (of core + wikibase)
on jenkins, it could be sometimes that a jenkins slave is using an existing checkout of mediawiki + wikibase and sometimes has to do fresh checkout.
maybe the
aude added a comment.
at the moment, i am running php 5.5.9-1ubuntu4.19 and am getting segmentation fault when I run wikibase repo tests locallyTASK DETAILhttps://phabricator.wikimedia.org/T142158EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: audeCc: aude,
Charlie_WMDE added a comment.
F4485801: final.png
file on commons can be found here:
https://commons.wikimedia.org/wiki/File:Quality_process_on_Wikidata.svgTASK DETAILhttps://phabricator.wikimedia.org/T129065EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:
Addshore added a comment.
It looks like adding the restriction of precision > 9 to the second list brings the number of matches statements down dramatically (then roughly the same for each list).
You can run this dump scan yourself using:
aude created this task.aude added projects: Wikidata, MediaWiki-extensions-WikibaseClient.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONmw.wikibase.label is now appending the language code when returning the label.
e.g. with the below module, {{#invoke:label|label}} returns "kittenen"
see
Tobi_WMDE_SW added a comment.
Cool, thx!TASK DETAILhttps://phabricator.wikimedia.org/T145384EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ArielGlenn, Tobi_WMDE_SWCc: ArielGlenn, demon, Reedy, Lydia_Pintscher, gabriel-wmde, kai.nissen, Jonas, Ladsgroup,
Esc3300 added a comment.
If you limit Gregorian before 1584 (or 1582) to precision > 9, do you get comparable numbers?
That being said, many of the years marked as Gregorian on https://tools.wmflabs.org/reasonator/?q=Q208233=en seem to be off by one year.
Unfortunatly not all. For years before
aude closed this task as "Resolved".aude claimed this task.aude removed a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T145624EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: audeCc: gerritbot, aude, Aklapper, D3r1ck01, Izno,
Addshore added a comment.
Thanks @ArielGlenn!TASK DETAILhttps://phabricator.wikimedia.org/T145384EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ArielGlenn, AddshoreCc: ArielGlenn, demon, Reedy, Lydia_Pintscher, gabriel-wmde, kai.nissen, Jonas, Ladsgroup,
ArielGlenn closed this task as "Resolved".ArielGlenn claimed this task.ArielGlenn added a comment.
This is now done. Closing.TASK DETAILhttps://phabricator.wikimedia.org/T145384EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ArielGlennCc: ArielGlenn, demon,
Addshore added a comment.
I have just re run the script I wrote rather a long time ago and here are the lists that came out
Dates marked as Julian that are more precise than year
24945 statements
P4067
Dates marked as Gregorian, before 1584
130388 statements
P4068TASK
Esc3300 added a comment.
Good news. Some stats:
Dates in Gregorian calendar < "+1582-10-15T00:00:00Z" with precision > 9 (no qualifiers). query is on property documentation
P5694899
P57018332
P58040
P582300
P585106
TASK DETAILhttps://phabricator.wikimedia.org/T105100EMAIL
gerritbot added a comment.
Change 38 merged by jenkins-bot:
Inline doc for $wgMaxShell*
https://gerrit.wikimedia.org/r/38TASK DETAILhttps://phabricator.wikimedia.org/T145819EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Anomie, aaron,
Esc3300 edited the task description. (Show Details)
EDIT DETAILS...Our plan: Create a Special Page that takes an item ID and returns a list of pages that use data from this item on this particular client. It could be something like en:Special:EntityUse/Q12345 This special page will also be used as
YMS added a comment.
Wikidata items without statements usually still are containers for sitelinks and thus actively used from various Wikimedia projects. We can not call them useless. We should not ignore them and hide them, and if it's only in the count.TASK
66 matches
Mail list logo
