[Wikidata-bugs] [Maniphest] [Commented On] T230856: RDF dump performance for SDC

2019-11-27 Thread ArielGlenn 
ArielGlenn added a comment.


  In T230856#5692766 , 
@Cparle wrote:
  
  > I'm not sure if T222497  covers 
this stuff and, if not, what is actionable here by the structured data team. 
@ArielGlenn any thoughts?
  
  Yes it does. In the meantime there are about 15k entries on beta commons with 
MediaInfo content now (captions and depicts), which can be used for short tests.

TASK DETAIL
  https://phabricator.wikimedia.org/T230856

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Cparle, ArielGlenn
Cc: Gehel, Multichill, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Tpt, Addshore, 
Ramsey-WMF, Lydia_Pintscher, Aklapper, WMDE-leszek, ArielGlenn, hoo, Smalyshev, 
darthmon_wmde, DannyS712, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, 
E1presidente, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, Lunewa, 
QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, Salgo60, Silverfish, 
Poyekhali, _jensen, rosalieper, Taiwania_Justo, Scott_WUaS, Jonas, Xmlizer, 
Susannaanas, Ixocactus, Wong128hk, gnosygnu, Jane023, jkroll, Wikidata-bugs, 
Jdouglas, Base, matthiasmullie, aude, Tobias1984, El_Grafo, Dinoguy1000, 
Manybubbles, Ricordisamoa, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, 
Mbch331, Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T230856: RDF dump performance for SDC

2019-11-26 Thread Cparle 
Cparle added a comment.


  I'm not sure if T222497  covers 
this stuff and, if not, what is actionable here by the structured data team. 
@ArielGlenn any thoughts?

TASK DETAIL
  https://phabricator.wikimedia.org/T230856

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Cparle
Cc: Gehel, Multichill, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Tpt, Addshore, 
Ramsey-WMF, Lydia_Pintscher, Aklapper, WMDE-leszek, ArielGlenn, hoo, Smalyshev, 
darthmon_wmde, DannyS712, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, 
E1presidente, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, Lunewa, 
QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, Salgo60, Silverfish, 
Poyekhali, _jensen, rosalieper, Taiwania_Justo, Scott_WUaS, Jonas, Xmlizer, 
Susannaanas, Ixocactus, Wong128hk, gnosygnu, Jane023, jkroll, Wikidata-bugs, 
Jdouglas, Base, matthiasmullie, aude, Tobias1984, El_Grafo, Dinoguy1000, 
Manybubbles, Ricordisamoa, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, 
Mbch331, Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T230856: RDF dump performance for SDC

2019-11-04 Thread ArielGlenn 
ArielGlenn added a comment.


  Bulk adds of depicts statements on deployment-prep will start this evening, 
now that the code is ready. It will run over a couple of days at least. Once 
complete we'll have 3k images on beta commons with captions and depicts 
statements in them, referencing 1k items on beta wikidata. I'd like to get us 
up to 50k total over the next few weeks.

TASK DETAIL
  https://phabricator.wikimedia.org/T230856

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Cparle, ArielGlenn
Cc: Gehel, Multichill, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Tpt, Addshore, 
Ramsey-WMF, Lydia_Pintscher, Aklapper, WMDE-leszek, ArielGlenn, hoo, Smalyshev, 
darthmon_wmde, DannyS712, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, 
E1presidente, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, Lunewa, 
QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, Salgo60, Silverfish, 
Poyekhali, _jensen, rosalieper, Taiwania_Justo, Jonas, Xmlizer, Susannaanas, 
Ixocactus, Wong128hk, gnosygnu, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, 
matthiasmullie, aude, Tobias1984, El_Grafo, Dinoguy1000, Manybubbles, 
Ricordisamoa, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T230856: RDF dump performance for SDC

2019-11-01 Thread ArielGlenn 
ArielGlenn added a comment.


  Adding items to wikidata in deployment-prep for use in depicts statements for 
the uploaded images in beta commons. Depicts statements early next week most 
likely.

TASK DETAIL
  https://phabricator.wikimedia.org/T230856

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Cparle, ArielGlenn
Cc: Gehel, Multichill, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Tpt, Addshore, 
Ramsey-WMF, Lydia_Pintscher, Aklapper, WMDE-leszek, ArielGlenn, hoo, Smalyshev, 
darthmon_wmde, DannyS712, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, 
E1presidente, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, Lunewa, 
QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, Salgo60, Silverfish, 
Poyekhali, _jensen, rosalieper, Taiwania_Justo, Jonas, Xmlizer, Susannaanas, 
Ixocactus, Wong128hk, gnosygnu, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, 
matthiasmullie, aude, Tobias1984, El_Grafo, Dinoguy1000, Manybubbles, 
Ricordisamoa, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T230856: RDF dump performance for SDC

2019-10-29 Thread ArielGlenn 
ArielGlenn added a comment.


  I've started generating, uploading and captioning images in beta commons 
today, using the latest version of the script linked above. I'd like to add 
some depicts statements too. In any case, by the end of the week expect that 
we'll have several batches of these little icons with diferent borders and 
background colors, all captioned for folks' testing needs.

TASK DETAIL
  https://phabricator.wikimedia.org/T230856

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Cparle, ArielGlenn
Cc: Gehel, Multichill, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Tpt, Addshore, 
Ramsey-WMF, Lydia_Pintscher, Aklapper, WMDE-leszek, ArielGlenn, hoo, Smalyshev, 
darthmon_wmde, DannyS712, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, 
E1presidente, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, Lunewa, 
QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, Salgo60, Silverfish, 
Poyekhali, _jensen, rosalieper, Taiwania_Justo, Jonas, Xmlizer, Susannaanas, 
Ixocactus, Wong128hk, gnosygnu, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, 
matthiasmullie, aude, Tobias1984, El_Grafo, Dinoguy1000, Manybubbles, 
Ricordisamoa, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T230856: RDF dump performance for SDC

2019-09-12 Thread Gehel 
Gehel added a comment.


  Note that T222497  needs to be 
resolved before we can actually have a working dump.

TASK DETAIL
  https://phabricator.wikimedia.org/T230856

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Multichill, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Tpt, Addshore, 
Ramsey-WMF, Lydia_Pintscher, Aklapper, WMDE-leszek, ArielGlenn, hoo, Smalyshev, 
darthmon_wmde, DannyS712, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, 
E1presidente, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, Lunewa, 
QZanden, EBjune, Tramullas, Acer, merbst, LawExplorer, Salgo60, Silverfish, 
Poyekhali, _jensen, rosalieper, Morgankevinj, Taiwania_Justo, Jonas, Xmlizer, 
Susannaanas, Ixocactus, Wong128hk, gnosygnu, Jane023, jkroll, Wikidata-bugs, 
Jdouglas, Base, matthiasmullie, aude, Tobias1984, El_Grafo, Dinoguy1000, 
Manybubbles, Ricordisamoa, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, 
Mbch331, Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T230856: RDF dump performance for SDC

2019-08-23 Thread ArielGlenn 
ArielGlenn added a comment.


  https://github.com/apergos/misc-wmf-crap/tree/master/glyph-image-generator 
Starting to get clever about this: ability to generate 50k small images with 
metadata that can be extracted for using in depicts and/or caption statements.

TASK DETAIL
  https://phabricator.wikimedia.org/T230856

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn
Cc: Lucas_Werkmeister_WMDE, Tpt, Addshore, Ramsey-WMF, Lydia_Pintscher, 
Aklapper, WMDE-leszek, ArielGlenn, hoo, Smalyshev, darthmon_wmde, DannyS712, 
Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, 
SandraF_WMF, GoranSMilovanovic, Lunewa, QZanden, EBjune, Tramullas, Acer, 
merbst, LawExplorer, Salgo60, Silverfish, Poyekhali, _jensen, rosalieper, 
Morgankevinj, Taiwania_Justo, Jonas, Xmlizer, Susannaanas, Ixocactus, 
Wong128hk, gnosygnu, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, 
matthiasmullie, aude, Tobias1984, El_Grafo, Dinoguy1000, Manybubbles, 
Ricordisamoa, Wesalius, Fabrice_Florin, Raymond, Jdforrester-WMF, 
Steinsplitter, Mbch331, Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T230856: RDF dump performance for SDC

2019-08-21 Thread ArielGlenn 
ArielGlenn added a comment.


  I'm looking at deployment-db05 now, and there are 63332 rows in the revision 
table, with 53250 rows in the content table. I guess we need to double the 
number of revisions and then add the structured data for those entries. we can 
probably be clever about this via a script.

TASK DETAIL
  https://phabricator.wikimedia.org/T230856

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn
Cc: Lucas_Werkmeister_WMDE, Tpt, Addshore, Ramsey-WMF, Lydia_Pintscher, 
Aklapper, WMDE-leszek, ArielGlenn, hoo, Smalyshev, darthmon_wmde, DannyS712, 
Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, 
SandraF_WMF, GoranSMilovanovic, Lunewa, QZanden, EBjune, Tramullas, Acer, 
merbst, LawExplorer, Salgo60, Silverfish, Poyekhali, _jensen, rosalieper, 
Morgankevinj, Taiwania_Justo, Jonas, Xmlizer, Susannaanas, Ixocactus, 
Wong128hk, gnosygnu, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, 
matthiasmullie, aude, Tobias1984, El_Grafo, Dinoguy1000, Manybubbles, 
Ricordisamoa, Wesalius, Fabrice_Florin, Raymond, Jdforrester-WMF, 
Steinsplitter, Mbch331, Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T230856: RDF dump performance for SDC

2019-08-20 Thread Smalyshev 
Smalyshev added a comment.


  Probably not a lot. Search for English labels returns 

 188 results, unfortunately search for statements and every label doesn't seem 
to work (probably needs a reindex?) so I don't know how many but probably also 
not a lot. I'll check tomorrow if I can get more specific figures.

TASK DETAIL
  https://phabricator.wikimedia.org/T230856

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Smalyshev
Cc: Lucas_Werkmeister_WMDE, Tpt, Addshore, Ramsey-WMF, Lydia_Pintscher, 
Aklapper, WMDE-leszek, ArielGlenn, hoo, Smalyshev, darthmon_wmde, DannyS712, 
Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, 
SandraF_WMF, GoranSMilovanovic, Lunewa, QZanden, EBjune, Tramullas, Acer, 
merbst, LawExplorer, Salgo60, Silverfish, Poyekhali, _jensen, rosalieper, 
Morgankevinj, Taiwania_Justo, Jonas, Xmlizer, Susannaanas, Ixocactus, 
Wong128hk, gnosygnu, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, 
matthiasmullie, aude, Tobias1984, El_Grafo, Dinoguy1000, Manybubbles, 
Ricordisamoa, Wesalius, Fabrice_Florin, Raymond, Jdforrester-WMF, 
Steinsplitter, Mbch331, Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T230856: RDF dump performance for SDC

2019-08-20 Thread ArielGlenn 
ArielGlenn added a comment.


  @Smalyshev Do you know how many entries have structured data on 
deployment-prep? Is that a useful testing ground right now or should we be 
populating the data over there first?

TASK DETAIL
  https://phabricator.wikimedia.org/T230856

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn
Cc: Lucas_Werkmeister_WMDE, Tpt, Addshore, Ramsey-WMF, Lydia_Pintscher, 
Aklapper, WMDE-leszek, ArielGlenn, hoo, Smalyshev, darthmon_wmde, DannyS712, 
Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, 
SandraF_WMF, GoranSMilovanovic, Lunewa, QZanden, EBjune, Tramullas, Acer, 
merbst, LawExplorer, Salgo60, Silverfish, Poyekhali, _jensen, rosalieper, 
Morgankevinj, Taiwania_Justo, Jonas, Xmlizer, Susannaanas, Ixocactus, 
Wong128hk, gnosygnu, Jane023, jkroll, Wikidata-bugs, Jdouglas, Base, 
matthiasmullie, aude, Tobias1984, El_Grafo, Dinoguy1000, Manybubbles, 
Ricordisamoa, Wesalius, Fabrice_Florin, Raymond, Jdforrester-WMF, 
Steinsplitter, Mbch331, Keegan
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs