dr0ptp4kt added a comment.
The job completed. The counts match up on this productionized job compared
with the prior one run in my namespace. Following are some Hive queries in case
needed later. Below that is a really small sample of the resultant data in
tabular format for each partition.
**Counts**
select count(1) from discovery.wikibase_rdf_scholarly_split where snapshot
= '20231016' and wiki = 'wikidata' and
scope = 'scholarly_articles';
7643858365
select count(1) from discovery.wikibase_rdf_scholarly_split where snapshot
= '20231016' and wiki = 'wikidata' and
scope = 'wikidata_main';
7677112695
**Samples**
Note: because the target sample size is so small, it's actually possible to
get slightly less than the target number of records due to sparseness in a
randomly selected set. One can compensate by setting the numerator higher or
the denominator lower if one likes to reduce the possibility of such potential
artifacts (e.g., to avoid getting 27 records when one really wants 30 records;
below we get 30 records apiece, mind you). Note the horizontal scrollbars at
the bottom of the tabular data in case the tables overflow on one's browser's
settings in Phabricator (mine do).
select "| " || concat_ws(" | ", subject, predicate, object, context) from
discovery.wikibase_rdf_scholarly_split where snapshot = '20231016' and wiki =
'wikidata' and
scope = 'scholarly_articles' and rand() <= (30/7643858365) distribute by
rand() sort by rand() limit 30;
{icon graduation-cap spin}
| subject
| predicate | object
|
context |
|
----------------------------------------------------------------------------------------
| ----------------------------------------------- |
---------------------------------------------------------------------------------------
| ----------------------------------------- |
|
http://www.wikidata.org/entity/statement/Q114851466-BB650063-6818-4AF5-88FD-743A5520811C
| http://www.w3.org/ns/prov#wasDerivedFrom |
http://www.wikidata.org/reference/a84e44b8b704dd021b87b792549c1623fc1edff3
| http://www.wikidata.org/entity/Q114851466 |
|
http://www.wikidata.org/entity/statement/Q73327727-EE2DF999-D668-4D6A-860F-B5FE8B93747E
| http://wikiba.se/ontology#rank |
http://wikiba.se/ontology#NormalRank
| http://www.wikidata.org/entity/Q73327727 |
| http://www.wikidata.org/entity/Q45987415
| http://www.wikidata.org/prop/direct/P407 |
http://www.wikidata.org/entity/Q1860
| http://www.wikidata.org/entity/Q45987415 |
|
http://www.wikidata.org/entity/statement/Q44327803-9B2ED327-7B22-41B3-927D-F0D780F14C63
| http://wikiba.se/ontology#rank |
http://wikiba.se/ontology#NormalRank
| http://www.wikidata.org/entity/Q44327803 |
| http://www.wikidata.org/entity/Q40775359
| http://schema.org/description |
"\u043D\u0430\u0443\u0447\u043D\u0430\u044F
\u0441\u0442\u0430\u0442\u044C\u044F"@ru |
http://www.wikidata.org/entity/Q40775359 |
|
http://www.wikidata.org/entity/statement/Q33904556-172A1324-DF02-4555-AC23-CD26DED1A182
| http://www.wikidata.org/prop/statement/P304 | "49-52"
|
http://www.wikidata.org/entity/Q33904556 |
| http://www.wikidata.org/entity/Q21994578
| http://schema.org/description |
"wetenschappelijk artikel (gepubliceerd op 2009/10/09)"@nl
| http://www.wikidata.org/entity/Q21994578 |
|
http://www.wikidata.org/entity/statement/Q93701619-747BA9CD-B887-4755-A744-01607FD15567
| http://wikiba.se/ontology#rank |
http://wikiba.se/ontology#NormalRank
| http://www.wikidata.org/entity/Q93701619 |
|
http://www.wikidata.org/entity/statement/Q42812060-1DBF45B2-E920-4CF6-8011-A94820FF10EA
| http://wikiba.se/ontology#rank |
http://wikiba.se/ontology#NormalRank
| http://www.wikidata.org/entity/Q42812060 |
|
http://www.wikidata.org/entity/statement/Q36819529-349D4DA8-BC3D-4B01-90F4-C5D42F4E3683
| http://www.wikidata.org/prop/statement/P50 |
http://www.wikidata.org/entity/Q58034888
| http://www.wikidata.org/entity/Q36819529 |
| http://www.wikidata.org/entity/Q44858419
| http://www.wikidata.org/prop/direct/P2860 |
http://www.wikidata.org/entity/Q36317712
| http://www.wikidata.org/entity/Q44858419 |
| http://www.wikidata.org/entity/Q60362876
| http://www.wikidata.org/prop/direct/P31 |
http://www.wikidata.org/entity/Q13442814
| http://www.wikidata.org/entity/Q60362876 |
| http://www.wikidata.org/entity/Q40459695
| http://schema.org/description |
"2016\u5E74\u8AD6\u6587"@zh-hk
| http://www.wikidata.org/entity/Q40459695 |
| http://www.wikidata.org/entity/Q71273478
| http://www.wikidata.org/prop/direct/P304 | "100-112"
|
http://www.wikidata.org/entity/Q71273478 |
| http://www.wikidata.org/entity/Q76599804
| http://www.wikidata.org/prop/P304 |
http://www.wikidata.org/entity/statement/Q76599804-4D1E857D-9A6D-4A20-8A83-21171E49D445
| http://www.wikidata.org/entity/Q76599804 |
|
http://www.wikidata.org/entity/statement/Q83330874-68AEEE6D-2713-4C17-9302-FD9B8D321C6D
| http://www.w3.org/1999/02/22-rdf-syntax-ns#type |
http://wikiba.se/ontology#BestRank
| http://www.wikidata.org/entity/Q83330874 |
|
http://www.wikidata.org/entity/statement/Q69606657-7DB05490-352E-484E-AA83-14736FB97FDF
| http://www.w3.org/ns/prov#wasDerivedFrom |
http://www.wikidata.org/reference/7ed4e1f8a263e1b76f533d7a87b490857b67e03f
| http://www.wikidata.org/entity/Q69606657 |
|
http://www.wikidata.org/entity/statement/Q90202645-4FF5BDC1-BA1F-4B42-93E1-E954F0268F4C
| http://www.w3.org/1999/02/22-rdf-syntax-ns#type |
http://wikiba.se/ontology#BestRank
| http://www.wikidata.org/entity/Q90202645 |
|
http://www.wikidata.org/entity/statement/Q40660107-7BF920C3-C7C1-41C3-94DE-2504A23A8858
| http://www.w3.org/1999/02/22-rdf-syntax-ns#type |
http://wikiba.se/ontology#BestRank
| http://www.wikidata.org/entity/Q40660107 |
| http://www.wikidata.org/entity/Q34775130
| http://schema.org/description | "articol
\u0219tiin\u021Bific"@ro
| http://www.wikidata.org/entity/Q34775130 |
| http://www.wikidata.org/reference/3266ceb219f19908f6f1b964a51312a25a9604c3
| http://www.wikidata.org/prop/reference/P698 | "1837481"
| http://wikiba.se/ontology#Reference |
|
http://www.wikidata.org/entity/statement/Q47377036-3B9BB36D-E9E5-4639-B080-CAD2AD17C760
| http://www.w3.org/ns/prov#wasDerivedFrom |
http://www.wikidata.org/reference/4713db7a27cd249fe1ebe4fc2883bd2d2304829a
| http://www.wikidata.org/entity/Q47377036 |
|
http://www.wikidata.org/entity/statement/Q94568867-53F34F65-200F-43FB-B96A-D3D4C09259F8
| http://wikiba.se/ontology#rank |
http://wikiba.se/ontology#NormalRank
| http://www.wikidata.org/entity/Q94568867 |
|
http://www.wikidata.org/entity/statement/Q56877680-F96C1513-9A28-44AF-AF11-377FCF292FE0
| http://www.wikidata.org/prop/qualifier/P1545 | "1"
|
http://www.wikidata.org/entity/Q56877680 |
| http://www.wikidata.org/entity/Q47320305
| http://www.wikidata.org/prop/direct/P2860 |
http://www.wikidata.org/entity/Q51932141
| http://www.wikidata.org/entity/Q47320305 |
|
http://www.wikidata.org/entity/statement/Q37867076-CFE94A3E-78EE-4F5B-8974-E6B17EC7C388
| http://wikiba.se/ontology#rank |
http://wikiba.se/ontology#NormalRank
| http://www.wikidata.org/entity/Q37867076 |
|
http://www.wikidata.org/entity/statement/Q59070330-9049FADB-B493-4076-877C-92C481788810
| http://www.wikidata.org/prop/qualifier/P1545 | "3"
|
http://www.wikidata.org/entity/Q59070330 |
|
http://www.wikidata.org/entity/statement/Q36790547-0FE3E519-6324-42CD-B8B6-F0EE9D67F035
| http://www.w3.org/1999/02/22-rdf-syntax-ns#type |
http://wikiba.se/ontology#BestRank
| http://www.wikidata.org/entity/Q36790547 |
|
http://www.wikidata.org/entity/statement/Q51084018-02E2B751-4299-4BCC-B0C7-D989395A3277
| http://wikiba.se/ontology#rank |
http://wikiba.se/ontology#NormalRank
| http://www.wikidata.org/entity/Q51084018 |
| http://www.wikidata.org/entity/Q107339531
| http://schema.org/description | "scholarly
article"@en |
http://www.wikidata.org/entity/Q107339531 |
|
select "| " || concat_ws(" | ", subject, predicate, object, context) from
discovery.wikibase_rdf_scholarly_split where snapshot = '20231016' and wiki =
'wikidata' and
scope = 'wikidata_main' and rand() <= (30/7677112695) distribute by rand()
sort by rand() limit 30;
{icon barcode spin}
| subject
| predicate
| object
|
context |
|
----------------------------------------------------------------------------------------------------------------------------------
| ------------------------------------------------- |
----------------------------------------------------------------------------------------------------------------------------
| ----------------------------------------- |
| http://www.wikidata.org/entity/Q49807406
|
http://www.wikidata.org/prop/P625 |
http://www.wikidata.org/entity/statement/Q49807406-66AF95D0-4518-42E9-9937-DCCE6556429E
|
http://www.wikidata.org/entity/Q49807406 |
|
http://www.wikidata.org/entity/statement/Q85378574-2947160E-F8C8-4313-8950-BC28CE1BED41
|
http://www.wikidata.org/prop/statement/P1215 |
"+9.701"^^http://www.w3.org/2001/XMLSchema#decimal
|
http://www.wikidata.org/entity/Q85378574 |
| http://www.wikidata.org/entity/Q108292558
|
http://www.w3.org/2000/01/rdf-schema#label | "Pseudocercospora
hemidesmi"@ext
| http://www.wikidata.org/entity/Q108292558 |
|
http://www.wikidata.org/entity/statement/Q50725055-D207E8C9-0BF9-42A1-A4F2-E5C5974DBA6F
|
http://www.w3.org/1999/02/22-rdf-syntax-ns#type |
http://wikiba.se/ontology#BestRank
|
http://www.wikidata.org/entity/Q50725055 |
| http://www.wikidata.org/entity/Q110491797
|
http://www.wikidata.org/prop/direct/P7715 | "wfo-0000539087"
| http://www.wikidata.org/entity/Q110491797 |
| http://www.wikidata.org/entity/Q32331573
|
http://schema.org/description | "kategori
Wikim\u00E9dia"@su
| http://www.wikidata.org/entity/Q32331573 |
| http://www.wikidata.org/entity/Q105545263
|
http://wikiba.se/ontology#sitelinks |
"0"^^http://www.w3.org/2001/XMLSchema#integer
|
http://www.wikidata.org/entity/Q105545263 |
|
http://www.wikidata.org/entity/statement/Q115169651-DDA3021D-BB03-4C7D-AD4F-B54D1FD469B0
|
http://www.w3.org/ns/prov#wasDerivedFrom |
http://www.wikidata.org/reference/cfbc5fe327f2c100c50be6ad2106edaf471ea3fa
|
http://www.wikidata.org/entity/Q115169651 |
| http://www.wikidata.org/entity/Q5627219
|
http://www.wikidata.org/prop/P625 |
http://www.wikidata.org/entity/statement/Q5627219-80E983C1-D244-415A-85C9-0479297CAB67
|
http://www.wikidata.org/entity/Q5627219 |
| http://www.wikidata.org/entity/Q24710751
|
http://schema.org/description | "Wikinews-artikel"@sv
| http://www.wikidata.org/entity/Q24710751 |
|
https://zh.wikisource.org/wiki/%E7%A4%BE%E4%BC%9A%E6%8A%9A%E5%85%BB%E8%B4%B9%E5%BE%81%E6%94%B6%E7%AE%A1%E7%90%86%E5%8A%9E%E6%B3%95
| http://schema.org/about |
http://www.wikidata.org/entity/Q63874217
|
http://www.wikidata.org/entity/Q63874217 |
| http://www.wikidata.org/entity/Q32939004
|
http://schema.org/description |
"\u062A\u0635\u0646\u064A\u0641 \u0628\u062A\u0627\u0639
\u0648\u064A\u0643\u064A\u0645\u064A\u062F\u064A\u0627"@arz |
http://www.wikidata.org/entity/Q32939004 |
|
http://www.wikidata.org/entity/statement/Q23181334-0C2D5667-CBCA-4DBF-879A-F6B15404D680
|
http://www.wikidata.org/prop/qualifier/P1057 |
http://www.wikidata.org/entity/Q50391046
|
http://www.wikidata.org/entity/Q23181334 |
|
http://www.wikidata.org/entity/statement/Q18301925-6FA6F7B4-33C2-4F0F-9B4B-742D5FB30370
|
http://www.w3.org/1999/02/22-rdf-syntax-ns#type |
http://wikiba.se/ontology#BestRank
|
http://www.wikidata.org/entity/Q18301925 |
|
http://www.wikidata.org/entity/statement/Q112070716-F836DC17-73CD-42F4-BC08-B46509EEABA7
|
http://www.wikidata.org/prop/statement/P131 |
http://www.wikidata.org/entity/Q785208
|
http://www.wikidata.org/entity/Q112070716 |
| http://www.wikidata.org/entity/Q65729373
|
http://schema.org/description | "kategori
Wikim\u00E9dia"@su
| http://www.wikidata.org/entity/Q65729373 |
| https://zh-yue.wikipedia.org/wiki/%E6%91%A9%E5%BE%B7%E7%B4%8D
| http://schema.org/name
| "\u6469\u5FB7\u7D0D"@yue
|
http://www.wikidata.org/entity/Q279 |
| http://www.wikidata.org/entity/Q65926032
|
http://schema.org/description | "\u0442\u0435\u043A,
\u0430\u0442\u0430-\u0442\u0435\u043A, \u04D9\u0443\u043B\u0435\u0442
\u0435\u0441\u0456\u043C"@kk-cyrl | http://www.wikidata.org/entity/Q65926032 |
|
http://www.wikidata.org/entity/statement/q3066762-57632F77-2ABD-400D-B1E3-276C4A931738
|
http://www.w3.org/1999/02/22-rdf-syntax-ns#type |
http://wikiba.se/ontology#BestRank
|
http://www.wikidata.org/entity/Q3066762 |
| http://www.wikidata.org/entity/Q83560496
|
http://schema.org/dateModified |
"2023-04-03T23:30:11Z"^^http://www.w3.org/2001/XMLSchema#dateTime
|
http://www.wikidata.org/entity/Q83560496 |
|
http://www.wikidata.org/entity/statement/Q337782-58ED5EAD-4B59-4480-943A-8CF9C54FF842
|
http://www.wikidata.org/prop/statement/P625 | "Point(17.47638889
48.27083333)"^^http://www.opengis.net/ont/geosparql#wktLiteral
|
http://www.wikidata.org/entity/Q337782 |
| http://www.wikidata.org/reference/14f0d027b29850b0e4d6342d63314a8fab09ef14
|
http://www.wikidata.org/prop/reference/value/P813 |
http://www.wikidata.org/value/3cd7e8cd5e5b054a043e175e93e8c62c
|
http://wikiba.se/ontology#Reference |
| http://www.wikidata.org/entity/Q21058424
|
http://schema.org/description | "Wikimedia-categorie"@li
| http://www.wikidata.org/entity/Q21058424 |
| http://www.wikidata.org/entity/Q22416145
|
http://wikiba.se/ontology#sitelinks |
"1"^^http://www.w3.org/2001/XMLSchema#integer
|
http://www.wikidata.org/entity/Q22416145 |
| http://www.wikidata.org/entity/Q5736159
|
http://www.wikidata.org/prop/direct/P17 |
http://www.wikidata.org/entity/Q794
|
http://www.wikidata.org/entity/Q5736159 |
| http://www.wikidata.org/entity/Q88698249
|
http://schema.org/description | "kategori Wikimedia"@jv
| http://www.wikidata.org/entity/Q88698249 |
| http://www.wikidata.org/value/48435e14b063af39dcd5b3fa1a93b809
|
http://wikiba.se/ontology#quantityAmount |
"+0.8465448252131576106747699141154275660042082174200357"^^http://www.w3.org/2001/XMLSchema#decimal
| http://wikiba.se/ontology#Value |
| http://www.wikidata.org/entity/Q65105814
|
http://www.w3.org/2004/02/skos/core#altLabel | "Guttin"@zh-my
| http://www.wikidata.org/entity/Q65105814 |
| http://www.wikidata.org/entity/Q66478013
|
http://www.wikidata.org/prop/direct/P625 | "Point(-2.1130284786468
55.742360250329)"^^http://www.opengis.net/ont/geosparql#wktLiteral
|
http://www.wikidata.org/entity/Q66478013 |
| http://www.wikidata.org/entity/Q55812113
|
http://www.w3.org/2004/02/skos/core#altLabel | "20.22"@nb
| http://www.wikidata.org/entity/Q55812113 |
TASK DETAIL
https://phabricator.wikimedia.org/T347989
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dr0ptp4kt
Cc: EBernhardson, bking, dr0ptp4kt, dcausse, Aklapper, Danny_Benjafield_WMDE,
Isabelladantes1983, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531,
Astuthiodit_1, AWesterinen, 786, Biggs657, karapayneWMDE, Invadibot,
maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz,
Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420,
Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE,
GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan,
_jensen, rosalieper, Neuronton, Scott_WUaS, Jonas, Xmlizer, jkroll,
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
_______________________________________________
Wikidata-bugs mailing list -- [email protected]
To unsubscribe send an email to [email protected]
