[Wikidata-bugs] [Maniphest] [Commented On] T198078: Extra xsd:decimal triples for some(?) globe coordinate values
dcausse added a comment. Data has been reloaded, please reopen if you encounter the problem again. TASK DETAIL https://phabricator.wikimedia.org/T198078 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, dcausse Cc: dcausse, Mahir256, Gehel, Tagishsimon, Pasleim, Smalyshev, Lucas_Werkmeister_WMDE, Nikki, CBogen, darthmon_wmde, ET4Eva, Nandana, Namenlos314, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T198078: Extra xsd:decimal triples for some(?) globe coordinate values
Tagishsimon added a comment. Per Laske, SPARQL for this issue in Germany [https://www.wikidata.org/wiki/Wikidata:Contact_the_development_team#Surplus_of_coordinates_-_T198078] SELECT ?item ?itemLabel ?stat ?lat ?long WITH { SELECT ?item ?stat (COUNT(?lat)+COUNT(?long) AS ?count) WHERE { VALUES ?countries { wd:Q183 } ?item wdt:P17 ?countries; p:P625 ?stat. ?stat psv:P625 [wikibase:geoLatitude ?lat ; wikibase:geoLongitude ?long ] . } GROUP BY ?item ?stat HAVING(?count>2) } AS %i WHERE { include %i ?stat psv:P625 [ wikibase:geoLatitude ?lat; wikibase:geoLongitude ?long ] . SERVICE wikibase:label { bd:serviceParam wikibase:language "[AUTO_LANGUAGE],en". } } ORDER BY ?item TASK DETAIL https://phabricator.wikimedia.org/T198078 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev, Tagishsimon Cc: Tagishsimon, Pasleim, Smalyshev, Lucas_Werkmeister_WMDE, Nikki, darthmon_wmde, ET4Eva, DannyS712, Nandana, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T198078: Extra xsd:decimal triples for some(?) globe coordinate values
Tagishsimon added a comment. Ditto http://www.wikidata.org/entity/Q17567523 ... there are probably others. TASK DETAIL https://phabricator.wikimedia.org/T198078 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev, Tagishsimon Cc: Tagishsimon, Pasleim, Smalyshev, Lucas_Werkmeister_WMDE, Nikki, darthmon_wmde, ET4Eva, DannyS712, Nandana, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T198078: Extra xsd:decimal triples for some(?) globe coordinate values
Tagishsimon added a comment. @Smalyshev Please check out the single coords property at https://www.wikidata.org/wiki/Q6522893#P625 versus the two rows returned by this query, suggestive of 'hidden' triples lurking still. SELECT ?item ?itemLabel ?stat ?lat ?long WHERE { VALUES ?item {wd:Q6522893} ?item p:P625 ?stat. ?stat psv:P625 [wikibase:geoLatitude ?lat ; wikibase:geoLongitude ?long ] . SERVICE wikibase:label { bd:serviceParam wikibase:language "[AUTO_LANGUAGE],en". } } TASK DETAIL https://phabricator.wikimedia.org/T198078 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev, Tagishsimon Cc: Tagishsimon, Pasleim, Smalyshev, Lucas_Werkmeister_WMDE, Nikki, darthmon_wmde, ET4Eva, DannyS712, Nandana, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T198078: Extra xsd:decimal triples for some(?) globe coordinate values
Nikki added a comment. I'm not aware of anyone else noticing yet, so it wouldn't appear to be urgent. The main issue from my point of view (it's the reason I noticed at least) is that queries including things like wd:Q1707 p:P625/psv:P625 [ wikibase:geoLatitude ?lat ; wikibase:geoLongitude ?lon ] . unexpectedly and confusingly return more results than they should (4 rows per statement instead of 1, or 8 rows if you also select the precision) and it's not clear to me how to get the expected behaviour... distinct doesn't help because the data types are different and filtering using datatype() means some statements are missing since some items only have decimal and some only have double. It's particularly confusing when looking at the results in the query service UI because the data type isn't shown there.TASK DETAILhttps://phabricator.wikimedia.org/T198078EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: NikkiCc: Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, Nikki, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T198078: Extra xsd:decimal triples for some(?) globe coordinate values
Smalyshev added a comment. I don't remember the exact time, but it looks like the only place the wrong (and old-format) triples could have come from... Generally, with our data volume now, and 12 servers, full reload is much larger proposition than before (and yes, we'd need to think if we can make it better, I have some ideas, but that's for another task). How bad is to have those extra triples? I can probably remove/convert them without full reload, I just need to know how to prioritize this.TASK DETAILhttps://phabricator.wikimedia.org/T198078EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, Nikki, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T198078: Extra xsd:decimal triples for some(?) globe coordinate values
Lucas_Werkmeister_WMDE added a comment. A full reload would also fix this, right? I thought we had at least one reload (for unrelated reasons) since last November anyways, but I must be remembering something else if those triples are still there.TASK DETAILhttps://phabricator.wikimedia.org/T198078EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, Nikki, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T198078: Extra xsd:decimal triples for some(?) globe coordinate values
Smalyshev added a comment. A problem though would be that some values only exist in old format, with xsd:decimal only, and we probably should not delete those, at least without updating. That makes the queries a bit harder. Still possible, but will probably take a bit more time to fix.TASK DETAILhttps://phabricator.wikimedia.org/T198078EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, Nikki, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T198078: Extra xsd:decimal triples for some(?) globe coordinate values
Smalyshev added a comment. Ohh, this is to be expected, and I forgot to address this unfortunately. The problem is that the hash of the value didn't change, but the content of the node did, so the update didn't work properly, because it assumes that nodes with the same hash have the same data. We'd probably need to manually drop the bad triples (should not be hard).TASK DETAILhttps://phabricator.wikimedia.org/T198078EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, Nikki, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs