| Multichill added a comment. |
In T99899#4121954, @Smalyshev wrote:make the index assume the entries are distinct and unique, so when it encounters a second Wikidata item with the same external ID, it just overwrites it
Index can't do that unfortunately. I don't even think there's such thing as unique field in ElasticSearch - the only field that is unique is the document ID.
So if you have two items with the same external ID, the search will find them both. Now if you build some service on top of it (like special page) it can interpret the search results and resolve the collision. But I see no way to not have duplicates in the search index if they are in the data.
I would do a really simple and stupid resolving approach: Take the top result and maybe do some sorting of the results by something like popularity_score .
Might be good to avoid making yet another special page and just use the API ( https://www.mediawiki.org/wiki/Special:MyLanguage/API:Search / https://www.wikidata.org/w/api.php?action=""> ). That way you probably only need a bit of _javascript_ to glue everything together. Now the _javascript_ is just hitting https://www.wikidata.org/w/api.php?action=""> , could be changed to hit the search if someone starts with P<some integer>:something . Or you could expand wbsearchentities to do the dirty work for you, but I think you'll get a bit of code mix up.
Probably best to split this task up in two parts:
- Get the ExternalId's indexed
- Figure out a way for the user to access it
First part is probably clear now (just index all ExternalId's), second part probably needs a bit more thought.
Cc: Lydia_Pintscher, PokestarFan, Josve05a, Herzi.Pinki, hoo, Jarekt, Multichill, Acer, Liuxinyu970226, Agabi10, -jem-, thiemowmde, Magnus, Jane023, Spage, Smalyshev, Bene, Ricordisamoa, Addshore, jeremyb, Aklapper, daniel, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
