Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-27 Thread Stryn
Oh, what a handy tool!
That's what I've been looking for.
Only bad is that it doesn't support redirects.
Now I'm waiting for getting the arbitrary access enabled on the Finnish
Wikipedia so I can try cool things :)

*Stryn*

*Suomenkielisen Wikipedian ylläpitäjä & osoitepaljastaja / Admin and
checkuser on the Finnish Wikipedia*

*Wikidatan ylläpitäjä / Admin on Wikidata*

*Meta-Wikin ylläpitäjä / Admin on Meta-Wiki*
*Ylivalvoja / Steward*

2015-07-23 10:29 GMT+03:00 Gerard Meijssen :

> Hoi,
> When the list is a list of articles in a Wikipedia, try "Linked items" one
> magnificent tool by Magnus that can be used for this..
> Thanks,
>  GerardM
>
>
>
>
> https://tools.wmflabs.org/wikidata-todo/linked_items.php
>
> On 23 July 2015 at 08:44, Sandra Fauconnier 
> wrote:
>
>> Hi everyone,
>>
>> I’ve been in the situation quite often (edit-a-thons; various to do
>> lists) where I had a list of terms (most usually names of a few hundreds of
>> people, or titles of Wikipedia articles), where I wanted to do a quick
>> search on Wikidata to retrieve each of these concept’s Q number.
>> Does anyone know of a tool that helps me make this easier? Enter a list
>> of, say, 100 of these search terms, and receive Q number suggestions for
>> each of them? I’ve looked around on wmflabs but have not found anything in
>> that direction (also not with the help of Hay’s awesome tool directory
>> ).
>>
>> Till now, I’ve done all these searches manually - use an excel sheet,
>> look for each term individually, enter Q number for each term - quite
>> accurate but very time-consuming!
>>
>> Would appreciate all help/tips !
>> Thanks! Sandra (User:Spinster)
>>
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
>>
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-24 Thread Magnus Manske
Now returning types (Wikidata properties 31 and 279) as Q values. I assume
you'd prefer those over their labels?

On Fri, Jul 24, 2015 at 2:10 PM Magnus Manske 
wrote:

> Ed, now generating an empty type array, so that your query should work;
> will fill soon-ish ;-)
>
> On Fri, Jul 24, 2015 at 1:31 PM Ed Summers  wrote:
>
>>
>> > On Jul 24, 2015, at 5:37 AM, Magnus Manske 
>> wrote:
>> >
>> > Early version:
>> > https://tools.wmflabs.org/wikidata-reconcile/
>>
>> Wow, that was crazy fast Magnus :) I gave it a try in the latest
>> OpenRefine on a very simple spreadsheet:
>>
>> city
>> Paris
>> New York City
>>
>> OpenRefine threw an exception (see below). I think OpenRefine is
>> expecting the type key in each result. From the documentation [1] it looks
>> like the value for the type key should be a array of types? I don’t know if
>> it’s easy to get at that in your app. Speaking of which is the code
>> available somewhere?
>>
>> Awesome work!
>>
>> //Ed
>>
>> [1]
>> https://github.com/OpenRefine/OpenRefine/wiki/Reconciliation-Service-API#query-response
>>
>> //Ed
>>
>> org.json.JSONException: JSONObject["type"] not found.
>> at org.json.JSONObject.get(JSONObject.java:406)
>> at org.json.JSONObject.getJSONArray(JSONObject.java:482)
>> at
>> com.google.refine.commands.recon.GuessTypesOfColumnCommand.guessTypes(GuessTypesOfColumnCommand.java:216)
>> at
>> com.google.refine.commands.recon.GuessTypesOfColumnCommand.doPost(GuessTypesOfColumnCommand.java:89)
>> at com.google.refine.RefineServlet.service(RefineServlet.java:177)
>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>> at
>> org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
>> at
>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1166)
>> at
>> org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:81)
>> at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:132)
>> at
>> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
>> at
>> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:388)
>> at
>> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>> at
>> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>> at
>> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
>> at
>> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418)
>> at
>> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>> at org.mortbay.jetty.Server.handle(Server.java:326)
>> at
>> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>> at
>> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:923)
>> at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:547)
>> at
>> org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>> at
>> org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>> at
>> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:745)
>>
>>
>>
>>
>>
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-24 Thread Magnus Manske
Ed, now generating an empty type array, so that your query should work;
will fill soon-ish ;-)

On Fri, Jul 24, 2015 at 1:31 PM Ed Summers  wrote:

>
> > On Jul 24, 2015, at 5:37 AM, Magnus Manske 
> wrote:
> >
> > Early version:
> > https://tools.wmflabs.org/wikidata-reconcile/
>
> Wow, that was crazy fast Magnus :) I gave it a try in the latest
> OpenRefine on a very simple spreadsheet:
>
> city
> Paris
> New York City
>
> OpenRefine threw an exception (see below). I think OpenRefine is expecting
> the type key in each result. From the documentation [1] it looks like the
> value for the type key should be a array of types? I don’t know if it’s
> easy to get at that in your app. Speaking of which is the code available
> somewhere?
>
> Awesome work!
>
> //Ed
>
> [1]
> https://github.com/OpenRefine/OpenRefine/wiki/Reconciliation-Service-API#query-response
>
> //Ed
>
> org.json.JSONException: JSONObject["type"] not found.
> at org.json.JSONObject.get(JSONObject.java:406)
> at org.json.JSONObject.getJSONArray(JSONObject.java:482)
> at
> com.google.refine.commands.recon.GuessTypesOfColumnCommand.guessTypes(GuessTypesOfColumnCommand.java:216)
> at
> com.google.refine.commands.recon.GuessTypesOfColumnCommand.doPost(GuessTypesOfColumnCommand.java:89)
> at com.google.refine.RefineServlet.service(RefineServlet.java:177)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> at
> org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
> at
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1166)
> at
> org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:81)
> at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:132)
> at
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
> at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:388)
> at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
> at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
> at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
> at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418)
> at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> at org.mortbay.jetty.Server.handle(Server.java:326)
> at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
> at
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:923)
> at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:547)
> at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
> at
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
>
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-24 Thread Ed Summers

> On Jul 24, 2015, at 5:37 AM, Magnus Manske  
> wrote:
> 
> Early version:
> https://tools.wmflabs.org/wikidata-reconcile/

Wow, that was crazy fast Magnus :) I gave it a try in the latest OpenRefine on 
a very simple spreadsheet:

city
Paris
New York City

OpenRefine threw an exception (see below). I think OpenRefine is expecting the 
type key in each result. From the documentation [1] it looks like the value for 
the type key should be a array of types? I don’t know if it’s easy to get at 
that in your app. Speaking of which is the code available somewhere?

Awesome work!

//Ed

[1] 
https://github.com/OpenRefine/OpenRefine/wiki/Reconciliation-Service-API#query-response

//Ed

org.json.JSONException: JSONObject["type"] not found.
at org.json.JSONObject.get(JSONObject.java:406)
at org.json.JSONObject.getJSONArray(JSONObject.java:482)
at 
com.google.refine.commands.recon.GuessTypesOfColumnCommand.guessTypes(GuessTypesOfColumnCommand.java:216)
at 
com.google.refine.commands.recon.GuessTypesOfColumnCommand.doPost(GuessTypesOfColumnCommand.java:89)
at com.google.refine.RefineServlet.service(RefineServlet.java:177)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at 
org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at 
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1166)
at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:81)
at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:132)
at 
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
at 
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:388)
at 
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at 
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at 
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418)
at 
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at 
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at 
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:923)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:547)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at 
org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)







signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-24 Thread Federico Leva (Nemo)

Ed Summers, 23/07/2015 22:20:

I suspect this is a bit too nerdy, but I was reconciling some messy CSV data to 
Wikidata recently and ended up writing a little Python library and command line 
tool that uses wbgetentities API call.

 https://github.com/edsu/wikidata_suggest


Interesting, I think I'll integrate it in 
https://gerrit.wikimedia.org/r/#/c/166629/


Nemo

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-24 Thread Info WorldUniversity
Great, Magnus,

And so wiki-quick!

Cheers,
Scott
On Jul 24, 2015 2:38 AM, "Magnus Manske" 
wrote:

> Early version:
> https://tools.wmflabs.org/wikidata-reconcile/
>
> On Fri, Jul 24, 2015 at 9:26 AM Magnus Manske 
> wrote:
>
>> On it...
>>
>> On Fri, Jul 24, 2015 at 1:41 AM Thad Guidry  wrote:
>>
>>> Yeah it would be awesome if Wikidata could hack together a OpenRefine
>>> compatible "reconcilation service" !
>>>
>>> Librarians use OpenRefine by the way ! (wink wink) ;)  More data, more
>>> data, more data
>>>
>>>
>>>
>>> Thad
>>> +ThadGuidry 
>>>
>>> On Thu, Jul 23, 2015 at 6:43 PM, Tom Morris  wrote:
>>>
 I'm biased, but I think this is a perfect use case for OpenRefine.
 What you'd need is an OpenRefine compatible "reconcilation service"
 provided by Wikidata that OpenRefine could use and then it'd allow you to
 match an entire column in spreadsheet, set a threshold for automatic
 matches, review candidates for those below the threshold, etc.

 https://github.com/OpenRefine/OpenRefine/wiki/Reconcilable-Data-Sources

 https://api.opencorporates.com/documentation/Google-Refine-Reconciliation-API
 http://refine.codefork.com/
 https://wiki.duraspace.org/display/VIVO/Extending+Google+Refine+for+VIVO

 Tom

 On Thu, Jul 23, 2015 at 2:44 AM, Sandra Fauconnier <
 sandra.fauconn...@gmail.com> wrote:

> Hi everyone,
>
> I’ve been in the situation quite often (edit-a-thons; various to do
> lists) where I had a list of terms (most usually names of a few hundreds 
> of
> people, or titles of Wikipedia articles), where I wanted to do a quick
> search on Wikidata to retrieve each of these concept’s Q number.
> Does anyone know of a tool that helps me make this easier? Enter a
> list of, say, 100 of these search terms, and receive Q number suggestions
> for each of them? I’ve looked around on wmflabs but have not found 
> anything
> in that direction (also not with the help of Hay’s awesome tool
> directory ).
>
> Till now, I’ve done all these searches manually - use an excel sheet,
> look for each term individually, enter Q number for each term - quite
> accurate but very time-consuming!
>
> Would appreciate all help/tips !
> Thanks! Sandra (User:Spinster)
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>

 ___
 Wikidata mailing list
 Wikidata@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/wikidata


>>> ___
>>> Wikidata mailing list
>>> Wikidata@lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>>
>>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-24 Thread Magnus Manske
Early version:
https://tools.wmflabs.org/wikidata-reconcile/

On Fri, Jul 24, 2015 at 9:26 AM Magnus Manske 
wrote:

> On it...
>
> On Fri, Jul 24, 2015 at 1:41 AM Thad Guidry  wrote:
>
>> Yeah it would be awesome if Wikidata could hack together a OpenRefine
>> compatible "reconcilation service" !
>>
>> Librarians use OpenRefine by the way ! (wink wink) ;)  More data, more
>> data, more data
>>
>>
>>
>> Thad
>> +ThadGuidry 
>>
>> On Thu, Jul 23, 2015 at 6:43 PM, Tom Morris  wrote:
>>
>>> I'm biased, but I think this is a perfect use case for OpenRefine.  What
>>> you'd need is an OpenRefine compatible "reconcilation service" provided by
>>> Wikidata that OpenRefine could use and then it'd allow you to match an
>>> entire column in spreadsheet, set a threshold for automatic matches, review
>>> candidates for those below the threshold, etc.
>>>
>>> https://github.com/OpenRefine/OpenRefine/wiki/Reconcilable-Data-Sources
>>>
>>> https://api.opencorporates.com/documentation/Google-Refine-Reconciliation-API
>>> http://refine.codefork.com/
>>> https://wiki.duraspace.org/display/VIVO/Extending+Google+Refine+for+VIVO
>>>
>>> Tom
>>>
>>> On Thu, Jul 23, 2015 at 2:44 AM, Sandra Fauconnier <
>>> sandra.fauconn...@gmail.com> wrote:
>>>
 Hi everyone,

 I’ve been in the situation quite often (edit-a-thons; various to do
 lists) where I had a list of terms (most usually names of a few hundreds of
 people, or titles of Wikipedia articles), where I wanted to do a quick
 search on Wikidata to retrieve each of these concept’s Q number.
 Does anyone know of a tool that helps me make this easier? Enter a list
 of, say, 100 of these search terms, and receive Q number suggestions for
 each of them? I’ve looked around on wmflabs but have not found anything in
 that direction (also not with the help of Hay’s awesome tool directory
 ).

 Till now, I’ve done all these searches manually - use an excel sheet,
 look for each term individually, enter Q number for each term - quite
 accurate but very time-consuming!

 Would appreciate all help/tips !
 Thanks! Sandra (User:Spinster)

 ___
 Wikidata mailing list
 Wikidata@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/wikidata


>>>
>>> ___
>>> Wikidata mailing list
>>> Wikidata@lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>>
>>>
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-24 Thread Magnus Manske
On it...

On Fri, Jul 24, 2015 at 1:41 AM Thad Guidry  wrote:

> Yeah it would be awesome if Wikidata could hack together a OpenRefine
> compatible "reconcilation service" !
>
> Librarians use OpenRefine by the way ! (wink wink) ;)  More data, more
> data, more data
>
>
>
> Thad
> +ThadGuidry 
>
> On Thu, Jul 23, 2015 at 6:43 PM, Tom Morris  wrote:
>
>> I'm biased, but I think this is a perfect use case for OpenRefine.  What
>> you'd need is an OpenRefine compatible "reconcilation service" provided by
>> Wikidata that OpenRefine could use and then it'd allow you to match an
>> entire column in spreadsheet, set a threshold for automatic matches, review
>> candidates for those below the threshold, etc.
>>
>> https://github.com/OpenRefine/OpenRefine/wiki/Reconcilable-Data-Sources
>>
>> https://api.opencorporates.com/documentation/Google-Refine-Reconciliation-API
>> http://refine.codefork.com/
>> https://wiki.duraspace.org/display/VIVO/Extending+Google+Refine+for+VIVO
>>
>> Tom
>>
>> On Thu, Jul 23, 2015 at 2:44 AM, Sandra Fauconnier <
>> sandra.fauconn...@gmail.com> wrote:
>>
>>> Hi everyone,
>>>
>>> I’ve been in the situation quite often (edit-a-thons; various to do
>>> lists) where I had a list of terms (most usually names of a few hundreds of
>>> people, or titles of Wikipedia articles), where I wanted to do a quick
>>> search on Wikidata to retrieve each of these concept’s Q number.
>>> Does anyone know of a tool that helps me make this easier? Enter a list
>>> of, say, 100 of these search terms, and receive Q number suggestions for
>>> each of them? I’ve looked around on wmflabs but have not found anything in
>>> that direction (also not with the help of Hay’s awesome tool directory
>>> ).
>>>
>>> Till now, I’ve done all these searches manually - use an excel sheet,
>>> look for each term individually, enter Q number for each term - quite
>>> accurate but very time-consuming!
>>>
>>> Would appreciate all help/tips !
>>> Thanks! Sandra (User:Spinster)
>>>
>>> ___
>>> Wikidata mailing list
>>> Wikidata@lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>>
>>>
>>
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
>>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-23 Thread Thad Guidry
Yeah it would be awesome if Wikidata could hack together a OpenRefine
compatible "reconcilation service" !

Librarians use OpenRefine by the way ! (wink wink) ;)  More data, more
data, more data



Thad
+ThadGuidry 

On Thu, Jul 23, 2015 at 6:43 PM, Tom Morris  wrote:

> I'm biased, but I think this is a perfect use case for OpenRefine.  What
> you'd need is an OpenRefine compatible "reconcilation service" provided by
> Wikidata that OpenRefine could use and then it'd allow you to match an
> entire column in spreadsheet, set a threshold for automatic matches, review
> candidates for those below the threshold, etc.
>
> https://github.com/OpenRefine/OpenRefine/wiki/Reconcilable-Data-Sources
>
> https://api.opencorporates.com/documentation/Google-Refine-Reconciliation-API
> http://refine.codefork.com/
> https://wiki.duraspace.org/display/VIVO/Extending+Google+Refine+for+VIVO
>
> Tom
>
> On Thu, Jul 23, 2015 at 2:44 AM, Sandra Fauconnier <
> sandra.fauconn...@gmail.com> wrote:
>
>> Hi everyone,
>>
>> I’ve been in the situation quite often (edit-a-thons; various to do
>> lists) where I had a list of terms (most usually names of a few hundreds of
>> people, or titles of Wikipedia articles), where I wanted to do a quick
>> search on Wikidata to retrieve each of these concept’s Q number.
>> Does anyone know of a tool that helps me make this easier? Enter a list
>> of, say, 100 of these search terms, and receive Q number suggestions for
>> each of them? I’ve looked around on wmflabs but have not found anything in
>> that direction (also not with the help of Hay’s awesome tool directory
>> ).
>>
>> Till now, I’ve done all these searches manually - use an excel sheet,
>> look for each term individually, enter Q number for each term - quite
>> accurate but very time-consuming!
>>
>> Would appreciate all help/tips !
>> Thanks! Sandra (User:Spinster)
>>
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
>>
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-23 Thread Tom Morris
I'm biased, but I think this is a perfect use case for OpenRefine.  What
you'd need is an OpenRefine compatible "reconcilation service" provided by
Wikidata that OpenRefine could use and then it'd allow you to match an
entire column in spreadsheet, set a threshold for automatic matches, review
candidates for those below the threshold, etc.

https://github.com/OpenRefine/OpenRefine/wiki/Reconcilable-Data-Sources
https://api.opencorporates.com/documentation/Google-Refine-Reconciliation-API
http://refine.codefork.com/
https://wiki.duraspace.org/display/VIVO/Extending+Google+Refine+for+VIVO

Tom

On Thu, Jul 23, 2015 at 2:44 AM, Sandra Fauconnier <
sandra.fauconn...@gmail.com> wrote:

> Hi everyone,
>
> I’ve been in the situation quite often (edit-a-thons; various to do lists)
> where I had a list of terms (most usually names of a few hundreds of
> people, or titles of Wikipedia articles), where I wanted to do a quick
> search on Wikidata to retrieve each of these concept’s Q number.
> Does anyone know of a tool that helps me make this easier? Enter a list
> of, say, 100 of these search terms, and receive Q number suggestions for
> each of them? I’ve looked around on wmflabs but have not found anything in
> that direction (also not with the help of Hay’s awesome tool directory
> ).
>
> Till now, I’ve done all these searches manually - use an excel sheet, look
> for each term individually, enter Q number for each term - quite accurate
> but very time-consuming!
>
> Would appreciate all help/tips !
> Thanks! Sandra (User:Spinster)
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-23 Thread Ed Summers
Hi Sandra,

I suspect this is a bit too nerdy, but I was reconciling some messy CSV data to 
Wikidata recently and ended up writing a little Python library and command line 
tool that uses wbgetentities API call.

https://github.com/edsu/wikidata_suggest

I also created an awkward video I did for Day of Digital Humanities here:

https://vimeo.com/128305641

//Ed

> On Jul 23, 2015, at 3:29 AM, Gerard Meijssen  
> wrote:
> 
> Hoi,
> When the list is a list of articles in a Wikipedia, try "Linked items" one 
> magnificent tool by Magnus that can be used for this..
> Thanks,
>  GerardM
> 
> 
> 
> 
> https://tools.wmflabs.org/wikidata-todo/linked_items.php
> 
> On 23 July 2015 at 08:44, Sandra Fauconnier  
> wrote:
> Hi everyone,
> 
> I’ve been in the situation quite often (edit-a-thons; various to do lists) 
> where I had a list of terms (most usually names of a few hundreds of people, 
> or titles of Wikipedia articles), where I wanted to do a quick search on 
> Wikidata to retrieve each of these concept’s Q number.
> Does anyone know of a tool that helps me make this easier? Enter a list of, 
> say, 100 of these search terms, and receive Q number suggestions for each of 
> them? I’ve looked around on wmflabs but have not found anything in that 
> direction (also not with the help of Hay’s awesome tool directory).
> 
> Till now, I’ve done all these searches manually - use an excel sheet, look 
> for each term individually, enter Q number for each term - quite accurate but 
> very time-consuming!
> 
> Would appreciate all help/tips !
> Thanks! Sandra (User:Spinster)
> 
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
> 
> 
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-23 Thread Sandra Fauconnier
Hi everyone,

Thanks for the tips so far!

I usually receive and look up ‘external’ lists of concepts/names, for which I 
have no corresponding Wikipedia article, and there may be spelling variations 
or even errors.
I tried Linked Items! Thank you! It does give me partial results, which makes a 
nice difference! But if someone knows of an even more generic search tool (e.g. 
across all Wikipedias and searching in all Wikidata aliases), that would make 
me even more happy :-D

In any case, Linked Items will make my life easier in the near future for sure.

BTW, here’s a typical example of a (small part of a) list of terms I’d like to 
look up on Wikidata:

Names of Dutch companies, well-known products, and designers, for an 
edit-a-thon, provided by A GLAM:

Wim Rietveld
Martin Visser
Spectrum Design
Kembo
TX 400
Rein Veersema
Gerard Kiljan
Heemaf
Wim Gilles
DRU
Vladimir Flem
Fridor
G.M.E. Bellefroid
Koninklijke Mosa

Thanks! Sandra





> On 23 Jul 2015, at 09:29, Gerard Meijssen  wrote:
> 
> Hoi,
> When the list is a list of articles in a Wikipedia, try "Linked items" one 
> magnificent tool by Magnus that can be used for this..
> Thanks,
>  GerardM
> 
> 
> 
> 
> https://tools.wmflabs.org/wikidata-todo/linked_items.php 
> 
> 
> On 23 July 2015 at 08:44, Sandra Fauconnier  > wrote:
> Hi everyone,
> 
> I’ve been in the situation quite often (edit-a-thons; various to do lists) 
> where I had a list of terms (most usually names of a few hundreds of people, 
> or titles of Wikipedia articles), where I wanted to do a quick search on 
> Wikidata to retrieve each of these concept’s Q number.
> Does anyone know of a tool that helps me make this easier? Enter a list of, 
> say, 100 of these search terms, and receive Q number suggestions for each of 
> them? I’ve looked around on wmflabs but have not found anything in that 
> direction (also not with the help of Hay’s awesome tool directory 
> ).
> 
> Till now, I’ve done all these searches manually - use an excel sheet, look 
> for each term individually, enter Q number for each term - quite accurate but 
> very time-consuming!
> 
> Would appreciate all help/tips !
> Thanks! Sandra (User:Spinster)
> 
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org 
> https://lists.wikimedia.org/mailman/listinfo/wikidata 
> 
> 
> 
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-23 Thread Tobi Gritschacher
Hey,

given you have titles of Wikipedia articles and you know from which
Wikipedia, you could easily use the Wikidata wbgetentities API module [1].
Here's a sample request for some random German monarchs [2].
Take also a closer look at the "props" parameter which allows you to
specify which information you want to get back from each entity.

HTH,
cheers, tobi

[1] https://www.wikidata.org/w/api.php?action=help&modules=wbgetentities
[2]
https://www.wikidata.org/w/api.php?action=wbgetentities&titles=Louis_the_German|Carloman_of_Bavaria|Charles_the_Fat|Henry_II,_Holy_Roman_Emperor|Hermann_of_Salm|Henry_Berengar&sites=enwiki&props=info


On Thu, Jul 23, 2015 at 8:44 AM, Sandra Fauconnier <
sandra.fauconn...@gmail.com> wrote:

> Hi everyone,
>
> I’ve been in the situation quite often (edit-a-thons; various to do lists)
> where I had a list of terms (most usually names of a few hundreds of
> people, or titles of Wikipedia articles), where I wanted to do a quick
> search on Wikidata to retrieve each of these concept’s Q number.
> Does anyone know of a tool that helps me make this easier? Enter a list
> of, say, 100 of these search terms, and receive Q number suggestions for
> each of them? I’ve looked around on wmflabs but have not found anything in
> that direction (also not with the help of Hay’s awesome tool directory
> ).
>
> Till now, I’ve done all these searches manually - use an excel sheet, look
> for each term individually, enter Q number for each term - quite accurate
> but very time-consuming!
>
> Would appreciate all help/tips !
> Thanks! Sandra (User:Spinster)
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>


-- 
Tobi Gritschacher
SCRUM Master

Imagine a world, in which every single human being can freely
share in the sum of all knowledge. That‘s our commitment.
http://spenden.wikimedia.de/

Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Phone +49 (0)30 219 158 260

Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-23 Thread Jan Ainali
And if you use that tool you can easily paste your excel sheet in
wikiformat as source in the big box labeled wikitext.

E.g. By entering:

[[Search]]
[[Term]]

the tool will return

Q1267283
Q3984436



*Med vänliga hälsningar,Jan Ainali*

Verksamhetschef, Wikimedia Sverige 
0729 - 67 29 48


*Tänk dig en värld där varje människa har fri tillgång till mänsklighetens
samlade kunskap. Det är det vi gör.*
Bli medlem. 


2015-07-23 9:29 GMT+02:00 Gerard Meijssen :

> Hoi,
> When the list is a list of articles in a Wikipedia, try "Linked items" one
> magnificent tool by Magnus that can be used for this..
> Thanks,
>  GerardM
>
>
>
>
> https://tools.wmflabs.org/wikidata-todo/linked_items.php
>
> On 23 July 2015 at 08:44, Sandra Fauconnier 
> wrote:
>
>> Hi everyone,
>>
>> I’ve been in the situation quite often (edit-a-thons; various to do
>> lists) where I had a list of terms (most usually names of a few hundreds of
>> people, or titles of Wikipedia articles), where I wanted to do a quick
>> search on Wikidata to retrieve each of these concept’s Q number.
>> Does anyone know of a tool that helps me make this easier? Enter a list
>> of, say, 100 of these search terms, and receive Q number suggestions for
>> each of them? I’ve looked around on wmflabs but have not found anything in
>> that direction (also not with the help of Hay’s awesome tool directory
>> ).
>>
>> Till now, I’ve done all these searches manually - use an excel sheet,
>> look for each term individually, enter Q number for each term - quite
>> accurate but very time-consuming!
>>
>> Would appreciate all help/tips !
>> Thanks! Sandra (User:Spinster)
>>
>> ___
>> Wikidata mailing list
>> Wikidata@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikidata
>>
>>
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-23 Thread Gerard Meijssen
Hoi,
When the list is a list of articles in a Wikipedia, try "Linked items" one
magnificent tool by Magnus that can be used for this..
Thanks,
 GerardM




https://tools.wmflabs.org/wikidata-todo/linked_items.php

On 23 July 2015 at 08:44, Sandra Fauconnier 
wrote:

> Hi everyone,
>
> I’ve been in the situation quite often (edit-a-thons; various to do lists)
> where I had a list of terms (most usually names of a few hundreds of
> people, or titles of Wikipedia articles), where I wanted to do a quick
> search on Wikidata to retrieve each of these concept’s Q number.
> Does anyone know of a tool that helps me make this easier? Enter a list
> of, say, 100 of these search terms, and receive Q number suggestions for
> each of them? I’ve looked around on wmflabs but have not found anything in
> that direction (also not with the help of Hay’s awesome tool directory
> ).
>
> Till now, I’ve done all these searches manually - use an excel sheet, look
> for each term individually, enter Q number for each term - quite accurate
> but very time-consuming!
>
> Would appreciate all help/tips !
> Thanks! Sandra (User:Spinster)
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-23 Thread Jane Darnell
Good question! This didn't used to be possible but should be today with
random access. When I need this it's generally because I want to add
something to those items, and if you are certain of the spelling you can
use quick_statements to add the statement and then collect the q numbers
that way. The problem with this approach is that you can easily add double
statements and you theoretically only want to augment the existing
statements per item, not duplicate them. Of course if all items share some
common statement you may be able to query that statement and filter the
results.  Another way I do this is with listeria. For example if I want the
artists in a collection, I set up a listeria query for all artworks in the
collection and include the creator field. Afterwards I collect the result
and filter for the artists' names or q numbers. Obvious problem here is
that most collections on Wikidata only include the most popular artworks in
the collection, because these are coming from the various wikipedia
projects. There are still lots and lots of artworks on Commons without
wikidata items.Hope it helps.

On Thu, Jul 23, 2015 at 8:44 AM, Sandra Fauconnier <
sandra.fauconn...@gmail.com> wrote:

> Hi everyone,
>
> I’ve been in the situation quite often (edit-a-thons; various to do lists)
> where I had a list of terms (most usually names of a few hundreds of
> people, or titles of Wikipedia articles), where I wanted to do a quick
> search on Wikidata to retrieve each of these concept’s Q number.
> Does anyone know of a tool that helps me make this easier? Enter a list
> of, say, 100 of these search terms, and receive Q number suggestions for
> each of them? I’ve looked around on wmflabs but have not found anything in
> that direction (also not with the help of Hay’s awesome tool directory
> ).
>
> Till now, I’ve done all these searches manually - use an excel sheet, look
> for each term individually, enter Q number for each term - quite accurate
> but very time-consuming!
>
> Would appreciate all help/tips !
> Thanks! Sandra (User:Spinster)
>
> ___
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>
>
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata] tool to do multiple searches in Wikidata at once?

2015-07-22 Thread Sandra Fauconnier
Hi everyone,

I’ve been in the situation quite often (edit-a-thons; various to do lists) 
where I had a list of terms (most usually names of a few hundreds of people, or 
titles of Wikipedia articles), where I wanted to do a quick search on Wikidata 
to retrieve each of these concept’s Q number.
Does anyone know of a tool that helps me make this easier? Enter a list of, 
say, 100 of these search terms, and receive Q number suggestions for each of 
them? I’ve looked around on wmflabs but have not found anything in that 
direction (also not with the help of Hay’s awesome tool directory 
).

Till now, I’ve done all these searches manually - use an excel sheet, look for 
each term individually, enter Q number for each term - quite accurate but very 
time-consuming!

Would appreciate all help/tips !
Thanks! Sandra (User:Spinster)___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata