Re: [DBpedia-discussion] status of DBpedia live

2018-09-12 Thread Martin Ostrovsky 
Thanks for the solid work on all this Sebastian.

Piggybacking of Peter’s comment - currently if you go to dbpedia.org 
 and hit the menu item “Downloads” you’re taken to 
https://wiki.dbpedia.org/develop/datasets 
 which has all of the old data. If 
not for your most recent email, I had *no* idea that 
http://downloads.dbpedia.org/repo/  was a 
thing.

Is there a description of what each file in lts/dev means? For example, If I 
want the old “infoboxproperties” dump, what’s the current equivalent?



___
DBpedia-discussion mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion

Re: [DBpedia-discussion] status of DBpedia live

2018-09-12 Thread Peter F. Patel-Schneider 
That's excellent news.

Has all the current status been posted somewhere?   My group spent quite a
while trying to figure out what was going on with the various pieces of DBpedia.

peter


On 9/12/18 12:19 AM, [email protected] wrote:
> Hi Peter,
> Yes, wikidata ext. has been running biweekly since Jan. Generic is finished
> and will run every 4-6 weeks. Mappings and post processing are running 
> currently.
> 
> Data will be published here http://downloads.dbpedia.org/repo/
> 
> More data so as a rule of thumb: every 4th release will be in lts forever,
> others in /dev/. dev data will be deleted after a year or so.
> 
> All the best,
> Sebastian
> 
> On September 12, 2018 5:50:27 AM GMT+02:00, "Peter F. Patel-Schneider"
>  wrote:
> 
> Hi:
> 
> Thanks for the answers.
> 
> So there will soon be weekly DBpedia releases as part of the new DBpedia. 
>  Is
> that correct?
> 
> peter
> 
> 
> On 9/11/18 3:09 AM, Sebastian Hellmann wrote:
> 
> Hi Peter,
> 
> first of all, I would like to thank you for your input at the 
> California
> meeting last year. We took your advice to make the mappings extraction
> faster.
> 
> It is running currently and after that we hope that it will run each 
> week.
> 
> 
> I can also answer you here, real quick. Actually there is a channel 
> for
> dbpedia-live called #dev-live
> 
> We are in quite a restructuring phase. The new DBpedia processes will
> be (1)
> better documented, (2) more reliable for a price and (3) more open 
> for the
> community to contribute.   
> 
> With regards to the live extraction, we are still looking for a small
> business
> model. The main reason is that it is very hard to maintain and we need
> to make
> this more reliable and have somebody monitoring and improving it.
> 
> Wikimedia changed its API, to be fair this was done in a very 
> professional
> way. They offered the OAI-PMH for ten years. Then a couple of years
> ago they
> had a Recent Changes (RC) API in parallel, declaring OAI-PMH as 
> legacy. We
> were the only ones using it in the end. RC didn't have the right
> features for
> the Live Extraction to work well. Now they switched to Kafka turning
> off the
> OAI-PMH. So we missed out the one lifecycle phase in their API 
> changes.
> 
> We have a student working on it, with the rest working on the 
> releases and
> spotlight, however this will not progress fast.
> 
> 
> We are happy for any ideas how to stabilize the service. In the end,
> we are
> considering these options:
> 
> - free to download and self install
> 
> - professional support for running it locally
> 
> - paid service (with a reduction for members) to make it more 
> reliable. 
> 
> Actually, it is almost a classical open source model.
> 
> All the best,
> 
> Sebastian
> 
> 
> On 06.09.2018 20:33, Peter F. Patel-Schneider wrote:
> 
> Hi:
> 
> It seems that DBpedia live hasn't been updating since May.
> 
> The most recent changeset at http://live.dbpedia.org/changesets/
> is from 17 May.
> 
> Is DBpedia live dead, or is it just resting?
> 
> peter
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> 
> --
> DBpedia-discussion mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
> 
> 
> -- 
> All the best,
> Sebastian Hellmann
> 
> Director of Knowledge Integration and Linked Data Technologies (KILT)
> Competence Center
> at the Institute for Applied Informatics (InfAI) at Leipzig University
> Executive Director of the DBpedia Association
> Projects: http://dbpedia.org, http://nlp2rdf.org,
> http://linguistics.okfn.org,
> https://www.w3.org/community/ld4lt 
> Homepage: http://aksw.org/SebastianHellmann
> Research Group: http://aksw.org
> 
> 
> 
> -- 
> Sent from my Android device with K-9 Mail. Please excuse my brevity.


___
DBpedia-discussion mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion

Re: [DBpedia-discussion] status of DBpedia live

2018-09-12 Thread hellmann 
Hi Peter,
Yes, wikidata ext. has been running biweekly since Jan. Generic is finished and 
will run every 4-6 weeks. Mappings and post processing are running currently.

Data will be published here http://downloads.dbpedia.org/repo/

More data so as a rule of thumb: every 4th release will be in lts forever, 
others in /dev/. dev data will be deleted after a year or so.

All the best,
Sebastian 

On September 12, 2018 5:50:27 AM GMT+02:00, "Peter F. Patel-Schneider" 
 wrote:
>Hi:
>
>Thanks for the answers.
>
>So there will soon be weekly DBpedia releases as part of the new
>DBpedia.  Is
>that correct?
>
>peter
>
>
>On 9/11/18 3:09 AM, Sebastian Hellmann wrote:
>> Hi Peter,
>> 
>> first of all, I would like to thank you for your input at the
>California
>> meeting last year. We took your advice to make the mappings
>extraction faster.
>> 
>> It is running currently and after that we hope that it will run each
>week.
>> 
>> 
>> I can also answer you here, real quick. Actually there is a channel
>for
>> dbpedia-live called #dev-live
>> 
>> We are in quite a restructuring phase. The new DBpedia processes will
>be (1)
>> better documented, (2) more reliable for a price and (3) more open
>for the
>> community to contribute.   
>> 
>> With regards to the live extraction, we are still looking for a small
>business
>> model. The main reason is that it is very hard to maintain and we
>need to make
>> this more reliable and have somebody monitoring and improving it.
>> 
>> Wikimedia changed its API, to be fair this was done in a very
>professional
>> way. They offered the OAI-PMH for ten years. Then a couple of years
>ago they
>> had a Recent Changes (RC) API in parallel, declaring OAI-PMH as
>legacy. We
>> were the only ones using it in the end. RC didn't have the right
>features for
>> the Live Extraction to work well. Now they switched to Kafka turning
>off the
>> OAI-PMH. So we missed out the one lifecycle phase in their API
>changes.
>> 
>> We have a student working on it, with the rest working on the
>releases and
>> spotlight, however this will not progress fast.
>> 
>> 
>> We are happy for any ideas how to stabilize the service. In the end,
>we are
>> considering these options:
>> 
>> - free to download and self install
>> 
>> - professional support for running it locally
>> 
>> - paid service (with a reduction for members) to make it more
>reliable. 
>> 
>> Actually, it is almost a classical open source model.
>> 
>> All the best,
>> 
>> Sebastian
>> 
>> 
>> On 06.09.2018 20:33, Peter F. Patel-Schneider wrote:
>>> Hi:
>>>
>>> It seems that DBpedia live hasn't been updating since May.
>>>
>>> The most recent changeset at http://live.dbpedia.org/changesets/ is
>from 17 May.
>>>
>>> Is DBpedia live dead, or is it just resting?
>>>
>>> peter
>>>
>>>
>--
>>> Check out the vibrant tech community on one of the world's most
>>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>>> ___
>>> DBpedia-discussion mailing list
>>> [email protected]
>>> https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
>>>
>> 
>> -- 
>> All the best,
>> Sebastian Hellmann
>> 
>> Director of Knowledge Integration and Linked Data Technologies (KILT)
>> Competence Center
>> at the Institute for Applied Informatics (InfAI) at Leipzig
>University
>> Executive Director of the DBpedia Association
>> Projects: http://dbpedia.org, http://nlp2rdf.org,
>http://linguistics.okfn.org,
>> https://www.w3.org/community/ld4lt
>
>> Homepage: http://aksw.org/SebastianHellmann
>> Research Group: http://aksw.org

-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity.___
DBpedia-discussion mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion

Re: [DBpedia-discussion] status of DBpedia live

2018-09-11 Thread Peter F. Patel-Schneider 
Hi:

Thanks for the answers.

So there will soon be weekly DBpedia releases as part of the new DBpedia.  Is
that correct?

peter


On 9/11/18 3:09 AM, Sebastian Hellmann wrote:
> Hi Peter,
> 
> first of all, I would like to thank you for your input at the California
> meeting last year. We took your advice to make the mappings extraction faster.
> 
> It is running currently and after that we hope that it will run each week.
> 
> 
> I can also answer you here, real quick. Actually there is a channel for
> dbpedia-live called #dev-live
> 
> We are in quite a restructuring phase. The new DBpedia processes will be (1)
> better documented, (2) more reliable for a price and (3) more open for the
> community to contribute.   
> 
> With regards to the live extraction, we are still looking for a small business
> model. The main reason is that it is very hard to maintain and we need to make
> this more reliable and have somebody monitoring and improving it.
> 
> Wikimedia changed its API, to be fair this was done in a very professional
> way. They offered the OAI-PMH for ten years. Then a couple of years ago they
> had a Recent Changes (RC) API in parallel, declaring OAI-PMH as legacy. We
> were the only ones using it in the end. RC didn't have the right features for
> the Live Extraction to work well. Now they switched to Kafka turning off the
> OAI-PMH. So we missed out the one lifecycle phase in their API changes.
> 
> We have a student working on it, with the rest working on the releases and
> spotlight, however this will not progress fast.
> 
> 
> We are happy for any ideas how to stabilize the service. In the end, we are
> considering these options:
> 
> - free to download and self install
> 
> - professional support for running it locally
> 
> - paid service (with a reduction for members) to make it more reliable. 
> 
> Actually, it is almost a classical open source model.
> 
> All the best,
> 
> Sebastian
> 
> 
> On 06.09.2018 20:33, Peter F. Patel-Schneider wrote:
>> Hi:
>>
>> It seems that DBpedia live hasn't been updating since May.
>>
>> The most recent changeset at http://live.dbpedia.org/changesets/ is from 17 
>> May.
>>
>> Is DBpedia live dead, or is it just resting?
>>
>> peter
>>
>> --
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>> ___
>> DBpedia-discussion mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
>>
> 
> -- 
> All the best,
> Sebastian Hellmann
> 
> Director of Knowledge Integration and Linked Data Technologies (KILT)
> Competence Center
> at the Institute for Applied Informatics (InfAI) at Leipzig University
> Executive Director of the DBpedia Association
> Projects: http://dbpedia.org, http://nlp2rdf.org, http://linguistics.okfn.org,
> https://www.w3.org/community/ld4lt 
> Homepage: http://aksw.org/SebastianHellmann
> Research Group: http://aksw.org


___
DBpedia-discussion mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion

Re: [DBpedia-discussion] status of DBpedia live

2018-09-11 Thread Sebastian Hellmann 

Ah yes, I forgot.

There is also the options that:

- you fix it yourself

- donate money to DBpedia dedicated to speed things up

All the best,

Sebastian


On 11.09.2018 12:09, Sebastian Hellmann wrote:


Hi Peter,

first of all, I would like to thank you for your input at the 
California meeting last year. We took your advice to make the mappings 
extraction faster.


It is running currently and after that we hope that it will run each 
week.



I can also answer you here, real quick. Actually there is a channel 
for dbpedia-live called #dev-live


We are in quite a restructuring phase. The new DBpedia processes will 
be (1) better documented, (2) more reliable for a price and (3) more 
open for the community to contribute.


With regards to the live extraction, we are still looking for a small 
business model. The main reason is that it is very hard to maintain 
and we need to make this more reliable and have somebody monitoring 
and improving it.


Wikimedia changed its API, to be fair this was done in a very 
professional way. They offered the OAI-PMH for ten years. Then a 
couple of years ago they had a Recent Changes (RC) API in parallel, 
declaring OAI-PMH as legacy. We were the only ones using it in the 
end. RC didn't have the right features for the Live Extraction to work 
well. Now they switched to Kafka turning off the OAI-PMH. So we missed 
out the one lifecycle phase in their API changes.


We have a student working on it, with the rest working on the releases 
and spotlight, however this will not progress fast.



We are happy for any ideas how to stabilize the service. In the end, 
we are considering these options:


- free to download and self install

- professional support for running it locally

- paid service (with a reduction for members) to make it more reliable.

Actually, it is almost a classical open source model.

All the best,

Sebastian



--
All the best,
Sebastian Hellmann

Director of Knowledge Integration and Linked Data Technologies (KILT) 
Competence Center

at the Institute for Applied Informatics (InfAI) at Leipzig University
Executive Director of the DBpedia Association
Projects: http://dbpedia.org, http://nlp2rdf.org, 
http://linguistics.okfn.org, https://www.w3.org/community/ld4lt 


Homepage: http://aksw.org/SebastianHellmann
Research Group: http://aksw.org
___
DBpedia-discussion mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion

Re: [DBpedia-discussion] status of DBpedia live

2018-09-11 Thread Sebastian Hellmann 

Hi Peter,

first of all, I would like to thank you for your input at the California 
meeting last year. We took your advice to make the mappings extraction 
faster.


It is running currently and after that we hope that it will run each week.


I can also answer you here, real quick. Actually there is a channel for 
dbpedia-live called #dev-live


We are in quite a restructuring phase. The new DBpedia processes will be 
(1) better documented, (2) more reliable for a price and (3) more open 
for the community to contribute.


With regards to the live extraction, we are still looking for a small 
business model. The main reason is that it is very hard to maintain and 
we need to make this more reliable and have somebody monitoring and 
improving it.


Wikimedia changed its API, to be fair this was done in a very 
professional way. They offered the OAI-PMH for ten years. Then a couple 
of years ago they had a Recent Changes (RC) API in parallel, declaring 
OAI-PMH as legacy. We were the only ones using it in the end. RC didn't 
have the right features for the Live Extraction to work well. Now they 
switched to Kafka turning off the OAI-PMH. So we missed out the one 
lifecycle phase in their API changes.


We have a student working on it, with the rest working on the releases 
and spotlight, however this will not progress fast.



We are happy for any ideas how to stabilize the service. In the end, we 
are considering these options:


- free to download and self install

- professional support for running it locally

- paid service (with a reduction for members) to make it more reliable.

Actually, it is almost a classical open source model.

All the best,

Sebastian


On 06.09.2018 20:33, Peter F. Patel-Schneider wrote:

Hi:

It seems that DBpedia live hasn't been updating since May.

The most recent changeset at http://live.dbpedia.org/changesets/ is from 17 May.

Is DBpedia live dead, or is it just resting?

peter

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
DBpedia-discussion mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion



--
All the best,
Sebastian Hellmann

Director of Knowledge Integration and Linked Data Technologies (KILT) 
Competence Center

at the Institute for Applied Informatics (InfAI) at Leipzig University
Executive Director of the DBpedia Association
Projects: http://dbpedia.org, http://nlp2rdf.org, 
http://linguistics.okfn.org, https://www.w3.org/community/ld4lt 


Homepage: http://aksw.org/SebastianHellmann
Research Group: http://aksw.org
___
DBpedia-discussion mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion