Having a static local version of ontology and mappings is good for the dump
extraction that takes several days and may have to be restarted. Things
would be unpredictable if we always used the latest version from the wiki,
so we download the stuff once before we start the extraction.
On Jun 27, 2013 2:42 PM, "Dimitris Kontokostas" <[email protected]> wrote:
> This is of course subjective but, having the option for a local cache is
> also good.
>
> Cheers,
> Dimitris
>
>
>
> On Thu, Jun 27, 2013 at 1:45 PM, Julien Plu <
> [email protected]> wrote:
>
>> Hi,
>>
>> Thanks for your lights :-)
>>
>> Personnally I think the process will be more logical if first we try to
>> download directly the last version of the mapping and ontology and if it's
>> not possible using the local files. No ?
>>
>> Best.
>>
>> Julien.
>>
>>
>> 2013/6/27 Dimitris Kontokostas <[email protected]>
>>
>>>
>>>
>>>
>>> On Thu, Jun 27, 2013 at 1:28 PM, Andrea Di Menna <[email protected]>wrote:
>>>
>>>> Hi Julien,
>>>>
>>>> in one case it is reading the file from the filesystem in the other
>>>> case it is downloading it from the mappings server.
>>>>
>>>> If you check org.dbpedia.extraction.dump.extract.ConfigLoader you will
>>>> see that:
>>>>
>>>> //language-independent val
>>>> private lazy val _ontology =
>>>> {
>>>> val ontologySource = if (config.ontologyFile != null &&
>>>> config.ontologyFile.isFile)
>>>> {
>>>> XMLSource.fromFile(config.ontologyFile, Language.Mappings)
>>>> }
>>>> else
>>>> {
>>>> val namespaces = Set(Namespace.OntologyClass,
>>>> Namespace.OntologyProperty)
>>>> val url = new URL(Language.Mappings.apiUri)
>>>> val language = Language.Mappings
>>>> WikiSource.fromNamespaces(namespaces, url, language)
>>>> }
>>>>
>>>> new OntologyReader().read(ontologySource)
>>>> }
>>>>
>>>> I suppose there are problems with the maven scala *
>>>> -DaddArgs=./dump/extraction.default.properties*
>>>> Can you try to double-quote the whole string? e.g. "*
>>>> -DaddArgs=./dump/extraction.default.properties"*
>>>>
>>>
>>> Andrea is correct but the problem lies in the contents of the property
>>> file
>>>
>>> # if ontology and mapping files are not given or do not exist, download
>>> info from mappings.dbpedia.org
>>> ontology=../ontology.xml
>>> mappings=../mappings
>>>
>>> The paths are relative and when you are in root dir, it cannot locate
>>> the files and downloads them from the server
>>>
>>> Cheers,
>>> Dimitris
>>>
>>>
>>>> *
>>>> *
>>>> Regards
>>>> Andrea
>>>>
>>>>
>>>> 2013/6/27 Julien Plu <[email protected]>
>>>>
>>>>> Hi,
>>>>>
>>>>> I think I have found an issue with Maven. When you run maven from
>>>>> "dump" directory an old mapping and ontology version is retrieved whereas
>>>>> if you run maven from "root" directory the last version of them is
>>>>> retrieved. By example from "dump" directory :
>>>>>
>>>>> *extraction-framework/dump$ mvn scala:run -Dlauncher=extraction
>>>>> -DaddArgs=extraction.default.properties*
>>>>>
>>>>> Here the log :
>>>>>
>>>>> *[INFO] --- maven-scala-plugin:2.15.2:run (default-cli) @ dump ---
>>>>> [INFO] Checking for multiple versions of scala
>>>>> [INFO] launcher 'extraction' selected =>
>>>>> org.dbpedia.extraction.dump.extract.Extraction
>>>>> juin 27, 2013 11:19:57 AM org.dbpedia.extraction.mappings.Redirects$
>>>>> loadFromCache
>>>>> INFO: Loading redirects from cache file
>>>>> /var/tmp/dumps/frwiki/20130601/frwiki-20130601-template-redirects.obj
>>>>> juin 27, 2013 11:19:57 AM org.dbpedia.extraction.mappings.Redirects$
>>>>> loadFromCache
>>>>> INFO: 0 redirects loaded from cache file
>>>>> /var/tmp/dumps/frwiki/20130601/frwiki-20130601-template-redirects.obj
>>>>> juin 27, 2013 11:19:57 AM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader read
>>>>> INFO: Loading ontology pages
>>>>> juin 27, 2013 11:20:00 AM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader read
>>>>> INFO: Loading ontology
>>>>> juin 27, 2013 11:20:00 AM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader$ClassBuilder$$anonfun$13
>>>>> apply
>>>>> WARNING: equivalent class 'dct:Location' of class 'Place' not found
>>>>> juin 27, 2013 11:20:00 AM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader$PropertyBuilder build
>>>>> WARNING: range 'metrePerSecondSquared' of property 'surfaceGravity'
>>>>> not found
>>>>> juin 27, 2013 11:20:00 AM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader$PropertyBuilder$$anonfun$build$7
>>>>> apply
>>>>> WARNING: Cannot use equivalent property 'foaf:gender'
>>>>> juin 27, 2013 11:20:00 AM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader read
>>>>> INFO: Ontology loaded
>>>>> juin 27, 2013 11:20:00 AM
>>>>> org.dbpedia.extraction.mappings.MappingsLoader$ load
>>>>> INFO: Loading mappings (fr)
>>>>> juin 27, 2013 11:20:01 AM
>>>>> org.dbpedia.extraction.mappings.MappingsLoader$ load
>>>>> INFO: Mappings loaded (fr)*
>>>>>
>>>>> From "root" directory :
>>>>>
>>>>> *extraction-framework$ mvn scala:run -Dlauncher=extraction
>>>>> -DaddArgs=./dump/extraction.default.properties*
>>>>>
>>>>> Here the log :
>>>>>
>>>>> *[INFO] --- maven-scala-plugin:2.15.2:run (default-cli) @ dump ---
>>>>> [INFO] Checking for multiple versions of scala
>>>>> [INFO] launcher 'extraction' selected =>
>>>>> org.dbpedia.extraction.dump.extract.Extraction
>>>>> juin 27, 2013 12:04:14 PM org.dbpedia.extraction.mappings.Redirects$
>>>>> loadFromCache
>>>>> INFO: Loading redirects from cache file
>>>>> /var/tmp/dumps/frwiki/20130601/frwiki-20130601-template-redirects.obj
>>>>> juin 27, 2013 12:04:15 PM org.dbpedia.extraction.mappings.Redirects$
>>>>> loadFromCache
>>>>> INFO: 0 redirects loaded from cache file
>>>>> /var/tmp/dumps/frwiki/20130601/frwiki-20130601-template-redirects.obj
>>>>> juin 27, 2013 12:04:15 PM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader read
>>>>> INFO: Loading ontology pages
>>>>> juin 27, 2013 12:04:53 PM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader read
>>>>> INFO: Loading ontology
>>>>> juin 27, 2013 12:04:53 PM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader
>>>>> org$dbpedia$extraction$ontology$io$OntologyReader$$loadOntologyProperty
>>>>> WARNING:
>>>>> title=Child;ns=202/OntologyProperty/OntologyProperty;language:wiki=mappings,locale=en
>>>>> - Found property with an invalid type
>>>>> juin 27, 2013 12:04:54 PM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader$PropertyBuilder$$anonfun$build$7
>>>>> apply
>>>>> WARNING: Cannot use equivalent property 'rdfs:label'
>>>>> juin 27, 2013 12:04:54 PM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader$PropertyBuilder$$anonfun$build$7
>>>>> apply
>>>>> WARNING: Cannot use equivalent property 'rdfs:label'
>>>>> juin 27, 2013 12:04:54 PM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader$PropertyBuilder$$anonfun$build$7
>>>>> apply
>>>>> WARNING: Cannot use equivalent property 'foaf:img'
>>>>> juin 27, 2013 12:04:54 PM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader$PropertyBuilder$$anonfun$build$7
>>>>> apply
>>>>> WARNING: Cannot use equivalent property 'rdfs:label'
>>>>> juin 27, 2013 12:04:54 PM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader$PropertyBuilder$$anonfun$build$7
>>>>> apply
>>>>> WARNING: Cannot use equivalent property 'rdfs:label'
>>>>> juin 27, 2013 12:04:54 PM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader$PropertyBuilder$$anonfun$build$7
>>>>> apply
>>>>> WARNING: Cannot use equivalent property 'rdfs:label'
>>>>> juin 27, 2013 12:04:54 PM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader$PropertyBuilder$$anonfun$build$7
>>>>> apply
>>>>> WARNING: Cannot use equivalent property 'rdfs:label'
>>>>> juin 27, 2013 12:04:54 PM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader$PropertyBuilder$$anonfun$build$7
>>>>> apply
>>>>> WARNING: Cannot use equivalent property 'rdfs:comment'
>>>>> juin 27, 2013 12:04:54 PM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader$PropertyBuilder$$anonfun$build$7
>>>>> apply
>>>>> WARNING: Cannot use equivalent property 'rdfs:label'
>>>>> juin 27, 2013 12:04:54 PM
>>>>> org.dbpedia.extraction.ontology.io.OntologyReader read
>>>>> INFO: Ontology loaded
>>>>> juin 27, 2013 12:04:54 PM
>>>>> org.dbpedia.extraction.mappings.MappingsLoader$ load
>>>>> INFO: Loading mappings (fr)
>>>>> juin 27, 2013 12:04:58 PM
>>>>> org.dbpedia.extraction.mappings.MappingsLoader$ load
>>>>> INFO: Mappings loaded (fr)*
>>>>>
>>>>> Someone know what's happen ?
>>>>>
>>>>> Thanks in advance.
>>>>>
>>>>> Best.
>>>>>
>>>>> Julien.
>>>>>
>>>>>
>>>>> ------------------------------------------------------------------------------
>>>>> This SF.net email is sponsored by Windows:
>>>>>
>>>>> Build for Windows Store.
>>>>>
>>>>> http://p.sf.net/sfu/windows-dev2dev
>>>>> _______________________________________________
>>>>> Dbpedia-discussion mailing list
>>>>> [email protected]
>>>>> https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
>>>>>
>>>>>
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> This SF.net email is sponsored by Windows:
>>>>
>>>> Build for Windows Store.
>>>>
>>>> http://p.sf.net/sfu/windows-dev2dev
>>>> _______________________________________________
>>>> Dbpedia-discussion mailing list
>>>> [email protected]
>>>> https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
>>>>
>>>>
>>>
>>>
>>> --
>>> Kontokostas Dimitris
>>>
>>
>>
>
>
> --
> Kontokostas Dimitris
>
>
> ------------------------------------------------------------------------------
> This SF.net email is sponsored by Windows:
>
> Build for Windows Store.
>
> http://p.sf.net/sfu/windows-dev2dev
> _______________________________________________
> Dbpedia-discussion mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
>
>
------------------------------------------------------------------------------
See everything from the browser to the database with AppDynamics
Get end-to-end visibility with application monitoring from AppDynamics
Isolate bottlenecks and diagnose root cause in seconds.
Start your free trial of AppDynamics Pro today!
http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
_______________________________________________
Dbpedia-discussion mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
