On 22/11/13 15:38, Sebastian Schaffert wrote:
I have now finished implementing a bulk-loading API for quickly dumping big RDF datasets into a KiWi/Marmotta triplestore. All code is located in libraries/kiwi/kiwi-loader. There is a command line tool (implemented mostly by Jakob) called KiWiLoader as well as an API implementation. Since it is probably more relevant for the rest of you, I'll explain in the following the API implementation: (...) A typical call of KiWiLoader would be: java -jar target/kiwi-loader-3.2.0-SNAPSHOT.one-jar.jar -S /tmp/loader.png -D postgresql -d jdbc:postgresql://localhost:5432/freebase?prepareThreshold=3 -U marmotta -P marmotta -z -f text/turtle -i freebase-rdf-2013-11-10-00-00_fixed.gz The option "-S" enables statistics sampling and creates diagrams similar to the one I attached. "-z"/"-j" select gzip/bzip2 compressed input, "-f" specifies input format, "-i" the input file, "-D" the database dialect. Rest is self-explanatory ;-)
It'd be nice to keep updated the documentation with these latest changes: http://wiki.apache.org/marmotta/ImportData#Import_data_directly_to_the_KiWi_triple_store ;-) -- Sergio Fernández Senior Researcher Knowledge and Media Technologies Salzburg Research Forschungsgesellschaft mbH Jakob-Haringer-Straße 5/3 | 5020 Salzburg, Austria T: +43 662 2288 318 | M: +43 660 2747 925 [email protected] http://www.salzburgresearch.at
