[orientdb] Announcement: new OrientDB-ETL project, no more code to import data in OrientDB!

[Luca Garulli]

Hi guys,
I'm glad to announce a new project under the Orient Technologies umbrella:
*OrientDB-ETL*!

This is the URL of WiKi:
*https://github.com/orientechnologies/orientdb-etl/wiki
<https://github.com/orientechnologies/orientdb-etl/wiki>*

Thanks to OrientDB-ETL project, moving data from/to OrientDB is super fast
and require no more code writing: only a JSON file.

So far these are the available components:

   - *Extractors*:
   - File
   - *Transformers*:
   - CSV, to convert rows in documents
      - Link, to transform JOIN in links
      - Merge, to merge the parsed document with an existent
      - Vertex, to convert a document in Vertex
      - Edge, to create edges
      - Skip, to skip records based on expressions
      - Code, to execute arbitrary Javascript code
   - *Loaders*:
   - OrientDB, to save into a OrientDB database

OrientDB-ETL module is in beta status, and will be final with OrientDB v2.0
(September). To use it against OrientDB 2.0-SNAPSHOT follow the
"Installation" instructions.

Below an example to import *DBPedia* *csv* files (
http://wiki.dbpedia.org/DBpediaAsTables):

{
  config: {
    verbose: true,
    fileDirectory: "/temp/databases/dbpedia_csv/",
    fileName: "Person.csv.gz"
  },
  begin: [
   { let: { name: "$filePath",  value: "$fileDirectory.append( $fileName
)"} },
   { let: { name: "$className", value: "$fileName.substring( 0,
$fileName.indexOf('.') )"} }
  ],
  extractor : {
    line: { path: "$filePath", lock : true }
  },
  transformers : [
   { csv: { separator: ",", nullValue: "NULL", skipFrom: 1, skipTo: 3 } },
   { merge: { joinFieldName:"URI", lookup:"V.URI" } },
   { vertex: { class: "$className"} }
  ],
  loader : {
    orientdb: {
      dbURL: "plocal:/temp/databases/dbpedia",
      dbUser: "admin",
      dbPassword: "admin",
      dbAutoCreate: true,
      tx: false,
      batchCommit: 1000,
      dbType: "graph",
      indexes: [{class:"V", fields:["URI:string"], type:"UNIQUE" }]
    }
  }
}

For more information:
https://github.com/orientechnologies/orientdb-etl/wiki/Import-from-DBPedia.

Lvc@

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"OrientDB" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to orient-database+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.