Well instead of using a JDBC connection to MySQL I instead now want to use
a *CSV *file to load from.
So I tried out many things and again ETL is having huge problems. Well it
still seems pretty unstable and not well documented. The only tutorial in
the internet is the one about the DBPedia. Well I don't know that plattform
this is but for sure it's the same way of an usual CSV like:
id,name
1,Name1
2,Name2
and so on
So I tried it with an own example:
{
"config": {
"verbose": true,
"fileDirectory": "C:/Users/kwoxer/Desktop/DB -
orientdb/bin/backup/csv-etl/",
"fileName": "Person.csv.gz"
},
"begin": [
{ "let": { "name": "$filePath", "value": "$fileDirectory.append(
$fileName )"} },
{ "let": { "name": "$className", "value": "$fileName.substring( 0,
$fileName.indexOf(".") )"} }
],
"source" : {
"file": { "path": "$filePath", "lock" : false }
},
"extractor" : {
"row": {}
},
"transformers" : [
{ "csv": { "separator": ",", "nullValue": "NULL", "skipFrom": 2, "skipTo"
: 2 } },
{ "vertex": { "class": "$className"} }
],
"loader" : {
"orientdb": {
"dbURL": "plocal:C:\Users\kwoxer\Desktop\DB - orientdb\databases\Test"
,
"dbUser": "root",
"dbPassword": "root",
"dbAutoCreate": true,
"tx": false,
"batchCommit": 1000,
"dbType": "graph",
"indexes": [{"class":"V", "fields":["id:string"], "type":"UNIQUE" }]
}
}
}
But when I run this I get:
C:\Users\kwoxer\Desktop\DB - orientdb\bin>oetl.bat backup\csv-etl\person.
json
OrientDB etl v.1.7.8 (build @BUILD@) www.orientechnologies.com
BEGIN ETL PROCESSOR
2014-08-26 17:08:26:501 WARN Transformer [com.orientechnologies.orient.etl.
trans
former.OCSVTransformer@107598d7] returned null, skip rest of pipeline
execution
[OETLPipeline]END ETL PROCESSOR
+ extracted 1 rows (0 rows/sec) - 1 rows -> loaded 0 vertices (0 vertices/
sec) T
otal time: 35ms [0 warnings, 0 errors]
Some Transformer Warning, well due there is no real example about a normal
CSV I cannot do anything. I also don't understand why the "skip"'s are
mandatory. Why should I skip line in a CSV? Is this just for DBPedia where
comments might happen?
Could some please add more examples. I just want to import a CSV with ETL
nothing else. Thanks.
BTW: I also tried the unzipped version:
"fileName": "Person.csv"
Same result...:
C:\Users\kwoxer\Desktop\DB - orientdb\bin>oetl.bat backup\csv-etl\person.
json
OrientDB etl v.1.7.8 (build @BUILD@) www.orientechnologies.com
BEGIN ETL PROCESSOR
2014-08-26 17:18:21:189 WARN Transformer [com.orientechnologies.orient.etl.
trans
former.OCSVTransformer@1747c] returned null, skip rest of pipeline
execution [OE
TLPipeline]END ETL PROCESSOR
+ extracted 1 rows (0 rows/sec) - 1 rows -> loaded 0 vertices (0 vertices/
sec) T
otal time: 25ms [0 warnings, 0 errors]
--
---
You received this message because you are subscribed to the Google Groups
"OrientDB" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
