Hi,
I did some research, how to import data into orientDB very quickly and I
found these improvements:
"parallel": true in config section - it depends on your hardware, but
try it ;)
"dbAutoCreateProperties": true, - in loader section - your database
will be smaller and import quicker
"wal": false, - I tried to disable wal, bud without success
with these settings I'm able to import 20 000 vertexes per second.
If I imported edges, the import speed dropped to cca 2000 edges per second.
If anyone knows, how to import data quicker, please, let me know.
Thanks
Marek
Dne úterý 16. června 2015 15:02:12 UTC+2 [email protected] napsal(a):
>
> All,
>
> Tried to load data using using ETL Module and I am able to load only 1,378
> records/sec. To load 4M records it took 1hour 10 mts which a lot.
> is there any way to improve this loading process. my Json config file is
> using the below configuration.
>
> Highly appreciate your help on this.
>
>
> {
> "config": {
> "log": "debug"
> },
> "extractor" : {
> "jdbc": { "driver": "oracle.jdbc.driver.OracleDriver",
> "url": "jdbc:oracle:thin:@hostname:1534/dbname",
> "userName": "oracle",
> "userPassword": "oracle",
> "query": "select * from LINE_TMP" }
> },
> "transformers" : [
> { "vertex": { "class":"LINE_TMP"} }
> ],
> "loader" : {
> "orientdb": {
> "dbURL":
> "plocal:/nosql/orientdb/orientdb-enterprise-2.1-rc1/databases/orientdbcrm",
> "dbUser": "admin",
> "dbPassword": "admin",
> "dbAutoCreate": False,
> "tx": false,
> "batchCommit": 10000,
> dbType:"graph"
> }
> }
> }
>
>
>
> On Sunday, June 14, 2015 at 3:23:09 AM UTC-4, [email protected] wrote:
>
>> Hi,
>>
>> I am a new bee to orientdb and working on a test case to compare
>> performance of some of the aggregate sql queries.
>>
>> Can you please let me know what is the best and fast way to load 100M
>> records from oracle database to orientdb cluster.
>>
>> also how tracing is enabled in orient db?
>>
>>
--
---
You received this message because you are subscribed to the Google Groups
"OrientDB" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
