Hi Shivanandan, the problem here is that ETL is creating an in-memory database, and every in-memory db is completely deleted when the VM goes down (in this case when the ETL terminates). If you want a persistent db you have to use PLocal
Regards Luigi 2015-02-19 10:45 GMT+01:00 Shivanandan Gupta <[email protected]>: > Hi Luigi, > > I used below given json for ETL the data load happened but I am not able > to see any vertex in the class. > > > { > "source": { "file": { "path": "C:\odb\s_asset.csv" } }, > "extractor": { "row": {} }, > "transformers": [ > { "csv": {} }, > { "vertex": { "class": "S_ASSET" } } > ], > "loader": { > "orientdb": { > "dbURL": "memory:/temp/databases/eigenin", > "dbUser": "root", > "dbPassword": "root", > "dbAutoCreate": true, > "tx": false, > "batchCommit": 10000, > "dbType": "graph" > } > } > } > > > Thanks, > Shivanandan Gupta > > > > On Thursday, 19 February 2015 14:50:02 UTC+5:30, Shivanandan Gupta wrote: >> >> Thanks Luigi I changed it and it worked. the statics is given below: >> >> *RecordsLoaded* >> >> *AttributesPerRecords* >> >> *DataVolume* >> >> *TimeTaken (MS)* >> >> *TimeTaken(Seconds)* >> >> 1,000,320 >> >> 75 >> >> 250 MB >> >> 50435ms >> >> 50 Sec >> >> Thanks >> Shivanandan Gupta >> >> On Thursday, 19 February 2015 14:40:04 UTC+5:30, Luigi Dell'Aquila wrote: >>> >>> Hi Shivanandan, >>> >>> you can just replace this >>> >>> "loader": { >>> "orientdb": { >>> "dbURL": "remote:localhost/databases/indb", >>> "dbUser": "root", >>> "dbPassword": "root", >>> "dbAutoCreate": true, >>> "tx": false, >>> "batchCommit": 10000, >>> "dbType": "graph" >>> } >>> } >>> >>> with this >>> >>> "loader": { >>> "orientdb": { >>> "dbURL": "plocal:/your/absolute/path/to/OrientDB/databases/indb", >>> "dbUser": "admin", >>> "dbPassword": "admin", >>> "dbAutoCreate": true, >>> "tx": false, >>> "batchCommit": 10000, >>> "dbType": "graph" >>> } >>> } >>> >>> And launch the ETL again. If the database does not exist, the ETL will >>> create it for you. >>> Just ensure that there are no other instances of OrientDB running on >>> that database while ETL is running, otherwise you will have an IOException >>> >>> Regards >>> >>> Luigi >>> >>> >>> 2015-02-19 10:02 GMT+01:00 Shivanandan Gupta <[email protected]>: >>> >>>> Hi Luigi, >>>> >>>> Thanks for your response ,I am loading the csv file from the same >>>> server where orientdb is installed, I tried doing a plocal (create a DB as >>>> plocal ? ) can you please help me how to go with it? I am a newbei to >>>> orientdb. >>>> >>>> We are trying to have a data model as DWH like facts and dimensions in >>>> orientdb. >>>> >>>> Thanks, >>>> Shivanandan Gupta >>>> >>>> On Thursday, 19 February 2015 13:26:58 UTC+5:30, Luigi Dell'Aquila >>>> wrote: >>>>> >>>>> Hi Shivanandan, >>>>> >>>>> the easy way to go faster is using plocal instead of remote, but I >>>>> don't know if in your case it's possible (other instances OrientDB have to >>>>> be shut down for the time ETL works...) >>>>> >>>>> Luigi >>>>> >>>>> >>>>> 2015-02-19 7:19 GMT+01:00 Shivanandan Gupta <[email protected]>: >>>>> >>>>>> Hi All, >>>>>> >>>>>> I tried loading data from csb file to in-memory graphdatabase class >>>>>> and the statistics I am getting is given below. I used json ETL file to >>>>>> load data from csv. If I anyone has a better way to load the same amount >>>>>> of >>>>>> data quickly them please suggest the way. >>>>>> >>>>>> We are planning of implementing a near to realtime DWH on orientdb. >>>>>> >>>>>> >>>>>> *RecordsLoaded* >>>>>> >>>>>> *AttributesPerRecords* >>>>>> >>>>>> *DataVolume(csv file)* >>>>>> >>>>>> *TimeTaken (MS)* >>>>>> >>>>>> *TimeTaken(Minutes)* >>>>>> >>>>>> 1,000,320 >>>>>> >>>>>> 75 >>>>>> >>>>>> 250 MB >>>>>> >>>>>> 261365 >>>>>> >>>>>> 4.36 >>>>>> >>>>>> >>>>>> >>>>>> { >>>>>> "source": { "file": { "path": "F:\Work\MDATA-ETL\s_asset.csv" } }, >>>>>> "extractor": { "row": {} }, >>>>>> "transformers": [ >>>>>> { "csv": {} }, >>>>>> { "vertex": { "class": "S_ASSET" } } >>>>>> ], >>>>>> "loader": { >>>>>> "orientdb": { >>>>>> "dbURL": "remote:localhost/databases/indb", >>>>>> "dbUser": "root", >>>>>> "dbPassword": "root", >>>>>> "dbAutoCreate": true, >>>>>> "tx": false, >>>>>> "batchCommit": 10000, >>>>>> "dbType": "graph" >>>>>> } >>>>>> } >>>>>> } >>>>>> >>>>>> >>>>>> Thanks in advance. >>>>>> >>>>>> Regards, >>>>>> Shivanandan Gupta >>>>>> >>>>>> -- >>>>>> >>>>>> --- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "OrientDB" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to [email protected]. >>>>>> For more options, visit https://groups.google.com/d/optout. >>>>>> >>>>> >>>>> -- >>>> >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "OrientDB" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- > > --- > You received this message because you are subscribed to the Google Groups > "OrientDB" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- --- You received this message because you are subscribed to the Google Groups "OrientDB" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
