Hi Luigi,
I used below given json for ETL the data load happened but I am not able to
see any vertex in the class.
{
"source": { "file": { "path": "C:\odb\s_asset.csv" } },
"extractor": { "row": {} },
"transformers": [
{ "csv": {} },
{ "vertex": { "class": "S_ASSET" } }
],
"loader": {
"orientdb": {
"dbURL": "memory:/temp/databases/eigenin",
"dbUser": "root",
"dbPassword": "root",
"dbAutoCreate": true,
"tx": false,
"batchCommit": 10000,
"dbType": "graph"
}
}
}
Thanks,
Shivanandan Gupta
On Thursday, 19 February 2015 14:50:02 UTC+5:30, Shivanandan Gupta wrote:
>
> Thanks Luigi I changed it and it worked. the statics is given below:
>
> *RecordsLoaded*
>
> *AttributesPerRecords*
>
> *DataVolume*
>
> *TimeTaken (MS)*
>
> *TimeTaken(Seconds)*
>
> 1,000,320
>
> 75
>
> 250 MB
>
> 50435ms
>
> 50 Sec
>
> Thanks
> Shivanandan Gupta
>
> On Thursday, 19 February 2015 14:40:04 UTC+5:30, Luigi Dell'Aquila wrote:
>>
>> Hi Shivanandan,
>>
>> you can just replace this
>>
>> "loader": {
>> "orientdb": {
>> "dbURL": "remote:localhost/databases/indb",
>> "dbUser": "root",
>> "dbPassword": "root",
>> "dbAutoCreate": true,
>> "tx": false,
>> "batchCommit": 10000,
>> "dbType": "graph"
>> }
>> }
>>
>> with this
>>
>> "loader": {
>> "orientdb": {
>> "dbURL": "plocal:/your/absolute/path/to/OrientDB/databases/indb",
>> "dbUser": "admin",
>> "dbPassword": "admin",
>> "dbAutoCreate": true,
>> "tx": false,
>> "batchCommit": 10000,
>> "dbType": "graph"
>> }
>> }
>>
>> And launch the ETL again. If the database does not exist, the ETL will
>> create it for you.
>> Just ensure that there are no other instances of OrientDB running on that
>> database while ETL is running, otherwise you will have an IOException
>>
>> Regards
>>
>> Luigi
>>
>>
>> 2015-02-19 10:02 GMT+01:00 Shivanandan Gupta <[email protected]>:
>>
>>> Hi Luigi,
>>>
>>> Thanks for your response ,I am loading the csv file from the same server
>>> where orientdb is installed, I tried doing a plocal (create a DB as plocal
>>> ? ) can you please help me how to go with it? I am a newbei to orientdb.
>>>
>>> We are trying to have a data model as DWH like facts and dimensions in
>>> orientdb.
>>>
>>> Thanks,
>>> Shivanandan Gupta
>>>
>>> On Thursday, 19 February 2015 13:26:58 UTC+5:30, Luigi Dell'Aquila wrote:
>>>>
>>>> Hi Shivanandan,
>>>>
>>>> the easy way to go faster is using plocal instead of remote, but I
>>>> don't know if in your case it's possible (other instances OrientDB have to
>>>> be shut down for the time ETL works...)
>>>>
>>>> Luigi
>>>>
>>>>
>>>> 2015-02-19 7:19 GMT+01:00 Shivanandan Gupta <[email protected]>:
>>>>
>>>>> Hi All,
>>>>>
>>>>> I tried loading data from csb file to in-memory graphdatabase class
>>>>> and the statistics I am getting is given below. I used json ETL file to
>>>>> load data from csv. If I anyone has a better way to load the same amount
>>>>> of
>>>>> data quickly them please suggest the way.
>>>>>
>>>>> We are planning of implementing a near to realtime DWH on orientdb.
>>>>>
>>>>>
>>>>> *RecordsLoaded*
>>>>>
>>>>> *AttributesPerRecords*
>>>>>
>>>>> *DataVolume(csv file)*
>>>>>
>>>>> *TimeTaken (MS)*
>>>>>
>>>>> *TimeTaken(Minutes)*
>>>>>
>>>>> 1,000,320
>>>>>
>>>>> 75
>>>>>
>>>>> 250 MB
>>>>>
>>>>> 261365
>>>>>
>>>>> 4.36
>>>>>
>>>>>
>>>>>
>>>>> {
>>>>> "source": { "file": { "path": "F:\Work\MDATA-ETL\s_asset.csv" } },
>>>>> "extractor": { "row": {} },
>>>>> "transformers": [
>>>>> { "csv": {} },
>>>>> { "vertex": { "class": "S_ASSET" } }
>>>>> ],
>>>>> "loader": {
>>>>> "orientdb": {
>>>>> "dbURL": "remote:localhost/databases/indb",
>>>>> "dbUser": "root",
>>>>> "dbPassword": "root",
>>>>> "dbAutoCreate": true,
>>>>> "tx": false,
>>>>> "batchCommit": 10000,
>>>>> "dbType": "graph"
>>>>> }
>>>>> }
>>>>> }
>>>>>
>>>>>
>>>>> Thanks in advance.
>>>>>
>>>>> Regards,
>>>>> Shivanandan Gupta
>>>>>
>>>>> --
>>>>>
>>>>> ---
>>>>> You received this message because you are subscribed to the Google
>>>>> Groups "OrientDB" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>>> an email to [email protected].
>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>
>>>>
>>>> --
>>>
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "OrientDB" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to [email protected].
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>>
--
---
You received this message because you are subscribed to the Google Groups
"OrientDB" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
