Hi Roland,
Glad to here log_enable(3) enabled the large graph to be deleted ...
Best Regards
Hugh Williams
Professional Services
OpenLink Software, Inc. // http://www.openlinksw.com/
Weblog -- http://www.openlinksw.com/blogs/
LinkedIn -- http://www.linkedin.com/company/openlink-software/
Twitter -- http://twitter.com/OpenLink
Google+ -- http://plus.google.com/100570109519069333827/
Facebook -- http://www.facebook.com/OpenLinkSoftware
Universal Data Access, Integration, and Management Technology Providers
On 7 Feb 2014, at 20:10, Roland Cornelissen <metamatter...@gmail.com> wrote:
> That did the trick: log_enable(3)
>
> Thanks!
>
>
> On 07-02-14 18:00, Roland Cornelissen wrote:
>> Hi Hugh,
>>
>> I didn't turn of transactions by log_enable(3). I have a new try running
>> right now. I'll let you know if that made difference.
>>
>> The VOS7 version used is:
>> Virtuoso Open Source Edition (Column Store) (multi threaded)
>> Version 7.0.0.3203-pthreads as of Sep 16 2013
>> Compiled for Linux (x86_64-unknown-linux-gnu)
>> Copyright (C) 1998-2013 OpenLink Software
>>
>> Thanks,
>> Roland
>>
>> On 07-02-14 18:00, Hugh Williams wrote:
>>> Hi Roland,
>>>
>>> Did run have the log_enable(3) option to turn off transactions when
>>> performing such large operations on graphs to reduce the memory required,
>>> as detailed in the document at:
>>>
>>>
>>> http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VirtTipsAndTricksGuideDeleteLargeGraphs
>>>
>>> Having said that the server still should not have crashed and if anything
>>> hang when the system runs out of memory or possibly warn that the operation
>>> cannot be completed ideally ...
>>>
>>> What version are you running (virtuoso-t -?) ?
>>>
>>> Best Regards
>>> Hugh Williams
>>> Professional Services
>>> OpenLink Software, Inc. // http://www.openlinksw.com/
>>> Weblog -- http://www.openlinksw.com/blogs/
>>> LinkedIn -- http://www.linkedin.com/company/openlink-software/
>>> Twitter -- http://twitter.com/OpenLink
>>> Google+ -- http://plus.google.com/100570109519069333827/
>>> Facebook -- http://www.facebook.com/OpenLinkSoftware
>>> Universal Data Access, Integration, and Management Technology Providers
>>>
>>> On 7 Feb 2014, at 12:54, Roland Cornelissen <metamatter...@gmail.com> wrote:
>>>
>>>> Hi,
>>>> I try to delete a larger graph (300M triples) on my VOS7 store
>>>> (07.00.3203-pthreads for Linux, Database version 3126) but VOS crashes
>>>> on a memory problem.
>>>> I down scaled memory assignment in virtuoso.ini to 12GB (the box has 16
>>>> GB, previously 14 GB was assigned) in virtuoso.ini
>>>> ; 12 GB
>>>> NumberOfBuffers = 1020000
>>>> MaxDirtyBuffers = 750000
>>>>
>>>>
>>>> But it keeps crashing (see error below).
>>>> What is my problem here? Does anyone have a suggestion on how to proceed?
>>>>
>>>> Thanks,
>>>> Roland
>>>>
>>>>
>>>> error:
>>>> SQL> sparql clear graph <http://data.metamatter.nl/test/>;
>>>> 13:40:37 mmap failed with 12
>>>> 13:40:42 mmap failed with 12
>>>> 13:40:42 mmap failed with 12
>>>> 13:40:42 mmap failed with 12
>>>> 13:40:42 mmap failed with 12
>>>> 13:40:42 virtuoso-t() [0x8ff2b8]
>>>> 13:40:42 virtuoso-t() [0x8ff326]
>>>> 13:40:42 virtuoso-t() [0x8fd844]
>>>> 13:40:42 virtuoso-t() [0x8fd8e0]
>>>> 13:40:42 virtuoso-t() [0x8ed7c5]
>>>> 13:40:42 virtuoso-t() [0x49a971]
>>>> 13:40:42 virtuoso-t() [0x49ab86]
>>>> 13:40:42 virtuoso-t() [0x49adb8]
>>>> 13:40:42 virtuoso-t() [0x4a58f7]
>>>> 13:40:42 virtuoso-t() [0x4a66c8]
>>>> 13:40:42 virtuoso-t() [0x546f4c]
>>>> 13:40:42 virtuoso-t() [0x54a670]
>>>> 13:40:42 virtuoso-t() [0x67219e]
>>>> 13:40:42 virtuoso-t() [0x63d5d4]
>>>> 13:40:42 virtuoso-t() [0x63dbbc]
>>>> 13:40:42 virtuoso-t(delete_node_run+0x102) [0x606e42]
>>>> 13:40:42 virtuoso-t(delete_node_input+0xae) [0x607a7e]
>>>> 13:40:42 virtuoso-t() [0x604018]
>>>> 13:40:42 virtuoso-t() [0x604473]
>>>> 13:40:42 virtuoso-t(table_source_input+0x1ca) [0x60ebca]
>>>> 13:40:42 virtuoso-t() [0x604018]
>>>> 13:40:42 virtuoso-t() [0x604333]
>>>> 13:40:42 virtuoso-t() [0x63c637]
>>>> 13:40:42 virtuoso-t() [0x604018]
>>>> 13:40:42 virtuoso-t() [0x60db6a]
>>>> 13:40:42 virtuoso-t(bif_exec+0x6f1) [0x57ed31]
>>>> 13:40:42 virtuoso-t() [0x5d6128]
>>>> 13:40:42 virtuoso-t() [0x5de303]
>>>> 13:40:42 virtuoso-t() [0x60412a]
>>>> 13:40:42 virtuoso-t() [0x60c671]
>>>> 13:40:42 virtuoso-t() [0x5d65f9]
>>>> 13:40:42 virtuoso-t() [0x5d7842]
>>>> 13:40:42 virtuoso-t() [0x5db9cc]
>>>> 13:40:42 virtuoso-t() [0x604001]
>>>> 13:40:42 virtuoso-t() [0x604333]
>>>> 13:40:42 virtuoso-t() [0x63c637]
>>>> 13:40:42 virtuoso-t() [0x604018]
>>>> 13:40:42 virtuoso-t() [0x5d860b]
>>>> 13:40:42 virtuoso-t() [0x5d86f8]
>>>> 13:40:42 virtuoso-t() [0x5de684]
>>>> 13:40:42 virtuoso-t() [0x60412a]
>>>> 13:40:42 virtuoso-t() [0x60db6a]
>>>> 13:40:42 virtuoso-t() [0x6167e4]
>>>> 13:40:42 virtuoso-t(sf_sql_execute_w+0x7f) [0x616e5f]
>>>> 13:40:42 virtuoso-t() [0x903548]
>>>> 13:40:42 virtuoso-t() [0x90736f]
>>>> 13:40:42 /lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a) [0x7fe352688e9a]
>>>> 13:40:42 /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7fe351eb53fd]
>>>> 13:40:42 GPF: Dkpool.c:1579 could not allocate memory with mmap
>>>> GPF: Dkpool.c:1579 could not allocate memory with mmap
>>>>
>>>> *** Error 08S01: [Virtuoso Driver]CL065: Lost connection to server
>>>> at line 3 of Top-Level:
>>>> sparql clear graph <http://data.metamatter.nl/ggc/>
>>>> [1]+ Segmentation fault (core dumped) virtuoso-t -f
>>>>
>>>>
>>>> ------------------------------------------------------------------------------
>>>> Managing the Performance of Cloud-Based Applications
>>>> Take advantage of what the Cloud has to offer - Avoid Common Pitfalls.
>>>> Read the Whitepaper.
>>>> http://pubads.g.doubleclick.net/gampad/clk?id=121051231&iu=/4140/ostg.clktrk
>>>> _______________________________________________
>>>> Virtuoso-users mailing list
>>>> Virtuoso-users@lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/virtuoso-users
>>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Managing the Performance of Cloud-Based Applications
>> Take advantage of what the Cloud has to offer - Avoid Common Pitfalls.
>> Read the Whitepaper.
>> http://pubads.g.doubleclick.net/gampad/clk?id=121051231&iu=/4140/ostg.clktrk
>>
>>
>> _______________________________________________
>> Virtuoso-users mailing list
>> Virtuoso-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/virtuoso-users
>
------------------------------------------------------------------------------
Managing the Performance of Cloud-Based Applications
Take advantage of what the Cloud has to offer - Avoid Common Pitfalls.
Read the Whitepaper.
http://pubads.g.doubleclick.net/gampad/clk?id=121051231&iu=/4140/ostg.clktrk
_______________________________________________
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users
