Hi,
We had a fatal error on our sedna database. We were able to bring
everything back but I am just wondering what could have caused it.
So I looked at the event.log and found the following lines (more lines on
the attached document). Would you have any ideas or suggestions we could
do to protect further problems?
Note that I forgot to do the "post install" steps for assigning more
semaphores which could explain our fatal error but I am not sure (this is a
new server). After the fatal error, and once we were back to normal, I did
add more semaphore as suggested by http://sedna.org/install.html#post_linux.
Here is the event.log snippet:
LOG 11/01/2013 12:04:30 (TRN student-awards pid=13365 sid=21 trid=-1)
[tr_common_funcs.cpp:on_transaction_end:414]: Transaction has been COMMITED
LOG 11/01/2013 12:04:30 (TRN student-awards pid=13365 sid=21 trid=21)
[tr_functions.cpp:on_user_statement_begin:102]: User query:
--- let $app :=
index-scan('app.award-competition-ref.ref','1357572144113','EQ')let
$dashboard := index-scan('dashboard.app-ref.ref',$app/@id,'EQ')return
$dashboard
*SYS 11/01/2013 12:05:41 (SM student-awards pid=26638)
[usem.c:USemaphoreCreate:57]: semget (code = 28): No space left on device*
*FATAL 11/01/2013 12:05:41 (SM student-awards pid=26638)
[bm_functions.cpp:bm_register_session:301]: Cannot create
SM_TO_VMM_CALLBACK_SEM2_BASE_STR*
INFO 11/01/2013 12:46:16 (GOV pid=13491)
[gov_functions.cpp:log_out_system_information:87]: SEDNA version is 3.5.161
(64bit Release)
INFO 11/01/2013 12:46:16 (GOV pid=13491)
[gov_functions.cpp:log_out_system_information:95]: System: Linux
2.6.32-279.2.1.el6.x86_64 x86_64
LOG 11/01/2013 12:46:16 (GOV pid=13491) [gov.cpp:main:239]: Process ping
server is ready
LOG 11/01/2013 12:46:16 (GOV pid=13491)
[listener.cpp:client_listener:72]: GOVERNOR is ready
--
Data Architect / Development Manager
Information Systems
Office of the Registrar
University of Alberta
780.492.3874
LOG 11/01/2013 12:03:32 (TRN student-awards pid=13354 sid=24 trid=24)
[tr_functions.cpp:on_user_statement_begin:102]: User query:
--- let $award :=
collection('award-competition')/award-competition[student-payload-ref/@ref='1357572144114']let
$app := index-scan('app.award-competition-ref.ref',$award/@id,'EQ')let
$dashboard := index-scan('dashboard.app-ref.ref',$app/@id,'EQ')return $dashboard
LOG 11/01/2013 12:04:22 (TRN student-awards pid=13359 sid=23 trid=-1)
[tr.cpp:TRmain:184]: Session is ready
LOG 11/01/2013 12:04:22 (TRN student-awards pid=13359 sid=23 trid=-1)
[tr_common_funcs.cpp:on_transaction_end:414]: Transaction has been COMMITED
LOG 11/01/2013 12:04:22 (TRN student-awards pid=13361 sid=22 trid=-1)
[tr.cpp:TRmain:184]: Session is ready
LOG 11/01/2013 12:04:22 (TRN student-awards pid=13359 sid=23 trid=23)
[tr_functions.cpp:on_user_statement_begin:102]: User query:
--- let $app :=
index-scan('app.award-competition-ref.ref','1357572144113','EQ')let $dashboard
:= index-scan('dashboard.app-ref.ref',$app/@id,'EQ')return $dashboard
LOG 11/01/2013 12:04:22 (TRN student-awards pid=13361 sid=22 trid=-1)
[tr_common_funcs.cpp:on_transaction_end:414]: Transaction has been COMMITED
LOG 11/01/2013 12:04:22 (TRN student-awards pid=13361 sid=22 trid=22)
[tr_functions.cpp:on_user_statement_begin:102]: User query:
--- let $award :=
collection('award-competition')/award-competition[student-payload-ref/@ref='1357572144114']let
$app := index-scan('app.award-competition-ref.ref',$award/@id,'EQ')let
$dashboard := index-scan('dashboard.app-ref.ref',$app/@id,'EQ')return $dashboard
LOG 11/01/2013 12:04:30 (TRN student-awards pid=13365 sid=21 trid=-1)
[tr.cpp:TRmain:184]: Session is ready
LOG 11/01/2013 12:04:30 (TRN student-awards pid=13365 sid=21 trid=-1)
[tr_common_funcs.cpp:on_transaction_end:414]: Transaction has been COMMITED
LOG 11/01/2013 12:04:30 (TRN student-awards pid=13365 sid=21 trid=21)
[tr_functions.cpp:on_user_statement_begin:102]: User query:
--- let $app :=
index-scan('app.award-competition-ref.ref','1357572144113','EQ')let $dashboard
:= index-scan('dashboard.app-ref.ref',$app/@id,'EQ')return $dashboard
SYS 11/01/2013 12:05:41 (SM student-awards pid=26638)
[usem.c:USemaphoreCreate:57]: semget (code = 28): No space left on device
FATAL 11/01/2013 12:05:41 (SM student-awards pid=26638)
[bm_functions.cpp:bm_register_session:301]: Cannot create
SM_TO_VMM_CALLBACK_SEM2_BASE_STR
INFO 11/01/2013 12:46:16 (GOV pid=13491)
[gov_functions.cpp:log_out_system_information:87]: SEDNA version is 3.5.161
(64bit Release)
INFO 11/01/2013 12:46:16 (GOV pid=13491)
[gov_functions.cpp:log_out_system_information:95]: System: Linux
2.6.32-279.2.1.el6.x86_64 x86_64
LOG 11/01/2013 12:46:16 (GOV pid=13491) [gov.cpp:main:239]: Process ping
server is ready
LOG 11/01/2013 12:46:16 (GOV pid=13491) [listener.cpp:client_listener:72]:
GOVERNOR is ready
LOG 11/01/2013 12:46:22 (SM campus-visit pid=13495) [sm.cpp:main:493]: Event
log is ready
LOG 11/01/2013 12:46:22 (SM campus-visit pid=13495) [sm.cpp:main:506]: Ping
client has been started
SYS 11/01/2013 12:46:22 (SM campus-visit pid=13495)
[uprocess.c:uGetEnvironmentVariable:101]: getenv (code = 0): Success
SYS 11/01/2013 12:46:22 (SM campus-visit pid=13495)
[uprocess.c:uGetEnvironmentVariable:101]: getenv (code = 0): Success
LOG 11/01/2013 12:46:22 (SM campus-visit pid=13495)
[sm.cpp:recover_database_by_physical_and_logical_log:753]: Event log in
recovery procedure is ready
LOG 11/01/2013 12:46:22 (SM campus-visit pid=13495)
[sm.cpp:recover_database_by_physical_and_logical_log:763]: Starting database
recovery or hot-backup restoration...
LOG 11/01/2013 12:46:22 (SM campus-visit pid=13495)
[sm.cpp:recover_database_by_physical_and_logical_log:803]: Buffer manager is
started
LOG 11/01/2013 12:46:22 (SM campus-visit pid=13495)
[sm.cpp:recover_database_by_physical_and_logical_log:810]: Database has been
recovered by physical log successfully
LOG 11/01/2013 12:46:22 (SM campus-visit pid=13495)
[blk_mngmt.cpp:extend_tmp_file:629]: Temp file has been extended, size: 6400000
LOG 11/01/2013 12:46:22 (SM campus-visit pid=13495)
[sm.cpp:recover_database_by_physical_and_logical_log:822]: Checkpoints are
disabled
LOG 11/01/2013 12:46:22 (SM campus-visit pid=13495)
[sm.cpp:recover_database_by_physical_and_logical_log:845]: Wu is initialized
LOG 11/01/2013 12:46:22 (RCV campus-visit pid=13499) [tr.cpp:TRmain:184]:
Session is ready
LOG 11/01/2013 12:46:22 (RCV campus-visit pid=13499)
[tr_common_funcs.cpp:on_transaction_end:414]: Transaction has been COMMITED
INFO 11/01/2013 12:46:22 (SM campus-visit pid=13495)
[bm_core.cpp:bm_log_out_io_statistics:537]: IO block reads:120, writes:0
LOG 11/01/2013 12:46:22 (RCV campus-visit pid=13499) [tr.cpp:TRmain:454]:
recovery process by logical log finished
LOG 11/01/2013 12:46:23 (SM campus-visit pid=13495)
[sm.cpp:recover_database_by_physical_and_logical_log:851]: Database has been
recovered by logical log successfully
LOG 11/01/2013 12:46:23 (SM campus-visit pid=13495)
[sm.cpp:recover_database_by_physical_and_logical_log:856]: Checkpoints are
enabled
LOG 11/01/2013 12:46:23 (SM campus-visit pid=13495)
[trmgr.cpp:checkpoint_thread:149]: Starting checkpoint procedure
SYS 11/01/2013 12:46:24 (SM campus-visit pid=13495)
[uhdd.c:uIsFileExist:376]: stat64 (code = 2): No such file or directory
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13495)
[trmgr.cpp:checkpoint_thread:198]: Checkpoint procedure is finished
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13495)
[sm.cpp:recover_database_by_physical_and_logical_log:866]: Shutdown checkpoint
thread done
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13495)
[sm.cpp:recover_database_by_physical_and_logical_log:869]: Wu is released
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13495)
[sm.cpp:recover_database_by_physical_and_logical_log:873]: Buffer manager is
stopped
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13495)
[sm.cpp:recover_database_by_physical_and_logical_log:889]: Recovery procedure
has been finished successfully
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13502) [sm.cpp:main:493]: Event
log is ready
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13502) [sm.cpp:main:506]: Ping
client has been started
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13502) [sm.cpp:main:597]:
Logical log has been started
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13502) [sm.cpp:main:604]:
Temporary files have been deleted
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13502) [sm.cpp:main:613]: Buffer
manager started
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13502) [sm.cpp:main:645]: Wu is
initialized
SYS 11/01/2013 12:46:24 (SM campus-visit pid=13502)
[uprocess.c:uGetEnvironmentVariable:101]: getenv (code = 536870952): Failed to
obtain error message
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13502) [sm.cpp:main:671]: SM has
been started
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13502) [sm.cpp:main:645]: Wu is
initialized
SYS 11/01/2013 12:46:24 (SM campus-visit pid=13502)
[uprocess.c:uGetEnvironmentVariable:101]: getenv (code = 536870952): Failed to
obtain error message
LOG 11/01/2013 12:46:24 (SM campus-visit pid=13502) [sm.cpp:main:671]: SM has
been started
LOG 11/01/2013 12:46:35 (TRN campus-visit pid=13506 sid=49 trid=-1)
[tr.cpp:TRmain:184]: Session is ready
LOG 11/01/2013 12:46:35 (TRN campus-visit pid=13506 sid=49 trid=-1)
[tr_common_funcs.cpp:on_transaction_end:414]: Transaction has been COMMITED
LOG 11/01/2013 12:46:35 (TRN campus-visit pid=13506 sid=49 trid=49)
[tr_functions.cpp:on_user_statement_begin:102]: User query:
---
exists(doc('$documents')/documents/collection[@name='registrations']/document[@name='1357583704915'])
LOG 11/01/2013 12:46:35 (TRN campus-visit pid=13506 sid=49 trid=49)
[tr_functions.cpp:on_user_statement_begin:102]: User query:
--- LOAD STDIN "1357583704915" "registrations"
LOG 11/01/2013 12:46:35 (TRN campus-visit pid=13506 sid=49 trid=49)
[tr_functions.cpp:on_user_statement_begin:102]: User query:
---
exists(doc('$documents')/documents/collection[@name='participants']/document[@name='1357583704916'])
LOG 11/01/2013 12:46:35 (TRN campus-visit pid=13506 sid=49 trid=49)
[tr_functions.cpp:on_user_statement_begin:102]: User query:
------------------------------------------------------------------------------
Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and
much more. Get web development skills now with LearnDevNow -
350+ hours of step-by-step video tutorials by Microsoft MVPs and experts.
SALE $99.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122812
_______________________________________________
Sedna-discussion mailing list
Sedna-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/sedna-discussion
