[tickets] [opensaf:tickets] #1001 IMM: PBE fails in sqlite on commit of CCB object create
- **status**: review -- fixed - **Comment**: opensaf-4.5.x: changeset: 5639:6f91a7303ffa branch: opensaf-4.5.x parent: 5637:35734330f2ec user:Zoran Milinkovic zoran.milinko...@ericsson.com date:Thu Aug 21 16:14:28 2014 +0200 summary: immtools: fix memory release of object names when CCB data is deleted [#1001] - default(4.6): changeset: 5640:519dded451af tag: tip parent: 5638:5542e0886de4 user:Zoran Milinkovic zoran.milinko...@ericsson.com date:Thu Aug 21 16:14:28 2014 +0200 summary: immtools: fix memory release of object names when CCB data is deleted [#1001] --- ** [tickets:#1001] IMM: PBE fails in sqlite on commit of CCB object create** **Status:** fixed **Milestone:** 4.5.0 **Created:** Thu Aug 21, 2014 05:38 AM UTC by Sirisha Alla **Last Updated:** Thu Aug 21, 2014 02:43 PM UTC **Owner:** Zoran Milinkovic This issue is seen on SLES 64bit 4 node VMs. The changeset of OpenSAF used is 5608 along with patches for #938,#994 and #997. IMM applications are in progress when the issue is observed. During one of the CCB commit operations following is observed on the active controller: Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmpbed: ER SQL statement('INSERT INTO objects (obj_id, class_id, dn, last_ccb) VALUES (?, ?, ?, ?)') failed with error code: 19 Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 46 will be aborted Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 46 ABORTED (exowner) Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 2e/46 Once this error is seen further CCB commits(ccbApply()) fail with FAILED_OPERATION. Cluster becomes unusable for CCB commit operations. Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmpbed: ER Failed to bind obj_id with error code: 21 Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 47 will be aborted Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 47 ABORTED (adminOwner) Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 2f/47 Aug 21 10:15:52 SLES-64BIT-SLOT1 osafimmpbed: IN Create of class noDanglingPreconfigurationClass committing with ccbId:10089 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Create of class noDanglingPreconfigurationClass is PERSISTENT. Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: ER Failed to bind obj_id with error code: 21 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 92 will be aborted Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 92 ABORTED (noDanglingPreconfigurationClass) Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 5c/92 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: IN Delete of class noDanglingPreconfigurationClass committing with ccbId:1008a Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Delete of class noDanglingPreconfigurationClass is PERSISTENT. Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: IN Create of class immsv_N0_Dangling_test01 committing with ccbId:1008b Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Create of class immsv_N0_Dangling_test01 is PERSISTENT. Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: ER Failed to bind obj_id with error code: 21 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 98 will be aborted Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 98 ABORTED (immsv_N0_Dangling_test01) Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 62/98 This issue is reproducible. Traces are attached. IMMD traces are available and will be able to share them on request. I am not sure whether this is consequence after #1000 is observed. I will try to see if this can be reproduced independantly. --- Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is subscribed to https://sourceforge.net/p/opensaf/tickets/ To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/opensaf/admin/tickets/options. Or, if this is a mailing list, you can unsubscribe from the mailing list.-- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/___ Opensaf-tickets mailing list Opensaf-tickets@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/opensaf-tickets
[tickets] [opensaf:tickets] #1001 IMM: PBE fails in sqlite on commit of CCB object create
- **summary**: IMMSv is not honoring further CCB commits once SQL operation failure is reported by PBE -- IMM: PBE fails in sqlite on commit of CCB object create - **Comment**: Changing slogan for this ticket because it reports two problems. 1) The main problem of the failure in sqlite to commit a ccb object create. 2) After this failure, subsequent CCBs fail. The second issue is covered by ticket #996. --- ** [tickets:#1001] IMM: PBE fails in sqlite on commit of CCB object create** **Status:** accepted **Milestone:** 4.5.0 **Created:** Thu Aug 21, 2014 05:38 AM UTC by Sirisha Alla **Last Updated:** Thu Aug 21, 2014 01:15 PM UTC **Owner:** Zoran Milinkovic This issue is seen on SLES 64bit 4 node VMs. The changeset of OpenSAF used is 5608 along with patches for #938,#994 and #997. IMM applications are in progress when the issue is observed. During one of the CCB commit operations following is observed on the active controller: Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmpbed: ER SQL statement('INSERT INTO objects (obj_id, class_id, dn, last_ccb) VALUES (?, ?, ?, ?)') failed with error code: 19 Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 46 will be aborted Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 46 ABORTED (exowner) Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 2e/46 Once this error is seen further CCB commits(ccbApply()) fail with FAILED_OPERATION. Cluster becomes unusable for CCB commit operations. Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmpbed: ER Failed to bind obj_id with error code: 21 Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 47 will be aborted Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 47 ABORTED (adminOwner) Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 2f/47 Aug 21 10:15:52 SLES-64BIT-SLOT1 osafimmpbed: IN Create of class noDanglingPreconfigurationClass committing with ccbId:10089 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Create of class noDanglingPreconfigurationClass is PERSISTENT. Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: ER Failed to bind obj_id with error code: 21 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 92 will be aborted Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 92 ABORTED (noDanglingPreconfigurationClass) Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 5c/92 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: IN Delete of class noDanglingPreconfigurationClass committing with ccbId:1008a Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Delete of class noDanglingPreconfigurationClass is PERSISTENT. Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: IN Create of class immsv_N0_Dangling_test01 committing with ccbId:1008b Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Create of class immsv_N0_Dangling_test01 is PERSISTENT. Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: ER Failed to bind obj_id with error code: 21 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 98 will be aborted Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 98 ABORTED (immsv_N0_Dangling_test01) Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 62/98 This issue is reproducible. Traces are attached. IMMD traces are available and will be able to share them on request. I am not sure whether this is consequence after #1000 is observed. I will try to see if this can be reproduced independantly. --- Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is subscribed to https://sourceforge.net/p/opensaf/tickets/ To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/opensaf/admin/tickets/options. Or, if this is a mailing list, you can unsubscribe from the mailing list.-- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/___ Opensaf-tickets mailing list Opensaf-tickets@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/opensaf-tickets
[tickets] [opensaf:tickets] #1001 IMM: PBE fails in sqlite on commit of CCB object create
The intention of delete is there may be possibility of class delete, Looks like class delete is not happened. In the below traces some memory corruption is happening in osaf_extended_name_borrow(ccbUtilOperationData-objectName) Aug 21 15:39:56.182092 osafimmpbed [13438:immpbe_daemon.cc:1335] saImmOiCcbCompletedCallback: Completed callback for CCB:45 Aug 21 15:39:56.182444 osafimmnd [13393:immnd_evt.c:3699] T5 IMMND UPCALL TO PBE for ccb 45, SEND SUCCEEDED Aug 21 15:39:56.182679 osafimmnd [13393:immnd_evt.c:3902] immnd_evt_proc_ccb_compl_rsp Aug 21 15:39:56.182700 osafimmnd [13393:immnd_evt.c:8401] dequeue_outgoing Aug 21 15:39:56.182714 osafimmnd [13393:immnd_evt.c:8407] TR Pending replies:0 space:16 out list?:(nil) Aug 21 15:39:56.182762 osafimmnd [13393:immnd_evt.c:8436] dequeue_outgoing Aug 21 15:39:56.182779 osafimmnd [13393:immnd_evt.c:8520] immnd_evt_proc_fevs_rcv Aug 21 15:39:56.186353 osafimmpbed [13438:immpbe_daemon.cc:1382] TR Begin PBE transaction for CCB 45 OK Aug 21 15:39:56.186433 osafimmpbed [13438:immpbe_daemon.cc:0105] TR Create of object with DN: no object name is printed? Aug 21 15:39:56.186468 osafimmpbed [13438:immpbe_dump.cc:2270] objectToPBE Aug 21 15:39:56.186524 osafimmpbed [13438:immpbe_dump.cc:2271] T1 Dumping object Aug 21 15:39:56.188103 osafimmpbed [13438:immpbe_dump.cc:2389] objectToPBE Aug 21 15:39:56.338118 osafimmpbed [13438:immpbe_daemon.cc:1398] TR COMMIT PBE TRANSACTION for ccb 45 epoch:10 OK Aug 21 15:39:56.338198 osafimmpbed [13438:immpbe_daemon.cc:1421] saImmOiCcbCompletedCallback Aug 21 15:39:56.349090 osafimmpbed [13438:immpbe_daemon.cc:1335] saImmOiCcbCompletedCallback: Completed callback for CCB:46 Aug 21 15:39:56.350387 osafimmpbed [13438:immpbe_daemon.cc:1382] TR Begin PBE transaction for CCB 46 OK Aug 21 15:39:56.350417 osafimmpbed [13438:immpbe_daemon.cc:0105] TR Create of object with DN: no object name is printed. Aug 21 15:39:56.350426 osafimmpbed [13438:immpbe_dump.cc:2270] objectToPBE Aug 21 15:39:56.350432 osafimmpbed [13438:immpbe_dump.cc:2271] T1 Dumping object Aug 21 15:39:56.350525 osafimmpbed [13438:immpbe_dump.cc:2311] ER SQL statement('INSERT INTO objects (obj_id, class_id, dn, last_ccb) VALUES (?, ?, ?, ?)') failed with error code: 19 Aug 21 15:39:56.352149 osafimmpbed [13438:immpbe_daemon.cc:1421] saImmOiCcbCompletedCallback Regards, Neel. --- ** [tickets:#1001] IMM: PBE fails in sqlite on commit of CCB object create** **Status:** accepted **Milestone:** 4.5.0 **Created:** Thu Aug 21, 2014 05:38 AM UTC by Sirisha Alla **Last Updated:** Thu Aug 21, 2014 01:27 PM UTC **Owner:** Zoran Milinkovic This issue is seen on SLES 64bit 4 node VMs. The changeset of OpenSAF used is 5608 along with patches for #938,#994 and #997. IMM applications are in progress when the issue is observed. During one of the CCB commit operations following is observed on the active controller: Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmpbed: ER SQL statement('INSERT INTO objects (obj_id, class_id, dn, last_ccb) VALUES (?, ?, ?, ?)') failed with error code: 19 Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 46 will be aborted Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 46 ABORTED (exowner) Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 2e/46 Once this error is seen further CCB commits(ccbApply()) fail with FAILED_OPERATION. Cluster becomes unusable for CCB commit operations. Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmpbed: ER Failed to bind obj_id with error code: 21 Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 47 will be aborted Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 47 ABORTED (adminOwner) Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 2f/47 Aug 21 10:15:52 SLES-64BIT-SLOT1 osafimmpbed: IN Create of class noDanglingPreconfigurationClass committing with ccbId:10089 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Create of class noDanglingPreconfigurationClass is PERSISTENT. Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: ER Failed to bind obj_id with error code: 21 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 92 will be aborted Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 92 ABORTED (noDanglingPreconfigurationClass) Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 5c/92 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: IN Delete of class noDanglingPreconfigurationClass committing with ccbId:1008a Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Delete of class noDanglingPreconfigurationClass is PERSISTENT. Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: IN Create of class immsv_N0_Dangling_test01 committing with ccbId:1008b Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]:
[tickets] [opensaf:tickets] #1001 IMM: PBE fails in sqlite on commit of CCB object create
- **status**: accepted -- review - **Comment**: http://sourceforge.net/p/opensaf/mailman/opensaf-devel/thread/patchbomb.1408630778%40elx00642cl-3t.rnd.ki.sw.ericsson.se/#msg32744993 --- ** [tickets:#1001] IMM: PBE fails in sqlite on commit of CCB object create** **Status:** review **Milestone:** 4.5.0 **Created:** Thu Aug 21, 2014 05:38 AM UTC by Sirisha Alla **Last Updated:** Thu Aug 21, 2014 01:54 PM UTC **Owner:** Zoran Milinkovic This issue is seen on SLES 64bit 4 node VMs. The changeset of OpenSAF used is 5608 along with patches for #938,#994 and #997. IMM applications are in progress when the issue is observed. During one of the CCB commit operations following is observed on the active controller: Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmpbed: ER SQL statement('INSERT INTO objects (obj_id, class_id, dn, last_ccb) VALUES (?, ?, ?, ?)') failed with error code: 19 Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 46 will be aborted Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 46 ABORTED (exowner) Aug 21 10:15:44 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 2e/46 Once this error is seen further CCB commits(ccbApply()) fail with FAILED_OPERATION. Cluster becomes unusable for CCB commit operations. Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmpbed: ER Failed to bind obj_id with error code: 21 Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 47 will be aborted Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 47 ABORTED (adminOwner) Aug 21 10:15:50 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 2f/47 Aug 21 10:15:52 SLES-64BIT-SLOT1 osafimmpbed: IN Create of class noDanglingPreconfigurationClass committing with ccbId:10089 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Create of class noDanglingPreconfigurationClass is PERSISTENT. Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: ER Failed to bind obj_id with error code: 21 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 92 will be aborted Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 92 ABORTED (noDanglingPreconfigurationClass) Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 5c/92 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: IN Delete of class noDanglingPreconfigurationClass committing with ccbId:1008a Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Delete of class noDanglingPreconfigurationClass is PERSISTENT. Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: IN Create of class immsv_N0_Dangling_test01 committing with ccbId:1008b Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Create of class immsv_N0_Dangling_test01 is PERSISTENT. Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: ER Failed to bind obj_id with error code: 21 Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Invalid error reported implementer 'OpenSafImmPBE', Ccb 98 will be aborted Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmnd[3645]: NO Ccb 98 ABORTED (immsv_N0_Dangling_test01) Aug 21 10:15:53 SLES-64BIT-SLOT1 osafimmpbed: WA Failed to find CCB object for 62/98 This issue is reproducible. Traces are attached. IMMD traces are available and will be able to share them on request. I am not sure whether this is consequence after #1000 is observed. I will try to see if this can be reproduced independantly. --- Sent from sourceforge.net because opensaf-tickets@lists.sourceforge.net is subscribed to https://sourceforge.net/p/opensaf/tickets/ To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/opensaf/admin/tickets/options. Or, if this is a mailing list, you can unsubscribe from the mailing list.-- Slashdot TV. Video for Nerds. Stuff that matters. http://tv.slashdot.org/___ Opensaf-tickets mailing list Opensaf-tickets@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/opensaf-tickets