Hello List, I am new here. I worked with Linux HA during 2006-2008, went in HPC direction, and came back to HA a month ago. Realized that a lot has changed.
My setup: Two KVM machines vdb1 (192.168.122.11), vdb2 (192.168.122.12) ClusterIP: 192.168.122.10 Fedora 19 (64 bit). PCS, CoroSync, PaceMaker, DRBD Note: I use the names node1 and node2 for vdb1 and vdb2 for explanations. I am trying to setup a test cluster, using http://clusterlabs.org/doc/en-US/Pacemaker/1.1-pcs/html/Clusters_from_Scratch/_configure_the_cluster_for_drbd.html First, the status: [root@vdb1 drbd.d]# pcs status Cluster name: MySQLCluster Last updated: Tue Nov 26 14:05:33 2013 Last change: Mon Nov 25 17:25:59 2013 via crm_resource on vdb2.example.com Stack: corosync Current DC: vdb1.example.com (1) - partition with quorum Version: 1.1.9-3.fc19-781a388 2 Nodes configured, unknown expected votes 2 Resources configured. Online: [ vdb1.example.com vdb2.example.com ] Full list of resources: ClusterIP (ocf::heartbeat:IPaddr2): Started vdb1.example.com Apache (ocf::heartbeat:apache): Started vdb1.example.com [root@vdb1 drbd.d]# My DRBD disks are: [root@vdb1 drbd.d]# drbd-overview 1:MySQLDisk/0 Connected Secondary/Secondary UpToDate/UpToDate C r----- 2:ApacheDisk/0 Connected Secondary/Secondary UpToDate/UpToDate C r----- [root@vdb1 drbd.d]# Now, the guide suggests creating a small config file, define the new resources in that, and then push that in CIB. Extract from the guide: # pcs cluster cib drbd_cfg # pcs -f drbd_cfg resource create WebData ocf:linbit:drbd \ drbd_resource=wwwdata op monitor interval=60s # pcs -f drbd_cfg resource master WebDataClone WebData \ master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 \ notify=true I decided to execute the commands (manually), without using the config file method, as: # pcs resource create p_ApacheDisk ocf:linbit:drbd \ > drbd_resource=ApacheDisk op monitor interval=60s # pcs resource master MasterApacheDisk p_ApacheDisk \ > master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 \ > notify=true (I changed the names of resources a bit) I get the following errors: [root@vdb2 ~]# pcs resource create p_ApacheDisk ocf:linbit:drbd \ > drbd_resource=ApacheDisk op monitor interval=60s [root@vdb2 ~]# pcs status Cluster name: MySQLCluster Last updated: Wed Nov 27 11:50:35 2013 Last change: Wed Nov 27 11:49:36 2013 via cibadmin on vdb2.example.com Stack: corosync Current DC: vdb1.example.com (1) - partition with quorum Version: 1.1.9-3.fc19-781a388 2 Nodes configured, unknown expected votes 3 Resources configured. Online: [ vdb1.example.com vdb2.example.com ] Full list of resources: ClusterIP (ocf::heartbeat:IPaddr2): Started vdb1.example.com Apache (ocf::heartbeat:apache): Started vdb1.example.com p_ApacheDisk (ocf::linbit:drbd): Stopped Failed actions: p_ApacheDisk_monitor_0 (node=vdb1.example.com, call=27, rc=6, status=complete, last-rc-change=Wed Nov 27 11:49:36 2013 , queued=23ms, exec=0ms ): not configured p_ApacheDisk_monitor_0 (node=vdb2.example.com, call=15, rc=6, status=complete, last-rc-change=Wed Nov 27 11:49:36 2013 , queued=22ms, exec=1ms ): not configured Got the following in /var/log/messages on DC (node 1): Nov 27 11:49:36 vdb1 cib[538]: notice: cib:diff: Diff: --- 0.43.13 Nov 27 11:49:36 vdb1 cib[538]: notice: cib:diff: Diff: +++ 0.44.1 f4b87d9dee145747f86583cb5eb8276b Nov 27 11:49:36 vdb1 stonith-ng[539]: notice: unpack_config: On loss of CCM Quorum: Ignore Nov 27 11:49:36 vdb1 crmd[543]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ] Nov 27 11:49:36 vdb1 pengine[542]: notice: unpack_config: On loss of CCM Quorum: Ignore Nov 27 11:49:36 vdb1 pengine[542]: notice: LogActions: Start p_ApacheDisk#011(vdb2.example.com) Nov 27 11:49:36 vdb1 pengine[542]: notice: process_pe_message: Calculated Transition 92: /var/lib/pacemaker/pengine/pe-input-74.bz2 Nov 27 11:49:36 vdb1 crmd[543]: notice: te_rsc_command: Initiating action 8: monitor p_ApacheDisk_monitor_0 on vdb2.example.com Nov 27 11:49:36 vdb1 crmd[543]: notice: te_rsc_command: Initiating action 6: monitor p_ApacheDisk_monitor_0 on vdb1.example.com (local) Nov 27 11:49:36 vdb1 drbd(p_ApacheDisk)[9807]: ERROR: meta parameter misconfigured, expected clone-max -le 2, but found unset. Nov 27 11:49:36 vdb1 crmd[543]: notice: process_lrm_event: LRM operation p_ApacheDisk_monitor_0 (call=27, rc=6, cib-update=124, confirmed=true) not configured Nov 27 11:49:36 vdb1 crmd[543]: warning: status_from_rc: Action 8 (p_ApacheDisk_monitor_0) on vdb2.example.com failed (target: 7 vs. rc: 6): Error Nov 27 11:49:36 vdb1 crmd[543]: notice: te_rsc_command: Initiating action 7: probe_complete probe_complete on vdb2.example.com - no waiting Nov 27 11:49:36 vdb1 crmd[543]: warning: status_from_rc: Action 6 (p_ApacheDisk_monitor_0) on vdb1.example.com failed (target: 7 vs. rc: 6): Error Nov 27 11:49:36 vdb1 crmd[543]: notice: te_rsc_command: Initiating action 5: probe_complete probe_complete on vdb1.example.com (local) - no waiting Nov 27 11:49:36 vdb1 crmd[543]: notice: run_graph: Transition 92 (Complete=4, Pending=0, Fired=0, Skipped=3, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-74.bz2): Stopped Nov 27 11:49:36 vdb1 pengine[542]: notice: unpack_config: On loss of CCM Quorum: Ignore Nov 27 11:49:36 vdb1 pengine[542]: error: unpack_rsc_op: Preventing p_ApacheDisk from re-starting anywhere in the cluster : operation monitor failed 'not configured' (rc=6) Nov 27 11:49:36 vdb1 pengine[542]: error: unpack_rsc_op: Preventing p_ApacheDisk from re-starting anywhere in the cluster : operation monitor failed 'not configured' (rc=6) Nov 27 11:49:36 vdb1 pengine[542]: notice: process_pe_message: Calculated Transition 93: /var/lib/pacemaker/pengine/pe-input-75.bz2 Nov 27 11:49:36 vdb1 crmd[543]: notice: run_graph: Transition 93 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-75.bz2): Complete Nov 27 11:49:36 vdb1 crmd[543]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] I then executed the second command and got this: [root@vdb2 drbd.d]# pcs resource master MasterApacheDisk p_ApacheDisk \ > master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 \ > notify=true [root@vdb2 drbd.d]# pcs status Cluster name: MySQLCluster Last updated: Wed Nov 27 11:52:54 2013 Last change: Wed Nov 27 11:52:39 2013 via cibadmin on vdb1.example.com Stack: corosync Current DC: vdb1.example.com (1) - partition with quorum Version: 1.1.9-3.fc19-781a388 2 Nodes configured, unknown expected votes 4 Resources configured. Online: [ vdb1.example.com vdb2.example.com ] Full list of resources: ClusterIP (ocf::heartbeat:IPaddr2): Started vdb1.example.com Apache (ocf::heartbeat:apache): Started vdb1.example.com Master/Slave Set: MasterApacheDisk [p_ApacheDisk] Stopped: [ vdb1.example.com vdb2.example.com ] Failed actions: p_ApacheDisk_monitor_0 (node=vdb1.example.com, call=27, rc=6, status=complete, last-rc-change=Wed Nov 27 11:49:36 2013 , queued=23ms, exec=0ms ): not configured p_ApacheDisk_monitor_0 (node=vdb2.example.com, call=15, rc=6, status=complete, last-rc-change=Wed Nov 27 11:49:36 2013 , queued=22ms, exec=1ms ): not configured [root@vdb2 drbd.d]# Got the following in log file on /var/log/messages: Nov 27 11:52:39 vdb1 cib[538]: notice: cib:diff: Diff: --- 0.44.3 Nov 27 11:52:39 vdb1 cib[538]: notice: cib:diff: Diff: +++ 0.45.1 d62a8fd52495c636c2bc012ac156d3e2 Nov 27 11:52:39 vdb1 crmd[543]: notice: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ] Nov 27 11:52:39 vdb1 stonith-ng[539]: notice: unpack_config: On loss of CCM Quorum: Ignore Nov 27 11:52:39 vdb1 pengine[542]: notice: unpack_config: On loss of CCM Quorum: Ignore Nov 27 11:52:39 vdb1 pengine[542]: error: unpack_rsc_op: Preventing MasterApacheDisk from re-starting anywhere in the cluster : operation monitor failed 'not configured' (rc=6) Nov 27 11:52:39 vdb1 pengine[542]: error: unpack_rsc_op: Preventing MasterApacheDisk from re-starting anywhere in the cluster : operation monitor failed 'not configured' (rc=6) Nov 27 11:52:39 vdb1 pengine[542]: notice: process_pe_message: Calculated Transition 94: /var/lib/pacemaker/pengine/pe-input-76.bz2 Nov 27 11:52:39 vdb1 crmd[543]: notice: run_graph: Transition 94 (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pacemaker/pengine/pe-input-76.bz2): Complete Nov 27 11:52:39 vdb1 crmd[543]: notice: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] I have tried them they way it is specified in the guide and it works. (i.e. by using an intermediate config file). But my question is, why I cannot use the two commands individually? Are there any limitations in doing so? If someone can explain the above errors and the reasons behind them, I would really appreciate. Thank you for your time. Regards, K On Wed, Nov 27, 2013 at 12:00 PM, <pacemaker-requ...@oss.clusterlabs.org>wrote: > Send Pacemaker mailing list submissions to > pacemaker@oss.clusterlabs.org > > To subscribe or unsubscribe via the World Wide Web, visit > http://oss.clusterlabs.org/mailman/listinfo/pacemaker > or, via email, send a message with subject or body 'help' to > pacemaker-requ...@oss.clusterlabs.org > > You can reach the person managing the list at > pacemaker-ow...@oss.clusterlabs.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Pacemaker digest..." > > > Today's Topics: > > 1. Re: howto group resources without having an order > (Michael Schwartzkopff) > 2. Re: Can in pass commands to Pacemaker from a Remote Machine > (David Vossel) > 3. Re: howto group resources without having an order > (Bauer, Stefan (IZLBW Extern)) > 4. Re: howto group resources without having an order > (Michael Schwartzkopff) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Tue, 26 Nov 2013 15:03:56 +0100 > From: Michael Schwartzkopff <m...@sys4.de> > To: The Pacemaker cluster resource manager > <pacemaker@oss.clusterlabs.org> > Subject: Re: [Pacemaker] howto group resources without having an order > Message-ID: <4335855.BDW45BEUI9@nb003> > Content-Type: text/plain; charset="iso-8859-1" > > Am Dienstag, 26. November 2013, 13:44:58 schrieb Bauer, Stefan: > (...) > > As Lars already noted. Or make a constraint set, as Florian already > noted: > > > > colocation c-set inf: (OVPN1 OVPN2 ...) myGroup > > > > -> Can you recommend a documentation about howto specify a colocation? > What > > is the function of the "(" for example. > > http://www.oreilly.de/catalog/linuxhacluster3ger/index.html > > Sorry, it was too tempting. > > Also: > > http://clusterlabs.org/doc/en-US/Pacemaker/1.1-crmsh/html/Pacemaker_Explained/s-resource-sets-ordering.html > > and its following pages. > > > http://clusterlabs.org/doc/en-US/Pacemaker/1.1-crmsh/html/Pacemaker_Explained/s-resource-sets-collocation.html > > and its following pages. > > -- > Mit freundlichen Gr??en, > > Michael Schwartzkopff > > -- > [*] sys4 AG > > http://sys4.de, +49 (89) 30 90 46 64, +49 (162) 165 0044 > Franziskanerstra?e 15, 81669 M?nchen > > Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 > Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer > Aufsichtsratsvorsitzender: Florian Kirstein > -------------- next part -------------- > A non-text attachment was scrubbed... > Name: signature.asc > Type: application/pgp-signature > Size: 230 bytes > Desc: This is a digitally signed message part. > URL: < > http://oss.clusterlabs.org/pipermail/pacemaker/attachments/20131126/8134bbce/attachment-0001.sig > > > > ------------------------------ > > Message: 2 > Date: Tue, 26 Nov 2013 11:27:31 -0500 (EST) > From: David Vossel <dvos...@redhat.com> > To: The Pacemaker cluster resource manager > <pacemaker@oss.clusterlabs.org> > Subject: Re: [Pacemaker] Can in pass commands to Pacemaker from a > Remote Machine > Message-ID: > <1288802713.69018898.1385483251900.javamail.r...@redhat.com> > Content-Type: text/plain; charset=utf-8 > > ----- Original Message ----- > > From: "Puneet Jindal" <puneetjin...@drishti-soft.com> > > To: pacemaker@oss.clusterlabs.org > > Sent: Sunday, November 24, 2013 2:58:35 AM > > Subject: [Pacemaker] Can in pass commands to Pacemaker from a Remote > Machine > > > > Hello, > > > > I want to build a GUI on top of pacemaker, i configures > "remote-tls-port" in > > cib and now cib is listening on that port. What all commands can i send > to > > CIB and how to do that. Can anyone provide some examples > > look at the 'cibadmin' tool > > > > > _______________________________________________ > > Pacemaker mailing list: Pacemaker@oss.clusterlabs.org > > http://oss.clusterlabs.org/mailman/listinfo/pacemaker > > > > Project Home: http://www.clusterlabs.org > > Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf > > Bugs: http://bugs.clusterlabs.org > > > > > > ------------------------------ > > Message: 3 > Date: Wed, 27 Nov 2013 08:50:59 +0000 > From: "Bauer, Stefan (IZLBW Extern)" <stefan.ba...@iz.bwl.de> > To: The Pacemaker cluster resource manager > <pacemaker@oss.clusterlabs.org> > Subject: Re: [Pacemaker] howto group resources without having an order > Message-ID: > <6ccc8d7d73bc5e4e8a87293ef611ba4f2058d...@bwlsm15.zd.bwl.net> > Content-Type: text/plain; charset="us-ascii" > > Hi Michael, > > i already have your book but i can't find anything related to the way, you > define constraint sets like stated here: > > -------------- > As Lars already noted. Or make a constraint set, as Florian already noted: > > colocation c-set inf: (OVPN1 OVPN2 ...) myGroup > -------------- > > What is the behavior of the brackets for example? > > Stefan > > > > ------------------------------ > > Message: 4 > Date: Wed, 27 Nov 2013 10:28:28 +0100 > From: Michael Schwartzkopff <m...@sys4.de> > To: The Pacemaker cluster resource manager > <pacemaker@oss.clusterlabs.org> > Subject: Re: [Pacemaker] howto group resources without having an order > Message-ID: <2538092.ha62r51U8D@nb003> > Content-Type: text/plain; charset="iso-8859-1" > > Am Mittwoch, 27. November 2013, 08:50:59 schrieb Bauer, Stefan: > > Hi Michael, > > > > i already have your book but i can't find anything related to the way, > you > > define constraint sets like stated here: > > > > -------------- > > As Lars already noted. Or make a constraint set, as Florian already > noted: > > > > colocation c-set inf: (OVPN1 OVPN2 ...) myGroup > > -------------- > > > > What is the behavior of the brackets for example? > > This feature was not implemented at the time I wrote the book. Time for a > update. > > But you find the details, as always, in the man pages: > > http://www.nongnu.org/crmsh/crm.8.html > > See the section about colocation and order > > -- > Mit freundlichen Gr??en, > > Michael Schwartzkopff > > -- > [*] sys4 AG > > http://sys4.de, +49 (89) 30 90 46 64, +49 (162) 165 0044 > Franziskanerstra?e 15, 81669 M?nchen > > Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 > Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer > Aufsichtsratsvorsitzender: Florian Kirstein > -------------- next part -------------- > A non-text attachment was scrubbed... > Name: signature.asc > Type: application/pgp-signature > Size: 230 bytes > Desc: This is a digitally signed message part. > URL: < > http://oss.clusterlabs.org/pipermail/pacemaker/attachments/20131127/8ca9f78a/attachment-0001.sig > > > > ------------------------------ > > _______________________________________________ > Pacemaker mailing list > Pacemaker@oss.clusterlabs.org > http://oss.clusterlabs.org/mailman/listinfo/pacemaker > > > End of Pacemaker Digest, Vol 72, Issue 70 > ***************************************** > -- http://www.wbitt.com , http://techsnail.com Computer bugs are like shipwrecks. They are not found, unless they want to be found.
_______________________________________________ Pacemaker mailing list: Pacemaker@oss.clusterlabs.org http://oss.clusterlabs.org/mailman/listinfo/pacemaker Project Home: http://www.clusterlabs.org Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf Bugs: http://bugs.clusterlabs.org
