>>> Lars Marowsky-Bree <[email protected]> schrieb am 21.08.2012 um 22:09 in >>> Nachricht <[email protected]>: > On 2012-08-21T14:32:53, Ulrich Windl <[email protected]> > wrote: > > > Maybe I'm expecting too much, but isn't it possible to simply log "Telling > other nodes that PV blabla is being created"? > > The problem is the error case, in which we want more logs. There is > progress (libqb with the flight recorder/blackbox thingy where we > internally log at a higher trace level and retroactively dump that when > we hit a problem, allowing us to have a much lower default loglevel), > but that isn't fully merged into all tools and components yet. > > I'm not so much worried about what gets logged when the cluster actually > does something - i.e., how often do you really create an LV? -, but the > quiet/idle case shouldn't be so noisy.
Hi Lars! Actually you could log events like: "starting to inform the cluster about..." "failed to inform the cluster about..." "finsished to inform the cluster about..." So that's actually two messages instead on one then. I saw a lot of messages when: A PV is created A VG is created A LV is created A LV is activated A LV is mirrored So basically whenever there's a change with LVM you get lots of messages. Way too much. For comparison, here's the messages that HP-UX logs when activating two cluster VGs (system uptime 610 days): Jan 24 08:45:09 rkdvmhp1 LVM[12876]: vgchange -a e -q n vg30 Jan 24 08:45:09 rkdvmhp1 LVM[12881]: vgchange -a e -q n vg31 That's it! Clean ad easy. Here's the messages when an LV is extended: Jan 24 08:45:46 rkdvmhp1 LVM[13007]: lvextend -L 16320 /dev/vg30/lvol1 Jan 24 08:45:46 rkdvmhp1 LVM[13007]: Volume Group configuration for /dev/vg30 has been saved in /etc/lvmconf/vg30.conf And here's the message if y PV failed: Nov 23 14:52:42 rkdvmhp1 vmunix: LVM: WARNING: VG 64 0x1f0000: LV 2: Some I/O requests to this LV are waiting Nov 23 14:52:42 rkdvmhp1 vmunix: indefinitely for an unavailable PV. These requests will be queued until Nov 23 14:52:42 rkdvmhp1 vmunix: the PV becomes available (or a timeout is specified for the LV). And if the device comes back later: Nov 23 14:53:08 rkdvmhp1 vmunix: LVM: NOTICE: VG 64 0x1f0000: LV 2: All I/O requests to this LV that were Nov 23 14:53:08 rkdvmhp1 vmunix: waiting indefinitely for an unavailable PV have now completed. I'm not saying that HP-UX is perfect, but there's a difference in the messages a developer wants to see, and the messages an administrator wants to see. While we're at it: Messages I don't want to see are these (looks like a bad implementation of a feature): Aug 21 14:10:59 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 2 on node 220314ac Aug 21 14:35:14 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6bcf00, msglen =32, client=0x6bcc50 Aug 21 14:37:53 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 6 on node 220314ac Aug 21 14:37:53 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 9 on node 220314ac Aug 21 14:40:00 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6bcf00, msglen =32, client=0x6bcc50 Aug 21 14:40:14 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 15 on node 220314ac Aug 21 14:40:14 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 18 on node 220314ac Aug 21 14:49:27 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6bec10, msglen =32, client=0x6bcc50 Aug 21 14:49:27 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6fec30, msglen =32, client=0x6bcc50 Aug 21 14:54:27 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 24 on node 220314ac Aug 21 14:54:27 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 28 on node 220314ac Aug 21 14:54:42 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 34 on node 220314ac Aug 21 14:54:42 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 38 on node 220314ac Aug 21 14:54:48 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 44 on node 220314ac Aug 21 14:54:48 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 48 on node 220314ac Aug 21 14:56:15 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6fec20, msglen =32, client=0x6b8220 Aug 21 14:56:15 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6bf1b0, msglen =32, client=0x6b8220 Aug 21 14:56:15 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6fec20, msglen =32, client=0x6b8220 Aug 21 14:56:15 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6fec20, msglen =32, client=0x6b8220 Aug 21 14:56:15 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6fec20, msglen =32, client=0x6b8220 Aug 21 14:56:15 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6bec10, msglen =32, client=0x6b8220 Aug 21 14:56:34 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6fec20, msglen =32, client=0x6b8df0 Aug 21 14:56:34 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6bf1b0, msglen =32, client=0x6b8df0 Aug 21 14:57:00 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6fec20, msglen =32, client=0x6b8ca0 Aug 21 14:57:00 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x6bf1b0, msglen =32, client=0x6b8ca0 Aug 21 14:57:00 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000920, msglen =32, client=0x6b8ca0 Aug 21 14:57:00 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000920, msglen =32, client=0x6b8ca0 Aug 21 14:57:00 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000920, msglen =32, client=0x6b8ca0 Aug 21 14:57:00 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd1180008e0, msglen =32, client=0x6b8ca0 Aug 21 14:58:36 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 54 on node 220314ac Aug 21 14:58:36 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 58 on node 220314ac Aug 21 14:58:46 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 14:58:46 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b00, msglen =32, client=0x7fd1180008b0 Aug 21 14:58:46 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 14:58:46 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 14:58:46 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 14:58:46 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b00, msglen =32, client=0x7fd1180008b0 Aug 21 15:27:56 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 1 on node 200314ac Aug 21 15:27:56 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 4 on node 200314ac Aug 21 15:28:09 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 61 on node 220314ac Aug 21 15:28:09 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 64 on node 220314ac Aug 21 15:28:20 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 70 on node 220314ac Aug 21 15:28:20 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 74 on node 220314ac Aug 21 15:30:19 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 79 on node 220314ac Aug 21 15:30:19 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 15:30:19 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 15:30:19 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b00, msglen =32, client=0x7fd1180008b0 Aug 21 15:30:19 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 3 on node 210314ac Aug 21 15:30:19 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 82 on node 220314ac Aug 21 15:30:19 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 9 on node 200314ac Aug 21 15:30:19 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 3 on node 230314ac Aug 21 15:30:20 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b00, msglen =32, client=0x7fd1180008b0 Aug 21 15:30:20 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 6 on node 210314ac Aug 21 15:30:20 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 6 on node 230314ac Aug 21 15:30:20 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 12 on node 200314ac Aug 21 15:30:59 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b00, msglen =32, client=0x7fd1180008b0 Aug 21 15:30:59 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b00, msglen =32, client=0x7fd1180008b0 Aug 21 15:31:05 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 15:31:05 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b00, msglen =32, client=0x7fd1180008b0 Aug 21 15:31:05 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 15:31:05 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 15:31:05 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 15:31:05 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b00, msglen =32, client=0x7fd1180008b0 Aug 21 15:40:03 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 16 on node 200314ac Aug 21 15:40:03 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 22 on node 200314ac Aug 21 15:40:09 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 26 on node 200314ac Aug 21 15:40:09 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 32 on node 200314ac Aug 21 15:48:55 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 15:48:55 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b00, msglen =32, client=0x7fd1180008b0 Aug 21 15:48:56 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 15:48:56 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 15:48:56 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b40, msglen =32, client=0x7fd1180008b0 Aug 21 15:48:56 o1 clvmd[30725]: process_local_command: unknown (0x2d) msg=0x7fd118000b00, msglen =32, client=0x7fd1180008b0 Aug 21 15:49:13 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 88 on node 220314ac Aug 21 15:49:13 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 92 on node 220314ac Aug 21 16:02:00 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 36 on node 200314ac Aug 21 16:02:01 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 42 on node 200314ac Aug 21 16:02:01 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 47 on node 200314ac Aug 21 16:13:56 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 2 on node 200314ac Aug 21 16:13:56 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 5 on node 200314ac Aug 21 16:13:57 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 11 on node 200314ac Aug 21 16:13:57 o1 clvmd[30725]: process_remote_command unknown (0x2d) for clientid 0x5000000 XID 16 on node 200314ac Regards, Ulrich _______________________________________________ Linux-HA mailing list [email protected] http://lists.linux-ha.org/mailman/listinfo/linux-ha See also: http://linux-ha.org/ReportingProblems
