hi all, I'm testing OCFS2 in a mixed Fedora Core 4, 5 and 6 cluster with 12 nodes. SAN is: - Storage is a FC Infortrend - QLogic16 port FC switch - FC adapter is LSI FC929X
I had an unstable node which kept freezing, still investigating it. Anyway, during freeze time, other nodes noticed the problem and correctly evicted it from the ocfs2 node pool. Problem is, accessing the filesystem from any other node, e.g. via 'df', leave the process stuck in 'D' state in some ocfs2 driver function (as seen via 'ps -elf') as soon as the faulty node reboots, the stuck processes on the other nodes get unstuck. Is it correct behaviour after one node eviction, provided that the quorum is reached such as in the situation I depicted ? in attachment, the syslog and some log info from one of the node (the cluster frontend). cheers -- [EMAIL PROTECTED] ICQ:290677265 SKYPE:d.rossetti
cluster.conf
Description: Binary data
processor : 0 vendor_id : AuthenticAMD cpu family : 15 model : 33 model name : Dual Core AMD Opteron(tm) Processor 265 stepping : 2 cpu MHz : 1000.000 cache size : 1024 KB physical id : 0 siblings : 2 core id : 0 cpu cores : 2 fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt lm 3dnowext 3dnow pni lahf_lm cmp_legacy bogomips : 2010.91 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp processor : 1 vendor_id : AuthenticAMD cpu family : 15 model : 33 model name : Dual Core AMD Opteron(tm) Processor 265 stepping : 2 cpu MHz : 1000.000 cache size : 1024 KB physical id : 0 siblings : 2 core id : 1 cpu cores : 2 fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt lm 3dnowext 3dnow pni lahf_lm cmp_legacy bogomips : 2010.91 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp processor : 2 vendor_id : AuthenticAMD cpu family : 15 model : 33 model name : Dual Core AMD Opteron(tm) Processor 265 stepping : 2 cpu MHz : 1000.000 cache size : 1024 KB physical id : 1 siblings : 2 core id : 0 cpu cores : 2 fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt lm 3dnowext 3dnow pni lahf_lm cmp_legacy bogomips : 2010.91 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp processor : 3 vendor_id : AuthenticAMD cpu family : 15 model : 33 model name : Dual Core AMD Opteron(tm) Processor 265 stepping : 2 cpu MHz : 1000.000 cache size : 1024 KB physical id : 1 siblings : 2 core id : 1 cpu cores : 2 fpu : yes fpu_exception : yes cpuid level : 1 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt lm 3dnowext 3dnow pni lahf_lm cmp_legacy bogomips : 2010.91 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management: ts fid vid ttp
00:00.0 Memory controller: nVidia Corporation CK804 Memory Controller (rev a3) Subsystem: Tyan Computer: Unknown device 2892 Flags: bus master, 66Mhz, fast devsel, latency 0 Capabilities: <available only to root> 00:01.0 ISA bridge: nVidia Corporation CK804 ISA Bridge (rev a3) Subsystem: Tyan Computer: Unknown device 2892 Flags: bus master, 66Mhz, fast devsel, latency 0 I/O ports at 8c00 [size=128] 00:01.1 SMBus: nVidia Corporation CK804 SMBus (rev a2) Subsystem: Tyan Computer: Unknown device 2892 Flags: 66Mhz, fast devsel I/O ports at 1000 [size=32] I/O ports at 5000 [size=64] I/O ports at 5040 [size=64] Capabilities: <available only to root> 00:02.0 USB Controller: nVidia Corporation CK804 USB Controller (rev a2) (prog-if 10 [OHCI]) Subsystem: Tyan Computer: Unknown device 2892 Flags: bus master, 66Mhz, fast devsel, latency 0, IRQ 58 Memory at da000000 (32-bit, non-prefetchable) [size=4K] Capabilities: <available only to root> 00:02.1 USB Controller: nVidia Corporation CK804 USB Controller (rev a3) (prog-if 20 [EHCI]) Subsystem: Tyan Computer: Unknown device 2892 Flags: bus master, 66Mhz, fast devsel, latency 0, IRQ 50 Memory at da001000 (32-bit, non-prefetchable) [size=256] Capabilities: <available only to root> 00:06.0 IDE interface: nVidia Corporation CK804 IDE (rev f2) (prog-if 8a [Master SecP PriP]) Subsystem: Tyan Computer: Unknown device 2892 Flags: bus master, 66Mhz, fast devsel, latency 0 I/O ports at 1400 [size=16] Capabilities: <available only to root> 00:09.0 PCI bridge: nVidia Corporation CK804 PCI Bridge (rev a2) (prog-if 01 [Subtractive decode]) Flags: bus master, 66Mhz, fast devsel, latency 0 Bus: primary=00, secondary=01, subordinate=01, sec-latency=64 I/O behind bridge: 00002000-00002fff Memory behind bridge: da100000-dbffffff Prefetchable memory behind bridge: 88000000-880fffff 00:0d.0 PCI bridge: nVidia Corporation CK804 PCIE Bridge (rev a3) (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=00, secondary=02, subordinate=02, sec-latency=0 Capabilities: <available only to root> 00:0e.0 PCI bridge: nVidia Corporation CK804 PCIE Bridge (rev a3) (prog-if 00 [Normal decode]) Flags: bus master, fast devsel, latency 0 Bus: primary=00, secondary=03, subordinate=03, sec-latency=0 Capabilities: <available only to root> 00:18.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration Flags: fast devsel Capabilities: <available only to root> 00:18.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map Flags: fast devsel 00:18.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller Flags: fast devsel 00:18.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous Control Flags: fast devsel 00:19.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration Flags: fast devsel Capabilities: <available only to root> 00:19.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map Flags: fast devsel 00:19.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller Flags: fast devsel 00:19.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous Control Flags: fast devsel 01:06.0 VGA compatible controller: ATI Technologies Inc Rage XL (rev 27) (prog-if 00 [VGA]) Subsystem: ATI Technologies Inc Rage XL Flags: bus master, stepping, medium devsel, latency 66, IRQ 10 Memory at db000000 (32-bit, non-prefetchable) [size=16M] I/O ports at 2000 [size=256] Memory at da100000 (32-bit, non-prefetchable) [size=4K] [virtual] Expansion ROM at 88000000 [disabled] [size=128K] Capabilities: <available only to root> 01:08.0 Ethernet controller: Intel Corporation 82557/8/9 [Ethernet Pro 100] (rev 10) Subsystem: Intel Corporation EtherExpress PRO/100 S Server Adapter Flags: bus master, medium devsel, latency 66, IRQ 233 Memory at da101000 (32-bit, non-prefetchable) [size=4K] I/O ports at 2400 [size=64] Memory at da120000 (32-bit, non-prefetchable) [size=128K] Capabilities: <available only to root> 08:0a.0 PCI bridge: Advanced Micro Devices [AMD] AMD-8131 PCI-X Bridge (rev 12) (prog-if 00 [Normal decode]) Flags: bus master, 66Mhz, medium devsel, latency 64 Bus: primary=08, secondary=09, subordinate=09, sec-latency=64 I/O behind bridge: 00003000-00003fff Memory behind bridge: dc300000-dc3fffff Prefetchable memory behind bridge: 00000000de000000-00000000dff00000 Capabilities: <available only to root> 08:0a.1 PIC: Advanced Micro Devices [AMD] AMD-8131 PCI-X IOAPIC (rev 01) (prog-if 10 [IO-APIC]) Subsystem: Advanced Micro Devices [AMD] AMD-8131 PCI-X IOAPIC Flags: bus master, medium devsel, latency 0 Memory at dc200000 (64-bit, non-prefetchable) [size=4K] 08:0b.0 PCI bridge: Advanced Micro Devices [AMD] AMD-8131 PCI-X Bridge (rev 12) (prog-if 00 [Normal decode]) Flags: bus master, 66Mhz, medium devsel, latency 64 Bus: primary=08, secondary=0a, subordinate=0a, sec-latency=64 I/O behind bridge: 00004000-00004fff Memory behind bridge: dc400000-dc4fffff Prefetchable memory behind bridge: 0000000088100000-0000000088200000 Capabilities: <available only to root> 08:0b.1 PIC: Advanced Micro Devices [AMD] AMD-8131 PCI-X IOAPIC (rev 01) (prog-if 10 [IO-APIC]) Subsystem: Advanced Micro Devices [AMD] AMD-8131 PCI-X IOAPIC Flags: bus master, medium devsel, latency 0 Memory at dc201000 (64-bit, non-prefetchable) [size=4K] 09:03.0 RAID bus controller: 3ware Inc: Unknown device 1003 Subsystem: 3ware Inc: Unknown device 1003 Flags: bus master, 66Mhz, medium devsel, latency 64, IRQ 201 Memory at de000000 (64-bit, prefetchable) [size=32M] Memory at dc300000 (64-bit, non-prefetchable) [size=4K] I/O ports at 3000 [size=64] [virtual] Expansion ROM at dc320000 [disabled] [size=128K] Capabilities: <available only to root> 0a:03.0 Fibre Channel: LSI Logic / Symbios Logic FC929X Fibre Channel Adapter (rev 81) Subsystem: LSI Logic / Symbios Logic: Unknown device 5030 Flags: bus master, 66Mhz, medium devsel, latency 72, IRQ 209 I/O ports at 4000 [size=256] Memory at dc410000 (64-bit, non-prefetchable) [size=64K] Memory at dc400000 (64-bit, non-prefetchable) [size=64K] [virtual] Expansion ROM at 88100000 [disabled] [size=1M] Capabilities: <available only to root> 0a:09.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5704 Gigabit Ethernet (rev 03) Subsystem: Broadcom Corporation: Unknown device 1644 Flags: bus master, 66Mhz, medium devsel, latency 64, IRQ 217 Memory at dc430000 (64-bit, non-prefetchable) [size=64K] Memory at dc420000 (64-bit, non-prefetchable) [size=64K] [virtual] Expansion ROM at 88200000 [disabled] [size=64K] Capabilities: <available only to root> 0a:09.1 Ethernet controller: Broadcom Corporation NetXtreme BCM5704 Gigabit Ethernet (rev 03) Subsystem: Broadcom Corporation: Unknown device 1644 Flags: bus master, 66Mhz, medium devsel, latency 64, IRQ 225 Memory at dc450000 (64-bit, non-prefetchable) [size=64K] Memory at dc440000 (64-bit, non-prefetchable) [size=64K] [virtual] Expansion ROM at 88210000 [disabled] [size=64K] Capabilities: <available only to root>
syslog
Description: Binary data
Linux theboss.ape 2.6.17-1.2142_FC4smp #1 SMP Tue Jul 11 22:59:20 EDT 2006 x86_64 x86_64 x86_64 GNU/Linux
_______________________________________________ Ocfs2-users mailing list [email protected] http://oss.oracle.com/mailman/listinfo/ocfs2-users
