Günaydın, Loglarda ve sosreport logunda ilgili crash “reboot” neden olan hiçbir net bulguya bende rastlayamadığım için sizlerinde fikrini almak istedim. RedHat case açtırıp onlarada sordum onlarda crash neden olan sebebi tesbit edemediler. Sunucu sadece ilgili zamanda reboot olmuş görünüyor. Kdump configure edip sorun olursa oradan birşey yakalamaya çalışacağım. Dönüşünüz için tşkler.
Saygılarımla, Zekeriya YELTEPE From: linux-sunucu-boun...@liste.linux.org.tr <linux-sunucu-boun...@liste.linux.org.tr> On Behalf Of Kerem ERSOY Sent: 8 Ağustos 2018 Çarşamba 05:57 To: linux-sunucu@liste.linux.org.tr Subject: [Linux-sunucu] Re: Sunucu crash sorunu İyi ama o bahsettiğiniz mesaj informatif bir mesaj. Sadece Jurnal büyüklüğünü ve ayrılan alanı gösteriyor. Crash ile bir ilgisi olduğunu düşünmüyorum. Saygılarımızla / Kind Regards, Kerem ERSOY From: linux-sunucu-boun...@liste.linux.org.tr<mailto:linux-sunucu-boun...@liste.linux.org.tr> <linux-sunucu-boun...@liste.linux.org.tr<mailto:linux-sunucu-boun...@liste.linux.org.tr>> On Behalf Of Zekeriya YELTEPE Sent: 7 Ağustos 2018 Salı 08:22 To: linux-sunucu@liste.Linux.org.tr<mailto:linux-sunucu@liste.Linux.org.tr> Subject: [Linux-sunucu] Sunucu crash sorunu Günaydın, Yapımda oracle 11.2.0.4 DB’in çalıştığı RedHat 7.4 sunucum 04.08.2018 17:46 crash oldu. Messages loglara baktığımda crash süreci Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 125.8G available → current limit 4.0G). log ile başlıyor. Sunucu crash sonrası ayakta şu anda sorunsuz çalışıyor. Fakat yaşanan bu crash durumu, kernel güncellemeyi işaret etsede tam olarak sebebini ortaya koyamadım. Kernel versiyonum “3.10.0-693.21.1.el7.x86_64“ Tekrar yaşamadan sorunun kaynağını bulmam gerekiyor. Sizlerde göz atıp yorumlarınızı iletirseniz sevinirim. Aug 4 17:31:01 ynaproddb systemd: Created slice User Slice of root. Aug 4 17:31:01 ynaproddb systemd: Starting User Slice of root. Aug 4 17:31:01 ynaproddb systemd: Started Session 10240 of user root. Aug 4 17:31:01 ynaproddb systemd: Starting Session 10240 of user root. Aug 4 17:31:01 ynaproddb systemd: Removed slice User Slice of root. Aug 4 17:31:01 ynaproddb systemd: Stopping User Slice of root. Aug 4 17:31:10 ynaproddb python: 2018/08/04 17:31:10.522790 INFO ExtHandler Updated NIC state: [{ "name": "lo", "link": "<LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT qlen 1\ link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 promiscuity 0 addrgenmode eui64 " }, { "name": "virbr0", "link": "<NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN mode DEFAULT qlen 1000\ link/ether 52:54:00:94:55:e7 brd ff:ff:ff:ff:ff:ff promiscuity 0 \ bridge forward_delay 200 hello_time 200 max_age 2000 ageing_time 30000 stp_state 1 priority 32768 vlan_filtering 0 vlan_protocol 802.1Q bridge_id 8000.52:54:0:94:55:e7 designated_root 8000.52:54:0:94:55:e7 root_port 0 root_path_cost 0 topology_change 0 topology_change_detected 0 hello_timer 1.46 tcn_timer 0.00 topology_change_timer 0.00 gc_timer 248.81 vlan_default_pvid 1 group_fwd_mask 0 group_address 01:80:c2:00:00:00 mcast_snooping 1 mcast_router 1 mcast_query_use_ifaddr 0 mcast_querier 0 mcast_hash_elasticity 4 mcast_hash_max 512 mcast_last_member_count 2 mcast_startup_query_count 2 mcast_last_member_interval 100 mcast_membership_interval 26000 mcast_querier_interval 25500 mcast_query_interval 12500 mcast_query_response_interval 1000 mcast_startup_query_interval 3125 addrgenmode eui64 " }, { "name": "eth0", "link": "<BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT qlen 1000\ link/ether 00:0d:3a:43:ef:5e brd ff:ff:ff:ff:ff:ff promiscuity 0 addrgenmode eui64 " }] Aug 4 17:46:38 ynaproddb journal: Runtime journal is using 8.0M (max allowed 4.0G, trying to leave 4.0G free of 125.8G available → current limit 4.0G). Aug 4 17:46:38 ynaproddb kernel: Initializing cgroup subsys cpuset Aug 4 17:46:38 ynaproddb kernel: Initializing cgroup subsys cpu Aug 4 17:46:38 ynaproddb kernel: Initializing cgroup subsys cpuacct Aug 4 17:46:38 ynaproddb kernel: Linux version 3.10.0-693.21.1.el7.x86_64 (mockbu...@x86-040.build.eng.bos.redhat.com<mailto:mockbu...@x86-040.build.eng.bos.redhat.com>) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-16) (GCC) ) #1 SMP Fri Feb 23 18:54:16 UTC 2018 Aug 4 17:46:38 ynaproddb kernel: Command line: BOOT_IMAGE=/vmlinuz-3.10.0-693.21.1.el7.x86_64 root=/dev/mapper/rootvg-LV_root ro rootdelay=300 console=ttyS0 earlyprintk=ttyS0 crashkernel=auto rd.lvm.lv=rootvg/LV_root rd.lvm.lv=rootvg/LV_swap1 rd.lvm.lv=rootvg/LV_swap2 rhgb quiet Aug 4 17:46:38 ynaproddb kernel: e820: BIOS-provided physical RAM map: Aug 4 17:46:38 ynaproddb kernel: BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Aug 4 17:46:38 ynaproddb kernel: BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Aug 4 17:46:38 ynaproddb kernel: BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved Aug 4 17:46:38 ynaproddb kernel: BIOS-e820: [mem 0x0000000000100000-0x000000001ffeffff] usable Aug 4 17:46:38 ynaproddb kernel: BIOS-e820: [mem 0x000000001fff0000-0x000000001fffefff] ACPI data Aug 4 17:46:38 ynaproddb kernel: BIOS-e820: [mem 0x000000001ffff000-0x000000001fffffff] ACPI NVS Aug 4 17:46:38 ynaproddb kernel: BIOS-e820: [mem 0x0000000100000000-0x0000000fdfffffff] usable Aug 4 17:46:38 ynaproddb kernel: BIOS-e820: [mem 0x0000001000000000-0x00000020ffffffff] usable Aug 4 17:46:38 ynaproddb kernel: BIOS-e820: [mem 0x0000002100200000-0x00000041001fffff] usable Aug 4 17:46:38 ynaproddb kernel: bootconsole [earlyser0] enabled Aug 4 17:46:38 ynaproddb kernel: NX (Execute Disable) protection: active Aug 4 17:46:38 ynaproddb kernel: SMBIOS 2.3 present. Aug 4 17:46:38 ynaproddb kernel: Hypervisor detected: Microsoft HyperV Aug 4 17:46:38 ynaproddb kernel: HyperV: features 0x2e7f, hints 0x4c2c Aug 4 17:46:38 ynaproddb kernel: HyperV: LAPIC Timer Frequency: 0x30d40 Aug 4 17:46:38 ynaproddb kernel: tsc: Marking TSC unstable due to running on Hyper-V Aug 4 17:46:38 ynaproddb kernel: e820: last_pfn = 0x4100200 max_arch_pfn = 0x400000000 Aug 4 17:46:38 ynaproddb kernel: x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106 Aug 4 17:46:38 ynaproddb kernel: e820: last_pfn = 0x1fff0 max_arch_pfn = 0x400000000 Aug 4 17:46:38 ynaproddb kernel: found SMP MP-table at [mem 0x000ff780-0x000ff78f] mapped at [ffff8800000ff780] Aug 4 17:46:38 ynaproddb kernel: Using GB pages for direct mapping Aug 4 17:46:38 ynaproddb kernel: RAMDISK: [mem 0x1d5a9000-0x1f2bbfff] Aug 4 17:46:38 ynaproddb kernel: Early table checksum verification disabled Aug 4 17:46:38 ynaproddb kernel: ACPI: RSDP 00000000000f5bf0 00014 (v00 ACPIAM) Aug 4 17:46:38 ynaproddb kernel: ACPI: RSDT 000000001fff0000 00040 (v01 VRTUAL MICROSFT 06001702 MSFT 00000097) Aug 4 17:46:38 ynaproddb kernel: ACPI: FACP 000000001fff0200 00081 (v02 VRTUAL MICROSFT 06001702 MSFT 00000097) Aug 4 17:46:38 ynaproddb kernel: ACPI: DSDT 000000001fff1d24 03CBE (v01 MSFTVM MSFTVM02 00000002 INTL 02002026) Aug 4 17:46:38 ynaproddb kernel: ACPI: FACS 000000001ffff000 00040 Aug 4 17:46:38 ynaproddb kernel: ACPI: WAET 000000001fff1a80 00028 (v01 VRTUAL MICROSFT 06001702 MSFT 00000097) Aug 4 17:46:38 ynaproddb kernel: ACPI: SLIC 000000001fff1ac0 00176 (v01 VRTUAL MICROSFT 06001702 MSFT 00000097) Aug 4 17:46:38 ynaproddb kernel: ACPI: OEM0 000000001fff1cc0 00064 (v01 VRTUAL MICROSFT 06001702 MSFT 00000097) Aug 4 17:46:38 ynaproddb kernel: ACPI: SRAT 000000001fff0800 002C0 (v02 VRTUAL MICROSFT 00000001 MSFT 00000001) Aug 4 17:46:38 ynaproddb kernel: ACPI: APIC 000000001fff0300 00452 (v01 VRTUAL MICROSFT 06001702 MSFT 00000097) Aug 4 17:46:38 ynaproddb kernel: ACPI: OEMB 000000001ffff040 00064 (v01 VRTUAL MICROSFT 06001702 MSFT 00000097) Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 0 -> APIC 0x00 -> Node 0 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 0 -> APIC 0x01 -> Node 0 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 0 -> APIC 0x02 -> Node 0 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 0 -> APIC 0x03 -> Node 0 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 0 -> APIC 0x04 -> Node 0 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 0 -> APIC 0x05 -> Node 0 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 0 -> APIC 0x06 -> Node 0 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 0 -> APIC 0x07 -> Node 0 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 1 -> APIC 0x08 -> Node 1 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 1 -> APIC 0x09 -> Node 1 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 1 -> APIC 0x0a -> Node 1 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 1 -> APIC 0x0b -> Node 1 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 1 -> APIC 0x0c -> Node 1 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 1 -> APIC 0x0d -> Node 1 Aug 4 17:46:38 ynaproddb kernel: SRAT: PXM 1 -> APIC 0x0f -> Node 1 Aug 4 17:46:38 ynaproddb kernel: SRAT: Node 0 PXM 0 [mem 0x00000000-0x1fffffff] hotplug Aug 4 17:46:38 ynaproddb kernel: SRAT: Node 0 PXM 0 [mem 0x100000000-0xfdfffffff] hotplug Aug 4 17:46:38 ynaproddb kernel: SRAT: Node 0 PXM 0 [mem 0x1000000000-0x20ffffffff] hotplug Aug 4 17:46:38 ynaproddb kernel: SRAT: Node 1 PXM 1 [mem 0x2100200000-0x41001fffff] hotplug Aug 4 17:46:38 ynaproddb kernel: SRAT: Node 0 PXM 0 [mem 0x4100400000-0xa07fffffff] hotplug Aug 4 17:46:38 ynaproddb kernel: SRAT: Node 0 PXM 0 [mem 0x10000200000-0x17fffffffff] hotplug Aug 4 17:46:38 ynaproddb kernel: SRAT: Node 0 PXM 0 [mem 0x20000200000-0x2ffffffffff] hotplug Aug 4 17:46:38 ynaproddb kernel: SRAT: Node 1 PXM 1 [mem 0xa080200000-0xffffdfffff] hotplug Aug 4 17:46:38 ynaproddb kernel: SRAT: Node 1 PXM 1 [mem 0x18000200000-0x1ffffffffff] hotplug Aug 4 17:46:38 ynaproddb kernel: SRAT: Node 1 PXM 1 [mem 0x30000200000-0x3ffffffffff] hotplug Aug 4 17:46:38 ynaproddb kernel: NUMA: Node 0 [mem 0x00000000-0x1fffffff] + [mem 0x100000000-0xfdfffffff] -> [mem 0x00000000-0xfdfffffff] Aug 4 17:46:38 ynaproddb kernel: NUMA: Node 0 [mem 0x00000000-0xfdfffffff] + [mem 0x1000000000-0x20ffffffff] -> [mem 0x00000000-0x20ffffffff] Aug 4 17:46:38 ynaproddb kernel: NODE_DATA(0) allocated [mem 0x20fffd9000-0x20ffffffff] Aug 4 17:46:38 ynaproddb kernel: NODE_DATA(1) allocated [mem 0x41001d8000-0x41001fefff] Aug 4 17:46:38 ynaproddb kernel: Reserving 176MB of memory at 288MB for crashkernel (System RAM: 262143MB) Aug 4 17:46:38 ynaproddb kernel: Section 2079 and 2080 (node 1) have a circular dependency on usemap and pgdat allocations Aug 4 17:46:38 ynaproddb kernel: Zone ranges: Aug 4 17:46:38 ynaproddb kernel: DMA [mem 0x00001000-0x00ffffff] Aug 4 17:46:38 ynaproddb kernel: DMA32 [mem 0x01000000-0xffffffff] Aug 4 17:46:38 ynaproddb kernel: Normal [mem 0x100000000-0x41001fffff] Aug 4 17:46:38 ynaproddb kernel: Movable zone start for each node Aug 4 17:46:38 ynaproddb kernel: Early memory node ranges Aug 4 17:46:38 ynaproddb kernel: node 0: [mem 0x00001000-0x0009efff] Aug 4 17:46:38 ynaproddb kernel: node 0: [mem 0x00100000-0x1ffeffff] Aug 4 17:46:38 ynaproddb kernel: node 0: [mem 0x100000000-0xfdfffffff] Aug 4 17:46:38 ynaproddb kernel: node 0: [mem 0x1000000000-0x20ffffffff] Aug 4 17:46:38 ynaproddb kernel: node 1: [mem 0x2100200000-0x41001fffff] Aug 4 17:46:38 ynaproddb kernel: Initmem setup node 0 [mem 0x00001000-0x20ffffffff] Aug 4 17:46:38 ynaproddb kernel: Initmem setup node 1 [mem 0x2100200000-0x41001fffff] Aug 4 17:46:38 ynaproddb kernel: ACPI: PM-Timer IO Port: 0x408 Aug 4 17:46:38 ynaproddb kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled) Aug 4 17:46:38 ynaproddb kernel: Booting paravirtualized kernel on bare hardware Aug 4 17:46:38 ynaproddb kernel: setup_percpu: NR_CPUS:5120 nr_cpumask_bits:128 nr_cpu_ids:128 nr_node_ids:2 Aug 4 17:46:38 ynaproddb kernel: PERCPU: Embedded 35 pages/cpu @ffff88207ee00000 s104600 r8192 d30568 u262144 Aug 4 17:46:38 ynaproddb kernel: Built 2 zonelists in Zone order, mobility grouping on. Total pages: 66058105 Aug 4 17:46:38 ynaproddb kernel: Policy zone: Normal Aug 4 17:46:38 ynaproddb kernel: Kernel command line: BOOT_IMAGE=/vmlinuz-3.10.0-693.21.1.el7.x86_64 root=/dev/mapper/rootvg-LV_root ro rootdelay=300 console=ttyS0 earlyprintk=ttyS0 crashkernel=auto rd.lvm.lv=rootvg/LV_root rd.lvm.lv=rootvg/LV_swap1 rd.lvm.lv=rootvg/LV_swap2 rhgb quiet Aug 4 17:46:38 ynaproddb kernel: PID hash table entries: 4096 (order: 3, 32768 bytes) Aug 4 17:46:38 ynaproddb kernel: x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 Aug 4 17:46:38 ynaproddb kernel: xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form Aug 4 17:46:38 ynaproddb kernel: Memory: 4555072k/272631808k available (6940k kernel code, 4196808k absent, 4507660k reserved, 4560k data, 1792k init) Aug 4 17:46:38 ynaproddb kernel: SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=128, Nodes=2 Aug 4 17:46:38 ynaproddb kernel: x86/pti: Unmapping kernel while in userspace Aug 4 17:46:38 ynaproddb kernel: Hierarchical RCU implementation. Aug 4 17:46:38 ynaproddb kernel: #011RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=128. Aug 4 17:46:38 ynaproddb kernel: NR_IRQS:327936 nr_irqs:1448 0 Aug 4 17:46:38 ynaproddb kernel: Console: colour VGA+ 80x25 Aug 4 17:46:38 ynaproddb kernel: console [ttyS0] enabled, bootconsole disabled Aug 4 17:46:38 ynaproddb kernel: allocated 1074266112 bytes of page_cgroup Aug 4 17:46:38 ynaproddb kernel: please try 'cgroup_disable=memory' option if you don't want memory cgroups Aug 4 17:46:38 ynaproddb kernel: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl Aug 4 17:46:38 ynaproddb kernel: tsc: Fast TSC calibration failed Aug 4 17:46:38 ynaproddb kernel: tsc: Unable to calibrate against PIT Aug 4 17:46:38 ynaproddb kernel: tsc: using PMTIMER reference calibration Aug 4 17:46:38 ynaproddb kernel: tsc: Detected 2294.663 MHz processor Aug 4 17:46:38 ynaproddb kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 4589.32 BogoMIPS (lpj=2294663) Aug 4 17:46:38 ynaproddb kernel: pid_max: default: 131072 minimum: 1024 Aug 4 17:46:38 ynaproddb kernel: Security Framework initialized Aug 4 17:46:38 ynaproddb kernel: SELinux: Initializing. Aug 4 17:46:38 ynaproddb kernel: Yama: becoming mindful. Aug 4 17:46:38 ynaproddb kernel: Dentry cache hash table entries: 33554432 (order: 16, 268435456 bytes) Aug 4 17:46:38 ynaproddb kernel: Inode-cache hash table entries: 16777216 (order: 15, 134217728 bytes) Aug 4 17:46:38 ynaproddb kernel: Mount-cache hash table entries: 524288 (order: 10, 4194304 bytes) Aug 4 17:46:38 ynaproddb kernel: Mountpoint-cache hash table entries: 524288 (order: 10, 4194304 bytes) Yardımlarınız için şimdiden tşkler.
_______________________________________________ Linux-sunucu E-Posta Listesi Linux-sunucu@liste.linux.org.tr Liste kurallarını http://liste.linux.org.tr/kurallar.php bağlantısından okuyabilirsiniz; Bu Listede neden bulunduğunuzu bilmiyorsanız veya artık bu listeden gelen e-postaları almak istemiyorsanız aşağıdaki bağlantı adresini kullanarak 1 dakika içinde üyeliğinizi sonlandırabilirsiniz. https://liste.linux.org.tr/mailman/listinfo/linux-sunucu
