Re: errors on shutdown with PMP
Tejun Heo wrote: Marc Bejarano wrote: At 03:33 7/28/2007, Tejun Heo wrote: Device times out write. odd that it would be able to be part of an lv's filesystem that had hundreds of gigabytes recently written to it and then choke on flushing during shutdown. And then never comes back. asleep at the wheel ;) Please post the result of 'smartctl -a /dev/sdX' where sdX is the device which went offline. i suppose i should have seen that coming. here you go: === [EMAIL PROTECTED] ~]# /usr/local/sbin/smartctl -a /dev/sdc smartctl version 5.37 [x86_64-unknown-linux-gnu] Copyright (C) 2002-6 Bruce Allen Home page is http://smartmontools.sourceforge.net/ === START OF INFORMATION SECTION === Model Family: Seagate Barracuda 7200.10 family Device Model: ST3750640AS [--snip--] ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000f 090 079 006Pre-fail Always - 66902364 5 Reallocated_Sector_Ct 0x0033 100 100 036Pre-fail Always - 31 7 Seek_Error_Rate 0x000f 081 060 030Pre-fail Always - 146651228 195 Hardware_ECC_Recovered 0x001a 056 049 000Old_age Always - 102514302 198 Offline_Uncorrectable 0x0010 099 099 000Old_age Offline - 40 Counters don't look too friendly. Do you happen to have another drive of the same model? If so, can you post smartctl -a of the drive? Offline_Uncorrectable looks bad, as well as Reallocated_Sector_Ct... For Raw_Read_Error_Rate/Seek_Error_Rate/Hardware_ECC_Recovered it is how Seagates work: gwy:~# for a in /dev/sd[a-f]; do smartctl -a $a; done | grep '\(Raw_Read\|Seek_Error\|Hardware_ECC\|Offline_Uncorr\|Reallocated\|^Device M\|^Firmware\)' Device Model: Hitachi HDT725032VLA380 Firmware Version: V54OA52A 1 Raw_Read_Error_Rate 0x000b 100 100 016Pre-fail Always - 0 5 Reallocated_Sector_Ct 0x0033 100 100 005Pre-fail Always - 0 7 Seek_Error_Rate 0x000b 100 100 067Pre-fail Always - 0 196 Reallocated_Event_Count 0x0032 100 100 000Old_age Always - 0 198 Offline_Uncorrectable 0x0008 100 100 000Old_age Offline - 0 Device Model: Hitachi HDS721010KLA330 Firmware Version: GKAOA70F 1 Raw_Read_Error_Rate 0x000b 100 100 016Pre-fail Always - 0 5 Reallocated_Sector_Ct 0x0033 100 100 005Pre-fail Always - 0 7 Seek_Error_Rate 0x000b 100 100 067Pre-fail Always - 0 196 Reallocated_Event_Count 0x0032 100 100 000Old_age Always - 0 198 Offline_Uncorrectable 0x0008 100 100 000Old_age Offline - 0 Device Model: ST3750640AS Firmware Version: 3.AAE 1 Raw_Read_Error_Rate 0x000f 110 087 006Pre-fail Always - 201790283 5 Reallocated_Sector_Ct 0x0033 100 100 036Pre-fail Always - 0 7 Seek_Error_Rate 0x000f 076 060 030Pre-fail Always - 43520234 195 Hardware_ECC_Recovered 0x001a 059 050 000Old_age Always - 40212951 198 Offline_Uncorrectable 0x0010 100 100 000Old_age Offline - 0 Device Model: Hitachi HDS721010KLA330 Firmware Version: GKAOA70F 1 Raw_Read_Error_Rate 0x000b 100 100 016Pre-fail Always - 0 5 Reallocated_Sector_Ct 0x0033 100 100 005Pre-fail Always - 0 7 Seek_Error_Rate 0x000b 100 100 067Pre-fail Always - 0 196 Reallocated_Event_Count 0x0032 100 100 000Old_age Always - 0 198 Offline_Uncorrectable 0x0008 100 100 000Old_age Offline - 0 Device Model: ST3750640AS Firmware Version: 3.AAD 1 Raw_Read_Error_Rate 0x000f 114 083 006Pre-fail Always - 121388046 5 Reallocated_Sector_Ct 0x0033 100 100 036Pre-fail Always - 0 7 Seek_Error_Rate 0x000f 078 065 030Pre-fail Always - 78605591 195 Hardware_ECC_Recovered 0x001a 066 050 000Old_age Always - 194670617 198 Offline_Uncorrectable 0x0010 100 100 000Old_age Offline - 0 Device Model: Sans Digital V.36.B0D Firmware Version: V.36.B0D BTW, sdb-sde are behind PMP, no problems on shutdown. Funniest is that all these counters are 32bit, so during day you see like your disk is estimated to die in 5 days, then suddenly that 32bit counter overflows, and your disk is again healthy as possible. I did not measure what these counters actually count on these 750GB drives, but on 100GB notebook Seagate drive every sector read counts as 3-5 ECC errors, and every Smart data interrogation as 1...
Re: errors on shutdown with PMP
At 00:32 7/31/2007, Tejun Heo wrote: Marc Bejarano wrote: At 03:33 7/28/2007, Tejun Heo wrote: Please post the result of 'smartctl -a /dev/sdX' where sdX is the device which went offline. i suppose i should have seen that coming. here you go: === [EMAIL PROTECTED] ~]# /usr/local/sbin/smartctl -a /dev/sdc smartctl version 5.37 [x86_64-unknown-linux-gnu] Copyright (C) 2002-6 Bruce Allen Home page is http://smartmontools.sourceforge.net/ === START OF INFORMATION SECTION === Model Family: Seagate Barracuda 7200.10 family Device Model: ST3750640AS [--snip--] ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000f 090 079 006Pre-fail Always - 66902364 5 Reallocated_Sector_Ct 0x0033 100 100 036Pre-fail Always - 31 7 Seek_Error_Rate 0x000f 081 060 030Pre-fail Always - 146651228 195 Hardware_ECC_Recovered 0x001a 056 049 000Old_age Always - 102514302 198 Offline_Uncorrectable 0x0010 099 099 000Old_age Offline - 40 Counters don't look too friendly. Do you happen to have another drive of the same model? about 100 or so of them ;) If so, can you post smartctl -a of the drive? here are the other two drives in the unhappy lv: === [EMAIL PROTECTED] ~]# smartctl -a /dev/sdg smartctl version 5.33 [x86_64-redhat-linux-gnu] Copyright (C) 2002-4 Bruce Allen Home page is http://smartmontools.sourceforge.net/ Device: ATA ST3750640AS Version: 3.AA Serial number: 5QD05VBA Device type: disk Local Time is: Tue Jul 31 12:14:00 2007 EDT Device does not support SMART Request Sense failed, [Input/output error] Error Counter logging not supported Error Events logging not supported [GLTSD (Global Logging Target Save Disable) set. Enable Save with '-S on'] Device does not support Self Test logging [EMAIL PROTECTED] ~]# /usr/local/sbin/smartctl -a /dev/sdg smartctl version 5.37 [x86_64-unknown-linux-gnu] Copyright (C) 2002-6 Bruce Allen Home page is http://smartmontools.sourceforge.net/ === START OF INFORMATION SECTION === Model Family: Seagate Barracuda 7200.10 family Device Model: ST3750640AS Serial Number:5QD05VBA Firmware Version: 3.AAE User Capacity:750,156,374,016 bytes Device is:In smartctl database [for details use: -P show] ATA Version is: 7 ATA Standard is: Exact ATA specification draft version not indicated Local Time is:Tue Jul 31 12:14:11 2007 EDT SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x82) Offline data collection activity was completed without error. Auto Offline Data Collection: Enabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: ( 430) seconds. Offline data collection capabilities:(0x5b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. No Conveyance Self-test supported. Selective Self-test supported. SMART capabilities:(0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability:(0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time:( 1) minutes. Extended self-test routine recommended polling time:( 202) minutes. SMART Attributes Data Structure revision number: 10 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000f 091 082 006Pre-fail Always - 226717799 3 Spin_Up_Time0x0003 093 093 000Pre-fail Always - 0 4 Start_Stop_Count0x0032 100 100 020Old_age Always - 13 5 Reallocated_Sector_Ct 0x0033 100 100 036Pre-fail Always - 15 7 Seek_Error_Rate 0x000f 081 060 030
Re: errors on shutdown with PMP
Hello, Marc Bejarano wrote: Counters don't look too friendly. Do you happen to have another drive of the same model? about 100 or so of them ;) Cool. If so, can you post smartctl -a of the drive? here are the other two drives in the unhappy lv: [--snip--] 5 Reallocated_Sector_Ct 0x0033 100 100 036Pre-fail Always - 15 198 Offline_Uncorrectable 0x0010 100 100 000Old_age Offline - 0 [--snip--] 5 Reallocated_Sector_Ct 0x0033 100 100 036Pre-fail Always - 0 198 Offline_Uncorrectable 0x0010 100 100 000Old_age Offline - 0 Offline uncorrectable is zero on both drives. I think it's likely that the not-responding drive is faulty. Note that write command usually complete right after it fills the buffer, so write errors often show up on cache flush. Also, write failure usually means that even reallocation failed and the drive is in pretty bad shape. Thanks. -- tejun - To unsubscribe from this list: send the line unsubscribe linux-ide in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: errors on shutdown with PMP
At 03:33 7/28/2007, Tejun Heo wrote: Device times out write. odd that it would be able to be part of an lv's filesystem that had hundreds of gigabytes recently written to it and then choke on flushing during shutdown. And then never comes back. asleep at the wheel ;) Please post the result of 'smartctl -a /dev/sdX' where sdX is the device which went offline. i suppose i should have seen that coming. here you go: === [EMAIL PROTECTED] ~]# /usr/local/sbin/smartctl -a /dev/sdc smartctl version 5.37 [x86_64-unknown-linux-gnu] Copyright (C) 2002-6 Bruce Allen Home page is http://smartmontools.sourceforge.net/ === START OF INFORMATION SECTION === Model Family: Seagate Barracuda 7200.10 family Device Model: ST3750640AS Serial Number:5QD05YFC Firmware Version: 3.AAE User Capacity:750,156,374,016 bytes Device is:In smartctl database [for details use: -P show] ATA Version is: 7 ATA Standard is: Exact ATA specification draft version not indicated Local Time is:Mon Jul 30 23:00:27 2007 EDT SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x82) Offline data collection activity was completed without error. Auto Offline Data Collection: Enabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: ( 430) seconds. Offline data collection capabilities:(0x5b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. No Conveyance Self-test supported. Selective Self-test supported. SMART capabilities:(0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability:(0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time:( 1) minutes. Extended self-test routine recommended polling time:( 202) minutes. SMART Attributes Data Structure revision number: 10 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000f 090 079 006Pre-fail Always - 66902364 3 Spin_Up_Time0x0003 093 093 000Pre-fail Always - 0 4 Start_Stop_Count0x0032 100 100 020Old_age Always - 13 5 Reallocated_Sector_Ct 0x0033 100 100 036Pre-fail Always - 31 7 Seek_Error_Rate 0x000f 081 060 030Pre-fail Always - 146651228 9 Power_On_Hours 0x0032 098 098 000Old_age Always - 2190 10 Spin_Retry_Count0x0013 100 100 097Pre-fail Always - 0 12 Power_Cycle_Count 0x0032 100 100 020Old_age Always - 25 187 Unknown_Attribute 0x0032 001 001 000Old_age Always - 810 189 Unknown_Attribute 0x003a 100 100 000Old_age Always - 0 190 Temperature_Celsius 0x0022 063 057 045Old_age Always - 68647119028261 194 Temperature_Celsius 0x0022 037 043 000Old_age Always - 37 (Lifetime Min/Max 0/32) 195 Hardware_ECC_Recovered 0x001a 056 049 000Old_age Always - 102514302 197 Current_Pending_Sector 0x0012 099 099 000Old_age Always - 40 198 Offline_Uncorrectable 0x0010 099 099 000Old_age Offline - 40 199 UDMA_CRC_Error_Count0x003e 200 200 000Old_age Always - 0 200 Multi_Zone_Error_Rate 0x 100 253 000Old_age Offline - 0 202 TA_Increase_Count 0x0032 100 253 000Old_age Always - 0 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 100 Not_testing 200
Re: errors on shutdown with PMP
Marc Bejarano wrote: At 03:33 7/28/2007, Tejun Heo wrote: Device times out write. odd that it would be able to be part of an lv's filesystem that had hundreds of gigabytes recently written to it and then choke on flushing during shutdown. And then never comes back. asleep at the wheel ;) Please post the result of 'smartctl -a /dev/sdX' where sdX is the device which went offline. i suppose i should have seen that coming. here you go: === [EMAIL PROTECTED] ~]# /usr/local/sbin/smartctl -a /dev/sdc smartctl version 5.37 [x86_64-unknown-linux-gnu] Copyright (C) 2002-6 Bruce Allen Home page is http://smartmontools.sourceforge.net/ === START OF INFORMATION SECTION === Model Family: Seagate Barracuda 7200.10 family Device Model: ST3750640AS [--snip--] ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000f 090 079 006Pre-fail Always - 66902364 5 Reallocated_Sector_Ct 0x0033 100 100 036Pre-fail Always - 31 7 Seek_Error_Rate 0x000f 081 060 030Pre-fail Always - 146651228 195 Hardware_ECC_Recovered 0x001a 056 049 000Old_age Always - 102514302 198 Offline_Uncorrectable 0x0010 099 099 000Old_age Offline - 40 Counters don't look too friendly. Do you happen to have another drive of the same model? If so, can you post smartctl -a of the drive? -- tejun - To unsubscribe from this list: send the line unsubscribe linux-ide in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: errors on shutdown with PMP
Hello, Marc. Marc Bejarano wrote: hi, tejun. i've been using your libata-tj-2.6.22-rc6-20070702 kernel on a centos 4 machine for a while with some 3124's and 3726's. up until today, i hadn't seen any issues. while trying to shut the machine down, this happened: === Jul 27 14:58:44 dell shutdown: shutting down for system halt Jul 27 14:59:15 dell kernel: ata8.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x2 frozen Jul 27 14:59:15 dell kernel: ata8.00: cmd 61/10:00:a7:0a:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 8192 out Jul 27 14:59:15 dell kernel: res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout) Device times out write. Jul 27 14:59:15 dell kernel: ata8.15: hard resetting link Jul 27 14:59:17 dell kernel: ata8.15: SATA link up 3.0 Gbps (SStatus 123 SControl 0) Jul 27 14:59:17 dell kernel: ata8.00: hard resetting link Jul 27 14:59:27 dell kernel: ata8.00: softreset failed (timeout) Jul 27 14:59:27 dell kernel: ata8.00: hard resetting link Jul 27 14:59:28 dell kernel: ata8.00: COMRESET failed (errno=-5) Jul 27 14:59:28 dell kernel: ata8.00: reset failed, giving up Jul 27 14:59:28 dell kernel: ata8.15: hard resetting link Jul 27 14:59:38 dell kernel: ata8.15: softreset failed (timeout) Jul 27 14:59:38 dell kernel: ata8.15: hard resetting link Jul 27 14:59:40 dell kernel: ata8.15: SATA link up 3.0 Gbps (SStatus 123 SControl 0) Jul 27 14:59:40 dell kernel: ata8.00: hard resetting link Jul 27 14:59:50 dell kernel: ata8.00: softreset failed (timeout) Jul 27 14:59:50 dell kernel: ata8.00: hard resetting link Jul 27 14:59:51 dell kernel: ata8.00: COMRESET failed (errno=-5) Jul 27 14:59:51 dell kernel: ata8.00: reset failed, giving up Jul 27 14:59:51 dell kernel: ata8.15: hard resetting link Jul 27 15:00:01 dell kernel: ata8.15: softreset failed (timeout) Jul 27 15:00:01 dell kernel: ata8.15: hard resetting link Jul 27 15:00:03 dell kernel: ata8.15: SATA link up 3.0 Gbps (SStatus 123 SControl 0) Jul 27 15:00:03 dell kernel: ata8.00: hard resetting link Jul 27 15:00:13 dell kernel: ata8.00: softreset failed (timeout) Jul 27 15:00:13 dell kernel: ata8.00: hard resetting link Jul 27 15:00:14 dell kernel: ata8.00: COMRESET failed (errno=-5) Jul 27 15:00:14 dell kernel: ata8.00: reset failed, giving up Jul 27 15:00:14 dell kernel: ata8.00: failed to recover link after 3 tries, disabling Jul 27 15:00:14 dell kernel: ata8.00: disabled And then never comes back. Please post the result of 'smartctl -a /dev/sdX' where sdX is the device which went offline. -- tejun - To unsubscribe from this list: send the line unsubscribe linux-ide in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html
errors on shutdown with PMP
hi, tejun. i've been using your libata-tj-2.6.22-rc6-20070702 kernel on a centos 4 machine for a while with some 3124's and 3726's. up until today, i hadn't seen any issues. while trying to shut the machine down, this happened: === Jul 27 14:58:44 dell shutdown: shutting down for system halt Jul 27 14:59:15 dell kernel: ata8.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x2 frozen Jul 27 14:59:15 dell kernel: ata8.00: cmd 61/10:00:a7:0a:00/00:00:00:00:00/40 tag 0 cdb 0x0 data 8192 out Jul 27 14:59:15 dell kernel: res 40/00:00:00:00:00/00:00:00:00:00/00 Emask 0x4 (timeout) Jul 27 14:59:15 dell kernel: ata8.15: hard resetting link Jul 27 14:59:17 dell kernel: ata8.15: SATA link up 3.0 Gbps (SStatus 123 SControl 0) Jul 27 14:59:17 dell kernel: ata8.00: hard resetting link Jul 27 14:59:27 dell kernel: ata8.00: softreset failed (timeout) Jul 27 14:59:27 dell kernel: ata8.00: hard resetting link Jul 27 14:59:28 dell kernel: ata8.00: COMRESET failed (errno=-5) Jul 27 14:59:28 dell kernel: ata8.00: reset failed, giving up Jul 27 14:59:28 dell kernel: ata8.15: hard resetting link Jul 27 14:59:38 dell kernel: ata8.15: softreset failed (timeout) Jul 27 14:59:38 dell kernel: ata8.15: hard resetting link Jul 27 14:59:40 dell kernel: ata8.15: SATA link up 3.0 Gbps (SStatus 123 SControl 0) Jul 27 14:59:40 dell kernel: ata8.00: hard resetting link Jul 27 14:59:50 dell kernel: ata8.00: softreset failed (timeout) Jul 27 14:59:50 dell kernel: ata8.00: hard resetting link Jul 27 14:59:51 dell kernel: ata8.00: COMRESET failed (errno=-5) Jul 27 14:59:51 dell kernel: ata8.00: reset failed, giving up Jul 27 14:59:51 dell kernel: ata8.15: hard resetting link Jul 27 15:00:01 dell kernel: ata8.15: softreset failed (timeout) Jul 27 15:00:01 dell kernel: ata8.15: hard resetting link Jul 27 15:00:03 dell kernel: ata8.15: SATA link up 3.0 Gbps (SStatus 123 SControl 0) Jul 27 15:00:03 dell kernel: ata8.00: hard resetting link Jul 27 15:00:13 dell kernel: ata8.00: softreset failed (timeout) Jul 27 15:00:13 dell kernel: ata8.00: hard resetting link Jul 27 15:00:14 dell kernel: ata8.00: COMRESET failed (errno=-5) Jul 27 15:00:14 dell kernel: ata8.00: reset failed, giving up Jul 27 15:00:14 dell kernel: ata8.00: failed to recover link after 3 tries, disabling Jul 27 15:00:14 dell kernel: ata8.00: disabled Jul 27 15:00:14 dell kernel: ata8: failed to recover PMP, retrying in 5 secs Jul 27 15:00:19 dell kernel: ata8.15: hard resetting link Jul 27 15:00:29 dell kernel: ata8.15: softreset failed (timeout) Jul 27 15:00:29 dell kernel: ata8.15: hard resetting link Jul 27 15:00:32 dell kernel: ata8.15: SATA link up 3.0 Gbps (SStatus 123 SControl 0) Jul 27 15:00:32 dell kernel: ata8.01: hard resetting link Jul 27 15:00:33 dell kernel: ata8.01: SATA link up 3.0 Gbps (SStatus 123 SControl 300) Jul 27 15:00:33 dell kernel: ata8.02: hard resetting link Jul 27 15:00:33 dell kernel: ata8.02: SATA link up 3.0 Gbps (SStatus 123 SControl 300) Jul 27 15:00:33 dell kernel: ata8.03: hard resetting link Jul 27 15:00:34 dell kernel: ata8.03: SATA link up 1.5 Gbps (SStatus 113 SControl 300) Jul 27 15:00:34 dell kernel: ata8.04: hard resetting link Jul 27 15:00:35 dell kernel: ata8.04: SATA link down (SStatus 0 SControl 300) Jul 27 15:00:35 dell kernel: ata8.05: hard resetting link Jul 27 15:00:35 dell kernel: ata8.05: SATA link up 1.5 Gbps (SStatus 113 SControl 300) Jul 27 15:00:35 dell kernel: ata8.01: configured for UDMA/100 Jul 27 15:00:35 dell kernel: ata8.02: configured for UDMA/100 Jul 27 15:00:35 dell kernel: ata8.03: configured for UDMA/100 Jul 27 15:00:35 dell kernel: sd 7:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE,SUGGEST_OK Jul 27 15:00:35 dell kernel: sd 7:0:0:0: [sdc] Sense Key : Aborted Command [current] [descriptor] Jul 27 15:00:35 dell kernel: Descriptor sense data with sense descriptors (in hex): Jul 27 15:00:35 dell kernel: 72 0b 00 00 00 00 00 0c 00 0a 80 00 00 00 00 00 Jul 27 15:00:35 dell kernel: 00 00 00 00 Jul 27 15:00:35 dell kernel: sd 7:0:0:0: [sdc] Add. Sense: No additional sense information Jul 27 15:00:35 dell kernel: end_request: I/O error, dev sdc, sector 2727 Jul 27 15:00:35 dell kernel: ata8: EH complete Jul 27 15:00:35 dell kernel: sd 7:0:0:0: rejecting I/O to offline device Jul 27 15:00:35 dell kernel: Buffer I/O error on device dm-4, logical block 1055 Jul 27 15:00:35 dell kernel: lost page write due to I/O error on dm-4 Jul 27 15:00:35 dell kernel: Aborting journal on device dm-4. Jul 27 15:00:35 dell kernel: journal commit I/O error Jul 27 15:00:36 dell kernel: sd 7:0:1:0: [sdd] 488397168 512-byte hardware sectors (250059 MB) Jul 27 15:00:36 dell kernel: sd 7:0:1:0: [sdd] Write Protect is off Jul 27 15:00:36 dell kernel: sd 7:0:1:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Jul 27 15:00:36 dell kernel: sd 7:0:2:0: [sde] 488397168 512-byte hardware sectors (250059 MB) Jul 27 15:00:36 dell kernel: sd