RE: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
> > Am 17.10.18 um 10:14 schrieb Christoph Hellwig: > > On Tue, Oct 16, 2018 at 07:33:53PM +0200, Stefan Priebe - Profihost AG > wrote: > >> Hi David, > >> > >> can you give as any hint? We're running aroud 120 Adaptec Controllers > >> and i don't want to replace them all... > > > > 4.15 had a fair amount of aacraid changes. You can't bisect them by > > any chance? > > > I'm not able to reproduce the issue. It happens once a week out of nothing... > > Stefan Hi Stefan, So far, I haven't been able to see the issue ... The system is just doing some normal I/O from fio, But I haven't seen anything so far ... Will keep looking ... Thanks, -Dave
Re: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
Am 17.10.18 um 10:14 schrieb Christoph Hellwig: > On Tue, Oct 16, 2018 at 07:33:53PM +0200, Stefan Priebe - Profihost AG wrote: >> Hi David, >> >> can you give as any hint? We're running aroud 120 Adaptec Controllers >> and i don't want to replace them all... > > 4.15 had a fair amount of aacraid changes. You can't bisect them by > any chance? > I'm not able to reproduce the issue. It happens once a week out of nothing... Stefan
Re: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
On Tue, Oct 16, 2018 at 07:33:53PM +0200, Stefan Priebe - Profihost AG wrote: > Hi David, > > can you give as any hint? We're running aroud 120 Adaptec Controllers > and i don't want to replace them all... 4.15 had a fair amount of aacraid changes. You can't bisect them by any chance?
Re: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
Hi David, can you give as any hint? We're running aroud 120 Adaptec Controllers and i don't want to replace them all... Greets, Stefan Am 27.09.2018 um 14:23 schrieb Stefan Priebe - Profihost AG: > > Am 27.09.2018 um 12:59 schrieb Emmanuel Florac: >> Le Wed, 19 Sep 2018 08:10:41 +0200 >> Stefan Priebe - Profihost AG écrivait: >> >>> Hello, >>> >>> after upgrading the aacraid driver / kernel from aacraid 50792 to >>> aacraid 50877. >>> >>> I get aborted comands every night. >>> >> >> I have exactly the same problem since 4.15 was out, and nobody >> answered... aacraid doesn't work properly neither with ASR7xx5 or >> ASR8xx5 cards. > > Than it must be something different. ASR7 and ASR8 cards work fine for > me. Only series ASR6 cards trigger Host adapter abort request under high > load. > > Stefan >
Re: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
Hi Dave, Am 03.10.2018 um 19:32 schrieb dave.carr...@microchip.com: >> Am 27.09.2018 um 12:59 schrieb Emmanuel Florac: >>> Le Wed, 19 Sep 2018 08:10:41 +0200 >>> Stefan Priebe - Profihost AG écrivait: >>> Hello, after upgrading the aacraid driver / kernel from aacraid 50792 to aacraid 50877. I get aborted comands every night. >>> >>> I have exactly the same problem since 4.15 was out, and nobody >>> answered... aacraid doesn't work properly neither with ASR7xx5 or >>> ASR8xx5 cards. >> >> Than it must be something different. ASR7 and ASR8 cards work fine for me. >> Only series ASR6 cards trigger Host adapter abort request under high load. >> >> Stefan > > Hi All, > > Sorry for the delay in responding ... We have looked into the ASR7, and ASR8, > and cannot reproduce the issue. as i already said - i have no problems with ASR7 or 8 series. They work fine to me. > With Series-6 in the mix, we will also try that. There hasn't been a change > which should impact any of these issues. I have run S7/S8 all the way through > 4.19-rc5 and have not seen the issue. I'll get someone to test the S6 issue. > We haven't forgotten about this, just haven't been able to see the issue. Thanks that would be great. I'm not sure whether this is driver related or an issue with PCIe or ASPM code in the kernel? Greets, Stefan
RE: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
> Am 27.09.2018 um 12:59 schrieb Emmanuel Florac: > > Le Wed, 19 Sep 2018 08:10:41 +0200 > > Stefan Priebe - Profihost AG écrivait: > > > >> Hello, > >> > >> after upgrading the aacraid driver / kernel from aacraid 50792 to > >> aacraid 50877. > >> > >> I get aborted comands every night. > >> > > > > I have exactly the same problem since 4.15 was out, and nobody > > answered... aacraid doesn't work properly neither with ASR7xx5 or > > ASR8xx5 cards. > > Than it must be something different. ASR7 and ASR8 cards work fine for me. > Only series ASR6 cards trigger Host adapter abort request under high load. > > Stefan Hi All, Sorry for the delay in responding ... We have looked into the ASR7, and ASR8, and cannot reproduce the issue. With Series-6 in the mix, we will also try that. There hasn't been a change which should impact any of these issues. I have run S7/S8 all the way through 4.19-rc5 and have not seen the issue. I'll get someone to test the S6 issue. We haven't forgotten about this, just haven't been able to see the issue. Thanks, -Dave
Re: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
Am 27.09.2018 um 12:59 schrieb Emmanuel Florac: > Le Wed, 19 Sep 2018 08:10:41 +0200 > Stefan Priebe - Profihost AG écrivait: > >> Hello, >> >> after upgrading the aacraid driver / kernel from aacraid 50792 to >> aacraid 50877. >> >> I get aborted comands every night. >> > > I have exactly the same problem since 4.15 was out, and nobody > answered... aacraid doesn't work properly neither with ASR7xx5 or > ASR8xx5 cards. Than it must be something different. ASR7 and ASR8 cards work fine for me. Only series ASR6 cards trigger Host adapter abort request under high load. Stefan
Re: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
Le Mon, 24 Sep 2018 08:11:20 +0200 Stefan Priebe - Profihost AG écrivait: > all series 6 controllers are those with problems when high load > happens. > As I mentioned in my messages to the ML since late june, the driver doesn't work either with 7xx5 and 8xx5 controllers. Who's maintaining this driver? -- Emmanuel Florac | Direction technique | Intellique | | +33 1 78 94 84 02 pgp3m6dCcF7E3.pgp Description: Signature digitale OpenPGP
Re: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
Le Sun, 23 Sep 2018 20:22:56 +0200 Stefan Priebe - Profihost AG écrivait: > Am 22.09.2018 um 23:40 schrieb Bart Van Assche: > > On 9/18/18 11:10 PM, Stefan Priebe - Profihost AG wrote: > >> after upgrading the aacraid driver / kernel from aacraid 50792 to > >> aacraid 50877. > > > > The aacraid driver version was updated to 50792 in commit > > 0662cc968ace ("scsi: aacraid: Update driver version") and to 50877 > > in commit 1cdb74b80f93 ("scsi: aacraid: Update driver version to > > 50877"). That means that the regression you encountered got > > introduced after commit 0662cc968ace. 114 changes got checked in > > after that commit. That's too much to find the root cause by > > rereading all these changes. Is there any way to trigger the > > problem faster such that it becomes feasible to run a bisect? > > Sadly i'm not able. May be also something else in the kernel has > changed. > > I'm now trying the original out of tree driver from microsemi / > adaptec: Adaptec aacraid driver 1.2.1.56008src > > No idea how those driver versions corespond to the kernel ones. I can tell you that the last working version for me is 50834. You can find the version number in aacraid.h, that's the value of the AAC_DRIVER_BUILD constant. the 50877 driver has been broken since it was out several months ago! -- Emmanuel Florac | Direction technique | Intellique | | +33 1 78 94 84 02 pgpnWeRtVzBvT.pgp Description: Signature digitale OpenPGP
Re: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
Le Wed, 19 Sep 2018 08:10:41 +0200 Stefan Priebe - Profihost AG écrivait: > Hello, > > after upgrading the aacraid driver / kernel from aacraid 50792 to > aacraid 50877. > > I get aborted comands every night. > I have exactly the same problem since 4.15 was out, and nobody answered... aacraid doesn't work properly neither with ASR7xx5 or ASR8xx5 cards. -- Emmanuel Florac | Direction technique | Intellique | | +33 1 78 94 84 02 pgpONEVFsp4Xf.pgp Description: Signature digitale OpenPGP
Re: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
Am 23.09.2018 um 20:22 schrieb Stefan Priebe - Profihost AG: > > Am 22.09.2018 um 23:40 schrieb Bart Van Assche: >> On 9/18/18 11:10 PM, Stefan Priebe - Profihost AG wrote: >>> after upgrading the aacraid driver / kernel from aacraid 50792 to >>> aacraid 50877. >> >> The aacraid driver version was updated to 50792 in commit 0662cc968ace >> ("scsi: aacraid: Update driver version") and to 50877 in commit >> 1cdb74b80f93 ("scsi: aacraid: Update driver version to 50877"). That >> means that the regression you encountered got introduced after commit >> 0662cc968ace. 114 changes got checked in after that commit. That's too >> much to find the root cause by rereading all these changes. Is there any >> way to trigger the problem faster such that it becomes feasible to run a >> bisect? > > Sadly i'm not able. May be also something else in the kernel has changed. > > I'm now trying the original out of tree driver from microsemi / adaptec: > Adaptec aacraid driver 1.2.1.56008src > > No idea how those driver versions corespond to the kernel ones. OK the out of tree also timed out and the whole system went unreachable. The output just looked different: 2018-09-24 03:00:29 aacraid :03:00.0: AAC0:aac_eh_abort:Host adapter abort request (0,0,1,0) 2018-09-24 03:00:29 aacraid :03:00.0: AAC0:aac_eh_abort:Timed out Command: 2a 00 c0 98 6f a2 00 00 28 00 00 00 00 00 00 00 2018-09-24 03:00:29 aacraid :03:00.0: AAC0:aac_eh_abort:FIB = 950ca6706780 : bac49220 Command = 502 XferState = 830ad Wait Time = 120Sec 2018-09-24 03:00:29 aacraid :03:00.0: AAC0:aac_eh_abort:Host adapter abort request (0,0,1,0) 2018-09-24 03:00:29 aacraid :03:00.0: AAC0:aac_eh_abort:Timed out Command: 2a 00 c0 98 6d a2 00 02 00 00 00 00 00 00 00 00 2018-09-24 03:00:29 aacraid :03:00.0: AAC0:aac_eh_abort:FIB = 950ca67066c8 : bac48a00 Command = 502 XferState = 830ad Wait Time = 120Sec 2018-09-24 03:00:29 aacraid :03:00.0: AAC0:aac_eh_abort:Host adapter abort request (0,0,1,0) 2018-09-24 03:00:29 aacraid :03:00.0: AAC0:aac_eh_abort:Timed out Command: 2a 00 c0 98 6b a2 00 02 00 00 00 00 00 00 00 00 2018-09-24 03:00:29 aacraid :03:00.0: AAC0:aac_eh_abort:FIB = 950ca6706610 : bac481e0 Command = 502 XferState = 830ad Wait Time = 120Sec 2018-09-24 03:00:29 aacraid :03:00.0: AAC0:aac_eh_abort:Host adapter abort request (0,0,1,0) 2018-09-24 03:00:29 aacraid :03:00.0: AAC0:aac_eh_abort:Timed out Command: 2a 00 c0 98 69 a2 00 02 00 00 00 00 00 00 00 00 2018-09-24 03:00:29 aacraid :03:00.0: AAC0:aac_eh_abort:FIB = 950ca6706558 : bac479c0 Command = 502 XferState = 830ad Wait Time = 120Sec all series 6 controllers are those with problems when high load happens. Greets, Stefan > >> $ git log 0662cc968ace..master drivers/scsi/aacraid | grep -c ^commit >> 114 >> >> Bart.
Re: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
Am 22.09.2018 um 23:40 schrieb Bart Van Assche: > On 9/18/18 11:10 PM, Stefan Priebe - Profihost AG wrote: >> after upgrading the aacraid driver / kernel from aacraid 50792 to >> aacraid 50877. > > The aacraid driver version was updated to 50792 in commit 0662cc968ace > ("scsi: aacraid: Update driver version") and to 50877 in commit > 1cdb74b80f93 ("scsi: aacraid: Update driver version to 50877"). That > means that the regression you encountered got introduced after commit > 0662cc968ace. 114 changes got checked in after that commit. That's too > much to find the root cause by rereading all these changes. Is there any > way to trigger the problem faster such that it becomes feasible to run a > bisect? Sadly i'm not able. May be also something else in the kernel has changed. I'm now trying the original out of tree driver from microsemi / adaptec: Adaptec aacraid driver 1.2.1.56008src No idea how those driver versions corespond to the kernel ones. Greets, Stefan > $ git log 0662cc968ace..master drivers/scsi/aacraid | grep -c ^commit > 114 > > Bart.
Re: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
On 9/18/18 11:10 PM, Stefan Priebe - Profihost AG wrote: after upgrading the aacraid driver / kernel from aacraid 50792 to aacraid 50877. The aacraid driver version was updated to 50792 in commit 0662cc968ace ("scsi: aacraid: Update driver version") and to 50877 in commit 1cdb74b80f93 ("scsi: aacraid: Update driver version to 50877"). That means that the regression you encountered got introduced after commit 0662cc968ace. 114 changes got checked in after that commit. That's too much to find the root cause by rereading all these changes. Is there any way to trigger the problem faster such that it becomes feasible to run a bisect? $ git log 0662cc968ace..master drivers/scsi/aacraid | grep -c ^commit 114 Bart.
Re: aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
nobody? Greets, Stefan Am 19.09.2018 um 08:10 schrieb Stefan Priebe - Profihost AG: > Hello, > > after upgrading the aacraid driver / kernel from aacraid 50792 to > aacraid 50877. > > I get aborted comands every night. > > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009056] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009056] > aacraid: Outstanding commands on (0,0,0,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009108] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009108] > aacraid: Outstanding commands on (0,0,0,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009152] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009152] > aacraid: Outstanding commands on (0,0,0,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009192] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009192] > aacraid: Outstanding commands on (0,0,0,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009233] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009233] > aacraid: Outstanding commands on (0,0,0,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009273] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009273] > aacraid: Outstanding commands on (0,0,1,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009313] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009313] > aacraid: Outstanding commands on (0,0,1,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009352] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009352] > aacraid: Outstanding commands on (0,0,1,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009392] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009392] > aacraid: Outstanding commands on (0,0,1,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009433] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009433] > aacraid: Outstanding commands on (0,0,1,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009473] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009473] > aacraid: Outstanding commands on (0,0,1,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009513] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009513] > aacraid: Outstanding commands on (0,0,1,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009553] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009553] > aacraid: Outstanding commands on (0,0,1,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009592] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009592] > aacraid: Outstanding commands on (0,0,1,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.010887] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.010887] > aacraid: Outstanding commands on (0,0,1,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.012127] > aacraid: Host adapter abort request. > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.012127] > aacraid: Outstanding commands on (0,0,1,0): > kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.013341] > aacraid: Host adapter abort request. > ... > kern-20180830.gz:Aug 30 01:56:08 server1044-han kernel: [63734.999227] > aacraid: Host adapter reset request. SCSI hang ? > kern-20180830.gz:Aug 30 01:56:24 server1044-han kernel: [63750.343146] > aacraid: Host adapter reset request. SCSI hang ? > kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.703859] > aacraid: Host adapter reset request. SCSI hang ? > kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.704457] > aacraid :03:00.0: outstanding cmd: midlevel-0 > kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.705021] > aacraid :03:00.0: outstanding cmd: lowlevel-0 > kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.705556] > aacraid :03:00.0: outstanding cmd: error handler-0 > kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.706087] > aacraid :03:00.0: outstanding cmd: firmware-120 > kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.706612] > aacra
aacraid: latest driver results in Host adapter abort request. / Outstanding commands on (0,0,0,0):
Hello, after upgrading the aacraid driver / kernel from aacraid 50792 to aacraid 50877. I get aborted comands every night. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009056] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009056] aacraid: Outstanding commands on (0,0,0,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009108] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009108] aacraid: Outstanding commands on (0,0,0,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009152] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009152] aacraid: Outstanding commands on (0,0,0,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009192] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009192] aacraid: Outstanding commands on (0,0,0,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009233] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009233] aacraid: Outstanding commands on (0,0,0,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009273] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009273] aacraid: Outstanding commands on (0,0,1,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009313] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009313] aacraid: Outstanding commands on (0,0,1,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009352] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009352] aacraid: Outstanding commands on (0,0,1,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009392] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009392] aacraid: Outstanding commands on (0,0,1,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009433] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009433] aacraid: Outstanding commands on (0,0,1,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009473] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009473] aacraid: Outstanding commands on (0,0,1,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009513] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009513] aacraid: Outstanding commands on (0,0,1,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009553] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009553] aacraid: Outstanding commands on (0,0,1,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009592] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.009592] aacraid: Outstanding commands on (0,0,1,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.010887] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.010887] aacraid: Outstanding commands on (0,0,1,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.012127] aacraid: Host adapter abort request. kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.012127] aacraid: Outstanding commands on (0,0,1,0): kern-20180830.gz:Aug 30 01:55:26 server1044-han kernel: [63693.013341] aacraid: Host adapter abort request. ... kern-20180830.gz:Aug 30 01:56:08 server1044-han kernel: [63734.999227] aacraid: Host adapter reset request. SCSI hang ? kern-20180830.gz:Aug 30 01:56:24 server1044-han kernel: [63750.343146] aacraid: Host adapter reset request. SCSI hang ? kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.703859] aacraid: Host adapter reset request. SCSI hang ? kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.704457] aacraid :03:00.0: outstanding cmd: midlevel-0 kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.705021] aacraid :03:00.0: outstanding cmd: lowlevel-0 kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.705556] aacraid :03:00.0: outstanding cmd: error handler-0 kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.706087] aacraid :03:00.0: outstanding cmd: firmware-120 kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.706612] aacraid :03:00.0: outstanding cmd: kernel-0 kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.707160] aacraid :03:00.0: Controller reset type is 3 kern-20180830.gz:Aug 30 01:56:39 server1044-han kernel: [63765.708066] aacraid :03:00.0: Issuing IO