Hi Sreekanth, I have bisected the issue down to commit <https://git.kernel.org/cgit/linux/kernel/git/stable/linux-stable.git/commit/?id=52f518a3a7c2f80551a38d38be28bc9f335e713c> "x86/MSI: Use hierarchical irqdomains to manage MSI interrupts".
The timeout happens reliably after two warm boots with a 'bad' kernel after coming from a 'good' kernel, and also after one cold boot with a 'bad' kernel (meaning cold booting a 'bad' kernel leads directly to the timeout and warm booting needs a second run to produce the timeout). I haven't tested bare metal yet - I can do that tomorrow if necessary. Here is the bisect log: > Bisecting: a merge base must be tested > [b953c0d234bc72e8489d3bf51a276c5c4ec85345] Linux 4.1 > Bisecting: 7475 revisions left to test after this (roughly 13 steps) > [c11d716218910c3aa2bac1bb641e6086ad649555] Merge tag 'armsoc-cleanup' of > git://git.kernel.org/pub/scm/linux/kernel/git/arm/arm-soc > Bisecting: 4008 revisions left to test after this (roughly 12 steps) > [8a8c35fadfaf55629a37ef1a8ead1b8fb32581d2] mm: kmemleak_alloc_percpu() should > follow the gfp from per_alloc() > Bisecting: 1680 revisions left to test after this (roughly 11 steps) > [10b4b096d0c7e9f1b5f84c2a0658b2963e1e6ed0] Merge tag 'gpio-v4.2-1' of > git://git.kernel.org/pub/scm/linux/kernel/git/linusw/linux-gpio > Bisecting: 793 revisions left to test after this (roughly 10 steps) > [e75c73ad64478c12b3a44b86a3e7f62a4f65b93e] Merge branch 'x86-fpu-for-linus' > of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip > Bisecting: 380 revisions left to test after this (roughly 9 steps) > [407a2c720556e8e340e06f6a7174f5d6d80cf9ea] Merge branch 'irq-core-for-linus' > of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip > Bisecting: 210 revisions left to test after this (roughly 8 steps) > [539f5113650068ba221197f190267ab727296ef5] x86/asm/entry/64: Disentangle > error_entry/exit gsbase/ebx/usermode code > Bisecting: 98 revisions left to test after this (roughly 7 steps) > [191a66353b22fad8ac89404ab4c929cbe7b0afb2] Merge branch 'x86/asm' into > x86/apic, to resolve a conflict > Bisecting: 51 revisions left to test after this (roughly 6 steps) > [099c5c03487f6bca30c628e14e666788dd61fb33] irq_remapping/vt-d: Move struct > irq_2_iommu into intel_irq_remapping.c > Bisecting: 25 revisions left to test after this (roughly 5 steps) > [90d84fe95dd6b418383aa0e0e5cace8f1b1e7e30] x86/MSI: Replace msi_update_msg() > with irq_chip_compose_msi_msg() > Bisecting: 12 revisions left to test after this (roughly 4 steps) > [3cb96f0c97330834929abe9bd2ca3c252a83def0] x86/hpet: Enhance HPET IRQ to > support hierarchical irqdomains > Bisecting: 6 revisions left to test after this (roughly 3 steps) > [b1855c752e67d1125d41fadb499014b49a245db8] x86/MSI: Clean up unused MSI > related code and interfaces > Bisecting: 2 revisions left to test after this (roughly 2 steps) > [2b43817e481da9f5118adb56aef46b3f0298c685] irq_remapping/vt-d: Clean up > unused MSI related code > Bisecting: 0 revisions left to test after this (roughly 1 step) > [80aa283364a17998dceb577bd185e3380b927544] x86/irq: Directly call > native_compose_msi_msg() for DMAR IRQ > Bisecting: 0 revisions left to test after this (roughly 0 steps) > [52f518a3a7c2f80551a38d38be28bc9f335e713c] x86/MSI: Use hierarchical > irqdomains to manage MSI interrupts > 52f518a3a7c2f80551a38d38be28bc9f335e713c is the first bad commit > commit 52f518a3a7c2f80551a38d38be28bc9f335e713c > Author: Jiang Liu <jiang....@linux.intel.com> > Date: Mon Apr 13 14:11:35 2015 +0800 > > x86/MSI: Use hierarchical irqdomains to manage MSI interrupts > > Enhance MSI code to support hierarchical irqdomains, it helps to make > the architecture more clear. > > Signed-off-by: Jiang Liu <jiang....@linux.intel.com> > Cc: Konrad Rzeszutek Wilk <konrad.w...@oracle.com> > Cc: David Cohen <david.a.co...@linux.intel.com> > Cc: Sander Eikelenboom <li...@eikelenboom.it> > Cc: David Vrabel <david.vra...@citrix.com> > Cc: Tony Luck <tony.l...@intel.com> > Cc: Greg Kroah-Hartman <gre...@linuxfoundation.org> > Cc: io...@lists.linux-foundation.org > Cc: Joerg Roedel <jroe...@suse.de> > Cc: Bjorn Helgaas <bhelg...@google.com> > Cc: Benjamin Herrenschmidt <b...@kernel.crashing.org> > Cc: Rafael J. Wysocki <r...@rjwysocki.net> > Cc: Randy Dunlap <rdun...@infradead.org> > Cc: Yinghai Lu <ying...@kernel.org> > Cc: Borislav Petkov <b...@alien8.de> > Cc: Dimitri Sivanich <sivan...@sgi.com> > Cc: Joerg Roedel <j...@8bytes.org> > Link: > http://lkml.kernel.org/r/1428905519-23704-14-git-send-email-jiang....@linux.intel.com > Signed-off-by: Thomas Gleixner <t...@linutronix.de> > > :040000 040000 786bcad9a3fad413e0b744e2cfa20da7ff402db6 > 22618cac66dee85a7752bb3af81169fff3a242d8 M arch > :040000 040000 acee54015803d4cd52d582a9e5e93aa56ad08482 > 40d2c7a02c0f8677e596c98c936404b2211336a3 M drivers --- Matthias Am 22.03.2016 um 22:02 schrieb Matthias Prager: > Hi Sreekanth, > > Am 22.03.2016 um 11:52 schrieb Sreekanth Reddy: >> Hi Matthias, >> >> Thanks for providing detail explanation. >> >> Currently I am trying to reproduce this issue locally. I have used the >> same HBA card but still I am not able to reproduce this issue on 4.5 >> kernel. >> >> I will try for few more times and I will also try to get the diff >> between 4.1 to 4.5 kernels w.r.t msix vectors support. > I will try to bisect this tomorrow. And I will try to reproduce this > outside the VM environment on bare metal. > >> >> Meanwhile can you please provide me the output of "lspci -vvv" command >> for LSI SAS2 HBA's and also hexdump of config sysfs parameter for SAS2 >> pci device. I need this data to be collected before "timeout" print is >> observed, or in the mpt3sas_base.c file and in the >> mpt3sas_base_attach(). return from mpt3sas_base_attach() function if >> return value of mpt3sas_base_map_resources() is non zero instead of >> freeing the resources, as shown below >> >> --------------------------------------------------------------------------- >> r = mpt3sas_base_map_resources(ioc); >> if (r) >> - goto out_free_resources; >> + return r; >> ----------------------------------------------------------------------------- > I will get you this data tomorrow too. > >> >> Also are you sure that this issue won't occur on less than 4.1 kernel? > Yes definitely - I never observed these timeouts with any kernel > <=4.1.20, and I started seeing them from kernel 4.2.1 onward (I haven't > actually tested 4.2.0 yet). > >> >> Thanks, >> Sreekanth >> >> On Mon, Mar 21, 2016 at 10:00 PM, Matthias Prager >> <li...@matthiasprager.de> wrote: >>> Am 21.03.2016 um 16:52 schrieb Matthias Prager: >>>> Hi Sreekanth, >>>> >>>> thanks for digging into this issue. Regarding the 4.5.0 after 4.1.20 >>>> boot statement, I will try to express myself better: >>>> >>>> I first started the system with the 4.1.20 kernel. Then I issued an >>>> 'init 6' warm-reboot and chose to boot the 4.5.0 kernel. This procedure >>>> often works (i.e. I'm able to boot the newer kernels (>=4.2) this way >>>> with mpt2sas initializing just fine). >>> One small addition: warm-rebooting kernel 4.5.0 from kernel 4.5.0 >>> reliably leads to this issue manifesting (mpt2sas driver not initializing). >>> >>>> >>>> I will try the msix_disable parameter and report back. Maybe kernel >>>> version 4.2 broke interrupt handling somehow? >>> With the msix_disable parameter set kernels 4.5.0, 4.4.5, 4.3.3 and >>> 4.2.1 boot without the mpt2sas init issue. I also tried the pci=nomsi >>> paremeter instead, which also works fine. >>> >>> The igb ethernet-driver issue I mentioned as possibly related has not >>> changed with pci=nomsi. So I'm assuming it is not the same issue, but >>> possibly related, since it also occurs on kernels >=4.2. >>> >>>> >>>> --- >>>> Matthias >>>> >>>> >>>> Am 21.03.2016 um 14:59 schrieb Sreekanth Reddy: >>>>> Hi Matthias, >>>>> >>>>> Thanks for providing the logs. In these logs, I am not observing any >>>>> such a prints which should be suspected for this issue. >>>>> >>>>> Can you please try once by setting mpt3sas driver's "msix_disable" >>>>> module parameter to one. >>>>> >>>>> Also, can you please elaborate below statement for me, I am not able >>>>> understand this statement >>>>> "I managed to boot the same 4.5.0 kernel successfully after warm >>>>> rebooting from 4.1.20" >>>>> >>>>> Thanks, >>>>> Sreekanth >>>>> >>>>> On Mon, Mar 21, 2016 at 2:48 PM, Matthias Prager >>>>> <li...@matthiasprager.de> wrote: >>>>>> Hi Sreekanth, >>>>>> >>>>>> thank you for replying so quickly. Here are the logs you requested >>>>>> (kernel 4.5.0): >>>>>> >>>>>>> [ 2.083177] mpt3sas version 09.102.00.00 loaded >>>>>>> [ 2.083757] mpt2sas_cm0: mpt3sas_base_attach >>>>>>> [ 2.083956] mpt2sas_cm0: mpt3sas_base_map_resources >>>>>>> [ 2.084708] mpt2sas_cm0: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, >>>>>>> total mem (3074748 kB) >>>>>>> [ 2.084964] mpt2sas_cm0: _base_get_ioc_facts >>>>>>> [ 2.085154] mpt2sas_cm0: _base_wait_for_iocstate >>>>>>> [ 2.140893] offset:data >>>>>>> [ 2.141082] [0x00]:03100200 >>>>>>> [ 2.141257] [0x04]:00002300 >>>>>>> [ 2.141432] [0x08]:00000000 >>>>>>> [ 2.141606] [0x0c]:00000000 >>>>>>> [ 2.141780] [0x10]:00000000 >>>>>>> [ 2.141955] [0x14]:00010480 >>>>>>> [ 2.142129] [0x18]:22130d68 >>>>>>> [ 2.142303] [0x1c]:0001285c >>>>>>> [ 2.142477] [0x20]:14000400 >>>>>>> [ 2.142651] [0x24]:00000020 >>>>>>> [ 2.142825] [0x28]:0100000f >>>>>>> [ 2.143000] [0x2c]:000c000b >>>>>>> [ 2.143174] [0x30]:003c0003 >>>>>>> [ 2.143349] [0x34]:0020ffe0 >>>>>>> [ 2.143544] [0x38]:00800122 >>>>>>> [ 2.143719] [0x3c]:00000009 >>>>>>> [ 2.143895] mpt2sas_cm0: hba queue depth(3432), max chains per >>>>>>> io(128) >>>>>>> [ 2.144106] mpt2sas_cm0: request frame size(128), reply frame >>>>>>> size(128) >>>>>>> [ 2.144397] mpt2sas_cm0: msix is supported, vector_count(1) >>>>>>> [ 2.144600] mpt2sas_cm0: MSI-X vectors supported: 1, no of cores: 4, >>>>>>> max_msix_vectors: -1 >>>>>>> [ 2.145161] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 58 >>>>>>> [ 2.145361] mpt2sas_cm0: iomem(0x00000000fd4fc000), >>>>>>> mapped(0xffffc900000d0000), size(16384) >>>>>>> [ 2.145591] mpt2sas_cm0: ioport(0x0000000000004000), size(256) >>>>>>> [ 2.146206] mpt2sas_cm0: _base_get_ioc_facts >>>>>>> [ 2.146397] mpt2sas_cm0: _base_wait_for_iocstate >>>>>>> [ 2.202087] offset:data >>>>>>> [ 2.202281] [0x00]:03100200 >>>>>>> [ 2.202456] [0x04]:00002300 >>>>>>> [ 2.202631] [0x08]:00000000 >>>>>>> [ 2.202805] [0x0c]:00000000 >>>>>>> [ 2.202980] [0x10]:00000000 >>>>>>> [ 2.203154] [0x14]:00010480 >>>>>>> [ 2.203328] [0x18]:22130d68 >>>>>>> [ 2.203521] [0x1c]:0001285c >>>>>>> [ 2.203695] [0x20]:14000400 >>>>>>> [ 2.203870] [0x24]:00000020 >>>>>>> [ 2.204044] [0x28]:0100000f >>>>>>> [ 2.204219] [0x2c]:000c000b >>>>>>> [ 2.204394] [0x30]:003c0003 >>>>>>> [ 2.204571] [0x34]:0020ffe0 >>>>>>> [ 2.204746] [0x38]:00800122 >>>>>>> [ 2.204926] [0x3c]:00000009 >>>>>>> [ 2.205102] mpt2sas_cm0: hba queue depth(3432), max chains per >>>>>>> io(128) >>>>>>> [ 2.205314] mpt2sas_cm0: request frame size(128), reply frame >>>>>>> size(128) >>>>>>> [ 2.205528] mpt2sas_cm0: _base_make_ioc_ready >>>>>>> [ 2.205719] mpt2sas_cm0: _base_get_port_facts >>>>>>> [ 2.234205] offset:data >>>>>>> [ 2.234397] [0x00]:05070000 >>>>>>> [ 2.234573] [0x04]:00000000 >>>>>>> [ 2.234748] [0x08]:00000000 >>>>>>> [ 2.234928] [0x0c]:00000000 >>>>>>> [ 2.235103] [0x10]:00000000 >>>>>>> [ 2.235278] [0x14]:00003000 >>>>>>> [ 2.235453] [0x18]:00000078 >>>>>>> [ 2.235629] mpt2sas_cm0: _base_allocate_memory_pools >>>>>>> [ 2.235826] mpt2sas_cm0: scatter gather: sge_in_main_msg(3), >>>>>>> sge_per_chain(15), sge_per_io(128), chains_per_io(9) >>>>>>> [ 2.236227] mpt2sas_cm0: reply post free pool (0xffff8800bb380000): >>>>>>> depth(6944),element_size(8), pool_size(54 kB) >>>>>>> [ 2.236611] mpt2sas_cm0: reply_post_free_dma = (0xbb380000) >>>>>>> [ 2.236813] mpt2sas_cm0: scsi host: can_queue depth (3307) >>>>>>> [ 2.237086] mpt2sas_cm0: request pool(0xffff8800ba880000): >>>>>>> depth(3432), frame_size(128), pool_size(429 kB) >>>>>>> [ 2.238580] mpt2sas_cm0: request pool: dma(0xba880000) >>>>>>> [ 2.238781] mpt2sas_cm0: scsiio(0xffff8800ba880000): depth(3307) >>>>>>> [ 2.243644] mpt2sas_cm0: chain pool depth(29763), frame_size(128), >>>>>>> pool_size(3720 kB) >>>>>>> [ 2.243887] mpt2sas_cm0: hi_priority(0xffff8800ba8e7600): depth(60), >>>>>>> start smid(3308) >>>>>>> [ 2.244113] mpt2sas_cm0: internal(0xffff8800ba8e9400): depth(65), >>>>>>> start smid(3368) >>>>>>> [ 2.244390] mpt2sas_cm0: sense pool(0xffff8800ba480000): >>>>>>> depth(3307), element_size(96), pool_size(310 kB) >>>>>>> [ 2.244774] mpt2sas_cm0: sense_dma(0xba480000) >>>>>>> [ 2.245038] mpt2sas_cm0: reply pool(0xffff8800ba500000): >>>>>>> depth(3496), frame_size(128), pool_size(437 kB) >>>>>>> [ 2.245413] mpt2sas_cm0: reply_dma(0xba500000) >>>>>>> [ 2.245608] mpt2sas_cm0: reply_free pool(0xffff8800ba430000): >>>>>>> depth(3496), element_size(4), pool_size(13 kB) >>>>>>> [ 2.245985] mpt2sas_cm0: reply_free_dma (0xba430000) >>>>>>> [ 2.246181] mpt2sas_cm0: config page(0xffff8800ba429000): size(512) >>>>>>> [ 2.246389] mpt2sas_cm0: config_page_dma(0xba429000) >>>>>>> [ 2.246584] mpt2sas_cm0: Allocated physical memory: size(4964 kB) >>>>>>> [ 2.246791] mpt2sas_cm0: Current Controller Queue Depth(3307),Max >>>>>>> Controller Queue Depth(3432) >>>>>>> [ 2.247155] mpt2sas_cm0: Scatter Gather Elements per IO(128) >>>>>>> [ 2.247361] mpt2sas_cm0: _base_make_ioc_operational >>>>>>> [ 2.247962] mpt2sas_cm0: _base_send_ioc_init >>>>>>> [ 2.248154] offset:data >>>>>>> [ 2.248325] [0x00]:02000004 >>>>>>> [ 2.248499] [0x04]:00000000 >>>>>>> [ 2.248673] [0x08]:00000000 >>>>>>> [ 2.248848] [0x0c]:23000200 >>>>>>> [ 2.249023] [0x10]:00000000 >>>>>>> [ 2.249197] [0x14]:00000000 >>>>>>> [ 2.249372] [0x18]:00200000 >>>>>>> [ 2.249546] [0x1c]:0da81b20 >>>>>>> [ 2.249720] [0x20]:00000000 >>>>>>> [ 2.249894] [0x24]:00000000 >>>>>>> [ 2.250068] [0x28]:ba880000 >>>>>>> [ 2.250242] [0x2c]:00000000 >>>>>>> [ 2.250416] [0x30]:bb380000 >>>>>>> [ 2.250589] [0x34]:00000000 >>>>>>> [ 2.250768] [0x38]:ba430000 >>>>>>> [ 2.250941] [0x3c]:00000000 >>>>>>> [ 2.251115] [0x40]:983eb686 >>>>>>> [ 2.251288] [0x44]:00000153 >>>>>>> [ 2.296610] offset:data >>>>>>> [ 2.296795] [0x00]:02050004 >>>>>>> [ 2.296969] [0x04]:00000000 >>>>>>> [ 2.297143] [0x08]:00000000 >>>>>>> [ 2.297318] [0x0c]:00000000 >>>>>>> [ 2.297493] [0x10]:00000000 >>>>>>> [ 2.297668] mpt2sas_cm0: _base_event_notification >>>>>>> [ 5.093707] floppy0: no floppy controllers found >>>>>>> [ 32.293619] mpt2sas_cm0: _base_event_notification: timeout >>>>>>> [ 32.293909] mf: >>>>>>> >>>>>>> [ 32.294132] 07000000 >>>>>>> [ 32.294397] 00000000 >>>>>>> [ 32.294445] 00000000 >>>>>>> [ 32.294719] 00000000 >>>>>>> [ 32.294767] 00000000 >>>>>>> [ 32.295031] 0f2f7fff >>>>>>> [ 32.295078] ffffff7c >>>>>>> [ 32.295342] ffffffff >>>>>>> [ 32.295389] >>>>>>> >>>>>>> [ 32.295823] ffffffff >>>>>>> [ 32.295871] 00000000 >>>>>>> [ 32.296134] 00000000 >>>>>>> >>>>>>> [ 32.296615] mpt2sas_cm0: mpt3sas_base_free_resources >>>>>>> [ 32.296880] mpt2sas_cm0: _base_make_ioc_ready >>>>>>> [ 32.297135] mpt2sas_cm0: sending message unit reset !! >>>>>>> [ 32.298941] mpt2sas_cm0: message unit reset: SUCCESS >>>>>>> [ 32.299212] mpt2sas_cm0: mpt3sas_base_unmap_resources >>>>>>> [ 32.300381] mpt2sas_cm0: _base_release_memory_pools >>>>>>> [ 32.300654] mpt2sas_cm0: request_pool(0xffff8800ba880000): free >>>>>>> [ 32.300934] mpt2sas_cm0: sense_pool(0xffff8800ba480000): free >>>>>>> [ 32.301211] mpt2sas_cm0: reply_pool(0xffff8800ba500000): free >>>>>>> [ 32.301485] mpt2sas_cm0: reply_free_pool(0xffff8800ba430000): free >>>>>>> [ 32.301774] mpt2sas_cm0: reply_post_free_pool(0xffff8800bb380000): >>>>>>> free >>>>>>> [ 32.302061] mpt2sas_cm0: config_page(0xffff8800ba429000): free >>>>>>> [ 32.371097] mpt2sas_cm0: failure at >>>>>>> drivers/scsi/mpt3sas/mpt3sas_scsih.c:8592/_scsih_probe()! >>>>>>> [ 32.371958] mpt2sas_cm1: mpt3sas_base_attach >>>>>>> [ 32.372154] mpt2sas_cm1: mpt3sas_base_map_resources >>>>>>> [ 32.372950] mpt2sas_cm1: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, >>>>>>> total mem (3074748 kB) >>>>>>> [ 32.373201] mpt2sas_cm1: _base_get_ioc_facts >>>>>>> [ 32.375261] mpt2sas_cm1: _base_wait_for_iocstate >>>>>>> [ 32.432012] offset:data >>>>>>> [ 32.432262] [0x00]:03100200 >>>>>>> [ 32.432499] [0x04]:00002300 >>>>>>> [ 32.432735] [0x08]:00000000 >>>>>>> [ 32.432971] [0x0c]:00000000 >>>>>>> [ 32.433206] [0x10]:00000000 >>>>>>> [ 32.433443] [0x14]:00010480 >>>>>>> [ 32.433701] [0x18]:22130d68 >>>>>>> [ 32.433937] [0x1c]:0001285c >>>>>>> [ 32.435434] [0x20]:14000400 >>>>>>> [ 32.435674] [0x24]:00000020 >>>>>>> [ 32.435909] [0x28]:0100000f >>>>>>> [ 32.436144] [0x2c]:000c000b >>>>>>> [ 32.436379] [0x30]:003c0003 >>>>>>> [ 32.436615] [0x34]:0020ffe0 >>>>>>> [ 32.436850] [0x38]:00800122 >>>>>>> [ 32.437085] [0x3c]:00000009 >>>>>>> [ 32.437322] mpt2sas_cm1: hba queue depth(3432), max chains per >>>>>>> io(128) >>>>>>> [ 32.437607] mpt2sas_cm1: request frame size(128), reply frame >>>>>>> size(128) >>>>>>> [ 32.438014] mpt2sas_cm1: msix is supported, vector_count(1) >>>>>>> [ 32.438288] mpt2sas_cm1: MSI-X vectors supported: 1, no of cores: 4, >>>>>>> max_msix_vectors: 8 >>>>>>> [ 32.439101] mpt2sas1-msix0: PCI-MSI-X enabled: IRQ 58 >>>>>>> [ 32.439373] mpt2sas_cm1: iomem(0x00000000fd1fc000), >>>>>>> mapped(0xffffc900000d8000), size(16384) >>>>>>> [ 32.439682] mpt2sas_cm1: ioport(0x0000000000007000), size(256) >>>>>>> [ 32.440504] mpt2sas_cm1: _base_get_ioc_facts >>>>>>> [ 32.440765] mpt2sas_cm1: _base_wait_for_iocstate >>>>>>> [ 32.499305] offset:data >>>>>>> [ 32.499557] [0x00]:03100200 >>>>>>> [ 32.499794] [0x04]:00002300 >>>>>>> [ 32.500031] [0x08]:00000000 >>>>>>> [ 32.500267] [0x0c]:00000000 >>>>>>> [ 32.500504] [0x10]:00000000 >>>>>>> [ 32.500740] [0x14]:00010480 >>>>>>> [ 32.500974] [0x18]:22130d68 >>>>>>> [ 32.501209] [0x1c]:0001285c >>>>>>> [ 32.501444] [0x20]:14000400 >>>>>>> [ 32.501687] [0x24]:00000020 >>>>>>> [ 32.501922] [0x28]:0100000f >>>>>>> [ 32.502157] [0x2c]:000c000b >>>>>>> [ 32.502391] [0x30]:003c0003 >>>>>>> [ 32.502626] [0x34]:0020ffe0 >>>>>>> [ 32.502862] [0x38]:00800122 >>>>>>> [ 32.503098] [0x3c]:00000009 >>>>>>> [ 32.503336] mpt2sas_cm1: hba queue depth(3432), max chains per >>>>>>> io(128) >>>>>>> [ 32.503644] mpt2sas_cm1: request frame size(128), reply frame >>>>>>> size(128) >>>>>>> [ 32.503933] mpt2sas_cm1: _base_make_ioc_ready >>>>>>> [ 32.504191] mpt2sas_cm1: _base_get_port_facts >>>>>>> [ 32.534282] offset:data >>>>>>> [ 32.534537] [0x00]:05070000 >>>>>>> [ 32.534782] [0x04]:00000000 >>>>>>> [ 32.535058] [0x08]:00000000 >>>>>>> [ 32.536473] [0x0c]:00000000 >>>>>>> [ 32.536710] [0x10]:00000000 >>>>>>> [ 32.536946] [0x14]:00003000 >>>>>>> [ 32.537183] [0x18]:00000078 >>>>>>> [ 32.537420] mpt2sas_cm1: _base_allocate_memory_pools >>>>>>> [ 32.537686] mpt2sas_cm1: scatter gather: sge_in_main_msg(3), >>>>>>> sge_per_chain(15), sge_per_io(128), chains_per_io(9) >>>>>>> [ 32.538232] mpt2sas_cm1: reply post free pool (0xffff8800bb3d0000): >>>>>>> depth(6944),element_size(8), pool_size(54 kB) >>>>>>> [ 32.538758] mpt2sas_cm1: reply_post_free_dma = (0xbb3d0000) >>>>>>> [ 32.539030] mpt2sas_cm1: scsi host: can_queue depth (3307) >>>>>>> [ 32.539378] mpt2sas_cm1: request pool(0xffff8800ba480000): >>>>>>> depth(3432), frame_size(128), pool_size(429 kB) >>>>>>> [ 32.539882] mpt2sas_cm1: request pool: dma(0xba480000) >>>>>>> [ 32.540149] mpt2sas_cm1: scsiio(0xffff8800ba480000): depth(3307) >>>>>>> [ 32.545893] mpt2sas_cm1: chain pool depth(29763), frame_size(128), >>>>>>> pool_size(3720 kB) >>>>>>> [ 32.546137] mpt2sas_cm1: hi_priority(0xffff8800ba4e7600): depth(60), >>>>>>> start smid(3308) >>>>>>> [ 32.546365] mpt2sas_cm1: internal(0xffff8800ba4e9400): depth(65), >>>>>>> start smid(3368) >>>>>>> [ 32.546651] mpt2sas_cm1: sense pool(0xffff8800ba880000): >>>>>>> depth(3307), element_size(96), pool_size(310 kB) >>>>>>> [ 32.547030] mpt2sas_cm1: sense_dma(0xba880000) >>>>>>> [ 32.547537] mpt2sas_cm1: reply pool(0xffff880000100000): >>>>>>> depth(3496), frame_size(128), pool_size(437 kB) >>>>>>> [ 32.547921] mpt2sas_cm1: reply_dma(0x100000) >>>>>>> [ 32.548117] mpt2sas_cm1: reply_free pool(0xffff8800ba964000): >>>>>>> depth(3496), element_size(4), pool_size(13 kB) >>>>>>> [ 32.548500] mpt2sas_cm1: reply_free_dma (0xba964000) >>>>>>> [ 32.548698] mpt2sas_cm1: config page(0xffff8800ba960000): size(512) >>>>>>> [ 32.548908] mpt2sas_cm1: config_page_dma(0xba960000) >>>>>>> [ 32.549105] mpt2sas_cm1: Allocated physical memory: size(4964 kB) >>>>>>> [ 32.549314] mpt2sas_cm1: Current Controller Queue Depth(3307),Max >>>>>>> Controller Queue Depth(3432) >>>>>>> [ 32.550950] mpt2sas_cm1: Scatter Gather Elements per IO(128) >>>>>>> [ 32.551160] mpt2sas_cm1: _base_make_ioc_operational >>>>>>> [ 32.551855] mpt2sas_cm1: _base_send_ioc_init >>>>>>> [ 32.552051] offset:data >>>>>>> [ 32.552224] [0x00]:02000004 >>>>>>> [ 32.552400] [0x04]:00000000 >>>>>>> [ 32.552576] [0x08]:00000000 >>>>>>> [ 32.552761] [0x0c]:23000200 >>>>>>> [ 32.552937] [0x10]:00000000 >>>>>>> [ 32.553114] [0x14]:00000000 >>>>>>> [ 32.553291] [0x18]:00200000 >>>>>>> [ 32.553468] [0x1c]:0da81b20 >>>>>>> [ 32.553685] [0x20]:00000000 >>>>>>> [ 32.553862] [0x24]:00000000 >>>>>>> [ 32.554038] [0x28]:ba480000 >>>>>>> [ 32.554215] [0x2c]:00000000 >>>>>>> [ 32.554393] [0x30]:bb3d0000 >>>>>>> [ 32.554569] [0x34]:00000000 >>>>>>> [ 32.554752] [0x38]:ba964000 >>>>>>> [ 32.554929] [0x3c]:00000000 >>>>>>> [ 32.555106] [0x40]:983f2ce6 >>>>>>> [ 32.555283] [0x44]:00000153 >>>>>>> [ 32.601516] offset:data >>>>>>> [ 32.601768] [0x00]:02050004 >>>>>>> [ 32.602003] [0x04]:00000000 >>>>>>> [ 32.602239] [0x08]:00000000 >>>>>>> [ 32.602474] [0x0c]:00000000 >>>>>>> [ 32.602709] [0x10]:00000000 >>>>>>> [ 32.602945] mpt2sas_cm1: _base_event_notification >>>>>>> [ 62.593604] mpt2sas_cm1: _base_event_notification: timeout >>>>>>> [ 62.593906] mf: >>>>>>> >>>>>>> [ 62.594127] 07000000 >>>>>>> [ 62.594390] 00000000 >>>>>>> [ 62.594438] 00000000 >>>>>>> [ 62.594709] 00000000 >>>>>>> [ 62.594757] 00000000 >>>>>>> [ 62.595019] 0f2f7fff >>>>>>> [ 62.595067] ffffff7c >>>>>>> [ 62.595330] ffffffff >>>>>>> [ 62.595377] >>>>>>> >>>>>>> [ 62.595808] ffffffff >>>>>>> [ 62.595855] 00000000 >>>>>>> [ 62.596117] 00000000 >>>>>>> >>>>>>> [ 62.596601] mpt2sas_cm1: mpt3sas_base_free_resources >>>>>>> [ 62.596871] mpt2sas_cm1: _base_make_ioc_ready >>>>>>> [ 62.597125] mpt2sas_cm1: sending message unit reset !! >>>>>>> [ 62.599013] mpt2sas_cm1: message unit reset: SUCCESS >>>>>>> [ 62.599283] mpt2sas_cm1: mpt3sas_base_unmap_resources >>>>>>> [ 62.600443] mpt2sas_cm1: _base_release_memory_pools >>>>>>> [ 62.600721] mpt2sas_cm1: request_pool(0xffff8800ba480000): free >>>>>>> [ 62.601002] mpt2sas_cm1: sense_pool(0xffff8800ba880000): free >>>>>>> [ 62.601280] mpt2sas_cm1: reply_pool(0xffff880000100000): free >>>>>>> [ 62.601560] mpt2sas_cm1: reply_free_pool(0xffff8800ba964000): free >>>>>>> [ 62.601845] mpt2sas_cm1: reply_post_free_pool(0xffff8800bb3d0000): >>>>>>> free >>>>>>> [ 62.602133] mpt2sas_cm1: config_page(0xffff8800ba960000): free >>>>>>> [ 62.673591] mpt2sas_cm1: failure at >>>>>>> drivers/scsi/mpt3sas/mpt3sas_scsih.c:8592/_scsih_probe()! >>>>>> >>>>>> These are for two controllers, I don't know whether the output from the >>>>>> second is helpful at all - I added it anyway. >>>>>> >>>>>> >>>>>> I managed to boot the same 4.5.0 kernel successfully after warm >>>>>> rebooting from 4.1.20. That gave me this dmesg output (for comparison): >>>>>> >>>>>>> [ 2.057685] mpt3sas version 09.102.00.00 loaded >>>>>>> [ 2.058371] mpt2sas_cm0: mpt3sas_base_attach >>>>>>> [ 2.058632] mpt2sas_cm0: mpt3sas_base_map_resources >>>>>>> [ 2.059583] mpt2sas_cm0: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, >>>>>>> total mem (3074748 kB) >>>>>>> [ 2.059911] mpt2sas_cm0: _base_get_ioc_facts >>>>>>> [ 2.060166] mpt2sas_cm0: _base_wait_for_iocstate >>>>>>> [ 2.116337] offset:data >>>>>>> [ 2.116576] [0x00]:03100200 >>>>>>> [ 2.116817] [0x04]:00002300 >>>>>>> [ 2.117051] [0x08]:00000000 >>>>>>> [ 2.117285] [0x0c]:00000000 >>>>>>> [ 2.117518] [0x10]:00000000 >>>>>>> [ 2.117752] [0x14]:00010480 >>>>>>> [ 2.117986] [0x18]:22130d68 >>>>>>> [ 2.118220] [0x1c]:0001285c >>>>>>> [ 2.119624] [0x20]:14000400 >>>>>>> [ 2.119858] [0x24]:00000020 >>>>>>> [ 2.120093] [0x28]:0100000f >>>>>>> [ 2.120351] [0x2c]:000c000b >>>>>>> [ 2.120586] [0x30]:003c0003 >>>>>>> [ 2.120820] [0x34]:0020ffe0 >>>>>>> [ 2.121055] [0x38]:00800122 >>>>>>> [ 2.121288] [0x3c]:00000009 >>>>>>> [ 2.121524] mpt2sas_cm0: hba queue depth(3432), max chains per >>>>>>> io(128) >>>>>>> [ 2.121808] mpt2sas_cm0: request frame size(128), reply frame >>>>>>> size(128) >>>>>>> [ 2.122195] mpt2sas_cm0: msix is supported, vector_count(1) >>>>>>> [ 2.122468] mpt2sas_cm0: MSI-X vectors supported: 1, no of cores: 4, >>>>>>> max_msix_vectors: -1 >>>>>>> [ 2.123239] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 58 >>>>>>> [ 2.123507] mpt2sas_cm0: iomem(0x00000000fd4fc000), >>>>>>> mapped(0xffffc900000d0000), size(16384) >>>>>>> [ 2.123816] mpt2sas_cm0: ioport(0x0000000000004000), size(256) >>>>>>> [ 2.124623] mpt2sas_cm0: _base_get_ioc_facts >>>>>>> [ 2.124878] mpt2sas_cm0: _base_wait_for_iocstate >>>>>>> [ 2.180907] offset:data >>>>>>> [ 2.181145] [0x00]:03100200 >>>>>>> [ 2.181379] [0x04]:00002300 >>>>>>> [ 2.181613] [0x08]:00000000 >>>>>>> [ 2.181847] [0x0c]:00000000 >>>>>>> [ 2.182081] [0x10]:00000000 >>>>>>> [ 2.182315] [0x14]:00010480 >>>>>>> [ 2.182547] [0x18]:22130d68 >>>>>>> [ 2.182781] [0x1c]:0001285c >>>>>>> [ 2.183014] [0x20]:14000400 >>>>>>> [ 2.183248] [0x24]:00000020 >>>>>>> [ 2.183481] [0x28]:0100000f >>>>>>> [ 2.183720] [0x2c]:000c000b >>>>>>> [ 2.183954] [0x30]:003c0003 >>>>>>> [ 2.184190] [0x34]:0020ffe0 >>>>>>> [ 2.184424] [0x38]:00800122 >>>>>>> [ 2.184658] [0x3c]:00000009 >>>>>>> [ 2.184893] mpt2sas_cm0: hba queue depth(3432), max chains per >>>>>>> io(128) >>>>>>> [ 2.185177] mpt2sas_cm0: request frame size(128), reply frame >>>>>>> size(128) >>>>>>> [ 2.185462] mpt2sas_cm0: _base_make_ioc_ready >>>>>>> [ 2.185717] mpt2sas_cm0: _base_get_port_facts >>>>>>> [ 2.214057] offset:data >>>>>>> [ 2.214295] [0x00]:05070000 >>>>>>> [ 2.214529] [0x04]:00000000 >>>>>>> [ 2.214762] [0x08]:00000000 >>>>>>> [ 2.214997] [0x0c]:00000000 >>>>>>> [ 2.215230] [0x10]:00000000 >>>>>>> [ 2.215464] [0x14]:00003000 >>>>>>> [ 2.215697] [0x18]:00000078 >>>>>>> [ 2.215931] mpt2sas_cm0: _base_allocate_memory_pools >>>>>>> [ 2.216194] mpt2sas_cm0: scatter gather: sge_in_main_msg(3), >>>>>>> sge_per_chain(15), sge_per_io(128), chains_per_io(9) >>>>>>> [ 2.216734] mpt2sas_cm0: reply post free pool (0xffff8800bafc0000): >>>>>>> depth(6944),element_size(8), pool_size(54 kB) >>>>>>> [ 2.217244] mpt2sas_cm0: reply_post_free_dma = (0xbafc0000) >>>>>>> [ 2.217514] mpt2sas_cm0: scsi host: can_queue depth (3307) >>>>>>> [ 2.217866] mpt2sas_cm0: request pool(0xffff8800ba800000): >>>>>>> depth(3432), frame_size(128), pool_size(429 kB) >>>>>>> [ 2.218369] mpt2sas_cm0: request pool: dma(0xba800000) >>>>>>> [ 2.218637] mpt2sas_cm0: scsiio(0xffff8800ba800000): depth(3307) >>>>>>> [ 2.224773] mpt2sas_cm0: chain pool depth(29763), frame_size(128), >>>>>>> pool_size(3720 kB) >>>>>>> [ 2.225092] mpt2sas_cm0: hi_priority(0xffff8800ba867600): depth(60), >>>>>>> start smid(3308) >>>>>>> [ 2.225395] mpt2sas_cm0: internal(0xffff8800ba869400): depth(65), >>>>>>> start smid(3368) >>>>>>> [ 2.225958] mpt2sas_cm0: sense pool(0xffff8800ba480000): >>>>>>> depth(3307), element_size(96), pool_size(310 kB) >>>>>>> [ 2.226457] mpt2sas_cm0: sense_dma(0xba480000) >>>>>>> [ 2.227039] mpt2sas_cm0: reply pool(0xffff8800ba500000): >>>>>>> depth(3496), frame_size(128), pool_size(437 kB) >>>>>>> [ 2.227413] mpt2sas_cm0: reply_dma(0xba500000) >>>>>>> [ 2.227616] mpt2sas_cm0: reply_free pool(0xffff8800ba450000): >>>>>>> depth(3496), element_size(4), pool_size(13 kB) >>>>>>> [ 2.227992] mpt2sas_cm0: reply_free_dma (0xba450000) >>>>>>> [ 2.228192] mpt2sas_cm0: config page(0xffff8800ba43b000): size(512) >>>>>>> [ 2.228402] mpt2sas_cm0: config_page_dma(0xba43b000) >>>>>>> [ 2.228598] mpt2sas_cm0: Allocated physical memory: size(4964 kB) >>>>>>> [ 2.228806] mpt2sas_cm0: Current Controller Queue Depth(3307),Max >>>>>>> Controller Queue Depth(3432) >>>>>>> [ 2.229171] mpt2sas_cm0: Scatter Gather Elements per IO(128) >>>>>>> [ 2.229378] mpt2sas_cm0: _base_make_ioc_operational >>>>>>> [ 2.229959] mpt2sas_cm0: _base_send_ioc_init >>>>>>> [ 2.230151] offset:data >>>>>>> [ 2.230323] [0x00]:02000004 >>>>>>> [ 2.230499] [0x04]:00000000 >>>>>>> [ 2.230675] [0x08]:00000000 >>>>>>> [ 2.230851] [0x0c]:23000200 >>>>>>> [ 2.231026] [0x10]:00000000 >>>>>>> [ 2.231201] [0x14]:00000000 >>>>>>> [ 2.231376] [0x18]:00200000 >>>>>>> [ 2.231551] [0x1c]:0da81b20 >>>>>>> [ 2.231726] [0x20]:00000000 >>>>>>> [ 2.231900] [0x24]:00000000 >>>>>>> [ 2.232075] [0x28]:ba800000 >>>>>>> [ 2.232250] [0x2c]:00000000 >>>>>>> [ 2.232423] [0x30]:bafc0000 >>>>>>> [ 2.232597] [0x34]:00000000 >>>>>>> [ 2.232775] [0x38]:ba450000 >>>>>>> [ 2.232950] [0x3c]:00000000 >>>>>>> [ 2.233125] [0x40]:98596e4f >>>>>>> [ 2.233299] [0x44]:00000153 >>>>>>> [ 2.278752] offset:data >>>>>>> [ 2.278988] [0x00]:02050004 >>>>>>> [ 2.279220] [0x04]:00000000 >>>>>>> [ 2.279453] [0x08]:00000000 >>>>>>> [ 2.279685] [0x0c]:00000000 >>>>>>> [ 2.279918] [0x10]:00000000 >>>>>>> [ 2.280151] mpt2sas_cm0: _base_event_notification >>>>>>> [ 2.280537] mpt2sas_cm0: _base_event_notification: complete >>>>>>> [ 2.281694] mpt2sas_cm0: LSISAS2008: FWVersion(20.00.04.00), >>>>>>> ChipRevision(0x03), BiosVersion(07.39.00.00) >>>>>>> [ 2.282196] mpt2sas_cm0: Protocol=( >>>>>>> [ 2.282261] Initiator >>>>>>> [ 2.282522] ,Target >>>>>>> [ 2.282567] ), >>>>>>> [ 2.282824] Capabilities=( >>>>>>> [ 2.282877] TLR >>>>>>> [ 2.283132] ,EEDP >>>>>>> [ 2.283175] ,Snapshot Buffer >>>>>>> [ 2.283444] ,Diag Trace Buffer >>>>>>> [ 2.283502] ,Task Set Full >>>>>>> [ 2.283774] ,NCQ >>>>>>> [ 2.283816] ) >>>>>>> [ 2.284350] scsi host0: Fusion MPT SAS Host >>>>>>> [ 2.299028] mpt2sas_cm0: sending port enable !! >>>>>>> [ 2.299540] mpt2sas_cm0: Discovery: (start) >>>>>>> >>>>>>> [ 2.299972] mpt2sas_cm0: SAS Enclosure Device Status Change >>>>>>> [ 2.299984] mpt2sas_cm0: discovery event: (start) >>>>>>> >>>>>>> [ 2.300554] mpt2sas_cm0: SAS Topology Change List >>>>>>> [ 2.300759] mpt2sas_cm0: Discovery: (stop) >>>>>>> >>>>>>> [ 2.301146] mpt2sas_cm0: Discovery: (start) >>>>>>> >>>>>>> [ 2.301535] mpt2sas_cm0: Discovery: (stop) >>>>>>> >>>>>>> [ 2.301927] mpt2sas_cm0: Discovery: (start) >>>>>>> >>>>>>> [ 2.302316] mpt2sas_cm0: Discovery: (stop) >>>>>>> >>>>>>> [ 2.302707] mpt2sas_cm0: Discovery: (start) >>>>>>> >>>>>>> [ 2.304908] mpt2sas_cm0: Discovery: (stop) >>>>>>> >>>>>>> [ 2.305297] mpt2sas_cm0: Discovery: (start) >>>>>>> >>>>>>> [ 2.306776] mpt2sas_cm0: Discovery: (stop) >>>>>>> >>>>>>> [ 2.307166] mpt2sas_cm0: Discovery: (start) >>>>>>> >>>>>>> [ 2.307559] mpt2sas_cm0: Discovery: (stop) >>>>>>> >>>>>>> [ 2.307948] mpt2sas_cm0: Discovery: (start) >>>>>>> >>>>>>> [ 2.308336] mpt2sas_cm0: Discovery: (stop) >>>>>>> >>>>>>> [ 2.311738] mpt2sas_cm0: host_add: handle(0x0001), >>>>>>> sas_addr(0x500605b003683dd0), phys(8) >>>>>>> [ 2.312097] mpt2sas_cm0: enclosure status change: (enclosure add) >>>>>>> handle(0x0001), enclosure logical >>>>>>> id(0x500605b003683dd0) number slots(0) >>>>>>> [ 2.312551] mpt2sas_cm0: sas topology change: (responding) >>>>>>> [ 2.312768] handle(0x0000), enclosure_handle(0x0001) >>>>>>> start_phy(00), count(8) >>>>>>> [ 2.313003] phy(01), attached_handle(0x0009): target add: >>>>>>> link rate: new(0x0a), old(0x00) >>>>>>> [ 2.313250] phy(02), attached_handle(0x000a): target add: >>>>>>> link rate: new(0x09), old(0x00) >>>>>>> [ 2.313498] phy(03), attached_handle(0x000b): target add: >>>>>>> link rate: new(0x09), old(0x00) >>>>>>> [ 2.313745] phy(04), attached_handle(0x000c): target add: >>>>>>> link rate: new(0x09), old(0x00) >>>>>>> [ 2.313992] phy(05), attached_handle(0x000d): target add: >>>>>>> link rate: new(0x09), old(0x00) >>>>>>> [ 2.314248] phy(06), attached_handle(0x000e): target add: >>>>>>> link rate: new(0x09), old(0x00) >>>>>>> [ 2.314495] phy(07), attached_handle(0x000f): target add: >>>>>>> link rate: new(0x09), old(0x00) >>>>>>> [ 2.314747] mpt2sas_cm0: updating handles for >>>>>>> sas_host(0x500605b003683dd0) >>>>>>> [ 2.316041] mpt2sas_cm0: _scsih_sas_device_init_add: handle(0x0009), >>>>>>> sas_addr(0x4433221101000000) >>>>>>> [ 2.316465] mpt2sas_cm0: _scsih_sas_device_init_add: enclosure >>>>>>> logical id(0x500605b003683dd0), slot( 2) >>>>>>> [ 2.317200] mpt2sas_cm0: _scsih_sas_device_init_add: handle(0x000a), >>>>>>> sas_addr(0x4433221102000000) >>>>>>> [ 2.317669] mpt2sas_cm0: _scsih_sas_device_init_add: enclosure >>>>>>> logical id(0x500605b003683dd0), slot( 1) >>>>>>> [ 2.318431] mpt2sas_cm0: _scsih_sas_device_init_add: handle(0x000b), >>>>>>> sas_addr(0x4433221103000000) >>>>>>> [ 2.318900] mpt2sas_cm0: _scsih_sas_device_init_add: enclosure >>>>>>> logical id(0x500605b003683dd0), slot( 0) >>>>>>> [ 2.319366] mpt2sas_cm0: _scsih_determine_boot_device: >>>>>>> current_boot_device(0x4433221103000000) >>>>>>> [ 2.320151] mpt2sas_cm0: _scsih_sas_device_init_add: handle(0x000c), >>>>>>> sas_addr(0x4433221104000000) >>>>>>> [ 2.321371] mpt2sas_cm0: _scsih_sas_device_init_add: enclosure >>>>>>> logical id(0x500605b003683dd0), slot( 7) >>>>>>> [ 2.322137] mpt2sas_cm0: _scsih_sas_device_init_add: handle(0x000d), >>>>>>> sas_addr(0x4433221105000000) >>>>>>> [ 2.322606] mpt2sas_cm0: _scsih_sas_device_init_add: enclosure >>>>>>> logical id(0x500605b003683dd0), slot( 6) >>>>>>> [ 2.323367] mpt2sas_cm0: _scsih_sas_device_init_add: handle(0x000e), >>>>>>> sas_addr(0x4433221106000000) >>>>>>> [ 2.323834] mpt2sas_cm0: _scsih_sas_device_init_add: enclosure >>>>>>> logical id(0x500605b003683dd0), slot( 5) >>>>>>> [ 2.324602] mpt2sas_cm0: _scsih_sas_device_init_add: handle(0x000f), >>>>>>> sas_addr(0x4433221107000000) >>>>>>> [ 2.325071] mpt2sas_cm0: _scsih_sas_device_init_add: enclosure >>>>>>> logical id(0x500605b003683dd0), slot( 4) >>>>>>> [ 2.325541] mpt2sas_cm0: discovery event: (stop) >>>>>>> >>>>>>> [ 2.326017] mpt2sas_cm0: discovery event: (start) >>>>>>> >>>>>>> [ 2.326492] mpt2sas_cm0: discovery event: (stop) >>>>>>> >>>>>>> [ 2.326975] mpt2sas_cm0: discovery event: (start) >>>>>>> >>>>>>> [ 2.327450] mpt2sas_cm0: discovery event: (stop) >>>>>>> >>>>>>> [ 2.327923] mpt2sas_cm0: discovery event: (start) >>>>>>> >>>>>>> [ 2.328396] mpt2sas_cm0: discovery event: (stop) >>>>>>> >>>>>>> [ 2.328868] mpt2sas_cm0: discovery event: (start) >>>>>>> >>>>>>> [ 2.329340] mpt2sas_cm0: discovery event: (stop) >>>>>>> >>>>>>> [ 2.329816] mpt2sas_cm0: discovery event: (start) >>>>>>> >>>>>>> [ 2.330316] mpt2sas_cm0: discovery event: (stop) >>>>>>> >>>>>>> [ 2.330797] mpt2sas_cm0: discovery event: (start) >>>>>>> >>>>>>> [ 2.331269] mpt2sas_cm0: discovery event: (stop) >>>>>>> >>>>>>> [ 2.331740] mpt2sas_cm0: port enable: complete from worker thread >>>>>>> [ 2.350236] mpt2sas_cm0: port enable: SUCCESS >>>>>>> [ 2.356432] scsi 0:0:0:0: Direct-Access ATA ST3750330NS >>>>>>> SN06 PQ: 0 ANSI: 6 >>>>>>> [ 2.356683] scsi 0:0:0:0: SATA: handle(0x000b), >>>>>>> sas_addr(0x4433221103000000), phy(3), device_name(0x5000c5000267c9f8) >>>>>>> [ 2.357080] scsi 0:0:0:0: SATA: >>>>>>> enclosure_logical_id(0x500605b003683dd0), slot(0) >>>>>>> [ 2.357405] scsi 0:0:0:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>>> [ 2.383043] scsi 0:0:1:0: Direct-Access ATA Hitachi >>>>>>> HDS5C302 A800 PQ: 0 ANSI: 6 >>>>>>> [ 2.383296] scsi 0:0:1:0: SATA: handle(0x0009), >>>>>>> sas_addr(0x4433221101000000), phy(1), device_name(0x5000cca369cdd311) >>>>>>> [ 2.383684] scsi 0:0:1:0: SATA: >>>>>>> enclosure_logical_id(0x500605b003683dd0), slot(2) >>>>>>> [ 2.384028] scsi 0:0:1:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>>> [ 2.405088] scsi 0:0:2:0: Direct-Access ATA ST3750330NS >>>>>>> SN06 PQ: 0 ANSI: 6 >>>>>>> [ 2.405346] scsi 0:0:2:0: SATA: handle(0x000a), >>>>>>> sas_addr(0x4433221102000000), phy(2), device_name(0x5000c5000ccfbd32) >>>>>>> [ 2.405735] scsi 0:0:2:0: SATA: >>>>>>> enclosure_logical_id(0x500605b003683dd0), slot(1) >>>>>>> [ 2.406082] scsi 0:0:2:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>>> [ 2.424125] scsi 0:0:3:0: Direct-Access ATA ST3750330NS >>>>>>> SN06 PQ: 0 ANSI: 6 >>>>>>> [ 2.424373] scsi 0:0:3:0: SATA: handle(0x000c), >>>>>>> sas_addr(0x4433221104000000), phy(4), device_name(0x5000c5000267abee) >>>>>>> [ 2.424763] scsi 0:0:3:0: SATA: >>>>>>> enclosure_logical_id(0x500605b003683dd0), slot(7) >>>>>>> [ 2.425108] scsi 0:0:3:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>>> [ 2.444834] scsi 0:0:4:0: Direct-Access ATA ST3750330NS >>>>>>> SN06 PQ: 0 ANSI: 6 >>>>>>> [ 2.445086] scsi 0:0:4:0: SATA: handle(0x000d), >>>>>>> sas_addr(0x4433221105000000), phy(5), device_name(0x5000c50009c0e5e6) >>>>>>> [ 2.445478] scsi 0:0:4:0: SATA: >>>>>>> enclosure_logical_id(0x500605b003683dd0), slot(6) >>>>>>> [ 2.445803] scsi 0:0:4:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>>> [ 2.464065] scsi 0:0:5:0: Direct-Access ATA ST3750330NS >>>>>>> SN16 PQ: 0 ANSI: 6 >>>>>>> [ 2.464312] scsi 0:0:5:0: SATA: handle(0x000e), >>>>>>> sas_addr(0x4433221106000000), phy(6), device_name(0x5000c5003cb9ac10) >>>>>>> [ 2.464699] scsi 0:0:5:0: SATA: >>>>>>> enclosure_logical_id(0x500605b003683dd0), slot(5) >>>>>>> [ 2.465048] scsi 0:0:5:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>>> [ 2.484016] scsi 0:0:6:0: Direct-Access ATA ST3750330NS >>>>>>> SN06 PQ: 0 ANSI: 6 >>>>>>> [ 2.484266] scsi 0:0:6:0: SATA: handle(0x000f), >>>>>>> sas_addr(0x4433221107000000), phy(7), device_name(0x5000c5000839b69e) >>>>>>> [ 2.484655] scsi 0:0:6:0: SATA: >>>>>>> enclosure_logical_id(0x500605b003683dd0), slot(4) >>>>>>> [ 2.485001] scsi 0:0:6:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>>> [ 2.500660] mpt2sas_cm1: mpt3sas_base_attach >>>>>>> [ 2.500861] mpt2sas_cm1: mpt3sas_base_map_resources >>>>>>> [ 2.501599] mpt2sas_cm1: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, >>>>>>> total mem (3074748 kB) >>>>>>> [ 2.501847] mpt2sas_cm1: _base_get_ioc_facts >>>>>>> [ 2.502036] mpt2sas_cm1: _base_wait_for_iocstate >>>>>>> [ 2.559080] offset:data >>>>>>> [ 2.559318] [0x00]:03100200 >>>>>>> [ 2.559552] [0x04]:00002300 >>>>>>> [ 2.559785] [0x08]:00000000 >>>>>>> [ 2.560020] [0x0c]:00000000 >>>>>>> [ 2.560277] [0x10]:00000000 >>>>>>> [ 2.560511] [0x14]:00010480 >>>>>>> [ 2.560745] [0x18]:22130d68 >>>>>>> [ 2.560978] [0x1c]:0001285c >>>>>>> [ 2.561210] [0x20]:14000400 >>>>>>> [ 2.561443] [0x24]:00000020 >>>>>>> [ 2.561675] [0x28]:0100000f >>>>>>> [ 2.561907] [0x2c]:000c000b >>>>>>> [ 2.562139] [0x30]:003c0003 >>>>>>> [ 2.562371] [0x34]:0020ffe0 >>>>>>> [ 2.562602] [0x38]:00800122 >>>>>>> [ 2.562839] [0x3c]:00000009 >>>>>>> [ 2.563073] mpt2sas_cm1: hba queue depth(3432), max chains per >>>>>>> io(128) >>>>>>> [ 2.563355] mpt2sas_cm1: request frame size(128), reply frame >>>>>>> size(128) >>>>>>> [ 2.563745] mpt2sas_cm1: msix is supported, vector_count(1) >>>>>>> [ 2.564016] mpt2sas_cm1: MSI-X vectors supported: 1, no of cores: 4, >>>>>>> max_msix_vectors: 8 >>>>>>> [ 2.564918] mpt2sas1-msix0: PCI-MSI-X enabled: IRQ 59 >>>>>>> [ 2.566189] mpt2sas_cm1: iomem(0x00000000fd1fc000), >>>>>>> mapped(0xffffc900000d8000), size(16384) >>>>>>> [ 2.566498] mpt2sas_cm1: ioport(0x0000000000007000), size(256) >>>>>>> [ 2.567328] mpt2sas_cm1: _base_get_ioc_facts >>>>>>> [ 2.567583] mpt2sas_cm1: _base_wait_for_iocstate >>>>>>> [ 2.625125] offset:data >>>>>>> [ 2.625364] [0x00]:03100200 >>>>>>> [ 2.625597] [0x04]:00002300 >>>>>>> [ 2.625830] [0x08]:00000000 >>>>>>> [ 2.626064] [0x0c]:00000000 >>>>>>> [ 2.626296] [0x10]:00000000 >>>>>>> [ 2.626529] [0x14]:00010480 >>>>>>> [ 2.626769] [0x18]:22130d68 >>>>>>> [ 2.627002] [0x1c]:0001285c >>>>>>> [ 2.627235] [0x20]:14000400 >>>>>>> [ 2.627467] [0x24]:00000020 >>>>>>> [ 2.627702] [0x28]:0100000f >>>>>>> [ 2.627936] [0x2c]:000c000b >>>>>>> [ 2.628170] [0x30]:003c0003 >>>>>>> [ 2.628403] [0x34]:0020ffe0 >>>>>>> [ 2.628638] [0x38]:00800122 >>>>>>> [ 2.628872] [0x3c]:00000009 >>>>>>> [ 2.629107] mpt2sas_cm1: hba queue depth(3432), max chains per >>>>>>> io(128) >>>>>>> [ 2.629388] mpt2sas_cm1: request frame size(128), reply frame >>>>>>> size(128) >>>>>>> [ 2.629671] mpt2sas_cm1: _base_make_ioc_ready >>>>>>> [ 2.629928] mpt2sas_cm1: _base_get_port_facts >>>>>>> [ 2.660127] offset:data >>>>>>> [ 2.660389] [0x00]:05070000 >>>>>>> [ 2.660623] [0x04]:00000000 >>>>>>> [ 2.660858] [0x08]:00000000 >>>>>>> [ 2.661093] [0x0c]:00000000 >>>>>>> [ 2.661326] [0x10]:00000000 >>>>>>> [ 2.661562] [0x14]:00003000 >>>>>>> [ 2.661796] [0x18]:00000078 >>>>>>> [ 2.664346] mpt2sas_cm1: _base_allocate_memory_pools >>>>>>> [ 2.664608] mpt2sas_cm1: scatter gather: sge_in_main_msg(3), >>>>>>> sge_per_chain(15), sge_per_io(128), chains_per_io(9) >>>>>>> [ 2.665142] mpt2sas_cm1: reply post free pool (0xffff8800b8b10000): >>>>>>> depth(6944),element_size(8), pool_size(54 kB) >>>>>>> [ 2.666671] mpt2sas_cm1: reply_post_free_dma = (0xb8b10000) >>>>>>> [ 2.666954] mpt2sas_cm1: scsi host: can_queue depth (3307) >>>>>>> [ 2.667311] mpt2sas_cm1: request pool(0xffff8800b8b80000): >>>>>>> depth(3432), frame_size(128), pool_size(429 kB) >>>>>>> [ 2.667813] mpt2sas_cm1: request pool: dma(0xb8b80000) >>>>>>> [ 2.668080] mpt2sas_cm1: scsiio(0xffff8800b8b80000): depth(3307) >>>>>>> [ 2.674131] mpt2sas_cm1: chain pool depth(29763), frame_size(128), >>>>>>> pool_size(3720 kB) >>>>>>> [ 2.674448] mpt2sas_cm1: hi_priority(0xffff8800b8be7600): depth(60), >>>>>>> start smid(3308) >>>>>>> [ 2.674750] mpt2sas_cm1: internal(0xffff8800b8be9400): depth(65), >>>>>>> start smid(3368) >>>>>>> [ 2.675105] mpt2sas_cm1: sense pool(0xffff8800b8100000): >>>>>>> depth(3307), element_size(96), pool_size(310 kB) >>>>>>> [ 2.675605] mpt2sas_cm1: sense_dma(0xb8100000) >>>>>>> [ 2.675944] mpt2sas_cm1: reply pool(0xffff8800b8180000): >>>>>>> depth(3496), frame_size(128), pool_size(437 kB) >>>>>>> [ 2.676443] mpt2sas_cm1: reply_dma(0xb8180000) >>>>>>> [ 2.676702] mpt2sas_cm1: reply_free pool(0xffff8800b80a0000): >>>>>>> depth(3496), element_size(4), pool_size(13 kB) >>>>>>> [ 2.677124] mpt2sas_cm1: reply_free_dma (0xb80a0000) >>>>>>> [ 2.677322] mpt2sas_cm1: config page(0xffff8800b807f000): size(512) >>>>>>> [ 2.677532] mpt2sas_cm1: config_page_dma(0xb807f000) >>>>>>> [ 2.677728] mpt2sas_cm1: Allocated physical memory: size(4964 kB) >>>>>>> [ 2.677936] mpt2sas_cm1: Current Controller Queue Depth(3307),Max >>>>>>> Controller Queue Depth(3432) >>>>>>> [ 2.678304] mpt2sas_cm1: Scatter Gather Elements per IO(128) >>>>>>> [ 2.678514] mpt2sas_cm1: _base_make_ioc_operational >>>>>>> [ 2.679081] mpt2sas_cm1: _base_send_ioc_init >>>>>>> [ 2.679275] offset:data >>>>>>> [ 2.679448] [0x00]:02000004 >>>>>>> [ 2.679625] [0x04]:00000000 >>>>>>> [ 2.679805] [0x08]:00000000 >>>>>>> [ 2.681200] [0x0c]:23000200 >>>>>>> [ 2.681377] [0x10]:00000000 >>>>>>> [ 2.681554] [0x14]:00000000 >>>>>>> [ 2.681729] [0x18]:00200000 >>>>>>> [ 2.681906] [0x1c]:0da81b20 >>>>>>> [ 2.682082] [0x20]:00000000 >>>>>>> [ 2.682259] [0x24]:00000000 >>>>>>> [ 2.682435] [0x28]:b8b80000 >>>>>>> [ 2.682611] [0x2c]:00000000 >>>>>>> [ 2.682787] [0x30]:b8b10000 >>>>>>> [ 2.682963] [0x34]:00000000 >>>>>>> [ 2.683139] [0x38]:b80a0000 >>>>>>> [ 2.683314] [0x3c]:00000000 >>>>>>> [ 2.683489] [0x40]:98597011 >>>>>>> [ 2.683665] [0x44]:00000153 >>>>>>> [ 2.729849] offset:data >>>>>>> [ 2.730089] [0x00]:02050004 >>>>>>> [ 2.730349] [0x04]:00000000 >>>>>>> [ 2.730586] [0x08]:00000000 >>>>>>> [ 2.730822] [0x0c]:00000000 >>>>>>> [ 2.731058] [0x10]:00000000 >>>>>>> [ 2.731295] mpt2sas_cm1: _base_event_notification >>>>>>> [ 2.731606] mpt2sas_cm1: _base_event_notification: complete >>>>>>> [ 2.732501] mpt2sas_cm1: LSISAS2008: FWVersion(20.00.04.00), >>>>>>> ChipRevision(0x02), BiosVersion(07.39.00.00) >>>>>>> [ 2.733010] mpt2sas_cm1: Protocol=( >>>>>>> [ 2.733074] Initiator >>>>>>> [ 2.733339] ,Target >>>>>>> [ 2.733384] ), >>>>>>> [ 2.733642] Capabilities=( >>>>>>> [ 2.733696] TLR >>>>>>> [ 2.733952] ,EEDP >>>>>>> [ 2.733995] ,Snapshot Buffer >>>>>>> [ 2.734268] ,Diag Trace Buffer >>>>>>> [ 2.734326] ,Task Set Full >>>>>>> [ 2.734595] ,NCQ >>>>>>> [ 2.734637] ) >>>>>>> [ 2.735155] scsi host1: Fusion MPT SAS Host >>>>>>> [ 2.749047] mpt2sas_cm1: sending port enable !! >>>>>>> [ 2.749563] mpt2sas_cm1: Discovery: (start) >>>>>>> >>>>>>> [ 2.749989] mpt2sas_cm1: SAS Enclosure Device Status Change >>>>>>> [ 2.750001] mpt2sas_cm1: discovery event: (start) >>>>>>> >>>>>>> [ 2.750578] mpt2sas_cm1: SAS Topology Change List >>>>>>> [ 2.750788] mpt2sas_cm1: Discovery: (stop) >>>>>>> >>>>>>> [ 2.751181] mpt2sas_cm1: Discovery: (start) >>>>>>> >>>>>>> [ 2.751571] mpt2sas_cm1: Discovery: (stop) >>>>>>> >>>>>>> [ 2.752002] mpt2sas_cm1: Discovery: (start) >>>>>>> >>>>>>> [ 2.752391] mpt2sas_cm1: Discovery: (stop) >>>>>>> >>>>>>> [ 2.752779] mpt2sas_cm1: Discovery: (start) >>>>>>> >>>>>>> [ 2.754205] mpt2sas_cm1: Discovery: (stop) >>>>>>> >>>>>>> [ 2.754593] mpt2sas_cm1: Discovery: (start) >>>>>>> >>>>>>> [ 2.754983] mpt2sas_cm1: Discovery: (stop) >>>>>>> >>>>>>> [ 2.755371] mpt2sas_cm1: Discovery: (start) >>>>>>> >>>>>>> [ 2.755762] mpt2sas_cm1: Discovery: (stop) >>>>>>> >>>>>>> [ 2.759602] mpt2sas_cm1: host_add: handle(0x0001), >>>>>>> sas_addr(0x500605b0026f79b0), phys(8) >>>>>>> [ 2.759969] mpt2sas_cm1: enclosure status change: (enclosure add) >>>>>>> handle(0x0001), enclosure logical >>>>>>> id(0x500605b0026f79b0) number slots(0) >>>>>>> [ 2.760407] mpt2sas_cm1: sas topology change: (responding) >>>>>>> [ 2.760612] handle(0x0000), enclosure_handle(0x0001) >>>>>>> start_phy(00), count(8) >>>>>>> [ 2.760834] phy(02), attached_handle(0x000e): target add: >>>>>>> link rate: new(0x0a), old(0x00) >>>>>>> [ 2.761066] phy(03), attached_handle(0x000b): target add: >>>>>>> link rate: new(0x0a), old(0x00) >>>>>>> [ 2.761304] phy(04), attached_handle(0x000d): target add: >>>>>>> link rate: new(0x09), old(0x00) >>>>>>> [ 2.761538] phy(05), attached_handle(0x0009): target add: >>>>>>> link rate: new(0x09), old(0x00) >>>>>>> [ 2.761771] phy(06), attached_handle(0x000a): target add: >>>>>>> link rate: new(0x09), old(0x00) >>>>>>> [ 2.762002] phy(07), attached_handle(0x000c): target add: >>>>>>> link rate: new(0x09), old(0x00) >>>>>>> [ 2.762235] mpt2sas_cm1: updating handles for >>>>>>> sas_host(0x500605b0026f79b0) >>>>>>> [ 2.763653] mpt2sas_cm1: _scsih_sas_device_init_add: handle(0x000e), >>>>>>> sas_addr(0x4433221102000000) >>>>>>> [ 2.764036] mpt2sas_cm1: _scsih_sas_device_init_add: enclosure >>>>>>> logical id(0x500605b0026f79b0), slot( 1) >>>>>>> [ 2.764772] mpt2sas_cm1: _scsih_sas_device_init_add: handle(0x000b), >>>>>>> sas_addr(0x4433221103000000) >>>>>>> [ 2.765147] mpt2sas_cm1: _scsih_sas_device_init_add: enclosure >>>>>>> logical id(0x500605b0026f79b0), slot( 0) >>>>>>> [ 2.765891] mpt2sas_cm1: _scsih_sas_device_init_add: handle(0x000d), >>>>>>> sas_addr(0x4433221104000000) >>>>>>> [ 2.767250] mpt2sas_cm1: _scsih_sas_device_init_add: enclosure >>>>>>> logical id(0x500605b0026f79b0), slot( 7) >>>>>>> [ 2.768009] mpt2sas_cm1: _scsih_sas_device_init_add: handle(0x0009), >>>>>>> sas_addr(0x4433221105000000) >>>>>>> [ 2.768394] mpt2sas_cm1: _scsih_sas_device_init_add: enclosure >>>>>>> logical id(0x500605b0026f79b0), slot( 6) >>>>>>> [ 2.769136] mpt2sas_cm1: _scsih_sas_device_init_add: handle(0x000a), >>>>>>> sas_addr(0x4433221106000000) >>>>>>> [ 2.769510] mpt2sas_cm1: _scsih_sas_device_init_add: enclosure >>>>>>> logical id(0x500605b0026f79b0), slot( 5) >>>>>>> [ 2.769888] mpt2sas_cm1: _scsih_determine_boot_device: >>>>>>> current_boot_device(0x4433221106000000) >>>>>>> [ 2.770641] mpt2sas_cm1: _scsih_sas_device_init_add: handle(0x000c), >>>>>>> sas_addr(0x4433221107000000) >>>>>>> [ 2.771025] mpt2sas_cm1: _scsih_sas_device_init_add: enclosure >>>>>>> logical id(0x500605b0026f79b0), slot( 4) >>>>>>> [ 2.771405] mpt2sas_cm1: discovery event: (stop) >>>>>>> >>>>>>> [ 2.771788] mpt2sas_cm1: discovery event: (start) >>>>>>> >>>>>>> [ 2.772172] mpt2sas_cm1: discovery event: (stop) >>>>>>> >>>>>>> [ 2.772554] mpt2sas_cm1: discovery event: (start) >>>>>>> >>>>>>> [ 2.772942] mpt2sas_cm1: discovery event: (stop) >>>>>>> >>>>>>> [ 2.773326] mpt2sas_cm1: discovery event: (start) >>>>>>> >>>>>>> [ 2.773709] mpt2sas_cm1: discovery event: (stop) >>>>>>> >>>>>>> [ 2.774090] mpt2sas_cm1: discovery event: (start) >>>>>>> >>>>>>> [ 2.774474] mpt2sas_cm1: discovery event: (stop) >>>>>>> >>>>>>> [ 2.774855] mpt2sas_cm1: discovery event: (start) >>>>>>> >>>>>>> [ 2.775237] mpt2sas_cm1: discovery event: (stop) >>>>>>> >>>>>>> [ 2.775619] mpt2sas_cm1: port enable: complete from worker thread >>>>>>> [ 2.780192] mpt2sas_cm1: port enable: SUCCESS >>>>>>> [ 2.782404] scsi 1:0:0:0: Direct-Access ATA Hitachi >>>>>>> HDP72505 A5BA PQ: 0 ANSI: 6 >>>>>>> [ 2.782651] scsi 1:0:0:0: SATA: handle(0x000a), >>>>>>> sas_addr(0x4433221106000000), phy(6), device_name(0x5000cca34dc05584) >>>>>>> [ 2.783039] scsi 1:0:0:0: SATA: >>>>>>> enclosure_logical_id(0x500605b0026f79b0), slot(5) >>>>>>> [ 2.783390] scsi 1:0:0:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>>> [ 2.803032] scsi 1:0:1:0: Direct-Access ATA >>>>>>> ST8000AS0002-1NA AR15 PQ: 0 ANSI: 6 >>>>>>> [ 2.803272] scsi 1:0:1:0: SATA: handle(0x000e), >>>>>>> sas_addr(0x4433221102000000), phy(2), device_name(0x5000c500908f1d05) >>>>>>> [ 2.803660] scsi 1:0:1:0: SATA: >>>>>>> enclosure_logical_id(0x500605b0026f79b0), slot(1) >>>>>>> [ 2.803981] scsi 1:0:1:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>>> [ 2.821712] scsi 1:0:2:0: Direct-Access ATA >>>>>>> ST3000DM001-1CH1 CC43 PQ: 0 ANSI: 6 >>>>>>> [ 2.821963] scsi 1:0:2:0: SATA: handle(0x000b), >>>>>>> sas_addr(0x4433221103000000), phy(3), device_name(0x5000c5004dfd2a8a) >>>>>>> [ 2.822352] scsi 1:0:2:0: SATA: >>>>>>> enclosure_logical_id(0x500605b0026f79b0), slot(0) >>>>>>> [ 2.822694] scsi 1:0:2:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>>> [ 2.844233] scsi 1:0:3:0: Direct-Access ATA ST3500320NS >>>>>>> SN16 PQ: 0 ANSI: 6 >>>>>>> [ 2.844483] scsi 1:0:3:0: SATA: handle(0x000d), >>>>>>> sas_addr(0x4433221104000000), phy(4), device_name(0x5000c50009dca65b) >>>>>>> [ 2.844870] scsi 1:0:3:0: SATA: >>>>>>> enclosure_logical_id(0x500605b0026f79b0), slot(7) >>>>>>> [ 2.845216] scsi 1:0:3:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>>> [ 2.868963] scsi 1:0:4:0: Direct-Access ATA SAMSUNG HD401LJ >>>>>>> 0-15 PQ: 0 ANSI: 6 >>>>>>> [ 2.870994] scsi 1:0:4:0: SATA: handle(0x0009), >>>>>>> sas_addr(0x4433221105000000), phy(5), device_name(0x695d550daf678093) >>>>>>> [ 2.871382] scsi 1:0:4:0: SATA: >>>>>>> enclosure_logical_id(0x500605b0026f79b0), slot(6) >>>>>>> [ 2.871728] scsi 1:0:4:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>>> [ 2.894004] scsi 1:0:5:0: Direct-Access ATA ST3750330NS >>>>>>> SN06 PQ: 0 ANSI: 6 >>>>>>> [ 2.894257] scsi 1:0:5:0: SATA: handle(0x000c), >>>>>>> sas_addr(0x4433221107000000), phy(7), device_name(0x5000c5000266bb02) >>>>>>> [ 2.894646] scsi 1:0:5:0: SATA: >>>>>>> enclosure_logical_id(0x500605b0026f79b0), slot(4) >>>>>>> [ 2.894972] scsi 1:0:5:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>> >>>>>> I don't see a clear pattern yet, but I suspect warm rebooting >=4.2 >>>>>> after having run 4.1.x leads to sucessful driver inits. But I also >>>>>> remember having had cold boots, with kernels >=4.2 that worked fine >>>>>> (obviously not all of the time). <=4.1.20 kernels on the other hand boot >>>>>> fine every single time. >>>>>> >>>>>> Interestingly the igb driver (ethernet) seems to be acting up at least >>>>>> with 4.5.0 on exactly the same boots when mpt2sas init fails. I don't >>>>>> know whether this could be connected or not (I just became aware of this >>>>>> coincidence). >>>>>> >>>>>> >>>>>> --- >>>>>> Matthias >>>>>> >>>>>> >>>>>> Am 21.03.2016 um 05:53 schrieb Sreekanth Reddy: >>>>>>> Hi Matthias, >>>>>>> >>>>>>> Can you please share us the driver logs with driver logging_level set >>>>>>> to 0x3f8. So that we can get more info from this log. >>>>>>> >>>>>>> Thanks, >>>>>>> Sreekanth >>>>>>> >>>>>>> On Mon, Mar 21, 2016 at 1:44 AM, Matthias Prager >>>>>>> <li...@matthiasprager.de> wrote: >>>>>>>> Hello, >>>>>>>> >>>>>>>> I don't know what's the correct procedure, whether I should file a bug >>>>>>>> or first report this issue on the kernel mailing-list. So please feel >>>>>>>> free to tell me to open a ticket in the bugtracker >>>>>>>> (bugzilla.kernel.org?). >>>>>>>> >>>>>>>> But first let me present the issue I encounter: >>>>>>>> >>>>>>>> Kernels >= 4.2 (4.2.1 was the first on I tried, but also 4.3, 4.4 and >>>>>>>> 4.5) fail to load the mpt2sas driver on most (but not all) boots. >>>>>>>> Kernels <= 4.1.x work fine every single time (4.1.19 was the latest I >>>>>>>> tried, also 3.18.29). >>>>>>>> >>>>>>>> Here is the dmesg output for a failed driver init with Kernel 4.5.0: >>>>>>>>> [ 2.068313] mpt3sas version 09.102.00.00 loaded >>>>>>>>> [ 2.069412] mpt2sas_cm0: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, >>>>>>>>> total mem (3074748 kB) >>>>>>>>> [ 2.125260] mpt2sas_cm0: MSI-X vectors supported: 1, no of cores: >>>>>>>>> 4, max_msix_vectors: -1 >>>>>>>>> [ 2.125996] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 58 >>>>>>>>> [ 2.126199] mpt2sas_cm0: iomem(0x00000000fd4fc000), >>>>>>>>> mapped(0xffffc900000d0000), size(16384) >>>>>>>>> [ 2.126430] mpt2sas_cm0: ioport(0x0000000000004000), size(256) >>>>>>>>> [ 2.216371] mpt2sas_cm0: Allocated physical memory: size(4964 kB) >>>>>>>>> [ 2.216600] mpt2sas_cm0: Current Controller Queue Depth(3307),Max >>>>>>>>> Controller Queue Depth(3432) >>>>>>>>> [ 2.217004] mpt2sas_cm0: Scatter Gather Elements per IO(128) >>>>>>>>> [ 5.086959] floppy0: no floppy controllers found >>>>>>>>> [ 32.256720] mpt2sas_cm0: _base_event_notification: timeout >>>>>>>>> [ 32.256940] mf: >>>>>>>>> >>>>>>>>> [ 32.257106] 07000000 >>>>>>>>> [ 32.257302] 00000000 >>>>>>>>> [ 32.257337] 00000000 >>>>>>>>> [ 32.257533] 00000000 >>>>>>>>> [ 32.257568] 00000000 >>>>>>>>> [ 32.257764] 0f2f7fff >>>>>>>>> [ 32.257800] ffffff7c >>>>>>>>> [ 32.257995] ffffffff >>>>>>>>> [ 32.258031] >>>>>>>>> >>>>>>>>> [ 32.258352] ffffffff >>>>>>>>> [ 32.258387] 00000000 >>>>>>>>> [ 32.258582] 00000000 >>>>>>>>> >>>>>>>>> [ 32.258950] mpt2sas_cm0: sending message unit reset !! >>>>>>>>> [ 32.260688] mpt2sas_cm0: message unit reset: SUCCESS >>>>>>>>> [ 32.325956] mpt2sas_cm0: failure at >>>>>>>>> drivers/scsi/mpt3sas/mpt3sas_scsih.c:8592/_scsih_probe()! >>>>>>>> >>>>>>>> For comparison here is a dmesg output for a successful boot on Kernel >>>>>>>> 4.1.15: >>>>>>>>> [ 2.035568] mpt2sas version 20.100.00.00 loaded >>>>>>>>> [ 2.037243] mpt2sas0: 32 BIT PCI BUS DMA ADDRESSING SUPPORTED, >>>>>>>>> total mem (2046352 kB) >>>>>>>>> [ 2.755374] mpt2sas0: MSI-X vectors supported: 1, no of cores: 3, >>>>>>>>> max_msix_vectors: 8 >>>>>>>>> [ 2.756377] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 58 >>>>>>>>> [ 2.756708] mpt2sas0: iomem(0x00000000fd5fc000), >>>>>>>>> mapped(0xffffc900000d0000), size(16384) >>>>>>>>> [ 2.757083] mpt2sas0: ioport(0x0000000000004000), size(256) >>>>>>>>> [ 3.842944] mpt2sas0: Allocated physical memory: size(4964 kB) >>>>>>>>> [ 3.843303] mpt2sas0: Current Controller Queue Depth(3307), Max >>>>>>>>> Controller Queue Depth(3432) >>>>>>>>> [ 3.843717] mpt2sas0: Scatter Gather Elements per IO(128) >>>>>>>>> [ 4.415980] mpt2sas0: LSISAS2008: FWVersion(20.00.04.00), >>>>>>>>> ChipRevision(0x03), BiosVersion(07.39.00.00) >>>>>>>>> [ 4.416618] mpt2sas0: Protocol=(Initiator,Target), >>>>>>>>> Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set >>>>>>>>> Full,NCQ) >>>>>>>>> [ 4.417846] scsi host0: Fusion MPT SAS Host >>>>>>>>> [ 4.436865] mpt2sas0: sending port enable !! >>>>>>>>> [ 4.440460] mpt2sas0: host_add: handle(0x0001), >>>>>>>>> sas_addr(0xxxxxxxxxxxxxxxxx), phys(8) >>>>>>>>> >>>>>>>>> ... >>>>>>>>> [ 4.444045] scsi 0:0:0:0: Direct-Access ATA Hitachi >>>>>>>>> HDS5C302 A800 PQ: 0 ANSI: 6 >>>>>>>>> [ 4.444338] scsi 0:0:0:0: SATA: handle(0x0009), >>>>>>>>> sas_addr(0xxxxxxxxxxxxxxxxx), phy(1), device_name(0xxxxxxxxxxxxxxxxx) >>>>>>>>> [ 4.444823] scsi 0:0:0:0: SATA: >>>>>>>>> enclosure_logical_id(0xxxxxxxxxxxxxxxxx), slot(2) >>>>>>>>> [ 4.445197] scsi 0:0:0:0: atapi(n), ncq(y), asyn_notify(n), >>>>>>>>> smart(y), fua(y), sw_preserve(y) >>>>>>>>> ... (n times for n drives) >>>>>>>>> >>>>>>>>> [ 4.515443] mpt2sas0: port enable: SUCCESS >>>>>>>> >>>>>>>> >>>>>>>> The Controller(s) are all Avego/LSI 9211-8i running the latest version >>>>>>>> of IT firmware (v20.00.04.00). These are passed through to a >>>>>>>> gentoo-linux VM on an ESXi 5.1 host (latest patchlevel). I have two of >>>>>>>> these systems (one production one testing) with nearly identical >>>>>>>> hardware (Supermicro X8DTi-F boards with 2x Intel Westmere CPUs). I >>>>>>>> also have an older set of systems running the same software config >>>>>>>> (Intel S3200SHLC boards with single Core2Quad) which exhibit the same >>>>>>>> buggy behavior. >>>>>>>> >>>>>>>> The 'uname -a' line on the current testing system looks like this: >>>>>>>>> Linux pserver2 4.1.19-gentoo #4 SMP Thu Mar 17 16:02:48 CET 2016 >>>>>>>>> x86_64 Intel(R) Xeon(R) CPU E5506 @ 2.13GHz GenuineIntel GNU/Linux >>>>>>>> p >>>>>>>> >>>>>>>> There seem to be other people with similar issues: >>>>>>>> <https://bbs.archlinux.org/viewtopic.php?id=209495> >>>>>>>> >>>>>>>> Any thoughts? >>>>>>>> >>>>>>>> --- >>>>>>>> Matthias >>>>>> >>> -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
