On Wed, Jul 8, 2009 at 4:29 PM, Erwin Tsaur<erwin.ts...@sun.com> wrote:
> Chris Worley wrote:
>>
>> On Wed, Jul 8, 2009 at 3:42 PM, Erwin Tsaur<erwin.ts...@sun.com> wrote:
>>
>>>
>>> ok I severely underestimated how much 1000 lines are, but I got the info
>>> I
>>> needed, mostly.  Now I'm wondering if there is an errata in the Root Port
>>> causing this.
>>>
>>> /p...@0,0/pci8086,3...@1/pci15d9,10c9, I know it's a nic device.  Both
>>> notes
>>> are complaining of CE errors.
>>>
>>> The best way is to disable reporting those 2 CEs is to add the following
>>> line in the driver's .conf file.
>>>
>>
>> This is the igb driver (SUNWigb package).  It doesn't have a conf file.
>>
>> It's for the Intel 82576 Dual-Port GigE on-board NIC.  This driver
>> didn't work prior to the update.
>>
>> So, I made a .conf file thusly and rebooted:
>>
>> /usr/kernel/drv# cat >igb.conf
>> pcie_ce_mask=0x1040;
>>
>> ... no difference.  Still lots of errors reported (attached last 1000
>> lines).
>>
>
> It's not picking up the conf property...
> According to the pkgdef, I think the correct place is /kernel/drv/igb.conf
>
> It should be in the same place as the igb driver.

Okay, it was there, and I changed it and rebooted:

r...@opensolaris:~# tail /kernel/drv/igb.conf
# For example, if you see,
#       "/p...@0,0/pci10de,5...@d/pci8086,0...@0" 0 "igb"
#       "/p...@0,0/pci10de,5...@d/pci8086,0...@0,1" 1 "igb"
#
# name = "pciex8086,10a7" parent = "/p...@0,0/pci10de,5...@d" unit-address = "0"
# flow_control = 1;
# name = "pciex8086,10a7" parent = "/p...@0,0/pci10de,5...@d" unit-address = 
"0,1"
# flow_control = 3;
pcie_ce_mask=0x1040;

Still, no joy... the last 1K lines attached.

Thanks,

Chris
>
>
>> Chris
>>
>>>
>>> pcie_ce_mask=0x1040;
>>>
>>> It requires reboot.
>>>
>>> If you need to do it on a live system let me know, the instructions are a
>>> bit more complicated.
>>>
>>> Chris Worley wrote:
>>>
>>>>
>>>> On Wed, Jul 8, 2009 at 2:57 PM, Erwin Tsaur<erwin.ts...@sun.com> wrote:
>>>>
>>>>
>>>>>
>>>>> Chris Worley wrote:
>>>>>
>>>>>
>>>>>>
>>>>>> On Wed, Jul 8, 2009 at 2:42 PM, Erwin Tsaur<erwin.ts...@sun.com>
>>>>>> wrote:
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Chris Worley wrote:
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>> On Wed, Jul 8, 2009 at 1:10 PM, Erwin Tsaur<erwin.ts...@sun.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> Chris Worley wrote:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> (Sorry for the misleading "Subject" in the initial post.  would
>>>>>>>>>> like
>>>>>>>>>> to know a more appropriate place to post, since fm is just the
>>>>>>>>>> messenger here.)
>>>>>>>>>>
>>>>>>>>>> More to add: fmadm faulty may be saying something about a bad PCIe
>>>>>>>>>> slot or device (is there an "lspci" in OpenSolaris?):
>>>>>>>>>>
>>>>>>>>>> # fmadm faulty
>>>>>>>>>> --------------- ------------------------------------
>>>>>>>>>>  --------------
>>>>>>>>>> ---------
>>>>>>>>>> TIME            EVENT-ID                              MSG-ID
>>>>>>>>>> SEVERITY
>>>>>>>>>> --------------- ------------------------------------
>>>>>>>>>>  --------------
>>>>>>>>>> ---------
>>>>>>>>>> Jul 07 07:55:42 016cf20c-d572-42c1-f217-9eb8d439b73c
>>>>>>>>>>  PCIEX-8000-KP
>>>>>>>>>>  Major
>>>>>>>>>>
>>>>>>>>>> Fault class : fault.io.pciex.device-interr-corr max 29%
>>>>>>>>>>          fault.io.pciex.bus-linkerr-corr max 14%
>>>>>>>>>> Affects     : dev:////p...@0,0/pci8086,3...@1/pci15d9,1...@0
>>>>>>>>>>          dev:////p...@0,0/pci8086,3...@1/pci15d9,1...@0,1
>>>>>>>>>>          dev:////p...@0,0/pci8086,3...@1
>>>>>>>>>>              faulted but still in service
>>>>>>>>>> FRU         : "MB"
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> (hc://:product-id=X8DTH-i-6-iF-6F:chassis-id=1234567890:server-id=opensolaris/motherboard=0)
>>>>>>>>>>              faulty
>>>>>>>>>>
>>>>>>>>>> Description : Too many recovered bus errors have been detected,
>>>>>>>>>> which
>>>>>>>>>> indicates
>>>>>>>>>>          a problem with the specified bus or with the specified
>>>>>>>>>>          transmitting device. This may degrade into an
>>>>>>>>>> unrecoverable
>>>>>>>>>>          fault.
>>>>>>>>>>          Refer to http://sun.com/msg/PCIEX-8000-KP for more
>>>>>>>>>> information.
>>>>>>>>>>
>>>>>>>>>> Response    : One or more device instances may be disabled
>>>>>>>>>>
>>>>>>>>>> Impact      : Loss of services provided by the device instances
>>>>>>>>>> associated
>>>>>>>>>> with
>>>>>>>>>>          this fault
>>>>>>>>>>
>>>>>>>>>> Action      : If a plug-in card is involved check for badly-seated
>>>>>>>>>> cards
>>>>>>>>>> or
>>>>>>>>>>          bent pins. Otherwise schedule a repair procedure to
>>>>>>>>>> replace
>>>>>>>>>> the
>>>>>>>>>>          affected device.  Use fmadm faulty to identify the device
>>>>>>>>>> or
>>>>>>>>>>          contact Sun for support.
>>>>>>>>>>
>>>>>>>>>> How bad is this error?  I need to put some adapters in, but it
>>>>>>>>>> sounds
>>>>>>>>>> like the OS doesn't handle the NHM's IOH (or is it really
>>>>>>>>>> detaining
>>>>>>>>>> a
>>>>>>>>>> HW issue?).
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> OS does handle these issues and unfortunately it is a HW issue.
>>>>>>>>>  This
>>>>>>>>> is
>>>>>>>>> likely to eventually cause your system to panic or fill up your
>>>>>>>>> hard
>>>>>>>>> drive.
>>>>>>>>>  Assuming you are seeing a lot of btlp and rto errors..  If
>>>>>>>>> anything
>>>>>>>>> these
>>>>>>>>> errors are performance killer.  Not only is the RTO/BTLP error
>>>>>>>>> telling
>>>>>>>>> you
>>>>>>>>> that many packets require retransmit, the OS also has to constantly
>>>>>>>>> go
>>>>>>>>> out
>>>>>>>>> and scan and clean up the fabric.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> This system is triple boot: RHEL5.3, W2008S, and OpenSolaris.
>>>>>>>>
>>>>>>>> The errors in OpenSolaris occur if no cards are installed in the
>>>>>>>> bus.
>>>>>>>>
>>>>>>>> The other OSes don't report any errors w/ or w/o cards in the bus.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> This doesn't happen when there are no cards installed, since the
>>>>>>> error
>>>>>>> is
>>>>>>> literally complaining about a packets received between 2 devices.
>>>>>>>  Are
>>>>>>> you
>>>>>>> sure it's you are correctly identifying the right slot?
>>>>>>>
>>>>>>> I believe only OpenSolaris even detects these errors, which is why
>>>>>>> the
>>>>>>> other
>>>>>>> OSes don't report any errors.  It doesn't mean that errors aren't
>>>>>>> occurring
>>>>>>> though.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> It would also be nice to throttle the errlog so it doesn't fill
>>>>>>>>>> the
>>>>>>>>>> disk an hour after boot.  Is this possible?
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> no throttling possible, but you could turn it off, though highly
>>>>>>>>> not
>>>>>>>>> recommended, it's better to fix the issue.  It really could just be
>>>>>>>>> a
>>>>>>>>> badly
>>>>>>>>> seated card.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> How do I disable the errors?
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> We need to figure out exactly what your error is first, please
>>>>>>> provide
>>>>>>> the
>>>>>>> "fmdump -eV" log.  If it is huge, just tail the last 500-1000 lines
>>>>>>> should
>>>>>>> be enough.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> Would that produce the same as the incantation shown earlier?:
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>> I think all the CE's would produce the same message.  I also need to
>>>>> know
>>>>> the exact device.
>>>>>
>>>>>
>>>>
>>>> Last 1000 lines (of ~20 million) attached.
>>>>
>>>> There are some boards in the bus at this time, but the same error
>>>> occurs w/o them, and their drivers are not yet loaded.  Everything
>>>> else is built-in to the motherboard.
>>>>
>>>> Thanks,
>>>>
>>>> Chris
>>>>
>>>>
>>>>
>>>>>>>
>>>>>>> <snip>
>>>>>>>
>>>>>>>
>>>
>>>
>
>
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.dl.rto
        dev-status = 0x1
        ce-status = 0x1000
        __ttl = 0x1
        __tod = 0x4a55138d 0x12f8a272

Jul 08 2009 15:45:59.970932972 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c2bb7266002801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1/pci15d9,1...@0,1
        (end detector)

        bdf = 0x101
        device_id = 0x10c9
        vendor_id = 0x8086
        rev_id = 0x1
        dev_type = 0x0
        pcie_off = 0xa0
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x18
        pci_command = 0x47
        pcie_status = 0x11
        pcie_command = 0x2037
        pcie_dev_cap = 0x10008cc2
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62011
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x40
        pcie_ce_mask = 0x1040
        remainder = 0x1
        severity = 0x3
        __ttl = 0x1
        __tod = 0x4a551397 0x39df42ec

Jul 08 2009 15:45:49.318284402 ereport.io.pciex.rc.ce-msg
nvlist version: 0
        ena = 0x49b0c4a39e02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.rc.ce-msg
        rc-status = 0x1
        source-id = 0x8
        source-valid = 1
        __ttl = 0x1
        __tod = 0x4a55138d 0x12f8a272

Jul 08 2009 15:45:59.970954192 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c2bb77b5e02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x0
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x0
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x0
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551397 0x39df95d0

Jul 08 2009 15:46:00.017244122 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c2e79cd8702801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x1071fda

Jul 08 2009 15:45:49.318414289 ereport.io.pciex.dl.rto
nvlist version: 0
        ena = 0x49b0c69e6d02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.dl.rto
        dev-status = 0x1
        ce-status = 0x1000
        __ttl = 0x1
        __tod = 0x4a55138d 0x12fa9dd1

Jul 08 2009 15:46:00.096499337 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c3333254202801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x5c07689

Jul 08 2009 15:45:49.318414289 ereport.io.pciex.rc.ce-msg
nvlist version: 0
        ena = 0x49b0c69e6d02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.rc.ce-msg
        rc-status = 0x1
        source-id = 0x8
        source-valid = 1
        __ttl = 0x1
        __tod = 0x4a55138d 0x12fa9dd1

Jul 08 2009 15:46:00.153766083 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c369cf8f102801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x92a48c3

Jul 08 2009 15:46:00.248166782 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c3c3d68d402801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0xecab97e

Jul 08 2009 15:46:00.248193631 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c3c3dd13c02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0xecb225f

Jul 08 2009 15:46:00.307206100 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c3fc2474e02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x124f97d4

Jul 08 2009 15:45:49.327212760 ereport.io.pciex.dl.rto
nvlist version: 0
        ena = 0x49b14ce05402801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.dl.rto
        dev-status = 0x1
        ce-status = 0x1000
        __ttl = 0x1
        __tod = 0x4a55138d 0x1380ded8

Jul 08 2009 15:46:00.329848049 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c411bc3bb02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x13a914f1

Jul 08 2009 15:45:49.327212760 ereport.io.pciex.rc.ce-msg
nvlist version: 0
        ena = 0x49b14ce05402801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.rc.ce-msg
        rc-status = 0x1
        source-id = 0x8
        source-valid = 1
        __ttl = 0x1
        __tod = 0x4a55138d 0x1380ded8

Jul 08 2009 15:46:00.329887333 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c411c5c5102801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x13a9ae65

Jul 08 2009 15:46:00.393958875 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c44ee065702801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x177b55db

Jul 08 2009 15:46:00.440202798 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c47afa50102801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x1a3cf62e

Jul 08 2009 15:45:49.352285912 ereport.io.pciex.dl.rto
nvlist version: 0
        ena = 0x49b2cb758102801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.dl.rto
        dev-status = 0x1
        ce-status = 0x1000
        __ttl = 0x1
        __tod = 0x4a55138d 0x14ff74d8

Jul 08 2009 15:46:00.480168357 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c4a11780e02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x1c9ec9a5

Jul 08 2009 15:45:49.352285912 ereport.io.pciex.rc.ce-msg
nvlist version: 0
        ena = 0x49b2cb758102801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.rc.ce-msg
        rc-status = 0x1
        source-id = 0x8
        source-valid = 1
        __ttl = 0x1
        __tod = 0x4a55138d 0x14ff74d8

Jul 08 2009 15:46:00.514030039 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c4c16270702801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x1ea379d7

Jul 08 2009 15:46:00.620120343 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c5268f89202801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x24f64917

Jul 08 2009 15:46:00.770274599 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c5b5c24b602801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x2de97527

Jul 08 2009 15:46:00.789762291 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c5c8580c602801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x2f12d0f3

Jul 08 2009 15:45:49.650177429 ereport.io.pciex.dl.rto
nvlist version: 0
        ena = 0x49c48cec0f02801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        class = ereport.io.pciex.dl.rto
        dev-status = 0x1
        ce-status = 0x1000
        __ttl = 0x1
        __tod = 0x4a55138d 0x26c0eb95

Jul 08 2009 15:46:00.970276423 ereport.io.pci.fabric
nvlist version: 0
        class = ereport.io.pci.fabric
        ena = 0x4c6747ecb802801
        detector = (embedded nvlist)
        nvlist version: 0
                version = 0x0
                scheme = dev
                device-path = /p...@0,0/pci8086,3...@1
        (end detector)

        bdf = 0x8
        device_id = 0x3408
        vendor_id = 0x8086
        rev_id = 0x13
        dev_type = 0x40
        pcie_off = 0x90
        pcix_off = 0x0
        aer_off = 0x100
        ecc_ver = 0x0
        pci_status = 0x10
        pci_command = 0x47
        pci_bdg_sec_status = 0x0
        pci_bdg_ctrl = 0x3
        pcie_status = 0x1
        pcie_command = 0x27
        pcie_dev_cap = 0x8021
        pcie_adv_ctl = 0x0
        pcie_ue_status = 0x0
        pcie_ue_mask = 0x100000
        pcie_ue_sev = 0x62030
        pcie_ue_hdr0 = 0x0
        pcie_ue_hdr1 = 0x0
        pcie_ue_hdr2 = 0x0
        pcie_ue_hdr3 = 0x0
        pcie_ce_status = 0x1000
        pcie_ce_mask = 0x0
        pcie_rp_status = 0x0
        pcie_rp_control = 0x0
        pcie_adv_rp_status = 0x1
        pcie_adv_rp_command = 0x7
        pcie_adv_rp_ce_src_id = 0x8
        pcie_adv_rp_ue_src_id = 0x0
        remainder = 0x1
        severity = 0x1
        __ttl = 0x1
        __tod = 0x4a551398 0x39d53e47

_______________________________________________
fm-discuss mailing list
fm-discuss@opensolaris.org

Reply via email to