On 17/10/2019 6:20 pm, Sean Gleann wrote:
On our z14, z/OSMF takes some 60m+ EXCPs and 300 seconds of CPU time
(according to SDSF) before it can even be used...

I have been investigating this exact issue. Looking at SMF 92 records, it appears that z/OSMF opens, reads and closes the same files thousands of times.

On my Dallas RDP system z/OSMF also takes about 60m EXCPs to start up. Startup is still fast - I suspect through caching magic of read only filesystems or VM read only disks it achieves somewhere between 500K-1M EXCPs per second and takes 1-2 minutes to start. (I also wonder whether EXCPs are counted differently against filesystems.)

I wrote a Java program using EasySMF to count the type 92 file close records by file name. The program:

import java.io.IOException;
import java.time.LocalDateTime;
import java.util.stream.Collectors;
import com.blackhillsoftware.smf.SmfRecordReader;
import com.blackhillsoftware.smf.smf92.*;

public class UssFileCloseCount
{
    public static void main(String[] args) throws IOException
    {
        LocalDateTime start = LocalDateTime.of(2019, 10, 9, 14, 9);
        LocalDateTime end = LocalDateTime.of(2019, 10, 9, 14, 11);

        try (SmfRecordReader reader = SmfRecordReader.fromDD("INPUT"))
        {
            reader.include(92,11)
                .stream()
                .map(record -> Smf92Record.from(record))
                .filter(r92 -> r92.smfDateTime().isAfter(start)
                        && r92.smfDateTime().isBefore(end))
                .filter(r92 -> r92.identificationSection().smf92jbn().equals("IZUSVR1"))
                .flatMap(r92 -> r92.FileCloses().stream())
                .collect(Collectors.groupingBy(close -> close.smf92cpn(),
                        Collectors.counting()))
                .entrySet().stream()
                .filter(entry -> entry.getValue() > 10)// count > 10
                .sorted((a, b) -> b.getValue().compareTo(a.getValue()))
                .forEachOrdered(entry ->
                        System.out.format("%7d %s%n",
                                entry.getValue(), entry.getKey()));
        }
    }
}

The result:

   1771 ation/helps/eclipse/plugins/com.ibm.cpomessages.help.doc/doc.zip
   1719 helps/eclipse/plugins/com.ibm.cpomessages.help.doc/nl/ja/doc.zip
   1662 n/helps/eclipse/plugins/com.ibm.tcp.ipsec.ipsec.help.doc/doc.zip
   1597 s/eclipse/plugins/com.ibm.tcp.ipsec.ipsec.help.doc/nl/ja/doc.zip
   1157 elps/eclipse/plugins/com.ibm.zosmfcore.messages.help.doc/doc.zip
   1143 clipse/plugins/com.ibm.zosmfcore.messages.help.doc/nl/ja/doc.zip
   1118 ta/cacheAdapt/com.ibm.ws.classloading.sharedlibrary_403/.overlay
    903 clipse/plugins/com.ibm.zosmfdeployment.messages.help.doc/doc.zip
    877 /plugins/com.ibm.zosmfdeployment.messages.help.doc/nl/ja/doc.zip
    771 ipse/plugins/com.ibm.zosmfworkloadmgmt.messages.help.doc/doc.zip
    681 eclipse/plugins/com.ibm.zosmfworkflows.messages.help.doc/doc.zip
    676 gi/136/data/cacheAdapt/com.ibm.ws.classloading.sharedlibrary_403
    652 lugins/com.ibm.zosmfworkloadmgmt.messages.help.doc/nl/ja/doc.zip
    628 e/plugins/com.ibm.zosmfworkflows.messages.help.doc/nl/ja/doc.zip
    551 n/helps/eclipse/plugins/com.ibm.commserver.zert.help.doc/doc.zip
    478 n/helps/eclipse/plugins/com.ibm.zosmfdeployment.help.doc/doc.zip
    442 sgi/60/data/cacheAdapt/com.ibm.ws.classloading.sharedlibrary_403
    418 /var/zosmf/configuration/helps/eclipse/plugins/doc.zip
    348 ipse/plugins/com.ibm.zosmfcapacityprov.messages.help.doc/doc.zip
    342 lugins/com.ibm.zosmfcapacityprov.messages.help.doc/nl/ja/doc.zip
    191 plugins/com.ibm.zosmfcpm.softwareconfigmessages.help.doc/doc.zip
    191 lipse/plugins/com.ibm.zosmfincidentlog.messages.help.doc/doc.zip
    188 plugins/com.ibm.zosmfincidentlog.messages.help.doc/nl/ja/doc.zip
    188 /eclipse/plugins/com.ibm.zosmfcore.multisysplex.help.doc/doc.zip
    185 /plugins/com.ibm.zosmfworkflows.editor.messages.help.doc/doc.zip
    181 helps/eclipse/plugins/com.ibm.zosmfworkloadmgmt.help.doc/doc.zip
    180 osmfServer/workarea/org.eclipse.osgi/26/data/bundle.origin.cache
    178 helps/eclipse/plugins/com.ibm.zosmfcapacityprov.help.doc/doc.zip
    175 eclipse/plugins/com.ibm.zosmfcapacityprov.help.doc/nl/ja/doc.zip
    173 se/plugins/com.ibm.zosmfcore.multisysplex.help.doc/nl/ja/doc.zip
    168 eclipse/plugins/com.ibm.zosmfworkloadmgmt.help.doc/nl/ja/doc.zip
    166 lugins/com.ibm.zosmfcore.softwareconfigmessages.help.doc/doc.zip
    166 eclipse/plugins/com.ibm.zosmfcpm.softwareconfig.help.doc/doc.zip
    165 s/eclipse/plugins/com.ibm.zosmfcpm.resourceprov.help.doc/doc.zip
    157 ation/helps/eclipse/plugins/com.ibm.gpmmessages.help.doc/doc.zip
    154 /helps/eclipse/plugins/com.ibm.zosmfincidentlog.help.doc/doc.zip
    154 helps/eclipse/plugins/com.ibm.gpmmessages.help.doc/nl/ja/doc.zip
    151 /eclipse/plugins/com.ibm.zosmfincidentlog.help.doc/nl/ja/doc.zip
    149 lipse/plugins/com.ibm.zosmfresourcemon.messages.help.doc/doc.zip
    146 helps/eclipse/plugins/com.ibm.zosmfcore.general.help.doc/doc.zip
    145 eclipse/plugins/com.ibm.zosmfcore.general.help.doc/nl/ja/doc.zip
    142 plugins/com.ibm.zosmfresourcemon.messages.help.doc/nl/ja/doc.zip
    139 /eclipse/plugins/com.ibm.zosmfcore.resourceprov.help.doc/doc.zip
    137 /helps/eclipse/plugins/com.ibm.zosmfmondesktops.help.doc/doc.zip
    136 on/helps/eclipse/plugins/com.ibm.zosmfworkflows.help.doc/doc.zip
    134 /eclipse/plugins/com.ibm.zosmfmondesktops.help.doc/nl/ja/doc.zip
    129 ps/eclipse/plugins/com.ibm.zosmfworkflows.help.doc/nl/ja/doc.zip
    128 ns/com.ibm.zosmfworkflows.editor.messages.help.doc/nl/ja/doc.zip
    124 s/eclipse/plugins/com.ibm.zosmfworkflows.editor.help.doc/doc.zip
    107 e/plugins/com.ibm.zosmfcpm.resourceprovmessages.help.doc/doc.zip
    104 e/plugins/com.ibm.zosmfcpm.softwareconfig.help.doc/nl/ja/doc.zip
    101 elps/eclipse/plugins/com.ibm.zosmfispf.messages.help.doc/doc.zip
    101 ns/com.ibm.zosmfcpm.resourceprovrespoolmessages.help.doc/doc.zip
     98 clipse/plugins/com.ibm.zosmfispf.messages.help.doc/nl/ja/doc.zip
     91 pse/plugins/com.ibm.zosmfworkflows.editor.help.doc/nl/ja/doc.zip
     90 pse/plugins/com.ibm.zosmfcpm.resourceprov.help.doc/nl/ja/doc.zip
     90 /plugins/com.ibm.zosmfcore.resourceprovmessages.help.doc/doc.zip
     90 s/com.ibm.zosmfcpm.softwareconfigmessages.help.doc/nl/ja/doc.zip
     90 /com.ibm.zosmfcore.softwareconfigmessages.help.doc/nl/ja/doc.zip
     90 se/plugins/com.ibm.zosmfcore.resourceprov.help.doc/nl/ja/doc.zip
     88 /eclipse/plugins/com.ibm.zosmfsysplexmanagement.help.doc/doc.zip
     82 s/com.ibm.zosmfcore.resourceprovrespoolmessages.help.doc/doc.zip
... more


Andrew Rowley

Black Hill Software

----------------------------------------------------------------------
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to [email protected] with the message: INFO IBM-MAIN

Reply via email to