What you seem to be trying to do is grouping (although its not too obvious when the output mirrors the input). Each xpath is testing on the preceeding::* axis, which is why you are noticing the exponential time difference.
> Do you know of a good site that focus on stylesheet efficiency? You might want to join the xsl-list (http://www.mulberrytech.com/xsl/xsl-list/) and post a sample of your source xml and a sample of your required output - someone will help you produce a stylesheet that avoids using preceeding::* and mulitple predicates. cheers andrew > -----Original Message----- > From: Malia Zaheer [mailto:[EMAIL PROTECTED] > Sent: 25 July 2002 15:58 > To: Joseph Kesselman; Frank E. Weiss > Cc: [EMAIL PROTECTED] > Subject: RE: FW: transformer hangs > > > Sorry, I didn't attach the xsl file. > > > > -----Original Message----- > From: Malia Zaheer [mailto:[EMAIL PROTECTED] > Sent: Thursday, July 25, 2002 10:55 AM > To: Joseph Kesselman; Frank E. Weiss > Cc: [EMAIL PROTECTED] > Subject: RE: FW: transformer hangs > > > After using XSLTC instead of interpretive XSLT and using > SAXSource instead > of > StreamSource for input, the performance increased > significantly, but not yet > optimal. Here are the results: > > 25KB xml - took 14 sec > 50KB xml - took 70 sec > 75KB xml - took 220 sec > > I know that the stylesheet that I am using is not efficient. That is > because I am generating that stylesheet programmatically, not > by hand so > that I can optimize it for each input. Here is the > stylesheet (I know it's > hard to read, but it's just nested for-each, if and variable > statements > followed by choose statement). I have also attached it to > this email if you > want to open it in IE, it's easier to read. > > <?xml version="1.0" encoding="UTF-8"?> > <xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform"; > exclude-result-prefixes="java" version="1.0" > xmlns:java="http://xml.apache.org/xslt/java";><xsl:output indent="yes" > method="xml"/><xsl:template match="/"><xsl:element > name="document"><xsl:call-template > name="template_1"/></xsl:element></xsl:template> > > > <xsl:template name="template_1"> > <xsl:for-each > select="/document/record/Flags[not(preceding::Flags=.)]"> > <xsl:variable name="Flags_1" select="."/> > <xsl:if test="/document[record[Flags=$Flags_1]]"> > <xsl:for-each > select="/document/record/SPM_RegioId[not(preceding::SPM_RegioId=.)]"> > <xsl:variable name="SPM_RegioId_2" select="."/> > <xsl:if > test="/document[record[Flags=$Flags_1][SPM_RegioId=$SPM_RegioId_2]]"> > <xsl:for-each > select="/document/record/SPM_DeviceId[not(preceding::SPM_Devic > eId=.)]"> > <xsl:variable name="SPM_DeviceId_3" select="."/> > <xsl:if > test="/document[record[SPM_DeviceId=$SPM_DeviceId_3][Flags=$Fl > ags_1][SPM_Reg > ioId=$SPM_RegioId_2]]"> > <xsl:for-each > select="/document/record/SUB_Instance[not(preceding::SUB_Insta > nce=.)]"> > <xsl:variable name="SUB_Instance_4" select="."/> > <xsl:if > test="/document[record[SPM_DeviceId=$SPM_DeviceId_3][Flags=$Fl > ags_1][SUB_Ins > tance=$SUB_Instance_4][SPM_RegioId=$SPM_RegioId_2]]"> > <xsl:for-each > select="/document/record/SPM_SubId[not(preceding::SPM_SubId=.)]"> > <xsl:variable name="SPM_SubId_5" select="."/> > <xsl:if > test="/document[record[SPM_DeviceId=$SPM_DeviceId_3][Flags=$Fl > ags_1][SUB_Ins > tance=$SUB_Instance_4][SPM_SubId=$SPM_SubId_5][SPM_RegioId=$SP > M_RegioId_2]]" > > > <xsl:for-each > select="/document/record/SPM_IspId[not(preceding::SPM_IspId=.)]"> > <xsl:variable name="SPM_IspId_6" select="."/><xsl:if > test="/document[record[SPM_DeviceId=$SPM_DeviceId_3][Flags=$Fl > ags_1][SUB_Ins > tance=$SUB_Instance_4][SPM_SubId=$SPM_SubId_5][SPM_RegioId=$SP > M_RegioId_2][S > PM_IspId=$SPM_IspId_6]]"> > <xsl:for-each > select="/document/record/TimeStamp[not(preceding::TimeStamp=.) > ]"><xsl:variab > le name="TimeStamp_7" select="."/> > <xsl:if > test="/document[record[SPM_DeviceId=$SPM_DeviceId_3][Flags=$Fl > ags_1][SUB_Ins > tance=$SUB_Instance_4][SPM_SubId=$SPM_SubId_5][SPM_RegioId=$SP > M_RegioId_2][T > imeStamp=$TimeStamp_7][SPM_IspId=$SPM_IspId_6]]"> > <xsl:for-each > select="/document/record/SPM_TRUNKID[not(preceding::SPM_TRUNKI > D=.)]"><xsl:va > riable name="SPM_TRUNKID_8" select="."/> > <xsl:if > test="/document[record[SPM_DeviceId=$SPM_DeviceId_3][Flags=$Fl > ags_1][SPM_TRU > NKID=$SPM_TRUNKID_8][SUB_Instance=$SUB_Instance_4][SPM_SubId=$ > SPM_SubId_5][S > PM_RegioId=$SPM_RegioId_2][TimeStamp=$TimeStamp_7][SPM_IspId=$ > SPM_IspId_6]]" > > > <xsl:for-each > select="/document/record/IFI_IPACKETS[not(preceding::IFI_IPACK > ETS=.)]"><xsl: > variable name="IFI_IPACKETS_9" select="."/> > <xsl:if > test="/document[record[SPM_SubId=$SPM_SubId_5][IFI_IPACKETS=$I > FI_IPACKETS_9] > [Flags=$Flags_1][SPM_RegioId=$SPM_RegioId_2][SPM_TRUNKID=$SPM_ > TRUNKID_8][SUB > _Instance=$SUB_Instance_4][SPM_DeviceId=$SPM_DeviceId_3][SPM_I > spId=$SPM_IspI > d_6][TimeStamp=$TimeStamp_7]]"> > <xsl:for-each > select="/document/record/IFI_OPACKETS[not(preceding::IFI_OPACK > ETS=.)]"> > <xsl:variable name="IFI_OPACKETS_10" select="."/><xsl:if > test="/document[record[SPM_SubId=$SPM_SubId_5][IFI_IPACKETS=$I > FI_IPACKETS_9] > [IFI_OPACKETS=$IFI_OPACKETS_10][Flags=$Flags_1][SPM_RegioId=$S > PM_RegioId_2][ > SPM_TRUNKID=$SPM_TRUNKID_8][SUB_Instance=$SUB_Instance_4][SPM_ > DeviceId=$SPM_ > DeviceId_3][SPM_IspId=$SPM_IspId_6][TimeStamp=$TimeStamp_7]]"> > <xsl:for-each > select="/document/record/IFI_IBYTES[not(preceding::IFI_IBYTES= > .)]"><xsl:vari > able name="IFI_IBYTES_11" select="."/> > <xsl:if > test="/document[record[SPM_SubId=$SPM_SubId_5][IFI_IPACKETS=$I > FI_IPACKETS_9] > [IFI_OPACKETS=$IFI_OPACKETS_10][Flags=$Flags_1][SPM_RegioId=$S > PM_RegioId_2][ > IFI_IBYTES=$IFI_IBYTES_11][SPM_TRUNKID=$SPM_TRUNKID_8][SUB_Ins > tance=$SUB_Ins > tance_4][SPM_DeviceId=$SPM_DeviceId_3][SPM_IspId=$SPM_IspId_6] > [TimeStamp=$Ti > meStamp_7]]"> > <xsl:for-each > select="/document/record/IFI_OBYTES[not(preceding::IFI_OBYTES=.)]"> > <xsl:variable name="IFI_OBYTES_12" select="."/><xsl:if > test="/document[record[SPM_SubId=$SPM_SubId_5][IFI_IPACKETS=$I > FI_IPACKETS_9] > [IFI_OBYTES=$IFI_OBYTES_12][IFI_OPACKETS=$IFI_OPACKETS_10][Fla > gs=$Flags_1][S > PM_RegioId=$SPM_RegioId_2][IFI_IBYTES=$IFI_IBYTES_11][SPM_TRUN > KID=$SPM_TRUNK > ID_8][SUB_Instance=$SUB_Instance_4][SPM_DeviceId=$SPM_DeviceId > _3][SPM_IspId= > $SPM_IspId_6][TimeStamp=$TimeStamp_7]]"><xsl:for-each > select="/document/record/IFI_IQDROPS[not(preceding::IFI_IQDROP > S=.)]"><xsl:va > riable name="IFI_IQDROPS_13" select="."/> > <xsl:if > test="/document[record[SPM_SubId=$SPM_SubId_5][IFI_IPACKETS=$I > FI_IPACKETS_9] > [IFI_OBYTES=$IFI_OBYTES_12][IFI_OPACKETS=$IFI_OPACKETS_10][Fla > gs=$Flags_1][I > FI_IQDROPS=$IFI_IQDROPS_13][SPM_RegioId=$SPM_RegioId_2][IFI_IB > YTES=$IFI_IBYT > ES_11][SPM_TRUNKID=$SPM_TRUNKID_8][SUB_Instance=$SUB_Instance_ > 4][SPM_DeviceI > d=$SPM_DeviceId_3][SPM_IspId=$SPM_IspId_6][TimeStamp=$TimeStam > p_7]]"><xsl:fo > r-each > select="/document/record/IFI_OQDROPS[not(preceding::IFI_OQDROPS=.)]"> > <xsl:variable name="IFI_OQDROPS_14" select="."/> > <xsl:if > test="/document[record[SPM_SubId=$SPM_SubId_5][IFI_IPACKETS=$I > FI_IPACKETS_9] > [IFI_OBYTES=$IFI_OBYTES_12][IFI_OPACKETS=$IFI_OPACKETS_10][Fla > gs=$Flags_1][I > FI_IQDROPS=$IFI_IQDROPS_13][SPM_RegioId=$SPM_RegioId_2][IFI_IB > YTES=$IFI_IBYT > ES_11][SPM_TRUNKID=$SPM_TRUNKID_8][SUB_Instance=$SUB_Instance_ > 4][SPM_DeviceI > d=$SPM_DeviceId_3][SPM_IspId=$SPM_IspId_6][TimeStamp=$TimeStam > p_7][IFI_OQDRO > PS=$IFI_OQDROPS_14]]"> > <xsl:for-each > select="/document/record/PKTS_DROP_ERR[not(preceding::PKTS_DRO > P_ERR=.)]"><xs > l:variable name="PKTS_DROP_ERR_15" select="."/> > <xsl:if > test="/document[record[SPM_SubId=$SPM_SubId_5][IFI_IPACKETS=$I > FI_IPACKETS_9] > [IFI_OBYTES=$IFI_OBYTES_12][IFI_OPACKETS=$IFI_OPACKETS_10][Fla > gs=$Flags_1][I > FI_IQDROPS=$IFI_IQDROPS_13][SPM_RegioId=$SPM_RegioId_2][IFI_IB > YTES=$IFI_IBYT > ES_11][PKTS_DROP_ERR=$PKTS_DROP_ERR_15][SPM_TRUNKID=$SPM_TRUNK > ID_8][SUB_Inst > ance=$SUB_Instance_4][SPM_DeviceId=$SPM_DeviceId_3][SPM_IspId= > $SPM_IspId_6][ > TimeStamp=$TimeStamp_7][IFI_OQDROPS=$IFI_OQDROPS_14]]"><xsl:for-each > select="/document/record/MULTICAST_IN_PKTS[not(preceding::MULT > ICAST_IN_PKTS= > .)]"> > <xsl:variable name="MULTICAST_IN_PKTS_16" select="."/> > <xsl:if > test="/document[record[SPM_SubId=$SPM_SubId_5][IFI_IPACKETS=$I > FI_IPACKETS_9] > [MULTICAST_IN_PKTS=$MULTICAST_IN_PKTS_16][IFI_OBYTES=$IFI_OBYT > ES_12][IFI_OPA > CKETS=$IFI_OPACKETS_10][Flags=$Flags_1][IFI_IQDROPS=$IFI_IQDRO > PS_13][SPM_Reg > ioId=$SPM_RegioId_2][IFI_IBYTES=$IFI_IBYTES_11][PKTS_DROP_ERR= > $PKTS_DROP_ERR > _15][SPM_TRUNKID=$SPM_TRUNKID_8][SUB_Instance=$SUB_Instance_4] > [SPM_DeviceId= > $SPM_DeviceId_3][SPM_IspId=$SPM_IspId_6][TimeStamp=$TimeStamp_ > 7][IFI_OQDROPS > =$IFI_OQDROPS_14]]"> > <xsl:for-each > select="/document/record/MULTICAST_OUT_PKTS[not(preceding::MUL > TICAST_OUT_PKT > S=.)]"><xsl:variable name="MULTICAST_OUT_PKTS_17" select="."/> > <xsl:choose> > <xsl:when > test="/document[record[SPM_SubId=$SPM_SubId_5][IFI_IPACKETS=$I > FI_IPACKETS_9] > [MULTICAST_IN_PKTS=$MULTICAST_IN_PKTS_16][IFI_OBYTES=$IFI_OBYT > ES_12][IFI_OPA > CKETS=$IFI_OPACKETS_10][Flags=$Flags_1][MULTICAST_OUT_PKTS=$MU > LTICAST_OUT_PK > TS_17][IFI_IQDROPS=$IFI_IQDROPS_13][SPM_RegioId=$SPM_RegioId_2 > ][IFI_IBYTES=$ > IFI_IBYTES_11][PKTS_DROP_ERR=$PKTS_DROP_ERR_15][SPM_TRUNKID=$S > PM_TRUNKID_8][ > SUB_Instance=$SUB_Instance_4][SPM_DeviceId=$SPM_DeviceId_3][SP > M_IspId=$SPM_I > spId_6][TimeStamp=$TimeStamp_7][IFI_OQDROPS=$IFI_OQDROPS_14]]"> > <xsl:element name="record"><xsl:element name="Flags"><xsl:value-of > select="$Flags_1"/></xsl:element><xsl:element > name="SPM_RegioId"><xsl:value-of > select="$SPM_RegioId_2"/></xsl:element> > <xsl:element name="SPM_DeviceId"><xsl:value-of > select="$SPM_DeviceId_3"/></xsl:element> > <xsl:element name="SUB_Instance"><xsl:value-of > select="$SUB_Instance_4"/></xsl:element> > <xsl:element name="SPM_SubId"><xsl:value-of > select="$SPM_SubId_5"/></xsl:element> > <xsl:element name="SPM_IspId"><xsl:value-of > select="$SPM_IspId_6"/></xsl:element> > <xsl:element name="TimeStamp"><xsl:value-of > select="$TimeStamp_7"/></xsl:element> > <xsl:element name="SPM_TRUNKID"><xsl:value-of > select="$SPM_TRUNKID_8"/></xsl:element> > <xsl:element name="IFI_IPACKETS"><xsl:value-of > select="$IFI_IPACKETS_9"/></xsl:element> > <xsl:element name="IFI_OPACKETS"><xsl:value-of > select="$IFI_OPACKETS_10"/></xsl:element> > <xsl:element name="IFI_IBYTES"><xsl:value-of > select="$IFI_IBYTES_11"/></xsl:element> > <xsl:element name="IFI_OBYTES"><xsl:value-of > select="$IFI_OBYTES_12"/></xsl:element> > <xsl:element name="IFI_IQDROPS"><xsl:value-of > select="$IFI_IQDROPS_13"/></xsl:element> > <xsl:element name="IFI_OQDROPS"><xsl:value-of > select="$IFI_OQDROPS_14"/></xsl:element> > <xsl:element name="PKTS_DROP_ERR"><xsl:value-of > select="$PKTS_DROP_ERR_15"/></xsl:element><xsl:element > name="MULTICAST_IN_PKTS"><xsl:value-of > select="$MULTICAST_IN_PKTS_16"/></xsl:element><xsl:element > name="MULTICAST_OUT_PKTS"><xsl:value-of > select="$MULTICAST_OUT_PKTS_17"/></xsl:element></xsl:element> > </xsl:when> > </xsl:choose> > </xsl:for-each> > </xsl:if> > </xsl:for-each></xsl:if></xsl:for-each></xsl:if></xsl:for-each > ></xsl:if></xs > l:for-each></xsl:if></xsl:for-each></xsl:if></xsl:for-each></x > sl:if></xsl:fo > r-each></xsl:if></xsl:for-each></xsl:if></xsl:for-each></xsl:i > f></xsl:for-ea > ch></xsl:if></xsl:for-each></xsl:if></xsl:for-each></xsl:if></ > xsl:for-each>< > /xsl:if></xsl:for-each></xsl:if></xsl:for-each></xsl:if></xsl: > for-each></xsl > :template></xsl:stylesheet> > > > And sample data record is: > > <record><Flags>0</Flags> > <SPM_RegioId>1</SPM_RegioId> > <SPM_DeviceId>1</SPM_DeviceId> > <SUB_Instance>-1</SUB_Instance> > <SPM_SubId>-1</SPM_SubId> > <SPM_IspId>6</SPM_IspId> > <TimeStamp>Thu Jul 04 17:40:30 EDT 2002</TimeStamp> > <SPM_TRUNKID>45</SPM_TRUNKID> > <IFI_IPACKETS>113</IFI_IPACKETS> > <IFI_OPACKETS>219</IFI_OPACKETS> > <IFI_IBYTES>7002</IFI_IBYTES> > <IFI_OBYTES>13038</IFI_OBYTES> > <IFI_IQDROPS>0</IFI_IQDROPS> > <IFI_OQDROPS>0</IFI_OQDROPS> > <PKTS_DROP_ERR>0</PKTS_DROP_ERR> > <MULTICAST_IN_PKTS>6760</MULTICAST_IN_PKTS> > <MULTICAST_OUT_PKTS>0</MULTICAST_OUT_PKTS> > </record> > > > Do you know of a good site that focus on stylesheet efficiency? > > -----Original Message----- > From: Joseph Kesselman [mailto:[EMAIL PROTECTED] > Sent: Thursday, July 25, 2002 9:46 AM > To: Frank E. Weiss > Cc: [EMAIL PROTECTED] > Subject: Re: FW: transformer hangs > > > >If a lot of cross-referencing of the input document is occuring, > >then the process can increase super-linearly, that is to say, > exponentially or >factorially. > > Note that there isn't much in XSLT or XPath, per se, which > scales worse > than linearly -- but there are many ways to write a path or > stylesheet > which does. Also, of course, if you're processing something > large enough > to drive your system into heavy swapping to disk you can > expect to see a > knee in the curve. > > So I'm still inclined to agree that this is most likely an > inefficient > stylesheet. It may well be one that _can't_ be written efficiently; > convolving multiple lists against each other is sometimes > necessary and > always expensive... but it might be a good idea to look at one of the > websites which suggest ways of improving stylesheet > efficiency, and see > whether any of those tips apply to what you're trying to do. > > ______________________________________ > Joe Kesselman / IBM Research > > > --- > Incoming mail is certified Virus Free. > Checked by AVG anti-virus system (http://www.grisoft.com). > Version: 6.0.373 / Virus Database: 208 - Release Date: 01/07/2002 > > > --- Outgoing mail is certified Virus Free. Checked by AVG anti-virus system (http://www.grisoft.com). Version: 6.0.373 / Virus Database: 208 - Release Date: 01/07/2002
