The penultimate line in "tab",
m=. (;n{.&.>1) +/;.1 b
is an example of the "cut by partition length" problem
discussed a few days ago. The following is equivalent:
m=. (I.n)+//.b
----- Original Message -----
From: Roger Hui <[EMAIL PROTECTED]>
Date: Tuesday, November 11, 2008 14:15
Subject: Re: [Jprogramming] Extracting values from log strings
To: Programming forum <[email protected]>
> The last line of "tab" has been garbled by accident or
> by some "helpful" program along the way. In any case:
>
> NB. y: log file lines, may be terminated by CRLF or LF
> NB. x: required attributes
> tab=: 4 : 0
> y=. y-.CR
> av=. a: -.~ (y e. '&',LF) <;._2 y NB. att=value strings
> k=. av i.&> '='
> a=. k {.&.> av NB. attribute names
> v=. (1+k) }.&.> av NB. values
> b=. a e. x NB. attributes of interest
> n=. (y e. LF) +/;._2 y='=' NB. # attributes on each line
> m=. (;n{.&.>1) +/;.1 b NB. # attributes of interest
> in each line
> x , (m,)$(b#v) ((m#(#x)*i.#m)+x i. b#a)}(m*)$a:
> )
>
> The last line should read: x , (m , & # x ) $ ...
>
>
>
> ----- Original Message -----
> From: Roger Hui <[EMAIL PROTECTED]>
> Date: Tuesday, November 11, 2008 14:10
> Subject: Re: [Jprogramming] Extracting values from log strings
> To: Programming forum <[email protected]>
>
> > t=: 0 : 0
> > att0=4010&att7=2457&att2=439
> > att3=902&att2=413&att5=4262&att4=4967
> > att5=4040&att1=465
> >
> > att4=2733
> > att3=2397&att2=1104&att6=2625
> > )
> >
> > NB. y: log file lines, may be terminated by CRLF or LF
> > NB. x: required attributes
> > tab=: 4 : 0
> > y=. y-.CR
> > av=. a: -.~ (y e. '&',LF) <;._2 y NB. att=value strings
> > k=. av i.&> '='
> > a=. k {.&.>
> > av NB. attribute names
> > v=. (1+k) }.&.>
> > av NB. values
> > b=. a e.
> > x NB. attributes of interest
> > n=. (y e. LF) +/;._2
> > y='=' NB. #
> > attributes on each line
> > m=. (;n{.&.>1) +/;.1
> > b NB. # attributes of interest in each line
> > x , (m,)$(b#v) ((m#(#x)*i.#m)+x i. b#a)}(m*)$a:
> > )
> >
> > (<;._1 ' att0 att1 att2') tab t
> > +----+----+----+
> > |att0|att1|att2|
> > +----+----+----+
> > |4010| |439 |
> > +----+----+----+
> > | | |413 |
> > +----+----+----+
> > | |465 | |
> > +----+----+----+
> > | | | |
> > +----+----+----+
> > | | |1104|
> > +----+----+----+
> >
> > If lines are separated by CRLF or LF rather than terminated,
> > you have to append a LF to the right argument of tab .
> >
> >
> >
> > ----- Original Message -----
> > From: "Lettow, Kenneth" <[EMAIL PROTECTED]>
> > Date: Tuesday, November 11, 2008 12:38
> > Subject: [Jprogramming] Extracting values from log strings
> > To: [email protected]
> >
> > > I have some log file data stored as long strings of
> > (attribute=value)> pairs. Here is some dummy data
> representing
> > a few lines:
> > > ------------------------------------------------------------
> > >
> >
> att0=4010&att7=2457&att2=439
> > >
> >
> att3=902&att2=413&att5=4262&att4=4967
> > > att5=4040&att1=465
> > >
> > >
> >
> att4=2733
> > > att3=2397&att2=1104&att6=2625
> > > ------------------------------------------------------------
> > > Each of the (attribute=value) pairs is delimited by "&", and the
> > > attribute name is separated from the value by an "=" character.
> > >
> > > Each of the lines can have an arbitrary number of
> attributes,
> > > includinglines with no attributes.
> > >
> > > Values can be strings or numbers, necessitating boxed results.
> > >
> > > Attributes can appear in any order on a line (i.e. att0 can occur
> > > before/after att1 etc.).
> > >
> > > What I want to do is to take the values from certain
> > attributes
> > > and put
> > > them into a table, i.e. take the values of att0, att1 and
> att2
> > > in dummy
> > > data (above) and create the following table.
> > >
> > > +----+----+----+
> > > |att0|att1|att2|
> > > +----+----+----+
> > > |4010| |439 |
> > > +----+----+----+
> > > | | |413 |
> > > +----+----+----+
> > > | |465 | |
> > > +----+----+----+
> > > | | | |
> > > +----+----+----+
> > > | | |1104|
> > > +----+----+----+
> > >
> > > Below is what I have so far. I cannot figure out the last steps.
> > >
> > > NB. Verb to generate dummy data
> > > genattdat=: 3 : 0
> > > NB. y = #lines testdata to generate
> > > numlines=. y
> > >
> > > NB. Maximum attributes per line (for demo purposes)
> > > MAXATTS=. 8
> > > MAXVAL=. 5000 NB. Max dummy value
> > >
> > > NB. Create attribute list
> > > attrlist=: 'att'&, each cut":i.MAXATTS
> > >
> > > res=. ''
> > > for. i.>:y do.
> > > randatts=. (~.(? (?#attrlist) $
> > > (#attrlist))){attrlist randvals=. ":each
> > > <"0 ((#randatts) ?MAXVAL)
> > > res=. res,(<}:;;<"1
> > > randatts,.(<'='),.randvals,.(<'&')) end.
> > > ]res=. >}.res
> > > )
> > >
> > > NB. Generate 5 lines of dummy data
> > > ]testdata=: genattdat 5
> > > att5=1830
> > > att2=3371&att6=3188&att3=536&att4=1176&att7=1832
> > > att0=1732&att7=4102&att3=797
> > > att6=4278&att1=3480&att2=4333&att5=2933&att7=1160
> > > att1=808&att2=2321&att4=3544&att5=3794
> > >
> > > NB. Parsed attributes
> > >
> > > ]atts=: deb each >{."1 each > each <"1 '='&cut
> > > each '&'&cut"1
> > > testdata
> > > +----+----+----+----+----+
> > > |att5| | |
> > > | |
> > > +----+----+----+----+----+
> > > |att2|att6|att3|att4|att7|
> > > +----+----+----+----+----+
> > > |att0|att7|att3| | |
> > > +----+----+----+----+----+
> > > |att6|att1|att2|att5|att7|
> > > +----+----+----+----+----+
> > > |att1|att2|att4|att5| |
> > > +----+----+----+----+----+
> > >
> > > NB. Parsed values
> > > ]vals=: deb each >,@}.@|: each > each <"1
> > > '='&cut each '&'&cut"1
> > > testdata
> > > +----+----+----+----+----+
> > > |1830| | |
> > > | |
> > > +----+----+----+----+----+
> > > |3371|3188|536 |1176|1832|
> > > +----+----+----+----+----+
> > > |1732|4102|797 | | |
> > > +----+----+----+----+----+
> > > |4278|3480|4333|2933|1160|
> > > +----+----+----+----+----+
> > > |808 |2321|3544|3794| |
> > > +----+----+----+----+----+
> > >
> > > NB. Attributes I want to keep and put into a table
> > >
> > > ]keepattributes=: 'att'&, each cut":i.3
> > > +----+----+----+
> > > |att0|att1|att2|
> > > +----+----+----+
> > >
> > > NB. mask of attributes to keep
> > >
> > > ]keepmsk=: (#keepattributes)>keepattributes i. atts
> > > 0 0 0 0 0
> > > 1 0 0 0 0
> > > 1 0 0 0 0
> > > 0 1 1 0 0
> > > 1 1 0 0 0
> > >
> > > NB. attributes to keep
> > > ]keepatts=: keepmsk #"1 1 atts
> > > +----+----+
> > > | | |
> > > +----+----+
> > > |att2| |
> > > +----+----+
> > > |att0| |
> > > +----+----+
> > > |att1|att2|
> > > +----+----+
> > > |att1|att2|
> > > +----+----+
> > >
> > > NB. values to keep
> > > ]keepvals=: keepmsk #"1 1 vals
> > > +----+----+
> > > | | |
> > > +----+----+
> > > |3371| |
> > > +----+----+
> > > |1732| |
> > > +----+----+
> > > |3480|4333|
> > > +----+----+
> > > |808 |2321|
> > > +----+----+
> > >
> > > It is here that I get stuck. How do I get keepatts and
> > > keepvals to this
> > > form?
> > >
> > > NB. Hand built result
> > > +----+----+----+
> > > |att0|att1|att2|
> > > +----+----+----+
> > > | | | |
> > > +----+----+----+
> > > | | |3371|
> > > +----+----+----+
> > > |1732| | |
> > > +----+----+----+
> > > | |3480|4333|
> > > +----+----+----+
> > > | |808 |2321|
> > > +----+----+----+
----------------------------------------------------------------------
For information about J forums see http://www.jsoftware.com/forums.htm
