Re: Strange phenomenon

2014-08-31 Thread R.J. Baars
> W dniu 2014-08-31 07:41, R.J. Baars pisze: >> I understand that, but it is not what I tried to ask. Wij is the >> degree-sign not a separate token? > > Because it is not one of the tokenizing characters. I think some rules > in some languages rely on this, so we'd have to be very careful. Okay,

Re: Strange phenomenon

2014-08-31 Thread Marcin Miłkowski
W dniu 2014-08-31 07:41, R.J. Baars pisze: > I understand that, but it is not what I tried to ask. Wij is the > degree-sign not a separate token? Because it is not one of the tokenizing characters. I think some rules in some languages rely on this, so we'd have to be very careful. Marcin > > Ru

Re: Strange phenomenon

2014-08-30 Thread R.J. Baars
I understand that, but it is not what I tried to ask. Wij is the degree-sign not a separate token? Ruud > On 2014-08-30 13:24, R.J. Baars wrote: > >> > regexp="yes">[0-9]{1,2}|[a-z] > >> Is there an explanation for the rule catching 2 characters in the >> token, >> like -3 and 1° ? > > [0-

Re: Strange phenomenon

2014-08-30 Thread Daniel Naber
On 2014-08-30 13:24, R.J. Baars wrote: >regexp="yes">[0-9]{1,2}|[a-z] > Is there an explanation for the rule catching 2 characters in the > token, > like -3 and 1° ? [0-9]{1,2} matches 0, 1, 2... 10, 11, 12... [a-z] matches a, b, c... As this is in an exception, the rule will match eve