Greetings everyone,

This is my first attempt at Open Source. Sharing knowledge instead of keeping it locked up in patents and so on. What is it scientists used to say? That they stand on the shoulders of those who went before them, and extend the knowledge. Nowdays, it seems that profit rules everything, and knowledge gets locked down and unavailable. Great shame when you consider that all knowledge comes from one source.


What this little routine does is to split a sentence, or program statement into tokens or words, and allow you to access them them separately. I've used the routines for years in such things as Interpretive languages, an Indexing package for large manuals and other things.

You can get it here: http://members.ozemail.com.au/~oscarptyltd/tokenize.html

Main page: http://members.ozemail.com.au/~oscarptyltd/

================

As it happened, this is the first code to be released because I needed to get the indexing package running on 32 bit Windows, and the Tokenising routines needed to be converted first.

Which also means that I should be able to get an expression evaluation/ interpreter routine out soon, too.

================

The PL/I routines have two demo programs, but I have temporarily run out of time to do the Assembler or C ones. If anyone is suddenly desperate,
let me know and I'll put something together, with "proper" documentation.

Really, all you have to do is copy the string you want to be tokenized into an area, set the two preceding bytes to the length, call a routine, and it is all split up ready for you to access each word simply.

Create only beautiful days, live life to the max, and don't only think outside the box, but get rid of it!

Clem Clarke



Clement V. Clarke - Author Jol, EASYJCL, EASYPANEL, OSCAR, 370TO486
[EMAIL PROTECTED], Web: http://www.ozemail.com.au/~oscarptyltd
16/38 Kings Park Road, West Perth, AUSTRALIA, 6005.
Tel (61)-8-9324-1119, Mob 0401-054-155.

----------------------------------------------------------------------
For IBM-MAIN subscribe / signoff / archive access instructions,
send email to [EMAIL PROTECTED] with the message: GET IBM-MAIN INFO
Search the archives at http://bama.ua.edu/archives/ibm-main.html

Reply via email to