Re: Finding common words and phrases in a large block of text?

2018-10-25 Thread Tom Glod via use-livecode
Hi Terry, I see, thanks for sharing your handler. I'm going to run it on some text and see the output. LC is sooo good with chunks.I find it really fast as well. All the best, Tom On Thu, Oct 25, 2018 at 5:07 PM, Terry Judd via use-livecode < use-livecode@lists.runrev.com> wrote: > On 26

Re: Finding common words and phrases in a large block of text?

2018-10-25 Thread Terry Judd via use-livecode
On 26/10/2018 4:27 am, "use-livecode on behalf of Tom Glod via use-livecode" wrote: Hi Terry, glad you found a solution. I have a similar challenge. I did a word count, but would love to recognize the same phrases. Did you just compare chunks? ... hash them? (proba

Re: Finding common words and phrases in a large block of text?

2018-10-25 Thread Tom Glod via use-livecode
Hi Terry, glad you found a solution. I have a similar challenge. I did a word count, but would love to recognize the same phrases. Did you just compare chunks? ... hash them? (probably redundant?) Are there any more hints you can drop about this? Thanks, Tom On Thu, Oct 25, 2018 at 4:27

Re: Finding common words and phrases in a large block of text?

2018-10-25 Thread Terry Judd via use-livecode
OK - was easier than I thought. I have something that works fast enough by iterating through runs of words in each sentence in a block of text, incrementing counts into an array and then sorting the contents of that array by phrase length and frequency. Terry... On 25/10/2018 4:56 pm, "use-li

Finding common words and phrases in a large block of text?

2018-10-24 Thread Terry Judd via use-livecode
Hi – I’m looking to analyse some large block of text (journal abstracts from key educational technology journals over a several year period) to find common words and phrases. Finding common words should be easy enough but I’m not clear on what approach to take for finding common phrases (iterati