Re: slow loading & navigation to card containing large field

[Curry Kenworthy via use-livecode]

I would use binfile to a variable, rather than a custom prop.

I've seen LC 9 fields become unusable after reaching a certain # of 
chars. I would trust LC 9 fields with 8 million chars - maybe not 80.


If users have a need to see what's going on, intentionally show them 
what they need to see. Not the raw data - when it's this big.


Best wishes,

Curry Kenworthy

Custom Software Development
"Better Methods, Better Results"
LiveCode Training and Consulting
http://livecodeconsulting.com/

___
use-livecode mailing list
use-livecode@lists.runrev.com
Please visit this url to subscribe, unsubscribe and manage your subscription 
preferences:
http://lists.runrev.com/mailman/listinfo/use-livecode

Re: slow loading & navigation to card containing large field

[David V Glasgow via use-livecode]

Hmmm.  Food for thought both!  

Loading I just use 

put URL ("file:" & theFilePath) into tdata

I have always assumed that reading as binary is only for data that isn’t  text. 
 I’ll try that. If I want to display some or all of the file in a field, do I 
need to process the data read as a binary, or can I just put it into a field?

So far I have worked on the principle that users should be able to see the 
effects of their searches, etc, so have defaulted to field.  Maybe I could 
store part of the list in the field (and swap in/out out as users scroll 
through) but do the main storage and heavy lifting within a custom property?

Thanks very much for the suggestions.

Cheers,

David G

> On 1 Jul 2020, at 5:15 pm, Klaus major-k via use-livecode 
>  wrote:
> 
> Hi David
> 
>> Am 01.07.2020 um 18:10 schrieb Richard Gaskin via use-livecode 
>> :
>> 
>> David V Glasgow wrote:
>> 
>>> Loading the plain text list of URLs from file is slowish, but more
>>> importantly, for some time gives no indication that the file is
>>> loading.
>> 
>> Are you reading the file as text or binary?
>> I would imagine reading as binary would be more efficient since it's a 
>> straight pull from disk, without the content alterations text-read does.
>> 
>> -- 
>> Richard Gaskin
> 
> and unless REALLY neccessary, store the data in a custom property instead of 
> a field.
> 
> 
> Best
> 
> Klaus
> 
> --
> Klaus Major
> https://www.major-k.de
> kl...@major-k.de
> 
> 
> ___
> use-livecode mailing list
> use-livecode@lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your subscription 
> preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode

___
use-livecode mailing list
use-livecode@lists.runrev.com
Please visit this url to subscribe, unsubscribe and manage your subscription 
preferences:
http://lists.runrev.com/mailman/listinfo/use-livecode

Re: slow loading & navigation to card containing large field

[Klaus major-k via use-livecode]

Hi David

> Am 01.07.2020 um 18:10 schrieb Richard Gaskin via use-livecode 
> :
> 
> David V Glasgow wrote:
> 
> > Loading the plain text list of URLs from file is slowish, but more
> > importantly, for some time gives no indication that the file is
> > loading.
> 
> Are you reading the file as text or binary?
> I would imagine reading as binary would be more efficient since it's a 
> straight pull from disk, without the content alterations text-read does.
> 
> -- 
> Richard Gaskin

and unless REALLY neccessary, store the data in a custom property instead of a 
field.


Best

Klaus

--
Klaus Major
https://www.major-k.de
kl...@major-k.de


___
use-livecode mailing list
use-livecode@lists.runrev.com
Please visit this url to subscribe, unsubscribe and manage your subscription 
preferences:
http://lists.runrev.com/mailman/listinfo/use-livecode

Re: slow loading & navigation to card containing large field

[Richard Gaskin via use-livecode]

David V Glasgow wrote:

> Loading the plain text list of URLs from file is slowish, but more
> importantly, for some time gives no indication that the file is
> loading.

Are you reading the file as text or binary?

I would imagine reading as binary would be more efficient since it's a 
straight pull from disk, without the content alterations text-read does.


--
 Richard Gaskin
 Fourth World Systems
 Software Design and Development for the Desktop, Mobile, and the Web
 
 ambassa...@fourthworld.comhttp://www.FourthWorld.com

___
use-livecode mailing list
use-livecode@lists.runrev.com
Please visit this url to subscribe, unsubscribe and manage your subscription 
preferences:
http://lists.runrev.com/mailman/listinfo/use-livecode

slow loading & navigation to card containing large field

[David V Glasgow via use-livecode]

Hello LCers

On Mac 10.13, LC 9.6

In my stack I have a field on one card consisting of imported text, which is 
typically several thousand of internet searches/file names/URLs.

I search for a number of  keywords, which are then aggregated, and by 
navigating to another card, display summary statistics  on the content 
analysis, in the form of a bar chart displaying the top 20 found terms.  So not 
a lot of data on the charting card.

I have a fairly extreme case of 781,000 lines (80,988,686 chars) in the content 
analysis field, consisting of a web history.

I am amazed at the efficiency of the searching process, which takes a while, 
but is as fast as I could hope.  It is slower than earlier versions, but the 
memory usage stays very steady, which wasn’t the case in 8 or early 9.  I’m 
happy to swap a bit of speed for more stability.  The content analysis works 
nicely, the transition to the chart card and chart displays quite quickly.

I have 2 problems:

1/ Loading the plain text list of URLs from file is slowish, but more 
importantly, for some time gives no indication that the file is loading.  After 
selecting the file, there is a long pause before the cursor becomes the OS 
beachball, another long pause and then eventually the card and populated field 
appears.  Is there any way of letting users know that this 82MB file *is* being 
loaded, they just need to be patient?  Or am I wholly in the hands of the OS?

2/  Navigating from the chart card back to the card containing the big list of 
URLs is very slow, typically taking about a minute from the mouseup on the 
navigate button (or command from message box).  A précis of the message watcher 
shows the delay occurs between the consecutive closeBackground and cREVTable 
messages below.

mouseup 3:55:45 PM (1)

closeCard 3:55:45 PM (0)

closeBackground 3:55:45 PM (0)

cREVTable 3:56:43 PM (58144)

opencard 3:56:45 PM (22)

(In the preopenstack of the big field card, I hide a group containing 9 fields 
each containing maybe 30 words - nothing that should take much time)

Am I just asking too much of LC, or are there any suggestions about making the 
transition between cards brisker? 


Best Wishes,
David Glasgow
Consultant Forensic & Clinical Psychologist

  

  
 
___
use-livecode mailing list
use-livecode@lists.runrev.com
Please visit this url to subscribe, unsubscribe and manage your subscription 
preferences:
http://lists.runrev.com/mailman/listinfo/use-livecode