Re: leo stalling for long periods

[Edward K. Ream]

On Fri, Dec 16, 2016 at 2:06 PM, 'Terry Brown' via leo-editor <
leo-editor@googlegroups.com> wrote:

> Sounds like a challenge, cross platform wise etc.​
>

​Thanks for this comment.

Rev 2a0eca16 uses the following default:

@bool check_for_changed_external_files = false

The node now contains a warning that references #262
, now named "@bool
check_for_changed_external_files may hang on network files".

Given the severity of #262, I don't see any real alternative.

EKR

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.

Re: leo stalling for long periods

['Terry Brown' via leo-editor]

Sounds like a challenge, cross platform wise etc.
A unix command like `df -l` (disk free local) seems to know. But there are so 
many ways non-local files can be mounted, sshfs, Windows shares, etc.
Cheers -Terry
 
  From: Edward K. Ream <edream...@gmail.com>
 To: leo-editor <leo-editor@googlegroups.com> 
 Sent: Friday, December 16, 2016 12:23 PM
 Subject: Re: leo stalling for long periods
   
On Fri, Dec 16, 2016 at 11:11 AM, john lunzer <lun...@gmail.com> wrote:


Here is the issue in question. 
​
Thanks.  I've reopened it, and labeled it a Bug to denote its new status re 
network drives.

I am dithering about whether to make file check the default or not.  It may 
depend on whether it's possible to check whether a drive is a network drive or 
not. Does anyone know whether a check is possible?

EKR-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.


   
 

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.

Re: leo stalling for long periods

[Edward K. Ream]

On Fri, Dec 16, 2016 at 11:11 AM, john lunzer  wrote:

Here is the issue in question
> .
>
​
Thanks.  I've reopened it, and labeled it a Bug to denote its new status re
network drives.

I am dithering about whether to make file check the default or not.  It may
depend on whether it's possible to check whether a drive is a network drive
or not. Does anyone know whether a check is possible?

EKR

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.

Re: leo stalling for long periods

[john lunzer]

Yes, this was me because I almost exclusively access files over a slow vpn 
on network drives.

Here is the issue in question 
. I actually never 
tested this change. I'll try to turn it on at some point soon. On the other 
hand, the date Curtis gave for his build (Dec 8th) indicates that your 
previous changes should be included so perhaps the changes you made didn't 
have the desired effect.

On Thursday, December 15, 2016 at 6:13:33 PM UTC-5, Edward K. Ream wrote:
>
>
>
> On Thu, Dec 15, 2016 at 3:54 PM, Curtis Carlsen  > wrote:
>
>> I was mistaken, most of my external files are local, but some may be on 
>>> network drives.
>>>
>>
>> That said, your setting change seems to have fixed the problem!
>>
>> Perhaps even local files have similar problems on some platforms?
>>
>
> ​Thanks to all the participants in this discussion.  ​Clearly, the present 
> situations isn't good enough.  John, was it you who reported the 
> performance problems with network drives?  Do you remember the issue 
> number? I'm having trouble finding it.  It probably should be reopened.
>
> Edward
>

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.

Re: leo stalling for long periods

[Edward K. Ream]

On Thu, Dec 15, 2016 at 3:54 PM, Curtis Carlsen 
wrote:

> I was mistaken, most of my external files are local, but some may be on
>> network drives.
>>
>
> That said, your setting change seems to have fixed the problem!
>
> Perhaps even local files have similar problems on some platforms?
>

​Thanks to all the participants in this discussion.  ​Clearly, the present
situations isn't good enough.  John, was it you who reported the
performance problems with network drives?  Do you remember the issue
number? I'm having trouble finding it.  It probably should be reopened.

Edward

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.

Re: leo stalling for long periods

[Curtis Carlsen]

>
> I was mistaken, most of my external files are local, but some may be on 
> network drives.
>

That said, your setting change seems to have fixed the problem!

Perhaps even local files have similar problems on some platforms?

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.

Re: leo stalling for long periods

[Curtis Carlsen]

All of my external files are on network drives.  I'll give that setting 
change a try.

Thanks for the help.


On Monday, December 12, 2016 at 12:53:52 PM UTC-8, Curtis Carlsen wrote:
>
> I downloaded the new code base to try out the new importers.  (Leo 5.4, 
> december 8th)
>
> I am seeing extended stalling of different parts of the program, where 
> everything freezes and the program does not respond to keypresses or mouse 
> clicks.  The stall lasts for up to 30 seconds or a minute, then things 
> start working again.  It seems to happen at random intervals.  I don't have 
> to be doing anything, sometimes I am just looking at a node, or navigating 
> the tree and it freezes.
>
> I have seen it happen when editting nodes, and also when I am in the 
> file|import any menu item.  It doesn't really seem to matter what I am 
> doing at the time.  And if I run leo from the terminal, I don't see any 
> error messages there.  The file I am editting is fairly large (1.15 MBytes)
>
> I am running on Windows 7, python 2.7
>
> If I revert to using leo 5.1 final from October 20th, the problem goes 
> away.
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.

Re: leo stalling for long periods

[john lunzer]

I have also had to make this change because most of my files are on network 
locations.

On Wednesday, December 14, 2016 at 5:59:17 PM UTC-5, Terry Brown wrote:
>
> Looking around a bit more, looks like you can disable those file checks 
> with
>
> @bool check_for_changed_external_files = False
>
> in @settings, I see I have that set to False on the machine where the 
> checks
> were causing trouble for me, try that and see if it helps.
>
> Cheers -Terry
>
>
> --
> *From:* Curtis Carlsen <curtis...@gmail.com >
> *To:* leo-editor <leo-e...@googlegroups.com > 
> *Sent:* Wednesday, December 14, 2016 1:32 PM
> *Subject:* Re: leo stalling for long periods
>
> The file consists of hundreds of smaller nodes.  There may be a few large 
> nodes, but I find the warning screen about the QT lost data bug annoying so 
> I usually delete them.
>
> The original file is my work diary, built up over many months.  It has 
> lots of proprietary company data.  The boss would not be pleased with me 
> sharing it.
>
> I usually close out the diary files after about a year, because they get 
> slow to work with.  But the symptoms this time are different.  Everything 
> is running along fast and then just stops.  It kinda has the feel of a 
> thread getting stalled by a locked resource.  I seem to recall some kind of 
> issue with python getting locked up on multiprocessors because of a poorly 
> designed global lock, I have no idea if that could actually be involved, 
> but it's just something I remember.
>
>
> -- 
> You received this message because you are subscribed to the Google Groups 
> "leo-editor" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to leo-editor+...@googlegroups.com .
> To post to this group, send email to leo-e...@googlegroups.com 
> .
> Visit this group at https://groups.google.com/group/leo-editor.
> For more options, visit https://groups.google.com/d/optout.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.

Re: leo stalling for long periods

['Terry Brown' via leo-editor]

Looking around a bit more, looks like you can disable those file checks with
@bool check_for_changed_external_files = False

in @settings, I see I have that set to False on the machine where the 
checkswere causing trouble for me, try that and see if it helps.
Cheers -Terry

 
  From: Curtis Carlsen <curtiscarl...@gmail.com>
 To: leo-editor <leo-editor@googlegroups.com> 
 Sent: Wednesday, December 14, 2016 1:32 PM
 Subject: Re: leo stalling for long periods
   
The file consists of hundreds of smaller nodes.  There may be a few large 
nodes, but I find the warning screen about the QT lost data bug annoying so I 
usually delete them.

The original file is my work diary, built up over many months.  It has lots of 
proprietary company data.  The boss would not be pleased with me sharing it.

I usually close out the diary files after about a year, because they get slow 
to work with.  But the symptoms this time are different.  Everything is running 
along fast and then just stops.  It kinda has the feel of a thread getting 
stalled by a locked resource.  I seem to recall some kind of issue with python 
getting locked up on multiprocessors because of a poorly designed global lock, 
I have no idea if that could actually be involved, but it's just something I 
remember.

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.


   
 

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.

Re: leo stalling for long periods

['Terry Brown' via leo-editor]

If the nodes are small and it worked before, it's probably not size related - I 
was thinking of syntax highlighting, but that's probably not it.
Are any of the files you're working with non-local, i.e. on network file 
systems?  I've had trouble with that, and I think Leo started scanning loaded 
files for external changes recently.  Seems like that's a possibility.
You can set the threshold for seeing the QT lost data bug (bytes in a single 
node), if you don't think the bugs impacting you and you're seeing the warning 
too often.
If you're familiar with git, you could try running git bisect to find the exact 
commit that broke things.
Re Python and threads, Pyhton's GIL Global Interpreter Lock prevents more than 
one *thread* using CPU time at once.  But Leo's limited use of threading hasn't 
changed recently, that I know of... although on-idle handling did change not 
that long ago. 
 
  From: Curtis Carlsen <curtiscarl...@gmail.com>
 To: leo-editor <leo-editor@googlegroups.com> 
 Sent: Wednesday, December 14, 2016 1:32 PM
 Subject: Re: leo stalling for long periods
   
The file consists of hundreds of smaller nodes.  There may be a few large 
nodes, but I find the warning screen about the QT lost data bug annoying so I 
usually delete them.

The original file is my work diary, built up over many months.  It has lots of 
proprietary company data.  The boss would not be pleased with me sharing it.

I usually close out the diary files after about a year, because they get slow 
to work with.  But the symptoms this time are different.  Everything is running 
along fast and then just stops.  It kinda has the feel of a thread getting 
stalled by a locked resource.  I seem to recall some kind of issue with python 
getting locked up on multiprocessors because of a poorly designed global lock, 
I have no idea if that could actually be involved, but it's just something I 
remember.

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.


   
 

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.

Re: leo stalling for long periods

[Curtis Carlsen]

The file consists of hundreds of smaller nodes.  There may be a few large 
nodes, but I find the warning screen about the QT lost data bug annoying so 
I usually delete them.

The original file is my work diary, built up over many months.  It has lots 
of proprietary company data.  The boss would not be pleased with me sharing 
it.

I usually close out the diary files after about a year, because they get 
slow to work with.  But the symptoms this time are different.  Everything 
is running along fast and then just stops.  It kinda has the feel of a 
thread getting stalled by a locked resource.  I seem to recall some kind of 
issue with python getting locked up on multiprocessors because of a poorly 
designed global lock, I have no idea if that could actually be involved, 
but it's just something I remember.

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.

Re: leo stalling for long periods

['Terry Brown' via leo-editor]

On Mon, 12 Dec 2016 10:56:28 -0800 (PST)
Curtis Carlsen  wrote:

> I downloaded the new code base to try out the new importers.  (Leo
> 5.4, december 8th)
> 
> I am seeing extended stalling of different parts of the program,
> where everything freezes and the program does not respond to
> keypresses or mouse clicks.  The stall lasts for up to 30 seconds or
> a minute, then things start working again.  It seems to happen at
> random intervals.  I don't have to be doing anything, sometimes I am
> just looking at a node, or navigating the tree and it freezes.
> 
> I have seen it happen when editting nodes, and also when I am in the 
> file|import any menu item.  It doesn't really seem to matter what I
> am doing at the time.  And if I run leo from the terminal, I don't
> see any error messages there.  The file I am editting is fairly large
> (1.15 MBytes)

Hi Curtis,

Are you editing the whole 1.15 MBytes in a single node?  I think Leo
would struggle with that.  If not, then I'm not sure what might be
causing your problem.

If you do have everything in one node, you can probably break it up
with a layout like:

   @clean myfile.dat
"@others"
 node1
"text for node 1"
 node2
"text for node 2"
 node3
"text for node 3"

where the top node would literally just be "@others", but the other
nodes would be much larger chunks of text.

> I am running on Windows 7, python 2.7
> 
> If I revert to using leo 5.1 final from October 20th, the problem
> goes away.

Hmm, so it works in an earlier Leo... I guess we need a more detailed
description of what you're editing - if you could share the file that
would help.

Cheers -Terry

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.

leo stalling for long periods

[Curtis Carlsen]

I downloaded the new code base to try out the new importers.  (Leo 5.4, 
december 8th)

I am seeing extended stalling of different parts of the program, where 
everything freezes and the program does not respond to keypresses or mouse 
clicks.  The stall lasts for up to 30 seconds or a minute, then things 
start working again.  It seems to happen at random intervals.  I don't have 
to be doing anything, sometimes I am just looking at a node, or navigating 
the tree and it freezes.

I have seen it happen when editting nodes, and also when I am in the 
file|import any menu item.  It doesn't really seem to matter what I am 
doing at the time.  And if I run leo from the terminal, I don't see any 
error messages there.  The file I am editting is fairly large (1.15 MBytes)

I am running on Windows 7, python 2.7

If I revert to using leo 5.1 final from October 20th, the problem goes away.

-- 
You received this message because you are subscribed to the Google Groups 
"leo-editor" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to leo-editor+unsubscr...@googlegroups.com.
To post to this group, send email to leo-editor@googlegroups.com.
Visit this group at https://groups.google.com/group/leo-editor.
For more options, visit https://groups.google.com/d/optout.