python crash on windows but not on linux
To all, I am running an EDI translator, and doing stress tests. When processing a test with a (relatively) big EDI file(s) on windowsXP I get a crash: 'sorry for the inconvenience' etc (so no clues about what is causing the problem) This happens with python 2.4, 2.5, 2.6 It does not happen in the same setup&tests on linux. (while the linux machine has only half of the RAM of the windows machine). I am quite sure it is not some external module; there's no GUI (apart from 'print'), no network connections. Actually, the crash is not predictablethe crash occurs most of the time...but at different points. So basically I am wondering how to proceed. Is it related to a memory problem? (which does not occur on Linux) any pointer is very welcome, henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 11, 7:01 pm, Peter Otten <__pete...@web.de> wrote: > hjebbers wrote: > > On Feb 11, 5:45 pm, M3RT wrote: > >> The problem may be related to how you treat the EDI file or lets say > >> DATA. Also your coding style is important. Can you provide more info? > > > Yes, a whole lot more; but I do not want to bother you with that now. > > I was just wondering if it is possible that the same setup gives a > > CRASH! on windows and just works on linux. > > (where is the bug?) > > In the platform-specific code ;) > > Even on alt.haruspicy they cannot do much without a liver now and then... if it is in the platform-specific code should I make this into a bugreport? (because the crash does not appear at the same place in my code (when doing the same test-run) it will be quite hard to point down) henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 11, 7:01 pm, Peter Otten <__pete...@web.de> wrote: > hjebbers wrote: > > On Feb 11, 5:45 pm, M3RT wrote: > >> The problem may be related to how you treat the EDI file or lets say > >> DATA. Also your coding style is important. Can you provide more info? > > > Yes, a whole lot more; but I do not want to bother you with that now. > > I was just wondering if it is possible that the same setup gives a > > CRASH! on windows and just works on linux. > > (where is the bug?) > > In the platform-specific code ;) > > Even on alt.haruspicy they cannot do much without a liver now and then... if it is in the platform-specific code should I make this into a bugreport? (because the crash does not appear at the same place in my code (when doing the same test-run) it will be quite hard to point down) henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 11, 7:01 pm, Peter Otten <__pete...@web.de> wrote: > hjebbers wrote: > > On Feb 11, 5:45 pm, M3RT wrote: > >> The problem may be related to how you treat the EDI file or lets say > >> DATA. Also your coding style is important. Can you provide more info? > > > Yes, a whole lot more; but I do not want to bother you with that now. > > I was just wondering if it is possible that the same setup gives a > > CRASH! on windows and just works on linux. > > (where is the bug?) > > In the platform-specific code ;) > > Even on alt.haruspicy they cannot do much without a liver now and then... if it is in the platform-specific code should I make this into a bugreport? (because the crash does not appear at the same place in my code (when doing the same test-run) it will be quite hard to point down) henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 11, 8:42 pm, Jerry Hill wrote: > On Thu, Feb 11, 2010 at 9:32 AM, hjebbers wrote: > > To all, > > I am running an EDI translator, and doing stress tests. > > When processing a test with a (relatively) big EDI file(s) on > > windowsXP I get a crash: > > 'sorry for the inconvenience' etc (so no clues about what is > > causing the problem) > > You need to give us more information if we're going to be able to > help. At the very least, you'll need to copy & paste the actual error > message. It would be even better if you could show us some of your > code, and better yet if you could give us a small bit of code that is > self contained and reproduces the problem you're experiencing. > > -- > Jerry the error is a windows thing, I can make a screenshot of it, but I can not copy/paste text. how do I upload a png-file? problem is that the same error happens over and over (I can reproduce it), but not at the same place (the is a logging in the application so that is quite easy to see.) but I can show you my code. it's an open source EDI application. but it is not a small bit of code I am more than will to show you how to reproduce the error. kind regards, henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 11, 8:42 pm, Jerry Hill wrote: > On Thu, Feb 11, 2010 at 9:32 AM, hjebbers wrote: > > To all, > > I am running an EDI translator, and doing stress tests. > > When processing a test with a (relatively) big EDI file(s) on > > windowsXP I get a crash: > > 'sorry for the inconvenience' etc (so no clues about what is > > causing the problem) > > You need to give us more information if we're going to be able to > help. At the very least, you'll need to copy & paste the actual error > message. It would be even better if you could show us some of your > code, and better yet if you could give us a small bit of code that is > self contained and reproduces the problem you're experiencing. > > -- > Jerry the error is a windows thing, I can make a screenshot of it, but I can not copy/paste text. how do I upload a png-file? problem is that the same error happens over and over (I can reproduce it), but not at the same place (the is a logging in the application so that is quite easy to see.) but I can show you my code. it's an open source EDI application. but it is not a small bit of code I am more than will to show you how to reproduce the error. kind regards, henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 11, 11:59 pm, Terry Reedy wrote: > On 2/11/2010 9:32 AM, hjebbers wrote: > > > > > To all, > > I am running an EDI translator, and doing stress tests. > > When processing a test with a (relatively) big EDI file(s) on > > windowsXP I get a crash: > > 'sorry for the inconvenience' etc (so no clues about what is > > causing the problem) > > > This happens with python 2.4, 2.5, 2.6 > > It does not happen in the same setup&tests on linux. (while the linux > > machine has only half of the RAM of the windows machine). > > I am quite sure it is not some external module; there's no GUI (apart > > from 'print'), no network connections. > > Actually, the crash is not predictablethe crash occurs most of the > > time...but at different points. > > > So basically I am wondering how to proceed. > > Is it related to a memory problem? (which does not occur on Linux) > > > any pointer is very welcome, > > Are you using a 3rd-party extension (compiled-C) module? If so, I would > suspect something platform specific in that. That was my first thought. Sop I tried to eliminate that. well, there is a connection to a database. but I tested this with connections to SQLite, MySQL, PostGreSQL, and the crash keeps coming. So I think it is not a 3rd party module And all else is is pure python. kind regards, Henk-Jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 12, 12:13 am, Emile van Sebille wrote: > On 2/11/2010 6:32 AM hjebbers said... > > > To all, > > I am running an EDI translator, > > ... let's say bots :) > > > and doing stress tests. > > When processing a test with a (relatively) big EDI file(s) on > > windowsXP I get a crash: > > 'sorry for the inconvenience' etc (so no clues about what is > > causing the problem) > > ... and it's running directly under python... > > I use textpad. It allows me to launch a script from a command window > under its control, which when python subsequently crashes, commonly > leaves the traceback in the textpad launched command window. > > Perhaps that'll help? > > Emile > --also on the bots list and will be digging in seriously over the next > several weeks > > > > > This happens with python 2.4, 2.5, 2.6 > > It does not happen in the same setup&tests on linux. (while the linux > > machine has only half of the RAM of the windows machine). > > I am quite sure it is not some external module; there's no GUI (apart > > from 'print'), no network connections. > > Actually, the crash is not predictablethe crash occurs most of the > > time...but at different points. > > > So basically I am wondering how to proceed. > > Is it related to a memory problem? (which does not occur on Linux) > > > any pointer is very welcome, > > > henk-jan > > Hi Emile, yes, we are talking bots. I run the bots engine from the commandline. But... there is no python traceback. Python crashed 'hard'. or have you something else in mind? kind regards,henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 12, 12:13 am, Emile van Sebille wrote: > On 2/11/2010 6:32 AM hjebbers said... > > > To all, > > I am running an EDI translator, > > ... let's say bots :) > > > and doing stress tests. > > When processing a test with a (relatively) big EDI file(s) on > > windowsXP I get a crash: > > 'sorry for the inconvenience' etc (so no clues about what is > > causing the problem) > > ... and it's running directly under python... > > I use textpad. It allows me to launch a script from a command window > under its control, which when python subsequently crashes, commonly > leaves the traceback in the textpad launched command window. > > Perhaps that'll help? > > Emile > --also on the bots list and will be digging in seriously over the next > several weeks > > > > > This happens with python 2.4, 2.5, 2.6 > > It does not happen in the same setup&tests on linux. (while the linux > > machine has only half of the RAM of the windows machine). > > I am quite sure it is not some external module; there's no GUI (apart > > from 'print'), no network connections. > > Actually, the crash is not predictablethe crash occurs most of the > > time...but at different points. > > > So basically I am wondering how to proceed. > > Is it related to a memory problem? (which does not occur on Linux) > > > any pointer is very welcome, > > > henk-jan > > -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 12, 12:13 am, Emile van Sebille wrote: > On 2/11/2010 6:32 AM hjebbers said... > > > To all, > > I am running an EDI translator, > > ... let's say bots :) > > > and doing stress tests. > > When processing a test with a (relatively) big EDI file(s) on > > windowsXP I get a crash: > > 'sorry for the inconvenience' etc (so no clues about what is > > causing the problem) > > ... and it's running directly under python... > > I use textpad. It allows me to launch a script from a command window > under its control, which when python subsequently crashes, commonly > leaves the traceback in the textpad launched command window. > > Perhaps that'll help? > > Emile > --also on the bots list and will be digging in seriously over the next > several weeks > > > > > This happens with python 2.4, 2.5, 2.6 > > It does not happen in the same setup&tests on linux. (while the linux > > machine has only half of the RAM of the windows machine). > > I am quite sure it is not some external module; there's no GUI (apart > > from 'print'), no network connections. > > Actually, the crash is not predictablethe crash occurs most of the > > time...but at different points. > > > So basically I am wondering how to proceed. > > Is it related to a memory problem? (which does not occur on Linux) > > > any pointer is very welcome, > > > henk-jan > > -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 11, 11:56 pm, Carl Banks wrote: > On Feb 11, 2:39 pm, hjebbers wrote: > > > > > On Feb 11, 8:42 pm, Jerry Hill wrote: > > > > On Thu, Feb 11, 2010 at 9:32 AM, hjebbers wrote: > > > > To all, > > > > I am running an EDI translator, and doing stress tests. > > > > When processing a test with a (relatively) big EDI file(s) on > > > > windowsXP I get a crash: > > > > 'sorry for the inconvenience' etc (so no clues about what is > > > > causing the problem) > > > > You need to give us more information if we're going to be able to > > > help. At the very least, you'll need to copy & paste the actual error > > > message. It would be even better if you could show us some of your > > > code, and better yet if you could give us a small bit of code that is > > > self contained and reproduces the problem you're experiencing. > > > > -- > > > Jerry > > > the error is a windows thing, I can make a screenshot of it, but I can > > not copy/paste text. > > how do I upload a png-file? > > > problem is that the same error happens over and over (I can reproduce > > it), but not at the same place (the is a logging in the application so > > that is quite easy to see.) > > but I can show you my code. it's an open source EDI application. > > but it is not a small bit of code > > I am more than will to show you how to reproduce the error. > > People coming here ask for help will vary in the amount of detail > given, but I've rarely seen anyone as reluctant as you. It's like > walking into an auto repair shop and asking the mechanic what's wrong > with your car by trying to imitate the noise it makes. > I am reluctant because it is a lot of code as I told you, it occurs during stress tests. I am more than willing to show how to reproduce the crash. > If your code is very largre, you're not going to get out of this > without doing some of your own legwork. I'm sorry. I am more than willing to do this, of course. > > Do this: Take your code, make a copy of it. Start removing code from > the copy (in a controlled way) until the problem disappears. When you > remove code don't worry about whether it produces anything useful, the > object is to try to identify what's causing the error. Whatever code > you removed when the error disappears should give you a clue what's > causing it. Then, if need be, you can come back and post details. If > you manage to get the program to a small size without eliminating the > problem, you can post it here. OK, I know how to trace a bug. As I said, these are stress tests, in this case the input files are MUCH larger than usualy. Other stress tests run thousands of input file of regular to big size. This all runs. It does run OK on Linux (so am I looking for a bug in my program??). The crash pops up at different places...this makes the procedure you suggest quite awkward. It is a hard crash of python. There is no traceback or something: Python dies. Python is no more. It's stone dead. It has ceased to be. It's a stiff. It's kicked the bucket etc kind regards, henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 11, 5:45 pm, M3RT wrote: > Hi, > > The problem may be related to how you treat the EDI file or lets say > DATA. Also your coding style is important. Can you provide more info? Yes, a whole lot more; but I do not want to bother you with that now. I was just wondering if it is possible that the same setup gives a CRASH! on windows and just works on linux. (where is the bug?) kind regards, henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 12, 3:41 am, a...@pythoncraft.com (Aahz) wrote: > In article > <34fcf680-1aa4-4835-9eba-3db3249f3...@q16g2000yqq.googlegroups.com>, > > hjebbers wrote: > > >the error is a windows thing, I can make a screenshot of it, but I can > >not copy/paste text. > > In that case, you need to -- very carefully -- make sure you transcribe > exactly the message that you see on the screen. > -- > Aahz (a...@pythoncraft.com) <*> http://www.pythoncraft.com/ > > "At Resolver we've found it useful to short-circuit any doubt and just > refer to comments in code as 'lies'. :-)" The message on the screen is (I typed it over): ** python.exe python.exe has encountered a problem and needs to close. We are sorry for the inconvenience. If you were in the middle of something, the information you were working on might be lost For more information about the error, click here. *** the information about the error is a windows dump. kind regards, henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 12, 2:06 pm, Dave Angel wrote: > hjebbers wrote: > > On Feb 12, 3:41 am, a...@pythoncraft.com (Aahz) wrote: > > >> In article > >> <34fcf680-1aa4-4835-9eba-3db3249f3...@q16g2000yqq.googlegroups.com>, > > >> hjebbers wrote: > > >>> the error is a windows thing, I can make a screenshot of it, but I can > >>> not copy/paste text. > > >> In that case, you need to -- very carefully -- make sure you transcribe > >> exactly the message that you see on the screen. > >> -- > >> Aahz (a...@pythoncraft.com) <*> > >> http://www.pythoncraft.com/ > > >> "At Resolver we've found it useful to short-circuit any doubt and just > >> > >> refer to comments in code as 'lies'. :-)" > > > The message on the screen is (I typed it over): > > > > > You shouldn't ever have to retype the message. Just paste from the DOS > box (or "Command Prompt"). It's easy using QuickEdit mode. > > You select a rectangle of the text by selecting with the mouse, then > using right-click to put it in the clipboard. > > If that doesn't work, you haven't yet enabled QuickEdit mode. Use > right-click on the DOS box's title bar. Choose Properties. Select the > first tab, which is Options. > > You should then see a selection box called "Quick Edit Mode". Turn it > on, and you won't have this problem again. > > DaveA Hi Dave, thanks. but the message is not in the DOS box (or "Command Prompt"). I do run the program in a DOS box (or "Command Prompt"), but the error is a windows dialog box. I can not select in this dialog box. kind regards, henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 12, 3:17 pm, Peter Otten <__pete...@web.de> wrote: > hjebbers wrote: > > On Feb 11, 7:01 pm, Peter Otten <__pete...@web.de> wrote: > >> hjebbers wrote: > >> > On Feb 11, 5:45 pm, M3RT wrote: > >> >> The problem may be related to how you treat the EDI file or lets say > >> >> DATA. Also your coding style is important. Can you provide more info? > > >> > Yes, a whole lot more; but I do not want to bother you with that now. > >> > I was just wondering if it is possible that the same setup gives a > >> > CRASH! on windows and just works on linux. > >> > (where is the bug?) > > >> In the platform-specific code ;) > > >> Even on alt.haruspicy they cannot do much without a liver now and then... > > > if it is in the platform-specific code should I make this into a > > bugreport? > > A this stage a bug report would be useless. The details you have provided so > far don't give anyone without physical access to your machine a chance to > reproduce the error. > > > (because the crash does not appear at the same place in my code (when > > doing the same test-run) it will be quite hard to point down) > > Indeed. The culprit may be an extension written in C that is overwriting > memory still in use by other parts of your program. > > Peter No C extensions used. Definitely not. As these crashes occur during stress tests, I go to the limits of the memory available. What strikes me is: 1. the crash on windows, but linux works OK (same test sets) 2. the linux box has 750Mb RAM, the windows box has 1.5Gb (twice as much). kind regards, Henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 12, 11:46 pm, Rob Williscroft wrote: > hjebbers wrote in news:2864756a-292b-4138-abfd- > 3348b72b7...@u9g2000yqb.googlegroups.com in comp.lang.python: > > > the information about the error is a windows dump. > > This may help: > > #http://msdn.microsoft.com/en-us/library/ms680621(VS.85).aspx > > SEM_FAILCRITICALERRORS = 1 > SEM_NOALIGNMENTFAULTEXCEPT = 4 > SEM_NOGPFAULTERRORBOX = 4 > SEM_NOOPENFILEERRORBOX = 8 > > import ctypes > from ctypes.wintypes import UINT > > SetErrorMode = ctypes.windll.kernel32.SetErrorMode > SetErrorMode.restype = UINT > SetErrorMode.argtypes = ( UINT,) > > Then putting: > > SetErrorMode( SEM_FAILCRITICALERRORS | SEM_NOGPFAULTERRORBOX ) > > at the start of you programme, should stop the "Critical Error" dialog > box you are seeing and you may get a chance to see a traceback. > > Rob. Hi Rob, thanks. I tried this, but did not work for me. henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 13, 11:03 am, Peter Otten <__pete...@web.de> wrote: > hjebbers wrote: > > On Feb 12, 3:17 pm, Peter Otten <__pete...@web.de> wrote: > >> hjebbers wrote: > >> > On Feb 11, 7:01 pm, Peter Otten <__pete...@web.de> wrote: > >> >> hjebbers wrote: > >> >> > On Feb 11, 5:45 pm, M3RT wrote: > >> >> >> The problem may be related to how you treat the EDI file or lets > >> >> >> say DATA. Also your coding style is important. Can you provide more > >> >> >> info? > > >> >> > Yes, a whole lot more; but I do not want to bother you with that > >> >> > now. I was just wondering if it is possible that the same setup > >> >> > gives a CRASH! on windows and just works on linux. > >> >> > (where is the bug?) > > >> >> In the platform-specific code ;) > > >> >> Even on alt.haruspicy they cannot do much without a liver now and > >> >> then... > > >> > if it is in the platform-specific code should I make this into a > >> > bugreport? > > >> A this stage a bug report would be useless. The details you have provided > >> so far don't give anyone without physical access to your machine a chance > >> to reproduce the error. > > >> > (because the crash does not appear at the same place in my code (when > >> > doing the same test-run) it will be quite hard to point down) > > >> Indeed. The culprit may be an extension written in C that is overwriting > >> memory still in use by other parts of your program. > > >> Peter > > > No C extensions used. Definitely not. > > > As these crashes occur during stress tests, I go to the limits of the > > memory available. > > What strikes me is: > > 1. the crash on windows, but linux works OK (same test sets) > > 2. the linux box has 750Mb RAM, the windows box has 1.5Gb (twice as > > much). > > Random thoughts: > > If there were not enough memory Python should give a MemoryError rather than > segfault. > > Do both systems use the same memory layout (i. e. 32 or 64bit OS, 16 or 32 > bit unicode)? bot use 32bits; but the windows box uses 16 bits unicode, on linux 32bits unicode is used. the memory used by my program is for the larger part unicode strings. well, but that makes the better performance of linux even stranger... > > Try an alpha of Python 2.7. If you're lucky "your" bug was found 'n' fixed > independently. well...that's what I thought for version 2.6 ;-) (I run into this crash a longer time ago) but seriously, I'll try this. kind regards, henk-jan > > Peter -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 13, 10:25 am, Dennis Lee Bieber wrote: > On Fri, 12 Feb 2010 09:21:07 -0800 (PST), hjebbers > declaimed the following in gmane.comp.python.general: > > > What strikes me is: > > 1. the crash on windows, but linux works OK (same test sets) > > 2. the linux box has 750Mb RAM, the windows box has 1.5Gb (twice as > > much). > > Which on its own does not mean much. > > Windows in a normal installation only grants 2GB address space to > user code, reserving the other 2GB space for the OS shared libraries. If > your program attempts to allocate over that, it will fail. That the > Windows box has twice the physical memory only means it doesn't resort > to page swapping as soon. > > There is a boot parameter switch that toggles Windows into a 3GB > user/1GB OS mode -- hey, that would be great!! on my 1,5G mahcine ;-) > it is mainly meant for server machines where there > won't be many disjoint OS libraries loaded, but the server applications > need lots of data space. > > What split does the Linux OS use? If it give 3GB to user space, > while you'd start to page swap much soon, you'd also have 50% more > virtual memory that can be allocated than under Windows. > -- > Wulfraed Dennis Lee Bieber KD6MOG > wlfr...@ix.netcom.com HTTP://wlfraed.home.netcom.com/ I will check this.any advice on how to check this? henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
to all, thanks for the pointers so far. if you feel the need to reproduce the crash, it's not that hard, (downloading and installing my edi translator, install configuration (button-click), and run. I have a modified version (replace some *.py files) that eliminate a lot of stuff (simpler setup, no database used, no external C-modules). contact me for recipe and files about me being reluctant to 'show the code': - the crash that happens during stress tests. - the crash occurs not always, and at different points. - the code does runs OK on linux (which does not mean there's no bugt in it ;-) kind regards, henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 13, 12:24 pm, "Diez B. Roggisch" wrote: > Am 13.02.10 11:50, schrieb hjebbers: > > > > > On Feb 13, 10:25 am, Dennis Lee Bieber wrote: > >> On Fri, 12 Feb 2010 09:21:07 -0800 (PST), hjebbers > >> declaimed the following in gmane.comp.python.general: > > >>> What strikes me is: > >>> 1. the crash on windows, but linux works OK (same test sets) > >>> 2. the linux box has 750Mb RAM, the windows box has 1.5Gb (twice as > >>> much). > > >> Which on its own does not mean much. > > >> Windows in a normal installation only grants 2GB address space to > >> user code, reserving the other 2GB space for the OS shared libraries. If > >> your program attempts to allocate over that, it will fail. That the > >> Windows box has twice the physical memory only means it doesn't resort > >> to page swapping as soon. > > >> There is a boot parameter switch that toggles Windows into a 3GB > >> user/1GB OS mode -- > > > hey, that would be great!! on my 1,5G mahcine ;-) > > You don't get it - it's about the virtual memory address space > available. This has nothing to do with physical memory. Obviously if the > latter runs out, the swapping will make the machine painfully slow. But > that's another issue. > > Diez Diez, you are right; I misunderstood. henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On Feb 13, 10:25 am, Dennis Lee Bieber wrote: > On Fri, 12 Feb 2010 09:21:07 -0800 (PST), hjebbers > declaimed the following in gmane.comp.python.general: > > > What strikes me is: > > 1. the crash on windows, but linux works OK (same test sets) > > 2. the linux box has 750Mb RAM, the windows box has 1.5Gb (twice as > > much). > > Which on its own does not mean much. > > Windows in a normal installation only grants 2GB address space to > user code, reserving the other 2GB space for the OS shared libraries. If > your program attempts to allocate over that, it will fail. That the > Windows box has twice the physical memory only means it doesn't resort > to page swapping as soon. > > There is a boot parameter switch that toggles Windows into a 3GB > user/1GB OS mode -- it is mainly meant for server machines where there > won't be many disjoint OS libraries loaded, but the server applications > need lots of data space. > > What split does the Linux OS use? If it give 3GB to user space, > while you'd start to page swap much soon, you'd also have 50% more > virtual memory that can be allocated than under Windows. > -- > Wulfraed Dennis Lee Bieber KD6MOG > wlfr...@ix.netcom.com HTTP://wlfraed.home.netcom.com/ Hi Wulfraed, I tried this (the 3GB switch). But python still crashes. kind regards, henk-jan -- http://mail.python.org/mailman/listinfo/python-list
Re: python crash on windows but not on linux
On 13 feb, 13:48, Dave Angel wrote: > hjebbers wrote: > > On Feb 13, 10:25 am, Dennis Lee Bieber wrote: > > >> On Fri, 12 Feb 2010 09:21:07 -0800 (PST), hjebbers > >> declaimed the following in gmane.comp.python.general: > > >>> What strikes me is: > >>> 1. the crash on windows, but linux works OK (same test sets) > >>> 2. the linux box has 750Mb RAM, the windows box has 1.5Gb (twice as > >>> much). > > >> Which on its own does not mean much. > > >> Windows in a normal installation only grants 2GB address space to > >> user code, reserving the other 2GB space for the OS shared libraries. If > >> your program attempts to allocate over that, it will fail. That the > >> Windows box has twice the physical memory only means it doesn't resort > >> to page swapping as soon. > > >> There is a boot parameter switch that toggles Windows into a 3GB > >> user/1GB OS mode -- > > > hey, that would be great!! on my 1,5G mahcine ;-) > > >> it is mainly meant for server machines where there > >> won't be many disjoint OS libraries loaded, but the server applications > >> need lots of data space. > > >> What split does the Linux OS use? If it give 3GB to user space, > >> while you'd start to page swap much soon, you'd also have 50% more > >> virtual memory that can be allocated than under Windows. > >> -- > >> Wulfraed Dennis Lee Bieber KD6MOG > >> wlfr...@ix.netcom.com HTTP://wlfraed.home.netcom.com/ > > > I will check this.any advice on how to check this? > > > henk-jan > > As I posted in recent thread on Tutor, > > But the one you might want is a boot.ini option that tells the OS to > only reserve 1gb for itself, and leave 3gb for user space. But there > are tradeoffs, including the need to modify an application's executable > to take advantage of it. And the whole system may run substantially > slower, even when your're extended app isn't running. See links: > http://www.microsoft.com/whdc/system/platform/server/PAE/PAEmem.mspx > > http://blogs.technet.com/askperf/archive/2007/03/23/memory-management... > > DaveA Yes, you are right, i also would need to modify the executable. the reason why I posted on this list was the hard crash of python - which python really should not do I think. AFAICS there is no 'bug' in my edi translator (runs OK on linux) - but it uses far to much memory. For me, I am going to bring back the memory footprint of my edi translator. Which should be fairly easy to do. kind regards, henk-jan -- http://mail.python.org/mailman/listinfo/python-list
