[opendx-users] Memory relocation problem
Hi, [I am using OpenDX 4.1.0 on FreeBSD 4.1.1 Dual Intel Pentium III 700 with 1 Gb memory.] I have some problems with importing series object. I am trying import series object from series.dx file like this containing 50 time steps. - object temperature class series member file tets00.fld member file tets001000.fld member file tets002000.fld member file tets003000.fld member file tets004000.fld member file tets005000.fld ... - where every tets%%% file has such header - object data class array type float rank 0 items 2 lsb ieee data 0 # object positions class gridpositions counts 20 20 50 origin 0 0 0 delta 1 0 0 delta 0 1 0 delta 0 0 1 # object connections class gridconnections counts 20 20 50 # object step1000 class field component data value data component positions value positions component connections value connections # attribute t_step string 1000 attribute time string 0.000221547 # end - When I try to import series with every time step about 3Mb in size (gridpositions counts 20 20 2000) i receive the following error message: ERROR: Import: Invalid data: bad or missing series member object/file '/w/Chdrv/calc/series.dx' line 6. This error follows by Memory reclamation action. The debug log is Begin Execution 0: Planning [08bd40e0] 481::/main:0/Import:1 0: opening file '/w/okun/Chdrv/calc/tets00.fld' 0: opening file '/w/okun/Chdrv/calc/tets001000.fld' 0: opening file '/w/okun/Chdrv/calc/tets002000.fld' 0: opening file '/w/okun/Chdrv/calc/tets003000.fld' 0: Memory reclamation: looking for 320 bytes ERROR: Import: Invalid data: bad or missing series member object / file '/w/Chdrv/calc/series.dx' line 6. The number of files read before error message varies from 3 to 8 for one data set. Thanks in advance Mike Okun [EMAIL PROTECTED]
RE: [opendx-users] trouble installing on Windows 98
You need to install the MFC and msvcrt dlls available from opendx.org website. As usual M$ tries to make Windows unpredictable, M$ started shipping different versions with different export symbols of C runtime dlls with different windows OS. Exceed 7.0 works just fine, However there is a maintainance release of Exceed 7.0.1 available to registered users. Use you Update from Web option from Exceed 7.0. It fixes several nasty bugs. Suhaib -Original Message- From: Debra Sue Goldberg [mailto:[EMAIL PROTECTED] Sent: Monday, January 08, 2001 9:55 AM To: opendx2-users@lists.berlios.de Subject: [opendx-users] trouble installing on Windows 98 I tried installing OpenDX on my IBM laptop, running Win98 SE. I have Exceed version 7, not v.6. Anyone try to load with v7? there was no exceed/user directory to copy files into. Backspace didn't work - probably because I didn't do the above copy. where should these files go? When trying to execute one of the sample programs, (accumulate.net) got illegal instruction unpacked the dxsamples file, couldn't do make. Still same error. didn't download dlls Thanks, Debra
Re: [opendx-users] Memory relocation problem
Hi, [I am using OpenDX 4.1.0 on FreeBSD 4.1.1 Dual Intel Pentium III 700 with 1 Gb memory.] I have some problems with importing series object. I am trying import series object from series.dx file like this containing 50 time steps. - object temperature class series member file tets00.fld member file tets001000.fld member file tets002000.fld member file tets003000.fld member file tets004000.fld member file tets005000.fld ... - If this is literally what you have, I don't see a member number, so this file should not import. member 0 file tets00.fld member 1 file tets01.fld ... Chris Pelkie Vice President/Scientific Visualization Producer Conceptual Reality Presentations, Inc. 30 West Meadow Drive Ithaca, NY 14850 [EMAIL PROTECTED]
Re[2]: [opendx-users] Memory relocation problem
Hello Chris, Thank you for your suggestion. But as I see in User Guide this number is optional. Now I have added this number but problem still remain. And the number of file read before error occurs is varying time to time. Generally, when I run my program first time after running DX executive there are 9 - 12 files successfully loads, then the number of files loaded before error decrease to 3-4. series.dx and time step files are unchanged. Thanks in advance, Mike Okun Russian Research Center Kurchatov Institute Kurchatov Square Moscow 123182 Russia Tel. +7 (095)196-72-80 [EMAIL PROTECTED] 16:47 09.01.2001 Tuesday, January 09, 2001, 3:41:35 PM, you wrote: Hi, [I am using OpenDX 4.1.0 on FreeBSD 4.1.1 Dual Intel Pentium III 700 with 1 Gb memory.] I have some problems with importing series object. I am trying import series object from series.dx file like this containing 50 time steps. - object temperature class series member file tets00.fld member file tets001000.fld member file tets002000.fld member file tets003000.fld member file tets004000.fld member file tets005000.fld ... - CP If this is literally what you have, I don't see a member number, so this CP file should not import. CP member 0 file tets00.fld CP member 1 file tets01.fld CP ... CP Chris Pelkie CP Vice President/Scientific Visualization Producer CP Conceptual Reality Presentations, Inc. CP 30 West Meadow Drive CP Ithaca, NY 14850 CP [EMAIL PROTECTED]
Re: [opendx-users] Memory relocation problem
I do not see the attributes for dependency. They are imperative and dx needs them to understand how to further process the data. I have noticed that not having these attributes can cause problems. object data class array type float rank 0 items 2 lsb ieee data 0 attribute dep string positions # object positions class gridpositions counts 20 20 50 origin 0 0 0 delta 1 0 0 delta 0 1 0 delta 0 0 1 attribute dep string positions # object connections class gridconnections counts 20 20 50 attribute dep string connections attribute ref string positions # object step1000 class field component data value data component positions value positions component connections value connections # attribute t_step string 1000 attribute time string 0.000221547 # end I'm also not sure about being able to use the named objects over and over. Whenever I have created a series object its always been in one file where I've had to use unique numbers for all the separate objects. Try it and let me know. David Hi, [I am using OpenDX 4.1.0 on FreeBSD 4.1.1 Dual Intel Pentium III 700 with 1 Gb memory.] I have some problems with importing series object. I am trying import series object from series.dx file like this containing 50 time steps. - object temperature class series member file tets00.fld member file tets001000.fld member file tets002000.fld member file tets003000.fld member file tets004000.fld member file tets005000.fld ... - where every tets%%% file has such header - object data class array type float rank 0 items 2 lsb ieee data 0 # object positions class gridpositions counts 20 20 50 origin 0 0 0 delta 1 0 0 delta 0 1 0 delta 0 0 1 # object connections class gridconnections counts 20 20 50 # object step1000 class field component data value data component positions value positions component connections value connections # attribute t_step string 1000 attribute time string 0.000221547 # end - When I try to import series with every time step about 3Mb in size (gridpositions counts 20 20 2000) i receive the following error message: ERROR: Import: Invalid data: bad or missing series member object/file '/w/Chdrv/calc/series.dx' line 6. This error follows by Memory reclamation action. The debug log is Begin Execution 0: Planning [08bd40e0] 481::/main:0/Import:1 0: opening file '/w/okun/Chdrv/calc/tets00.fld' 0: opening file '/w/okun/Chdrv/calc/tets001000.fld' 0: opening file '/w/okun/Chdrv/calc/tets002000.fld' 0: opening file '/w/okun/Chdrv/calc/tets003000.fld' 0: Memory reclamation: looking for 320 bytes ERROR: Import: Invalid data: bad or missing series member object / file '/w/Chdrv/calc/series.dx' line 6. The number of files read before error message varies from 3 to 8 for one data set. Thanks in advance Mike Okun [EMAIL PROTECTED] -- . David L. Thompson The University of Montana mailto:[EMAIL PROTECTED] Computer Science Department http://www.cs.umt.edu/u/dthompsn Missoula, MT 59812 Work Phone : (406)257-8530
Re[2]: [opendx-users] Memory relocation problem
I'm intrigued to know where it says the member number is optional, as both the html and pdf indicate it as required (position and value are optional). I've always put one in, so maybe it works without it and I just didn't know that. Anyway, I think you are simply running out of memory. Series are imported as a whole, so there must be room for every item to fit from each file. The advantage of series imports is that you can find the min-max of the entire series which can set ranges for colormaps, etc. So if you cannot load the whole series, you may have to run a preprocessing net that opens each series member one at a time, derives the min and max and stores it in a temporary value (see the Help on GetGlobal-SetGlobal). Then after you have these values, you can open each file for processing, again, one member at a time, process it, colorize it, etc. and write out an image file for animating with another program, like imageMagick or Quicktime or whatever you have. If you look at Import parameters, you see that you can specify which member(s) to open. These numbers can be driven by the Sequencer to automate the process. Or buy more memory. Open the Message Window and choose CommandsShow Memory Use to get a handle on how much memory is being consumed as you run DX. (You have to do it manually each time you want to know). Try stripping down your series file to contain only 3-4 members, load it, examine memory. Then add more members to the file, Reset Server to clear the cached imported file, run DX again, etc. At some point (some number of members), you'll see that available memory has been exceeded during the Import. Chris Pelkie Vice President/Scientific Visualization Producer Conceptual Reality Presentations, Inc. 30 West Meadow Drive Ithaca, NY 14850 [EMAIL PROTECTED]
Re[3]: [opendx-users] Memory relocation problem
Hello Chris, Thank you for your suggestions. It seems I should to process each file separately and determine max and min value as you suggested. As concerned memory usage that according ps or Dx information box dxexec using not more then 40 MB when I have about 1 GB free physical memory on my computer. And all my data file is about 180 Mb in size. I also check limits, it seems everything Ok (1 GB datasize, 65 MB stacksize ). Thank you again, Mike Okun Russian Research Center Kurchatov Institute Kurchatov Square Moscow 123182 Russia Tel. 007(095)196-72-80 [EMAIL PROTECTED] 20:35 09.01.2001 Tuesday, January 09, 2001, 7:26:23 PM, you wrote: CP I'm intrigued to know where it says the member number is optional, as both CP the html and pdf indicate it as required (position and value are optional). CP I've always put one in, so maybe it works without it and I just didn't know CP that. CP Anyway, I think you are simply running out of memory. Series are imported CP as a whole, so there must be room for every item to fit from each file. The CP advantage of series imports is that you can find the min-max of the entire CP series which can set ranges for colormaps, etc. So if you cannot load the CP whole series, you may have to run a preprocessing net that opens each CP series member one at a time, derives the min and max and stores it in a CP temporary value (see the Help on GetGlobal-SetGlobal). Then after you have CP these values, you can open each file for processing, again, one member at a CP time, process it, colorize it, etc. and write out an image file for CP animating with another program, like imageMagick or Quicktime or whatever CP you have. If you look at Import parameters, you see that you can specify CP which member(s) to open. These numbers can be driven by the Sequencer to CP automate the process. CP Or buy more memory. Open the Message Window and choose CommandsShow Memory CP Use to get a handle on how much memory is being consumed as you run DX. CP (You have to do it manually each time you want to know). Try stripping down CP your series file to contain only 3-4 members, load it, examine memory. Then CP add more members to the file, Reset Server to clear the cached imported CP file, run DX again, etc. At some point (some number of members), you'll see CP that available memory has been exceeded during the Import. CP Chris Pelkie CP Vice President/Scientific Visualization Producer CP Conceptual Reality Presentations, Inc. CP 30 West Meadow Drive CP Ithaca, NY 14850 CP [EMAIL PROTECTED]
Re[3]: [opendx-users] Memory relocation problem
Hello Chris, Thank you for your suggestions. It seems I should to process each file separately and determine max and min value as you suggested. As concerned memory usage that according ps or Dx information box dxexec using not more then 40 MB when I have about 1 GB free physical memory on my computer. And all my data file is about 180 Mb in size. I also check limits, it seems everything Ok (1 GB datasize, 65 MB stacksize ). dxexec may show only 40Mb on startup, but once you start loading lots of files, it will dynamically allocate more (thus my point about checking using the Message Window). If you have started DX with the -memory flag, you may have limited it to only 40 or so. Normally, DX will consume up to 7/8 of available memory if you do not limit it, so I would think you could at least load those files into the 1Gb. However, once you start performing operations, the memory use will shoot up rapidly in most cases. So 180Mb of files could easily exceed 1 Gb of memory depending on what you do to the data during the visualization. But follow David's suggestions also: this could be just a bogus series file due to syntax errors in your input confusing the Import parser. Chris Pelkie Vice President/Scientific Visualization Producer Conceptual Reality Presentations, Inc. 30 West Meadow Drive Ithaca, NY 14850 [EMAIL PROTECTED]
