Re: [Flightgear-devel] Terragear memory usage issue
Tom thanks for that terragear-cs81244fb0fe41dfc9d87b28baffdd5754b3801952 simgear 6250f675db9fdd6f2aef7be43207cd0ac0b6baeb Jason On Wed, 2011-11-02 at 07:12 -0700, Tom P wrote: > Hi Jason > > > You can open a terminal in the terragear-cs directory and type: > > > git show > > > The first lines show the commit ID, committer and short description > for the last commit, and the commit ID is the version information you > are looking for, > > > Hope this helps, > > > Tom > > > On Tue, Nov 1, 2011 at 2:43 PM, Jason Cox wrote: > Chris, > short of knowing how to tell versions of code with git all I > can say is > that I pulled the repo on the 20th of October for both > terragear-cs and > compiled it against the main simgear of the same day. > > If there is a way to ask git the version then let me know and > I will > report back for you. > > Jason > > PS I have uploaded some more scenery for NSW,Vic and Tas to my > dropbox > account for those interested > http://dl.dropbox.com/u/3028956/Aus-SE_Scenery.tar.bz2 > > > > > > > On Tue, 2011-11-01 at 08:03 +0100, Christian Schmitt wrote: > > Jason Cox wrote: > > > > > I would try a larger area, say 1x1 deg or larger and then > and then you > > > will see the list grow to include tiles that are no longer > needed. > > > > > > > I created a 2x3 degree area. No problems. What terragear-cs > version do you > > use and against which simgear do you compile it? > > > > Will now test even further and create another area. > > > > Chris > > > > > > -- > > RSA® Conference 2012 > > Save $700 by Nov 18 > > Register now > > http://p.sf.net/sfu/rsa-sfdev2dev1 > > ___ > > Flightgear-devel mailing list > > Flightgear-devel@lists.sourceforge.net > > > https://lists.sourceforge.net/lists/listinfo/flightgear-devel > > > > > > -- > RSA® Conference 2012 > Save $700 by Nov 18 > Register now! > > http://p.sf.net/sfu/rsa-sfdev2dev1 > ___ > Flightgear-devel mailing list > Flightgear-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/flightgear-devel > > > > -- > RSA® Conference 2012 > Save $700 by Nov 18 > Register now! > http://p.sf.net/sfu/rsa-sfdev2dev1 > ___ Flightgear-devel mailing list > Flightgear-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/flightgear-devel -- RSA(R) Conference 2012 Save $700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1 ___ Flightgear-devel mailing list Flightgear-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/flightgear-devel
Re: [Flightgear-devel] Terragear memory usage issue
Hi Jason You can open a terminal in the terragear-cs directory and type: git show The first lines show the commit ID, committer and short description for the last commit, and the commit ID is the version information you are looking for, Hope this helps, Tom On Tue, Nov 1, 2011 at 2:43 PM, Jason Cox wrote: > Chris, > short of knowing how to tell versions of code with git all I can say is > that I pulled the repo on the 20th of October for both terragear-cs and > compiled it against the main simgear of the same day. > > If there is a way to ask git the version then let me know and I will > report back for you. > > Jason > > PS I have uploaded some more scenery for NSW,Vic and Tas to my dropbox > account for those interested > http://dl.dropbox.com/u/3028956/Aus-SE_Scenery.tar.bz2 > > > > > > On Tue, 2011-11-01 at 08:03 +0100, Christian Schmitt wrote: > > Jason Cox wrote: > > > > > I would try a larger area, say 1x1 deg or larger and then and then you > > > will see the list grow to include tiles that are no longer needed. > > > > > > > I created a 2x3 degree area. No problems. What terragear-cs version do > you > > use and against which simgear do you compile it? > > > > Will now test even further and create another area. > > > > Chris > > > > > -- > > RSA® Conference 2012 > > Save $700 by Nov 18 > > Register now > > http://p.sf.net/sfu/rsa-sfdev2dev1 > > ___ > > Flightgear-devel mailing list > > Flightgear-devel@lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/flightgear-devel > > > > > -- > RSA® Conference 2012 > Save $700 by Nov 18 > Register now! > http://p.sf.net/sfu/rsa-sfdev2dev1 > ___ > Flightgear-devel mailing list > Flightgear-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/flightgear-devel > -- RSA® Conference 2012 Save $700 by Nov 18 Register now! http://p.sf.net/sfu/rsa-sfdev2dev1___ Flightgear-devel mailing list Flightgear-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/flightgear-devel
Re: [Flightgear-devel] Terragear memory usage issue
Chris, short of knowing how to tell versions of code with git all I can say is that I pulled the repo on the 20th of October for both terragear-cs and compiled it against the main simgear of the same day. If there is a way to ask git the version then let me know and I will report back for you. Jason PS I have uploaded some more scenery for NSW,Vic and Tas to my dropbox account for those interested http://dl.dropbox.com/u/3028956/Aus-SE_Scenery.tar.bz2 On Tue, 2011-11-01 at 08:03 +0100, Christian Schmitt wrote: > Jason Cox wrote: > > > I would try a larger area, say 1x1 deg or larger and then and then you > > will see the list grow to include tiles that are no longer needed. > > > > I created a 2x3 degree area. No problems. What terragear-cs version do you > use and against which simgear do you compile it? > > Will now test even further and create another area. > > Chris > > -- > RSA® Conference 2012 > Save $700 by Nov 18 > Register now > http://p.sf.net/sfu/rsa-sfdev2dev1 > ___ > Flightgear-devel mailing list > Flightgear-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/flightgear-devel -- RSA® Conference 2012 Save $700 by Nov 18 Register now! http://p.sf.net/sfu/rsa-sfdev2dev1 ___ Flightgear-devel mailing list Flightgear-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/flightgear-devel
Re: [Flightgear-devel] Terragear memory usage issue
Jason Cox wrote: > I would try a larger area, say 1x1 deg or larger and then and then you > will see the list grow to include tiles that are no longer needed. > I created a 2x3 degree area. No problems. What terragear-cs version do you use and against which simgear do you compile it? Will now test even further and create another area. Chris -- RSA® Conference 2012 Save $700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1 ___ Flightgear-devel mailing list Flightgear-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/flightgear-devel
Re: [Flightgear-devel] Terragear memory usage issue
Christian, what I am finding i that the larger the area being built the more of these files are being opened and not closed. I would try a larger area, say 1x1 deg or larger and then and then you will see the list grow to include tiles that are no longer needed. Jason On Mon, 2011-10-31 at 12:14 +0100, Christian Schmitt wrote: > Hi Jason, > > I just tried to reproduce this issue here. Generating some scenery around > LOWI with 850 airport layouts, I only see always two SRTM files open: the > arr.gz and fit.gz for the tile that is currently built. So no problems here. > What confuses me a bit is you using SRTM-2 files. What is this and how does > hgtchop handle these? > > Chris > > Jason Cox wrote: > > > Ok so I am replying to myself. > > > > after running fgfs-construct for the last 10+ hours at nice -20 and > > still going I have the following info. > > > > I ran lsof on the PID and have found that it is still holding all SRTM2 > > arr and fit files open. This is the probable cause of the memory leak > > that I am seeing. > > > > Can anyone point in the direction of where this should be unloaded and I > > will attempt to "hack" the code > > > > -- > Get your Android app more play: Bring it to the BlackBerry PlayBook > in minutes. BlackBerry App World™ now supports Android™ Apps > for the BlackBerry® PlayBook™. Discover just how easy and simple > it is! http://p.sf.net/sfu/android-dev2dev > ___ > Flightgear-devel mailing list > Flightgear-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/flightgear-devel -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Flightgear-devel mailing list Flightgear-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/flightgear-devel
Re: [Flightgear-devel] Terragear memory usage issue
Thats correct.these are the files created from SRTM data by hgtchop and terrafit Jason On Mon, 2011-10-31 at 11:30 +, Martin Spott wrote: > Christian Schmitt wrote: > > Jason Cox wrote: > > >> I ran lsof on the PID and have found that it is still holding all SRTM2 > >> arr and fit files open. This is the probable cause of the memory leak > >> that I am seeing. > > > What confuses me a bit is you using SRTM-2 files. What is this and how does > > hgtchop handle these? > > I think he's talking about the .arr.gz and .fit.gz files create from > SRTM2 - at least that's the only interpretation that makes sense to me. > > Cheers, > Martin. -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Flightgear-devel mailing list Flightgear-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/flightgear-devel
Re: [Flightgear-devel] Terragear memory usage issue
Christian Schmitt wrote: > Jason Cox wrote: >> I ran lsof on the PID and have found that it is still holding all SRTM2 >> arr and fit files open. This is the probable cause of the memory leak >> that I am seeing. > What confuses me a bit is you using SRTM-2 files. What is this and how does > hgtchop handle these? I think he's talking about the .arr.gz and .fit.gz files create from SRTM2 - at least that's the only interpretation that makes sense to me. Cheers, Martin. -- Unix _IS_ user friendly - it's just selective about who its friends are ! -- -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Flightgear-devel mailing list Flightgear-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/flightgear-devel
Re: [Flightgear-devel] Terragear memory usage issue
Hi Jason, I just tried to reproduce this issue here. Generating some scenery around LOWI with 850 airport layouts, I only see always two SRTM files open: the arr.gz and fit.gz for the tile that is currently built. So no problems here. What confuses me a bit is you using SRTM-2 files. What is this and how does hgtchop handle these? Chris Jason Cox wrote: > Ok so I am replying to myself. > > after running fgfs-construct for the last 10+ hours at nice -20 and > still going I have the following info. > > I ran lsof on the PID and have found that it is still holding all SRTM2 > arr and fit files open. This is the probable cause of the memory leak > that I am seeing. > > Can anyone point in the direction of where this should be unloaded and I > will attempt to "hack" the code > -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Flightgear-devel mailing list Flightgear-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/flightgear-devel
Re: [Flightgear-devel] Terragear memory usage issue
Ok so I am replying to myself. after running fgfs-construct for the last 10+ hours at nice -20 and still going I have the following info. I ran lsof on the PID and have found that it is still holding all SRTM2 arr and fit files open. This is the probable cause of the memory leak that I am seeing. Can anyone point in the direction of where this should be unloaded and I will attempt to "hack" the code lsof output fgfs-cons 30861 root cwd DIR 9,127 4096 89096552 /data/terragear/newSydScenery/work fgfs-cons 30861 root rtd DIR8,3 45056 2 / fgfs-cons 30861 root txt REG8,3 4094638 400355 /usr/local/bin/fgfs-construct fgfs-cons 30861 root mem REG8,3131363 1378117 /lib64/libpthread-2.12.2.so fgfs-cons 30861 root mem REG8,3 1440976 1378605 /lib64/libc-2.12.2.so fgfs-cons 30861 root mem REG8,3 92368 3013956 /lib64/libgcc_s.so.1 fgfs-cons 30861 root mem REG8,3522368 1378650 /lib64/libm-2.12.2.so fgfs-cons 30861 root mem REG8,3 1039824 1421451 /usr/lib64/gcc/x86_64-pc-linux-gnu/4.4.5/libstdc++.so.6.0.13 fgfs-cons 30861 root mem REG8,3 35656 1378683 /lib64/librt-2.12.2.so fgfs-cons 30861 root mem REG8,3 92536 1060302 /lib64/libz.so.1.2.5 fgfs-cons 30861 root mem REG8,3128464 1378684 /lib64/ld-2.12.2.so fgfs-cons 30861 root0u CHR 136,1 0t0 4 /dev/pts/1 fgfs-cons 30861 root1u CHR 136,1 0t0 4 /dev/pts/1 fgfs-cons 30861 root2u CHR 136,1 0t0 4 /dev/pts/1 fgfs-cons 30861 root3r REG 9,127 16776 90047457 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426690.arr.gz fgfs-cons 30861 root4r REG 9,127 337 90047491 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426690.fit.gz fgfs-cons 30861 root5r REG 9,127 16361 90047458 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426691.arr.gz fgfs-cons 30861 root6r REG 9,127 347 90047492 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426691.fit.gz fgfs-cons 30861 root7r REG 9,127 17375 90047461 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426698.arr.gz fgfs-cons 30861 root8r REG 9,127 344 90047495 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426698.fit.gz fgfs-cons 30861 root9r REG 9,127 16544 90047462 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426699.arr.gz fgfs-cons 30861 root 10r REG 9,127 342 90047496 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426699.fit.gz fgfs-cons 30861 root 11r REG 9,127 18892 90047465 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426706.arr.gz fgfs-cons 30861 root 12r REG 9,127 349 90047499 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426706.fit.gz fgfs-cons 30861 root 13r REG 9,127 17215 90047466 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426707.arr.gz fgfs-cons 30861 root 14r REG 9,127 352 90047500 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426707.fit.gz fgfs-cons 30861 root 15r REG 9,127 19956 90047469 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426714.arr.gz fgfs-cons 30861 root 16r REG 9,127 349 90047503 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426714.fit.gz fgfs-cons 30861 root 17r REG 9,127 19123 90047470 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426715.arr.gz fgfs-cons 30861 root 18r REG 9,127 346 90047504 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426715.fit.gz fgfs-cons 30861 root 19r REG 9,127 21395 90047475 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426723.arr.gz fgfs-cons 30861 root 20r REG 9,127 345 90047508 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426723.fit.gz fgfs-cons 30861 root 21r REG 9,127 22794 90047480 /data/terragear/newSydScenery/work/SRTM2-Australia-3/e150s40/e151s34/5426731.arr.gz fgfs-cons 30861 root 22r
Re: [Flightgear-devel] Terragear memory usage issue
Chris, As I am not a programmer, what info do you need and who do I collect it? Jason On Sat, 2011-10-29 at 13:47 +0200, Christian Schmitt wrote: > Jason Cox wrote: > > > is it not appropriate to issue a build of such a large area? > > should I use smaller chunks? > > should terragear not be releasing the memory after building a tile? > > Generally speaking, sometimes it works, sometimes it doesn't. And yes, it > should free unused memory after finishing a tile. This is also one of the > (many) issues. Patches or more info are always welcome. > > Chris > > -- > Get your Android app more play: Bring it to the BlackBerry PlayBook > in minutes. BlackBerry App World™ now supports Android™ Apps > for the BlackBerry® PlayBook™. Discover just how easy and simple > it is! http://p.sf.net/sfu/android-dev2dev > ___ > Flightgear-devel mailing list > Flightgear-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/flightgear-devel -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Flightgear-devel mailing list Flightgear-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/flightgear-devel
Re: [Flightgear-devel] Terragear memory usage issue
Jason Cox wrote: > is it not appropriate to issue a build of such a large area? > should I use smaller chunks? > should terragear not be releasing the memory after building a tile? Generally speaking, sometimes it works, sometimes it doesn't. And yes, it should free unused memory after finishing a tile. This is also one of the (many) issues. Patches or more info are always welcome. Chris -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Flightgear-devel mailing list Flightgear-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/flightgear-devel
Re: [Flightgear-devel] Terragear memory usage issue
Jason Cox wrote: > [...]--xdist=15 --ydist=35 [...] > is it not appropriate to issue a build of such a large area? Not really ;-) Cheers, Martin. -- Unix _IS_ user friendly - it's just selective about who its friends are ! -- -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Flightgear-devel mailing list Flightgear-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/flightgear-devel
[Flightgear-devel] Terragear memory usage issue
Hi all, I am currently build a large chunk of scenery for SE Australia and have found a problem with terragear's memory usage. most of the data I am building is low quality until I get to around S30 to S35 however I have only gotten to S36 using the following command ad the memory usage of terragear is out at 5.5G. This seams very excessive and at this rate will consume all physical and swap in my box long before completion. The command used is: fgfs-construct --work-dir=. --output-dir=Scenery/Terrain --lon=140 --lat=-20 --xdist=15 --ydist=35 AirportArea AirportObj SRTM2-Australia-3 Sand Freeways Trunk_Freeways Tertiary_Roads Service_Roads Secondary_Roads Primary_Roads Railroads Residential_Roads watercourcelines watercourceareas builtupareas mainlands lakes reservouirs is it not appropriate to issue a build of such a large area? should I use smaller chunks? should terragear not be releasing the memory after building a tile? Jason -- Get your Android app more play: Bring it to the BlackBerry PlayBook in minutes. BlackBerry App World™ now supports Android™ Apps for the BlackBerry® PlayBook™. Discover just how easy and simple it is! http://p.sf.net/sfu/android-dev2dev ___ Flightgear-devel mailing list Flightgear-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/flightgear-devel
