Re: [Opensim-dev] Multi-region OAR format
okay so if i wanted to make an OAR for Bad Wolf Island with a total of nine regions it would have row 1 (south) Southwest, South center , South East row 2 (center) West Center, Center, East Center row 3 (north) NorthWest , North Center, North east and if i wanted to have a 2X4 region then it would be row 1 (south) South West , South Center West, South Center East , South East row 2 (north) North West, North Center West, North Center East, North East and any region without data will create a hole in the sim if the server can be made to handle it i would suggest that a dummy manifest be used to create blank regions (modes would be fixed height, Blend or random) -- Robert L Martin ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
On Fri, Jul 20, 2012 at 4:15 PM, Robert L martin [via opensim-dev] ml-node+s2196679n7578165...@n2.nabble.com wrote: okay so if i wanted to make an OAR for Bad Wolf Island with a total of nine regions it would have row 1 (south) Southwest, South center , South East row 2 (center) West Center, Center, East Center row 3 (north) NorthWest , North Center, North east and if i wanted to have a 2X4 region then it would be row 1 (south) South West , South Center West, South Center East , South East row 2 (north) North West, North Center West, North Center East, North East and any region without data will create a hole in the sim That's right. if the server can be made to handle it i would suggest that a dummy manifest be used to create blank regions (modes would be fixed height, Blend or random) If I understand you correctly, you're asking for the load-oar command to create regions where none existed before. It doesn't do that currently, and I don't intend to make it start doing so. There are other ways to create regions (see Regions.ini), and I don't intend to add to them as that's a different feature. -- View this message in context: http://opensim-dev.2196679.n2.nabble.com/Multi-region-OAR-format-tp7578162p7578166.html Sent from the opensim-dev mailing list archive at Nabble.com.___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
I’m not sure I see the advantage of multiple regions in one oar file. Say I have a 3x3 set of regions saved in a backup oar file. I might want to restore one. That necessitates new command line parameters for selection, etc. To handle multiple regions, another approach is to push the grouping up a level and add commands for loading and creating multiple oar files with one command. That keeps the existing oar file format but solve the grouping feature. Or how about if the target of a ‘load oar’ is a directory, it loads all of the oar files therein? -- ra From: opensim-dev-boun...@lists.berlios.de [mailto:opensim-dev-boun...@lists.berlios.de] On Behalf Of Oren Hurvitz Sent: Friday, July 20, 2012 6:39 AM To: opensim-dev@lists.berlios.de Subject: Re: [Opensim-dev] Multi-region OAR format On Fri, Jul 20, 2012 at 4:15 PM, Robert L martin [via opensim-dev] [hidden email]/user/SendEmail.jtp?type=nodenode=7578166i=0 wrote: okay so if i wanted to make an OAR for Bad Wolf Island with a total of nine regions it would have row 1 (south) Southwest, South center , South East row 2 (center) West Center, Center, East Center row 3 (north) NorthWest , North Center, North east and if i wanted to have a 2X4 region then it would be row 1 (south) South West , South Center West, South Center East , South East row 2 (north) North West, North Center West, North Center East, North East and any region without data will create a hole in the sim That's right. if the server can be made to handle it i would suggest that a dummy manifest be used to create blank regions (modes would be fixed height, Blend or random) If I understand you correctly, you're asking for the load-oar command to create regions where none existed before. It doesn't do that currently, and I don't intend to make it start doing so. There are other ways to create regions (see Regions.ini), and I don't intend to add to them as that's a different feature. View this message in context: Re: Multi-region OAR formathttp://opensim-dev.2196679.n2.nabble.com/Multi-region-OAR-format-tp7578162p7578166.html Sent from the opensim-dev mailing list archivehttp://opensim-dev.2196679.n2.nabble.com/ at Nabble.com. ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
On Fri, Jul 20, 2012 at 9:38 AM, Oren Hurvitz or...@kitely.com wrote: If I understand you correctly, you're asking for the load-oar command to create regions where none existed before. It doesn't do that currently, and I don't intend to make it start doing so. There are other ways to create regions (see Regions.ini), and I don't intend to add to them as that's a different feature. Not create a region where there isn't one but create the CONTENTS (in this case just the Land part) of a region so for BWI if the Center sim does not have any assets you could put a dummy/keyword in that says Blend the land to its surroundings or Fill the land to 22 meters or create a random heightmap instead of needing to create a whole section just to rig this -- Robert L Martin ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
There are two big advantages. First, sometimes a group of regions comprises a logical, indivisible unit. E.g., RPG groups often create their world using many regions. Saving and loading their data in a single file is far more convenient than having to load each OAR separately. This is my motivation for this feature. The second advantage is that this way we don't have to duplicate the assets in each region, which would lead to massive waste in storage and load/save time. On Fri, Jul 20, 2012 at 6:11 PM, Adams, Robert [via opensim-dev] ml-node+s2196679n7578167...@n2.nabble.com wrote: I’m not sure I see the advantage of multiple regions in one oar file. Say I have a 3x3 set of regions saved in a backup oar file. I might want to restore one. That necessitates new command line parameters for selection, etc. ** ** To handle multiple regions, another approach is to push the grouping up a level and add commands for loading and creating multiple oar files with one command. That keeps the existing oar file format but solve the grouping feature. Or how about if the target of a ‘load oar’ is a directory, it loads all of the oar files therein? ** ** -- ra -- View this message in context: http://opensim-dev.2196679.n2.nabble.com/Multi-region-OAR-format-tp7578162p7578169.html Sent from the opensim-dev mailing list archive at Nabble.com.___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
I suppose some people will find this useful, but it's not something that is required for multi-region OARs so I won't implement it. Of course, you're welcome to add this feature yourself :) On Fri, Jul 20, 2012 at 6:40 PM, Robert L martin [via opensim-dev] ml-node+s2196679n7578168...@n2.nabble.com wrote: On Fri, Jul 20, 2012 at 9:38 AM, Oren Hurvitz [hidden email]http://user/SendEmail.jtp?type=nodenode=7578168i=0 wrote: If I understand you correctly, you're asking for the load-oar command to create regions where none existed before. It doesn't do that currently, and I don't intend to make it start doing so. There are other ways to create regions (see Regions.ini), and I don't intend to add to them as that's a different feature. Not create a region where there isn't one but create the CONTENTS (in this case just the Land part) of a region so for BWI if the Center sim does not have any assets you could put a dummy/keyword in that says Blend the land to its surroundings or Fill the land to 22 meters or create a random heightmap instead of needing to create a whole section just to rig this -- Robert L Martin ___ Opensim-dev mailing list [hidden email] http://user/SendEmail.jtp?type=nodenode=7578168i=1 https://lists.berlios.de/mailman/listinfo/opensim-dev -- View this message in context: http://opensim-dev.2196679.n2.nabble.com/Multi-region-OAR-format-tp7578162p7578170.html Sent from the opensim-dev mailing list archive at Nabble.com.___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
On Fri, Jul 20, 2012 at 11:41 AM, Oren Hurvitz or...@kitely.com wrote: There are two big advantages. First, sometimes a group of regions comprises a logical, indivisible unit. E.g., RPG groups often create their world using many regions. Saving and loading their data in a single file is far more convenient than having to load each OAR separately. This is my motivation for this feature. The second advantage is that this way we don't have to duplicate the assets in each region, which would lead to massive waste in storage and load/save time. i think that having a Mega Oar with 1 common assets OAR 2 the regional OARs 3 the control file would work best sionce that way if you wanted to restore just one region you can unpack the Mega OAR and work with the single regional OAR (and maybe the common assets OAR) -- Robert L Martin ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
That's an interesting idea. I'm wondering whether this would be slower, however, since OpenSim would have to untar all the data twice: once in the outer OAR, and again in the inner OARs. It might also take twice the RAM, depending on how the untar library works. -- View this message in context: http://opensim-dev.2196679.n2.nabble.com/Multi-region-OAR-format-tp7578162p7578172.html Sent from the opensim-dev mailing list archive at Nabble.com. ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
+1 on multi region oars. It simplifies global backup activities. :) On Fri, Jul 20, 2012 at 5:45 PM, Oren Hurvitz or...@kitely.com wrote: I suppose some people will find this useful, but it's not something that is required for multi-region OARs so I won't implement it. Of course, you're welcome to add this feature yourself :) On Fri, Jul 20, 2012 at 6:40 PM, Robert L martin [via opensim-dev] [hidden email] wrote: On Fri, Jul 20, 2012 at 9:38 AM, Oren Hurvitz [hidden email] wrote: If I understand you correctly, you're asking for the load-oar command to create regions where none existed before. It doesn't do that currently, and I don't intend to make it start doing so. There are other ways to create regions (see Regions.ini), and I don't intend to add to them as that's a different feature. Not create a region where there isn't one but create the CONTENTS (in this case just the Land part) of a region so for BWI if the Center sim does not have any assets you could put a dummy/keyword in that says Blend the land to its surroundings or Fill the land to 22 meters or create a random heightmap instead of needing to create a whole section just to rig this -- Robert L Martin ___ Opensim-dev mailing list [hidden email] https://lists.berlios.de/mailman/listinfo/opensim-dev View this message in context: Re: Multi-region OAR format Sent from the opensim-dev mailing list archive at Nabble.com. ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
Robert, I feel that load and save of multiple files simultaneously would be too fragile. And as Oren said, it ends up wasting a lot of space and some processing time for data that is held in common between regions (e.g. assets). I like this proposal, Oren. I should have put regions in separate directories originally but it's easy to say that in hindsight. One thing to watch out for is that OpenSimulator has an option to register multiple regions with the same name, though I suspect that's not a good idea in many contexts and I can't say for sure whether the option even works. So you may have to uniquify region folders with their UUID or similar. I would also prefer to see regions within a separate regions/ top level folder, e.g. regions/region1, regions/region2, etc. In the long term I would like to see all OARs to be saved with region directories, including single regions. However, in the interests of forward compatibility for existing OpenSimulator releases I think it is a good idea to save single regions in the existing structure, with the multi-region structure only being used with the --all flag. In a few releases time the new format can become the default and the old format only saved with an explicit flag. Or perhaps one could call the new structure .moar (I half kid). Something I might consider is whether the locations of other directories (e.g. assets) could be specified within the oar itself instead of with constants such as ArchiveConstants.ASSETS_PATH, though I don't know if that would help much in this case. Or try and think about ways to make oar/iar loading more liberal in what it accepts (following Postel's law). We used to have the same problem with XML loading where only one order of elements would be accepted but I think that has been pretty much eradicated. On 20/07/12 16:01, Adams, Robert wrote: I’m not sure I see the advantage of multiple regions in one oar file. Say I have a 3x3 set of regions saved in a backup oar file. I might want to restore one. That necessitates new command line parameters for selection, etc. To handle multiple regions, another approach is to push the grouping up a level and add commands for loading and creating multiple oar files with one command. That keeps the existing oar file format but solve the grouping feature. Or how about if the target of a ‘load oar’ is a directory, it loads all of the oar files therein? -- ra *From:*opensim-dev-boun...@lists.berlios.de [mailto:opensim-dev-boun...@lists.berlios.de] *On Behalf Of *Oren Hurvitz *Sent:* Friday, July 20, 2012 6:39 AM *To:* opensim-dev@lists.berlios.de *Subject:* Re: [Opensim-dev] Multi-region OAR format On Fri, Jul 20, 2012 at 4:15 PM, Robert L martin [via opensim-dev] [hidden email] /user/SendEmail.jtp?type=nodenode=7578166i=0 wrote: okay so if i wanted to make an OAR for Bad Wolf Island with a total of nine regions it would have row 1 (south) Southwest, South center , South East row 2 (center) West Center, Center, East Center row 3 (north) NorthWest , North Center, North east and if i wanted to have a 2X4 region then it would be row 1 (south) South West , South Center West, South Center East , South East row 2 (north) North West, North Center West, North Center East, North East and any region without data will create a hole in the sim That's right. if the server can be made to handle it i would suggest that a dummy manifest be used to create blank regions (modes would be fixed height, Blend or random) If I understand you correctly, you're asking for the load-oar command to create regions where none existed before. It doesn't do that currently, and I don't intend to make it start doing so. There are other ways to create regions (see Regions.ini), and I don't intend to add to them as that's a different feature. View this message in context: Re: Multi-region OAR format http://opensim-dev.2196679.n2.nabble.com/Multi-region-OAR-format-tp7578162p7578166.html Sent from the opensim-dev mailing list archive http://opensim-dev.2196679.n2.nabble.com/ at Nabble.com. ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev -- Justin Clark-Casey (justincc) http://justincc.org/blog http://twitter.com/justincc ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
On Fri, Jul 20, 2012 at 5:37 PM, Justin Clark-Casey jjusti...@googlemail.com wrote: Robert, I feel that load and save of multiple files simultaneously would be too fragile. And as Oren said, it ends up wasting a lot of space and some processing time for data that is held in common between regions (e.g. assets). not seeing what i was saying but it would also work if you had a folder tree in the OAR setup as Common Assets Regions and then inside the Region folder folders for each region (with any assets NOT common) then if you wanted to break out a single region you would just snag the regions folder and compress that part (maybe also needing to do the same to the Common Assets folder) -- Robert L Martin ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
I was addressing Robert Adams. Sorry, I should have made that clear. On 20/07/12 23:07, Robert Martin wrote: On Fri, Jul 20, 2012 at 5:37 PM, Justin Clark-Casey jjusti...@googlemail.com wrote: Robert, I feel that load and save of multiple files simultaneously would be too fragile. And as Oren said, it ends up wasting a lot of space and some processing time for data that is held in common between regions (e.g. assets). not seeing what i was saying but it would also work if you had a folder tree in the OAR setup as Common Assets Regions and then inside the Region folder folders for each region (with any assets NOT common) then if you wanted to break out a single region you would just snag the regions folder and compress that part (maybe also needing to do the same to the Common Assets folder) -- Justin Clark-Casey (justincc) http://justincc.org/blog http://twitter.com/justincc ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
Why not reuse the command line style for loading terrain? point to OAR, specify south-western corner ? ~ Marv. On 20/07/2012 16:01, Adams, Robert wrote: I'm not sure I see the advantage of multiple regions in one oar file. Say I have a 3x3 set of regions saved in a backup oar file. I might want to restore one. That necessitates new command line parameters for selection, etc. To handle multiple regions, another approach is to push the grouping up a level and add commands for loading and creating multiple oar files with one command. That keeps the existing oar file format but solve the grouping feature. Or how about if the target of a 'load oar' is a directory, it loads all of the oar files therein? -- ra *From:*opensim-dev-boun...@lists.berlios.de [mailto:opensim-dev-boun...@lists.berlios.de] *On Behalf Of *Oren Hurvitz *Sent:* Friday, July 20, 2012 6:39 AM *To:* opensim-dev@lists.berlios.de *Subject:* Re: [Opensim-dev] Multi-region OAR format On Fri, Jul 20, 2012 at 4:15 PM, Robert L martin [via opensim-dev] [hidden email] /user/SendEmail.jtp?type=nodenode=7578166i=0 wrote: okay so if i wanted to make an OAR for Bad Wolf Island with a total of nine regions it would have row 1 (south) Southwest, South center , South East row 2 (center) West Center, Center, East Center row 3 (north) NorthWest , North Center, North east and if i wanted to have a 2X4 region then it would be row 1 (south) South West , South Center West, South Center East , South East row 2 (north) North West, North Center West, North Center East, North East and any region without data will create a hole in the sim That's right. if the server can be made to handle it i would suggest that a dummy manifest be used to create blank regions (modes would be fixed height, Blend or random) If I understand you correctly, you're asking for the load-oar command to create regions where none existed before. It doesn't do that currently, and I don't intend to make it start doing so. There are other ways to create regions (see Regions.ini), and I don't intend to add to them as that's a different feature. View this message in context: Re: Multi-region OAR format http://opensim-dev.2196679.n2.nabble.com/Multi-region-OAR-format-tp7578162p7578166.html Sent from the opensim-dev mailing list archive http://opensim-dev.2196679.n2.nabble.com/ at Nabble.com. ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
[Opensim-dev] Multi-region OAR format
I want to extend the OAR format to support multiple regions. That's a significant change, so I'd like to get some feedback about the design before diving in. A multi-region OAR will store each region in its own subdirectory. Only the assets will remain in a top-level directory, to avoid storing multiple copies of the assets. I.e: my_oar/ assets/ - (all the assets) region1/ settings/ - region1.xml objects/ - (objects from region1) region2/ settings/ - region2.xml objects/ - (objects from region2) etc. The file archive.xml will get a table of contents that lists the included regions and their spatial relationship. Regions are listed first by row (South to North), and within each row regions are listed West-to-East: regions rowregionnameregion1/name/region regionnameregion2/name/region/row rowregionnameregion3/name/region regionnameregion4/name/region/row /regions The load-oar and save-oar commands will be extended as follows: save-oar - add a parameter called -all. If true then save all the regions in the simulator into a single OAR. If false or missing then save only the current region (as today). load-oar - when loading a multi-region OAR, load each region into the corresponding region in the simulator If the OAR contains only one region then we'll skip creating a subdirectory for the region, and won't include the regions element in archive.xml. This means all existing OARs will be compatible with the new format. Any thoughts? Oren -- View this message in context: http://opensim-dev.2196679.n2.nabble.com/Multi-region-OAR-format-tp7578162.html Sent from the opensim-dev mailing list archive at Nabble.com. ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
How does it know what order to restore them in? what if the oar is made on a none square shape? what if the regions are not next to each other? On Thu, Jul 19, 2012 at 10:01 PM, Oren Hurvitz or...@kitely.com wrote: I want to extend the OAR format to support multiple regions. That's a significant change, so I'd like to get some feedback about the design before diving in. A multi-region OAR will store each region in its own subdirectory. Only the assets will remain in a top-level directory, to avoid storing multiple copies of the assets. I.e: my_oar/ assets/ - (all the assets) region1/ settings/ - region1.xml objects/ - (objects from region1) region2/ settings/ - region2.xml objects/ - (objects from region2) etc. The file archive.xml will get a table of contents that lists the included regions and their spatial relationship. Regions are listed first by row (South to North), and within each row regions are listed West-to-East: regions rowregionnameregion1/name/region regionnameregion2/name/region/row rowregionnameregion3/name/region regionnameregion4/name/region/row /regions The load-oar and save-oar commands will be extended as follows: save-oar - add a parameter called -all. If true then save all the regions in the simulator into a single OAR. If false or missing then save only the current region (as today). load-oar - when loading a multi-region OAR, load each region into the corresponding region in the simulator If the OAR contains only one region then we'll skip creating a subdirectory for the region, and won't include the regions element in archive.xml. This means all existing OARs will be compatible with the new format. Any thoughts? Oren -- View this message in context: http://opensim-dev.2196679.n2.nabble.com/Multi-region-OAR-format-tp7578162.html Sent from the opensim-dev mailing list archive at Nabble.com. ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev -- Michael Emory Cerquoni - Nebadon Izumi @ http://osgrid.org ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev
Re: [Opensim-dev] Multi-region OAR format
The table of contents in archive.xml defines the spatial relationship of the regions. It can represent any rectangular shape. Holes are represented by an empty region/ element. -- View this message in context: http://opensim-dev.2196679.n2.nabble.com/Multi-region-OAR-format-tp7578162p7578164.html Sent from the opensim-dev mailing list archive at Nabble.com. ___ Opensim-dev mailing list Opensim-dev@lists.berlios.de https://lists.berlios.de/mailman/listinfo/opensim-dev