Hi Don, I'm happy to see some movement on the hardware for OpenAerialMap, but I'm questioning the requirements listed here so far. Perhaps I'm late to the discussion, but what makes ZFS an essential piece to meet performance needs? What are the anticipated performance needs and who came up with them? It seems a little early to hinge lots of technical decisions on a file system that we might not even need yet.
After thinking about and attempting to implement some piece of OAM on my own, I talked to many different people that each had their own idea of what OAM should be. For me, OAM is a tiling image server that hosts a public and free (as in beer and speech) set of aerial imagery from around the world. When I started to implement it, I started small with my corner of the United States: pulling in imagery via WMS from USGS and my state and local governments. That being said, I've heard other people express interest in support for rectifying images taken from blimps or kites. I'd love to hear what NPS's needs and wants for OAM are. -Ian On Mon, Sep 13, 2010 at 3:00 PM, Don Brutzman <brutz...@nps.edu> wrote: > Summary: here is how we hope to stand up an initial OAM server at NPS. > > Background: > - NPS has purchased dedicated new server hardware for an OAM restart. > specs: 22TB disk storage, 10 GB memory, 2 CPU at 2GHz > - NPS also has high-bandwidth public access to serve it from > - we hope to give make application-admin access to select members > of the OAM community, as needed, to help us configure and > administer the server > - mailing list discussions indicated that ZFS file system is essential > to reach goal performance levels > - OpenSolaris is the operating system that supports ZFS > - NPS must get all of our servers certified via security requirements > published by U.S. Defense Information Systems Agency (DISA) > - We have passed through the certification process for Linux CentOS > but not OpenSolaris. getting certified is a bit time-consuming. > > Don McGregor reports: > ==================== > OpenSolaris is no longer being supported by Oracle, the successor to Sun. > Since much of the > work on OpenSolaris was being performed by paid Sun employees, this makes > the long and > medium term viability of OpenSolaris questionable. > > ZFS is one of a class of high performance filesystems that is apparently > needed for Open > Aerial Map due to the large number of files involved; conventional > filesystems such > as ext3 fall down. There are two filesystems that can likely hold the full > release > of all files: ZFS and BTRFS. > > ZFS's license is engineered to be Linux-hostile, but a port operation is > underway that > allows ZFS to be run as an aftermarket add-on. The open release is probably > a few > months away. BTRFS is still in pre-release is is likely to be more than a > year out. > ==================== > > Development summary: > - OpenSolaris is not being supported by Oracle > - Another beta ZFS is being built for Linux by KnowledgeQuest (details > above) > but it is not clear how long it will take before that is stable > - We would really like to get this box online and get started > - A path to full backup from this server to NPS mass storage archive > is being worked out and should be available in a few weeks > > Recommendations: > - convert existing box to Linux CentOS with regular file system > - complete security checklist and get certified for public access > - put server online, install GeoServer etc. version 1.7 or 2.0? > - start working on OAM > - backup image files and switch to ZFS someday when it becomes > available on Linux > > Comments/questions welcome. > > all the best, Don > -- > Don Brutzman Naval Postgraduate School, Code USW/Br brutz...@nps.edu > Watkins 270 MOVES Institute, Monterey CA 93943-5000 USA +1.831.656.2149 > X3D, virtual worlds, underwater robots http://faculty.nps.edu/brutzman > > > _______________________________________________ > talk mailing list > t...@host134.hostmonster.com > http://host134.hostmonster.com/mailman/listinfo/talk_openaerialmap.org >
_______________________________________________ talk mailing list t...@host134.hostmonster.com http://host134.hostmonster.com/mailman/listinfo/talk_openaerialmap.org
