Re: [OSM-dev] helping #switch2osm

2012-01-12 Thread Roger Weeks
Hello

I'm the person Mikel was helping (thanks Mikel!) and I joined the list to
give my thoughts to this discussion. I think you have a couple of different
types of people you may want to think about here.

1. IT/devops

I fall into this category. The project I'm working on will require us to
have our own tile server that takes planet_osm, processes it and produces
updates to our client devices. Other people that fall into this category
will be anyone who wants to build their own GIS database from planet_osm,
for whatever reason. They'll also want to generate and serve tiles.

My major problem all through this process has been the vast amounts of
helpful and conflicting information. You'll note that the process I was
following to get a working PostGIS database populated with planet_osm, was
compiled by someone else and was not hosted at OSM. That process also is
flawed and needed a bunch of other things to make it work.

My suggestion for either a chef recipe, a juju charm, a puppet script, or
insert your configuration tool of choice here was meant to fix this
situation. If someone wants to set up a PostGIS OSM database, it should be
a repeatable process that is easy to do and scalable across multiple *nix
platforms. (I won't address Windows here as that's a whole other can of
worms).

Taking that idea a step further, if we were to provide a canned VM in KVM
or Xen formats that provides not just the host OS, but preconfigured
Postgres, PostGIS, an imported planet_osm, and then perhaps a choice of
mapnik, mod_tile, tilestache, or any of the other plethora of tile
generation and serving options, that would be an IDEAL way to summon
IT/devops folks who want to build their own map server infrastructure.

The last thing this needs is some really good documentation and
recommendations for WHAT to do. There are enough options out there
especially for tile generation and serving, that there needs to be a good
discussion of what you would want to use and why.

2. Maps developers and users

I'm not as familiar with the needs here but I think you are going to want
to do things like what MapBox is doing with Tilemill and what Cloudmade is
doing. The same comments I made above about recommendations of what you
want to use and why need to be easily accessible.

Happy to continue this discussion. I would be interested in participating
in development of both recipes and VMs.

Roger Weeks

On Jan 13, 2012 3:37 AM, Mikel Maron mikel_ma...@yahoo.com wrote:

  Hi
 
  Over the past couple days, I gave some assistance to someone setting up
 their own tile infrastructure. They mostly got along on their own,
 following http://weait.com/content/build-your-own-openstreetmap-server,
 and picking through the wiki, but they definitely could've had an easier
 time.
 
  And we should expect more of this soon, and we want this! Nestoria and
 StreetEasy switching, the Wired article. Just the beginning.

 Yes. The time when people are recognising the power of OSM is here. We
 should welcome everyone.

  How do we help folks get their tile servers up and running even easier.
 Here's some suggestions we discussed...
 
  1) Clear instructions, at an easily findable address (outside the wiki,
 which is hard to follow) (anyone register switch2osm.com? or tryosm.org).
 Should include some description of the different options, with links for
 getting into the details ... but at least a clear guide through the well
 worn path of setting up a tile server.
 
  2) A packaged solution, like a chef recipe, to install everything needed.
 
  3) A VM image for an open source virtualization package, that has
 everything installed. May not necessarily be for production, but at least
 make it easy to try things out.
 
  4) 
 
 Might be an overkilling idea, why not some quick screen casts? I guess
 videos will be more easier to grasp than guides.

  Would the EWG be the place to get this together?
 
  Cheers
  Mikel
 
 
  == Mikel Maron ==
  +14152835207 @mikel s:mikelmaron

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] helping #switch2osm

2012-01-16 Thread Roger Weeks
Mapnik not being in git is just one of the many issues with this doc. For
example, mapnik, if you get the current build from git, won't compile under
Ubuntu 10.04. You've got to go back and get an earlier 2.0 version or add a
PPA and get packages that other people have created.

The libboost versions of 1.40 don't work with 2.0 versions of mapnik
either. You need at least 1.41 but those packages aren't available for
10.04, so you need to add a PPA for 1.42 versions.

If you try and build this on a newer version of ubuntu you run across other
similar package and software version problems. Ubuntu 11.10 comes with
Postgres 9 and there are enough changes there that I was unable to get a
PostGIS server with Mapnik working.

All of this is why I suggested that a chef recipe, a juju charm, and a
pre-configured VM would all be ideal ways to prevent this sort of thing
from happening.

Roger

On Mon, Jan 16, 2012 at 4:38 AM, SomeoneElse li...@mail.atownsend.org.ukwrote:

 On 12/01/2012 22:10, Ian Dees wrote:

 During the book sprint last year I put together Richard's blog post and
 some stuff related to renderd/tirex to create this chapter in the book:

 http://en.flossmanuals.net/**openstreetmap/setting-up-your-**
 own-tile-server/http://en.flossmanuals.net/openstreetmap/setting-up-your-own-tile-server/

 It should be fairly complete and copy-pasteable. I'd be more than happy
 to make changes if anyone sees errors.


 One thing that I have noticed is that Mapnik source isn't in svn any more:

 mapniksvn: Repository moved permanently to 'https://github.com/mapnik/**
 mapnik https://github.com/mapnik/mapnik'; please relocate

 The problem is larger than just that one issue though - things get updated
 all the time, and there isn't (as far as I'm aware) a stable version of
 the required software in one place that works now and will stay working
 when Mapnik upgrades to version x+1 or someone updates mod_tile to support
 more environments.

 Cheers,
 Andy



 __**_
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.**org/listinfo/devhttp://lists.openstreetmap.org/listinfo/dev




-- 
Roger Weeks
Director of Engineering
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] helping #switch2osm

2012-01-16 Thread Roger Weeks
On Mon, Jan 16, 2012 at 12:03 PM, SomeoneElse li...@mail.atownsend.org.uk
wrote:


 If I was following some documentation that says to use a particular
 version of something (say, Mapnik 0.7.1) I wouldn't expect to be able to
 use some random newer version and expect to still be able to follow the
 instructions.  If the documentation was updated to say and here's where
 you get the version of Mapnik that these instructions were written for,
 and that was somewhere that wasn't at the mercy of a third-party project
 changing version control systems, then we'd be in the best of all possible
 worlds.


If I was following some instructions that pointed to a SVN repository that
was moved to git, and then did not contain any version prior to 2.0 of the
said software, I would also try the next available version since 0.71 isn't
available. What I had to do was finally find a PPA for Ubuntu 10.04 that
has the 0.72 branch of Mapnik, because I couldn't get any of the 2.0
versions to compile.


 ... and a pre-configured VM would all be ideal ways to prevent this sort
 of thing from happening.

 which would work, except that given the hardware needed to serve a map, a
 VM is probably not ideal for most people.


Who are most people? Are you really saying that most people will build
things on static hardware? Especially people who are trying out new
software to see if it works for them? I heartily disagree, and I think an
OVF of a preconfigured map server that already HAS the planet_osm file
imported into postgis would be not only extremely useful but would get you
a lot more people taking the mapserver for a spin.

It also doesn't explain how to get OSM running on a server that's already
 installed doing something else.  There are off-the-shelf black-box
 solutions out there already, but they don't explain the integration process
 any - which is exactly whathttp://en.flossmanuals.net/**
 openstreetmap/setting-up-your-**own-tile-server/http://en.flossmanuals.net/openstreetmap/setting-up-your-own-tile-server/
  and
 before it 
 http://weait.com/content/**build-your-own-openstreetmap-**serverhttp://weait.com/content/build-your-own-openstreetmap-server
  do
 extremely well.


I hate to disagree, but I don't think they do this extremely well. I think
the documentation is feasible but has flaws and every time something
changes in the build infrastructure, this will happen again. Today, if you
follow these instructions, you can't actually build a map server based on
them.

On the other hand, if you provided a modified version of these pretty good
instructions, along with a chef recipe / juju charm that builds it for you;
or if you provided the instructions and a VM that lets you take them and
start up a map server with less effort and hacking than is now required,
you would be in a much better place.

Roger Weeks
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] helping #switch2osm

2012-01-18 Thread Roger Weeks
Michal Migurski has build this tool, which is pretty close to what I was
tallking about:

http://linode.teczno.com/~migurski/tiledrawer/

It builds a map server for you on an EC2 instance or other machine running
Ubuntu 11.10. I'm trying it out now, will give more specifics once it's
done and ready to use.

Roger Weeks

On Wed, Jan 18, 2012 at 11:45 AM, Parveen Arora m...@parveenarora.inwrote:

 On Fri, Jan 13, 2012 at 8:15 PM, Kai Krueger kakrue...@gmail.com wrote:
  We should try and get more of the rendering tool stack into the standard
  repositories of Ubuntu and Feodora. That would probably make it easier
  to install a tile server. There are already a bunch of osm programs in
  the ubuntu repositories (e.g. josm and osm2pgsql, although the later is
  rather old), but programs like mod_tile, renderd and tirex are still
  missing.
 
  I wanted to see if I can do that, but then didn't get around to it. So
  if anyone else wants to try this it would be great. However, to get it
  into the next long term release 12.04, one would probably need to do
  this very soon.
 Hi Kai,

 I am interested to o this task to include it in the Ubuntu repositary,
 moreover we can also provide a add on feature of customised map tiles
 according to the choice of the users rather than the default tiles.

 Please let me know what should I need to do and what should I need to know?

 Thank You.


 --
 Parveen Arora
 www.parveenarora.in
 E-Mail: m...@parveenarora.in

 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] helping #switch2osm

2012-01-21 Thread Roger Weeks
On Wed, Jan 18, 2012 at 8:15 PM, Sajjad Anwar sajja...@gmail.com wrote:


 On Thu, Jan 19, 2012 at 1:23 AM, Roger Weeks ro...@tethr.org wrote:

 Michal Migurski has build this tool, which is pretty close to what I was
 tallking about:

 http://linode.teczno.com/~migurski/tiledrawer/

 It builds a map server for you on an EC2 instance or other machine
 running Ubuntu 11.10. I'm trying it out now, will give more specifics once
 it's done and ready to use.


 This looks promising. I'll also give it a shot. TileStache is another
 awesome project by Michal Migurski http://tilestache.org/, which is an
 easy to use, Python based tile server.


Just a note: his tiledrawer project does use TileStache to serve the tiles
once they are generated.

Roger



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev