Re: [OSM-dev] Using changesets-latest.osm

2012-01-30 Thread Josh Doe
On Sat, Jan 28, 2012 at 5:01 PM, Toby Murray toby.mur...@gmail.com wrote:
 I present ChangesetMD:

 https://github.com/ToeBee/ChangesetMD

What kind of stats are you (and others) thinking about generating? I'm
interested in seeing editor stats such as a time series of editor
usage, which editors people use (predominantly one or a mix, progress
from using one to another, etc.), the frequency and quality of
comments by editor, what tags people use besides the standard
comment/source/etc.
-Josh

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Using changesets-latest.osm

2012-01-30 Thread Toby Murray
On Mon, Jan 30, 2012 at 9:47 AM, Josh Doe j...@joshdoe.com wrote:
 On Sat, Jan 28, 2012 at 5:01 PM, Toby Murray toby.mur...@gmail.com wrote:
 I present ChangesetMD:

 https://github.com/ToeBee/ChangesetMD

 What kind of stats are you (and others) thinking about generating? I'm
 interested in seeing editor stats such as a time series of editor
 usage, which editors people use (predominantly one or a mix, progress
 from using one to another, etc.), the frequency and quality of
 comments by editor, what tags people use besides the standard
 comment/source/etc.
 -Josh

My initial use of this data was to get a specific list of changesets
for dealing with the license change. But I certainly had in mind that
it would be useful for some interesting analysis like what you have in
mind.

Off the top, I can say there are just over 700 unique key values used
in tagging changesets. Some of them are obvious errors, some of them
are actually interesting. There are 630,000 changesets with no changes
in them. Didn't P1 create a changeset as soon as it was fired up, even
if no changes were made? There are 239 changesets with 50,0001
objects. Off-by-one error in the API? :)

And that's just the first few things that came to mind. I haven't had
much time to get into the data yet. Heck, I'm still working on
processing my survey data from Christmas :/

Toby

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Using changesets-latest.osm

2012-01-29 Thread Richard Weait
On Sat, Jan 28, 2012 at 5:01 PM, Toby Murray toby.mur...@gmail.com wrote:
 I present ChangesetMD:

 https://github.com/ToeBee/ChangesetMD

Dear Toby,

Thank you for this.  It's shaved days off the setup time for the user
stats I've been playing with.

Best regards,
Richard

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Using changesets-latest.osm

2012-01-28 Thread Toby Murray
I present ChangesetMD:

https://github.com/ToeBee/ChangesetMD

As noted in the readme, this is my first real python so I can't
guarantee it won't try to erase your hard drive although this seems
kind  of unlikely :)

Right now I have indexes on tag key/values and user name. Depending on
what you are querying on, others might be called for. I'll see what
happens when I start playing with the data.

Toby

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Using changesets-latest.osm

2012-01-25 Thread Brett Henderson
On 22 January 2012 11:08, Toby Murray toby.mur...@gmail.com wrote:


 Yes, I am aware of this. I want to query the metadata. Comment tags,
 bboxes, users and such. I don't really care if it is in the apidb
 schema or not. My first thought was that this would just work with
 osmosis but that obviously isn't the case. I was just wondering if
 someone else already has something. It sounds like the answer is no.
 Which kind of makes me wonder why the changeset dump even exists if
 there are no standard tools to use it. But whatever. It's not like
 parsing XML is hard. I can write something to do what I need pretty
 quickly.


Osmosis doesn't support XML changeset records in OSM files.  It supports
the changeset id attribute on entities and will create dummy changeset
records in the database to satisfy referential integrity, but all the
metadata associated with a changeset is ignored.  If you process a file
with only changeset records then no processing will occur.

Brett
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Using changesets-latest.osm

2012-01-21 Thread Frederik Ramm

Hi,

On 01/21/2012 11:34 PM, Toby Murray wrote:

So is there some other utility that has already been written to parse
the changeset dump and push it into a database of some kind?


Pardon the question but you *are* aware that changesets-latest.osm.bz2 
does only contain changeset metadata, not the actual information on 
*which* objects have been changed in each changeset? Therefore, while 
importing that into an apidb schema is perhaps not completely useless, 
it is of limited use.


Bye
Frederik

--
Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09 E008°23'33

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Using changesets-latest.osm

2012-01-21 Thread Toby Murray
On Sat, Jan 21, 2012 at 5:17 PM, Frederik Ramm frede...@remote.org wrote:
 Hi,


 On 01/21/2012 11:34 PM, Toby Murray wrote:

 So is there some other utility that has already been written to parse
 the changeset dump and push it into a database of some kind?


 Pardon the question but you *are* aware that changesets-latest.osm.bz2 does
 only contain changeset metadata, not the actual information on *which*
 objects have been changed in each changeset? Therefore, while importing that
 into an apidb schema is perhaps not completely useless, it is of limited
 use.

Yes, I am aware of this. I want to query the metadata. Comment tags,
bboxes, users and such. I don't really care if it is in the apidb
schema or not. My first thought was that this would just work with
osmosis but that obviously isn't the case. I was just wondering if
someone else already has something. It sounds like the answer is no.
Which kind of makes me wonder why the changeset dump even exists if
there are no standard tools to use it. But whatever. It's not like
parsing XML is hard. I can write something to do what I need pretty
quickly.

Toby

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev