Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-03-28 Thread Peter Körner
 I'm currently setting up such a service, may be already working tonight.

 I just wanted to give this a try. Is this already working? What do I use
 for diffserver?

I announced it in a different Post. Take a look here:
http://lists.openstreetmap.org/pipermail/dev/2010-March/019106.html

Peter

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-03-26 Thread Andreas Höschler
Hi Peter,

 The heavies task is 1. Maybe we could set up a database for this 
 task..
 Peter

 I rather liked Brett's earlier suggestion to have this solved on the 
 diff
 server itself.

 So you could wget http://diffserver/state/minute/20100301_00;, 
 and
 the web service would find the right state file and return it to you.

 I'm currently setting up such a service, may be already working 
 tonight.

I just wanted to give this a try. Is this already working? What do I 
use for diffserver?

Thanks,

  Andreas


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-03-24 Thread Andreas Höschler
Hi all,
 I just noticed, that the minute diffs are not here anymore.
 My tool http://datenkueche.com/osmlive did use this files.

 Is there a possibility to find a file if I have only the time?

 For the old system I used:

 $delta=(int) $_GET['delta'];
 $time1=time()-7200-360 -$delta;
 $time2=time()-7200-300 -$delta;
 $time3=time()-7200-420 -$delta;
 $timestring1=date(YmdHi,$time1);
 $timestring2=date(YmdHi,$time2);
 $timestring3=date(YmdHi,$time3);


 $filename= $timestring1.-.$timestring2..osc.gz;
 --

 Any idea how to do that with the new system?

I would be interested inthat as well, ideally a file that is generated 
every hour with a fixed named scheme we can easily track for. Can this 
be reactivated? Why has it been disabled after all?

Thanks,

  Andreas


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-03-24 Thread Lennard

 The heavies task is 1. Maybe we could set up a database for this task..
 Peter

I rather liked Brett's earlier suggestion to have this solved on the diff
server itself.

So you could wget http://diffserver/state/minute/20100301_00;, and
the web service would find the right state file and return it to you.

-- 
Lennard


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-03-24 Thread Peter Körner
Lennard schrieb:
 The heavies task is 1. Maybe we could set up a database for this task..
 Peter
 
 I rather liked Brett's earlier suggestion to have this solved on the diff
 server itself.
 
 So you could wget http://diffserver/state/minute/20100301_00;, and
 the web service would find the right state file and return it to you.
 
I'm currently setting up such a service, may be already working tonight.

Peter

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-03-24 Thread Bernhard zwischenbrugger
hi

 I would be interested in that as well, ideally a file that is 
 generated every hour with a fixed named scheme we can easily track 
 for. Can this be reactivated? Why has it been disabled after all?
I would like to have that live.

At:
https://world.waze.com/livemap/
they have a live ticker.
All the edits are shown there.

If all the changesets would go to an xmpp stream, it would be a really 
easy to such a liveticker for osm.


xmpp is easy and all could be done be sending to a tcp socket:
message to =osmchanges...@xmppserver.somewhere.org type=groupchat
changeset/changeset
/message

Bernhard


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-03-24 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

Op 24-03-10 13:02, Bernhard zwischenbrugger schreef:
 If all the changesets would go to an xmpp stream, it would be a really 
 easy to such a liveticker for osm.

There was a site in the past where this was visible. I have created an
OpenLayers implementation to visualize it. So even with what is publish
now, not a line of XMPP is required to do so.


Stefan
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.14 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEAREKAAYFAkuqAYQACgkQYH1+F2Rqwn31OQCeMl+vRX+TtiqnwFetJM1HBAAd
NKgAn1q2EkiwsgL4pvxug1PSEs3O8VRN
=ozh+
-END PGP SIGNATURE-

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-03-24 Thread Bernhard zwischenbrugger
hi
 If all the changesets would go to an xmpp stream, it would be a really 
 easy to such a liveticker for osm.
 

 There was a site in the past where this was visible. I have created an
 OpenLayers implementation to visualize it. So even with what is publish
 now, not a line of XMPP is required to do so.
I did the osmlive based on minutely Changesets.
The best result was about 5 minutes delay.
On a webbrowser the xmpp lib strophe offers a nice BOSH connection and
no polling is needed.
http://code.stanziq.com/strophe/

A 5 second delay could be done without problem.
5 seconds is faster than 5 minutes.

Maybe you think 5 minutes are no problem.
But think about an interface where you see live what other
people are doing. The next step could be to implement a
fast human to human communication.
If you see somebody editing something in a strange way, you could give
help on how to do it better.

Bernhard


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-03-24 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

Op 24-03-10 13:46, Bernhard zwischenbrugger schreef:
 Maybe you think 5 minutes are no problem.

I based it on the minutely stuff.

And as I have pointed out to some other people already. This 'yet
another glue layer in database replication' still doesn't explore the
fact that there are existing (normal) master/slave replication scenarios
that clearly are not exploited yet. (Wheel is already invented, its around.)


Stefan
-BEGIN PGP SIGNATURE-
Version: GnuPG v2.0.14 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEAREKAAYFAkuqDJEACgkQYH1+F2Rqwn0vWwCfc60UWTuJpeIPdVyp8o0W2/VL
6PQAn2kNxhvP6xEFYxjNBMwZWgq1H3Rx
=nIHt
-END PGP SIGNATURE-

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-03-24 Thread Kai Krueger
On 01/-10/-28163 08:59 PM, Bernhard zwischenbrugger wrote:
 hi
 If all the changesets would go to an xmpp stream, it would be a
 really easy to such a liveticker for osm.

 There was a site in the past where this was visible. I have created an
 OpenLayers implementation to visualize it. So even with what is publish
 now, not a line of XMPP is required to do so.
 I did the osmlive based on minutely Changesets.
 The best result was about 5 minutes delay.
 On a webbrowser the xmpp lib strophe offers a nice BOSH connection and
 no polling is needed.
 http://code.stanziq.com/strophe/

 A 5 second delay could be done without problem.
 5 seconds is faster than 5 minutes.

 Maybe you think 5 minutes are no problem.
 But think about an interface where you see live what other
 people are doing. The next step could be to implement a
 fast human to human communication.
 If you see somebody editing something in a strange way, you could give
 help on how to do it better.

With LiveEditMapViewerJ[1,2], which was heavily modeled after osmlive, 
can sort of do that. You can zoom into edits (currently only node 
changes) that look odd, shift click on one of the nodes to get to the 
OSM-Browse-page for that node, with the details of the changeset and 
editor and contact the user through the osm messaging system.

So far, I have thought the replicate diffs work really well for that and 
are probably even simpler than the old minutely diffs. You simply get 
the state.txt, which contains the most recent sequence number, and then 
you just count up by one every time you successfully retrieve the 
corresponding diff file.

With the replicate diffs, the delay is now down to normally at max a 
minute and on average probably more like 30 seconds delay. It wouldn't 
be hard to move the replicate diffs to be generated every 30 seconds, so 
on average delays of only 15 seconds.

Can you give examples for when that would not be enough? Given that the 
standard map call from the api often takes more than 30 seconds to 
complete, you will partly not get any more up to date data from the live 
API either.

Kai


 Bernhard




[1] http://gpsmid.sourceforge.net/misc/LiveEditMapViewerJ.jar
[2] 
http://trac.openstreetmap.org/browser/applications/utils/LiveEditMapViewer

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-03-23 Thread Bernhard zwischenbrugger
hi

I just noticed, that the minute diffs are not here anymore.
My tool http://datenkueche.com/osmlive did use this files.

Is there a possibility to find a file if I have only the time?

For the old system I used:

$delta=(int) $_GET['delta'];
$time1=time()-7200-360 -$delta;
$time2=time()-7200-300 -$delta;
$time3=time()-7200-420 -$delta;
$timestring1=date(YmdHi,$time1);
$timestring2=date(YmdHi,$time2);
$timestring3=date(YmdHi,$time3);


$filename= $timestring1.-.$timestring2..osc.gz;
--

Any idea how to do that with the new system?

Bernhard



 Are there any objections to me disabling the old minute and hourly
 changesets and deleting their files from the planet server?
 http://planet.openstreetmap.org/minute/
 http://planet.openstreetmap.org/minute-slow/
 http://planet.openstreetmap.org/hourly/

 They are replaced by the (hopefully) reliable transaction based
 replication changesets.
 http://planet.openstreetmap.org/minute-replicate/
 http://planet.openstreetmap.org/hour-replicate/

 I haven't heard any complaints about the replication changesets so
 I'm assuming they're working well.



 I'll leave the daily changesets running for now because they are
 running with a much longer delay and shouldn't miss data.


 I'm not aware of anybody still using the minute diffs.  I'll disable 
 them early in the new year.  I won't delete the files straight away so 
 they can be re-enabled if somebody suddenly screams.

 I hope to disable the hour diffs around the same time but will wait 
 until Florian has moved off them first.

 Brett

 

 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev
   


___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-30 Thread Brett Henderson
On Sat, Jan 30, 2010 at 5:12 PM, John Smith deltafoxtrot...@gmail.comwrote:

 On 30 January 2010 15:03, Brett Henderson br...@bretth.com wrote:
  Yes, the error on that site seems to indicate an error with the minute
  changesets.  The minute changesets were disabled over three weeks ago.
  But
  they were using a broken mechanism so I don't want to re-enable them.

 And this proved my point, nothing would have shown up as an error
 until you removed them :)


Um, I'm not sure I understand your point.  I followed your advice 3 weeks
ago and renamed the directories to force breakages straight away.  I haven't
touched anything recently, the renamed directories still exist as I left
them 3 weeks ago.  I heard nothing in the days following that change, and
only now has this new error popped up.

Brett
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-30 Thread John Smith
On 30 January 2010 21:54, Brett Henderson br...@bretth.com wrote:
 Um, I'm not sure I understand your point.  I followed your advice 3 weeks
 ago and renamed the directories to force breakages straight away.  I haven't
 touched anything recently, the renamed directories still exist as I left
 them 3 weeks ago.  I heard nothing in the days following that change, and
 only now has this new error popped up.

I'm surprised stuff didn't come up sooner too, but yea, unless you
broke stuff which you did, unless people found out they wouldn't have
noticed most likely...

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-30 Thread Jeremy Adams

 I'm surprised stuff didn't come up sooner too, but yea, unless you
 broke stuff which you did, unless people found out they wouldn't have
 noticed most likely...


If the maintainer of that site didn't switch over to the replicate diffs in
the last months and hasn't fixed the site in the last month that it's been
non-functional, then it's hardly Brett's fault.  The old diffs were broken,
it was wise to force people to the new method.  It's not like they weren't
given plenty of time to make the switch.

I'd be interested in fixing the code for that site if anyone knows where the
source can be obtained.  I have server space to host it as well.

-Jeremy
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-29 Thread Stefano Salvador
   
 Are there any objections to me disabling the old minute and hourly
 changesets and deleting their files from the planet server?

I think that this broke OSM-Live web site:

http://datenkueche.com/osmlive/




Bye,

Stefano

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-29 Thread Jeremy Adams
On Fri, Jan 29, 2010 at 2:21 PM, Stefano Salvador 
stefano.salva...@gmail.com wrote:


  Are there any objections to me disabling the old minute and hourly
  changesets and deleting their files from the planet server?

 I think that this broke OSM-Live web site:

 http://datenkueche.com/osmlive/


That looks like a cool site.  Is the code to generate the map available
anywhere?

-Jeremy
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-29 Thread Brett Henderson
On Sat, Jan 30, 2010 at 6:21 AM, Stefano Salvador 
stefano.salva...@gmail.com wrote:


  Are there any objections to me disabling the old minute and hourly
  changesets and deleting their files from the planet server?

 I think that this broke OSM-Live web site:

 http://datenkueche.com/osmlive/


Yes, the error on that site seems to indicate an error with the minute
changesets.  The minute changesets were disabled over three weeks ago.  But
they were using a broken mechanism so I don't want to re-enable them.

Can the OSM-Live site switch over to the minute-replicate changes instead?

Brett
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-29 Thread John Smith
On 30 January 2010 15:03, Brett Henderson br...@bretth.com wrote:
 Yes, the error on that site seems to indicate an error with the minute
 changesets.  The minute changesets were disabled over three weeks ago.  But
 they were using a broken mechanism so I don't want to re-enable them.

And this proved my point, nothing would have shown up as an error
until you removed them :)

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-07 Thread Florian Lohoff
On Thu, Jan 07, 2010 at 12:03:27PM +1100, Brett Henderson wrote:
 I haven't heard anything but I've disabled the hourly diffs as well.  They
 can be re-enabled if necessary.

Thanks - i hadnt switched yet - trying now.

 As per the minute and minute-slow diffs, I'll delete these if nobody yells.
 I'll give it at least a few days though.

How do i init the --rri task (--rrii) to a specific date/time? 

I am set off at 7th of Jan 0:00 and i'd like to continue with --rri from
there.

Flo
-- 
Florian Lohoff f...@zz.de
Es ist ein grobes Missverständnis und eine Fehlwahrnehmung, dem Staat
im Internet Zensur- und Überwachungsabsichten zu unterstellen.
- - Bundesminister Dr. Wolfgang Schäuble -- 10. Juli in Berlin 


signature.asc
Description: Digital signature
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-07 Thread Jeremy Adams

 How do i init the --rri task (--rrii) to a specific date/time?

 I am set off at 7th of Jan 0:00 and i'd like to continue with --rri from
 there.

 Flo


Run ./osmosis --rrii workingDirectory=/work  with a suitable directory.
Osmosis will create some files in that directory.  Open the configuration
file and set the url to http://planet.openstreetmap.org/minute-replicate.
Set interval to whatever makes sense for your application.

Next, find the state.txt file on planet.openstreetmap.org that corresponds
to the time you'd like to start at.  Download that state.txt file and save
it to the osmosis working directory.  For instance, the state.txt file for
Jan 7 at 00:00 is 167266.

Run osmosis with --rri option to start downloading data.

-Jeremy
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-06 Thread Brett Henderson
On Wed, Jan 6, 2010 at 12:40 PM, Brett Henderson br...@bretth.com wrote:

 On Mon, Dec 21, 2009 at 3:05 PM, Brett Henderson br...@bretth.com wrote:

 On Sat, Dec 19, 2009 at 3:06 PM, Brett Henderson br...@bretth.comwrote:

 Are there any objections to me disabling the old minute and hourly
 changesets and deleting their files from the planet server?
 http://planet.openstreetmap.org/minute/
 http://planet.openstreetmap.org/minute-slow/
 http://planet.openstreetmap.org/hourly/

 They are replaced by the (hopefully) reliable transaction based
 replication changesets.
 http://planet.openstreetmap.org/minute-replicate/
 http://planet.openstreetmap.org/hour-replicate/

 I haven't heard any complaints about the replication changesets so I'm
 assuming they're working well.

 I'll leave the daily changesets running for now because they are running
 with a much longer delay and shouldn't miss data.


 I'm not aware of anybody still using the minute diffs.  I'll disable them
 early in the new year.  I won't delete the files straight away so they can
 be re-enabled if somebody suddenly screams.

 I hope to disable the hour diffs around the same time but will wait until
 Florian has moved off them first.


 The minute and minute-slow diffs are now disabled.

 I'll delete the following directories in a couple of days if nobody yells.

 http://planet.openstreetmap.org/minute/
 http://planet.openstreetmap.org/minute-slow/

 I'm keen to delete the hourly diffs as well.  *Florian*, have you had a
 chance to move off these yet?

 http://planet.openstreetmap.org/hourly/


I haven't heard anything but I've disabled the hourly diffs as well.  They
can be re-enabled if necessary.

As per the minute and minute-slow diffs, I'll delete these if nobody yells.
I'll give it at least a few days though.

Brett
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-06 Thread John Smith
2010/1/7 Brett Henderson br...@bretth.com:
 As per the minute and minute-slow diffs, I'll delete these if nobody yells.
 I'll give it at least a few days though.

Not that it's going to be a problem for me, but I don't anyone will
yell till the parent directories are deleted and people realise things
have changed and they need to update their systems. At present just
disabling new files from being generated isn't going to break
anything, it will just stop updates, but that probably won't spit out
errors.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-06 Thread Brett Henderson
Yep, fair enough.  How about I rename them so that things break ...

On Thu, Jan 7, 2010 at 12:21 PM, John Smith deltafoxtrot...@gmail.comwrote:

 2010/1/7 Brett Henderson br...@bretth.com:
  As per the minute and minute-slow diffs, I'll delete these if nobody
 yells.
  I'll give it at least a few days though.

 Not that it's going to be a problem for me, but I don't anyone will
 yell till the parent directories are deleted and people realise things
 have changed and they need to update their systems. At present just
 disabling new files from being generated isn't going to break
 anything, it will just stop updates, but that probably won't spit out
 errors.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-06 Thread John Smith
2010/1/7 Brett Henderson br...@bretth.com:
 Yep, fair enough.  How about I rename them so that things break ...

I doubt it matters either way, since people will need to alter their
systems sooner rather than later, all I'm saying is there is no point
just turning off the update it won't break anything.

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-06 Thread Brett Henderson
On Thu, Jan 7, 2010 at 1:04 PM, John Smith deltafoxtrot...@gmail.comwrote:

 2010/1/7 Brett Henderson br...@bretth.com:
  Yep, fair enough.  How about I rename them so that things break ...

 I doubt it matters either way, since people will need to alter their
 systems sooner rather than later, all I'm saying is there is no point
 just turning off the update it won't break anything.


I've renamed the directories.  At least this way I can re-enable them if
necessary.
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2010-01-05 Thread Brett Henderson
On Mon, Dec 21, 2009 at 3:05 PM, Brett Henderson br...@bretth.com wrote:

 On Sat, Dec 19, 2009 at 3:06 PM, Brett Henderson br...@bretth.com wrote:

 Are there any objections to me disabling the old minute and hourly
 changesets and deleting their files from the planet server?
 http://planet.openstreetmap.org/minute/
 http://planet.openstreetmap.org/minute-slow/
 http://planet.openstreetmap.org/hourly/

 They are replaced by the (hopefully) reliable transaction based
 replication changesets.
 http://planet.openstreetmap.org/minute-replicate/
 http://planet.openstreetmap.org/hour-replicate/

 I haven't heard any complaints about the replication changesets so I'm
 assuming they're working well.

 I'll leave the daily changesets running for now because they are running
 with a much longer delay and shouldn't miss data.


 I'm not aware of anybody still using the minute diffs.  I'll disable them
 early in the new year.  I won't delete the files straight away so they can
 be re-enabled if somebody suddenly screams.

 I hope to disable the hour diffs around the same time but will wait until
 Florian has moved off them first.


The minute and minute-slow diffs are now disabled.

I'll delete the following directories in a couple of days if nobody yells.
http://planet.openstreetmap.org/minute/
http://planet.openstreetmap.org/minute-slow/

I'm keen to delete the hourly diffs as well.  *Florian*, have you had a
chance to move off these yet?
http://planet.openstreetmap.org/hourly/

Brett
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2009-12-20 Thread Brett Henderson
On Sun, Dec 20, 2009 at 10:44 AM, Brett Henderson br...@bretth.com wrote:

 On Sun, Dec 20, 2009 at 6:44 AM, Florian Lohoff f...@rfc822.org wrote:

 Ich am still using the normal hourly diffs as of lately the replicated
 diff stuff has not been documented and i didnt want to read java code
 to find out ...


 Okay, that's fair enough.  I'll update the wiki as soon as I can.  I can
 keep the old ones running for a while if necessary, I don't believe they're
 causing any major problems, I'm just keen to start cleaning things up to
 simplify maintenance.


The wiki has been updated now.  Or at least the --read-replication-interval
task has been.
http://wiki.openstreetmap.org/wiki/Osmosis/Detailed_Usage#--read-replication-interval_.28--rri.29

Note that you'll need to run the --read-replication-interval-init task first
to create a working directory, edit the config file if necessary, and
download an appropriate state.txt from the server (some basic instructions
are on the wiki).  Usage is fairly similar to the old --read-change-interval
task.

If you get stuck or find the doco lacking let me know.

Brett
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2009-12-20 Thread Brett Henderson
On Sat, Dec 19, 2009 at 3:06 PM, Brett Henderson br...@bretth.com wrote:

 Are there any objections to me disabling the old minute and hourly
 changesets and deleting their files from the planet server?
 http://planet.openstreetmap.org/minute/
 http://planet.openstreetmap.org/minute-slow/
 http://planet.openstreetmap.org/hourly/

 They are replaced by the (hopefully) reliable transaction based replication
 changesets.
 http://planet.openstreetmap.org/minute-replicate/
 http://planet.openstreetmap.org/hour-replicate/

 I haven't heard any complaints about the replication changesets so I'm
 assuming they're working well.

 I'll leave the daily changesets running for now because they are running
 with a much longer delay and shouldn't miss data.


I'm not aware of anybody still using the minute diffs.  I'll disable them
early in the new year.  I won't delete the files straight away so they can
be re-enabled if somebody suddenly screams.

I hope to disable the hour diffs around the same time but will wait until
Florian has moved off them first.

Brett
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2009-12-19 Thread Lennard
Brett Henderson wrote:
 Are there any objections to me disabling the old minute and hourly 
 changesets and deleting their files from the planet server?

No objections from me, but you might take your time, between this 
announcement/request and actually removing them.

 I haven't heard any complaints about the replication changesets so I'm 
 assuming they're working well.

I've been working with them since about day 1. They work wonderfully 
well, especially with that one-off bug fixed.

 I'll leave the daily changesets running for now because they are running 
 with a much longer delay and shouldn't miss data.

And are probably used in a lot more automated processes, to create a new 
planet (extract) every day. I know we do it for planet.openstreetmap.nl, 
and hypercube uses the same daily diff files for the Coastline Error 
Checker.

-- 
Lennard

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2009-12-19 Thread Jeremy Adams
On Fri, Dec 18, 2009 at 11:06 PM, Brett Henderson br...@bretth.com wrote:

 Are there any objections to me disabling the old minute and hourly
 changesets and deleting their files from the planet server?
 http://planet.openstreetmap.org/minute/
 http://planet.openstreetmap.org/minute-slow/
 http://planet.openstreetmap.org/hourly/

 They are replaced by the (hopefully) reliable transaction based replication
 changesets.
 http://planet.openstreetmap.org/minute-replicate/
 http://planet.openstreetmap.org/hour-replicate/

 I haven't heard any complaints about the replication changesets so I'm
 assuming they're working well.

 I'll leave the daily changesets running for now because they are running
 with a much longer delay and shouldn't miss data.

 Brett


There is a fix for the TRAPI servers to use the minute-replicate diffs
instead of the regular minute diffs.  Both of my servers have been switched
over, but I'm not sure about any others.  I'd wait to hear from Mathieu
Arnold as he's in charge of the other server(s).

-Jeremy
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2009-12-19 Thread Shaun McDonald
Would it be safe to put a redirect/symlink from the old folder to the new 
folder?

Shaun

On 19 Dec 2009, at 04:06, Brett Henderson wrote:

 Are there any objections to me disabling the old minute and hourly changesets 
 and deleting their files from the planet server?
 http://planet.openstreetmap.org/minute/
 http://planet.openstreetmap.org/minute-slow/
 http://planet.openstreetmap.org/hourly/
 
 They are replaced by the (hopefully) reliable transaction based replication 
 changesets.
 http://planet.openstreetmap.org/minute-replicate/
 http://planet.openstreetmap.org/hour-replicate/
 
 I haven't heard any complaints about the replication changesets so I'm 
 assuming they're working well.
 
 I'll leave the daily changesets running for now because they are running with 
 a much longer delay and shouldn't miss data.
 
 Brett
 
 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2009-12-19 Thread Florian Lohoff
On Sat, Dec 19, 2009 at 03:06:13PM +1100, Brett Henderson wrote:
 Are there any objections to me disabling the old minute and hourly
 changesets and deleting their files from the planet server?
 http://planet.openstreetmap.org/minute/
 http://planet.openstreetmap.org/minute-slow/
 http://planet.openstreetmap.org/hourly/
 
 They are replaced by the (hopefully) reliable transaction based replication
 changesets.
 http://planet.openstreetmap.org/minute-replicate/
 http://planet.openstreetmap.org/hour-replicate/
 
 I haven't heard any complaints about the replication changesets so I'm
 assuming they're working well.
 
 I'll leave the daily changesets running for now because they are running
 with a much longer delay and shouldn't miss data.

Ich am still using the normal hourly diffs as of lately the replicated
diff stuff has not been documented and i didnt want to read java code
to find out ...

Flo
-- 
Florian Lohoff f...@rfc822.org
Es ist ein grobes Missverständnis und eine Fehlwahrnehmung, dem Staat
im Internet Zensur- und Überwachungsabsichten zu unterstellen.
- - Bundesminister Dr. Wolfgang Schäuble -- 10. Juli in Berlin 


signature.asc
Description: Digital signature
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2009-12-19 Thread Brett Henderson
On Sun, Dec 20, 2009 at 5:20 AM, Shaun McDonald
sh...@shaunmcdonald.me.ukwrote:

 Would it be safe to put a redirect/symlink from the old folder to the new
 folder?


Not really.  The new diffs and old diffs use very different directory
layouts, filenames, etc.  Plus the new files contain potentially multiple
changes for a single entity which tends to break some things.

Brett
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] Removing Minutely and Hourly Changesets

2009-12-19 Thread Brett Henderson
On Sun, Dec 20, 2009 at 6:44 AM, Florian Lohoff f...@rfc822.org wrote:

 Ich am still using the normal hourly diffs as of lately the replicated
 diff stuff has not been documented and i didnt want to read java code
 to find out ...


Okay, that's fair enough.  I'll update the wiki as soon as I can.  I can
keep the old ones running for a while if necessary, I don't believe they're
causing any major problems, I'm just keen to start cleaning things up to
simplify maintenance.

Brett
___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev