Re: [Server-devel] [PATCH] Detect school network, fix sleep and race, fix AC

2008-06-16 Thread Michael Stone
On Mon, Jun 16, 2008 at 06:34:15PM -0400, Martin Langhoff wrote: > On Mon, Jun 16, 2008 at 6:09 PM, Michael Stone <[EMAIL PROTECTED]> wrote: > > Are you saying that you think the overhead of starting a single extra > > python interpreter is too high? > $ time python -c 'exit' > > real0m0.110s

Re: [Server-devel] [PATCH] Touch a ".transfer_complete" to mark completion, minor cleanups

2008-06-16 Thread Michael Stone
On Mon, Jun 16, 2008 at 06:20:02PM -0400, Martin Langhoff wrote: > Note: this is a work in progress. Naturally. > Back to your question: we tack on a "transfer_complete" flag file in a > 2nd rsync transmission that is conditional on the first one > succeeding. A better solution is to wrap rsyn

Re: [Server-devel] Modify the "Kickstart File" on XS-163

2008-06-16 Thread Martin Langhoff
2008/6/16 Tony Pearson <[EMAIL PROTECTED]>: > "packages" and "@post" script. Does that look reasonable? Hmmm. I don't quite understand what is happening here. Our current ks file is here, but it is built to support the livecd bootstrapping process - a different beast altogether: http://dev.lapt

Re: [Server-devel] [PATCH] Detect school network, fix sleep and race, fix AC

2008-06-16 Thread Martin Langhoff
On Mon, Jun 16, 2008 at 6:09 PM, Michael Stone <[EMAIL PROTECTED]> wrote: > Are you saying that you think the overhead of starting a single extra > python interpreter is too high? Yes. This is a cronjob that we want to run cheaply and often on a power-constrained machine. If we keep the costs low,

Re: [Server-devel] [PATCH] Touch a ".transfer_complete" to mark completion, minor cleanups

2008-06-16 Thread Martin Langhoff
On Mon, Jun 16, 2008 at 6:03 PM, Michael Stone <[EMAIL PROTECTED]> wrote: >> In any case, all of this can merely prevent a "friendly fire" DoS. > As it turns out, the GET to the /new/* URL serves as a "commit message" > to inform the server that the client is satisfied that it has > transmitted all

Re: [Server-devel] [PATCH] Detect school network, fix sleep and race, fix AC

2008-06-16 Thread Michael Stone
On Mon, Jun 16, 2008 at 05:24:09PM -0400, Martin Langhoff wrote: > Scraping it in shell is horrid, and the tests are mixed up (costly and > cheap tests) so -- I know it looks like a sloppy job, but there wasn't > anything pretty that I could do there. The point of the shell stage is > to do what we

Re: [Server-devel] [PATCH] Touch a ".transfer_complete" to mark completion, minor cleanups

2008-06-16 Thread Michael Stone
On Mon, Jun 16, 2008 at 05:01:32PM -0400, Martin Langhoff wrote: > On Mon, Jun 16, 2008 at 4:42 PM, Michael Stone <[EMAIL PROTECTED]> wrote: > >> -def new_backup_notify(server, nonce, xo_serial): > >> -try: > >> -auth = sha.sha(nonce + xo_serial) > >> -# TODO: add auth header >

[Server-devel] Modify the "Kickstart File" on XS-163

2008-06-16 Thread Tony Pearson
Martin, To get past my installation issues, I decided it would be easier just to modify the existing XS-163.iso than go download all the git-clone and build it from scratch. That said, I was able to use Fedora 7 "kickstart configurator" tool to get the following, I can merge it with your "packag

[Server-devel] Moodle w/PostgreSQL

2008-06-16 Thread Tony Pearson
> From: "Tim Moody" <[EMAIL PROTECTED]> > I guess I'll continue to struggle get moodle to work with Pg on XS(163). I > didn't find Pg as an installed service and the moodle that yum installed > only had mysql support libraries as dependencies. Or should I just wait > until moodle is bundled

Re: [Server-devel] [PATCH] ds_backup - major rework

2008-06-16 Thread Martin Langhoff
On Mon, Jun 16, 2008 at 5:27 PM, Michael Stone <[EMAIL PROTECTED]> wrote: > On Mon, Jun 16, 2008 at 01:46:25PM -0400, [EMAIL PROTECTED] wrote: >> From: Martin Langhoff <[EMAIL PROTECTED]> >> +# setup datastore connection >> +bus = dbus.SessionBus() >> +obj = bus.get_object(DS_DBUS_SERVI

Re: [Server-devel] [PATCH] ds_backup - major rework

2008-06-16 Thread Michael Stone
On Mon, Jun 16, 2008 at 01:46:25PM -0400, [EMAIL PROTECTED] wrote: > From: Martin Langhoff <[EMAIL PROTECTED]> > +# setup datastore connection > +bus = dbus.SessionBus() > +obj = bus.get_object(DS_DBUS_SERVICE, DS_DBUS_PATH) > +datastore = dbus.Interface(obj, DS_DBUS_INTERFACE) Mig

Re: [Server-devel] [PATCH] Introducing ds_backup.sh - a lightweight wrapper.

2008-06-16 Thread Martin Langhoff
On Mon, Jun 16, 2008 at 5:08 PM, Michael Stone <[EMAIL PROTECTED]> wrote: > On Mon, Jun 16, 2008 at 01:46:32PM -0400, [EMAIL PROTECTED] wrote: >> From: Martin Langhoff <[EMAIL PROTECTED]> >> +# make the lock dir if needed >> +if [ ! -d ~/.sugar/default/lock ] >> +then >> +mkdir ~/.sugar/default

Re: [Server-devel] [PATCH] Detect school network, fix sleep and race, fix AC

2008-06-16 Thread Michael Stone
On Mon, Jun 16, 2008 at 01:46:37PM -0400, [EMAIL PROTECTED] wrote: > From: Martin Langhoff <[EMAIL PROTECTED]> > > - Adds network-detection cribbed from > olpc-netstatus to skip execution unless we know > we are in a school network. Do we know if this XS detection works with UY's school servers?

Re: [Server-devel] [PATCH] Introducing ds_backup.sh - a lightweight wrapper.

2008-06-16 Thread Michael Stone
On Mon, Jun 16, 2008 at 01:46:32PM -0400, [EMAIL PROTECTED] wrote: > From: Martin Langhoff <[EMAIL PROTECTED]> > +# make the lock dir if needed > +if [ ! -d ~/.sugar/default/lock ] > +then > +mkdir ~/.sugar/default/lock > +fi Why not use /var/lock like everybody else? We can add appropriate us

Re: [Server-devel] [PATCH] Touch a ".transfer_complete" to mark completion, minor cleanups

2008-06-16 Thread Martin Langhoff
On Mon, Jun 16, 2008 at 4:42 PM, Michael Stone <[EMAIL PROTECTED]> wrote: >> -def new_backup_notify(server, nonce, xo_serial): >> -try: >> -auth = sha.sha(nonce + xo_serial) >> -# TODO: add auth header >> -ret = urllib.urlopen(server + '/new/%s' % xo_serial).read() >> -

Re: [Server-devel] [PATCH] Add growdatastore script from Tomeu

2008-06-16 Thread Martin Langhoff
On Mon, Jun 16, 2008 at 4:46 PM, Michael Stone <[EMAIL PROTECTED]> wrote: > On Mon, Jun 16, 2008 at 01:46:27PM -0400, [EMAIL PROTECTED] wrote: > >> +for i in range(0, 10): > > Maybe it would be good if we could set the quantity of growth on the > script's command-line? yes, though that's just a de

Re: [Server-devel] [PATCH] Add growdatastore script from Tomeu

2008-06-16 Thread Michael Stone
On Mon, Jun 16, 2008 at 01:46:27PM -0400, [EMAIL PROTECTED] wrote: > +for i in range(0, 10): Maybe it would be good if we could set the quantity of growth on the script's command-line? Michael ___ Server-devel mailing list Server-devel@lists.laptop.or

Re: [Server-devel] [PATCH] Touch a ".transfer_complete" to mark completion, minor cleanups

2008-06-16 Thread Michael Stone
> -def new_backup_notify(server, nonce, xo_serial): > -try: > -auth = sha.sha(nonce + xo_serial) > -# TODO: add auth header > -ret = urllib.urlopen(server + '/new/%s' % xo_serial).read() > -except IOError, e: > -if e[1] == 403: > -# Auth not accep

Re: [Server-devel] [PATCH] ds_backup - major rework

2008-06-16 Thread Martin Langhoff
On Mon, Jun 16, 2008 at 1:53 PM, Tomeu Vizoso <[EMAIL PROTECTED]> wrote: > On Mon, Jun 16, 2008 at 7:46 PM, <[EMAIL PROTECTED]> wrote: >> From: Martin Langhoff <[EMAIL PROTECTED]> >> >> - Use json (part of the XO base install) instead of simplejson > > python-json looks unmaintained and lacks som

Re: [Server-devel] [PATCH] ds_backup - major rework

2008-06-16 Thread Tomeu Vizoso
On Mon, Jun 16, 2008 at 7:46 PM, <[EMAIL PROTECTED]> wrote: > From: Martin Langhoff <[EMAIL PROTECTED]> > > - Use json (part of the XO base install) instead of simplejson python-json looks unmaintained and lacks some features on which sugar depends, so I think you are safe by depending on it. Yo

Re: [Server-devel] XS SW

2008-06-16 Thread Martin Langhoff
On Mon, Jun 16, 2008 at 1:37 PM, Tim Moody <[EMAIL PROTECTED]> wrote: > Thanks for answering my question. Like you I only have anecdotal evidence, > and producing a thorough comparison is beyond what I could achieve with a > reasonable amount of effort. > > I guess I'll continue to struggle get mo

[Server-devel] [PATCH] skip_noschoolnet() bugfix - ethernet detection was missing

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> I had dropped the ethernet detection. Oops. --- ds_backup.sh |8 1 files changed, 8 insertions(+), 0 deletions(-) diff --git a/ds_backup.sh b/ds_backup.sh index e654adb..884e48d 100755 --- a/ds_backup.sh +++ b/ds_backup.sh @@ -22,6 +22,14 @@

[Server-devel] [PATCH] Detect school network, fix sleep and race, fix AC

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> - Adds network-detection cribbed from olpc-netstatus to skip execution unless we know we are in a school network. - Fix typo in sleep line - Fix race condition - while we sleep, someone may do our work. If that's the case, consider it done :-) Spefic

[Server-devel] [PATCH] Store the ds_backup-done flag to mark success

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> --- ds_backup.py |2 ++ 1 files changed, 2 insertions(+), 0 deletions(-) diff --git a/ds_backup.py b/ds_backup.py index f5e7e83..954c545 100755 --- a/ds_backup.py +++ b/ds_backup.py @@ -208,3 +208,5 @@ if __name__ == "__main__": # if ping_xs():

[Server-devel] [PATCH] Move cheaper checks earlier

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> With this each run is down to a minimum cost of 30ms. --- ds_backup.sh | 32 1 files changed, 16 insertions(+), 16 deletions(-) diff --git a/ds_backup.sh b/ds_backup.sh index 98547d1..4c89fbb 100755 --- a/ds_backup.sh +

[Server-devel] [PATCH] Add a portable (if slow) check for power

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> This patch adds a fallback portable check for power using HAL. This adds ~100ms on XO-1 HW. --- ds_backup.sh | 33 +++-- 1 files changed, 31 insertions(+), 2 deletions(-) diff --git a/ds_backup.sh b/ds_backup.sh index ceea99

[Server-devel] [PATCH] Uncomment the sleep line to stagger clients

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> This protects the XS from a tidal wave of clients looking for backup service. --- ds_backup.sh |2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/ds_backup.sh b/ds_backup.sh index 739bb43..ceea99a 100755 --- a/ds_backup.sh +++ b/ds_

[Server-devel] [PATCH] Introducing ds_backup.sh - a lightweight wrapper.

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> ds_backup.sh gets called from cron and/or from NetworkManager, and decides whether it's a good time to attempt a backup. It also protects ds_backup.py from concurrent executions, staggers clients to avoid stampedes, and keeps various other demons at bay.

[Server-devel] [PATCH] Touch a ".transfer_complete" to mark completion, minor cleanups

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> With this patch, ds_backup indicates to the XS that the transfer has completed successfully by creating an empy .transfer_complete file. With this, new_backup_notify() is obsolete and removed. --- ds_backup.py | 35 ---

[Server-devel] [PATCH] Fix rsync line and debug message

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> --- ds_backup.py | 15 +++ 1 files changed, 11 insertions(+), 4 deletions(-) diff --git a/ds_backup.py b/ds_backup.py index c04f491..9a960a3 100755 --- a/ds_backup.py +++ b/ds_backup.py @@ -26,6 +26,7 @@ import time import glob import pop

[Server-devel] [PATCH] Fix to handle UTF-8 metadata

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> --- ds_backup.py |7 +++ 1 files changed, 3 insertions(+), 4 deletions(-) diff --git a/ds_backup.py b/ds_backup.py index 7d8d4c9..c04f491 100755 --- a/ds_backup.py +++ b/ds_backup.py @@ -50,9 +50,7 @@ class BulkRestoreUnavailable(BackupError): pa

[Server-devel] [PATCH] Execute that bit...

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> --- ds_backup.py |2 +- 1 files changed, 1 insertions(+), 1 deletions(-) mode change 100644 => 100755 ds_backup.py mode change 100644 => 100755 utils/growdatastore.py diff --git a/ds_backup.py b/ds_backup.py old mode 100644 new mode 10075

[Server-devel] [PATCH] Add growdatastore script from Tomeu

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> --- utils/growdatastore.py | 31 +++ 1 files changed, 31 insertions(+), 0 deletions(-) create mode 100644 utils/growdatastore.py diff --git a/utils/growdatastore.py b/utils/growdatastore.py new file mode 100644 index 00

[Server-devel] [PATCH] ds_backup - major rework

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> With this commit ds_backup.py starts to run. Main changes - Several missing import lines - Use json (part of the XO base install) instead of simplejson - A simpler write_metadata() replaces _write_metadata_and_files() - cleanup_stale_metadata() cle

[Server-devel] ds-backup - work in progress

2008-06-16 Thread martin . langhoff
This patch series shows current progress with ds-backup. It depends on Tomeu's patch to move the metadata to plain cjson-encoded files on the fs. There are a few loose ends still. This is hosted in git://dev.laptop.org/users/martin/ds-backup ___

[Server-devel] ds-backup - work in progress

2008-06-16 Thread martin . langhoff
This patch series shows current progress with ds-backup. It depends on Tomeu's patch to move the metadata to plain cjson-encoded files on the fs. There are a few loose ends still. This is hosted in git://dev.laptop.org/users/martin/ds-backup ___

Re: [Server-devel] XS SW

2008-06-16 Thread Tim Moody
Hi Martin, Thanks for answering my question. Like you I only have anecdotal evidence, and producing a thorough comparison is beyond what I could achieve with a reasonable amount of effort. I guess I'll continue to struggle get moodle to work with Pg on XS(163). I didn't find Pg as an install

[Server-devel] [PATCH] named: Fix typo in german word for school

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> I misremembered the spelling. The typo made for a good demo of punycode, but for very bad Deutsch. --- fsroot.olpc.img/var/named/school.internal.zone.db |3 +-- 1 files changed, 1 insertions(+), 2 deletions(-) diff --git a/fsroot.olpc.img/var/named/s

Re: [Server-devel] [PATCH] named: add 'school' translations for es and de

2008-06-16 Thread Martin Langhoff
On Mon, Jun 16, 2008 at 1:01 PM, Stefan Reitz <[EMAIL PROTECTED]> wrote: > I found a typo - And I am in shame wrt to my German heritage. So it is just Schule with a regular u. Thanks! m -- [EMAIL PROTECTED] -- School Server Architect - ask interesting questions - don't get distracted with

Re: [Server-devel] [PATCH] named: add 'school' translations for es and de

2008-06-16 Thread Stefan Reitz
Martin, I found a typo - On Mon, 2008-06-16 at 12:47 -0400, [EMAIL PROTECTED] wrote: From: Martin Langhoff <[EMAIL PROTECTED]> For usability - type "Escuela" in your Browse activity and it just works. Now all I need are translations... --- fsroot.olpc.img/var/named/school.internal.zone.d

[Server-devel] Easy help: Translations of School in punycode

2008-06-16 Thread Martin Langhoff
Here's an opportunity to help w something simple: I am after as many translations of "school" as we can get, synonyms welcome. If they have non-latin chars, then what we want is the punycode for them. An easy way to get the punycode for a word is to use a modern webbrowser, and type your word in th

[Server-devel] [PATCH] named: add 'school' translations for es and de

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> For usability - type "Escuela" in your Browse activity and it just works. Now all I need are translations... --- fsroot.olpc.img/var/named/school.internal.zone.db | 12 1 files changed, 12 insertions(+), 0 deletions(-) diff --git a/fsroot.

[Server-devel] [PATCH] Squid: Now clients can request 'schoolserver' and it will work correctly

2008-06-16 Thread martin . langhoff
From: Martin Langhoff <[EMAIL PROTECTED]> This patch fixes squid so that it appends the search domain properly. --- fsroot.olpc.img/etc/squid/squid.conf | 14 .../sysconfig/olpc-scripts/domain_config.d/squid | 36 2 files changed, 50 insertions(+)

[Server-devel] [PATCH] Disallow root logins.

2008-06-16 Thread martin . langhoff
From: martin langhoff <[EMAIL PROTECTED]> --- fsroot.olpc.img/etc/ssh/sshd_config |2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/fsroot.olpc.img/etc/ssh/sshd_config b/fsroot.olpc.img/etc/ssh/sshd_config index e6c2f26..3fd5d41 100644 --- a/fsroot.olpc.img/etc/ssh/sshd_c

[Server-devel] [PATCH] Remove user/group database files

2008-06-16 Thread martin . langhoff
From: martin langhoff <[EMAIL PROTECTED]> The user/group database files were clobbering the correct user/group files that belong to the LiveCD. With this we also fix #6678 - the root password entered during install is preserved. --- fsroot.olpc.img/etc/group | 77

[Server-devel] [PATCH] Remove bogus entries from sudoers

2008-06-16 Thread martin . langhoff
From: martin langhoff <[EMAIL PROTECTED]> --- fsroot.olpc.img/etc/sudoers |5 ++--- 1 files changed, 2 insertions(+), 3 deletions(-) diff --git a/fsroot.olpc.img/etc/sudoers b/fsroot.olpc.img/etc/sudoers index 1b8342d..2c15ef7 100644 --- a/fsroot.olpc.img/etc/sudoers +++ b/fsroot.olpc.img/et

[Server-devel] Please read - higher visibility of code on the list

2008-06-16 Thread Martin Langhoff
Hi all, this list has been rather quiet,. and this is in part my fault. While I have been working on things, I have only been publishing code here. Publishing code on the list is a good practice, and the dev teams that I most enjoy working with do it. For some reason, as I started coding, I forgot

Re: [Server-devel] EduBlog v0.1 Available for Comment! (Martin Langhoff)

2008-06-16 Thread Greg Smith (gregmsmi)
Hi Martin and Tarun, I understand that there is a decision point about OuBlog vs. Moodleblog. I think the choice will affect what appears on the students home page. I'm ready to ask the teachers what they prefer but I'm not sure I have a well formed question. I was thinking that one teacher contr