Re: [9fans] Interested in improving networking in Plan 9

2009-09-03 Thread matt
Oh I don't know Shoehorning a DB interface into a FS interface doesn't feel right but stranger things have happened. I've done it a few ways. echo commit /n/db/0/ctl is kind of where one ends up for my limbo postgres module I never got round to the fs part. i just wrap the sql bits

Re: [9fans] Interested in improving networking in Plan 9

2009-09-03 Thread erik quanstrom
I've done it a few ways. echo commit /n/db/0/ctl is kind of where one ends up for my limbo postgres module I never got round to the fs part. i just wrap the sql bits in their own adt i would think that rather than use an adt, one would want to make the language the communication's

Re: [9fans] Interested in improving networking in Plan 9

2009-09-03 Thread erik quanstrom
[...] but... SQL is really ugly. it's not hard to construct something that provides the same functionality in a much more palatable form. aesthetics aside, if you're dealing with a database-heavy app, it can make the code much easier to read. could you explain what in particular is

Re: [9fans] Interested in improving networking in Plan 9

2009-09-03 Thread Robert Raschke
On Thu, Sep 3, 2009 at 5:13 PM, Anthony Sorace ano...@gmail.com wrote: i've not used matt's sql module itself (i should check it out) so i can't comment on his implementation, but... SQL is really ugly. it's not hard to construct something that provides the same functionality in a much more

Re: [9fans] Interested in improving networking in Plan 9

2009-09-03 Thread Steve Simon
it seems so straightforward to just send formatted sql or pl/sql to the engine and get normally formatted output. I did somthing like this for mysql to access our corperate telephone database. I took the inferno odbcfs as an example: http://www.vitanuova.com/inferno/man/10/odbc.html

Re: [9fans] Interested in improving networking in Plan 9

2009-09-03 Thread Daniel Lyons
On Sep 3, 2009, at 10:13 AM, Anthony Sorace wrote: you can do things like data constraints and validations in the application code, rather than in the sql database itself, which always feels like this random bolt-on to the application logic. I think it's useful to think of relational

Re: [9fans] Interested in improving networking in Plan 9

2009-09-02 Thread Bakul Shah
On Mon, 31 Aug 2009 11:33:13 CDT Eric Van Hensbergen eri...@gmail.com wrote: On Mon, Aug 31, 2009 at 11:16 AM, Bakul Shahbakul+pl...@bitblocks.com wrote: An intriguing idea that can point toward a synth fs interface to a dbms or search results But I don't think this would be a

Re: [9fans] Interested in improving networking in Plan 9

2009-09-02 Thread Robert Raschke
On Wed, Sep 2, 2009 at 5:50 PM, Bakul Shah bakul+pl...@bitblocks.combakul%2bpl...@bitblocks.com wrote: On Mon, 31 Aug 2009 11:33:13 CDT Eric Van Hensbergen eri...@gmail.com wrote: On Mon, Aug 31, 2009 at 11:16 AM, Bakul Shahbakul+pl...@bitblocks.combakul%2bpl...@bitblocks.com wrote:

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Eric Van Hensbergen
On Aug 30, 2009, at 10:34 PM, erik quanstrom quans...@quanstro.net wrote: On Sun Aug 30 14:37:29 EDT 2009, rminn...@gmail.com wrote: One way to make this kind of interesting is to address how you'd do a reasonable zeroconf effort given that you need to boot 1m+ machines. We've booted

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread erik quanstrom
I think there are a few issues beyond will it scale - of course with 128k nodes scaling is a baseline prereq for us. On BG we have a segmented network to deal with -- but it's likely you'll want some form of hierarchy regardless. I have done much with dynamic service registry using

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Vinu Rajashekhar
You can implement a NAT by mounting a /net from a perimeter machine with a public IP, while connecting to it from an internal network of private IP addresses, using the Plan 9 protocol 9P in the internal network. This is from the wikipedia page on Plan 9 OS. Is something like iptables like in

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread erik quanstrom
You can implement a NAT by mounting a /net from a perimeter machine with a public IP, while connecting to it from an internal network of private IP addresses, using the Plan 9 protocol 9P in the internal network. This is from the wikipedia page on Plan 9 OS. Is something like iptables

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Eric Van Hensbergen
On Mon, Aug 31, 2009 at 7:51 AM, erik quanstromquans...@quanstro.net wrote: could you explan why you're focused on dns? a more natural way to use plan 9 would be to use ndb and cs directly.  wouldn't it? Of course. My use of DNS was really just in abstract to refer to the suite of existing

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Anthony Sorace
that wiki writeup isn't really right. importing /net isn't NAT in any sort of technical sense; rather, it's what plan 9 does instead. there's no translation of ports or addresses, it's more (conceptually) like a straight multiplexing.

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread erik quanstrom
Of course. My use of DNS was really just in abstract to refer to the suite of existing services for name and service resolution under Plan 9. However, I think the current interfaces for ndb and cs are very limiting and the single file based query mechanisms don't really match the

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Eric Van Hensbergen
On Mon, Aug 31, 2009 at 9:04 AM, erik quanstromquans...@quanstro.net wrote: given the database= option, if one could confine rapid changes to smaller files, one could teach ndb to only reread changed files. Why not have a synthetic file system interface to ndb that allows it to update its own

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread erik quanstrom
given the database= option, if one could confine rapid changes to smaller files, one could teach ndb to only reread changed files. Why not have a synthetic file system interface to ndb that allows it to update its own files? I think this is my primary problem. Granular modification

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Devon H. O'Dell
2009/8/31 Vinu Rajashekhar vinuthe...@gmail.com: You can implement a NAT by mounting a /net from a perimeter machine with a public IP, while connecting to it from an internal network of private IP addresses, using the Plan 9 protocol 9P in the internal network. This is from the wikipedia page

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Francisco J Ballesteros
Hmmm. we did that for FS processes on Plan B. I mean, keep a dynamic version of a registry. It kept the list of volumes available at a central place. I think it can be used as is on Plan 9, without changes. There was a program (I think it was called adsrv; not sure, it´s on the Plan B man pages)

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Eric Van Hensbergen
On Mon, Aug 31, 2009 at 9:36 AM, erik quanstromquans...@quanstro.net wrote: i can see in principle how this could be a good idea (no more comments, though).  could you elaborate, though.  i have found editing /lib/ndb/local works well at the scales i see. I think the main issue with just

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Vinu Rajashekhar
On Mon, Aug 31, 2009 at 8:21 PM, Devon H. O'Delldevon.od...@gmail.com wrote: 2009/8/31 Vinu Rajashekhar vinuthe...@gmail.com: You can implement a NAT by mounting a /net from a perimeter machine with a public IP, while connecting to it from an internal network of private IP addresses, using the

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread erik quanstrom
i can see in principle how this could be a good idea (no more comments, though).  could you elaborate, though.  i have found editing /lib/ndb/local works well at the scales i see. [...] machines, even with multiple admins. I have a feeling it starts to break down with thousands of

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread erik quanstrom
While that sounds interesting and may be useful in its own right, a centralized server isn't really desirable -- part of the nice thing of zeroconf is moving to a decentralized environment, and ideally doing it in a scalable fashion (which isn't trivial on hundreds of thousands of cores, we

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Bakul Shah
On Mon, 31 Aug 2009 09:25:36 CDT Eric Van Hensbergen eri...@gmail.com wrote: Why not have a synthetic file system interface to ndb that allows it to update its own files? I think this is my primary problem. Granular modification to static files is a PITA to manage -- we should be using

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Eric Van Hensbergen
On Mon, Aug 31, 2009 at 10:52 AM, erik quanstromquans...@coraid.com wrote: so plunkers like us with a few hundred machines are just casual users? i'd hate for plan 9 to become harder to use outside a hpc environment. it would be good to be flexable enough to support fairly degnerate cases

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Eric Van Hensbergen
On Mon, Aug 31, 2009 at 11:16 AM, Bakul Shahbakul+pl...@bitblocks.com wrote: ndb maps directly to a list of lisp's association lists but how would you map this to a synthetic fs? Something like attr/value to yield a tuple? For example: My current intuition in these situations is to allow for

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread erik quanstrom
2009/8/31 Bakul Shah bakul+pl...@bitblocks.com: But this is nasty! % cat ndb/dom/'' # same as ndbquery dom '' No, the nasty part is really that the file should be called `.' and the filesystem reserves dot as the reference to the current directory. You could probably call the file `dot'

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Devon H. O'Dell
2009/8/31 erik quanstrom quans...@coraid.com: 2009/8/31 Bakul Shah bakul+pl...@bitblocks.com: But this is nasty! % cat ndb/dom/'' # same as ndbquery dom '' No, the nasty part is really that the file should be called `.' and the filesystem reserves dot as the reference to the current

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread Devon H. O'Dell
2009/8/31 Bakul Shah bakul+pl...@bitblocks.com: But this is nasty! % cat ndb/dom/'' # same as ndbquery dom '' No, the nasty part is really that the file should be called `.' and the filesystem reserves dot as the reference to the current directory. You could probably call the file `dot' or

Re: [9fans] Interested in improving networking in Plan 9

2009-08-31 Thread erik quanstrom
It's (in my opinion) slightly less evil because if(!strlen(name)) seems like a pretty poor way to determine that you're looking at the root zone. It's also more intuitive and easier to document that you're looking at the root than saying `to find root, look for a file named as an empty

[9fans] Interested in improving networking in Plan 9

2009-08-30 Thread Vinu Rajashekhar
Hi, I was looking for some open-source implementation work to be done as my master's project when I chanced upon the Plan 9 GSOC projects page. My interest is in networking, so I was particularly interested in projects about adding zeroconf networking and firewall support to Plan 9. I think I

Re: [9fans] Interested in improving networking in Plan 9

2009-08-30 Thread ron minnich
I think your first, best bet is to try to find out what the Plan 9 community needs, rather than adding on something that might not be the that important. I have not heard anyone express a need for zeroconf in Plan 9, but maybe I'm missing something. Simple example: file systems on Plan 9 are

Re: [9fans] Interested in improving networking in Plan 9

2009-08-30 Thread Eric Van Hensbergen
On Sun, Aug 30, 2009 at 9:21 AM, ron minnichrminn...@gmail.com wrote: I think your first, best bet is to try to find out what the Plan 9 community needs, rather than adding on something that might not be the that important. I have not heard anyone express a need for zeroconf in Plan 9, but

Re: [9fans] Interested in improving networking in Plan 9

2009-08-30 Thread erik quanstrom
Simple example: file systems on Plan 9 are slow. Why is that? How do they work? How would you go about finding out how to make them faster? which ones? there are quite a number to choose from. i've found that ken's fs beats the pants off nfs on similar hardware with literally one cpu tied

Re: [9fans] Interested in improving networking in Plan 9

2009-08-30 Thread erik quanstrom
personally, i think the best contributions come from people who have a real personal need or better want to solve a problem, solve it and contribute the solution back to the community. i think that's why unix and plan 9 exist at all. so i would encourage folks who would like to contribute to

Re: [9fans] Interested in improving networking in Plan 9

2009-08-30 Thread Vinu Rajashekhar
On Sun, Aug 30, 2009 at 10:52 PM, erik quanstromquans...@quanstro.net wrote: personally, i think the best contributions come from people who have a real personal need or better want to solve a problem, solve it and contribute the solution back to the community. Yes, I do agree with that.

Re: [9fans] Interested in improving networking in Plan 9

2009-08-30 Thread Venkatesh Srinivas
On Sun, Aug 30, 2009 at 1:07 PM, erik quanstromquans...@quanstro.net wrote: Simple example: file systems on Plan 9 are slow. Why is that? How do they work? How would you go about finding out how to make them faster? which ones? there are quite a number to choose from. i've found that ken's

Re: [9fans] Interested in improving networking in Plan 9

2009-08-30 Thread erik quanstrom
I wasn't thinking about doing this as a GSOC project, I wanted to do something for my master's project which was a hardcore open-source implementation, that's why I was going through the gsoc ideas page. makes sense to me. i'd incourage you to work a bit with the community. part of open

Re: [9fans] Interested in improving networking in Plan 9

2009-08-30 Thread erik quanstrom
Try this - build the source to charon over a 200ms link over 9p. Then try again over sshfs. why would you do this? why not run the compile closer to the source. this is the power of plan 9. Also, look at a single terminal with a local fossil install. Trace the path of an 'ls /'. Count the

Re: [9fans] Interested in improving networking in Plan 9

2009-08-30 Thread ron minnich
I see your point. It does sound like zeroconf would be useful to some people. I wonder if it could be done with a 9p orientation as eric suggested. I don't recall what the security issues are with zeroconf, but, if it's the microsoft-inspired version I'm thinking of, I would guess there are many.

Re: [9fans] Interested in improving networking in Plan 9

2009-08-30 Thread erik quanstrom
On Sun Aug 30 14:37:29 EDT 2009, rminn...@gmail.com wrote: One way to make this kind of interesting is to address how you'd do a reasonable zeroconf effort given that you need to boot 1m+ machines. We've booted 4400*250 VMs on a machine at sandia, and, let me tell you, it was a pain. It is

Re: [9fans] Interested in improving networking in Plan 9

2009-08-30 Thread Federico G. Benavento
Reposting this to 9fans: hola, First of all, I'm really glad you are considering Plan 9 for your project, thanks. Can someone please discuss with me how to proceed, and what are the things I should learn before starting on this ? you can start by reading nemo's intro Introduction to

Re: [9fans] Interested in improving networking in Plan 9

2009-08-30 Thread Vinu Rajashekhar
On Mon, Aug 31, 2009 at 9:47 AM, Federico G. Benaventobenave...@gmail.com wrote: Reposting this to 9fans: hola, First of all, I'm really glad you are considering Plan 9 for your project, thanks.  Can someone please discuss with me how to proceed, and what are the things I should learn