Re: GEOM Gate.

2003-10-15 Thread Terry Lambert
Wilko Bulte wrote:
 On Tue, Oct 14, 2003 at 10:44:14PM +0200, Oldach, Helge wrote:
  From: Richard Tobin [mailto:[EMAIL PROTECTED]
Ok, GEOM Gate is ready for testing.
For those who don't know what it is, they can read README:
  
   Aaargh!  It's the return of nd(4) from SunOS.
 
  Excuse me?
 
  # uname -a
  SunOS galaxy 4.1.4 18 sun4m
 
 Too new..

Yeah... Think Sun2 systems

http://www.netbsd.org/Documentation/network/netboot/nd.html

-- Terry
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-10-15 Thread Wilko Bulte
On Wed, Oct 15, 2003 at 12:28:12AM -0700, Terry Lambert wrote:
 Wilko Bulte wrote:
  On Tue, Oct 14, 2003 at 10:44:14PM +0200, Oldach, Helge wrote:
   From: Richard Tobin [mailto:[EMAIL PROTECTED]
 Ok, GEOM Gate is ready for testing.
 For those who don't know what it is, they can read README:
   
Aaargh!  It's the return of nd(4) from SunOS.
  
   Excuse me?
  
   # uname -a
   SunOS galaxy 4.1.4 18 sun4m
  
  Too new..
 
 Yeah... Think Sun2 systems
 
 http://www.netbsd.org/Documentation/network/netboot/nd.html

/me fondly remembers the hacked-up backplane in the Sun2/170
to allow it to use 7 1MB RAM cards..

-- 
|   / o / /_  _ [EMAIL PROTECTED]
|/|/ / / /(  (_)  Bulte 
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-10-15 Thread Richard Tobin
 Yeah... Think Sun2 systems
 
 http://www.netbsd.org/Documentation/network/netboot/nd.html

Though it wasn't just for booting in the old days.  On a diskless
workstation, your whole filesystem would be on nd.  And it was a real
mistake to mount a writable partition on two machines, but nothing
stopped you doing it.

-- Richard

___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


GEOM Gate.

2003-10-14 Thread Pawel Jakub Dawidek
Hello hackers...

Ok, GEOM Gate is ready for testing.
For those who don't know what it is, they can read README:

http://garage.freebsd.pl/geom_gate.README

and presentation from WIP/BSDCon03 session:

http://garage.freebsd.pl/GEOM_Gate.pdf

After compliation (cd geom_gate; make; make install) you should run
regression tests:

# regression/runtests.sh

If everything will went ok you can play with GEOM Gate and report any bugs.

I've spend some time to made GEOM Gate force-remove-safe so using
'-f' option with ggc(8) should be always safe.

Ah! Four manual pages are added, so feel free to read them first
(gg(4), geom_gate(4), ggc(8), ggd(8))

http://garage.freebsd.pl/geom_gate.tbz

Enjoy!

-- 
Pawel Jakub Dawidek   [EMAIL PROTECTED]
UNIX Systems Programmer/Administrator http://garage.freebsd.pl
Am I Evil? Yes, I Am! http://cerber.sourceforge.net


pgp0.pgp
Description: PGP signature


Re: GEOM Gate.

2003-10-14 Thread Richard Tobin
 Ok, GEOM Gate is ready for testing.
 For those who don't know what it is, they can read README:

Aaargh!  It's the return of nd(4) from SunOS.

(Sorry about that.)

-- Richard
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


RE: GEOM Gate.

2003-10-14 Thread Oldach, Helge
From: Richard Tobin [mailto:[EMAIL PROTECTED]
  Ok, GEOM Gate is ready for testing.
  For those who don't know what it is, they can read README:
 
 Aaargh!  It's the return of nd(4) from SunOS.

Excuse me?

# uname -a
SunOS galaxy 4.1.4 18 sun4m
# man nd
No manual entry for nd.
#

Helge
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-10-14 Thread Wilko Bulte
On Tue, Oct 14, 2003 at 10:44:14PM +0200, Oldach, Helge wrote:
 From: Richard Tobin [mailto:[EMAIL PROTECTED]
   Ok, GEOM Gate is ready for testing.
   For those who don't know what it is, they can read README:
  
  Aaargh!  It's the return of nd(4) from SunOS.
 
 Excuse me?
 
 # uname -a
 SunOS galaxy 4.1.4 18 sun4m

Too new..

 # man nd
 No manual entry for nd.
 #

-- 
|   / o / /_  _ [EMAIL PROTECTED]
|/|/ / / /(  (_)  Bulte 
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


GEOM Gate status.

2003-09-08 Thread Pawel Jakub Dawidek
Hello hackers...

I've spend some time working on GEOM Gate, so...

Cache was implemented, but only for reading (cache for write requests
isn't good idea here, IMHO).
Many workers can be used now. This will help to split requests.
Requests are queued and always worker with minimal number of pending
requests is choosen.
Workers can be added at run-time with '-r' option.

ggd(8) use now NFS-like exports file. Sample entries:
192.168.0.3 RD  /dev/acd0
192.168.0.4 RW  /test.img
192.168.0.5 RW  /dev/ad0s1a

I've also wrote some manual pages:
- gg(4),
- geom_gate(4) (exists, but isn't finished yet),
- ggc(8),
- ggd(8).

There are few sysctls that could help in performace and memory consumption
tuning and more to come.

TODO.
Errors handling needs more work.
Maybe UDP (for now transport is done via TCP).
Per-device sysctls created automatically.
Regression tests.
Performance benchmarks.

GEOM Gate is avaliable at:

http://garage.freebsd.pl/geom_gate.tbz
http://garage.freebsd.pl/geom_gate.README

See you all at BSDCon 2003!:)

-- 
Pawel Jakub Dawidek   [EMAIL PROTECTED]
UNIX Systems Programmer/Administrator http://garage.freebsd.pl
Am I Evil? Yes, I Am! http://cerber.sourceforge.net


pgp0.pgp
Description: PGP signature


Re: GEOM Gate.

2003-08-19 Thread Poul-Henning Kamp
In message [EMAIL PROTECTED], Dan Nelson writes:

I think this just demonstrates that you should not run benchmarks with
all your debugging flags enabled :)  Most people will not be running
production systems with WITNESS, and parts of the kernel that bog down
under the heavy load of WITNESS may work just fine on a regular kernal
config.

To quote from src/UPDATING:

] NOTE TO PEOPLE WHO THINK THAT 5.0-CURRENT IS SLOW:
] FreeBSD 5.0-CURRENT has many debugging features turned on, in
] both the kernel and userland.  These features attempt to detect
] incorrect use of system primitives, and encourage loud failure
] through extra sanity checking and fail stop semantics.  They
] also substantially impact system performance.  If you want to
] do performance measurement, benchmarking, and optimization,
] you'll want to turn them off.  This includes various WITNESS-
] related kernel options, INVARIANTS, malloc debugging flags
] in userland, and various verbose features in the kernel.  Many
] developers choose to disable these features on build machines
] to maximize performance.


-- 
Poul-Henning Kamp   | UNIX since Zilog Zeus 3.20
[EMAIL PROTECTED] | TCP/IP since RFC 956
FreeBSD committer   | BSD since 4.3-tahoe
Never attribute to malice what can adequately be explained by incompetence.
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-19 Thread Terry Lambert
Attila Nagy wrote:
 Terry Lambert wrote:
  It works on firewire and it works on a dual port RAID array (as a
  separate box containing the RAID array).
 
 What does 'it' means? I guess it's not UFS, but the pure ability of
 sharing a device on a bus, connected to more than one adapters.

The it was the subject of the previous sentence, which you diked
out; that's how prepositional phrases work in English.  8-).  In
other words, multiple access to the same device from one or more
SCSI controllers.


  SAN and NAS are also options, but of course, you still have to have
  an FS that can deal with it, and an external locking protocol.
 
 Right, we were talking about FreeBSD, which lacks such a filesystem :(

I've said it before, and I'll say it again: porting GFS would be
a really trivial amount of work, taking almost no creativity to do;
the last time this subject came up and Sistina was offering to
change their license, I ported all the user space utilities in under
a day.  I didn't finish off the whole FS port because I lacked the
necessary disk drives and FreeBSD lacked the necessary controller
driver for those disk drives, and the active maintainers claimed
that they had a port in progress.

These types of things are primarily busy-work and a way to spend
money on hardware I'll likely never use in a production environment
to end up with code under a license that prevents me from using it
in a commercial product.  That makes doing the work very uninteresting.

-- Terry
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-17 Thread Poul-Henning Kamp
In message [EMAIL PROTECTED], Pawel Jakub Dawidek writes
:

--X8oaj2qX3NXXvcHN
Content-Type: text/plain; charset=iso-8859-2
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Fri, Aug 15, 2003 at 11:53:11AM -0400, Robert Watson wrote:
+ That said, I think the geom gate stuff looks very cool :-).  You might be
+ able to run some interesting performance numbers comparing NFS and UFS
+ over a remote block device.

Ok. After last geom gate optimizations I'm ready to show some tests.

NFS read:  2539890 bytes/sec
NFS write: 2668428 bytes/sec

GG read file:  5791796 bytes/sec (file was exported)
GG write file: 4071411 bytes/sec (file was exported)

GG read device:4635277 bytes/sec (disk device was exported)
GG write device: I wasn't able to test

Please use /usr/src/tools/tools/ministat to do a proper statistical
benchmark.

-- 
Poul-Henning Kamp   | UNIX since Zilog Zeus 3.20
[EMAIL PROTECTED] | TCP/IP since RFC 956
FreeBSD committer   | BSD since 4.3-tahoe
Never attribute to malice what can adequately be explained by incompetence.
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-17 Thread Attila Nagy
Terry Lambert wrote:
It works on firewire and it works on a dual port RAID array (as a
separate box containing the RAID array).
What does 'it' means? I guess it's not UFS, but the pure ability of 
sharing a device on a bus, connected to more than one adapters.

SAN and NAS are also options, but of course, you still have to have
an FS that can deal with it, and an external locking protocol.
Right, we were talking about FreeBSD, which lacks such a filesystem :(

--
Attila Nagy   e-mail: [EMAIL PROTECTED]
Free Software Network (FSN.HU)   phone @work: +361 210 1415/127
ISOs: http://www.fsn.hu/?f=downloadcell.: +3630 306 6758
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-17 Thread Dan Nelson
In the last episode (Aug 17), Pawel Jakub Dawidek said:
 On Sat, Aug 16, 2003 at 08:50:30PM -0500, Dan Nelson wrote:
 + What kind of hardware were you using?  2.5MB/sec NFS sounds
 + abysmal.
 
 I don't think it is a hardware problem.
 
 Run this test on 5.1-CURRENT with:
 
 options   INVARIANTS
 options   INVARIANT_SUPPORT
 options   WITNESS
 
 and without any network and NFS optimization.

Yes, another test system (P5 MMX/233 laptop) drops its NFS throughput
from 4MB/sec to 2.5MB/sec when built with those flags.  So I'm assuming
you're doing these benchmarks on a comparable system?

I think this just demonstrates that you should not run benchmarks with
all your debugging flags enabled :)  Most people will not be running
production systems with WITNESS, and parts of the kernel that bog down
under the heavy load of WITNESS may work just fine on a regular kernal
config.

-- 
Dan Nelson
[EMAIL PROTECTED]
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-16 Thread Terry Lambert
Attila Nagy wrote:
 Pawel Jakub Dawidek wrote:
  It'll be, but probably in read-write mode on one machine and read-only
  mode on rest machines, because you don't export file systems here, but
  disk devices.
 
 This doesn't work on a shared SCSI bus, so I suspect sharing the device
 on the net won't help.

It works on firewire and it works on a dual port RAID array (as a
separate box containing the RAID array).

It's supposed to work on SCSI III, but the vendors can quit their
arguing and jockey'ing for advantage long enough to approve the
range locking specification (which is why GFS uses a network daemon).

SAN and NAS are also options, but of course, you still have to have
an FS that can deal with it, and an external locking protocol.

-- Terry
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-16 Thread Pawel Jakub Dawidek
On Fri, Aug 15, 2003 at 11:53:11AM -0400, Robert Watson wrote:
+ That said, I think the geom gate stuff looks very cool :-).  You might be
+ able to run some interesting performance numbers comparing NFS and UFS
+ over a remote block device.

Ok. After last geom gate optimizations I'm ready to show some tests.

NFS read:   2539890 bytes/sec
NFS write:  2668428 bytes/sec

GG read file:   5791796 bytes/sec (file was exported)
GG write file:  4071411 bytes/sec (file was exported)

GG read device: 4635277 bytes/sec (disk device was exported)
GG write device: I wasn't able to test

This was tested over 100Mbit/s network without any network tuning.

-- 
Pawel Jakub Dawidek   [EMAIL PROTECTED]
UNIX Systems Programmer/Administrator http://garage.freebsd.pl
Am I Evil? Yes, I Am! http://cerber.sourceforge.net


pgp0.pgp
Description: PGP signature


Re: GEOM Gate.

2003-08-16 Thread Dan Nelson
In the last episode (Aug 17), Pawel Jakub Dawidek said:
 On Fri, Aug 15, 2003 at 11:53:11AM -0400, Robert Watson wrote:
 + That said, I think the geom gate stuff looks very cool :-).  You
 + might be able to run some interesting performance numbers
 + comparing NFS and UFS over a remote block device.
 
 Ok. After last geom gate optimizations I'm ready to show some tests.
 
 NFS read: 2539890 bytes/sec
 NFS write:2668428 bytes/sec
 
 GG read file: 5791796 bytes/sec (file was exported)
 GG write file:4071411 bytes/sec (file was exported)
 
 GG read device:   4635277 bytes/sec (disk device was exported)
 GG write device: I wasn't able to test

What kind of hardware were you using?  2.5MB/sec NFS sounds abysmal. 
You should be able to saturate a 100mbit link with anything made in the
last 5 years.  The slowest machine I have it a P6/200 with FreeBSD 4.1
and this disk:

ad0: 3067MB QUANTUM FIREBALL_TM3200A [6232/16/63] at ata0-master using WDMA2

, which does 7MB/sec raw, can feed a NFS client doing a file read at
5MB/sec.

-- 
Dan Nelson
[EMAIL PROTECTED]
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-16 Thread Pawel Jakub Dawidek
On Sat, Aug 16, 2003 at 08:50:30PM -0500, Dan Nelson wrote:
+ What kind of hardware were you using?  2.5MB/sec NFS sounds abysmal. 

I don't think it is a hardware problem.

Run this test on 5.1-CURRENT with:

options INVARIANTS
options INVARIANT_SUPPORT
options WITNESS

and without any network and NFS optimization.

And this test was:

for write:
% dd if=/dev/zero /mnt/nfs/test bs=128k count=500
for read:
% dd if=/mnt/nfs/test /dev/null bs=128k count=500

-- 
Pawel Jakub Dawidek   [EMAIL PROTECTED]
UNIX Systems Programmer/Administrator http://garage.freebsd.pl
Am I Evil? Yes, I Am! http://cerber.sourceforge.net


pgp0.pgp
Description: PGP signature


Re: GEOM Gate.

2003-08-15 Thread Peter Jeremy
On Thu, Aug 14, 2003 at 10:29:09PM +0200, Pawel Jakub Dawidek wrote:
On Thu, Aug 14, 2003 at 09:52:25PM +0400, Buckie wrote:
+ BTW, QNX had this for a long time, it's called QNet in there. Allows
+ transparently to mount or use anything in /dev. Even a soundcard!

I think this isn't really hard to implement.

I tend to agree.  I've done some background thinking about this in the
past couple of months and couldn't come up with anything especially
difficult - though deeper thought may reveal something.  The logical
implementation is either as a pseudo-filesystem - aka devfs(5) - or
(more cleanly) a portal.

But there are two problems:
1. Device major numbers.

I don't see this as a problem - you do the name to major/minor mapping
on the remote system.  All that goes across the network is the device
name (filename in /dev).  This is the same way that NFS works.  The
device major number is just an easy way for the kernel to map a device
name onto the device-specific functions to access the physical
hardware - this only needs to occur on the server.

2. Handle network errors.

I think the easiest way is just to pass them back to the application.
This does mean that an application would get unexpected network-related
errors, but there's no obvious alternative.

I can think of a third potential problem:  Handling ioctl()s where the
third argument is a pointer to a structure that itself include pointers
to other data objects.  This would require special casing those ioctls.
(Worse would be SysV-style ioctl's which don't comply with the BSD
request encoding).

Peter
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-15 Thread Pawel Jakub Dawidek
On Fri, Aug 15, 2003 at 06:44:14PM +1000, Peter Jeremy wrote:
+ But there are two problems:
+ 1. Device major numbers.
+ 
+ I don't see this as a problem - you do the name to major/minor mapping
+ on the remote system.  All that goes across the network is the device
+ name (filename in /dev).  This is the same way that NFS works.  The
+ device major number is just an easy way for the kernel to map a device
+ name onto the device-specific functions to access the physical
+ hardware - this only needs to occur on the server.

Hmm, I was thinking about something like this:

# devaccess 192.168.0.2 host1
# ls -l /dev/host1
list of devices that was exported on host1

And 'devaccess' command will call some kernel mechanism to create new
devices, but all those devices are defined in this way:

[...]
.d_open =   std_open,
.d_close =  std_close,
.d_ioctl =  std_ioctl,
.d_maj =??
[...]

And std_open()/std_close()/std_ioctl() are functions that only pass
requests to userland daemon, which forwards them to remote host and back.

+ 2. Handle network errors.
+ 
+ I think the easiest way is just to pass them back to the application.
+ This does mean that an application would get unexpected network-related
+ errors, but there's no obvious alternative.

Or translate all of them to EIO.

-- 
Pawel Jakub Dawidek   [EMAIL PROTECTED]
UNIX Systems Programmer/Administrator http://garage.freebsd.pl
Am I Evil? Yes, I Am! http://cerber.sourceforge.net


pgp0.pgp
Description: PGP signature


Re: GEOM Gate.

2003-08-15 Thread Attila Nagy
Bruce M Simpson wrote:
Whatever next? PCI-over-IP?
Collecting cheap on board serial lines to make a big terminal server 
makes sense to me :)

BTW, Pawel's stuff would be even more interesting if it would be 
possible to mount the same filesystem on more than one machines.

--
Attila Nagy   e-mail: [EMAIL PROTECTED]
Free Software Network (FSN.HU)   phone @work: +361 210 1415/127
ISOs: http://www.fsn.hu/?f=downloadcell.: +3630 306 6758
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-15 Thread Pawel Jakub Dawidek
On Thu, Aug 14, 2003 at 09:48:57PM +0200, Attila Nagy wrote:
+ Bruce M Simpson wrote:
+ Whatever next? PCI-over-IP?
+ Collecting cheap on board serial lines to make a big terminal server 
+ makes sense to me :)
+ 
+ BTW, Pawel's stuff would be even more interesting if it would be 
+ possible to mount the same filesystem on more than one machines.

It'll be, but probably in read-write mode on one machine and read-only
mode on rest machines, because you don't export file systems here, but
disk devices.

-- 
Pawel Jakub Dawidek   [EMAIL PROTECTED]
UNIX Systems Programmer/Administrator http://garage.freebsd.pl
Am I Evil? Yes, I Am! http://cerber.sourceforge.net


pgp0.pgp
Description: PGP signature


Re: GEOM Gate.

2003-08-15 Thread Attila Nagy
Pawel Jakub Dawidek wrote:
It'll be, but probably in read-write mode on one machine and read-only
mode on rest machines, because you don't export file systems here, but
disk devices.
This doesn't work on a shared SCSI bus, so I suspect sharing the device 
on the net won't help.

--
Attila Nagy   e-mail: [EMAIL PROTECTED]
Free Software Network (FSN.HU)   phone @work: +361 210 1415/127
ISOs: http://www.fsn.hu/?f=downloadcell.: +3630 306 6758
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-15 Thread Wilko Bulte
On Fri, Aug 15, 2003 at 01:51:03PM +0200, Attila Nagy wrote:
 Pawel Jakub Dawidek wrote:
 It'll be, but probably in read-write mode on one machine and read-only
 mode on rest machines, because you don't export file systems here, but
 disk devices.
 This doesn't work on a shared SCSI bus, so I suspect sharing the device 
 on the net won't help.

TIme to write a cluster filesystem with lock manager..

-- 
|   / o / /_  _ [EMAIL PROTECTED]
|/|/ / / /(  (_)  Bulte 
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-15 Thread Robert Watson

On Fri, 15 Aug 2003, Pawel Jakub Dawidek wrote:

 On Thu, Aug 14, 2003 at 09:48:57PM +0200, Attila Nagy wrote:
 + Bruce M Simpson wrote:
 + Whatever next? PCI-over-IP?
 + Collecting cheap on board serial lines to make a big terminal server 
 + makes sense to me :)
 + 
 + BTW, Pawel's stuff would be even more interesting if it would be 
 + possible to mount the same filesystem on more than one machines.
 
 It'll be, but probably in read-write mode on one machine and read-only
 mode on rest machines, because you don't export file systems here, but
 disk devices. 

In order to do this, you need a file system capable of multi-node
consistency, and a medium capable of supporting the consistency
mechanisms.  Since we can't handle mounting the same file system
read-write and read-only in multiple places from the same block device
without a likely panic, I expect much the same results with a distributed
block device.  Multiple read-only mounts should work OK, but you don't
want to violate the assumptions of the read-only mounts by introducing a
read-write mount.  File systems can be written that do synchronization on
using a protocol of some sort when talking to a common block device, but
that will keep you busy for a while, I expect :-). 

That said, I think the geom gate stuff looks very cool :-).  You might be
able to run some interesting performance numbers comparing NFS and UFS
over a remote block device.

Robert N M Watson FreeBSD Core Team, TrustedBSD Projects
[EMAIL PROTECTED]  Network Associates Laboratories


___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-15 Thread Peter Jeremy
On Fri, Aug 15, 2003 at 11:01:47AM +0200, Pawel Jakub Dawidek wrote:
On Fri, Aug 15, 2003 at 06:44:14PM +1000, Peter Jeremy wrote:
+ But there are two problems:
+ 1. Device major numbers.
+ 
+ I don't see this as a problem - you do the name to major/minor mapping
+ on the remote system.  All that goes across the network is the device
+ name (filename in /dev).  This is the same way that NFS works.  The
+ device major number is just an easy way for the kernel to map a device
+ name onto the device-specific functions to access the physical
+ hardware - this only needs to occur on the server.

Hmm, I was thinking about something like this:

   # devaccess 192.168.0.2 host1
   # ls -l /dev/host1
   list of devices that was exported on host1

And 'devaccess' command will call some kernel mechanism to create new
devices, but all those devices are defined in this way:

   [...]
   .d_open =   std_open,
   .d_close =  std_close,
   .d_ioctl =  std_ioctl,
   .d_maj =??
   [...]

And std_open()/std_close()/std_ioctl() are functions that only pass
requests to userland daemon, which forwards them to remote host and back.

What you've described is a portal.  Have a read of Design and
Implementation of 4.4BSD by McKusick et al for details (my copy is at
work so I can't provide an exact reference).  They are mentioned in
psd/05.sysman and mount_portal(8).  There is a PORTALFS in LINT but
it's described as buggy.

Note that one downside of this approach is that you are adding two
additional userland-kernel transfers for all the data.  If you're
looking at passing serious amounts of data to/from a remote device,
this inefficiency may become noticable.

+ 2. Handle network errors.
+ 
+ I think the easiest way is just to pass them back to the application.
+ This does mean that an application would get unexpected network-related
+ errors, but there's no obvious alternative.

Or translate all of them to EIO.

You probably want to log the real error if you map it to something
else.  The kernel normally will report details of the error when it
returns EIO.

Peter
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-14 Thread Poul-Henning Kamp
In message [EMAIL PROTECTED], Pawel Jakub Dawidek writes
:

--Dx9iWuMxHO1cCoFc
Content-Type: text/plain; charset=iso-8859-2
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

Hello hackers...

I've done something what will be called GEOM Gate.
This software provide disk devices mounting through the network.

COOL

   http://garage.freebsd.pl/geom_gate.tbz

I'll look over it when I have a second.

-- 
Poul-Henning Kamp   | UNIX since Zilog Zeus 3.20
[EMAIL PROTECTED] | TCP/IP since RFC 956
FreeBSD committer   | BSD since 4.3-tahoe
Never attribute to malice what can adequately be explained by incompetence.
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


GEOM Gate.

2003-08-14 Thread Pawel Jakub Dawidek
Hello hackers...

I've done something what will be called GEOM Gate.
This software provide disk devices mounting through the network.

http://garage.freebsd.pl/geom_gate.tbz

Installation is quite trivial:

# tar -jvxf geom_gate.tbz
# cd geom_gate
# make
# make install

For example we got two machine: 'client' and 'server' and we want to mount
device /dev/ad0s1a from 'server' machine on 'client' machine.

server# ggd -f /dev/ad0s1a

client# kldload geom_gate
client# ggc -a -h 'server' -s sizeof(/dev/ad0s1a) -u 5
client# mount /dev/gg5 /mnt/foo

And that's all.

Of course we can also export files and treat them as devices:

server# truncate -s 256M test.img
server# ggd -f ./test.img -p 1234

client# ggc -a -h 'server' -p 1234 -s 256M -u 6
client# newfs -O2 -U /dev/gg6
client# mount /dev/gg6 /mnt/bar

This isn't finished yet, so it also isn't bugs free.
For example don't try to run client and server stuff on this same machine,
this could case a deadlock.

Comments, etc. are of course welcome.

-- 
Pawel Jakub Dawidek   [EMAIL PROTECTED]
UNIX Systems Programmer/Administrator http://garage.freebsd.pl
Am I Evil? Yes, I Am! http://cerber.sourceforge.net


pgp0.pgp
Description: PGP signature


Re: GEOM Gate.

2003-08-14 Thread Buckie
BTW, QNX had this for a long time, it's called QNet in there. Allows
transparently to mount or use anything in /dev. Even a soundcard!

PJD Hello hackers...

PJD I've done something what will be called GEOM Gate.
PJD This software provide disk devices mounting through the network.

PJD http://garage.freebsd.pl/geom_gate.tbz

___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-14 Thread Lars Eggert
Bruce M Simpson wrote:
On Thu, Aug 14, 2003 at 09:52:25PM +0400, Buckie wrote:

BTW, QNX had this for a long time, it's called QNet in there. Allows
transparently to mount or use anything in /dev. Even a soundcard!
Whatever next? PCI-over-IP?
*shudder*
Not new: http://www.isi.edu/div7/netstation/

Lars
--
Lars Eggert [EMAIL PROTECTED]   USC Information Sciences Institute


smime.p7s
Description: S/MIME Cryptographic Signature


Re: GEOM Gate.

2003-08-14 Thread Pawel Jakub Dawidek
On Thu, Aug 14, 2003 at 09:52:25PM +0400, Buckie wrote:
+ BTW, QNX had this for a long time, it's called QNet in there. Allows
+ transparently to mount or use anything in /dev. Even a soundcard!

I think this isn't really hard to implement.

But there are two problems:
1. Device major numbers.
2. Handle network errors.

-- 
Pawel Jakub Dawidek   [EMAIL PROTECTED]
UNIX Systems Programmer/Administrator http://garage.freebsd.pl
Am I Evil? Yes, I Am! http://cerber.sourceforge.net


pgp0.pgp
Description: PGP signature


Re: GEOM Gate.

2003-08-14 Thread Bruce M Simpson
On Thu, Aug 14, 2003 at 09:52:25PM +0400, Buckie wrote:
 BTW, QNX had this for a long time, it's called QNet in there. Allows
 transparently to mount or use anything in /dev. Even a soundcard!

Whatever next? PCI-over-IP?
*shudder*

BMS
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-14 Thread Wilko Bulte
On Thu, Aug 14, 2003 at 01:03:27PM +0200, Pawel Jakub Dawidek wrote:
 Hello hackers...
 
 I've done something what will be called GEOM Gate.
 This software provide disk devices mounting through the network.
 
   http://garage.freebsd.pl/geom_gate.tbz

Cute...! reminds me of RFS on SysV.

W/
-- 
|   / o / /_  _ [EMAIL PROTECTED]
|/|/ / / /(  (_)  Bulte 
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: GEOM Gate.

2003-08-14 Thread neq5
On Thu, Aug 14, 2003 at 01:03:27PM +0200, Pawel Jakub Dawidek wrote:
 This software provide disk devices mounting through the network.

maaan you're amazing. i hope some day you'll write remote terminal emulator.
that would be great. 

-- 
klub milosnikow czeskiego techno
___
[EMAIL PROTECTED] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to [EMAIL PROTECTED]