Re: proxy-defpager for all users?

2018-11-06 Thread Samuel Thibault
Richard Braun, le mar. 06 nov. 2018 11:52:45 +0100, a ecrit:
> On Mon, Nov 05, 2018 at 11:02:47PM +0100, Samuel Thibault wrote:
> > proxy-defpager is typically set on /servers/default-pager, but its
> > permissions are by default 644, which makes it unusable by normal users,
> > it'd need to be 755 (see the x check in the defpager source).
> > 
> > Apart from allowing users to eat memory, which they currently already
> > can do anyway, is there any downside to making this 755 so people can
> > mount their own tmpfs?
> 
> I personally wondered why it wasn't the case from the start.

Most probably because we didn't realize we had to make it +x to make it
usable by users.

Samuel



Re: proxy-defpager for all users?

2018-11-06 Thread Joshua Branson
Richard Braun  writes:

> On Mon, Nov 05, 2018 at 11:02:47PM +0100, Samuel Thibault wrote:
>> proxy-defpager is typically set on /servers/default-pager, but its
>> permissions are by default 644, which makes it unusable by normal users,
>> it'd need to be 755 (see the x check in the defpager source).
>> 
>> Apart from allowing users to eat memory, which they currently already
>> can do anyway, is there any downside to making this 755 so people can
>> mount their own tmpfs?
>
> I personally wondered why it wasn't the case from the start.
>
> That being said, I'll use this as an opportunity to restate a core
> problem of Mach memory management, as I couldn't find it on the wiki.
> This problem may or may not be even more triggered by using unprivileged
> tmpfs instances.

I'll add this information to the wiki in a few days.

>
> Thu Dec 29 2016 :
> < braunr> i've identified a fundamental flaw with the default pager
> < braunr> and actually, with mach in general i suppose
> < braunr> i assumed that it was necessary to trust the server only
> < braunr> that a server didn't need to trust its client
> < braunr> but mach messages carry memory that is potentially mapped from 
> unprivileged pagers
> < braunr> which means faulting on that memory effectively makes the faulting 
> process a client to the unprivileged pager 
> < braunr> and that's something that can happen to the default pager during 
> heavy memory pressure
> < braunr> in which case it deadlocks on itself because the copyout hangs on a 
> fault, waiting for the unprivileged pager to provide the data
> < braunr> (which it can't because of heavy memory pressure and because it's 
> unprivileged, it's blocked, waiting until allocations resume)
> < braunr> the pageout daemon will keep paging out to the default pager in the 
> hope those pages get freed
> < braunr> but sending to the default pager is now impossible because its map 
> is locked on the never-ending fault



Re: proxy-defpager for all users?

2018-11-06 Thread Samuel Thibault
Richard Braun, le mar. 06 nov. 2018 11:52:45 +0100, a ecrit:
> On Mon, Nov 05, 2018 at 11:02:47PM +0100, Samuel Thibault wrote:
> > proxy-defpager is typically set on /servers/default-pager, but its
> > permissions are by default 644, which makes it unusable by normal users,
> > it'd need to be 755 (see the x check in the defpager source).
> > 
> > Apart from allowing users to eat memory, which they currently already
> > can do anyway, is there any downside to making this 755 so people can
> > mount their own tmpfs?
> 
> I personally wondered why it wasn't the case from the start.
> 
> That being said, I'll use this as an opportunity to restate a core
> problem of Mach memory management, as I couldn't find it on the wiki.
> This problem may or may not be even more triggered by using unprivileged
> tmpfs instances.

I actually encountered such an issue with php7.3's shm testing, which
triggers an ext2fs crash due to a tmpfs issue. I'll probably add the
attached patch to the debian package for now, but it seems that the
server side of RPCs needs to be more careful about receiving data when
it's passed out of line.

Samuel
Yes, the pointer provided by the caller, coming from the RPC buffer, may not
actually be safe to dereference. Try this with /run/shm as tmpfs with the crash server configured to dump cores:

#include 
#include 
#include 
#include 
#include 

#define name "/run/shm/test.txt"
int main(void) {
	int fd = open(name, O_RDWR|O_CREAT, 0777);
	if (ftruncate(fd, 4096))
		perror("fruncate");
	char *c = mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_SHARED, fd, 0);
	if (c == MAP_FAILED)
		perror("mmap");
	if (close(fd))
		perror("close");
	if (unlink(name))
		perror("unlink");
	memset(c, 0, 4096);
	if (munmap(c, 4096))
		perror("munmap");

	return 0;
}

It will make *ext2fs* crash, because

- removing a file from tmpfs make its memory object go away, thus making *c
  unwritable (it's not the bug at stake, the program here is meant to crash)
- the crash server uses vm_read to read the process memory to write the
  core. GNU Mach achieves it by playing with virtual memory.
- the crash server uses vm_write to write this to the FS. GNU Mach passes the
  RPC data out of line by playing with virtual memory.
- ext2fs eventually tries to copy from the RPC data, assumed to be safe, to the
  memory object, here backed by the pager. But the data is actually not safe.


That probably needs to be fixed at the mig layer, to make sure incoming
out-of-line data is accessible before handing it to the routine?

Index: hurd-debian/libpager/pager-memcpy.c
===
--- hurd-debian.orig/libpager/pager-memcpy.c
+++ hurd-debian/libpager/pager-memcpy.c
@@ -124,11 +124,14 @@ pager_memcpy (struct pager *pager, memor
 	  __sync_synchronize();
 
 	  if (prot == VM_PROT_READ)
-		memcpy (other, (const void *) window + pageoff, copy_count);
+		err = hurd_safe_copyout (other, (const void *) window + pageoff, copy_count);
 	  else
-		memcpy ((void *) window + pageoff, other, copy_count);
+		err = hurd_safe_copyin ((void *) window + pageoff, other, copy_count);
 	  vm_deallocate (mach_task_self (), window, window_size);
 
+	  if (err)
+		return err;
+	  
 	  offset += copy_count;
 	  other += copy_count;
 	  to_copy -= copy_count;


Re: proxy-defpager for all users?

2018-11-06 Thread Richard Braun
On Mon, Nov 05, 2018 at 11:02:47PM +0100, Samuel Thibault wrote:
> proxy-defpager is typically set on /servers/default-pager, but its
> permissions are by default 644, which makes it unusable by normal users,
> it'd need to be 755 (see the x check in the defpager source).
> 
> Apart from allowing users to eat memory, which they currently already
> can do anyway, is there any downside to making this 755 so people can
> mount their own tmpfs?

I personally wondered why it wasn't the case from the start.

That being said, I'll use this as an opportunity to restate a core
problem of Mach memory management, as I couldn't find it on the wiki.
This problem may or may not be even more triggered by using unprivileged
tmpfs instances.

Thu Dec 29 2016 :
< braunr> i've identified a fundamental flaw with the default pager
< braunr> and actually, with mach in general i suppose
< braunr> i assumed that it was necessary to trust the server only
< braunr> that a server didn't need to trust its client
< braunr> but mach messages carry memory that is potentially mapped from 
unprivileged pagers
< braunr> which means faulting on that memory effectively makes the faulting 
process a client to the unprivileged pager 
< braunr> and that's something that can happen to the default pager during 
heavy memory pressure
< braunr> in which case it deadlocks on itself because the copyout hangs on a 
fault, waiting for the unprivileged pager to provide the data
< braunr> (which it can't because of heavy memory pressure and because it's 
unprivileged, it's blocked, waiting until allocations resume)
< braunr> the pageout daemon will keep paging out to the default pager in the 
hope those pages get freed
< braunr> but sending to the default pager is now impossible because its map is 
locked on the never-ending fault

-- 
Richard Braun



proxy-defpager for all users?

2018-11-05 Thread Samuel Thibault
Hello,

proxy-defpager is typically set on /servers/default-pager, but its
permissions are by default 644, which makes it unusable by normal users,
it'd need to be 755 (see the x check in the defpager source).

Apart from allowing users to eat memory, which they currently already
can do anyway, is there any downside to making this 755 so people can
mount their own tmpfs?

Samuel