On Fri, Jan 23, 2015 at 2:53 PM, Ingo Schwarze <schwa...@usta.de> wrote:

> Hi Predrag,
>
> Predrag Punosevac wrote on Fri, Jan 23, 2015 at 03:24:00PM -0500:
>
> > I was following this discussion with the great interest but without
> > intend to participate in it until today.
> >
> > Namely one of my OpenBSD servers (5.6 sparc64) runs Mollify and last
> > night I received an e-mail from an angry user who could not upload files
> > (the upload will fail or upload the file with file size zero). After
> > running df I noticed that /tmp was 100% full (4GB used) but the size of
> > individual files was only 12Kb.
>
> That is unlikely to be due to softdep.  The usual reason for a file
> system to be actually full and seemingly almost empty at the same
> time is somebody doing the following sequence of operations:
>
>  - open(2) a file for writing
>  - writing a lot of data until the file system is full
>  - unlink(2) the file
>  - keep the process running that open(2)'ed it
>  - let that process keep the file open and *not* close(2) it
>
> Specifically, in /tmp, anybody can do that.
>
> > I thought for a second and I remember seeing this with HAMMER on DF.
>
> The above works with almost any file system.
>
> > Long story short I checked /etc/fstab and
> > sure enough I had rw,softdep next to each partition including tmp. I
> > removed softdep rebooted the sytem and /tmp usage dropped to 0%.
>
> That's not likely to be related to softdep either.  Chances are
> just rebooting would have solved the issue as well - simply because
> rebooting terminates all running processes, and consequently closes
> all open files.
>

One more point to add to Ingo's detailed and very helpful reply. Reboot
actually clears /tmp.


>
> What you should have done instead was run fstat(1), look for processes
> having files open in /tmp, use ls(1) -iRa /tmp to find the inode
> numbers of linked files in /tmp, and kill the processes having files
> open that were *not* linked until you found the one having the big
> file open - and then have a friendly talk with the responsible user,
> if any, or figure out what went wrong in case some daemon process
> caused the issue.
>
> > My questions is which partitions should be mounted with softdep
> > option?
>
> I'm not an expert on that and hardly ever use softdep, but i'd say
> on file systems where file create/delete performance is *critically*
> important, performace has been clearly demonstrated to be insufficient
> without softdep, and you consider data loss harmless.
>
> > Is there a way to prune metadata which will save me for problems like
> > the one I encountered last night.
>
> I'm not convinced that's a good question to ask.
>
> Yours,
>   Ingo

Reply via email to