Re: I found a sort bug! - How to sort big files?

2015-06-24 Thread Jan Stary
On Mar 16 11:36:08, o...@drijf.net wrote: On Mon, Mar 16, 2015 at 10:20:07AM +, Stuart Henderson wrote: On 2015-03-15, Todd C. Miller todd.mil...@courtesan.com wrote: On Sat, 14 Mar 2015 12:29:21 -, Stuart Henderson wrote: I think the consensus was to try and replace it with

Re: I found a sort bug! - How to sort big files?

2015-03-17 Thread Steve Litt
On Tue, 17 Mar 2015 08:58:56 +1300 worik worik.stan...@gmail.com wrote: On 16/03/15 06:43, Steve Litt wrote: But IMHO, sorting 60megalines isn't something I would expect a generic sort command to easily and timely do out of the box. I would. These days such files are getting more and

Re: I found a sort bug! - How to sort big files?

2015-03-16 Thread Stuart Henderson
On 2015-03-15, Todd C. Miller todd.mil...@courtesan.com wrote: On Sat, 14 Mar 2015 12:29:21 -, Stuart Henderson wrote: I think the consensus was to try and replace it with another version but not sure what happened. I have a port of the FreeBSD sort but it is slower than our current

Re: I found a sort bug! - How to sort big files?

2015-03-16 Thread Otto Moerbeek
On Mon, Mar 16, 2015 at 10:20:07AM +, Stuart Henderson wrote: On 2015-03-15, Todd C. Miller todd.mil...@courtesan.com wrote: On Sat, 14 Mar 2015 12:29:21 -, Stuart Henderson wrote: I think the consensus was to try and replace it with another version but not sure what happened.

Re: I found a sort bug! - How to sort big files?

2015-03-16 Thread Paul Stoeber
Current sort(1) is unmaintanable in many ways. I say switch. I've seen with gdb that the current sort(1) somehow manages to make radixsort(3) do the work when the sort key is somewhere in the middle of the line. I don't even want to know... (and my reading comprehension of C is too weak to go

Re: I found a sort bug! - How to sort big files?

2015-03-16 Thread worik
On 16/03/15 06:43, Steve Litt wrote: But IMHO, sorting 60megalines isn't something I would expect a generic sort command to easily and timely do out of the box. I would. These days such files are getting more and more common. But there is a warning in the man page for sort under BUGS:

Re: Fwd: Re: I found a sort bug! - How to sort big files?

2015-03-16 Thread Stuart Henderson
On 2015-03-15, sort problem sortprob...@safe-mail.net wrote: So the default sort command is a big pile of shit when it comes to files bigger then 60 MByte? .. lol It's probably not the size, rather the contents of the files.

Fwd: Re: I found a sort bug! - How to sort big files?

2015-03-15 Thread sort problem
.. Original Message From: sort problem sortprob...@safe-mail.net To: andreas.zeilme...@mailbox.org Cc: misc@openbsd.org Subject: Re: I found a sort bug! - How to sort big files? Date: Sat, 14 Mar 2015 08:39:55 -0400 o.m.g. It works. Why doesn't sort uses this by default on files

Re: I found a sort bug! - How to sort big files?

2015-03-15 Thread Kenneth Gober
files compressed if needed... I was suprised... sort is a very old command.. Original Message From: sort problem sortprob...@safe-mail.net To: andreas.zeilme...@mailbox.org Cc: misc@openbsd.org Subject: Re: I found a sort bug! - How to sort big files? Date: Sat, 14 Mar 2015

Re: I found a sort bug! - How to sort big files?

2015-03-15 Thread Steve Litt
On Sun, 15 Mar 2015 09:53:34 -0400 sort problem sortprob...@safe-mail.net wrote: Whoops. At least I thought it helped. The default sort with the -H worked for 132 minutes then said: no space left in /home (that had before the sort command: 111 GBytes FREE). That's not surprising. -H

Re: Fwd: Re: I found a sort bug! - How to sort big files?

2015-03-15 Thread Ted Unangst
sort problem wrote: So the default sort command is a big pile of shit when it comes to files bigger then 60 MByte? .. lol I can send the ~600 MByte txt files compressed if needed... I was suprised... sort is a very old command.. I think you have discovered the answer. :(

Re: I found a sort bug! - How to sort big files?

2015-03-14 Thread Todd C. Miller
On Sat, 14 Mar 2015 12:29:21 -, Stuart Henderson wrote: I think the consensus was to try and replace it with another version but not sure what happened. I have a port of the FreeBSD sort but it is slower than our current sort (and slower than GNU sort). - todd

Re: I found a sort bug! - How to sort big files?

2015-03-14 Thread Stuart Henderson
On 2015-03-14, sort problem sortprob...@safe-mail.net wrote: # sort -u *.txt -o out Segmentation fault (core dumped) There are some known bugs in sort, I ran into a file it couldn't cope with a couple of years ago too, but it doesn't happen all that often. I think the consensus was to try and

Re: I found a sort bug! - How to sort big files?

2015-03-14 Thread Andreas Zeilmeier
On 03/14/15 12:49, sort problem wrote: Hello, -- # uname -a OpenBSD notebook.lan 5.6 GENERIC.MP#333 amd64 # # du -sh small/

Re: I found a sort bug! - How to sort big files?

2015-03-14 Thread sort problem
o.m.g. It works. Why doesn't sort uses this by default on files larger then 60 MByte? Thanks! Original Message From: Andreas Zeilmeier andreas.zeilme...@mailbox.org Apparently from: owner-misc+m147...@openbsd.org To: misc@openbsd.org Subject: Re: I found a sort bug! - How