[Qemu-devel] [PATCH] vnc: segmentation fault caused by incorrect 'bytes' count calculated in tight_compress_data()

2011-03-21 Thread Ulrich Obergfell
tight_compress_data() calculates an incorrect 'bytes' count if 'zstream-total_out' is greater than 0x7fff, because the type of the variable 'previous_out' is 'int'. 852 int previous_out; : 872 previous_out = zstream-total_out; : 881 bytes = zstream-total_out

Re: [Qemu-devel] [PATCH] vnc: segmentation fault caused by incorrect 'bytes' count calculated in tight_compress_data()

2011-03-21 Thread Corentin Chary
On Mon, Mar 21, 2011 at 8:48 AM, Ulrich Obergfell uober...@redhat.com wrote: tight_compress_data() calculates an incorrect 'bytes' count if 'zstream-total_out' is greater than 0x7fff, because the type of the variable 'previous_out' is 'int'.    852     int previous_out;     :    872    

Re: [Qemu-devel] [PATCH] vnc: segmentation fault caused by incorrect 'bytes' count calculated in tight_compress_data()

2011-03-21 Thread Ulrich Obergfell
Hi Ulrich, Looks a lot like vnc: tight: Fix crash after 2GB of output, right ? -- Corentin Chary http://xf.iksaif.net Hi Corentin, yes, this appears to be the same issue as: http://lists.gnu.org/archive/html/qemu-devel/2011-03/msg02044.html You posted your patch only a few minutes