> + int ch;
> + int planar = av_sample_fmt_is_planar(avctx->sample_fmt);
> + int plane_size = frame.nb_samples *
> + av_get_bytes_per_sample(avctx->sample_fmt) *
> + (planar ? 1 : avctx->channels);
> + int data_size = plane_size * (planar ? avctx->channels : 1);
I changed this to:
int ch, plane_size;
int planar = av_sample_fmt_is_planar(avctx->sample_fmt);
int data_size = av_samples_get_buffer_size(&plane_size, avctx->channels,
frame.nb_samples,
avctx->sample_fmt, 1);
I didn't want to resend the whole huge patch.
-Justin
_______________________________________________
libav-devel mailing list
[email protected]
https://lists.libav.org/mailman/listinfo/libav-devel
