Late last year I posted a thread "[Cin] Prepping HW upgrade options for
AV1 de-/encoding"
https://www.mail-archive.com/[email protected]/msg06626.html
and there have also been other threads about hardware acceleration
So here again, I also wanted to give it a first try with ffmpeg -hwaccel
AV1 QSV encoding.
First some system specifications:
inxi -CGS
System:
Host: localhost.localdomain Kernel: 6.9.4-1-default arch: x86_64
bits: 64
Desktop: GNOME v: 46.2 Distro: openSUSE Tumbleweed-Slowroll 20240605
CPU:
Info: 12-core (8-mt/4-st) model: 12th Gen Intel Core i7-12700KF
bits: 64
type: MST AMCP cache: L2: 12 MiB
Speed (MHz): avg: 800 min/max: 800/4900:5000:3800 cores: 1: 800
2: 800
3: 800 4: 800 5: 800 6: 800 7: 800 8: 800 9: 800 10: 800 11:
800 12: 800
13: 800 14: 800 15: 800 16: 800 17: 800 18: 800 19: 800 20: 800
Graphics:
Device-1: Intel DG2 [Arc A750] driver: i915 v: kernel
Device-2: Microdia Camera driver: snd-usb-audio,uvcvideo type: USB
Display: wayland server: X.org v: 1.21.1.12 with: Xwayland v: 24.1.0
compositor: gnome-shell driver: gpu: i915 resolution:
2560x1440~60Hz
API: OpenGL v: 4.6 vendor: intel mesa v: 24.0.8 renderer: Mesa
Intel Arc
A750 Graphics (DG2)
API: EGL Message: EGL data requires eglinfo. Check --recommends.
ls /dev/dri
by-path card1 renderD128
ffmpeg -hide_banner -hwaccels
Hardware acceleration methods:
vdpau
cuda
vaapi
qsv
drm
vulkan
ffmpeg -hide_banner -h encoder=av1_qsv
Encoder av1_qsv [AV1 (Intel Quick Sync Video acceleration)]:
General capabilities: delay hybrid
Threading capabilities: none
Supported hardware devices: qsv qsv qsv
Supported pixel formats: nv12 p010le qsv
av1_qsv encoder AVOptions:
-async_depth <int> E..V....... Maximum processing
parallelism (from 1 to INT_MAX) (default 4)
-preset <int> E..V....... (from 0 to 7) (default 0)
veryfast 7 E..V.......
faster 6 E..V.......
fast 5 E..V.......
medium 4 E..V.......
slow 3 E..V.......
slower 2 E..V.......
veryslow 1 E..V.......
-forced_idr <boolean> E..V....... Forcing I frames as IDR
frames (default false)
-low_power <boolean> E..V....... enable low power
mode(experimental: many limitations by mfx version, BRC modes, etc.)
(default auto)
-b_strategy <int> E..V....... Strategy to choose between
I/P/B-frames (from -1 to 1) (default -1)
-adaptive_i <int> E..V....... Adaptive I-frame placement
(from -1 to 1) (default -1)
-adaptive_b <int> E..V....... Adaptive B-frame placement
(from -1 to 1) (default -1)
-extbrc <int> E..V....... Extended bitrate control (from
-1 to 1) (default -1)
-low_delay_brc <boolean> E..V....... Allow to strictly obey
avg frame size (default auto)
-max_frame_size <int> E..V....... Maximum encoded frame
size in bytes (from -1 to INT_MAX) (default -1)
-max_frame_size_i <int> E..V....... Maximum encoded I
frame size in bytes (from -1 to INT_MAX) (default -1)
-max_frame_size_p <int> E..V....... Maximum encoded P
frame size in bytes (from -1 to INT_MAX) (default -1)
-profile <int> E..V....... (from 0 to INT_MAX) (default
unknown)
unknown 0 E..V.......
main 1 E..V.......
-tile_cols <int> E..V....... Number of columns for tiled
encoding (from 0 to 65535) (default 0)
-tile_rows <int> E..V....... Number of rows for tiled
encoding (from 0 to 65535) (default 0)
-look_ahead_depth <int> E..V....... Depth of look ahead in
number frames, available when extbrc option is enabled (from 0 to
100) (default 0)
--------------
So far I have not found any detailed user guide for this, so suggestions
are welcome.
I have tried to apply a sample command line from the FFmpeg
wiki:Hardware/QuickSync
https://trac.ffmpeg.org/wiki/Hardware/QuickSync#Transcode
ffmpeg -hwaccel qsv -qsv_device /dev/dri/renderD128 -c:v h264_qsv -i
input.mp4 -c:v h264_qsv output.mp4
I added -preset 4 (medium) from above (which gives much more compression
and smaller file size than with -preset 4 for av1_svt).
This didn't seem to change the file size compression compared with the
defaults (without setting preset)
Some visible artifacts (mosaic and stuttering ) is seen during zoom and
pan in the hdv file; probably due to hard compression and/or the memory
allocation error messages, I would guess.
-------------
In short, I have tested the same SD-DV 576i and HDV 1080i video files as
with SVT-AV1 (CPU based) in another resent post.
ffmpeg -hide_banner -hwaccel qsv -qsv_device /dev/dri/renderD128 -i
dv01_07.dv -c:v av1_qsv -preset 4 dv01_07_av1_qsv_pr4.webm
frame= 2832 fps=2106 q=-0.0 Lsize= 10554KiB time=00:01:53.24
bitrate= 763.5kbits/s speed=84.2x
fmpeg -hide_banner -hwaccel qsv -qsv_device /dev/dri/renderD128 -i
hdv09_04.m2t -c:v av1_qsv -preset 4 hdv09_04.m2t_av1_qsv_pr4.webm
frame= 5913 fps=700 q=-0.0 Lsize= 48022KiB time=00:03:58.77
bitrate=1647.6kbits/s dup=0 drop=4 speed=28.3x
du -sh dv01_07*
389M dv01_07.dv
11M dv01_07_av1_qsv_pr4.webm
24M dv01_07_svt-av1_pr4.webm
27M dv01_07_svt-av1_pr6.webm
28M dv01_07_svt-av1_pr8.webm
31M dv01_07_svt-av1_pr10.webm
33M dv01_07_svt-av1_pr12.webm
du -sh hdv09_04*
745M hdv09_04.m2t
47M hdv09_04.m2t_av1_qsv_pr4.webm
111M hdv09_04_m2t_svt-av1_pr4.webm
119M hdv09_04_m2t_svt-av1_pr6.webm
118M hdv09_04_m2t_svt-av1_pr8.webm
125M hdv09_04_m2t_svt-av1_pr10.webm
134M hdv09_04_m2t_svt-av1_pr12.webm
A warning output in both command lines is:
[vist#0:0/dvvideo @ 0x556a3f679100] WARNING: defaulting
hwaccel_output_format to qsv for compatibility with old
commandlines. This behaviour is DEPRECATED and will be removed in
the future. Please explicitly set "-hwaccel_output_format qsv".
I tried to add this without success, so suggestion is welcome !?
And possibly suggestions regarding the more seriously errors "Cannot
allocate memory" that arised from the second command transcoding the hdv
file?
[mpeg2_qsv @ 0x5596ba3d1500] Failed to allocate a qsv/nv12 frame
from a fixed pool of hardware frames.
[mpeg2_qsv @ 0x5596ba3d1500] Consider setting extra_hw_frames to a
larger value (currently set to 8, giving a pool size of 32).
[mpeg2_qsv @ 0x5596ba3d1500] get_buffer() failed
[vist#0:0/mpeg2video @ 0x5596ba394d00] [dec:mpeg2_qsv @
0x5596ba3921c0] Error submitting packet to decoder: Cannot allocate
memory
[mpeg2_qsv @ 0x5596ba3d1500] get_buffer() failed
[vist#0:0/mpeg2video @ 0x5596ba394d00] [dec:mpeg2_qsv @
0x5596ba3921c0] Error submitting packet to decoder: Cannot allocate
memory
....... skip
[mpegts @ 0x5596ba48c000] PES packet size mismatch0:03:46.20
bitrate=1650.3kbits/s speed=28.3x
[mpegts @ 0x5596ba48c000] Packet corrupt (stream = 1, dts = 258142320).
[mpeg2_qsv @ 0x5596ba3d1500] get_buffer() failed
[vist#0:0/mpeg2video @ 0x5596ba394d00] [dec:mpeg2_qsv @
0x5596ba3921c0] Decoding error: Cannot allocate memory
[mpeg2_qsv @ 0x5596ba3d1500] get_buffer() failed
[vist#0:0/mpeg2video @ 0x5596ba394d00] [dec:mpeg2_qsv @
0x5596ba3921c0] Decoding error: Cannot allocate memory
.......... skip
[mpeg2_qsv @ 0x5596ba3d1500] get_buffer() failed
[mpeg2_qsv @ 0x5596ba3d1500] Too many errors when draining, this is
a bug. Stop draining and force EOF.
[vist#0:0/mpeg2video @ 0x5596ba394d00] [dec:mpeg2_qsv @
0x5596ba3921c0] Decoding error: Internal bug, should not have happened
I attach also the "complete" ffmpeg output FWIW for both files, though
skipping repeated error lines:
ffmpeg -hide_banner -hwaccel qsv -qsv_device /dev/dri/renderD128 -i
dv01_07.dv -c:v av1_qsv -preset 4 dv01_07_av1_qsv_pr4.webm
libva info: VA-API version 1.21.0
libva info: Trying to open /usr/lib64/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_20
libva info: va_openDriver() returns 0
libva info: VA-API version 1.21.0
libva info: Trying to open /usr/lib64/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_20
libva info: va_openDriver() returns 0
[dv @ 0x556a3f643000] Estimating duration from bitrate, this may be
inaccurate
[vist#0:0/dvvideo @ 0x556a3f679100] WARNING: defaulting
hwaccel_output_format to qsv for compatibility with old
commandlines. This behaviour is DEPRECATED and will be removed in
the future. Please explicitly set "-hwaccel_output_format qsv".
Input #0, dv, from 'dv01_07.dv':
Metadata:
timecode : 01:09:35:09
Duration: 00:01:53.28, start: 0.000000, bitrate: 28800 kb/s
Stream #0:0: Video: dvvideo, yuv420p, 720x576 [SAR 16:15 DAR
4:3], 28800 kb/s, 60k fps, 25 tbr, 60k tbn
Stream #0:1: Audio: pcm_s16le, 48000 Hz, stereo, s16, 1536 kb/s
Stream mapping:
Stream #0:0 -> #0:0 (dvvideo (native) -> av1 (av1_qsv))
Stream #0:1 -> #0:1 (pcm_s16le (native) -> opus (libopus))
Press [q] to stop, [?] for help
[libopus @ 0x556a3f656580] No bit rate set. Defaulting to 96000 bps.
[av1_qsv @ 0x556a3f653040] Using the constant quantization parameter
(CQP) by default. Please use the global_quality option and other
options for a quality-based mode or the b option and other options
for a bitrate-based mode if the default is not the desired choice.
Output #0, webm, to 'dv01_07_av1_qsv_pr4.webm':
Metadata:
timecode : 01:09:35:09
encoder : Lavf61.1.100
Stream #0:0: Video: av1, nv12(bottom coded first (swapped)),
720x576 [SAR 16:15 DAR 4:3], q=2-31, 25 fps, 1k tbn
Metadata:
encoder : Lavc61.3.100 av1_qsv
Stream #0:1: Audio: opus, 48000 Hz, stereo, s16, 96 kb/s
Metadata:
encoder : Lavc61.3.100 libopus
[out#0/webm @ 0x556a3f4da5c0] video:9315KiB audio:1186KiB
subtitle:0KiB other streams:0KiB global headers:0KiB muxing
overhead: 0.505196%
frame= 2832 fps=2106 q=-0.0 Lsize= 10554KiB time=00:01:53.24
bitrate= 763.5kbits/s speed=84.2x
------------------
ffmpeg -hide_banner -hwaccel qsv -qsv_device /dev/dri/renderD128 -i
hdv09_04.m2t -c:v av1_qsv -preset 4 hdv09_04.m2t_av1_qsv_pr4.webm
libva info: VA-API version 1.21.0
libva info: Trying to open /usr/lib64/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_20
libva info: va_openDriver() returns 0
libva info: VA-API version 1.21.0
libva info: Trying to open /usr/lib64/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_20
libva info: va_openDriver() returns 0
[mpeg2video @ 0x5596ba391500] Invalid frame dimensions 0x0.
Last message repeated 3 times
[mpegts @ 0x5596ba48c000] PES packet size mismatch
[mpegts @ 0x5596ba48c000] Packet corrupt (stream = 1, dts = 258142320).
[mpegts @ 0x5596ba48c000] Could not find codec parameters for stream
2 (Unknown: none ([160][0][0][0] / 0x00A0)): unknown codec
Consider increasing the value for the 'analyzeduration' (0) and
'probesize' (5000000) options
[mpegts @ 0x5596ba48c000] Could not find codec parameters for stream
3 (Unknown: none ([161][0][0][0] / 0x00A1)): unknown codec
Consider increasing the value for the 'analyzeduration' (0) and
'probesize' (5000000) options
[vist#0:0/mpeg2video @ 0x5596ba394d00] WARNING: defaulting
hwaccel_output_format to qsv for compatibility with old
commandlines. This behaviour is DEPRECATED and will be removed in
the future. Please explicitly set "-hwaccel_output_format qsv".
Input #0, mpegts, from 'hdv09_04.m2t':
Duration: 00:03:59.06, start: 2629.496000, bitrate: 26110 kb/s
Program 100
Stream #0:0[0x810]: Video: mpeg2video (Main) ([2][0][0][0] /
0x0002), yuv420p(tv, bt709, top first), 1440x1080 [SAR 4:3 DAR
16:9], 25000 kb/s, 25 fps, 25 tbr, 90k tbn
Side data:
cpb: bitrate max/min/avg: 25000000/0/0 buffer size: 7340032
vbv_delay: N/A
Stream #0:1[0x814]: Audio: mp2 (mp3float) ([3][0][0][0] /
0x0003), 48000 Hz, stereo, fltp, 384 kb/s
Stream #0:2[0x815]: Unknown: none ([160][0][0][0] / 0x00A0)
Stream #0:3[0x811]: Unknown: none ([161][0][0][0] / 0x00A1)
Stream mapping:
Stream #0:0 -> #0:0 (mpeg2video (mpeg2_qsv) -> av1 (av1_qsv))
Stream #0:1 -> #0:1 (mp2 (native) -> opus (libopus))
Press [q] to stop, [?] for help
[libopus @ 0x5596ba448cc0] No bit rate set. Defaulting to 96000 bps.
[av1_qsv @ 0x5596ba39f1c0] Using the constant quantization parameter
(CQP) by default. Please use the global_quality option and other
options for a quality-based mode or the b option and other options
for a bitrate-based mode if the default is not the desired choice.
Output #0, webm, to 'hdv09_04.m2t_av1_qsv_pr4.webm':
Metadata:
encoder : Lavf61.1.100
Stream #0:0: Video: av1, qsv(tv, bt709, top coded first
(swapped)), 1440x1080 [SAR 4:3 DAR 16:9], q=2-31, 25 fps, 1k tbn
Metadata:
encoder : Lavc61.3.100 av1_qsv
Stream #0:1: Audio: opus, 48000 Hz, stereo, s16, 96 kb/s
Metadata:
encoder : Lavc61.3.100 libopus
[mpeg2_qsv @ 0x5596ba3d1500] Failed to allocate a qsv/nv12 frame
from a fixed pool of hardware frames.
[mpeg2_qsv @ 0x5596ba3d1500] Consider setting extra_hw_frames to a
larger value (currently set to 8, giving a pool size of 32).
[mpeg2_qsv @ 0x5596ba3d1500] get_buffer() failed
[vist#0:0/mpeg2video @ 0x5596ba394d00] [dec:mpeg2_qsv @
0x5596ba3921c0] Error submitting packet to decoder: Cannot allocate
memory
[mpeg2_qsv @ 0x5596ba3d1500] get_buffer() failed
[vist#0:0/mpeg2video @ 0x5596ba394d00] [dec:mpeg2_qsv @
0x5596ba3921c0] Error submitting packet to decoder: Cannot allocate
memory
[mpeg2_qsv @ 0x5596ba3d1500] get_buffer() failed
............skip
[mpegts @ 0x5596ba48c000] PES packet size mismatch0:03:46.20
bitrate=1650.3kbits/s speed=28.3x
[mpegts @ 0x5596ba48c000] Packet corrupt (stream = 1, dts = 258142320).
[mpeg2_qsv @ 0x5596ba3d1500] get_buffer() failed
[vist#0:0/mpeg2video @ 0x5596ba394d00] [dec:mpeg2_qsv @
0x5596ba3921c0] Decoding error: Cannot allocate memory
[mpeg2_qsv @ 0x5596ba3d1500] get_buffer() failed
[vist#0:0/mpeg2video @ 0x5596ba394d00] [dec:mpeg2_qsv @
0x5596ba3921c0] Decoding error: Cannot allocate memory
[mpeg2_qsv @ 0x5596ba3d1500] get_buffer() failed
[vist#0:0/mpeg2video @ 0x5596ba394d00] [dec:mpeg2_qsv @
0x5596ba3921c0] Decoding error: Cannot allocate memory
.......skip
[vist#0:0/mpeg2video @ 0x5596ba394d00] [dec:mpeg2_qsv @
0x5596ba3921c0] Decoding error: Cannot allocate memory
[mpeg2_qsv @ 0x5596ba3d1500] get_buffer() failed
[mpeg2_qsv @ 0x5596ba3d1500] Too many errors when draining, this is
a bug. Stop draining and force EOF.
[vist#0:0/mpeg2video @ 0x5596ba394d00] [dec:mpeg2_qsv @
0x5596ba3921c0] Decoding error: Internal bug, should not have happened
[out#0/webm @ 0x5596ba3cc400] video:45422KiB audio:2490KiB
subtitle:0KiB other streams:0KiB global headers:0KiB muxing
overhead: 0.230717%
frame= 5913 fps=700 q=-0.0 Lsize= 48022KiB time=00:03:58.77
bitrate=1647.6kbits/s dup=0 drop=4 speed=28.3x
--
Cin mailing list
[email protected]
https://lists.cinelerra-gg.org/mailman/listinfo/cin
