> On Nov 9, 2026, at 16:45, green-hand-shandong via ffmpeg-devel
> <[email protected]> wrote:
>
> From: green-hand-shandong
> <[email protected]>
>
> This series adds hardware video acceleration for Huawei Ascend NPUs
> (Atlas 300I-Duo / Ascend 310P, and other DVPP-equipped Ascend SoCs)
> through the open-source CANN runtime (libascendcl), enabled with
> --enable-libascendcl.
Please send a PR on https://code.ffmpeg.org/FFmpeg/FFmpeg.
And split the patch set into smaller ones to make it easier to review.
>
> What is included
> ----------------
>
> Decoders (VDEC): h264_ascend, hevc_ascend (10-bit streams decode to
> NV12; the 10-bit semi-planar output path is rejected by current
> 310P firmware, so those fall back to 8-bit output with a documented
> log). JPEG: jpeg_ascend decoder (JPEGD) and encoder (JPEGE).
> Encoders (VENC): h264_ascend, hevc_ascend with cbr/vbr/avbr/fixqp
> rate control and a zero_copy mode for ASCEND hardware frame input.
> Filters (VPC): scale_ascend, crop_ascend, pad_ascend, overlay_ascend.
> Infrastructure: AV_PIX_FMT_ASCEND, AV_HWDEVICE_TYPE_ASCEND and
> libavutil/hwcontext_ascend.c with a DVPP buffer pool and
> hwdownload/hwupload. device_id=-1 (default) auto-picks the first
> usable device via the runtime.
>
> Why this patchset
> -----------------
>
> Huawei ships the same hardware interface through MindX (mxVision), but
> their FFmpeg extension (MediaCodeV2 in mindsdk-referenceapps) is
> unmaintained and limited to a decode-resize-encode chain; nothing has
> ever been posted to ffmpeg-devel for these devices. This series brings
> the support into the mainline codec/filter/hwcontext abstractions so
> any existing FFmpeg user can use Ascend NPUs with standard CLI syntax.
>
> Testing
> -------
>
> All done on Atlas 300I-Duo (2x Ascend 310P3), CANN 9.1.0, aarch64,
> against this tree:
>
> - Decode matrix (10 cases): H264/H265 ES+MP4, odd sizes, 4K, 10-bit,
> seeks - all PASS; hw decode output MD5-identical to software decode
> - Transcode 1080p->720p full-hardware (decode->scale->encode):
> 748/750 frames, 113 fps after the hwdownload bulk-copy fix, 4 Mbps
> CBR output verified
> - zero_copy vs staged: 55 vs 46 fps on 720p->360p
> - JPEG round trip: encode->decode PSNR 51.8 dB at qfactor 90
> - Overlay: position and chroma verified against software overlay
> - 3x loop long-run (2243 frames): stable, no DVPP memory growth
> - 2 and 4 concurrent processes on one device: complete outputs
>
> Known limitations (documented in code comments)
> -----------------------------------------------
>
> - 310P VPC does not implement rotate/flip (HI_ERR_VPC_NOT_SUPPORT);
> no transpose_ascend is proposed
> - 310P JPEGD emits chroma as a luma replica for 4:2:0 sources; the
> decoder detects this and neutral-grays the chroma with a clear
> warning, so output is a clean grayscale image rather than garbage
> - 310P PNGD crashes in png_get_image_info (driver defect); png_ascend
> is NOT included
> - Some VPC ops require per-thread context binding; handled in each
> filter's thread paths
>
> Maintenance
> -----------
>
> I have the hardware on hand and will maintain these files.
>
> Feedback on the overall shape (especially hwcontext_ascend and the
> zero_copy contract in ascendenc) is welcome before I rework anything
> larger.
>
> green-hand-shandong
>
> green-hand-shandong (16):
> avcodec/ascenddec: add Ascend NPU (CANN DVPP) H.264/H.265 hardware
> decoder
> avcodec/ascenddec: single-pass frame copy and finer get_frame polling
> avcodec/ascenddec: 10-bit decode support (P010 output)
> avutil/hwcontext_ascend: Ascend NPU hardware frame support
> avcodec/ascendenc: Ascend NPU (CANN DVPP) H.264/H.265 hardware encoder
> avfilter/vf_scale_ascend: Ascend NPU VPC hardware scaling filter
> avcodec/ascenddec: tolerate flush reset failure and resume after EOS
> avcodec/ascendjpeg: neutral-gray chroma degradation for JPEGD
> avfilter/vf_crop_ascend, vf_pad_ascend: Ascend NPU VPC crop and
> letterbox
> avfilter/ascend: propagate frame_rate across hw filters
> avcodec/ascendenc: map VENC stream pts back to the original frame pts
> avfilter/vf_overlay_ascend: Ascend NPU VPC hardware overlay filter
> avcodec/ascendenc: zero_copy mode for ASCEND hw frame input
> avcodec/ascend: device_id=-1 auto-picks the first usable device
> avutil/hwcontext_ascend: bulk plane copy in transfer_data_from
> avcodec/ascendjpege: JPEG hardware encoder via CANN JPEGE
>
> configure | 24 +
> libavcodec/Makefile | 7 +
> libavcodec/allcodecs.c | 7 +
> libavcodec/ascenddec.c | 811 ++++++++++++++++++++++++++++++++
> libavcodec/ascendenc.c | 660 ++++++++++++++++++++++++++
> libavcodec/ascendjpeg.c | 568 ++++++++++++++++++++++
> libavcodec/ascendjpege.c | 390 +++++++++++++++
> libavfilter/Makefile | 7 +-
> libavfilter/allfilters.c | 5 +
> libavfilter/vf_crop_ascend.c | 318 +++++++++++++
> libavfilter/vf_overlay_ascend.c | 431 +++++++++++++++++
> libavfilter/vf_pad_ascend.c | 343 ++++++++++++++
> libavfilter/vf_scale_ascend.c | 281 +++++++++++
> libavutil/Makefile | 2 +
> libavutil/hwcontext.c | 4 +
> libavutil/hwcontext.h | 2 +
> libavutil/hwcontext_ascend.c | 441 +++++++++++++++++
> libavutil/hwcontext_ascend.h | 64 +++
> libavutil/hwcontext_internal.h | 1 +
> libavutil/pixdesc.c | 4 +
> libavutil/pixfmt.h | 7 +
> 21 files changed, 4376 insertions(+), 1 deletion(-)
> create mode 100644 libavcodec/ascenddec.c
> create mode 100644 libavcodec/ascendenc.c
> create mode 100644 libavcodec/ascendjpeg.c
> create mode 100644 libavcodec/ascendjpege.c
> create mode 100644 libavfilter/vf_crop_ascend.c
> create mode 100644 libavfilter/vf_overlay_ascend.c
> create mode 100644 libavfilter/vf_pad_ascend.c
> create mode 100644 libavfilter/vf_scale_ascend.c
> create mode 100644 libavutil/hwcontext_ascend.c
> create mode 100644 libavutil/hwcontext_ascend.h
>
> --
> 2.25.1
>
>
> _______________________________________________
> ffmpeg-devel mailing list -- [email protected]
> To unsubscribe send an email to [email protected]
_______________________________________________
ffmpeg-devel mailing list -- [email protected]
To unsubscribe send an email to [email protected]