New recipe only copies pre-built libraries to rootfs and bitbaked on its own does actually work

Problem starts with do_rootfs as these pre-built libraries are scanned for dependencies and found wanting. 

Error message amd  sequence of events are exactly as described here::

Unfortunately that thread has no answer…

Just to explain why I need this crazy configuration:

Big CMake based project compiled on target hardware with Visual Studio. Some libraries included in project … including libraries the pre-compiled library depends on. 

I know: difficult situation but I inherited this project when its inceptor left the company. 

Here is  the recipe:

SUMMARY = "Add libtorchtrt, dependencies and include files to image"
LICENSE = "CLOSED"

SRC_URI = "file://libtorchtrt.tar.gz"

INSANE_SKIP_${PN} = "ldflags"
INSANE_SKIP_${PN} += "already-stripped"
INSANE_SKIP_${PN} = "file-rdeps"
INHIBIT_PACKAGE_STRIP = "1"
INHIBIT_SYSROOT_STRIP = "1"
SOLIBS = ".so"
FILES_SOLIBSDEV = ""

do_install () {

        install -d ${D}${bindir}
        install -d ${D}${libdir}
        install -d ${D}${includedir}
        install -d ${D}${includedir}/torch_tensorrt/
        install -d ${D}${includedir}/torch_tensorrt/core
        install -d ${D}${includedir}/torch_tensorrt/core/plugins
        install -d ${D}${includedir}/torch_tensorrt/core/plugins/impl
        install -d ${D}${includedir}/torch_tensorrt/core/ir
        install -d ${D}${includedir}/torch_tensorrt/core/util
        install -d ${D}${includedir}/torch_tensorrt/core/util/logging
        install -d ${D}${includedir}/torch_tensorrt/core/lowering
        install -d ${D}${includedir}/torch_tensorrt/core/lowering/passes
        install -d ${D}${includedir}/torch_tensorrt/core/partitioning
        install -d ${D}${includedir}/torch_tensorrt/core/runtime
        install -d ${D}${includedir}/torch_tensorrt/core/conversion
        install -d ${D}${includedir}/torch_tensorrt/core/conversion/evaluators
        install -d ${D}${includedir}/torch_tensorrt/core/conversion/var
        install -d ${D}${includedir}/torch_tensorrt/core/conversion/converters
        install -d ${D}${includedir}/torch_tensorrt/core/conversion/conversionctx
        install -d ${D}${includedir}/torch_tensorrt/core/conversion/tensorcontainer


        install  -m 0755  ${WORKDIR}/torch_tensorrt/bin/* ${D}${bindir}
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/torch_tensorrt.h ${D}${includedir}/torch_tensorrt/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/logging.h ${D}${includedir}/torch_tensorrt/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/ptq.h ${D}${includedir}/torch_tensorrt/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/macros.h ${D}${includedir}/torch_tensorrt/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/plugins/plugins.h ${D}${includedir}/torch_tensorrt/core/plugins/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/plugins/impl/interpolate_plugin.h ${D}${includedir}/torch_tensorrt/core/plugins/impl/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/plugins/impl/normalize_plugin.h ${D}${includedir}/torch_tensorrt/core/plugins/impl/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/ir/ir.h ${D}${includedir}/torch_tensorrt/core/ir/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/util/prelude.h ${D}${includedir}/torch_tensorrt/core/util/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/util/Exception.h ${D}${includedir}/torch_tensorrt/core/util/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/util/logging/TorchTRTLogger.h ${D}${includedir}/torch_tensorrt/core/util/logging/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/util/build_info.h ${D}${includedir}/torch_tensorrt/core/util/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/util/macros.h ${D}${includedir}/torch_tensorrt/core/util/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/util/jit_util.h ${D}${includedir}/torch_tensorrt/core/util/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/util/trt_util.h ${D}${includedir}/torch_tensorrt/core/util/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/lowering/passes/passes.h ${D}${includedir}/torch_tensorrt/core/lowering/passes/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/lowering/lowering.h ${D}${includedir}/torch_tensorrt/core/lowering/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/partitioning/partitioning.h ${D}${includedir}/torch_tensorrt/core/partitioning/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/partitioning/shape_analysis.h ${D}${includedir}/torch_tensorrt/core/partitioning/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/partitioning/PartitionInfo.h ${D}${includedir}/torch_tensorrt/core/partitioning/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/partitioning/SegmentedBlock.h ${D}${includedir}/torch_tensorrt/core/partitioning/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/compiler.h ${D}${includedir}/torch_tensorrt/core/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/runtime/runtime.h ${D}${includedir}/torch_tensorrt/core/runtime/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/conversion/evaluators/evaluators.h ${D}${includedir}/torch_tensorrt/core/conversion/evaluators/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/conversion/var/Var_inl.h ${D}${includedir}/torch_tensorrt/core/conversion/var/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/conversion/var/Var.h ${D}${includedir}/torch_tensorrt/core/conversion/var/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/conversion/converters/Weights.h ${D}${includedir}/torch_tensorrt/core/conversion/converters/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/conversion/converters/converters.h ${D}${includedir}/torch_tensorrt/core/conversion/converters/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/conversion/converters/converter_util.h ${D}${includedir}/torch_tensorrt/core/conversion/converters/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/conversion/conversionctx/ConversionCtx.h ${D}${includedir}/torch_tensorrt/core/conversion/conversionctx/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/conversion/tensorcontainer/TensorContainer.h ${D}${includedir}/torch_tensorrt/core/conversion/tensorcontainer/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/include/torch_tensorrt/core/conversion/conversion.h ${D}${includedir}/torch_tensorrt/core/conversion/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/lib/libtorchtrt_runtime.so ${D}${libdir}/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/lib/libtorchtrt.so ${D}${libdir}/
        install  -m 0755  ${WORKDIR}/torch_tensorrt/lib/libtorchtrt_plugins.so ${D}${libdir}/
}

FILES_${PN} += "${bindir}/* ${libdir}/* ${includedir}/*"



And the do_rootfs errors:

ERROR: specs-dev-image-1.0-r0 do_rootfs: Could not invoke dnf. Command '/home/patrick/workspace/32.6.1-Guidance.Yocto.Tegra/build/tmp/work/guidance_jetson_xavier_nx_specs-poky-linux/specs-dev-image/1.0-r0/recipe-sysroot-native/usr/bin/dnf -v --rpmverbosity=info -y -c /home/patrick/workspace/32.6.1-Guidance.Yocto.Tegra/build/tmp/work/guidance_jetson_xavier_nx_specs-poky-linux/specs-dev-image/1.0-r0/rootfs/etc/dnf/dnf.conf --setopt=reposdir=/home/patrick/workspace/32.6.1-Guidance.Yocto.Tegra/build/tmp/work/guidance_jetson_xavier_nx_specs-poky-linux/specs-dev-image/1.0-r0/rootfs/etc/yum.repos.d --installroot=/home/patrick/workspace/32.6.1-Guidance.Yocto.Tegra/build/tmp/work/guidance_jetson_xavier_nx_specs-poky-linux/specs-dev-image/1.0-r0/rootfs --setopt=logdir=/home/patrick/workspace/32.6.1-Guidance.Yocto.Tegra/build/tmp/work/guidance_jetson_xavier_nx_specs-poky-linux/specs-dev-image/1.0-r0/temp --repofrompath=oe-repo,/home/patrick/workspace/32.6.1-Guidance.Yocto.Tegra/build/tmp/work/guidance_jetson_xavier_nx_specs-poky-linux/specs-dev-image/1.0-r0/oe-rootfs-repo --nogpgcheck install add-user ar0521 base-passwd bc boost boost-dev bzip2 chrony chronyc cmake cuda-samples cuda-symlink cuda-toolkit cudnn docker-compose ethtool ffmpeg gdb gdbserver git gstreamer1.0 gstreamer1.0-plugins-bad gstreamer1.0-plugins-base gstreamer1.0-plugins-good gstreamer1.0-plugins-nvvideo4linux2 gstreamer1.0-plugins-tegra gstreamer1.0-rtsp-server i2c-tools kernel-module-ar0521 kernel-module-inv-mpu6050 kernel-module-inv-mpu6050-spi kernel-module-spidev ldconfig libopencv-core libopencv-imgproc meson nano numactl numactl-dev nvidia-container-runtime nvidia-container-toolkit nvidia-docker openblas opencv opencv-dev opencv-staticdev openssh openssh-sftp-server packagegroup-base-extended packagegroup-core-boot packagegroup-core-sdk packagegroup-core-standalone-sdk-target pkgconfig procps python3-pip rsync run-postinsts shadow sudo tensorrt-core tensorrt-plugins tensorrt-samples torchtrt torchtrt-dev udev-xavier v4l-utils zip locale-base-en-us locale-base-en-gb' returned 1:
DNF version: 4.2.2
cachedir: /home/patrick/workspace/32.6.1-Guidance.Yocto.Tegra/build/tmp/work/guidance_jetson_xavier_nx_specs-poky-linux/specs-dev-image/1.0-r0/rootfs/var/cache/dnf
Added oe-repo repo from /home/patrick/workspace/32.6.1-Guidance.Yocto.Tegra/build/tmp/work/guidance_jetson_xavier_nx_specs-poky-linux/specs-dev-image/1.0-r0/oe-rootfs-repo
repo: using cache for: oe-repo
not found other for:
not found modules for:
not found deltainfo for:
not found updateinfo for:
oe-repo: using metadata from Sat 30 Sep 2023 07:19:27 AM UTC.
No module defaults found
--> Starting dependency resolution
--> Finished dependency resolution
Error:
 Problem 1: conflicting requests
  - nothing provides libc10.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libc10_cuda.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libcaffe2_detectron_ops_gpu.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libcaffe2_module_test_dynamic.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libcaffe2_nvrtc.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libcaffe2_observers.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libtorch.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libtorch_cpu.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libtorch_cuda.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libtorch_global_deps.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
 Problem 2: package torchtrt-dev-1.0.0-r0.aarch64 requires torchtrt = 1.0.0-r0, but none of the providers can be installed
  - conflicting requests
  - nothing provides libc10.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libc10_cuda.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libcaffe2_detectron_ops_gpu.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libcaffe2_module_test_dynamic.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libcaffe2_nvrtc.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libcaffe2_observers.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libtorch.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libtorch_cpu.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libtorch_cuda.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
  - nothing provides libtorch_global_deps.so()(64bit) needed by torchtrt-1.0.0-r0.aarch64
(try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)

ERROR: Logfile of failure stored in: /home/patrick/workspace/32.6.1-Guidance.Yocto.Tegra/build/tmp/work/guidance_jetson_xavier_nx_specs-poky-linux/specs-dev-image/1.0-r0/temp/log.do_rootfs.3555906
ERROR: Task (/home/patrick/workspace/32.6.1-Guidance.Yocto.Tegra/meta-guidance/recipes-core/images/specs-dev-image.bb:do_rootfs) failed with exit code '1'
NOTE: Tasks Summary: Attempted 7230 tasks of which 7224 didn't need to be rerun and 1 failed.

Summary: 1 task failed:
  /home/patrick/workspace/32.6.1-Guidance.Yocto.Tegra/meta-guidance/recipes-core/images/specs-dev-image.bb:do_rootfs
Summary: There was 1 WARNING message shown.
Summary: There was 1 ERROR message shown, returning a non-zero exit code.

==================================

Any help appreciated 

Best regards 


/Patrick
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#61174): https://lists.yoctoproject.org/g/yocto/message/61174
Mute This Topic: https://lists.yoctoproject.org/mt/101672733/21656
Group Owner: [email protected]
Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub 
[[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to