Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-06 Thread jeremy ardley



On 6/11/23 15:22, Andrew M.A. Cater wrote:
For future readers of the list: I had to search for the meaning of an 
NPU and found this reference helpful - 
https://www.backblaze.com/blog/ai-101-gpu-vs-tpu-vs-npu/ - no further 
opinions as to the company behind it. NPU - Neural Processing Unit - 
chip designed for AI use. 



NPU in this context is not actually the Big G. The leader on small 
system NPU is actually Nvidia and their Jetson product et al. In my case 
Rockchip has added a processor they style an NPU to their newer SOC 
products. What that boils down to is one or more units that can perform 
very fast vector arithmetic operations at various precisions. These can 
be used to process data in neural networks as well as conventional 
signal/image processing.


In my case I have a Rockchip RK3588 that can do 6 TOPS (Tera operations 
per second) using three independent NPU cores. You can use these to do 
neural network work or anything else that vector arithmetic is helpful 
with such as image processing or signal processing.


These NPU units will become more and more common and their use will be 
adapted by many current applications to speed operations for signal and 
image processing. However, at this stage, though they are also be able 
to do Neural Network processing, the really intense NN applications such 
as Large Language Models (e.g. GPT) are probably out of useful reach. 
That stuff is done in the cloud with dedicated NN processors (which may 
be Nvidia based?)




Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-05 Thread Andrew M.A. Cater
On Mon, Nov 06, 2023 at 09:32:05AM +0800, jeremy ardley wrote:
> 
> On 6/11/23 06:26, Andrew M.A. Cater wrote:
> > I think you've hit the curse of almost all ARM single board computers.
> > Almost all are small production runs / out of East Asia somewhere as
> > "prototypes"** with a board support package (BSP) that's probably just
> > the manufacturer's kernel, u-boot and dtbs.
> 
> 
> If that was all it was at, it would be livable.
> 
> But the new series of boards are coming with NPU processors and this
> necessitates using closed source driver component (some parts are open but
> not all)
> 

For future readers of the list: I had to search for the meaning of an NPU and
found this reference helpful - 
https://www.backblaze.com/blog/ai-101-gpu-vs-tpu-vs-npu/ - no further opinions 
as to the company behind it.

NPU - Neural Processing Unit - chip designed for AI use.

> As a corollary many packages have been tweaked to use the proprietary GPU
> and NPU stuff. As a consequence, in my case with a NanoPC-T6, I get on apt
> upgrade
> 
> The following packages have been kept back:
>   ffmpeg ffmpeg-doc ir-keytable libavcodec-dev libavcodec58 libavdevice-dev
> libavdevice58 libavfilter-dev
>   libavfilter7 libavformat-dev libavformat58 libavresample-dev
> libavresample4 libavutil-dev libavutil56
>   libdrm-dev libdvbv5-doc libpostproc-dev libpostproc55 libswresample-dev
> libswresample3 libswscale-dev
>   libswscale5 libv4l-0 libv4l-dev qv4l2 v4l-utils xserver-common
> xserver-xorg-core xserver-xorg-dev
>   xserver-xorg-legacy
> 

I'm unsure what can be done - most of those are audio/video coding programs
and camera support. It might be that the move to Wayland compositing *might*
help with the xorg - or maybe that you don't run X 

The problems continue ...

All the very best, as ever,

Andy
> 



Re: Debian support for ARM SBCs (was: Installing on Radxa Rock Pi 4B using SD-card-images)

2023-11-05 Thread Andrew M.A. Cater
On Sun, Nov 05, 2023 at 06:39:46PM -0500, Stefan Monnier wrote:
> > The way round this is to build u-boot or reverse-enginer the settings then
> > do the same for a kernel, dtb and then debootstrap Debian yourself
> >  - that's exactly the sort of thing that folk do to get their boards 
> > "supported in Debian" - folk like vagrantc and gwolf.
> > Painful isn't in it - there's a reason why there are relatively few
> > boards supported in the SD card images list.
> 
> BTW, do you happen to know of a good resource/URL/mailinglist for that
> specific task, both to find info about supported boards (and *how* they
> are supported) but also in case I want to help add support for the
> boards I happen to have around?
> 
> 

Hi Stefan,

On IRC, there's #debian-arm on OFTC
There's the debian-arm mailing list

Probably some of the regular "State of the ARM" videos at pretty much
every Debconf (now also available on Peertube and YouTube).

It probably doesn't help that the community is small - a chat around
Steve's BBQ in Cambridge every year probably yields world expertise :(
(Sledge, unixsmurf on IRC both worked for ARM for many years, Wookey
still does).

I don't know who vagrantc (Vagrant Cascadian) works/worked for but always
a useful person.

Asking on the Debian resources above is probably as good as any.

All the very best,

Andy 

> Stefan
> 



Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-05 Thread jeremy ardley



On 6/11/23 06:26, Andrew M.A. Cater wrote:
I think you've hit the curse of almost all ARM single board computers. 
Almost all are small production runs / out of East Asia somewhere as 
"prototypes"** with a board support package (BSP) that's probably just 
the manufacturer's kernel, u-boot and dtbs.



If that was all it was at, it would be livable.

But the new series of boards are coming with NPU processors and this 
necessitates using closed source driver component (some parts are open 
but not all)


As a corollary many packages have been tweaked to use the proprietary 
GPU and NPU stuff. As a consequence, in my case with a NanoPC-T6, I get 
on apt upgrade


The following packages have been kept back:
  ffmpeg ffmpeg-doc ir-keytable libavcodec-dev libavcodec58 
libavdevice-dev libavdevice58 libavfilter-dev
  libavfilter7 libavformat-dev libavformat58 libavresample-dev 
libavresample4 libavutil-dev libavutil56
  libdrm-dev libdvbv5-doc libpostproc-dev libpostproc55 
libswresample-dev libswresample3 libswscale-dev
  libswscale5 libv4l-0 libv4l-dev qv4l2 v4l-utils xserver-common 
xserver-xorg-core xserver-xorg-dev

  xserver-xorg-legacy




Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-05 Thread gene heskett

On 11/5/23 17:26, Andrew M.A. Cater wrote:

On Fri, Nov 03, 2023 at 12:22:36PM -0400, Daniel Gnoutcheff wrote:

The best answer is if the board has been supported for a while by
Armbian then that is probably a better choice than a less well
supported/documented manufacturer specific build of Debian.


Oh, I should clarify.  By "official Debian binaries and images" I meant
to say "pure" or "mainline" Debian as distributed from *.debian.org. Yes, a
bespoke "Debian" image from the hardware vendor is, indeed, out of the
question.  ARMbian is better, but I know and deeply trust the Debian project
and would prefer to use their releases over those from a derivative like
ARMbian.



I think you've hit the curse of almost all ARM single board computers.
Almost all are small production runs / out of East Asia somewhere as
"prototypes"** with a board support package (BSP) that's probably just
the manufacturer's kernel, u-boot and dtbs.

** Pine64, I'm looking at you: I have to buy from an EU distributor
to get longer than 30 days support.

With the caveat of almost no upstream support, Armbian will package the BSP
and do their best.

The manufacturer may have their "own" Debian remix but you're on your own
when it comes to adding "official" Debian packages.

The way round this is to build u-boot or reverse-enginer the settings then
do the same for a kernel, dtb and then debootstrap Debian yourself
  - that's exactly the sort of thing that folk do to get their boards
"supported in Debian" - folk like vagrantc and gwolf.
Painful isn't in it - there's a reason why there are relatively few
boards supported in the SD card images list.

This is one of the reasons why only some of the BananaPi variants are
supported - there's a new variant very regularly and the amount of work
needed to get a board supported can be significant. If nobody has that
board, it's going to be hard to get support, for example.
[That's also why I keep asking Gene whether he's running vanilla Debian
or not].


Thanks,
Daniel G.



Good luck with it all

Andy



Actually Armbian is not debian but arm64 ubuntu jammy ATM, however 
bookworm images are also available from the aug-31 spin.
However, video goes away at startx time in the last mint desktop full 
image for 23.8 but still works well for a slightly earlier xfce image 
brought fully up to date. Igor says probably fixed in next spin.  Other 
than that note, it just works with the usual iffy net setup for host 
file users like me.. cli versions for server stuff should just work but 
will get tested in the next week or two.


Debians bookworm for arm64 rpi's is working to run LinuxCNC on my rpi4b.
The kernel is not quite as low latency as my old 4.19 version, but still 
quick enough to do LinuxCNC perfectly.



.


Cheers, Gene Heskett.
--
"There are four boxes to be used in defense of liberty:
 soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author, 1940)
If we desire respect for the law, we must first make the law respectable.
 - Louis D. Brandeis



Debian support for ARM SBCs (was: Installing on Radxa Rock Pi 4B using SD-card-images)

2023-11-05 Thread Stefan Monnier
> The way round this is to build u-boot or reverse-enginer the settings then
> do the same for a kernel, dtb and then debootstrap Debian yourself
>  - that's exactly the sort of thing that folk do to get their boards 
> "supported in Debian" - folk like vagrantc and gwolf.
> Painful isn't in it - there's a reason why there are relatively few
> boards supported in the SD card images list.

BTW, do you happen to know of a good resource/URL/mailinglist for that
specific task, both to find info about supported boards (and *how* they
are supported) but also in case I want to help add support for the
boards I happen to have around?


Stefan



Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-05 Thread Andrew M.A. Cater
On Fri, Nov 03, 2023 at 12:22:36PM -0400, Daniel Gnoutcheff wrote:
> > The best answer is if the board has been supported for a while by
> > Armbian then that is probably a better choice than a less well
> > supported/documented manufacturer specific build of Debian.
> 
> Oh, I should clarify.  By "official Debian binaries and images" I meant
> to say "pure" or "mainline" Debian as distributed from *.debian.org. Yes, a
> bespoke "Debian" image from the hardware vendor is, indeed, out of the
> question.  ARMbian is better, but I know and deeply trust the Debian project
> and would prefer to use their releases over those from a derivative like
> ARMbian.
> 

I think you've hit the curse of almost all ARM single board computers.
Almost all are small production runs / out of East Asia somewhere as
"prototypes"** with a board support package (BSP) that's probably just
the manufacturer's kernel, u-boot and dtbs.

** Pine64, I'm looking at you: I have to buy from an EU distributor
to get longer than 30 days support.

With the caveat of almost no upstream support, Armbian will package the BSP
and do their best.

The manufacturer may have their "own" Debian remix but you're on your own
when it comes to adding "official" Debian packages.

The way round this is to build u-boot or reverse-enginer the settings then
do the same for a kernel, dtb and then debootstrap Debian yourself
 - that's exactly the sort of thing that folk do to get their boards 
"supported in Debian" - folk like vagrantc and gwolf.
Painful isn't in it - there's a reason why there are relatively few
boards supported in the SD card images list.

This is one of the reasons why only some of the BananaPi variants are
supported - there's a new variant very regularly and the amount of work
needed to get a board supported can be significant. If nobody has that
board, it's going to be hard to get support, for example.
[That's also why I keep asking Gene whether he's running vanilla Debian
or not].

> Thanks,
> Daniel G.
>

Good luck with it all

Andy 



Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-04 Thread Nicolas George
jeremy ardley (12023-11-04):
> The problem with pure Debian is it will likely not ever support the extra
> goodies on some SBC.

Indeed, running Debian on this kind of device is not perfect.

But there are problems with running a niche distro too. It would be
idiotic to suggest there is a perfect solution.

So all we have to do is trust that the original poster has made the
cost-benefit analysis according to one's own priorities and not try to
convince otherwise.

Regards,

-- 
  Nicolas George


signature.asc
Description: PGP signature


Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-03 Thread Stefan Monnier
> The problem with pure Debian is it will likely not ever support the extra
> goodies on some SBC. In my case the NPU and GPU which are
> manufacturer specific.

AFAIK for the GPU the situation is usually not that bad (many/most ARM
SoCs use Mali GPUs nowadays and these are fairly well supported under
GNU/Linux).

I'm not familiar with the situation with NPUs but indeed, I wouldn't be
surprised if those aren't usable without SoC-specific proprietary
drivers and blobs :-(

This said, never say never: back when I got my BananaPi, a Free Software
GPU driver for its Mali GPU seemed "impossible", yet that's exactly what
we have now.


Stefan



Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-03 Thread jeremy ardley



On 4/11/23 00:22, Daniel Gnoutcheff wrote:

The best answer is if the board has been supported for a while by
Armbian then that is probably a better choice than a less well
supported/documented manufacturer specific build of Debian.


Oh, I should clarify.  By "official Debian binaries and images" I meant
to say "pure" or "mainline" Debian as distributed from *.debian.org. 
Yes, a bespoke "Debian" image from the hardware vendor is, indeed, out 
of the question.  ARMbian is better, but I know and deeply trust the 
Debian project and would prefer to use their releases over those from 
a derivative like ARMbian. 



The problem with pure Debian is it will likely not ever support the 
extra goodies on some SBC. In my case the NPU and GPU which are 
manufacturer specific.


I have exactly this problem with a NanoPC-T6 which has a RK3588 SOC with 
a 6 TOPS NPU. I run the manufacturer version of Debian and they have 
locked down 20 or 30 packages to use the NPU so I can't upgrade any of them.


The alternative of Armbian is a WIP (work in progress) and pure Debian 
will likely never get in the game.




Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-03 Thread Stefan Monnier
> Oh, I should clarify.  By "official Debian binaries and images" I meant
> to say "pure" or "mainline" Debian as distributed from *.debian.org. Yes,
> a bespoke "Debian" image from the hardware vendor is, indeed, out of the
> question.  ARMbian is better, but I know and deeply trust the Debian project
> and would prefer to use their releases over those from a derivative
> like ARMbian.

Sadly, the way to install a bootloader is not well
standardized on those ARM SBCs, indeed.
What I've done is either:

- learn enough of how the boot works on my machine to manually install
  and configure the bootloader (and keep it configured properly when
  updating the kernel).
- use an existing device-specific image as a basis and then convert it
  to a "real" Debian system (which still requires figuring out to
  update the configuration when the kernel is updating since those
  images are typically completely oblivious to such needs, they seem
  designed under the assumption that those SBCs will be setup once and
  either thrown away a few months later or just left there to bitrot).

The first is the only option in the long run but the second can get you
started more quickly.


Stefan



Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-03 Thread Daniel Gnoutcheff

The best answer is if the board has been supported for a while by
Armbian then that is probably a better choice than a less well
supported/documented manufacturer specific build of Debian.


Oh, I should clarify.  By "official Debian binaries and images" I meant
to say "pure" or "mainline" Debian as distributed from *.debian.org. 
Yes, a bespoke "Debian" image from the hardware vendor is, indeed, out 
of the question.  ARMbian is better, but I know and deeply trust the 
Debian project and would prefer to use their releases over those from a 
derivative like ARMbian.


Thanks,
Daniel G.



Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-02 Thread Nicolas George
y...@vienna.at (12023-11-02):
> > I ear with ARMbian you have to use Docker to build a kernel. That makes
> > a pretty strong “why not ARMbian”.
> No

No what? No Docker is not necessary or no it is not a reason to ditch
armbian?

-- 
  Nicolas George



Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-02 Thread yxcv

On Thu, 2 Nov 2023 08:44:31 +0100
 Nicolas George  wrote:

y...@vienna.at (12023-11-02):

Why not try ARMbian?


I ear with ARMbian you have to use Docker to build a kernel. That 
makes

a pretty strong “why not ARMbian”.

Regards,

--
 Nicolas George


No



Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-02 Thread Nicolas George
y...@vienna.at (12023-11-02):
> Why not try ARMbian?

I ear with ARMbian you have to use Docker to build a kernel. That makes
a pretty strong “why not ARMbian”.

Regards,

-- 
  Nicolas George



Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-01 Thread jeremy ardley



On 2/11/23 08:01, y...@vienna.at wrote:

On Wed, 1 Nov 2023 18:17:24 -0400
 Daniel Gnoutcheff  wrote:
I have a Radxa Rock Pi 4B (an arm64 single-board computer) with a 
(removable) eMMC module.  I'd like to install Debian stable on it, 
and would strongly prefer to use official Debian binaries and images.


I successfully booted debian-installer from eMMC after flashing the 
rock-pi-4-rk3999 SD card image from [1] (using an eMMC-to-microSD 
adapter and following the instructions in 
README.concatenateable_images).  However, I can't find much 
information on how to use the installer on this board once it's 
started.  The Installation Manual [2] doesn't discuss the 
concatenateable images at all and says only that non-UEFI boards 
might need certain unspecified shell commands after install to make 
them bootable.


I tried installing to the eMMC module that the installer itself 
booted from (using guided full-disk partitioning with LVM) with the 
hope that this would at least preserve/re-use the copy of u-boot 
already there. (IIRC this worked for me on other SBCs, but I may have 
been using a different partitioning mode.)  The install finished and 
I rebooted when prompted, but I got nothing -- no response to pings 
and no HDMI output, not even from u-boot.  Same story after a hard 
power-cycle.  I guess u-boot got clobbered after all?


Anybody here know how these installers were meant to be used? Has 
this been documented anywhere?


Thanks,
Daniel G.

[1] 
https://deb.debian.org/debian/dists/bookworm/main/installer-arm64/current/images/netboot/SD-card-images/

[2] https://www.debian.org/releases/stable/arm64/



Why not try ARMbian?



The processor on the OP board is an RK3399 which is well supported in 
Armbian. Though there may be nuances of addons to the board that cause 
minor issues.


The issue with using Debian on the OP board is that the manufacturer has 
issued a modified version of Debian specific to that board and that uses 
sometimes quite complex file overlays as well as modified libraries that 
can't participate in regular Debian package upgrades.


The best answer is if the board has been supported for a while by 
Armbian then that is probably a better choice than a less well 
supported/documented manufacturer specific build of Debian.





Re: Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-01 Thread yxcv

On Wed, 1 Nov 2023 18:17:24 -0400
 Daniel Gnoutcheff  wrote:
I have a Radxa Rock Pi 4B (an arm64 single-board computer) with a 
(removable) eMMC module.  I'd like to install Debian stable on it, 
and would strongly prefer to use official Debian binaries and images.


I successfully booted debian-installer from eMMC after flashing the 
rock-pi-4-rk3999 SD card image from [1] (using an eMMC-to-microSD 
adapter and following the instructions in 
README.concatenateable_images).  However, I can't find much 
information on how to use the installer on this board once it's 
started.  The Installation Manual [2] doesn't discuss the 
concatenateable images at all and says only that non-UEFI boards 
might need certain unspecified shell commands after install to make 
them bootable.


I tried installing to the eMMC module that the installer itself 
booted from (using guided full-disk partitioning with LVM) with the 
hope that this would at least preserve/re-use the copy of u-boot 
already there. (IIRC this worked for me on other SBCs, but I may have 
been using a different partitioning mode.)  The install finished and 
I rebooted when prompted, but I got nothing -- no response to pings 
and no HDMI output, not even from u-boot.  Same story after a hard 
power-cycle.  I guess u-boot got clobbered after all?


Anybody here know how these installers were meant to be used?  Has 
this been documented anywhere?


Thanks,
Daniel G.

[1] 
https://deb.debian.org/debian/dists/bookworm/main/installer-arm64/current/images/netboot/SD-card-images/

[2] https://www.debian.org/releases/stable/arm64/



Why not try ARMbian?



Installing on Radxa Rock Pi 4B using SD-card-images

2023-11-01 Thread Daniel Gnoutcheff
I have a Radxa Rock Pi 4B (an arm64 single-board computer) with a 
(removable) eMMC module.  I'd like to install Debian stable on it, and 
would strongly prefer to use official Debian binaries and images.


I successfully booted debian-installer from eMMC after flashing the 
rock-pi-4-rk3999 SD card image from [1] (using an eMMC-to-microSD 
adapter and following the instructions in 
README.concatenateable_images).  However, I can't find much information 
on how to use the installer on this board once it's started.  The 
Installation Manual [2] doesn't discuss the concatenateable images at 
all and says only that non-UEFI boards might need certain unspecified 
shell commands after install to make them bootable.


I tried installing to the eMMC module that the installer itself booted 
from (using guided full-disk partitioning with LVM) with the hope that 
this would at least preserve/re-use the copy of u-boot already there. 
(IIRC this worked for me on other SBCs, but I may have been using a 
different partitioning mode.)  The install finished and I rebooted when 
prompted, but I got nothing -- no response to pings and no HDMI output, 
not even from u-boot.  Same story after a hard power-cycle.  I guess 
u-boot got clobbered after all?


Anybody here know how these installers were meant to be used?  Has this 
been documented anywhere?


Thanks,
Daniel G.

[1] 
https://deb.debian.org/debian/dists/bookworm/main/installer-arm64/current/images/netboot/SD-card-images/

[2] https://www.debian.org/releases/stable/arm64/