it’s an 8MB RPi 4B and RAM is abundant, though using μSD card for filesys. the interesting thing is that there are two datasets, one large and one small, and the large one is quick but the small one is orders of magnitude slower. the larger dataset (vp2-originated) gobbles >95% cpu but the smaller dataset (gw1000-originated) <0.3%. it must be something to do with the nature of the data, not the quantity. ⊣ Graham Eddy ⊢
> On 9 Mar 2022, at 12:11 pm, vince <[email protected]> wrote: > > Need some info on which computer(s) you are doing this on. Normally when I > see long run times and low cpu, it's out of RAM or waiting for i/o. What > does something like 'htop' show ? > > Have you tried to split your input data into smaller pieces ? Perhaps try a > year as a test and see if that's still massively slow ? > > > -- > You received this message because you are subscribed to the Google Groups > "weewx-user" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected] > <mailto:[email protected]>. > To view this discussion on the web visit > https://groups.google.com/d/msgid/weewx-user/5e57077d-8e2e-4529-92f9-d70581d3f6cbn%40googlegroups.com > > <https://groups.google.com/d/msgid/weewx-user/5e57077d-8e2e-4529-92f9-d70581d3f6cbn%40googlegroups.com?utm_medium=email&utm_source=footer>. -- You received this message because you are subscribed to the Google Groups "weewx-user" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/weewx-user/76C77D79-5E2D-44C2-8203-F75261F6F7E1%40gmail.com.
