Re: [weewx-development] Reportgenerator 'hangs' with vector plot

[Lucas Heijst]

Vince,

The following set of weewx programs runs for years now on my raspberry pi 
2B.
1. Vantage driver
2. Meteostick driver
3. Klimalogg drive4
4. Computer monitor.
The programs run from a memory stick.
The data is written to 4 external mariadb5 databases on my Synology NAS.
The uploaded data is send to my webserver in the Netherlands. 
The FTP speed is about 1 file per second.
My ISP doesn’t offer RSYNC (I know how fast this is on my NASes).
Starting with version 4.0.0b17 I have these slow calculations of vector 
plots.

Luc

On Friday, 3 April 2020 22:56:58 UTC-3, Vince Skahan wrote:
>
> On Friday, April 3, 2020 at 5:24:21 PM UTC-7, Lucas Heijst wrote:
>>
>> I included the syslog this time.
>>
>> I was wrong: the reportgenerator didn't hang, only it is VERY slow
>>
>
>
> I still think you are doing too much (and too frequently)  for your model 
> pi, the SD card, and your network.
>
>
> Generated 73 images for report vproReport in 425.79 seconds
>
> ftpgenerator: Ftp'd 79 files in 89.01 seconds 
>
>
> What's your interval period ?
>
> Just the two items above are over 8.5 minutes for one cycle.
>
>
> Also switching from ftp to rsync will dramatically improve how long it 
> takes to upload things to your remote site.
>
> I continue to suggest turning everything off but the base Seasons report 
> to baseline your system, then turn other things one-at-a-time.
>
> Or get a much better computer to run weewx on, and a much better computer 
> to ftp to.
>

-- 
You received this message because you are subscribed to the Google Groups 
"weewx-development" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to weewx-development+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/weewx-development/3d596c10-5315-48dc-b70a-6008ed6dd31f%40googlegroups.com.

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

[Vince Skahan]

On Friday, April 3, 2020 at 5:24:21 PM UTC-7, Lucas Heijst wrote:
>
> I included the syslog this time.
>
> I was wrong: the reportgenerator didn't hang, only it is VERY slow
>


I still think you are doing too much (and too frequently)  for your model 
pi, the SD card, and your network.


Generated 73 images for report vproReport in 425.79 seconds

ftpgenerator: Ftp'd 79 files in 89.01 seconds 


What's your interval period ?

Just the two items above are over 8.5 minutes for one cycle.


Also switching from ftp to rsync will dramatically improve how long it 
takes to upload things to your remote site.

I continue to suggest turning everything off but the base Seasons report to 
baseline your system, then turn other things one-at-a-time.

Or get a much better computer to run weewx on, and a much better computer 
to ftp to.

-- 
You received this message because you are subscribed to the Google Groups 
"weewx-development" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to weewx-development+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/weewx-development/a8fcb81b-e03a-47a6-81a0-2676969c4a42%40googlegroups.com.

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

[Lucas Heijst]

Tom,

There was not much info in the syslog, thats why I didnt send it.
I included the syslog this time.

I was wrong: the reportgenerator didn't hang, only it is VERY slow

First I generated all other plots: 71 images in 90 seconds
Generated 71 images for report vproReport in 89.58 seconds

Then I added a 6-hour vector plot. Extra time for that 6h plot: 70 seconds
Generated 72 images for report vproReport in 159.32 seconds

Then added a 24-hour vector plot. Extra time for that 24h vector plot 266 
seconds
Generated 73 images for report vproReport in 425.79 seconds

Estimated time for the other vector plots:
week vector plot 31 minutes
month vector plot: 137 minutes
year vector plot: 27 hours

Luc


On Friday, 3 April 2020 20:13:16 UTC-3, Tom Keffer wrote:
>
> Worked fine for me. 
>
> Luc: you know better. We need a log! Perhaps the ReportGenerator is not 
> finishing before the next report is due? Perhaps the program segfaulted? 
> Who knows without a log?
>
> -tk
> [image: image.png]
>
> On Fri, Apr 3, 2020 at 4:09 PM Lucas Heijst  > wrote:
>
>> Currently running weewx 4.0.0b18.
>>
>> The reportgenerator hangs (it never finishes) during calculating of the 
>> section below.
>>
>> [[[hourwindvec]]]
>> windvec
>> plot_type  = vector
>> windgustvec
>> plot_type  = vector
>> aggregate_type = max
>> aggregate_interval = 900# == 15 min
>>
>> Luc
>>
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "weewx-development" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to weewx-de...@googlegroups.com .
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/weewx-development/601f87df-cbe7-482c-bf49-722a7a5de7bd%40googlegroups.com
>>  
>> 
>> .
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"weewx-development" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to weewx-development+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/weewx-development/afee474f-61cb-4c8d-8bfd-5f1c9a18773f%40googlegroups.com.
Apr  3 20:47:12 pi21 vpro[12254] INFO __main__: Initializing weewx version 
4.0.0b18
Apr  3 20:47:12 pi21 vpro[12254] INFO __main__: Using Python 3.7.3 (default, 
Dec 20 2019, 18:57:59) #012[GCC 8.3.0]
Apr  3 20:47:12 pi21 vpro[12254] INFO __main__: Platform 
Linux-4.19.97-v7+-armv7l-with-debian-10.3
Apr  3 20:47:12 pi21 vpro[12254] INFO __main__: Locale is 'en_GB.UTF-8'
Apr  3 20:47:12 pi21 vpro[12254] INFO __main__: PID file is 
/var/run/weewx_vpro.pid
Apr  3 20:47:12 pi21 vpro[12258] INFO __main__: Using configuration file 
/home/weewx/weewx_vpro.conf
Apr  3 20:47:13 pi21 vpro[12258] DEBUG __main__: Initializing engine
Apr  3 20:47:13 pi21 vpro[12258] INFO weewx.engine: Loading station type 
Vantage (user.vantage-312-lh)
Apr  3 20:47:13 pi21 /weewxd: vantage-312-lh: Driver version is 3.1.2
Apr  3 20:47:13 pi21 /weewxd: vantage-312-lh: Opened up serial port /dev/vpro; 
baud 19200; timeout 4.00
Apr  3 20:47:13 pi21 /weewxd: vantage-312-lh: Gentle wake up of console 
successful
Apr  3 20:47:13 pi21 /weewxd: vantage-312-lh: Hardware type is 16
Apr  3 20:47:13 pi21 /weewxd: vantage-312-lh: ISS ID is 2
Apr  3 20:47:13 pi21 /weewxd: vantage-312-lh: Hardware name: Vantage Pro2
Apr  3 20:47:13 pi21 vpro[12258] DEBUG weewx.engine: Loading service 
weewx.engine.StdTimeSynch
Apr  3 20:47:13 pi21 vpro[12258] DEBUG weewx.engine: Finished loading service 
weewx.engine.StdTimeSynch
Apr  3 20:47:13 pi21 vpro[12258] DEBUG weewx.engine: Loading service 
weewx.engine.StdConvert
Apr  3 20:47:13 pi21 vpro[12258] INFO weewx.engine: StdConvert target unit is 
0x10
Apr  3 20:47:13 pi21 vpro[12258] DEBUG weewx.engine: Finished loading service 
weewx.engine.StdConvert
Apr  3 20:47:13 pi21 vpro[12258] DEBUG weewx.engine: Loading service 
weewx.engine.StdCalibrate
Apr  3 20:47:13 pi21 vpro[12258] DEBUG weewx.engine: Finished loading service 
weewx.engine.StdCalibrate
Apr  3 20:47:13 pi21 vpro[12258] DEBUG weewx.engine: Loading service 
weewx.engine.StdQC
Apr  3 20:47:13 pi21 vpro[12258] DEBUG weewx.engine: Finished loading service 
weewx.engine.StdQC
Apr  3 20:47:13 pi21 vpro[12258] DEBUG weewx.engine: Loading service 
weewx.wxservices.StdWXCalculate
Apr  3 20:47:13 pi21 vpro[12258] DEBUG weewx.manager: Daily summary version is 
2.0
Apr  3 20:47:13 pi21 vpro[12258] INFO weewx.wxservices: The following values 
will be calculated: pressure=prefer_hardware, barometer=prefer_hardware, 
altimeter=prefer_hardware, windchill=prefer_hardware, 
heatindex=prefer_hardware, dewpoint=prefer_hardware, 
inDewpoint=prefer_hardware, 

Re: [weewx-development] Reportgenerator 'hangs' with vector plot

[Thomas Keffer]

Worked fine for me.

Luc: you know better. We need a log! Perhaps the ReportGenerator is not
finishing before the next report is due? Perhaps the program segfaulted?
Who knows without a log?

-tk
[image: image.png]

On Fri, Apr 3, 2020 at 4:09 PM Lucas Heijst  wrote:

> Currently running weewx 4.0.0b18.
>
> The reportgenerator hangs (it never finishes) during calculating of the
> section below.
>
> [[[hourwindvec]]]
> windvec
> plot_type  = vector
> windgustvec
> plot_type  = vector
> aggregate_type = max
> aggregate_interval = 900# == 15 min
>
> Luc
>
> --
> You received this message because you are subscribed to the Google Groups
> "weewx-development" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to weewx-development+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/weewx-development/601f87df-cbe7-482c-bf49-722a7a5de7bd%40googlegroups.com
> 
> .
>

-- 
You received this message because you are subscribed to the Google Groups 
"weewx-development" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to weewx-development+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/weewx-development/CAPq0zEAHtjAMtN12TcY8Em%2B-w1_n%3DD%3DSpypXD7wWJ93-haNtRA%40mail.gmail.com.

[weewx-development] Reportgenerator 'hangs' with vector plot

[Lucas Heijst]

Currently running weewx 4.0.0b18.

The reportgenerator hangs (it never finishes) during calculating of the 
section below.

[[[hourwindvec]]]
windvec
plot_type  = vector
windgustvec
plot_type  = vector
aggregate_type = max
aggregate_interval = 900# == 15 min

Luc

-- 
You received this message because you are subscribed to the Google Groups 
"weewx-development" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to weewx-development+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/weewx-development/601f87df-cbe7-482c-bf49-722a7a5de7bd%40googlegroups.com.