No joy
I tried reuse_ssl = True here:
# To upload files from something other than what HTML_ROOT is set
# to above, specify a different HTML_ROOT here.
#HTML_ROOT = /var/www/html/weewx
reuse_ssl = True
# Most FTP servers use port 21
port = 21
# Set to 1 to use passive mode, zero for active mode
passive = 1
And closer to the bottom of the FTP section.
Jan 17 23:50:27 pi-weather weewx[429] DEBUG weewx.reportengine: Found
configuration file /etc/weewx/skins/Ftp/skin.conf for report 'FTP'
Jan 17 23:50:28 pi-weather weewx[429] DEBUG weeutil.ftpupload: Attempting
connection to www.cliffandbuster.com
Jan 17 23:50:33 pi-weather weewx[429] DEBUG weeutil.ftpupload: Connected to
www.cliffandbuster.com
Jan 17 23:50:33 pi-weather weewx[429] ERROR weeutil.ftpupload: Failed
uploading /var/www/html/weewx/yearradiation.png to server
www.cliffandbuster.com. Reason: '229 Extended Passive Mode Entered
(|||50223|)'
Jan 17 23:50:33 pi-weather weewx[429] ERROR weewx.reportengine:
ftpgenerator: (0): caught exception '<class 'ftplib.error_reply'>': 229
Extended Passive Mode Entered (|||50223|)
Jan 17 23:50:33 pi-weather weewx[429] ERROR weewx.reportengine:
**** Traceback (most recent call last):
Jan 17 23:50:33 pi-weather weewx[429] ERROR weewx.reportengine:
**** File "/usr/share/weewx/weewx/reportengine.py", line 331, in run
Jan 17 23:50:33 pi-weather weewx[429] ERROR weewx.reportengine:
**** n = ftp_data.run()
Jan 17 23:50:33 pi-weather weewx[429] ERROR weewx.reportengine:
**** File "/usr/share/weewx/weeutil/ftpupload.py", line 163, in run
Jan 17 23:50:33 pi-weather weewx[429] ERROR weewx.reportengine:
**** ftp_server.storbinary(stor_cmd, fd)
Jan 17 23:50:33 pi-weather weewx[429] ERROR weewx.reportengine:
**** File "/usr/lib/python3.7/ftplib.py", line 504, in storbinary
Jan 17 23:50:33 pi-weather weewx[429] ERROR weewx.reportengine:
**** with self.transfercmd(cmd, rest) as conn:
Jan 17 23:50:33 pi-weather weewx[429] ERROR weewx.reportengine:
**** File "/usr/lib/python3.7/ftplib.py", line 399, in transfercmd
On Monday, January 18, 2021 at 5:46:12 PM UTC-6 [email protected] wrote:
> [Rich sent me his credentials via a private email.]
>
> As soon as I tried FTP to Rich's server, I recognized the problem. The
> server is using Pure-FTPd, which reuses SSL connections. The Python library
> has a bug
> <https://stackoverflow.com/questions/46633536/getting-a-oserror-when-trying-to-list-ftp-directories-in-python/53456626>
>
> that prevents this. WeeWX V4.1.0 and greater have a workaround for the bug.
> To activate, add option reuse_ssl and set it to true.
>
> [[FTP]]
> ...
> reuse_ssl = True
>
> See if that helps.
>
> -tk
>
> On Mon, Jan 18, 2021 at 9:39 AM Rich Strle <[email protected]> wrote:
>
>> Status: Resolving address of www.cliffandbuster.com
>> Status: Connecting to 107.180.51.77:21...
>> Status: Connection established, waiting for welcome message...
>> Status: Initializing TLS...
>> Status: Verifying certificate...
>> Status: TLS connection established.
>> Status: Logged in
>> Status: Retrieving directory listing of "/"...
>> Status: Directory listing of "/" successful
>> Status: Resolving address of www.cliffandbuster.com
>> Status: Connecting to 107.180.51.77:21...
>> Status: Connection established, waiting for welcome message...
>> Status: Initializing TLS...
>> Status: Verifying certificate...
>> Status: TLS connection established.
>> Status: Logged in
>> Status: Starting upload of /var/www/html/weewx/image.jpg
>> Status: File transfer successful, transferred 49,150 bytes in 1 second
>> Status: Retrieving directory listing of "/"...
>> Status: Directory listing of "/" successful
>>
>> I disconnected and reconnected. Does filezilla trust the site now so
>> we're not seeing all of the connection comments?
>>
>> On Monday, January 18, 2021 at 10:37:24 AM UTC-6 [email protected] wrote:
>>
>>> That's pretty much what I'm thinking, but I'm trying to get the evidence
>>> from Filezilla. It should say that as it negotiates with the server.
>>>
>>> FTP is 40 year old technology. It's amazing that there are still so many
>>> incompatible versions out there.
>>>
>>> On Mon, Jan 18, 2021 at 8:34 AM Les Niles <[email protected]> wrote:
>>>
>>>> The server is responding to the PASV command by entering extended
>>>> passive mode EPSV, which apparently is a legal response but which
>>>> weewx/ftplib is not handling correctly. (I don’t have access to the code
>>>> right now so can’t be more precise about where to fix.) The difference is
>>>> that in EPSV mode the server doesn’t return an IP, just a port number.
>>>> (The
>>>> line “host, port = self.makepasv()” is not going to work.)
>>>>
>>>> Apparently passive mode has been the default for ftplib since python
>>>> 2.1, so maybe just skip trying to change to PASV entirely?
>>>>
>>>> -Les
>>>>
>>>>
>>>> On Jan 18, 2021, at 7:21 AM, Rich Strle <[email protected]> wrote:
>>>>
>>>>
>>>> Command: TYPE I
>>>> Trace: CFtpControlSocket::OnReceive()
>>>> Response: 200 TYPE is now 8-bit binary
>>>> Trace: CFtpRawTransferOpData::ParseResponse() in state 1
>>>> Trace: CControlSocket::SendNextCommand()
>>>> Trace: CFtpRawTransferOpData::Send() in state 2
>>>> Command: PASV
>>>> Trace: CFtpControlSocket::OnReceive()
>>>> Response: 200 TYPE is now 8-bit binary
>>>> Trace: CFtpRawTransferOpData::ParseResponse() in state 1
>>>> Trace: CControlSocket::SendNextCommand()
>>>> Trace: CFtpRawTransferOpData::Send() in state 2
>>>> Command: PASV
>>>> Trace: CFtpControlSocket::OnReceive()
>>>> Response: 227 Entering Passive Mode (107,180,51,77,196,142)
>>>> Trace: CFtpRawTransferOpData::ParseResponse() in state 2
>>>> Trace: CControlSocket::SendNextCommand()
>>>> Trace: CFtpRawTransferOpData::Send() in state 4
>>>> Trace: Binding data connection source IP to control connection source
>>>> IP 192.168.12.117
>>>> Command: STOR yearbarometer.png
>>>> Trace: CTransferSocket::OnConnect
>>>> Trace: CTlsSocketImpl::Handshake()
>>>> Trace: Trying to resume existing TLS session.
>>>> Trace: CTlsSocketImpl::ContinueHandshake()
>>>> Trace: CFtpControlSocket::OnReceive()
>>>> Response: 227 Entering Passive Mode (107,180,51,77,197,217)
>>>> Trace: CFtpRawTransferOpData::ParseResponse() in state 2
>>>> Trace: CControlSocket::SendNextCommand()
>>>> Trace: CFtpRawTransferOpData::Send() in state 4
>>>> Trace: Binding data connection source IP to control connection source
>>>> IP 192.168.12.117
>>>> Command: STOR yearhilow.png
>>>>
>>>> On Monday, January 18, 2021 at 7:16:26 AM UTC-6 [email protected] wrote:
>>>>
>>>>> Good to hear that Filezilla is working. We can use it to understand
>>>>> what the server is doing.
>>>>>
>>>>> Using Filezilla, go into its "Settings" (under the "Edit" menu). Then
>>>>> the "Debug" tab. There's a drop down list of message levels. Default is
>>>>> "0
>>>>> - None". Set it to "3- Verbose". Then click "OK".
>>>>>
>>>>> [image: image.png]
>>>>>
>>>>> Then use Filezilla again to transfer some files. This time, watch the
>>>>> window at top that tells you what Filezilla is doing. See if the client
>>>>> (Filezilla, in this case) is negotiating with the server. Tell us what
>>>>> you
>>>>> see, or, better, copy and paste it into a post.
>>>>>
>>>>>
>>>>>
>>>>> On Sun, Jan 17, 2021 at 7:33 PM Rich Strle <[email protected]> wrote:
>>>>>
>>>>>> Jan 17 21:30:44 pi-weather weewx[429] ERROR weeutil.ftpupload: Failed
>>>>>> uploading /var/www/html/weewx/yearradiation.png to server
>>>>>> www.cliffandbuster.com. Reason: '229 Extended Passive Mode Entered
>>>>>> (|||50458|)'
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> ftpgenerator: (2): caught exception '<class 'ftplib.error_reply'>': 229
>>>>>> Extended Passive Mode Entered (|||50458|)
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** Traceback (most recent call last):
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** File "/usr/share/weewx/weewx/reportengine.py", line 331, in
>>>>>> run
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** n = ftp_data.run()
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** File "/usr/share/weewx/weeutil/ftpupload.py", line 163, in run
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** ftp_server.storbinary(stor_cmd, fd)
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** File "/usr/lib/python3.7/ftplib.py", line 504, in storbinary
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** with self.transfercmd(cmd, rest) as conn:
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** File "/usr/lib/python3.7/ftplib.py", line 399, in transfercmd
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** return self.ntransfercmd(cmd, rest)[0]
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** File "/usr/lib/python3.7/ftplib.py", line 359, in ntransfercmd
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** host, port = self.makepasv()
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** File "/usr/lib/python3.7/ftplib.py", line 337, in makepasv
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** host, port = parse227(self.sendcmd('PASV'))
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** File "/usr/lib/python3.7/ftplib.py", line 845, in parse227
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** raise error_reply(resp)
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] ERROR weewx.reportengine:
>>>>>> **** ftplib.error_reply: 229 Extended Passive Mode Entered
>>>>>> (|||50458|)
>>>>>> Jan 17 21:30:45 pi-weather weewx[429] DEBUG weewx.reportengine:
>>>>>> Report 'RSYNC' not enabled. Skipping.
>>>>>>
>>>>>>
>>>>>> On Sunday, January 17, 2021 at 9:28:38 PM UTC-6 Rich Strle wrote:
>>>>>>
>>>>>>> I installed FileZilla and was able to use the same user name and
>>>>>>> password to upload files from /var/www/html/weewx/ to the same spot on
>>>>>>> my
>>>>>>> webserver. I did get an error message Hostname does not match
>>>>>>> certificate
>>>>>>> but I've gotten that before...
>>>>>>>
>>>>>>> On Sunday, January 17, 2021 at 7:24:45 PM UTC-6 [email protected]
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Can you FTP using Filezilla? The goal here is to see if it's some
>>>>>>>> firewall / network/ provider issue, or a problem peculiar to the
>>>>>>>> Python FTP
>>>>>>>> library.
>>>>>>>>
>>>>>>>> On Sun, Jan 17, 2021 at 10:04 AM Rich Strle <[email protected]>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> My bad, the ftp in whew still doesn't work. The Access Point only
>>>>>>>>> has an IPv6 number listed, it doesn't have an IPv4 number listed. My
>>>>>>>>> website provider only allows 1 sftp account at the root level and I
>>>>>>>>> was
>>>>>>>>> trying to avoid using that.
>>>>>>>>>
>>>>>>>>> On Sunday, January 17, 2021 at 11:41:18 AM UTC-6 Rich Strle wrote:
>>>>>>>>>
>>>>>>>>>> I spoke with t-mobile again. They didn't say they did anything
>>>>>>>>>> but all of a sudden ftp started working. I will continue to monitor.
>>>>>>>>>>
>>>>>>>>>> On Sunday, January 17, 2021 at 10:50:19 AM UTC-6 galfert wrote:
>>>>>>>>>>
>>>>>>>>>>> Anyone care to google "T-Mobile FTP" ???? You'll see that this
>>>>>>>>>>> is an issue for everyone! My recommendation is to try to instead
>>>>>>>>>>> use SFTP.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Sunday, January 17, 2021 at 11:41:25 AM UTC-5 Rich Strle
>>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> I did as instructed. Attached is the log file after I made the
>>>>>>>>>>>> change. I have a call into my provider to see if they are IPV6.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On Sunday, January 17, 2021 at 10:17:33 AM UTC-6
>>>>>>>>>>>> [email protected] wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> You definitely want passive mode (passive=1).
>>>>>>>>>>>>>
>>>>>>>>>>>>> Two things:
>>>>>>>>>>>>>
>>>>>>>>>>>>> 1. By any chance, is your new provider using IPV6 (instead of
>>>>>>>>>>>>> the traditional IPV4)?
>>>>>>>>>>>>>
>>>>>>>>>>>>> 2. Set debug=2 in weewx.conf, then retry. This will put lots
>>>>>>>>>>>>> of information in the log about what FTP is doing.
>>>>>>>>>>>>>
>>>>>>>>>>>>> -tk
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Sun, Jan 17, 2021 at 7:46 AM Rich Strle <[email protected]>
>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks for your response David but that didn't fix my issue.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> It was set at 1. I stopped the weewx process, set the ftp to
>>>>>>>>>>>>>> 0, restarted weewx and it did not help. I changed it back to 1.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Sunday, January 17, 2021 at 6:21:02 AM UTC-6
>>>>>>>>>>>>>> [email protected] wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Check out http://weewx.com/docs/usersguide.htm#config_FTP and
>>>>>>>>>>>>>>> look to add/adjust the passive setting in your weewx.conf
>>>>>>>>>>>>>>> config.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> David
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Saturday, January 16, 2021 at 10:11:56 PM UTC-5 Rich
>>>>>>>>>>>>>>> Strle wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I changed out my internet provider to t-mobile home
>>>>>>>>>>>>>>>> internet service and now I'm getting ftp errors. I tried
>>>>>>>>>>>>>>>> connecting to the
>>>>>>>>>>>>>>>> ftp from another computer and that worked. When my raspberry
>>>>>>>>>>>>>>>> pi tries to
>>>>>>>>>>>>>>>> connect I get errors. This was working fine before I switched
>>>>>>>>>>>>>>>> providers.
>>>>>>>>>>>>>>>> Any ideas?
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Jan 16 21:01:25 pi-weather weewx[30706] DEBUG
>>>>>>>>>>>>>>>> weeutil.ftpupload: Attempting connection to
>>>>>>>>>>>>>>>> www.cliffandbuster.com
>>>>>>>>>>>>>>>> Jan 16 21:01:26 pi-weather weewx[30706] DEBUG
>>>>>>>>>>>>>>>> weeutil.ftpupload: Connected to www.cliffandbuster.com
>>>>>>>>>>>>>>>> Jan 16 21:01:26 pi-weather weewx[30706] ERROR
>>>>>>>>>>>>>>>> weeutil.ftpupload: Failed uploading
>>>>>>>>>>>>>>>> /var/www/html/weewx/seasons.css to
>>>>>>>>>>>>>>>> server www.cliffandbuster.com. Reason: '229 Extended
>>>>>>>>>>>>>>>> Passive Mode Entered (|||50207|)'
>>>>>>>>>>>>>>>> Jan 16 21:01:27 pi-weather weewx[30706] ERROR
>>>>>>>>>>>>>>>> weewx.reportengine: ftpgenerator: (1): caught exception
>>>>>>>>>>>>>>>> '<class
>>>>>>>>>>>>>>>> 'ftplib.error_reply'>': 229 Extended Passive Mode Entered
>>>>>>>>>>>>>>>> (|||50207|)
>>>>>>>>>>>>>>>> Jan 16 21:01:27 pi-weather weewx[30706] ERROR
>>>>>>>>>>>>>>>> weewx.reportengine: **** Traceback (most recent call
>>>>>>>>>>>>>>>> last):
>>>>>>>>>>>>>>>> Jan 16 21:01:27 pi-weather weewx[30706] ERROR
>>>>>>>>>>>>>>>> weewx.reportengine: **** File
>>>>>>>>>>>>>>>> "/usr/share/weewx/weewx/reportengine.py", line 331, in run
>>>>>>>>>>>>>>>> Jan 16 21:01:27 pi-weather weewx[30706] ERROR
>>>>>>>>>>>>>>>> weewx.reportengine: **** n = ftp_data.run()
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> You received this message because you are subscribed to the
>>>>>>>>>>>>>> Google Groups "weewx-user" group.
>>>>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from
>>>>>>>>>>>>>> it, send an email to [email protected].
>>>>>>>>>>>>>> To view this discussion on the web visit
>>>>>>>>>>>>>> https://groups.google.com/d/msgid/weewx-user/ba3b1d83-b48b-4578-b7a5-85b3fe2e4fden%40googlegroups.com
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> <https://groups.google.com/d/msgid/weewx-user/ba3b1d83-b48b-4578-b7a5-85b3fe2e4fden%40googlegroups.com?utm_medium=email&utm_source=footer>
>>>>>>>>>>>>>> .
>>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>> You received this message because you are subscribed to the Google
>>>>>>>>> Groups "weewx-user" group.
>>>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>>>> send an email to [email protected].
>>>>>>>>>
>>>>>>>> To view this discussion on the web visit
>>>>>>>>> https://groups.google.com/d/msgid/weewx-user/08999a97-41a4-4436-b59d-2f8793532fb6n%40googlegroups.com
>>>>>>>>>
>>>>>>>>> <https://groups.google.com/d/msgid/weewx-user/08999a97-41a4-4436-b59d-2f8793532fb6n%40googlegroups.com?utm_medium=email&utm_source=footer>
>>>>>>>>> .
>>>>>>>>>
>>>>>>>> --
>>>>>> You received this message because you are subscribed to the Google
>>>>>> Groups "weewx-user" group.
>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>> send an email to [email protected].
>>>>>>
>>>>> To view this discussion on the web visit
>>>>>> https://groups.google.com/d/msgid/weewx-user/74ddbc8e-2a66-4ff4-b7d0-712939105d15n%40googlegroups.com
>>>>>>
>>>>>> <https://groups.google.com/d/msgid/weewx-user/74ddbc8e-2a66-4ff4-b7d0-712939105d15n%40googlegroups.com?utm_medium=email&utm_source=footer>
>>>>>> .
>>>>>>
>>>>> --
>>>> You received this message because you are subscribed to the Google
>>>> Groups "weewx-user" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>> an email to [email protected].
>>>> To view this discussion on the web visit
>>>> https://groups.google.com/d/msgid/weewx-user/7915453a-fa1a-4aa1-b04b-2e102626c35bn%40googlegroups.com
>>>>
>>>> <https://groups.google.com/d/msgid/weewx-user/7915453a-fa1a-4aa1-b04b-2e102626c35bn%40googlegroups.com?utm_medium=email&utm_source=footer>
>>>> .
>>>>
>>>> --
>>>> You received this message because you are subscribed to the Google
>>>> Groups "weewx-user" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>> an email to [email protected].
>>>>
>>> To view this discussion on the web visit
>>>> https://groups.google.com/d/msgid/weewx-user/E07ACE72-CDA3-47AB-9C4B-FDA3293777C6%40gmail.com
>>>>
>>>> <https://groups.google.com/d/msgid/weewx-user/E07ACE72-CDA3-47AB-9C4B-FDA3293777C6%40gmail.com?utm_medium=email&utm_source=footer>
>>>> .
>>>>
>>> --
>> You received this message because you are subscribed to the Google Groups
>> "weewx-user" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to [email protected].
>>
> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/weewx-user/2bc3700f-0a95-4fa4-904f-d5f974159befn%40googlegroups.com
>>
>> <https://groups.google.com/d/msgid/weewx-user/2bc3700f-0a95-4fa4-904f-d5f974159befn%40googlegroups.com?utm_medium=email&utm_source=footer>
>> .
>>
>
--
You received this message because you are subscribed to the Google Groups
"weewx-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/weewx-user/ce09ba1d-7933-44b0-b5e8-242d302766e7n%40googlegroups.com.
