[Twisted-Python] Twisted 17.9.0 Release Announcement

[Amber Hawkie Brown]

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release 
of Twisted 17.9.0!

The highlights of this release are:

- More Python 3 porting, including twisted.mail.imap4, twisted.python.shortcut, 
twisted.python.rebuild, twisted.web.sux, twisted.web.microdom, and a ton of 
bugs and inconsistencies fixed.
- twistd on Python 3 now supports the dns, inetd, portforward, procmon, socks, 
and words plugins.
- HTTP/1.1 and HTTP/2 OPTIONS * request support in Twisted Web
- twist web now accepts the argument --add-header, which can be used to set 
things like HSTS headers without custom code
- Improvements to IMAP4 behaviour and several logic bugfixes
- Removal of outdated documentation and updates to make them work on Python 3
- Over 70 closed tickets overall.

For more information, check the NEWS file (link provided below).

You can find the downloads at > (or alternatively 
>). The NEWS file is also 
available at >.

Many thanks to everyone who had a part in this release - the supporters of the 
Twisted Software Foundation, the developers who contributed code as well as 
documentation, and all the people building great things with Twisted!

Twisted Regards,
Amber Brown (HawkOwl)


signature.asc
Description: Message signed with OpenPGP
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 17.9.0 Release Candidate Announcement

[Amber Hawkie Brown]

Hello everyone! Time for yet another Twisted release. What's new this time you 
may ask?

- More Python 3 porting, including twisted.mail.imap4, twisted.python.shortcut, 
twisted.python.rebuild, twisted.web.sux, twisted.web.microdom, and a ton of 
bugs and inconsistencies fixed.
- twistd on Python 3 now supports the dns, inetd, portforward, procmon, socks, 
and words plugins.
- HTTP/1.1 and HTTP/2 OPTIONS * request support in Twisted Web
- twist web now accepts the argument --add-header, which can be used to set 
things like HSTS headers without custom code
- Improvements to IMAP4 behaviour and several logic bugfixes
- Removal of outdated documentation and updates to make them work on Python 3
- Over 70 closed tickets overall.

You can get the tarball and the NEWS file at 
https://twistedmatrix.com/Releases/rc/17.9.0rc1/ , or you can try it out from 
PyPI:

python -m pip install Twisted==17.9.0rc1

Please test it, and let me know how your applications fare, good or bad! If 
nothing comes up, 17.9 will release in a week.

Twisted Regards,
Amber Brown


signature.asc
Description: Message signed with OpenPGP
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] SSLContext not valid for TLS Server

[Amber Hawkie Brown]

A quick git blame says that it landed in 
https://github.com/pyca/pyopenssl/commit/6c6bf865acdd3c5ca5f47b1dbc2903023fd286b6
 
,
 which exists in 17.0.0+. We require 16.0.0+, so it ought to be a relatively 
simple version check.

- Amber


> On 25 Aug 2017, at 18:19, Cory Benfield  wrote:
> 
> This is a somewhat-known issue that I’ve had bubbling on the backburner for 
> some time. For a long time PyOpenSSL didn’t automatically load all EC curves 
> and didn’t provide any API to do so, so Twisted told OpenSSL which curve to 
> use. Some time ago PyOpenSSL changed this behaviour to automatically load all 
> curves, which would resolve this issue.
> 
> The most comprehensive fix here is to do some history spelunking in PyOpenSSL 
> to find out what the lowest version is that has this code block[1] in it, and 
> then only execute the current ecCurve logic if that code block doesn’t appear 
> to have worked.
> 
> Cory
> 
> 
> [1]: 
> https://github.com/pyca/pyopenssl/blob/master/src/OpenSSL/SSL.py#L632-L636
> 
>> On 24 Aug 2017, at 20:40, Thomas Hartwich  wrote:
>> 
>> I think I now know why it is not working. As I initially suspected that ECC 
>> could be the reasons, it seems to have come true. No matter what kind of ECC 
>> curve I use, the current implementation of Twisted always uses prime256v1 
>> curve. Maybe because pyOpenSSL hasn't got full ECC support currently!? (got 
>> it from some comments in _sslverify.py)
>> 
>> In my setting I use secp521r1 curve and for testing purpose I created a key 
>> pair of prime256v1 and this works with CertificateOptions. If you have a 
>> look at the implementations of twisted.internet._sslverify you will see that 
>> prime256v1 is always used as default curve and it seems that no other curve 
>> is being accepted. This should be the reason why CertificateOptions does not 
>> work for my ECC key.
>> 
>> But somehow it works even with secp521r1, if I use the 
>> DefaultOpenSSLContextFactory. So do you know any workaround how it can be 
>> fixed that twisted accepts other curves than prime256v1?
>> 
>> Thank you!
>> 
>> 
>> Gesendet: Mittwoch, 23. August 2017 um 06:21 Uhr
>> Von: Glyph 
>> An: "Twisted general discussion" 
>> Betreff: Re: [Twisted-Python] SSLContext not valid for TLS Server
>> 
>> 
>> 
>> On Aug 22, 2017, at 9:16 AM, Thomas Hartwich 
>>  wrote:
>> 
>> Yes, you're right for sure. As an alternative I tried to instantiate an 
>> object from twisted.internet._sslverify.OpenSSLCertificateOptions (as it is 
>> used by PrivateCertificate e.g.):
>> 
>> co = OpenSSLCertificateOptions(privateKey=pkey,certificate=cert_obj)
>> 
>> Please note that importing names with "._" in them is relying on private API 
>> :).  The public alias for this is `twisted.internet.ssl.CertificateOptions` 
>> https://twistedmatrix.com/documents/17.5.0/api/twisted.internet.ssl.CertificateOptions.html[https://twistedmatrix.com/documents/17.5.0/api/twisted.internet.ssl.CertificateOptions.html]
>> 
>> Despite it provides a SSL-context, it does not work similarly to the 
>> options() method I tried before from PrivateCertificate().
>> 
>> Can you tell me how I can make use of IOpenSSLServerConnectionCreator to 
>> create a valid SSL-Context for the TLS server in my case?
>> 
>> You should probably just use CertificateOptions - I still would like to 
>> understand why it doesn't work ;-).
>> 
>> https://twistedmatrix.com/documents/17.5.0/api/twisted.internet.interfaces.IOpenSSLServerConnectionCreator.html[https://twistedmatrix.com/documents/17.5.0/api/twisted.internet.interfaces.IOpenSSLServerConnectionCreator.html]
>>  is documented here; this is just the interface you should implement (rather 
>> than subclassing ContextFactory and implementing getContext) if you want to 
>> do something totally custom with the OpenSSL API rather than Twisted's API; 
>> I'd still rather understand why Twisted's API, i.e. CertificateOptions, 
>> doesn't work for you.
>> 
>> -glyph
>> 
>> Thank you!
>> 
>> 
>> Gesendet: Sonntag, 20. August 2017 um 22:36 Uhr
>> Von: Glyph 
>> An: "Twisted general discussion" 
>> 
>> Betreff: Re: [Twisted-Python] SSLContext not valid for TLS Server
>> 
>> 
>> 
>> On Aug 20, 2017, at 9:30 AM, Thomas Hartwich 
>> 
>>  wrote:
>> Ok, I finally got a solution for my problem. As I know, the TLS server was 
>> working with DefaultOpenSSLContextFactory but this only takes file paths to 
>> private key/certificate, I created my own SSL-Context file.
>> 
>> For anybody who has the same problem:
>> Please note that this solution will prevent the 

Re: [Twisted-Python] Newer Pypy on buildbot?

[Amber Hawkie Brown]

> On 6 Jul 2017, at 12:41, Glyph  wrote:
> 
> 
>> On Jul 5, 2017, at 12:26 PM, Craig Rodrigues > > wrote:
>> 
>> Hi,
>> 
>> This builder: 
>> https://buildbot.twistedmatrix.com/builders/ubuntu16.04-pypy5/builds/86/steps/select/logs/stdio
>>  
>> 
>> 
>> seems to now be failing with:
>> 
>> cryptography 1.9 is not compatible with PyPy < 5.3. Please upgrade PyPy to 
>> use this library.
>> 
>> Can someone upgrade pypy on this builder?
> 
> Technically speaking I have access to this via our cloud control panel, but 
> the SSH key isn't recorded anywhere that I can see, and it doesn't have my 
> public keys on it, so it would be pretty labor-intensive for me to reset 
> passwords and/or reprovision these machines to do this upgrade.
> 
> We should probably have some kind of official r...@twistedmatrix.com 
>  key file someplace to make it easier to sync 
> up all our provisioned machines and keep access control up to date.
> 
> Until then though - hawkie, can you upgrade pypy on the relevant cloud 
> machines?
> 
> -glyph

This is done. PyPy graces https://speed.twistedmatrix.com/comparison/ 
 once again, and the unsupported 
build works.

- Amber



signature.asc
Description: Message signed with OpenPGP
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Notice of future removal of Python 3.3 and 3.4 support in Twisted

[Amber Hawkie Brown]

> On 11 Jun 2017, at 17:05, Glyph <gl...@twistedmatrix.com> wrote:
> 
>> On Jun 10, 2017, at 7:55 PM, Amber Hawkie Brown <hawk...@atleastfornow.net 
>> <mailto:hawk...@atleastfornow.net>> wrote:
>> 
>> We currently have no 3.3 or 3.4 builders except on Travis, so these Python 
>> versions aren't really "fully supported" per our policy
> 
> Why don't travis builders imply full support?  My understanding was that CI 
> == supported.
> 
> (This is just a procedural concern, I am fine with dropping >2.7<3.5 in the 
> proposed release.)
> 
> -glyph

Our policy says "buildbot builder" explicitly as the basis for support. Plus, 
Travis is some Pythons yolo'd onto a random Ubuntu for the purposes of smoke 
testing for people without access to our full build fleet; and the support for 
Python in Twisted has so far been on the basis of "what are people actually 
using" -- hence why we don't have a 3.3 or 3.4, as they are only generally 
available on EOL'd or enterprise distributions (which are unlikely to be used 
by people who want/can get the newest Twisted).

- Amber


signature.asc
Description: Message signed with OpenPGP
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Notice of future removal of Python 3.3 and 3.4 support in Twisted

[Amber Hawkie Brown]

As per our Compatibility Policy 
(https://twistedmatrix.com/documents/current/core/development/policy/compatibility-policy.html#supporting-and-de-supporting-python-versions
 
),
 this is an announcement that Twisted will be officially dropping support for 
Python 3.3 and Python 3.4 in the release after next.

We currently have no 3.3 or 3.4 builders except on Travis, so these Python 
versions aren't really "fully supported" per our policy, as no current version 
of the distributions we test against ship it. However lack of support is 
different from explicitly dropping support, and so in Twisted 17.5 + two 
versions, we will be removing compatibility hacks for supporting 3.3 and 3.4, 
and focusing on 3.5+.

- Amber


signature.asc
Description: Message signed with OpenPGP
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 17.5 Release Announcement

[Amber Hawkie Brown]

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release 
of Twisted 17.5!

The highlights of this release are:

- twisted.python.url has been spun out into the new 'hyperlink' package; 
importing twisted.python.url is now a compatibility alias
- Initial support for OpenSSL 1.1.0.
- Fixes around the reactor DNS resolver changes in 17.1, solving all known 
regressions
- Deferred.asFuture and Deferred.fromFuture, to allow you to map asyncio 
Futures to Twisted Deferreds and vice versa, for use the with Python 3+ 
asyncioreactor in Twisted
- Support for TLS 1.3 ciphersuites, in advance of a released OpenSSL to enable 
the protocol
- Further Python 3 support in twisted.web, initial support in twisted.mail.smtp.

For more information, check the NEWS file (link provided below).

You can find the downloads at > (or alternatively 
>). The NEWS file is also 
available at >.

Many thanks to everyone who had a part in this release - the supporters of the 
Twisted Software Foundation, the developers who contributed code as well as 
documentation, and all the people building great things with Twisted!

Twisted Regards,
Amber Brown (HawkOwl)


signature.asc
Description: Message signed with OpenPGP
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Twisted 17.5.0rc2 RC Announcement

[Amber Hawkie Brown]

> On 30 May 2017, at 05:27, Glyph  wrote:
> 
> 
>> On May 26, 2017, at 4:38 AM, Jean-Paul Calderone > > wrote:
>> 
>> Some of the txkube problems have been resolved but either not entirely or 
>> some new ones have been introduced.  Attached is a log of the failures from 
>> the unit test suite.  I haven't investigated these new errors in depth yet 
>> so I won't say whether these are txkube's fault or Twisted's fault... but at 
>> least something is at fault.
> 
> I do think we need to block the final release until we at least know where 
> the responsibility lies for these tracebacks :-\.  These all still pass on 
> 16.6.0 I presume?

I investigated them, they're all due to Agent changes -- how they don't use 
connectSSL anymore, and instead use a wrapped TCP port, and how Agent now uses 
HostnameEndpoint's GAI resolving. I put up some fixes (although not up to spec 
for merge) here for JP: https://github.com/LeastAuthority/txkube/pull/135 


I would put these down to an issue in txkube, even if it's not txkube's fault, 
it's just that Twisted does things differently (and in the case of not using 
connectSSL, imo better :) ).

- Amber


signature.asc
Description: Message signed with OpenPGP
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
https://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 17.1 Release Announcement

[Amber Hawkie Brown]

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release 
of Twisted 17.1!

The highlights of this release are:

- twisted.web.client.Agent now supports IPv6! It's also now the primary web 
client in Twisted, with twisted.web.client.getPage being deprecated in favour 
of it and Treq.
- twisted.web.server has had many cleanups revolving around timing out inactive 
clients.
- twisted.internet.ssl.CertificateOptions has had its `method` argument 
deprecated, in favour of the new raiseMinimumTo, lowerMaximumSecurityTo, and 
insecurelyLowerMinimumTo arguments, which take TLSVersion arguments. This 
allows you to better give a range of versions of TLS you wish to negotiate, 
rather than forcing yourself to any one version.
- twisted.internet.ssl.CertificateOptions will use OpenSSL's 
MODE_RELEASE_BUFFERS, which will let it free unused memory that was held by 
idle TLS connections.
- You can now call the new twist runner with `python -m twisted`.
- twisted.conch.ssh now has some ECDH key exchange support and supports 
`hmac-sha2-384`.
- Better Unicode support in twisted.internet.reactor.spawnProcess, especially 
on Windows on Python 3.6.
- More Python 3 porting in Conch, and more under-the-hood changes to facilitate 
a Twisted-wide jump to new-style classes only on Python 2 in 2018/2019. This 
release has also been tested on Python 3.6 on Linux.
- Lots of deprecated code removals, to make a sleeker, less confusing Twisted.
- 60+ closed tickets.

For more information, check the NEWS file (link provided below).

You can find the downloads at > (or alternatively 
>). The NEWS file is also 
available at >.

Many thanks to everyone who had a part in this release - the supporters of the 
Twisted Software Foundation, the developers who contributed code as well as 
documentation, and all the people building great things with Twisted!

Twisted Regards,
Amber Brown (HawkOwl)


signature.asc
Description: Message signed with OpenPGP
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 17.1.0rc1 Release Candidate Announcement

[Amber Hawkie Brown]

Hello everyone!

16.7 didn't go as well as planned, so I thought we'd try again in the new year! 
So, here is Twisted 17.1, the first release of 2017. It's got all the cool 
things that were going to be in 16.7, *and more*. Wow!

- twisted.web.client.Agent now supports IPv6! It's also now the primary web 
client in Twisted, with twisted.web.client.getPage being deprecated in favour 
of it and Treq.
- twisted.web.server has had many cleanups revolving around timing out inactive 
clients.
- twisted.internet.ssl.CertificateOptions has had its `method` argument 
deprecated, in favour of the new raiseMinimumTo, lowerMaximumSecurityTo, and 
insecurelyLowerMinimumTo arguments, which take TLSVersion arguments. This 
allows you to better give a range of versions of TLS you wish to negotiate, 
rather than forcing yourself to any one version.
- twisted.internet.ssl.CertificateOptions will use OpenSSL's 
MODE_RELEASE_BUFFERS, which will let it free unused memory that was held by 
idle TLS connections.
- You can now call the new twist runner with `python -m twisted`.
- twisted.conch.ssh now has some ECDH key exchange support and supports 
`hmac-sha2-384`.
- Better Unicode support in twisted.internet.reactor.spawnProcess, especially 
on Windows on Python 3.6.
- More Python 3 porting in Conch, and more under-the-hood changes to facilitate 
a Twisted-wide jump to new-style classes only on Python 2 in 2018/2019. This 
release has also been tested on Python 3.6 on Linux.
- Lots of deprecated code removals, to make a sleeker, less confusing Twisted.
- 60+ closed tickets.

You can get the tarball and the NEWS file at 
https://twistedmatrix.com/Releases/rc/17.1.0rc1/ 
 , or you can try it out from 
PyPI:

python -m pip install Twisted==17.1.0rc1

Please test it, and let me know how your applications fare, good or bad! If 
nothing comes up, 17.1 will release in a week.

A bit more hopeful this time,
Amber Brown


signature.asc
Description: Message signed with OpenPGP
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.7.0rc2 Release Candidate Announcement

[Amber "Hawkie" Brown]

Happy new year!

Twisted 16.7.0rc2 is out, with a bugfix for a problem scrapy ran into. Sorry 
for the delay in 16.7 final, we've had a few regression reports, and we've made 
sure to follow them all up and get to the bottom of them before we did the 
release!

You can get the tarball and the NEWS file at 
https://twistedmatrix.com/Releases/rc/16.7.0rc2/ 
 , or you can try it out from 
PyPI:

python -m pip install Twisted==16.7.0rc2

Please test it, and let me know how your applications fare, good or bad! It 
will release this weekend if nothing is reported.

Regards,
Amber Brown___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] "twistd" in Twisted 16.4.0 can't import modules/packages from current working directory

[Amber "Hawkie" Brown]

> On 4 Jan 2017, at 07:20, Glyph Lefkowitz <gl...@twistedmatrix.com> wrote:
> 
>> 
>> On Jan 2, 2017, at 6:10 AM, Jean-Paul Calderone <exar...@twistedmatrix.com 
>> <mailto:exar...@twistedmatrix.com>> wrote:
>> 
>> On Thu, Sep 1, 2016 at 11:36 AM, Amber "Hawkie" Brown 
>> <hawk...@atleastfornow.net <mailto:hawk...@atleastfornow.net>> wrote:
>> 
>> > On 1 Sep 2016, at 21:42, Yuri <yuri_abzya...@fastmail.fm 
>> > <mailto:yuri_abzya...@fastmail.fm>> wrote:
>> >
>> > Hi all
>> >
>> > I couldn't find Twisted-specific group, so posting here.
>> >
>> > Recently Twisted 16.4.0 got released. Yesterday I've tried to upgrade it 
>> > for my apps and got an error.
>> >
>> > ...
>> >
>> > The errors comes down to this: twistd script does not add current working 
>> > directory to python path (or removes it, I don't know what exactly 
>> > happens), so it fails to import any packages/modules from it. The issue 
>> > does not appear in previous version (Twisted 16.3.2).
>> >
>> > Any ideas what caused it?
>> 
>> Yes -- we moved to using setuptools console scripts, and these console 
>> scripts don't add "." to the PYTHONPATH. We realised this in prerelease but 
>> decided against fixing it, as it adding the current working dir to the PATH 
>> has lead to a lot of  subtle bugs in the past and this is a good chance to 
>> make a break from them.
>> 
>> So, in short, this is expected behaviour -- we generally want people to be 
>> running twistd, trial, etc on *installed* Python packages -- testing or 
>> running from checkouts often hides many bugs about what is or isn't included 
>> in the installed package by accident. If you rely on this behaviour, though, 
>> set the PYTHONPATH environment variable to "." -- e.g. `env PYTHONPATH=. 
>> twistd -n myplugin`.
>> 
>> 
>> FWIW, as a user, it would have been nice to have a NEWS entry for this.  It 
>> would have been easier to discover there than searching through the mail 
>> archives.
> 
> Yes, there definitely should have been.  We only realized the implications of 
> the change after the fact, and only after some discussion decided that it was 
> in fact desirable and should not be rolled back in a patch release.
> 
> We don't have a process for fixing NEWS files right now, and given that 
> releases are immutable, I wonder if there's any way we could.  So, in the 
> rare case that we mess up this way in the future, what (aside from the 
> mailing list) would be a good communication mechanism to users?
> 
> -glyph

We have, in the past, fixed up historic NEWS files in later releases (e.g. the 
one which removed 2.6 support). We could always roll these changes into a 
post1, but, that seems like a lot of effort. Maybe we could put errata on the 
blog?

- Amber___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] tx github announcements in #twisted-dev

[Amber "Hawkie" Brown]

On 2 Jan 2017, at 23:57, Jean-Paul Calderone  wrote:
> 
> How do folks feel about this?  Good idea or not?
> 
> Jean-Paul
> 
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

We have some already (PRs opened?) so, I say go for it, if there's useful 
information in there. We can always turn it off again.

- Amber
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Twisted 16.7.0rc1 Release Candidate Announcement

[Amber "Hawkie" Brown]

 it, but I'm not sure 
> what to do next.  I was able to get it working by downloading and installing 
> get-pip.py and Automat (contrary to the python.org documentation, I didn't 
> have pip installed on my system even though it is Python 2.7.13 downloaded 
> from python.org.)
>sudo python get-pip.py
>sudo pip install Automat
> 
> This is worrisome to me because I think this requires Internet access to 
> pypi.python.org, which I have on my development and testing systems, but not 
> on my production systems.  Everything else I've ever needed, I could download 
> and install source files.
> 
> Having done this, my app seems to run fine (only quick sanity testing so far.)
> 
> 
> install---
> Searching for Automat>=0.3.0
> Reading https://pypi.python.org/simple/Automat/ 
> <https://pypi.python.org/simple/Automat/>
> Download error on https://pypi.python.org/simple/Automat/ 
> <https://pypi.python.org/simple/Automat/>: [SSL: CERTIFICATE_VERIFY_FAILED] 
> certificate verify failed (_ssl.c:590) -- Some packages may not be found!
> Couldn't find index page for 'Automat' (maybe misspelled?)
> Scanning index of all packages (this may take a while)
> Reading https://pypi.python.org/simple/ <https://pypi.python.org/simple/>
> Download error on https://pypi.python.org/simple/ 
> <https://pypi.python.org/simple/>: [SSL: CERTIFICATE_VERIFY_FAILED] 
> certificate verify failed (_ssl.c:590) -- Some packages may not be found!
> No local packages or working download links found for Automat>=0.3.0
> error: Could not find suitable distribution for 
> Requirement.parse('Automat>=0.3.0')
> --
> 
> ---try to use without Automat---
> medusa@Medusa:~/run> python medusa_server.py Rain
> Traceback (most recent call last):
>   File "medusa_server.py", line 72, in 
> from twisted.application import service, internet
>   File 
> "/usr/lib/python2.7/site-packages/Twisted-16.7.0rc1-py2.7-linux-x86_64.egg/twisted/application/internet.py",
>  line 54, in 
> from automat import MethodicalMachine
> ImportError: No module named automat
> --
> 
> On 12/22/2016 11:33 PM, Amber "Hawkie" Brown wrote:
>> Hello everyone, and happy holidays!
>> 
>> Although it didn't quite fall on the solstice, one could call this Twisted 
>> release a little ray of sunshine, with some nice new improvements. 16.7.0rc1 
>> brings the following stocking stuffers:
>> 
>> - twisted.web.client.Agent now supports IPv6! It's also now the primary web 
>> client in Twisted, with twisted.web.client.getPage being deprecated in 
>> favour of it and Treq.
>> - twisted.internet.ssl.CertificateOptions has had its `method` argument 
>> deprecated, in favour of the new raiseMinimumTo, lowerMaximumSecurityTo, and 
>> insecurelyLowerMinimumTo arguments, which take TLSVersion arguments. This 
>> allows you to better give a range of versions of TLS you wish to negotiate, 
>> rather than forcing yourself to any one version.
>> - twisted.internet.ssl.CertificateOptions will use OpenSSL's 
>> MODE_RELEASE_BUFFERS, which will let it free unused memory that was held by 
>> idle TLS connections.
>> - You can now call the new twist runner with `python -m twisted`.
>> - Conch has the beginnings of ECDH key exchange, and supports 
>> `hmac-sha2-384` in twisted.conch.ssh.
>> - Better Unicode support in twisted.internet.reactor.spawnProcess, 
>> especially on Windows on Python 3.6.
>> - More Python 3 porting in Conch, and more under-the-hood changes to 
>> facilitate a Twisted-wide jump to new-style classes only on Python 2 in 
>> 2018/2019. This release has also been tested on Python 3.6 on Linux.
>> - Lots of deprecated code removals, to make a sleeker, less confusing 
>> Twisted.
>> - 20+ closed tickets.
>> 
>> You can get the tarball and the NEWS file at 
>> https://twistedmatrix.com/Releases/rc/16.7.0rc1/ 
>> <https://twistedmatrix.com/Releases/rc/16.7.0rc1/> , or you can try it out 
>> from PyPI:
>> 
>> python -m pip install Twisted==16.7.0rc1
>> 
>> Please test it, and let me know how your applications fare, good or bad! If 
>> nothing comes up, 16.7 looks like it'll land just before the new year.
>> 
>> With festive hoots,
>> Amber Brown
>> 
>> 
>> 
>> ___
>> Twisted-Python mailing list
>> Twisted-Python@twistedmatrix.com <mailto:Twisted-Python@twistedmatrix.com>
>> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python 
>> <http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python>
> 
> 
> -- 
> John Santos
> Evans Griffiths & Hart, Inc.
> 781-861-0670 ext 539
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] twisted.python.sendmsg segfault - looking for confirmation

[Amber "Hawkie" Brown]

> On 28 Dec. 2016, at 14:15, ex vito  wrote:
> 
> Dear all,
> 
> While working on http://twistedmatrix.com/trac/ticket/8912 and the associated 
> PR at https://github.com/twisted/twisted/pull/647 I hit a segmentation fault 
> on a test I was preparing.
> 
> I think narrowed it down Linux + Python 2, but I'm not 100% sure. Can anyone 
> please confirm the  code below segfaults on such environment? For 
> completeness, from my tests, it works fine on Linux + Python 3, and fails 
> with socket.error/OSError on Mac OS 10.9.5 + Python 2/3. No BSDs at hand to 
> try out...
> 
> As far as I can tell, no code in Twisted uses sendmsg in the way the code is 
> using it. However, twisted.python.sendmsg is a public API so someone 
> somewhere may hit this like I just did.
> 
> Other than looking for confirmation, I have a fix which I included two 
> isolated commits in the PR. Twisted project members: if this is confirmed, 
> maybe a ticket should be created in Trac and an independent PR created, 
> correct?
> 
> Thanks in advance for any input.
> Regards,
> --
> exvito
> 
> -[ cut here 
> ]--
> 
> import os
> import socket
> import struct
> import sys
> 
> from twisted.python import sendmsg
> 
> if __name__ == '__main__':
> 
># This code segfaults when running with twisted/trunk commit
># 98a3df200968b78bd3b985dfd4fb10a5b415d6fc on Linux Python 2
># due to a bug in src/twisted/python/_sendmsg.c and glibc's
># CMSG_NXTHDR implementation.
> 
># get connected sockets
>s1, s2 = socket.socketpair(socket.AF_UNIX)
> 
># two CMSGs in ancillary data (no segfault with just one)
>ancillary = [
>(socket.SOL_SOCKET, sendmsg.SCM_RIGHTS, struct.pack('i', s1.fileno())),
>(socket.SOL_SOCKET, sendmsg.SCM_RIGHTS, struct.pack('i', s2.fileno())),
>]
> 
>expected = {
>2: 'Expecting to segfault.',
>3: 'Should not segfault.',
>}
>print expected.get(sys.version_info.major, 'Unexpected Python version.')
>retval = sendmsg.sendmsg(s1, data=b'some data', ancillary=ancillary)
>print 'Did not segfault.'
> 
> -[ cut here 
> ]--
> 
> 
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

FWIW, for people wanting to track this down, this may be a bug in our C 
extension (src/twisted/python/_sendmsg.c). Python 3 uses the stdlib's 
functionality, which is probably why it isn't running into this.

- Amber


___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] New Supported Platforms - FreeBSD (2.7 & 3.5), Python 3.6 (Linux)

[Amber Hawkie Brown]

Hi everyone,

I just migrated a few buildbots over to the 'supported' column. This includes 
Python 3.6 on Ubuntu 16.04 (compiled, not an official distro binary :) ) and 
FreeBSD 10.1 (Python 2.7 & 3.5). Twisted 16.7 passes on both of these, so you 
can consider them supported platforms for it.

- Amber
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.7.0rc1 Release Candidate Announcement

[Amber "Hawkie" Brown]

Hello everyone, and happy holidays!

Although it didn't quite fall on the solstice, one could call this Twisted 
release a little ray of sunshine, with some nice new improvements. 16.7.0rc1 
brings the following stocking stuffers:

- twisted.web.client.Agent now supports IPv6! It's also now the primary web 
client in Twisted, with twisted.web.client.getPage being deprecated in favour 
of it and Treq.
- twisted.internet.ssl.CertificateOptions has had its `method` argument 
deprecated, in favour of the new raiseMinimumTo, lowerMaximumSecurityTo, and 
insecurelyLowerMinimumTo arguments, which take TLSVersion arguments. This 
allows you to better give a range of versions of TLS you wish to negotiate, 
rather than forcing yourself to any one version.
- twisted.internet.ssl.CertificateOptions will use OpenSSL's 
MODE_RELEASE_BUFFERS, which will let it free unused memory that was held by 
idle TLS connections.
- You can now call the new twist runner with `python -m twisted`.
- Conch has the beginnings of ECDH key exchange, and supports `hmac-sha2-384` 
in twisted.conch.ssh.
- Better Unicode support in twisted.internet.reactor.spawnProcess, especially 
on Windows on Python 3.6.
- More Python 3 porting in Conch, and more under-the-hood changes to facilitate 
a Twisted-wide jump to new-style classes only on Python 2 in 2018/2019. This 
release has also been tested on Python 3.6 on Linux.
- Lots of deprecated code removals, to make a sleeker, less confusing Twisted.
- 20+ closed tickets.

You can get the tarball and the NEWS file at 
https://twistedmatrix.com/Releases/rc/16.7.0rc1/ 
 , or you can try it out from 
PyPI:

python -m pip install Twisted==16.7.0rc1

Please test it, and let me know how your applications fare, good or bad! If 
nothing comes up, 16.7 looks like it'll land just before the new year.

With festive hoots,
Amber Brown

___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] memory leaks

[Amber "Hawkie" Brown]

> On 6 Dec. 2016, at 17:09, Glyph Lefkowitz  wrote:
> 
> 
> twisted.logger._initialBuffer can consume a surprisingly large amount of 
> memory if logging is not initialized
> 
> 
> The way that `twisted.logger` is supposed to work is that at process startup 
> time, the global log observer has a ring buffer for any messages emitted 
> before logging is initialized, and emit those messages to the initial set of 
> log observers passed to `globalLogBeginner.beginLoggingTo`.
> 
> The size of this buffer (in `twisted.logger._buffer._DEFAULT_BUFFER_MAXIMUM` 
> is 65535.  This value was selected arbitrarily, probably because somebody (me 
> or wsanchez) thought "huh, yeah, 64k, that's probably a fine number); but of 
> course, that's 64k ''bytes''.
> 
> If this were a buffer of actual formatted log messages, of say 200 bytes 
> each, that would be about 13 megabytes, which is maybe an acceptable amount 
> of RAM to spend on a log buffer.
> 
> However, it isn't that.  It's a buffer of 64k log ''events'', each of which 
> probably has a `log_logger` and `log_source` set, each of which is an object 
> attached to potentially arbitrary data.  For example, every `Factory` that 
> starts up logs something, which means you're holding on to an instance, and 
> an instance dictionary, and the protocol instance, and the protocol instance 
> dictionary.  Worse yet, any logged ''failures'' might hold on to all the 
> stuff on their stack.
> 
> Add it all up and you end up with a log buffer totaling in the hundreds of 
> megabytes, or even gigabytes, once it's full.  In an application that naively 
> uses Twisted without ever initializing logging, this hangs around forever.
> 
> This buffer should probably be a ''lot'' smaller, and we might want to emit a 
> warning when it fills up, reminding people that it is ''only polite'' to 
> start up the logging subsystem, even just to explicitly throw logs away.


I fixed trac: https://twistedmatrix.com/trac/ticket/8936#ticket 


- Amber___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Twisted 16.6.0 Release Announcement

[Amber "Hawkie" Brown]

Er, that should be 16.6 in the first line. Shouldn't release software at 6am!

- Amber

> On 26 Nov. 2016, at 07:02, Amber Hawkie Brown <hawk...@atleastfornow.net> 
> wrote:
> 
> On behalf of Twisted Matrix Laboratories, I am honoured to announce the 
> release of Twisted 16.5!
> 
> The highlights of this release are:
> 
> - The ability to use "python -m twisted" to call the new `twist` runner,
> - More reliable tests from a more reliable implementation of some things, 
> like IOCP,
> - Fixes for async/await & twisted.internet.defer.ensureDeferred, meaning it's 
> getting closer to prime time!
> - ECDSA support in Conch & ckeygen (which has also been ported to Python 3),
> - Python 3 support for Words' IRC support and twisted.protocols.sip among 
> some smaller modules,
> - Some HTTP/2 server optimisations,
> - and a few bugfixes to boot!
> 
> For more information, check the NEWS file (link provided below).
> 
> You can find the downloads at <https://pypi.python.org/pypi/Twisted 
> <https://pypi.python.org/pypi/Twisted>> (or alternatively 
> <http://twistedmatrix.com/trac/wiki/Downloads 
> <http://twistedmatrix.com/trac/wiki/Downloads>>). The NEWS file is also 
> available at <https://github.com/twisted/twisted/blob/twisted-16.6.0/NEWS 
> <https://github.com/twisted/twisted/blob/twisted-16.6.0/NEWS>>.
> 
> Many thanks to everyone who had a part in this release - the supporters of 
> the Twisted Software Foundation, the developers who contributed code as well 
> as documentation, and all the people building great things with Twisted!
> 
> Twisted Regards,
> Amber Brown (HawkOwl)

___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.6.0 Release Announcement

[Amber "Hawkie" Brown]

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release 
of Twisted 16.5!

The highlights of this release are:

- The ability to use "python -m twisted" to call the new `twist` runner,
- More reliable tests from a more reliable implementation of some things, like 
IOCP,
- Fixes for async/await & twisted.internet.defer.ensureDeferred, meaning it's 
getting closer to prime time!
- ECDSA support in Conch & ckeygen (which has also been ported to Python 3),
- Python 3 support for Words' IRC support and twisted.protocols.sip among some 
smaller modules,
- Some HTTP/2 server optimisations,
- and a few bugfixes to boot!

For more information, check the NEWS file (link provided below).

You can find the downloads at > (or alternatively 
>). The NEWS file is also 
available at >.

Many thanks to everyone who had a part in this release - the supporters of the 
Twisted Software Foundation, the developers who contributed code as well as 
documentation, and all the people building great things with Twisted!

Twisted Regards,
Amber Brown (HawkOwl)___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Twisted 16.6.0rc1 Release Candidate Announcement

[Amber "Hawkie" Brown]

> On 17 Nov. 2016, at 18:50, Amber Hawkie Brown <hawk...@atleastfornow.net> 
> wrote:
> 
>> 
>> On 17 Nov. 2016, at 18:22, Glyph Lefkowitz <gl...@twistedmatrix.com 
>> <mailto:gl...@twistedmatrix.com>> wrote:
>> 
>>> 
>>> On Nov 16, 2016, at 11:15 PM, Mark Williams <markrwilli...@gmail.com 
>>> <mailto:markrwilli...@gmail.com>> wrote:
>>> 
>>> On Thu, Nov 10, 2016 at 07:56:52PM +1100, Amber "Hawkie" Brown wrote:
>>>> - Python 3 support for Words' IRC support and twisted.protocols.sip among 
>>>> some smaller modules,
>>> 
>>> I have opened a PR to revert this:
>>> 
>>> https://github.com/twisted/twisted/pull/593 
>>> <https://github.com/twisted/twisted/pull/593>
>>> 
>>> A full explanation is here:
>>> 
>>> https://twistedmatrix.com/trac/ticket/6320#comment:16
>>> 
>>> In summary: a valid IRC message will cause a UnicodeDecodeError within
>>> the event loop that a user cannot handle or avoid, and all length
>>> checks on line sizes are wrong because they occur prior to encoding to
>>> utf-8.
>> 
>> Reverts should be commits that go straight to trunk and reopen tickets, per 
>> the current process.
>> 
>> However; is it really a regression to have py3 support for Words that just 
>> doesn't support other encodings yet?  It strikes me that this is just a bug, 
>> and that we should just fall back from UTF-8 to latin-1 in this scenario.  
>> But adding that fallback is a small additional fix (perhaps one that should 
>> be slated for 16.6.0 if you want to make it).
>> 
>> -glyph
> 
> Yeah, this is just a plain old bug. Bugs in new features (where a module 
> being on Python 3 counts as one to me) aren't regressions; we sometimes fix 
> them in pre if there's time/other stuff is getting fixed, but this one will 
> just be a known bug until 16.7 in December.
> 
> - Amber

(or a 16.6.1)___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Twisted 16.6.0rc1 Release Candidate Announcement

[Amber "Hawkie" Brown]

> On 17 Nov. 2016, at 18:22, Glyph Lefkowitz <gl...@twistedmatrix.com> wrote:
> 
>> 
>> On Nov 16, 2016, at 11:15 PM, Mark Williams <markrwilli...@gmail.com> wrote:
>> 
>> On Thu, Nov 10, 2016 at 07:56:52PM +1100, Amber "Hawkie" Brown wrote:
>>> - Python 3 support for Words' IRC support and twisted.protocols.sip among 
>>> some smaller modules,
>> 
>> I have opened a PR to revert this:
>> 
>> https://github.com/twisted/twisted/pull/593
>> 
>> A full explanation is here:
>> 
>> https://twistedmatrix.com/trac/ticket/6320#comment:16
>> 
>> In summary: a valid IRC message will cause a UnicodeDecodeError within
>> the event loop that a user cannot handle or avoid, and all length
>> checks on line sizes are wrong because they occur prior to encoding to
>> utf-8.
> 
> Reverts should be commits that go straight to trunk and reopen tickets, per 
> the current process.
> 
> However; is it really a regression to have py3 support for Words that just 
> doesn't support other encodings yet?  It strikes me that this is just a bug, 
> and that we should just fall back from UTF-8 to latin-1 in this scenario.  
> But adding that fallback is a small additional fix (perhaps one that should 
> be slated for 16.6.0 if you want to make it).
> 
> -glyph

Yeah, this is just a plain old bug. Bugs in new features (where a module being 
on Python 3 counts as one to me) aren't regressions; we sometimes fix them in 
pre if there's time/other stuff is getting fixed, but this one will just be a 
known bug until 16.7 in December.

- Amber___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.6.0rc1 Release Candidate Announcement

[Amber "Hawkie" Brown]

Hi everyone, here's a Twisted release to hopefully lift your spirits a little. 
It's not a big one, but it's got some goodies regardless.

It features:

- The ability to use "python -m twisted" to call the new `twist` runner,
- More reliable tests from a more reliable implementation of some things, like 
IOCP,
- Fixes for async/await & twisted.internet.defer.ensureDeferred, meaning it's 
getting closer to prime time!
- ECDSA support in Conch & ckeygen (which has also been ported to Python 3),
- Python 3 support for Words' IRC support and twisted.protocols.sip among some 
smaller modules,
- Some HTTP/2 server optimisations,
- and a few bugfixes to boot!

You can get the tarball and the NEWS file at 
https://twistedmatrix.com/Releases/rc/16.6.0rc1/ 
 , or you can try it out from 
PyPI:

python -m pip install Twisted==16.6.0rc1

Please test it, and let me know how your applications fare, good or bad! If 
nothing comes up, I will release 16.6.0 next week.

- Amber___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.5.0rc2 Release Candidate Announcement

[Amber "Hawkie" Brown]

Hi everyone,

I've just cut Twisted 16.5.0rc2, the second RC of the 16.5.0 release series. It 
contains fixes for three bugs:

- Twisted Logger writing tracebacks in the middle of JSON-formatted logs
- `twisted.version`'s package changing case (which was fixed with making 
Incremental compare them lower cased)
- Comparing non-ASCII-subset Unicode strings in Trial on Python 2.7 failing 
with a UnicodeDecodeError.

You can get it by running `pip install Twisted==16.5.0rc2` or getting the 
tarball from https://twistedmatrix.com/Releases/rc/16.5.0rc2/. The full NEWS 
file is also available there, if you wish to read more details.

16.5.0 will be released sometime around Wednesday, provided no more serious 
bugs rear their head! Remember to test it with your applications, you'll get a 
virtual cookie if you do :)

- Amber
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Some things I've learned: safer callbacks, better t.p.context

[Amber "Hawkie" Brown]

> On 20 Oct. 2016, at 08:54, Glyph Lefkowitz  wrote:
> 
> 
>> On Oct 19, 2016, at 2:47 PM, Itamar Turner-Trauring > > wrote:
>> 
>> On Wed, Oct 19, 2016, at 05:45 PM, Itamar Turner-Trauring wrote:
>>> Well... I had a test that went through synchronous Deferred path. And yeah, 
>>> it was easier to write than async test. But it failed to catch a bug that 
>>> was only in async case. So the problem I see is that supporting both in 
>>> Deferred means you need twice the number of tests each time you use 
>>> Deferreds.
>> 
>> Er, that was unclear. I had a bug that wasn't caught by tests because it 
>> passed with sync Deferred and failed with async Deferred callback, and I 
>> didn't have tests for latter.
> 
> 
> To be clear: I do see this as a downside to Deferred's architecture; it's a 
> tradeoff.  I see the loose coupling with the event loop as a worthwhile 
> upside.

One thing that I have still not figured out is how Futures (which are tightly 
tied to an event loop) will possibly ever work over multiple event loops. I 
think since you can't really chain them, this is less of a problem, but 
Deferreds like to absorb other Deferreds and make one big one, which would make 
the tight coupling problematic if you wanted to use two event loops (like, say, 
a GTK one and an IOCP one on Windows).

- Amber

> 
> However, it's totally possible to write the async Deferred callback case as 
> well, just by having the test fire the Deferred after returning to the test 
> body instead of firing it before :-).
> 
> -glyph
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.5.0rc1 Release Candidate Announcement

[Amber "Hawkie" Brown]

Hello everyone! It's time for another Twisted release.

I bring you Twisted 16.5.0rc1, the first release candidate of the 16.5 series. 
This release contains the following:

- Deferred.addTimeout, for timing out your Deferreds! (contributed by cyli, 
reviews by adiroiban, theisencouple, manishtomar, markrwilliams)
- yield from support for Deferreds, in functions wrapped with 
twisted.internet.defer.ensureDeferred. This will work in Python 3.4, unlike 
async/await which is 3.5+ (contributed by hawkowl, reviews by markrwilliams, 
lukasa).
- The new asyncio interop reactor, which allows Twisted to run on top of the 
asyncio event loop. This doesn't include any Deferred-Future interop, but stay 
tuned! (contributed by itamar and hawkowl, reviews by rodrigc, markrwilliams)
- twisted.internet.cfreactor is now supported on Python 2.7 and Python 3.5+! 
This is useful for writing pyobjc or Toga applications. (contributed by 
hawkowl, reviews by glyph, markrwilliams)
- twisted.python.constants has been split out into constantly on PyPI, and 
likewise with twisted.python.versions going into the PyPI package incremental. 
Twisted now uses these external packages, which will be shared with other 
projects (like Klein). (contributed by hawkowl, reviews by glyph, markrwilliams)
- Many new Python 3 modules, including twisted.pair, twisted.python.zippath, 
twisted.spread.pb, and more parts of Conch! (contributed by rodrigc, hawkowl, 
glyph, berdario, & others, reviews by acabhishek942, rodrigc, & others)
- Many bug fixes and cleanups!
- 260+ closed tickets overall.

For more information, check the NEWS file (link provided below).

As usual, it's available for download -- go here 
(https://twistedmatrix.com/Releases/rc/16.5.0rc1/ 
) to get the release 
candidate tarballs and the full NEWS file. If you want to install it right 
away, run:

   pip install Twisted==16.5.0rc1

Please let me know if you have any issues, as well as if you don't! If 
everything works well, that's a good thing for me to know :)

Twisted Regards,
Amber Brown (HawkOwl)___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Conch examples give me host key related errors

[Amber "Hawkie" Brown]

Hi,

This is most likely because of a security change I made a few versions ago, 
where conch will no longer use a set of default, hard-coded SSH keys.

You may want to do something like 
https://github.com/twisted/twisted/blob/trunk/src/twisted/conch/manhole_tap.py#L149
 

 , and add a key yourself -- we should update these examples to add this, so 
that they run out of the box again.

- Amber

> On 10 Oct. 2016, at 13:05, Oon-Ee Ng  wrote:
> 
> My google-fu is failing me (or I'm the only one with a misconfigured
> ssh system), but none of the examples on
> http://twistedmatrix.com/documents/current/conch/examples/index.html
> run for me.
> 
> The ConchError I'm mostly getting says ('no host keys, failing',
> None), while the simplesshserver.py example fails with a KeyError
> 'sshKeyDir'
> 
> Not sure where twisted-conch expects host keys to be, but my openssh
> host keys are fine (I have a running sshd which sources them from
> /etc/ssh as per usual). That being said, there's no way twisted-conch
> as a python user-process would have access to them (nor should it).
> 
> I'm actually just wanting to use twisted-conch-manhole, but running
> into this problem first. Is there something I need to configure in my
> system?
> 
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.4.1 Prerelease 1 Announcement

[Amber "Hawkie" Brown]

Hello again everyone,

I bring you a prerelease of the Twisted 16.4.1 security fix release, thus 
deemed 16.4.1pre1. This release contains:

- A mitigation for SWEET32 
(https://www.openssl.org/blog/blog/2016/08/24/sweet32/ 
).
- The inclusion of ChaCha20 to our TLS cipher suite, providing your underlying 
OpenSSL supports it.

Please note that the SWEET32 mitigation will break TLS from IE on Windows XP. 
This shouldn't be an issue for you (hopefully), but if you need to support 
those poor XP using souls, you can add 3DES back to your CertificateOptions 
yourself.

As usual, it's available for download -- go here 
(https://twistedmatrix.com/Releases/pre/16.4.1pre1/ 
) to get the prerelease 
tarballs and the full NEWS file. If you want to install it right away, run:

   pip install 
https://twistedmatrix.com/Releases/pre/16.4.1pre1/Twisted-16.4.1rc1.tar.bz2 


Please let me know if you have any issues, as well as if you don't! If 
everything works well, that's a good thing for me to know :)

Have fun, and stay secure!

Twisted Regards,
Amber Brown (HawkOwl)


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Trial not operating on current working dir & Sunsetting Python 3.3

[Amber "Hawkie" Brown]

Hi everyone!

Two things to let you all know in this email:

1. The new trial console script does not add the current directory to the PATH. 
Meaning, you can't use it to test a checkout of your code anymore! Instead, you 
should only use it for things that are actually on your path -- we recommend 
using something like tox to automate installing your package and testing your 
code. Hynek goes into detail here: https://hynek.me/articles/testing-packaging/ 
. If you really want to do this, you can use 'python -m twisted.trial', but you 
should really be testing installed versions of your code instead!

2. The next release of Twisted (tentatively named 16.5) will be the last to 
support Python 3.3. It's not in any LTS platforms, and the only reason we cared 
was PyPy3 -- but PyPy3.3.5 is not exactly production ready, and since they're 
working hard on the move to 3.5, I think there's no reason hanging around on 
3.3. Hence, 16.5 will still support it in line with our compat policy, but 16.6 
(the next release -- might be called 16.11 or 16.12 by that time!) will drop it 
completely.

Enjoy 16.4.0!

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Waiting time for tests running on Travis CI and Buildbot

[Amber "Hawkie" Brown]

The only reason to support Python 3.3 is PyPy3. However, since they now have 
funding to push it to 3.5, and PyPy3 is by no means production ready, I think 
it is reasonable to do this.

I will announce the release after Twisted 16.4 as the final one to support 
Python 3.3, in accordance with our compatibility policy.

- Amber

> On 24 Aug 2016, at 01:27, Mark Williams  wrote:
> 
> On Tue, Aug 23, 2016 at 09:44:16AM -0700, Glyph Lefkowitz wrote:
>> 
>> We can drop support for 3.3 of course, but that's a separate discussion.
> 
> I'm marginally in favor of it.  I appreciate Adi's concern about the
> build infrastructure.  And thanks to the inimitable Donald Stufft,
> it's easy to get a sense of how popular Python 3.3 is among Twisted
> users and whether or not dropping support for it will affect a large
> percentage of them.
> 
> He provided the following BigTable Query to run against the PyPI
> downloads dataset (available at
> https://bigquery.cloud.google.com/dataset/the-psf:pypi?pli=1 ):
> 
> SELECT
>  REGEXP_EXTRACT(details.python, r"^([^\.]+\.[^\.]+)") as python_version,
>  COUNT(*) as downloads,
> FROM
>  TABLE_DATE_RANGE(
>[the-psf:pypi.downloads],
>DATE_ADD(CURRENT_TIMESTAMP(), -31, "day"),
>DATE_ADD(CURRENT_TIMESTAMP(), -1, "day")
>  )
> WHERE file.project = 'twisted'
> GROUP BY python_version
> ORDER BY
>  downloads DESC
> 
> 
> Here're the results:
> 
> python_versiondownloads
> 2.7 446869
> null21959
> 3.5 15204
> 3.4 11245
> 2.6 5060
> 3.3 1060
> 3.2 271
> 3.6 241
> 2.4 5
> 1.17  3
> 2.5   2
> 
> (Donald explained that `null` represents mirrors and caches like
> bandersnatch.)
> 
> It appears that dropping Python 3.3 wouldn't exclude very many of our
> users.
> 
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Please fix the broken buildbots

[Amber "Hawkie" Brown]

So I also investigated and it appeared like the hack I had in 
https://github.com/twisted-infra/braid/blob/master/services/buildbot/master/twisted_factories.py#L368
 to prevent this from occurring disappeared in prod; I think maybe Adi pushed 
up something trying to replicate what it was doing without committing it :)

I've redeployed from master of braid, and it appears to be working now.

- Amber

> On 23 Aug 2016, at 15:43, Mark Williams  wrote:
> 
> Glyph got me all set up so I can work on the Buildbots.  Thanks,
> Glyph!
> 
> I hope to resolve the issue Craig identified soon and will announce
> any progress.  Stay tuned!
> 
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.4.0 Prerelease 2 Announcement

[Amber "Hawkie" Brown]

Hi everyone!

I bring you a new Twisted 16.4.0 prerelease, with the following fixes:

- Twisted's HTTP server, when operating over TLS, would not cleanly close 
sockets, causing it to build up CLOSE_WAIT sockets until it would eventually 
run out of file descriptors. (from 16.3.2)
- AMP no longer fails on floats on Python 3.

For more information, check the NEWS file (link provided below).

As usual, it's available for download -- go here 
(https://twistedmatrix.com/Releases/pre/16.4.0pre2/ 
) to get the prerelease 
tarballs and the full NEWS file. If you want to install it right away, run:

   pip install 
https://twistedmatrix.com/Releases/pre/16.4.0pre2/Twisted-16.4.0rc2.tar.bz2 


Please let me know if you have any issues, as well as if you don't! If 
everything works well, that's a good thing for me to know :)

Twisted Regards,
Amber Brown (HawkOwl)


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.3.2 Release Announcement

[Amber "Hawkie" Brown]

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release 
of Twisted 16.3.1.

This is a security fix release, and is recommended for all users of Twisted. 
The fixes contained are:

- Twisted's HTTP server, when operating over TLS, would not cleanly close 
sockets, causing it to build up CLOSE_WAIT sockets until it would eventually 
run out of file descriptors.

For more information, check the NEWS file (link provided below).

You can find the downloads at > (or alternatively 
>). The NEWS file is also 
available at >.

Many thanks to everyone who had a part in this release - the supporters of the 
Twisted Software Foundation, the developers who contributed code as well as 
documentation, and all the people building great things with Twisted!

Twisted Regards,
Amber Brown (HawkOwl)


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Moving under a src directory, or: Sorry But I Broke All Your Pull Requests

[Amber "Hawkie" Brown]

Hi everyone,

I have just merged the branch which puts twisted under a src/ directory. The 
reasons are many (see https://hynek.me/articles/testing-packaging/ for details 
as to why this is a Fantastic Idea), and it will require a bit of care with 
existing branches and pull requests.

Thankfully, glyph has scripted all that your PR should need to do:

python admin/fix-for-src-mv.py

This will move everything under the src/ dir. If you have moved/renamed files 
in your PR, you may need to manually fix the conflicts.

Happy hacking, everyone :)

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] [BACKWARDS INCOMPATIBILITY] Making twisted.python.dist3 private

[Amber "Hawkie" Brown]

Hi everyone,

I am moving the dist3 from a whitelist to a blacklist, and that requires 
changing the whole module's interface, which shouldn't be public anyway.

You can get the branch here: https://github.com/twisted/twisted/pull/501 , 
it'll be available for a further week.

The only concern for this code was depgraph, which we are now at the point of 
not needing, as we're getting to leaf modules and not core modules.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.3.1 Release Announcement

[Amber "Hawkie" Brown]

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release 
of Twisted 16.3.1.

This is a bug fix & security fix release, and is recommended for all users of 
Twisted. The fixes are:

- A bugfix for a HTTP/2 edge case,
- Fix for CVE-2008-7317 (generating potentially guessable HTTP session 
identifiers)
- Fix for CVE-2008-7318 (sending secure session cookies over insecured 
connections)
- Fix for CVE-2016-1000111 (http://httpoxy.org/ )

For more information, check the NEWS file (link provided below).

You can find the downloads at > (or alternatively 
>). The NEWS file is also 
available at >.

Many thanks to everyone who had a part in this release - the supporters of the 
Twisted Software Foundation, the developers who contributed code as well as 
documentation, and all the people building great things with Twisted!

Twisted Regards,
Amber Brown (HawkOwl)


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.4.0 Prerelease 1 Announcement

[Amber "Hawkie" Brown]

In a rare Twisted release double feature right after 16.3.1, I bring you the 
first prerelease of Twisted 16.4.0.

This is a big release, the first after the Git migration has really kicked in! 
And so, here's what it brings us:

- twist, a new command line tool for running Twisted plugins, similar to twistd 
but with a simpler, cleaner interface.
- A new interface for Protocols, IHandshakeListener, which tells Twisted to 
tell the Protocol when the TLS handshake has been completed.
- async/await support for Deferreds, allowing you to write Python 3.5+ 
coroutines using Twisted
- Trial can be invoked with "python -m twisted.trial".
- 35+ more modules ported to Python 3, and many many cleanups on the way to 
Python 3 on Windows support.
- 240+ closed tickets overall.

For more information, check the NEWS file (link provided below).

As usual, it's available for download -- go here 
(https://twistedmatrix.com/Releases/pre/16.4.0pre1/ 
) to get the prerelease 
tarballs and the full NEWS file. If you want to install it right away, run:

   pip install 
https://twistedmatrix.com/Releases/pre/16.4.0pre1/Twisted-16.4.0rc1.tar.bz2 


Please let me know if you have any issues, as well as if you don't! If 
everything works well, that's a good thing for me to know :)

Twisted Regards,
Amber Brown (HawkOwl)


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] IProtocolWithReactor, or passing the reactor though to protocols

[Amber "Hawkie" Brown]

> On 18 Jul 2016, at 09:15, Glyph Lefkowitz <gl...@twistedmatrix.com> wrote:
> 
>> On Jul 16, 2016, at 06:01, Amber Hawkie Brown <hawk...@atleastfornow.net> 
>> wrote:
>> 
>> Yes, that ticket is almost what I want! That is a much better solution for 
>> Protocols.
>> 
>> However, Factories still need the reactor given, and it seems really silly 
>> and very hard to explain why you both would need to create a Factory with a 
>> reference to a reactor, and then call 
>> reactor.listenTCP/endpoint.connect/listen, also with a reactor. I feel like 
>> one of these should really be able to tell the other.
> 
> Which factories need this reference given?  Some need a clock, for e.g. 
> timeouts, but then... that's OK, give them a clock.  The fact that a 
> parameter must sometimes be passed to two different places doesn't mean we 
> shouldn't make it a parameter...

Yes, but it's a very big footgun. If we are using a custom reactor, we must 
pass it at every level of the stack, when the information can easily be got 
from other sources.

> Possibly the problem here is that 'doStart' and 'doStop' ought to receive the 
> reactor passed to them as well.  And maybe something else, too, for that 
> matter, like an address, or an endpoint - that interface has always been a 
> bit annoyingly narrow.  But a concrete use-case would help here.

My use case is making it easier to write things that require the reactor not 
having to be given absolutely everywhere -- it's very very inpenetrable to look 
at every interface and see if it has a reactor parameter.

> 
>> This also doesn't fit the problem idnar raised on IRC -- that the reactor 
>> serving the connections may not be the one that the protocol wants to use, 
>> for whatever reason (gui reactor and a not gui reactor?)
> 
> This use-case doesn't make any sense, because if you want to have a GUI you 
> need to use a GUI reactor for everything; the reference passed is the running 
> reactor.
> 

Different reactors in threads (e.g. gilectomy, STM).

>> -- I can't say if #3205 has the same problems, but I believe it does. I 
>> guess then that's up to the protocol, but I kind of would like if all 
>> protocols had one consistent place for "this is the reactor I should 
>> schedule things on" -- and transport.reactor does not seem to be it, because 
>> that's still got the problem that idnar has raised.
> 
> Where did idnar raise this problem?  I am still not clear on exactly what 
> we're talking about.

IRC, like I mentioned :)

> 
> -glyph
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] IProtocolWithReactor, or passing the reactor though to protocols

[Amber "Hawkie" Brown]

> On 15 Jul 2016, at 23:06, Glyph Lefkowitz <gl...@twistedmatrix.com> wrote:
> 
>> 
>> On Jul 15, 2016, at 6:02 AM, Amber Hawkie Brown <hawk...@atleastfornow.net> 
>> wrote:
>> 
>> (disclaimer: this is after several hours on an aeroplane, this may all be 
>> nonsense)
>> 
>> So, I'm currently looking into adding some features to twisted.web -- 
>> something that historically hasn't had the best support for pluggable 
>> reactors, and which requires levels and levels of monkeypatching (see the 
>> top level of 
>> https://github.com/twisted/twisted/compare/trunk...deferreds-in-resrender-3711
>>  ). So, I was thinking, what if we made a new way for things to get their 
>> reactor, rather than extending all these concrete implementations everywhere?
>> 
>> Currently, you'd pass a reactor instance through to protocols by making the 
>> factory understand it, and the protocol calling self.factory._reactor or 
>> whatever. I never thought this was a supremely helpful or useful interface 
>> -- especially for one-shot classes -- so what if instead we made a new 
>> IProtocol-extending interface, which signals to tcp.Port/etc that the 
>> protocol, once created, should have a reactor set on it (maybe through some 
>> "setConnectingReactor" or something). This would mean that the factory 
>> doesn't know about the reactor in most cases (with things like HTTPFactory 
>> doing logging as an exception) -- but we could also have an 
>> IClient/ServerFactoryWithReactor, that Endpoints (which needs to know about 
>> the reactor, and which reactor it is listening on) can then check for and 
>> call a similar function, telling the Factory what reactor it is actually 
>> running under.
>> 
>> This, I think, would reduce a bunch of duplicate code in __init__s of 
>> factories, and could be implemented in the base class of Protocol or 
>> ServerFactory, possibly. What do people think?
> 
> 
> First off, I think a clearer articulation of the problem would be helpful :). 
>  Is it "I don't want to take parameters in __init__"?  Or "I don't want to 
> have duplicated code to grab the global reactor everywhere, but I still want 
> to grab the global reactor everywhere"?  Is it "most factories don't need the 
> reactor except to hand it to their protocols, therefore they shouldn't have 
> to have code to deal with it at all"?
> 
> I definitely don't think we should address any of these issues with 
> 'setConnectedReactor'.  This is using a side-effect rather than just 
> constructing the object with the things that it needs.  We also shouldn't do 
> it with a base class.  Depending even more on inheritance would be movement 
> in the wrong direction.
> 
> If we want to address the issue of duplicated code in constructors, how about 
> something like a @reactorParameter(name='reactor') decorator, which does the 
> grab-the-current-global-reactor-if-it's-not-passed thing?  A better pattern 
> is 'just pass in the reactor', of course.
> 
> Or, perhaps what you want is this 7-year-old ticket? :) 
> https://twistedmatrix.com/trac/ticket/3205
> 
> -glyph

Yes, that ticket is almost what I want! That is a much better solution for 
Protocols.

However, Factories still need the reactor given, and it seems really silly and 
very hard to explain why you both would need to create a Factory with a 
reference to a reactor, and then call 
reactor.listenTCP/endpoint.connect/listen, also with a reactor. I feel like one 
of these should really be able to tell the other.

This also doesn't fit the problem idnar raised on IRC -- that the reactor 
serving the connections may not be the one that the protocol wants to use, for 
whatever reason (gui reactor and a not gui reactor?) -- I can't say if #3205 
has the same problems, but I believe it does. I guess then that's up to the 
protocol, but I kind of would like if all protocols had one consistent place 
for "this is the reactor I should schedule things on" -- and transport.reactor 
does not seem to be it, because that's still got the problem that idnar has 
raised.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Twisted 16.3.0 Prerelease 2 Announcement

[Amber "Hawkie" Brown]

Hmm, I have it working fine (Python 2.7/3.5, w/ Cryptography wheels on OS X)...

The default ciphers in Twisted are:

ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+3DES:!aNULL:!MD5:!DSS

So I am not sure why it's not picking up 
"TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256" first...

- Amber

> On 10 Jul 2016, at 01:30, Paweł Miech  wrote:
> 
> Thanks for fixing this.
> 
> Did anyone actually manage to make HTTP2 in Twisted work with Google-Chrome? 
> I tried to do this today, and it seems this is surprisingly difficult. It 
> turns out that Chrome requires ALPN and it dropped support for NPN. ALPN is 
> only supported with OpenSSL 1.0.2 or above, which by default is not available 
> in most systems. This is discussed here. I tried setting up docker image with 
> Ubuntu 16.04 that has required version of OpenSSL, but it seems that Chrome 
> still doesn't like it. It returns ERR_SPDY_INADEQUATE_TRANSPORT_SECURITY 
> error and fails to load page. Looking up this error I found out this might be 
> happening because some TSL ciphers are blacklisted in HTTP2, there is nice 
> answer about this here it links to this part of HTTP2 spec 
> https://http2.github.io/http2-spec/#rfc.section.9.2.2
> 
> My question is: should user deal with this kind of stuff themselves? If some 
> ciphers are blacklisted in HTTP2 shouldn't this be handled somewhere in 
> Twisted? E.g. perhaps there should be some Http2SSLContextFactory? If you'd 
> like to reproduce this I did some sample repo here: 
> https://github.com/pawelmhm/sf-books-http2 it contains dockerfile that builds 
> from Ubuntu 16.04 and runs simple Twisted HTTP 2 resource.
> 
> 2016-07-04 13:48 GMT+02:00 Craig Rodrigues :
> On Sun, Jul 3, 2016 at 3:15 AM, Paweł Miech  wrote:
> HTTP2 support sounds really exciting.
> 
> > Please let me know if you have any issues, as well as if you don't! If 
> > everything works well, that's a good thing for me to know :)
> 
> I played around with this today and found out that the command you recommend:
> 
> >  pip install -U 
> > https://twistedmatrix.com/Releases/pre/16.3.0pre2/Twisted-16.3.0rc2.tar.bz2#egg=Twisted[http2,tls]
> 
> does NOT install dependencies when ran on Python 3, I had to manually install 
> h2 to HTTP2 support to work. It works ok on Python 2. My installation logs on 
> Python 3.4 look like this:
> 
> 
> I think I've fixed that in trunk with this:
> 
> https://github.com/twisted/twisted/pull/287
> 
> --
> Craig
> 
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python
> 
> 
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.3.0 Release Announcement

[Amber Hawkie Brown]

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release 
of Twisted 16.3.0.

The highlights of this release are:

- The Git migration has happened, so we've updated our development 
documentation to match. We're now trialling accepting pull requests at 
github.com/twisted/twisted, so if you've ever wanted an excuse to contribute, 
now's the chance!
- In our steady shedding of baggage, twisted.spread.ui, twisted.manhole (not to 
be confused with twisted.conch.manhole!), and a bunch of old and deprecated 
stuff from twisted.python.reflect and twisted.protocols.sip have been removed.
- twisted.web's HTTP server now handles pipelined requests better -- it used to 
try and process them in parallel, but this was fraught with problems and now it 
processes them in series, which is less surprising to code that expects the 
Request's transport to not be buffered (e.g. WebSockets). There is also a 
bugfix for HTTP timeouts not working in 16.2.
- Twisted now has HTTP/2 support in its web server! This is currently not 
available by default -- you will need to install hyper-h2, which is available 
in the [h2] setuptools extras. If you want to play around with it "pip install 
twisted[h2]" (on Python 2, a bugfix release will make it available on Python 3) 
and add "h2" to your Site's acceptableProtocols.
- 53 tickets closed overall, including cleanups that move us closer to a total 
Python 3 port.

For more information, check the NEWS file (link provided below).

You can find the downloads at  (or 
alternatively ). The NEWS file is 
also available at .

Many thanks to everyone who had a part in this release - the supporters of the 
Twisted Software Foundation, the developers who contributed code as well as 
documentation, and all the people building great things with Twisted!

Twisted Regards,
Amber Brown (HawkOwl)


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.3.0 Prerelease 2 Announcement

[Amber "Hawkie" Brown]

Hi everyone,

Here's another prerelease in the 16.3 series -- fixing a 16.2 regression in 
HTTP timeouts not working.

For more information, check the NEWS file (link provided below).

As usual, it's available for download -- go here 
(https://twistedmatrix.com/Releases/pre/16.3.0pre2/) to get the prerelease 
tarballs and the full NEWS file. If you want to install it right away, run:

   pip install 
https://twistedmatrix.com/Releases/pre/16.3.0pre2/Twisted-16.3.0rc2.tar.bz2

A reminder that if you would like to try out the newly-landed HTTP/2 support, 
run:

   pip install -U 
https://twistedmatrix.com/Releases/pre/16.3.0pre2/Twisted-16.3.0rc2.tar.bz2#egg=Twisted[http2,tls]

This will download the new HTTP/2 dependencies and the TLS requirements as well.

Please let me know if you have any issues, as well as if you don't! If 
everything works well, that's a good thing for me to know :)

Twisted Regards,
Amber Brown (HawkOwl)


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] two minor things

[Amber "Hawkie" Brown]

> On 22 Jun 2016, at 18:51, Tristan Seligmann  wrote:
> 
> On Wed, 22 Jun 2016 at 10:05 Glyph  wrote:
> 
> If we are going to change this, I would really appreciate it if someone in 
> favor of the change would write a script to re-name the literally thousands 
> of outstanding branches to the new convention, so we don't have a random mix. 
>  Luckily git makes this considerably more light weight, since it just changes 
> the name of the pointer and doesn't create new revisions :-).
> 
> I think most of the "outstanding branches" are actually merged, and need to 
> be deleted. So maybe a script to do that first...? (Sorry, I'm not likely to 
> get around to this any time soon)

I might take a stab at this... firstly we want to delete the merged ones, and 
then migrate the rest.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.3.0 Prerelease 1 Announcement

[Amber "Hawkie" Brown]

Hello everyone! It's time for yet another Twisted release -- although not long 
after the last, we have had a bunch of good changes from the PyCon sprints, and 
some long-awaited work has landed!

- The Git migration has happened, so we've updated our development 
documentation to match. We're now trialling accepting pull requests at 
github.com/twisted/twisted, so if you've ever wanted an excuse to contribute, 
now's the chance!
- In our steady shedding of baggage, twisted.spread.ui, twisted.manhole (not to 
be confused with twisted.conch.manhole!), and a bunch of old and deprecated 
stuff from twisted.python.reflect and twisted.protocols.sip have been removed.
- twisted.web's HTTP server now handles pipelined requests better -- it used to 
try and process them in parallel, but this was fraught with problems and now it 
processes them in series, which is less surprising to code that expects the 
Request's transport to not be buffered (e.g. WebSockets).
- Twisted now has HTTP/2 support in its web server! This is currently not 
available by default -- you will need to install hyper-h2, which is available 
in the [h2] setuptools extras. If you want to play around with it, see the 
install link below. Upon release, you will be able to simply "pip install 
twisted[http2]".
- 53 tickets closed overall, including cleanups that move us closer to a total 
Python 3 port.

For more information, check the NEWS file (link provided below).

As usual, it's available for download -- go here 
(https://twistedmatrix.com/Releases/pre/16.3.0pre1/) to get the prerelease 
tarballs and the full NEWS file. If you want to install it right away, run:

pip install 
https://twistedmatrix.com/Releases/pre/16.3.0pre1/Twisted-16.3.0rc1.tar.bz2

If you would like to try out the newly-landed HTTP/2 support, run:

pip install -U 
https://twistedmatrix.com/Releases/pre/16.3.0pre1/Twisted-16.3.0rc1.tar.bz2#egg=Twisted[http2,tls]

This will download the new HTTP/2 dependencies and the TLS requirements as well.

Please let me know if you have any issues, as well as if you don't! If 
everything works well, that's a good thing for me to know :)

Twisted Regards,
Amber Brown (HawkOwl)



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Porting PB to python3

[Amber "Hawkie" Brown]

> On 13 Jun 2016, at 01:04, Wolfgang Rohdewald  
> wrote:
> 
> Am Freitag, 10. Juni 2016, 12:39:20 CEST schrieb Craig Rodrigues:
>> I hope you haven't lost interest in this, and are still willing to push
>> forward.
> 
> Maybe in autumn. But I rather hope somebody else would continue with this.
> 

I will -- as mentioned, I have a patch that's missing a few things, so I'll 
combine them and keep pushing this forward :)

- Amber

> --
> Wolfgang
> 
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Upcoming Buildbot Changes (Ubuntu version support)

[Amber "Hawkie" Brown]

> On 12 Jun 2016, at 03:36, Glyph <gl...@twistedmatrix.com> wrote:
> 
>> On Jun 10, 2016, at 21:35, Amber Hawkie Brown <hawk...@atleastfornow.net> 
>> wrote:
>> 
>> Hi everyone,
>> 
>> I'm doing some builder work today; including changing the versions of Ubuntu 
>> we test on. From next week, our supported Ubuntu platforms will be:
>> 
>> - Ubuntu 12.04 (Python 2.7)
>> - Ubuntu 14.04 (Python 2.7)
>> - Ubuntu 16.04 (Python 2.7, Python 3.4, Python 3.5, PyPy (unsupported))

(correction, 16.04 dropped Python 3.4 from the repos, so it will be 2.7, 3.5, 
PyPy on that platform, with 3.4 being covered by Fedora)

> 
> Cool!  Is this going to let us delete any builders? :)

Yes, all of our 15.04 and 15.10 builders can be removed now, which I'll do 
shortly.

> 
>> These are all LTS versions right now, and should provide us pretty wide 
>> coverage of Ubuntus that are widely used.
> 
> Thanks for taking on this maintenance.

:)

> 
> -g
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] overview: new review queue venue

[Amber "Hawkie" Brown]

Mark has been working on a bot which would reopen it with a comment: 
https://github.com/markrwilliams/txghbot

- Amber

> On 23 May 2016, at 12:56, Craig Rodrigues  wrote:
> 
> I submitted this PR, which is now closed: 
> https://github.com/twisted/twisted/pull/62
> 
> I don't want to re-open that PR, but I am using that as an example
> As an example, if I wanted to re-open that, how would I go about doing it?
> 
> I am not an administrator of the Twisted GitHub project, so on that web link,
> there is no option for me to re-open the PR.
> 
> Are you suggesting that I would need to
>-> create a new branch in my repo with new commits
>-> create a new pull request
> 
> ?
> 
> --
> Craig
> 
> On Sun, May 22, 2016 at 9:39 PM, meejah  wrote:
> 
> closing a PR with a nice note explaining, "please re-open when X is
> fixed/changed" scares away a potential contributer I have my doubts as
> to whether they would fix X if you *didn't* close it...)
> 
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] overview: new review queue venue

[Amber "Hawkie" Brown]

> On 22 May 2016, at 15:23, Glyph  wrote:
> 
> 
>> On May 22, 2016, at 12:15 AM, Hynek Schlawack  wrote:
>> 
>> Ah finally a fine bike shedding thread that gets everyone involved. ;)
> 
> OKAY NOW THAT I'VE GOT YOU ALL HERE LET'S TALK ABOUT 
> https://twistedmatrix.com/trac/ticket/288
> 
> *slams a metal grating shut over the only exit from the mailing list*
> 
JEAN-CHA^W^W GLYPH YOU FOOL, YOU'VE LOCKED US ALL IN!

> -glyph


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] overview: new review queue venue

[Amber "Hawkie" Brown]

> On 22 May 2016, at 14:24, Daniel Sank  wrote:
> 
> All,
> 
> > Please do not use squash commits.  See 
> > http://mjg59.dreamwidth.org/42759.html.
> 
> Squashing commits is essential to making useful commit histories. Are you 
> just saying not to use Github's built-in feature which squashes everything 
> into a _single_ commit? If so, note that you can turn that GUI feature off so 
> nobody is tempted to use it. That does leave the question of whether you want 
> people to use merge commits or to rebase their branch on the latest master 
> before merging so that you always get a fast-forward.
> 

The thing is that we don't want fast-forward; fast-forward merging creates 
awful commit histories with no regard to branches, especially for ones like 
Twisted where (near) every commit on trunk needs to be a deployable one, and 
where we may need to revert an entire branch.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] overview: new review queue venue

[Amber "Hawkie" Brown]

> On 22 May 2016, at 14:15, Glyph  wrote:
> 
> Sorry, I guess I wasn't clear.  I know that PRs are presently a potential 
> alternative to a diff, and that we are still using Trac for ticketing.  I 
> want to make it possible to avoid using Trac for ticketing; perhaps switching 
> to github issues entirely.

This is an optimistic idea but one that, unfortunately, won't happen yet ;)

The things GitHub Issues need to be competitive with Trac as it stands:

- Allowing triage by people without write.
- Useful search (GitHub search is kind of abysmal)
- Assigning to non-committers.

Without these things (and quite a few more), it's unlikely that GitHub Issues 
will be as useful to us.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] overview: new review queue venue

[Amber "Hawkie" Brown]

> On 22 May 2016, at 06:12, Glyph  wrote:
> 
> It is therefore tempting to map it into GitHub via labels and webhooks and 
> bot workflows.  However, I think a better mapping would be this:
> 
>   • Proposing: Just open a pull request.  Any open pull request should be 
> treated as part of the queue.
>   • Accepting: A committer pushes the big green button; this
>   • Reviewing: This is the potentially slightly odd part.  I believe a 
> review that doesn't result in acceptance should close the PR.  We need to be 
> careful to always include some text that explains that closing a PR does not 
> mean that the change is rejected, just that the submitter must re-submit.  
> Initially this would just mean opening a new PR, but Mark Williams is working 
> on a bot to re-open pull requests when a submitter posts a "please review" 
> comment: https://github.com/markrwilliams/txghbot
>   • Responding: A submitter can open a new PR, or, once we start running 
> txghbot, reopen their closed PR.
>   • Viewing: 
> https://github.com/twisted/twisted/pulls?utf8=✓=is%3Apr+is%3Aopen+-status%3Afailed

I think this is reasonable. I believe txghbot is in a place where we can start 
using it for just that.

> The one thing that this workflow is missing from trac is a convenient way for 
> committers, having eyeballed a patch for any obvious malware, to send it to 
> the buildbots.
> 
> We could also potentially just replace our buildbot build farm with a 
> combination of appveyor and travis-ci; this would remove FreeBSD from our 
> list of supported platforms, as well as eliminating a diversity of kernel 
> integrations.  However, for the stuff that doesn't work in containers (mostly 
> inotify) we could run one builder on non-container-based infrastructure, and 
> for everything else (integrating with different system toolchains) we can 
> test using Docker: https://docs.travis-ci.com/user/docker/.  I am very much 
> on the fence about this, since I don't want to move backwards in terms of our 
> test coverage, but this would accelerate the contribution process so much 
> that it's probably worth discussing.

I don't think that this will do us any good. Having travis/appveyor to be a 
first line of review (giving a quick "builds fail/builds probably pass) so that 
contributors get an immediate "does this have a chance of being merged" is a 
good thing; but there is certainly value in having the various different 
platforms. All we need is a bit more tooling around it (and I think txghbot is 
a good starting place for that).

We also need to look into some extra tooling around tox; mainly around the 
ratcheting quality checkers -- some form of fetching the latest build from 
buildbot and downloading it locally to compare, or something.

> 10 years ago or so, we would routinely discover kernel bugs in our 
> integration test harness and they would be different on different platforms.  
> But today's platform realities are considerably less harsh, since there are a 
> lot more entities in the ecosystem that have taken responsibility for testing 
> that layer of the stack; I couldn't find anything since 2008 or so where we 
> really saw a difference between Fedora and Ubuntu at the kernel level, for 
> example.

The issue in 2016 is not actually the kernel; but OpenSSL and OpenSSH, among 
other system libraries. Every new version of Fedora has been red on the 
buildbots for this reason; OpenSSL changed, and we needed to fix our use of it. 
Worth also noting is that Travis is so horrendously behind in all things 
Python+Ubuntu (do they even have a current PyPy yet?) that we're not actually 
testing the platforms people are *using*, which is something I think is 
valuable that the current system gives us.

> 
> Thoughts?
> 
> -glyph

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.2 Release Announcement

[Amber "Hawkie" Brown]

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release 
of Twisted 16.2!

Just in time for PyCon US, this release brings a few headlining features (like 
the haproxy endpoint) and the continuation of the modernisation of the 
codebase. More Python 3, less deprecated code, what's not to like?

- twisted.protocols.haproxy.proxyEndpoint, a wrapper endpoint that gives some 
extra information to the wrapped protocols passed by haproxy;
- Migration of twistd and other twisted.application.app users to the new 
logging system (twisted.logger);
- Porting of parts of Twisted Names' server to Python 3;
- The removal of the very old MSN client code and the deprecation of the 
unmaintained ICQ/OSCAR client code;
- More cleanups in Conch in preparation for a Python 3 port and cleanups in 
HTTP code in preparation for HTTP/2 support;
- Over thirty tickets overall closed since 16.1.

For more information, check the NEWS file (link provided below).

You can find the downloads at  (or 
alternatively ). The NEWS file is 
also available at .

Many thanks to everyone who had a part in this release - the supporters of the 
Twisted Software Foundation, the developers who contributed code as well as 
documentation, and all the people building great things with Twisted!

Twisted Regards,
Amber Brown (HawkOwl)


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] [ALL IS WELL] [INFRASTRUCTURE OUTAGE] Migration of Buildbot to new hardware

[Amber "Hawkie" Brown]

Hi everyone,

The BuildBot migration is now complete.

- Amber

> On 11 May 2016, at 16:28, Amber Hawkie Brown <hawk...@atleastfornow.net> 
> wrote:
> 
> Hi everyone,
> 
> Keeping the infrastructure updates coming! I'm going to be moving the 
> Buildbot to new hardware, so it may be down for today, plus however long DNS 
> takes to propagate. This should only affect Twisted committers running tests 
> on the builder infrastructure; Trac, docs, and everything else will remain 
> online.
> 
> - Amber
> ___
> Twisted-web mailing list
> twisted-...@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-web



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] [INCOMPATIBLE CHANGE] Removal of twisted.manhole and twisted.spread.ui

[Amber "Hawkie" Brown]

As part of some spring cleaning, I'm removing two of the largest sections of 
unmaintained, undocumented, and mostly untested code in Twisted. These are 
twisted.manhole (not twisted.conch.manhole, which is over SSH/telnet; 
twisted.manhole is over PB) and twisted.spread.ui (a GTK interface + some other 
things that are similar in purpose, which also depends on twisted.manhole). 
They are both broken and not very useful in their current form; and any 
improvements would require an almost complete rewrite, meaning that there's 
little to no chance that they are worth keeping.

As per the compatibility policy, these two branches are available for you to 
test your applications with:

- https://twistedmatrix.com/trac/ticket/8329 -- removing twisted.spread.ui
- https://twistedmatrix.com/trac/ticket/8330 -- removing twisted.manhole

The git branches are available on the Trac links. They will be available for a 
week from now before the minimum merge time, as per the policy, for you to test 
your applications.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] [INFRASTRUCTURE OUTAGE] Migration of Buildbot to new hardware

[Amber "Hawkie" Brown]

Hi everyone,

Keeping the infrastructure updates coming! I'm going to be moving the Buildbot 
to new hardware, so it may be down for today, plus however long DNS takes to 
propagate. This should only affect Twisted committers running tests on the 
builder infrastructure; Trac, docs, and everything else will remain online.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] [INFRASTRUCTURE OUTAGE] Moving from SVN to Git

[Amber "Hawkie" Brown]

Hi everyone!

It's finally time to pull the trigger on this.

Twisted's Trac may be down intermittently in the next few hours as I do the 
migration.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.2.0pre1 Release Announcement

[Amber "Hawkie" Brown]

Hi everyone! Time for another Twisted prerelease!

Our release cadence stays steady, and this prerelease should bring some new 
nice features! The highlights include:

- twisted.protocols.haproxy.proxyEndpoint, a wrapper endpoint that gives some 
extra information to the wrapped protocols passed by haproxy;
- Migration of twistd and other twisted.application.app users to the new 
logging system (twisted.logger);
- Porting of parts of Twisted Names' server to Python 3;
- The removal of the very old MSN client code and the deprecation of the 
unmaintained ICQ/OSCAR client code;
- More cleanups in Conch in preparation for a Python 3 port and cleanups in 
HTTP code in preparation for HTTP/2 support;
- Over thirty tickets overall closed since 16.1.

For more information, check the NEWS file (link provided below).

As usual, it's available for download -- go here 
(https://twistedmatrix.com/Releases/pre/16.2.0pre1/) to get the prerelease 
tarballs and the full NEWS file.

Please let me know if you have any issues, as well as if you don't! If 
everything works well, that's a good thing for me to know :)

Twisted Regards,
Amber Brown (HawkOwl)



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] [MIGRATION COMPLETE] Changes to Twisted's Trac (GitHub Authentication)

[Amber "Hawkie" Brown]

I would like to note that this migration has now finished, and you can now log 
in via GitHub. Legacy logins have been disabled, and previous admin accounts 
(except for a current handful) have been revoked in the name of minimising our 
security surface; if you once had access to our Trac and would like to still 
use it, please let me know what your GitHub user account is, and I can set 
those permissions back up.

- Amber

> On 27 Apr 2016, at 19:13, Amber Hawkie Brown <hawk...@atleastfornow.net> 
> wrote:
> 
> Hi everyone,
> 
> If you've ever had your password eaten by our Trac instance, had your comment 
> rejected by spambayes, or seen the amount of effort it takes removing random 
> nulls from our htpasswd files, rejoice! With 
> https://github.com/twisted-infra/braid/pull/192 , we are moving our Trac 
> instance to log in using GitHub OAuth. This should mean we solve the issue of 
> keeping passwords (making you and us more secure), being able to turn off the 
> spam filter (as we don't have anonymous ticket submittal, and github is 
> better at catching spammers than we are), and hopefully cause less ongoing 
> issues with passwords suddenly not working.
> 
> What this means for you is that your username and password will no longer 
> work for logging into our Trac, you will need to authorise your GitHub login 
> to access it. This means that you may have another username, please contact 
> me privately and I will see what I can do about migrating any ticket 
> histories over, if you feel like it is needed.
> 
> - Amber
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Changes to Twisted's Trac (GitHub Authentication)

[Amber "Hawkie" Brown]

Hi everyone,

If you've ever had your password eaten by our Trac instance, had your comment 
rejected by spambayes, or seen the amount of effort it takes removing random 
nulls from our htpasswd files, rejoice! With 
https://github.com/twisted-infra/braid/pull/192 , we are moving our Trac 
instance to log in using GitHub OAuth. This should mean we solve the issue of 
keeping passwords (making you and us more secure), being able to turn off the 
spam filter (as we don't have anonymous ticket submittal, and github is better 
at catching spammers than we are), and hopefully cause less ongoing issues with 
passwords suddenly not working.

What this means for you is that your username and password will no longer work 
for logging into our Trac, you will need to authorise your GitHub login to 
access it. This means that you may have another username, please contact me 
privately and I will see what I can do about migrating any ticket histories 
over, if you feel like it is needed.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Twisted 16.1 Release Announcement

[Amber "Hawkie" Brown]

> On 12 Apr 2016, at 21:17, anatoly techtonik  wrote:
> 
> Hi,
> 
> Are there any plans to get back 32-bit wheels for Twisted?
> 
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Hi,

Yes, sometime, when either Glyph or I have the moment to do builder work and 
get the needed stuff installed on the builder. They will be Windows 7-compiled 
32bit wheels.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.1.1 Release Announcement

[Amber "Hawkie" Brown]

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release 
of Twisted 16.1.1!

This is a small bugfix release in the 16.1 series, fixing a bug where `twistd 
web` would not output access logs.

For more information, check the NEWS file (link provided below).

You can find the downloads at  (or 
alternatively ). The NEWS file is 
also available at .

Twisted Regards,
Amber Brown


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.1.1 Prerelease 1 Announcement

[Amber "Hawkie" Brown]

Hi everyone,

I'd like to announce a prerelease of the upcoming Twisted 16.1.1, a patch 
release for Twisted 16.1. This fixes a regression in twisted.web where requests 
would not be logged.

The tarball and NEWS file can be found at 
https://twistedmatrix.com/Releases/pre/16.1.1pre1/ . Please test this release 
with your software.

If no issues are found, it will be released in a day or two.

Amber Brown
Twisted Release Manager


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.1 Release Announcement

[Amber "Hawkie" Brown]

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release 
of Twisted 16.1!

This release is hot off the heels of 16.0 released last month, including some 
nice little tidbits. The highlights include:

- twisted.application.internet.ClientService, a service that maintains a 
persistent outgoing endpoint-based connection -- a replacement for 
ReconnectingClientFactory that uses modern APIs;
- A large (77% on one benchmark) performance improvement when using 
twisted.web's client on PyPy;
- A few conch modules have been ported to Python 3, in preparation for further 
porting of the SSH functionality;
- Full support for OpenSSL 1.0.2f and above;
- t.web.http.Request.addCookie now accepts Unicode and bytes keys/values;
- `twistd manhole` no longer uses a hard-coded SSH host key, and will generate 
one for you on the fly (this adds a 'appdirs' PyPI dependency, installing with 
[conch] will add it automatically);
- Over eighteen tickets overall closed since 16.0.

For more information, check the NEWS file (link provided below).

You can find the downloads at  (or 
alternatively ). The NEWS file is 
also available at .

Many thanks to everyone who had a part in this release - the supporters of the 
Twisted Software Foundation, the developers who contributed code as well as 
documentation, and all the people building great things with Twisted!

Twisted Regards,
Amber Brown (HawkOwl)


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.1.0 Prerelease 1 Announcement

[Amber "Hawkie" Brown]

Hi everyone,

Another Twisted release is upon us -- this one is small, but has some nice to 
haves. In this release is:

- twisted.application.internet.ClientService, a service that maintains a 
persistent outgoing endpoint-based connection -- a replacement for 
ReconnectingClientFactory that uses modern APIs;
- A large (77% on one benchmark) performance improvement when using 
twisted.web's client on PyPy;
- A few conch modules have been ported, in preparation for further porting of 
the SSH functionality;
- Full support for OpenSSL 1.0.2f and above;
- t.web.http.Request.addCookie now accepts Unicode and bytes keys/values;
- `twistd manhole` no longer uses a hard-coded SSH host key, and will generate 
one for you on the fly (this adds a 'appdirs' PyPI dependency, installing with 
[conch] will add it automatically);
- Over eighteen tickets overall closed since 16.0.

As usual, you can get the NEWS file at 
https://twistedmatrix.com/Releases/pre/16.1.0pre1/NEWS.txt and download the 
tarball from https://twistedmatrix.com/Releases/pre/16.1.0pre1/.

Please test this release with your applications, and let me know if all goes 
smoothly. If there's no reported issues, the release will occur in roughly a 
week.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.0 Released

[Amber "Hawkie" Brown]

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release 
of Twisted 16.0!

Twisted 16.0 brings some important changes, and some nice-to-haves as well. The 
major things are:

- TLS endpoints have arrived! They're like the old `ssl:` endpoints, but 
support faster IPv4/IPv6 connections (using HostnameEndpoint) and always do 
hostname verification.
- Conch now uses Cryptography instead of PyCrypto for underlying cryptographic 
operations. This means it'll work much better on PyPy!
- Headers objects (notably used by t.web.server.Request) now support Unicode 
for the vast majority of cases, encoding keys to ISO-8859-1 and values to UTF-8.
- WSGI support and AMP have been ported to Python 3, along with a handful of 
other modules.
- More shedding of the past, with the GTK+ 1 reactor being removed.
- Over 45 tickets have been closed since 15.5.

For more information, check the NEWS file (link provided below).

You can find the downloads at  (or 
alternatively ). The NEWS file is 
also available at .

Many thanks to everyone who had a part in this release - the supporters of the 
Twisted Software Foundation, the developers who contributed code as well as 
documentation, and all the people building great things with Twisted!

Twisted Regards,

Amber Brown (HawkOwl)
Twisted Release Manager


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.0.0 Prerelease 3 Announcement

[Amber "Hawkie" Brown]

Hi everyone,

exarkun spotted a regression in the 16.0.0 prereleases, where calling 
endpoints' serverWithString with a SSL strports description and an empty chain 
file would give an unhelpful error message.

These issues have been fixed and are in Twisted 16.0.0pre3. You can find it and 
the NEWS file at https://twistedmatrix.com/Releases/pre/16.0.0pre3/ .

If no further issues are identified, Twisted 16.0 will be released this week 
(for real!).

- Amber Brown
Twisted Release Manager


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.0.0 Prerelease 2 Announcement

[Amber "Hawkie" Brown]

Hi everyone,

A few issues were identified in Twisted 16.0.0pre1 by the Canonical MAAS team, 
related to the twisted.conch.ssh.keys module missing some dependencies when 
installed on Python 3.

These issues have been fixed and are in Twisted 16.0.0pre2. You can find it and 
the NEWS file at https://twistedmatrix.com/Releases/pre/16.0.0pre2/ .

If no further issues are identified, Twisted 16.0 will be released this week.

- Amber Brown
Twisted Release Manager


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted + OpenSSL 1.0.2f issues resolved

[Amber "Hawkie" Brown]

Hi everyone,

Since Tristan Seligmann has fixed https://twistedmatrix.com/trac/ticket/8189 , 
and the CFFI crash-on-shutdown bugs have been resolved upstream, Twisted is now 
fully compatible with OpenSSL 1.0.2f as included in Cryptography 1.2.2, and as 
included in distributions that have been updated.

This fix is in Twisted trunk, but did not make it into Twisted 16.0. Twisted 
16.1 will include the fix.

Thanks to Tristan and Glyph (the reviewer) for getting this issue fixed.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 16.0pre1 Announcement

[Amber "Hawkie" Brown]

Hi everyone, it's time for another Twisted release!

Twisted 16.0 brings some important changes, and some nice-to-haves as well. The 
major things are:

- TLS endpoints have arrived! They're like the old `ssl:` endpoints, but 
support faster IPv4/IPv6 connections (using HostnameEndpoint) and always do 
hostname verification.
- Conch now uses Cryptography instead of PyCrypto for underlying cryptographic 
operations. This means it'll work much better on PyPy!
- Headers objects (notably used by t.web.server.Request) now support Unicode 
for the vast majority of cases, encoding keys to ISO-8859-1 and values to UTF-8.
- WSGI support and AMP have been ported to Python 3, along with a handful of 
other modules.
- More shedding of the past, with the GTK+ 1 reactor being removed.
- Over 45 tickets have been closed.

As usual, it's available for download -- go here 
(https://twistedmatrix.com/Releases/pre/16.0.0pre1/) to get the prerelease 
tarballs and the full NEWS file.

Please let me know if you have any issues, as well as if you don't! If 
everything works well, that's a good thing for me to know :)

Thanks! <3

- Amber Brown
Twisted Release Manager


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Compatibility issues with Twisted and OpenSSL 1.0.2f

[Amber "Hawkie" Brown]

Hi everyone,

There's a known issue with Twisted + PyOpenSSL>=0.13 using OpenSSL version 
1.0.2f. Please note, this only potentially affects you if:

- You use Windows or OS X -- Cryptography 1.2.2's wheels have a bundled 1.0.2f.
OR
- You use a Linux or FreeBSD distribution which has OpenSSL 1.0.2f. If you are 
using a released distribution of Ubuntu or Debian, you most likely have a 
*patched* (so, still secure) past version (like Ubuntu 15.10, which has a 
patched 1.0.2d). If you are using Fedora 23, you may have 1.0.2f. You can check 
by running "openssl version".

There is also an unrelated issue with CFFI that causes Cryptography 1.2 wheels 
for Windows/OS X to cause CPython to crash on interpreter shutdown.

The current highest working Cryptography version that causes a test suite pass 
is 1.2.2 on Linux with OpenSSL versions other than 1.0.2f, 1.1.2 on Windows & 
OS X without an unreleased CFFI patch, and 1.2.1 once the CFFI patch is 
released. Our Windows and OS X builders have their Cryptography dependencies 
pinned to 1.1.2 until these problems are solved.

Please note, this doesn't mean your applications may or may not work in 
practice with OpenSSL 1.0.2f! It just means the test suite does not pass, so we 
can't be absolutely sure that 1.0.2f will not cause problems for you. The 
latest patched versions of OpenSSL are strongly recommended from a security 
standpoint.

The relevant issues are:

- Make tests pass on 1.0.2f (Twisted, 
https://twistedmatrix.com/trac/ticket/8189)
- Crash during interpreter shutdown when using static callbacks (CFFI, 
https://bitbucket.org/cffi/cffi/issues/246/crash-during-interpreter-shutdown-when)

Regards,

Amber Brown
Twisted Release Manager


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] twisted-python on OS X 10.11 conch does not install

[Amber "Hawkie" Brown]

> On 30 Dec 2015, at 22:10, Adi Roiban  wrote:
> 
> On 30 December 2015 at 15:47, Guglielmo Pasa  
> wrote:
> Hi,
> I’m trying to get twisted installed on OS X 10.11 with virtualenv and 
> python3.5. All dependencies are satisfied.
> It seems to install correctly and it seems that OpenSSL is working pretty 
> well with it.
> 
> But when I try to load
> 
> import Crypto
> import twisted.conch.ssh.transport
> 
> I get
> 
> Traceback (most recent call last):
>   File "", line 1, in 
> ImportError: No module named ‘twisted.conch'
> 
> on inspection, in the folder site-packages/twisted there is no conch folder.
> 
> 
> I tried to build twisted from source and conch doesn’t seem to build either
> 
> What can I do to solve this?
> 
> Use Python 2.7 :)
> 
> Conch.ssh was not ported to Python 3

Yet ;)

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] [(maybe) BACKWARDS INCOMPATIBLE] Moving Twisted to PEP-3333

[Amber "Hawkie" Brown]

> On 22 Dec 2015, at 14:27, Amber Hawkie Brown <hawk...@atleastfornow.net> 
> wrote:
> 
> Hi everyone!
> 
> We've been attempting to port twisted.web.wsgi to Python 3, as of recent. The 
> existence of PEP- makes this easier, but due to our backwards 
> compatibility policy, implementing stricter checks to make sure 
> t.w.wsgi-using applications are actually PEP- may be a change which 
> cannot be easily done.
> 
> The patch we have currently, which is based on work by jMyles (of Hendrix), 
> tirelessly worked on allennap (of Canonical MAAS), and sheparded along by the 
> wonderful Adi (our other Twisted Fellow), is in very good shape, bringing 
> Twisted's WSGI support to be compliant with PEP-. PEP- is much 
> stricter on bytes/Unicode, and the patch introduces some further type 
> checking that the original PEP-333 describes as a must, even though we did 
> not check this before.
> 
> This branch cannot currently be merged because of backwards compatibility 
> issues -- the spirit of our Compatibility Policy is that 'apps keep working', 
> and sufficiently Unicode unclean WSGI applications may break due to it, even 
> though PEP-333 is very explicit in saying that "HTTP does not directly 
> support Unicode, and neither does this interface".
> 
> So, I am looking to get a compat exception for this -- WSGI is very explicit 
> in its types, and any misbehaving applications are violating the 
> specification grossly enough for there to possibly not need a compat 
> exception -- but going through this way may catch the attention of anyone 
> with a potentially misbehaving application and fix it before Twisted 16.0, 
> when I expect this will be merged.
> 
> The ticket is https://twistedmatrix.com/trac/ticket/7993, and the branch you 
> should test against is linked at the top. The compatibility policy will allow 
> a week before we move to merge the ticket, although we may have some changes 
> to the branch to make warnings turn into errors, if we are breaking backwards 
> compat, so please ensure no exceptions *or warnings* are produced by your 
> code.
> 
> Thanks,
> 
> - Amber
> Twisted Fellow, RM, Python 3 Overlord
> ___
> Twisted-web mailing list
> twisted-...@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-web

Hi everyone!

So, with further looking with Tom Prince, it appears that my backwards compat 
fears in regards to Unicode were from my older remembering of the branch, 
allenap and Adi have made it so that it raises a warning on Python 2 if you're 
not Unicode/bytes clean, as well as introducing hard-checks on Python 3, where 
it is reasonable to do so.

So, this should mean that all your Python 2 WSGI apps should keep working, even 
if they're not Unicode clean, but I am still wanting to go through the 
exception process to give users of Twisted's WSGI support a chance to raise any 
problems that they may have with the PEP--compatible code, as unlikely as 
they are to be.

I'd like to say thanks again to allenap and Adi's herculean efforts on this 
branch :)

- Amber



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] [BACKWARDS INCOMPATIBLE] Moving Twisted to PEP-3333

[Amber "Hawkie" Brown]

Hi everyone!

We've been attempting to port twisted.web.wsgi to Python 3, as of recent. The 
existence of PEP- makes this easier, but due to our backwards compatibility 
policy, implementing stricter checks to make sure t.w.wsgi-using applications 
are actually PEP- may be a change which cannot be easily done.

The patch we have currently, which is based on work by jMyles (of Hendrix), 
tirelessly worked on allennap (of Canonical MAAS), and sheparded along by the 
wonderful Adi (our other Twisted Fellow), is in very good shape, bringing 
Twisted's WSGI support to be compliant with PEP-. PEP- is much stricter 
on bytes/Unicode, and the patch introduces some further type checking that the 
original PEP-333 describes as a must, even though we did not check this before.

This branch cannot currently be merged because of backwards compatibility 
issues -- the spirit of our Compatibility Policy is that 'apps keep working', 
and sufficiently Unicode unclean WSGI applications may break due to it, even 
though PEP-333 is very explicit in saying that "HTTP does not directly support 
Unicode, and neither does this interface".

So, I am looking to get a compat exception for this -- WSGI is very explicit in 
its types, and any misbehaving applications are violating the specification 
grossly enough for there to possibly not need a compat exception -- but going 
through this way may catch the attention of anyone with a potentially 
misbehaving application and fix it before Twisted 16.0, when I expect this will 
be merged.

The ticket is https://twistedmatrix.com/trac/ticket/7993, and the branch you 
should test against is linked at the top. The compatibility policy will allow a 
week before we move to merge the ticket, although we may have some changes to 
the branch to make warnings turn into errors, if we are breaking backwards 
compat, so please ensure no exceptions *or warnings* are produced by your code.

Thanks,

- Amber
Twisted Fellow, RM, Python 3 Overlord


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] asynchronous response

[Amber "Hawkie" Brown]

> On 17 Dec 2015, at 08:11, Kevin Mcintyre  wrote:
> 
> Hey - I'm confused, so nothing new :) ...but I'm running at this example and 
> I'm scratching my head.
> 
> http://twistedmatrix.com/documents/current/web/howto/web-in-60/asynchronous-deferred.html
> 
> I would've thought 2 requests could be served simultaneously, but when I fire 
> off 2 requests the first received gets it's response after 5 seconds, while 
> the second response takes 10 seconds.
> 
> I think I understand what's happening, but I don't know why...and I would 
> love an example where the subsequent request doesn't have to wait for the 
> first request to finish.
> 
> Thanks,
> Kevin


I've ran into this before --  browsers sometimes rate-limit requests, and won't 
actually send the second request until the first is done, over the same 
connection, rather than making a second TCP connection -- try using cURL or 
wget, which has no such limitation, and see if it works any better.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] PotentialZombieWarning warning message?

[Amber "Hawkie" Brown]

> On 14 Dec 2015, at 22:52, pisymbol .  wrote:
> 
> Hi:
> 
> I'd like to adopt Twisted for a current project I'm coding up. I'm on
> CentOS 6.7 x86-64 using python v2.6 and the stock
> python-twisted-8.2.0-3.1 package built for this release.

...

> Is there anyway to get rid of this message? I realize I'm using an
> older release of twisted but I can't upgrade to the latest without
> incurring the cost of installing an python v2.7 or greater.

Hi,

Python 2.6 has been EOL for years and Twisted 8.2.0 is nearly seven years old. 
We can't really help with things that old (many, many issues have since been 
fixed, so remembering what's a bug that's been squashed and what's a platform 
bug is nearly impossible), but upgrading to Twisted 15.4 (the last release with 
Python 2.6 support, and only 4 or so months old) may help.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] When's the next release?

[Amber "Hawkie" Brown]

Hi!

Since a release went out just the other week, I'd say January at the earliest. 
Every 2-3 months is the schedule that seems to balance getting things out there 
with the burden of downstream & users having to handle updates.

- Amber

> On 14 Dec 2015, at 20:16, Jonathan Lange  wrote:
> 
> Hello!
> 
> I've just landed a fix to #4811, which ought to make it possible to use trial 
> with regular standard library unittests that have expected failures & 
> unexpected successes.
> 
> I'm very keen to start using that in my code base, and the easiest way for me 
> to do that is for there to be an official release of Twisted. When might one 
> expect the next release to take place?
> 
> Thanks,
> jml
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Python 2.7 on CentOS 6 (was: PotentialZombieWarning warning message?)

[Amber "Hawkie" Brown]

> On 15 Dec 2015, at 08:43, Glyph Lefkowitz  wrote:
> 
>>> But again: Python 2.6 is unsupported by the upstream Python developers.  You
>>> really should not be using it, since it won't receive security updates (of
>>> course, Red Hat and transitively CentOS claim to "support" these packages,
>>> but if upstream is refusing patches at this point, it's not clear where that
>>> support will come from).
>> 
>> As you can imagine, this boils down to politics.
> 
> I understand that things like this often do, which is exactly why I want to 
> make it clear that we (speaking in terms of the broader Python community now, 
> not just Twisted) are trying to push people towards more recent versions just 
> because they're more fun or more aesthetically pleasant, but because there 
> are very real risks associated with being on unsupported ancient versions of 
> things.  It pains me not to be supporting a configuration that some users 
> want, but there is a line where "conservative about change" becomes 
> "negligent about maintenance" and python 2.6 crossed it a little over two 
> years ago :-).

There is a solution to this, and Nick Coghlan has mentioned it to me many times 
-- Software Collections for RHEL and CentOS. Software Collections is RH's 
answer to "new software" on "stable distributions" --  SCLs operate 
side-by-side with system packages, so it won't break anything. Since you're a 
CentOS 6.7 user, the standard SCL should work (it's 6.5+).

You can find the Python 2.7 SCL at 
https://www.softwarecollections.org/en/scls/rhscl/python27/, and CentOS 
publishes instructions on using them on 
https://wiki.centos.org/AdditionalResources/Repositories/SCL . This might solve 
your problem of being restrained to CentOS 6, but Python 2.6 being EOL'd 
everywhere but it.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 15.4 was the last release to support Python 2.6; or: a HawkOwl Can't Words Situation

[Amber "Hawkie" Brown]

Hi everyone!

It's been brought to my attention that I misworded something in the release 
notes and it slipped through the cracks. In the NEWS I said:

> This is the last Twisted release where Python 2.6 is supported, on any 
> platform.

However, I meant that this is the first Twisted release to drop 2.6 support 
wholesale, preventing import on this platform. Twisted 15.4 will still operate, 
so if you have Python 2.6 deployment requirements, bracket the maximum to 15.4 
on that platform by using an if statement in your setup.py, and `Twisted 
>=*minreq*,<=15.4; python_version < '2.7'` under requires_dist in your 
setup.cfg, where minreq is the minimum required Twisted.

Sorry for the inconvenience!

- Amber "HawkOwl" Brown
Twisted Release Manager


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] [INCOMPATIBLE CHANGE] Removing Gadfly support from adbapi

[Amber "Hawkie" Brown]

So, apparently, a long time ago, there was a database called Gadfly, and 
Twisted used to test adbapi against it. However, since then, we've moved on 
from Python versions that gadfly supports, so it outright doesn't work now -- 
not buggy, not weird -- just doesn't even import.

This doesn't change any user facing code, but does change some tests, and even 
though it's covered under the compatibility policy, I thought I'd put it on the 
ML anyway. :)

You can find the code at https://twistedmatrix.com/trac/ticket/8119. We do not 
require any signoffs to remove it, this email is purely informational.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Suggested plan for GitHub migration

[Amber "Hawkie" Brown]

> On 4 Dec 2015, at 11:07, Glyph Lefkowitz  wrote:
> 
> 
>> On Dec 3, 2015, at 3:53 PM, Craig Rodrigues  wrote:
>> 
>> 
>> 
>> On Tue, Dec 1, 2015 at 5:01 PM, Glyph Lefkowitz  
>> wrote:
>> 
>> One thing that I'd love to see is a checklist that is kept up-to-date 
>> regarding which parts of this have already happened.
>> 
>> 
>> I worked with Amber and Adi and we have the checklist:
>> https://github.com/twisted-infra/braid/blob/git-migration-plan/gitmigration.md
> 
> Thank you very much for your participation in this.
> 
> The important thing about a "checklist" though, is checking things off - how 
> will that be kept up to date in sync with what has actually happened?
> 
> -glyph

When it's accepted, we can make it a GItHub issue, and then we can, well, click 
on the checkbox. :)

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Supported Platform Changes: Fedora 23 (3.4) & Ubuntu 15.10 (2.7, 3.5) Added, Fedora 21 (2.7, 3.4) Removed

[Amber "Hawkie" Brown]

Hi everyone,

Three new platforms have been added as supported platforms for Twisted:

- Fedora 23, Python 3.4 (2.7 has test failures, will become supported soon)
- Ubuntu 15.10, Python 2.7
- Ubuntu 15.10, Python 3.5

Additionally, Fedora 21 has gone End Of Life and its builders have been removed.

Regards,

Amber Brown
Twisted Infrastructure Owl


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Suggested plan for GitHub migration

[Amber "Hawkie" Brown]

Hi Craig,

Thanks for this, sharing your past experience is invaluable :)

I've gone through and thought about it a bit, and rewritten it into 
https://github.com/twisted-infra/braid/blob/git-migration-plan/gitmigration.rst 
-- it is basically your plan, with some added notes about Twisted Infra 
specific parts. I've skimmed over the specific details, since I feel that going 
too in-depth in such a plan will just be wasted effort as unknown issues arise, 
but with enough structure that we have a clear set of overarching goals for 
each step.

The migration will have a handful of policy changes that we will have to 
resolve -- such as ensuring that all merges have a topfile -- which aren't 
possible under a GitHub based system. I think these issues will just involve a 
lot of scrutiny and double checking during the transitional period until we are 
confident that we are enforcing our existing quality and process standards.

If anyone has any suggestions, or any more invaluable experience to share, 
please do :)

- Amber


> On 18 Nov 2015, at 07:48, Craig Rodrigues  wrote:
> 
> On Tue, Nov 17, 2015 at 8:57 AM, Adi Roiban  wrote:
> 
> For now, the funds were raised to migrate to GitHub, so we can not use
> them to do other things.
> 
> We will stay on Trac for issues... at least for now.
> 
> I have no idea how we can migrate to any issue tracker without losing
> data if we don't have full access to the database.
> 
> It is possible to migrate to another issue tracker and not lose
> data.  I've done Trac -> Redmine, and it works, but there was an existing 
> migration
> script I could use.
> For migrating to a cloud based bug tracker, you would need to take every user
> in the existing Trac database, and see if there would be a way to map
> the existing users to the cloud database, such as GitHub.  It's a lot of 
> work, but possible.
> However, for the scope of this project, if staying with Trac for issues is 
> what is required, that is fine.
> 
> 
> We don't plan to migrate to GitHub Issues / GitHub Wiki / GitHub Pages
> 
> 
> OK.
> 
> So based on what you have listed, I would say that most of the work will be
> working with Git post commit hooks.
> 
> I would say the plan should be something like this.
> 
> A.1  https://github.com/twisted/twisted will be the "repository of truth"
>for Twisted.
>-> Twisted releases will be done from GitHub
>-> the Twisted developers who are now "core committers" for SVN, 
> must be
>given access to be "core committers" to 
> https://github.com/twisted/twisted
> 
> A.2  On the Trac server, a local git mirror of the GitHub must be set up.
>Every bug tracker I've seen that integrates with git needs a local 
> mirror of the repo
> in order to parse the git history in order to update the bug database.
> This mirror should be read-only, and the only thing updating this 
> repo should be the Trac GitHub plugin.
> 
> A.3  On the Trac server, this plugin must be installed: 
> https://github.com/trac-hacks/trac-github
> 
> A.4  On the GitHub server, a post-commit web hook must be configured.  The 
> workflow will be this:
> 
>[core committer does push to https://github.com/twisted/twisted]
>  -> [post commit GitHub hook will be called to poke the Trac 
> GitHub plugin]
>  -> [Trac GitHub plugin will update the local git repo on the 
> Trac server]
>  -> [Trac GitHub will parse the git history for new commits and 
> update tickets]
> 
> I would recommend that steps (1) - (4) be made to work in a staging 
> environment, with a separate
> GitHub repo, and a separate copy of the Trac database.  That way, you can 
> test things out without derailing
> Twisted developers.  When you are confident that this workflow works, then 
> the transition plan will be something
> like the following.
> 
> B.1   Send an e-mail to the mailing list and pick one day for the maintenance 
> window.
> This will warn folks when they should take a holiday from Twisted 
> work. :)
> 
> B.2   When maintenance is about to begin, send a [HEADSUP] mail saying that 
> repo will be unavailable.
> 
> B.3  Create Subversion pre-commit hook to disable all commits to
>  Subversion:
>   
> http://stackoverflow.com/questions/2411122/how-to-freeze-entire-svn-repository-to-make-it-read-only
> 
> B.4  Set up steps A.1 - A.4
> 
> B.5  Verify that B.4 works.  Have someone (Glyph?) do a commit to 
> https://github.com/twisted/twisted, and
>  make sure that Trac works.
> 
> B.6  Once the Twisted core team are satisified that everything works, send an 
> e-mail to the mailing list
> that the maintenance window is over, and GitHub is now where the 
> action is!
> 
> B.7  Update all wiki documentation to change all references to getting code 
> from Subversion,
>  to getting code from GitHub.
> 
> B.8  Update all systems 

[Twisted-Python] Twisted 15.5 Release Announcement

[Amber "Hawkie" Brown]

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release 
of Twisted 15.5!

The sixth (!!) release in 2015 has quite a few goodies in it -- incrementalism 
is the name of the game here, and everything is just a little better than it 
was before. Some of the highlights of this release are:

- Python 3.5 support on POSIX was added, and Python 2.6 support was dropped. We 
also only support x64 Python on Windows 7 now.
- More than nine additional modules have been ported to Python 3, ranging from 
Twisted Web's Agent and downloadPage, twisted.python.logfile, and many others, 
as well as...
- twistd is ported to Python 3, and its first plugin, web, is ported.
- twisted.python.url, a new URL/IRI abstraction, has been introduced to answer 
the question "just what IS a URL" in Twisted, once and for all.
- NPN and ALPN support has been added to Twisted's TLS implementation, paving 
the way for HTTP/2.
- Conch now supports the DH group14-sha1 and group-exchange-sha256 key exchange 
algorithms, as well as hmac-sha2-256 and hmac-sha2-512 MAC algorithms. Conch 
also works nicer with newer OpenSSH implementations.
- Twisted's IRC support now has a sendCommand() method, which enables the use 
of sending messages with tags.
- 55+ closed tickets overall.

For more information, check the NEWS file (link provided below).

You can find the downloads at <https://pypi.python.org/pypi/Twisted> (or 
alternatively <http://twistedmatrix.com/trac/wiki/Downloads>) .
The NEWS file is also available at 
<https://github.com/twisted/twisted/blob/twisted-15.5.0/NEWS>.

Also worth noting is the two Twisted Software Foundation fellows -- Adi Roiban 
and myself -- who have been able to dedicate time to reviewing tickets and 
generally pushing things along in the process. We're funded by the Twisted 
Software Foundation, which is, in turn, funded by donators and sponsors -- 
potentially like you! If you would like to know how you can assist in the 
continued funding of the Fellowship program, see our website: 
https://twistedmatrix.com/trac/wiki/TwistedSoftwareFoundation#BenefitsofSponsorship

Many thanks to everyone who had a part in this release - the supporters of the 
Twisted Software Foundation, the developers who contributed code as well as 
documentation, and all the people building great things with Twisted!

Twisted Regards,

Amber "Hawkie" Brown
Twisted Release Manager, Twisted Fellow


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] doc breakage

[Amber "Hawkie" Brown]

> On 27 Nov 2015, at 20:10, Phil Mayers  wrote:
> 
> Does this look right?
> 
> https://twistedmatrix.com/documents/current/api/twisted.internet.interfaces.IReadWriteDescriptor.html
> 
> Looks like docs for logPrefix has stomped on docs for all the other interface 
> methods?
> 
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Yeah, this is a bug in PyDoctor we haven't got to the bottom of... sorry!

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 15.5.0 Prerelease 2 Announcement

[Amber "Hawkie" Brown]

Hi everyone,

Twisted 15.5.0pre2 is now available for download. This includes a bugfix for a 
regression in 15.5 which prevents Twisted Web's client from doing requests to 
raw IPv6 addresses.

You can find the new release and the NEWS file at 
https://twistedmatrix.com/Releases/pre/15.5.0pre2/. Please test it! If no more 
issues are found, 15.5 will release sometime at the end of this week.

Regards,
Amber Brown
Twisted Release Manager


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 15.5 Prerelease 1 Announcement

[Amber "Hawkie" Brown]

Hello everyone!

Hot off the presses comes Twisted 15.5.0pre1, the prerelease of Twisted 15.5, 
which has been described by some as "totally radical" and "off the wall".

In this release:

- Python 3.5 support on POSIX was added, and Python 2.6 support was dropped.
- More than nine additional modules have been ported to Python 3, ranging from 
Twisted Web's Agent and downloadPage, twisted.python.logfile, and many others, 
as well as...
- twistd is ported to Python 3, and its first plugin, web, is ported.
- twisted.python.url, a new URL/IRI abstraction, has been introduced to answer 
the question "just what IS a URL" in Twisted, once and for all.
- NPN and ALPN support has been added to Twisted's TLS implementation, paving 
the way for HTTP/2.
- Conch now supports the DH group14-sha1 and group-exchange-sha256 key exchange 
algorithms, as well as hmac-sha2-256 and hmac-sha2-512 MAC algorithms. Conch 
also works nicer with newer OpenSSH implementations.
- Twisted's IRC support now has a sendCommand() method, which enables the use 
of sending messages with tags.
- 55+ closed tickets overall.

As usual, it's available for download -- go here 
(https://twistedmatrix.com/Releases/pre/15.5.0pre1/) to get the prerelease 
tarballs and the full NEWS file.

Please let me know if you have any issues, as well as if you don't! If 
everything works well, that's a good thing for me to know :)

Thanks! <3

Amber Brown
Twisted Release Manager


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] The End of Windows XP Support in Twisted 15.5

[Amber "Hawkie" Brown]

Hi everyone,

We've just removed the Windows XP builder from our buildbot. Many thanks for 
Tom Prince for keeping it online for so long, but right now, we think it's time 
to retire targeting XP.

Our only current supported Windows platform is Windows 7 x64, with Python 
2.7.10, with Python 3.4 and Python 3.5 support coming soon.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Possible bug

[Amber "Hawkie" Brown]

Hi Chris,

Twisted does not yet support Python 3 on Windows.

There's a ticket at https://twistedmatrix.com/trac/ticket/8025#ticket which 
makes all the tests pass on the platform; I just need to work on it some more. 
I expect Twisted 16.0 to have base support for Python 3 on Windows.

- Amber

> On 31 Oct 2015, at 14:41, Chris Norman  wrote:
> 
> Hi all,
> Using windows 10 with Python 3.5, importing pretty much anything gives me the 
> following error. Not sure if there's something wrong with my configuration or 
> if it's a bug... I seem to remember something a while back, should I file a 
> ticket?
> 
> 
> Traceback (most recent call last):
>  File "", line 1, in 
>  File "C:\python35\lib\site-packages\twisted\internet\reactor.py", line 38, 
> in 
>from twisted.internet import default
>  File "C:\python35\lib\site-packages\twisted\internet\default.py", line 56, 
> in 
>install = _getInstallFunction(platform)
>  File "C:\python35\lib\site-packages\twisted\internet\default.py", line 50, 
> in _getInstallFunction
>from twisted.internet.selectreactor import install
>  File "C:\python35\lib\site-packages\twisted\internet\selectreactor.py", line 
> 18, in 
>from twisted.internet import posixbase
>  File "C:\python35\lib\site-packages\twisted\internet\posixbase.py", line 18, 
> in 
>from twisted.internet import error, udp, tcp
>  File "C:\python35\lib\site-packages\twisted\internet\udp.py", line 53, in 
> 
>from twisted.internet import base, defer, address
>  File "C:\python35\lib\site-packages\twisted\internet\base.py", line 23, in 
> 
>from twisted.internet import fdesc, main, error, abstract, defer, threads
>  File "C:\python35\lib\site-packages\twisted\internet\defer.py", line 29, in 
> 
>from twisted.python import lockfile, failure
>  File "C:\python35\lib\site-packages\twisted\python\lockfile.py", line 52, in 
> 
>_open = file
> NameError: name 'file' is not defined
> 
> Cheers,
> 
> 
> ___
> Twisted-Python mailing list
> Twisted-Python@twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] revisiting onboarding

[Amber "Hawkie" Brown]

> On 27 Oct 2015, at 04:52, Chris Wolfe  wrote:
> 
> On 2 February 2015 at 19:18, Glyph Lefkowitz  wrote:
> [snip]
> > Not all committers are actively involved in the project at all times, so we 
> > should form a "committer committee"
> > of people who are interested in evaluating candidates.  If you would like 
> > to do that and you're already a committer,
> > please contact me and I'll add you to the list.
> 
> It looks like this new process has stalled on the formation of the committee 
> to review new contributor requests. As of right now, the committee has no 
> members. :-)
> 
> This email is a call for volunteers. If you would like to serve on the 
> committee, please reply to this thread and state that you are interested in 
> serving on the committee. Once enough volunteers have signed up, new 
> contributor requests will be sent to the committee's mailing list.

I'm happy to be on this.

- Amber


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Changing the Twisted Compatibility Policy

[Amber "Hawkie" Brown]

Hi everyone,

As many know, one of the things that makes the Twisted project so unique is our 
conformance to our Compatibility Policy. This policy means that users of 
Twisted can freely upgrade between versions with all incompatibilities being 
warned about before causing code to break. However, for a while, one part of 
the compatibility policy has caused issues - what we do with code that has been 
deprecated for a long time, and at least the release +  2 & 1 year after.

The existing policy states:

"Removal should happen once the deprecated API becomes an additional 
maintenance burden. For example, if it makes implementation of a new feature 
more difficult, if it makes documentation of non-deprecated APIs more 
confusing, or if its unit tests become an undue burden on the continuous 
integration system. Removal should not be undertaken just to follow a timeline."

This makes the only reasonable cause for any code being removed from Twisted is 
if it is a maintenance burden, but does not take into account the effect that 
keeping large amounts of deprecated code has on new, existing, and future 
Twisted users. It does specify that it should be removed if it makes 
documentation of non-deprecated APIs confusing, but by its very existence, it 
makes what should be "best practice" more confusing -- especially if the 
deprecated API is "simpler" at first glance, but was deprecated because of vast 
underlying issues,

Discussions have come to the conclusion that the exact reverse of this policy 
should be instated:

"Removal of code should occur as soon as the deprecation grace period has 
ended."

The reason for this is that a leaner Twisted is a better Twisted -- we should 
strive to not break existing applications, but we have the deprecation policy 
in place to ensure that breakage is, if all goes to plan, never out of the 
blue. Less code surface means that Twisted is easier to learn for new users and 
Twisted-using projects onboarding new people, easier to use for established 
users with a clear best practice, and easier to maintain because the codebase 
is not a web of things we deprecated and then never removed. We believe this 
change benefits everyone.

This is also similar to the deprecation policy of another time-based releasing 
project, Django 
(https://docs.djangoproject.com/en/1.8/internals/release-process/#internal-release-deprecation-policy),
 where releases are every 9 months and code is *always* removed in Release 
where deprecated + 2, giving them a deprecation grace period of up to 1 and a 
half years.

If you have any opinions on this change, please let me know, and we'll take it 
all into account before changing the policy.

Twisted Regards,
Amber "Hawkie" Brown
Twisted Release Manager


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Changes to Twisted's binary distribution

[Amber "Hawkie" Brown]

Hi everyone,

Just letting everyone know, the next release (Twisted 15.5) will not include 
MSI or EXE installers for Windows, only binary wheels, and installation through 
pip or from source dist will be the only supported method of installation. The 
exe/msi installers didn't work well (or at all?) for virtualenvs, and when we 
(eventually) start shipping binary wheels for OS X, it'll make everything more 
consistent.

Regards,

Amber "Hawkie" Brown
Twisted Release manager
GPG: https://keybase.io/hawkowl
hawk...@atleastfornow.net




signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Exception's Implicit Public API, and Python 3

[Amber "Hawkie" Brown]

We just ran into an issue in Autobahn|Python where a log message that tried to 
use the message attribute an Exception subclass 
(twisted.internet.error.ProcessTerminated). The message attribute was 
deprecated in Python 2.6, and removed in Python 3 -- but it still "works" in 
Python 2.7.

So, this needs the question: Is this breaking Twisted's backwards compat (that 
.message isn't there on Python 3)? Should we go through and look at our 
exception subclasses, and look at what makes sense to have a .message attribute 
(for example, I'd say it makes sense on ProcessTerminated) and then add it? Or 
is it just a 2/3 change that should be expected during porting? It seems like 
an interesting edge case (and another example of "Don't use subclassing, kids" 
;) ).

The Autobahn ticket (which we're fixing as I write this email) is here 
https://github.com/tavendo/AutobahnPython/issues/479 .

Regards,

Amber "Hawkie" Brown
GPG: https://keybase.io/hawkowl
hawk...@atleastfornow.net




signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 15.4.0 Release Announcement

[Amber "Hawkie" Brown]

On behalf of Twisted Matrix Laboratories, I am honoured to announce the release 
of Twisted 15.4, codenamed "Trial By Fire".

Twisted is continuing to forge ahead, with the highlights of this release being:

- twisted.positioning, the rest of twisted.internet.endpoints, KQueueReactor 
(for real this time), and twisted.web.proxy/guard have all been ported to 
Python 3.
- Trial has been ported to Python 3! This was made possible by a Python 
Software Foundation grant.
- Twisted officially supports several more platforms: Py3.4 on FreeBSD, 
Py2.7/Py3.4 on Fedora 21/22, and Py2.7 on RHEL7.
- Python 2.6 is no longer supported, and support for Debian 6, and RHEL6 has 
been removed because of this.
- Support for the EOL'd platforms of Fedora 17/18/19 has been removed.
- Twisted has moved to requiring setuptools for installation.
- twisted.python.failure.Failure's __repr__ now includes the exception message.
- 19 tickets in total closed!

You can find the downloads at https://pypi.python.org/pypi/Twisted (or 
alternatively http://twistedmatrix.com/trac/wiki/Downloads). The NEWS file can 
be found at https://github.com/twisted/twisted/blob/trunk/NEWS .

Many thanks to everyone who had a part in this release - the supporters of the 
Twisted Software Foundation, the developers who contributed code as well as 
documentation, and all the people building great things with Twisted!

Amber "Hawkie" Brown
GPG: https://keybase.io/hawkowl
hawk...@atleastfornow.net


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 15.4.0pre1 Prerelease Announcement

[Amber Hawkie Brown]

Hello everyone!

Another few months, another Twisted release. This one has a few more Py3 
goodies in it!

- twisted.positioning, the rest of twisted.internet.endpoints, KQueueReactor 
(for real this time), twisted.web.proxy/guard, and Trial (!!!) have all been 
ported to Python 3.
- Twisted officially supports several more platforms: Py3.4 on FreeBSD, 
Py2.7/Py3.4 on Fedora 21/22, and Py2.7 on RHEL7.
- Python 2.6 is no longer supported, and support for Debian 6, and RHEL6 has 
been removed because of this.
- Support for the EOL'd platforms of Fedora 17/18/19 has been removed.
- Twisted has moved to requiring setuptools for installation.
- twisted.python.failure.Failure's __repr__ now includes the  exception message.
- 19 tickets in total closed!

As usual, you can find the tarball and newsfile at 
http://twistedmatrix.com/Releases/pre/15.4.0pre1/ ! Please download them, test 
them, share them, appreciate them, make them a little nest so that they are 
comfortable. If there aren't any reported issues, this will be getting a full 
release soon.

Twisted Regards,

Amber Hawkie Brown
GPG: https://keybase.io/hawkowl



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Updates on the Twisted Buildbots

[Amber Hawkie Brown]

Hi everyone,

If you haven't looked at the buildbots for a while, there's been some changes! 
(for brevity's sake, unsupported builders will be prefixed with a U, eg U2.7)

- Fedora 17 (2.7), 18 (2.7), 19 (2.7, 3.3), and RHEL6 (2.6) are removed, and 
replaced by RHEL7 (2.7), Fedora 21 (2.7, 3.4), Fedora 22 (U2.7, U3.4, to be 
fixed very soon, UPyPy2.4). RHEL6 will return with the 2.7 EPEL soon.
- FreeBSD 10.1 is supported on both Py2.7 and Py3.4.
- OS X 10.6 has been removed and OSX 10.10 has been added (2.7-select 
supported, kqueue and cfreactor both unsupported)
- Ubuntu 15.04 is now a supported platform (2.7, 3.4) and has unsupported PyPy 
(2.5) and Jython (2.7) builders.
- All of the builders (excepting Windows) are built and ran in a virtualenv. 
This means that they have up-to-date dependencies, and if Twisted gains 
dependencies, the infra team can add them to the build process easily.

Twisted Regards,

Amber Hawkie Brown
GPG: https://keybase.io/hawkowl



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] failing coverage builders

[Amber Hawkie Brown]

Hi Glyph,

I'll take a look.

I find the combined codecov rather valuable for figuring out what isn't covered 
on either, but I'll remove it for now.

Amber Hawkie Brown
GPG: https://keybase.io/hawkowl

 On 7 Aug 2015, at 04:32, Glyph gl...@twistedmatrix.com wrote:
 
 The python 3.4 coverage builders are failing, apparently because one of the 
 builders is down:
 
 https://buildbot.twistedmatrix.com/builders/debian7-py3.4-coverage/builds/399/steps/shell_5/logs/stdio
 
 I'll probably make those builders unsupported later today if there is no 
 obvious fix; at this point, depending on codecov is mostly just a net 
 negative.  We can't have it reasonably fail our builds or report status for 
 us, and coverage html produces perfectly usable coverage reports, and so 
 the main consequence is that our builds will fail if they're down (or if they 
 introduce a version of coverage on PyPI that doesn't support python 3, 
 apparently?)
 
 -glyph
 ___
 Twisted-Python mailing list
 Twisted-Python@twistedmatrix.com
 http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 15.3 Release Announcement

[Amber Hawkie Brown]

On behalf of Twisted Matrix Labs, I am honoured to announce the release of 
Twisted 15.3.

We're marching confidently into the future, and this release demonstrates this:

* 10+ modules ported to Python 3 (see NEWS for specifics)
* Twisted Lore has been removed.
* Twisted no longer releases as 'subprojects' -- there is only one 
Twisted, long may it reign.
* twistd now uses cProfile (instead of Hotshot) as the default profiler.
* 40+ more tickets closed overall.

You can find the downloads at https://pypi.python.org/pypi/Twisted (or 
alternatively http://twistedmatrix.com/trac/wiki/Downloads). The NEWS file can 
be found at https://github.com/twisted/twisted/blob/trunk/NEWS .

Many thanks to everyone who had a part in this release - the supporters of the 
Twisted Software Foundation, the developers who contributed code as well as 
documentation, and all the people building great things with Twisted!

Twisted Regards,

Amber Hawkie Brown
GPG: https://keybase.io/hawkowl



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Twisted 15.3.0pre2 Prerelease Announcement

[Amber Hawkie Brown]

Hi everyone,

I've just uploaded 15.3.0pre2 to 
http://twistedmatrix.com/Releases/pre/15.3.0pre2/ , which provides a small fix 
for Twisted-using libraries that subclass Protocol overwriting the `_log` 
attribute.

Please test your software with it, but as this is a very minor change, I will 
release it very soon.

Twisted Regards,

Amber Hawkie Brown
GPG: https://keybase.io/hawkowl



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] An error occurred with twisted 15.2.1 python 3.4.3 on windows

[Amber Hawkie Brown]

 On 29 Jul 2015, at 10:38, Glyph Lefkowitz gl...@twistedmatrix.com wrote:
 
 
 On Jul 28, 2015, at 3:29 AM, Gelin Yan dynami...@gmail.com wrote:
 
 
 
 On Tue, Jul 28, 2015 at 3:46 PM, Tristan Seligmann mithra...@mithrandi.net 
 wrote:
 On Mon, 27 Jul 2015 at 13:18 Gelin Yan dynami...@gmail.com wrote:
   Is it a bug?
 
 Yes; see https://twistedmatrix.com/trac/ticket/7626 for more details.
 
 ___
 Twisted-Python mailing list
 Twisted-Python@twistedmatrix.com
 http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python
 
 
   It looks like this bug has existed for almost one year. Do we have windows 
 building slave for python 3?
 
 No.  For this reason, technically Twisted only supports Python 3 on Linux.  
 Does anyone feel like volunteering to set up a 3 builder?  I wonder if 
 HawkOwl has already done this...

I haven't -- I don't think I have access or know how to get onto the Windows 
builders. Happy to set up a Py3 tests+coverage builder (after PyCon AU, that 
is). (Also, I might set up a Py2.7 coverage builder now we have 
https://codecov.io/github/twisted/twisted to combine it...)

- Amber

 
 -glyph
 
 ___
 Twisted-Python mailing list
 Twisted-Python@twistedmatrix.com
 http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

[Twisted-Python] Considerations for Twisted prereleases on PyPI

[Amber Hawkie Brown]

Hi everyone,

PyPI + pip has supported uploading prereleases for a long while, and this would 
be a much better way for you, the Twisted user, to get the prereleases, rather 
than messing about with tarballs.

Pip 1.4+ (which according to 
https://caremad.io/2015/04/a-year-of-pypi-downloads/ constitutes 80%+ of pips) 
supports prereleases on PyPI.

So, the question is, do people think we should start putting them on PyPI? Is 
it worth some users on ancient pips inadvertantly getting (admittedly quite 
stable) prereleases? Would you use it, and would you be more likely to test 
Twisted prereleases if they were distributed like this (in addition to the 
tarball)?

Thanks,

Amber Hawkie Brown
GPG: https://keybase.io/hawkowl



signature.asc
Description: Message signed with OpenPGP using GPGMail
___
Twisted-Python mailing list
Twisted-Python@twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python