Re: [Twisted-Python] reviews

2021-07-20 Thread Barry Scott
On Tuesday, 20 July 2021 05:38:23 BST Glyph wrote: > Hello Twisted friends, > > This is just a friendly reminder that https://twisted.reviews > is full to bursting - 34 open reviews right now, > some dating back as far as May of last year. If you've got a few free >

Re: [Twisted-Python] Twisted 21.7.0 Pre-Release Announcement

2021-07-15 Thread Barry Scott
On Thursday, 15 July 2021 17:00:06 BST Richard van der Hoff wrote: > On 11/07/2021 00:49, Glyph wrote: > > Thank you Adi! Very glad to see us collectively getting back on the > > release-management horse again! And it was super encouraging to see > > how quickly you were able to get this out,

Re: [Twisted-Python] twisted.web HTTPS client certificate

2021-07-14 Thread Barry Scott
On Tuesday, 13 July 2021 22:48:18 BST Glyph wrote: > > > On Jul 13, 2021, at 2:09 AM, Barry Scott wrote: > > > > On Monday, 12 July 2021 09:27:19 BST Glyph wrote: > >> FWIW I would avoid calling the pyOpenSSL APIs for this, since hopefully > >>

Re: [Twisted-Python] twisted.web HTTPS client certificate

2021-07-13 Thread Barry Scott
On Monday, 12 July 2021 09:27:19 BST Glyph wrote: > FWIW I would avoid calling the pyOpenSSL APIs for this, since hopefully we'll > manage to move away from OpenSSL and at least somewhat abstract away the > transition. Are you thinking to use the Windows and macOS provided crypto API and only

Re: [Twisted-Python] IDNA problem in twisted

2021-04-29 Thread Barry Scott
On Wednesday, 28 April 2021 06:52:30 BST Glyph wrote: > > > On Apr 27, 2021, at 8:58 PM, Wim Lewis wrote: > > > > On Thursday, April 8, 2021 8:43:35 AM PDT, Barry Scott wrote: > >> We just added a patch to our twisted to prevent twisted from doing idna &g

[Twisted-Python] IDNA problem in twisted

2021-04-08 Thread Barry Scott
We just added a patch to our twisted to prevent twisted from doing idna validation. _idnaBytes and _idnaText not convert from bytes to unicode based on the type of the provided arg. We had to do this because there are domain names that youtube.com uses that are not valid under IDNA-2008

Re: [Twisted-Python] Enable and use GitHub Discussions for twisted/twisted

2021-03-29 Thread Barry Scott
On Monday, 29 March 2021 15:27:31 BST Adi Roiban wrote: > Hi, > > Should I enable GitHub discussions for twisted/twisted repo? I can keep up with the email, but you will lose me if I have to browse to github to see what is going on. Barry > > Advantages: > > * it's like email but I think

Re: [Twisted-Python] reactor for Linux io_uring

2021-01-05 Thread Barry Scott
On Tuesday, 5 January 2021 13:38:11 GMT Hynek Schlawack wrote: > >> What's more interesting is that io_uring accepts files as > >> well as network/pipe handles: avoiding the need for threads. > > > > What threads? Why do you call out file FDs different from socket FDs? > > > > The point of

Re: [Twisted-Python] reactor for Linux io_uring

2021-01-05 Thread Barry Scott
On Tuesday, 5 January 2021 13:31:49 GMT Jean-Paul Calderone wrote: > On Tue, Jan 5, 2021 at 6:49 AM Barry Scott > wrote: > > > On Monday, 4 January 2021 04:01:42 GMT Ian Haywood wrote: > > > In investigating async file I/O I came across this. In a nutshell

Re: [Twisted-Python] reactor for Linux io_uring

2021-01-05 Thread Barry Scott
On Monday, 4 January 2021 04:01:42 GMT Ian Haywood wrote: > In investigating async file I/O I came across this. In a nutshell it's > the new epoll() > It's marginally more efficient although this is only apparent at very > high loads. > What's more interesting is that io_uring accepts files as

Re: [Twisted-Python] Participating to GitHub Sponsors

2020-12-17 Thread Barry Scott
On Wednesday, 16 December 2020 11:17:06 GMT Adi Roiban wrote: > Hi, > > On Wed, 16 Dec 2020 at 02:49, Ian Haywood wrote: > > > No objection, but any plans for the money? I'd ask for more reviewers, I'd > > like to contribute more to twisted but there's little point without access > > to code

Re: [Twisted-Python] Current twisted dns client just doesn't work

2020-12-11 Thread Barry Scott
g. Is that what you are trying to fix in twisted? The use of ANY? Barry > > Пт, 11 дек. 2020 г. в 12:26, Barry Scott : > > > On Thursday, 10 December 2020 23:29:33 GMT spam tam wrote: > > > I would like to find problems with ANY. But I think that there is no > &g

Re: [Twisted-Python] Current twisted dns client just doesn't work

2020-12-11 Thread Barry Scott
8482-saying-goodbye-to-any/ > > If you don't see the problem please provide your opinion. I would like to > find solution with ANY but it seems it is impossible. > > So what do you think? > > On Thu, Dec 10, 2020 at 8:30 PM Barry Scott > wrote: > > > Answers to but

Re: [Twisted-Python] Current twisted dns client just doesn't work

2020-12-10 Thread Barry Scott
I'm not sure when I can look at this. Do you want to look at the packets that twisted sends and receives and compared to dig? Barry > > > > On Wed, Dec 9, 2020 at 12:16 PM Barry Scott > > wrote: > > > > > > On Tuesday, 8 December 2020 21:01:56 GMT spam tam wrote: > &

Re: [Twisted-Python] Current twisted dns client just doesn't work

2020-12-09 Thread Barry Scott
On Tuesday, 8 December 2020 20:08:09 GMT Glyph wrote: > Hi Barry! > > > On Dec 8, 2020, at 6:57 AM, Barry Scott wrote: > > > > I recall that the DNS caching code cannot work and we replaced all the > > logic. > > Did you open a ticket for this?

Re: [Twisted-Python] Current twisted dns client just doesn't work

2020-12-08 Thread Barry Scott
On Saturday, 5 December 2020 01:37:33 GMT spam tam wrote: > Twisted provide ability to run dns client in the same thread as main > twisted application. But it just doesn't work. I will have to check the code we are using but I think I have this working in production. I'll have to check for

Re: [Twisted-Python] doWrite on twisted.internet.tcp.Port

2020-09-16 Thread Barry Scott
On Tuesday, 15 September 2020 19:37:41 BST Glyph wrote: > > On Sep 15, 2020, at 10:05 AM, Barry Scott > > wrote: > > > > We do this so that we can open priv'ed ports that the children will share. > > We drop priv's after the priv'ed ports are opened. > > A b

Re: [Twisted-Python] Black enabled in trunk

2020-09-15 Thread Barry Scott
On Monday, 14 September 2020 07:45:43 BST Tom Most wrote: > Hi all, > > Craig and I have been working to land a switch to The *Black* Coding Style > . It's in! > The tree has been reformatted >

Re: [Twisted-Python] doWrite on twisted.internet.tcp.Port

2020-09-15 Thread Barry Scott
On Friday, 11 September 2020 19:28:13 BST Jean-Paul Calderone wrote: > On Fri, Sep 11, 2020 at 1:34 PM wrote: > > > Hey guys, > > > > > > > > Last year I hit a condition discussed in this ticket: > > https://twistedmatrix.com/trac/ticket/4759 for doWrite called on a > >

Re: [Twisted-Python] Incremental vs. Black

2020-08-10 Thread Barry Scott
On Saturday, 1 August 2020 18:14:15 BST Moshe Zadka wrote: > Hi all, > > I opened https://github.com/twisted/incremental/issues/55 a few days ago, and > I'm wondering if anyone has any objection to me making a fix. I'm using > incremental at work on a project that uses black, so this just means

[Twisted-Python] Check of command leads to Traceback in http.py

2020-07-29 Thread Barry Scott
I'm seeing a Traceback in twisted/web/http.py and that lead me to read some of the code. First question in this code from HTTPChannel.lineReceived() at line 2103 why only check that the command is ASCII? By spec the whole line must be a subset of ASCII, is there a good reason to not check that

Re: [Twisted-Python] composition VS. inheritance

2020-06-30 Thread Barry Scott
On Saturday, 27 June 2020 07:47:14 BST Ian Haywood wrote: > In smb I have a SMBPacketReceiver that inherits from t.i.p.Protocol, it > breaks the incoming TCP stream into logical packets (the analogue of > LineReceiver in line-based protocols). > > I then subclass SMBPacketReceiver to

Re: [Twisted-Python] Changing supported configurations regarding Unicode handling on Windows

2020-06-22 Thread Barry Scott
On Monday, 22 June 2020 08:06:22 BST Glyph wrote: > > On Jun 19, 2020, at 4:37 AM, Amber Brown (hawkowl) > > wrote: > > > > Hi all, > > > > The past week or so, I noticed failures in the Azure Pipelines CI (see > > https://github.com/twisted/twisted/pull/1278 for the ticket with them, > > among

Re: [Twisted-Python] log.callWithLogger not used - slows down reactor?

2020-06-03 Thread Barry Scott
On Wednesday, 3 June 2020 08:07:37 BST Glyph wrote: > > On Jun 2, 2020, at 4:54 AM, Barry Scott > > wrote: > > > > I'm hunting down performance issue in our code and spotted this in > > passing. As far I can tell nothing seems to need callWithLogger. > > >

[Twisted-Python] log.callWithLogger not used - slows down reactor?

2020-06-02 Thread Barry Scott
I'm hunting down performance issue in our code and spotted this in passing. As far I can tell nothing seems to need callWithLogger. I ran our 6k+ tests with this patch applied and everything worked. Does anything in the twisted world need it? Barry diff --git

Re: [Twisted-Python] Twisted and Thread, thread not running when twisted app is running as service

2020-05-22 Thread Barry Scott
On Thursday, 21 May 2020 21:45:44 BST Sereysethy TOUCH wrote: > I am on MacOS, it is a development phase, but deployment will be on Linux. > > It is hard to run dtrace/dtruss on MacOS due to the "system integrity > protection" on MacOS. I got some output but very limited information. > > So if

Re: [Twisted-Python] [RFC] Drop support for Python 3.5 sometime after May 2021?

2020-05-19 Thread Barry Scott
On Monday, 18 May 2020 22:21:16 BST Tom Most wrote: > On Sun, May 17, 2020, at 12:22 PM, Glyph wrote: > >> In the one case that may be complicated I think that pinning Twisted will > >> be acceptable, since the service in question is a process supervisor > >> without direct external exposure.> >

Re: [Twisted-Python] unified filesystem API (was: SMB server component for twisted)

2020-05-19 Thread Barry Scott
On Saturday, 16 May 2020 02:14:57 BST Ian Haywood wrote: > On 16/05/2020 10:55 am, Ian Haywood wrote: > > On 15/05/2020 10:52 am, Glyph wrote: > >> y 14, 2020, at 5:23 PM, Wilfredo Sánchez Vega >> > >> > >>> I think it's great to get an SMB implementation in the

Re: [Twisted-Python] IReactorTime.seconds: epoch time or no?

2020-03-26 Thread Barry Scott
On Wednesday, 25 March 2020 07:02:46 GMT Glyph wrote: > > On Mar 24, 2020, at 4:05 PM, Tom Most wrote: > > > > I'll offer a dissenting opinion: > > > > I've worked on systems where the reactor is patched to use monotonic time. > > (This is essential on embedded systems that lack a real-time

Re: [Twisted-Python] Supporting a two-part client protocol.

2020-02-06 Thread Barry Scott
On Thursday, 6 February 2020 16:02:40 GMT Go Luhng wrote: > Thanks for the detailed responses, Colin and Barry. I have a followup > > question about sans-io. From the document: > > For input (that is, receiving data from the network), the > > calling code is responsible for delivering code to

Re: [Twisted-Python] Supporting a two-part client protocol.

2020-02-05 Thread Barry Scott
On Wednesday, 5 February 2020 08:48:41 GMT Colin Dunklau wrote: > I wasn't able to find an example in Twisted of an implicit state > machine. Maybe someone else has a concrete example somewhere? There is an example of an explicit state machine in the twisted code for http chunked transfer

Re: [Twisted-Python] Supporting a two-part client protocol.

2020-02-04 Thread Barry Scott
On Tuesday, 4 February 2020 07:39:11 GMT Colin Dunklau wrote: > On Tue, Feb 4, 2020 at 1:18 AM Go Luhng wrote: > > > Colin Dunklau wrote: > > > > > > Assuming the header has a fixed length, > > > > It does. The header is just a serialized C struct, so it's > > fully-specified for length and

Re: [Twisted-Python] doPoll timeout problems

2018-10-17 Thread Barry Scott
On Wednesday, 17 October 2018 06:59:07 BST Glyph wrote: > > On Oct 16, 2018, at 7:28 PM, Wim Lewis wrote: > > > > Scott, Barry wrote: > >> We are seeing a problem with poll being called very often and think that > >> the problem is in the timeout calculation.> > > I think you're right and that

[Twisted-Python] How do recommend I run epytext?

2018-08-03 Thread Barry Scott
The tox checking does not cover the epytext checks it seems. How do you recommend I have epytext checked for a patch? Barry ___ Twisted-Python mailing list Twisted-Python@twistedmatrix.com

[Twisted-Python] Why you are starting to see patch from me

2018-08-03 Thread Barry Scott
I thought you might like a little background on why I'm starting to send in patches. The code base I'm working on uses Twisted 2.0 with lots of patches and some back ports for newer Twisted. We also use Nevow. The code started life a long time ago. I have been porting the code to use current

[Twisted-Python] I preparing a patch but the buildbot OSX seems to be broken.

2018-08-01 Thread Barry Scott
I'm working on my first path for twisted and learning your workflow. https://github.com/twisted/twisted/pull/1044 The CI pipe line has been helpful in spotting things I missed but for the last few hours this job is not completing. buildbot/osx10.11-py2.7-coverage Expected — Waiting for status

Re: [Twisted-Python] Strategy for finding source of unhandled error in Deferred

2018-03-26 Thread Barry Scott
On Sunday, 18 March 2018 15:23:58 BST Jean-Paul Calderone wrote: > On Sun, Mar 18, 2018 at 11:21 AM, Jean-Paul Calderone < > > exar...@twistedmatrix.com> wrote: > > On Sun, Mar 18, 2018 at 11:04 AM, Alex Railean wrote: > >> Hello, > >> > >> I have inherited a misbehaving

Re: [Twisted-Python] COMMERCIAL:Re: Clarification or pausing a consumer

2017-10-24 Thread Barry Scott
On Monday, 23 October 2017 17:31:19 BST Jean-Paul Calderone wrote: > On Mon, Oct 23, 2017 at 8:10 AM, Barry Scott <barry.sc...@forcepoint.com> > > wrote: > > On Saturday, 14 October 2017 07:44:12 BST Glyph wrote: > > > > On Oct 13, 2017, at 5:47 PM,

Re: [Twisted-Python] COMMERCIAL:Re: Clarification or pausing a consumer

2017-10-23 Thread Barry Scott
On Saturday, 14 October 2017 07:44:12 BST Glyph wrote: > > On Oct 13, 2017, at 5:47 PM, Jean-Paul Calderone > > <exar...@twistedmatrix.com> wrote: > > > > On Fri, Oct 13, 2017 at 8:29 AM, Barry Scott <barry.sc...@forcepoint.com > > <mailto:barry.

[Twisted-Python] Clarification or pausing a consumer

2017-10-13 Thread Barry Scott
I have a app that needs to send data as an http response. But the data is produced slowly. More slowly then the time taken to transmit it. The consumer keeps calling resumeProducing, but there is no data to send often. What is the correct way to pause the consumer so that it does not keep

[Twisted-Python] nevow problem with TWISTED_NEWSTYLE=true

2017-09-06 Thread Barry Scott
I wanted to use the new style classes everywhere but hit this problem with nevow 0.14.3. Is there a patch to fix this available? $ TWISTED_NEWSTYLE=true python2 Python 2.7.13 (default, Jun 26 2017, 10:20:05) [GCC 7.1.1 20170622 (Red Hat 7.1.1-3)] on linux2 Type "help", "copyright", "credits" or

Re: [Twisted-Python] COMMERCIAL:Re: COMMERCIAL:Re: Chunked decoding missing fromHTTPClient?

2017-08-21 Thread Barry Scott
On Monday, 21 August 2017 11:27:53 BST Jean-Paul Calderone wrote: > On Mon, Aug 21, 2017 at 5:52 AM, Barry Scott <barry.sc...@forcepoint.com> > > wrote: > > On Tuesday, 15 August 2017 14:12:21 BST Jean-Paul Calderone wrote: > > > On Tue, Aug 15, 2017 at

Re: [Twisted-Python] COMMERCIAL:Re: Chunked decoding missing from HTTPClient?

2017-08-21 Thread Barry Scott
On Tuesday, 15 August 2017 14:12:21 BST Jean-Paul Calderone wrote: > On Tue, Aug 15, 2017 at 8:43 AM, Barry Scott <barry.sc...@forcepoint.com> > > wrote: > > I see that HTTPChannel knows about chunking and indeed works well. > > > > However shouldn't HTTPClient a

Re: [Twisted-Python] COMMERCIAL:Re: Is there a nice way to writetransport-agnostic protocols and servers/clients?

2017-08-17 Thread Barry Scott
On Thursday, 17 August 2017 03:03:41 BST Kevin Conway wrote: > > There is no datagram endpoints API as yet, though (see #4471), only > > stream endpoints. > > I'm not sure I understand the distinction. Endpoints supports UDP which is > a datagram based transport. From a Protocol perspective, you

Re: [Twisted-Python] COMMERCIAL:Re: Is there a nice way to writetransport-agnostic protocols and servers/clients?

2017-08-17 Thread Barry Scott
On Thursday, 17 August 2017 03:03:41 BST Kevin Conway wrote: > > There is no datagram endpoints API as yet, though (see #4471), only > > stream endpoints. > > I'm not sure I understand the distinction. Endpoints supports UDP which is > a datagram based transport. From a Protocol perspective, you

[Twisted-Python] Chunked decoding missing from HTTPClient?

2017-08-15 Thread Barry Scott
I see that HTTPChannel knows about chunking and indeed works well. However shouldn't HTTPClient also support chunking? Or Am I missing something to get chunking working for the response from a server? Barry ___ Twisted-Python mailing list

Re: [Twisted-Python] COMMERCIAL:Re: WebSockets and QUIC for Twisted

2017-07-07 Thread Barry Scott
On Thursday, 6 July 2017 03:58:05 BST Glyph wrote: > > On Jul 5, 2017, at 2:32 AM, Barry Scott <barry.sc...@forcepoint.com> > > wrote: > > > > I am interested in using Twisted with a couple of technologies: WebSockets > > and QUIC. I'm researching what is

[Twisted-Python] WebSockets and QUIC for Twisted

2017-07-05 Thread Barry Scott
I am interested in using Twisted with a couple of technologies: WebSockets and QUIC. I'm researching what is already available. I found the autobahn-python for WebSockets, are there other projects that provide WebSockets that I have missed? I could not find references to any projects