Re: [Twisted-Python] trial.unitest-specific segfault with lxml

2017-08-18 Thread Phil Mayers
On 18/08/2017 07:05, Tristan Seligmann wrote: Note that I don't think you're allowed to catch GeneratorExit like this; Interesting, I cribbed that from the lxml docs. Will look into it, thanks for the pointer. Given that the crash only occurs at exit, I suspect this has something to do

Re: [Twisted-Python] WebSockets and QUIC for Twisted

2017-07-08 Thread Phil Mayers
On 08/07/17 03:59, Glyph wrote: Ironically the goals of QUIC are, I believe, similar to Vertex ;o) Really? How so? Sorry, memory not serving me well. I'm thinking of the PTCP bits, I'd managed to remember that, but forget about all the rest! So no, not similar - my mistake.

Re: [Twisted-Python] COMMERCIAL:Re: WebSockets and QUIC for Twisted

2017-07-07 Thread Phil Mayers
On 07/07/17 13:17, Barry Scott wrote: As someone else noted, maybe you're thinking of SPDY? I know abnout SPDY, it is indeed QUIC that I'm researching into. I was talking to Glyph ;o) Sorry for any confusion. ___ Twisted-Python mailing list

Re: [Twisted-Python] WebSockets and QUIC for Twisted

2017-07-07 Thread Phil Mayers
On 06/07/17 03:58, Glyph wrote: On Jul 5, 2017, at 2:32 AM, Barry Scott > wrote: I am interested in using Twisted with a couple of technologies: WebSockets and QUIC. I'm researching what is already available. Why are you

Re: [Twisted-Python] HTTP PUT a GET's streaming response with treq

2017-05-05 Thread Phil Mayers
On 05/05/17 12:40, Nagy, Attila wrote: Cool. If you're happy using private members, knock yourself out. I'm not happy with that of course. The really cool thing would be if Twisted could support this task without the need of complicated and error-prone code. I don't disagree, of course.

Re: [Twisted-Python] HTTP PUT a GET's streaming response with treq

2017-05-05 Thread Phil Mayers
On 05/05/17 12:10, Cory Benfield wrote: As a second note, you may lock yourself out of HTTP/2. HTTP/2 is not guaranteed to give you access to a raw transport object (though it FWIW this kind of thing was, more or less, what I was thinking. It seems unlikely that stealing the TCP connection

Re: [Twisted-Python] HTTP PUT a GET's streaming response with treq

2017-05-05 Thread Phil Mayers
On 05/05/17 10:41, Nagy, Attila wrote: What possible side effects do you see here? What problems could it cause? So far I've tried to copy a lot of files in parallel, arbitrarily drop connections. Everything seems OK. The file is either transferred in its entirety or (in case of dropped

Re: [Twisted-Python] Twisted and Flask or Django

2017-04-19 Thread Phil Mayers
On 18/04/17 06:09, Hynek Schlawack wrote: Oh and I’d like to propose to officially merge the twisted-web mailing list into this one. I don’t think it makes any sense to Seconded. ___ Twisted-Python mailing list Twisted-Python@twistedmatrix.com

Re: [Twisted-Python] Python3 twistd daemon for Ubuntu 14.04 alternatives

2017-02-23 Thread Phil Mayers
On 23/02/17 09:11, Glyph Lefkowitz wrote: Yes, and building these binary artifacts is often harder than some people (cough, alpine, cough) seem to think. But there are better ways to square this circle than restricting yourself to the versions of /python/ libraries that happen to be available

Re: [Twisted-Python] Python3 twistd daemon for Ubuntu 14.04 alternatives

2017-02-23 Thread Phil Mayers
On 23/02/17 10:27, Hynek Schlawack wrote: What I don't quite understand is how people can be in love with Go’s static linking but complaining about Virtualenvs in deployments. Unwieldy as virtualenvs are: *for Python code* they are exactly that: statically linked build artifacts. The

Re: [Twisted-Python] Python3 twistd daemon for Ubuntu 14.04 alternatives

2017-02-22 Thread Phil Mayers
On 22/02/17 20:59, Cory Benfield wrote: The permitted C dependencies *for dynamic linking* are tiny, sure. But those libraries may statically link as they please. The likely scenario for most such packages is that they statically link whatever they need. This is the approach taken by some that

Re: [Twisted-Python] Python3 twistd daemon for Ubuntu 14.04 alternatives

2017-02-22 Thread Phil Mayers
On 22/02/17 17:42, Hynek Schlawack wrote: I have to disagree here: I don’t want build tools of any kind in my final containers therefore I build my artifacts separately no matter what language. Of course you can just build the venv on your build Agreed, 100%. Apologies if I gave you the

Re: [Twisted-Python] Python3 twistd daemon for Ubuntu 14.04 alternatives

2017-02-22 Thread Phil Mayers
On 22/02/17 17:35, Steve Waterbury wrote: On 02/22/2017 12:23 PM, Phil Mayers wrote: On 22/02/17 15:00, Steve Waterbury wrote: Have you considered the 'conda' package manager? I've never come across it. It looks too big for me to give a quick opinion on, but I'll bear it in mind. Thanks

Re: [Twisted-Python] Python3 twistd daemon for Ubuntu 14.04 alternatives

2017-02-22 Thread Phil Mayers
On 22/02/17 15:00, Steve Waterbury wrote: Have you considered the 'conda' package manager? I've never come across it. It looks too big for me to give a quick opinion on, but I'll bear it in mind. Thanks for the pointer. ___ Twisted-Python mailing

Re: [Twisted-Python] Python3 twistd daemon for Ubuntu 14.04 alternatives

2017-02-22 Thread Phil Mayers
On 22/02/17 13:06, Jean-Paul Calderone wrote: Ah! They are now, maybe you haven't seen them? Check out https://github.com/pypa/manylinux and https://github.com/pypa/python-manylinux-demo I had not seen this. Thanks, this looks like a big leap forward. A lot of people seem to be thinking

Re: [Twisted-Python] Python3 twistd daemon for Ubuntu 14.04 alternatives

2017-02-22 Thread Phil Mayers
On 22/02/17 12:49, Hynek Schlawack wrote: That’s why you should use a build server and not ship build environments. Which we do. I don’t see how that’s tedious since a compute does that for me. Although I don’t see any value at wheeling them (and some packages cannot be wheeled); my CI

Re: [Twisted-Python] Python3 twistd daemon for Ubuntu 14.04 alternatives

2017-02-22 Thread Phil Mayers
On 22/02/17 11:12, Glyph Lefkowitz wrote: I'm tempted to launch into a diatribe about namespacing, containers, and application isolation generally, but before I do - why is it that you /want/ to use the system Python environment? Had you just not considered the option of virtual environments?

Re: [Twisted-Python] Twisted 17.1 Release Announcement

2017-02-12 Thread Phil Mayers
On 12/02/2017 01:44, Glyph Lefkowitz wrote: Yeah, this is a lack of test coverage for the 'default' case. Technically it /is/ a regression, but it's probably pretty unusual to use the default; point being, I don't think we need an emergency release here. Agreed. It's completely tolerable.

Re: [Twisted-Python] Twisted 17.1 Release Announcement

2017-02-11 Thread Phil Mayers
On 11/02/17 18:12, Phil Mayers wrote: On 11/02/2017 17:28, Tristan Seligmann wrote: String endpoint descriptions, as used by twist/twistd among other things, for listening on tcp ports now require the "tcp:": that is, "80" is no longer accepted, you need to use "

Re: [Twisted-Python] Twisted 17.1 Release Announcement

2017-02-11 Thread Phil Mayers
On 11/02/2017 17:28, Tristan Seligmann wrote: String endpoint descriptions, as used by twist/twistd among other things, for listening on tcp ports now require the "tcp:": that is, "80" is no longer accepted, you need to use "tcp:80". In which case there's a regression in the "portforward"

Re: [Twisted-Python] Problems with inlineCallback, Deferred, yield and Python 3 in buildbot

2017-01-25 Thread Phil Mayers
On 24/01/2017 21:14, Glyph Lefkowitz wrote: I've encountered this before and quickly worked around it, but I think this might actually be a bug in python 3, or at least its documentation. The language docs officially say that a "list display" (which is what I believe we're looking at here)

Re: [Twisted-Python] How do you determine the buffer size of a transport - a use-case for not using back pressure

2016-08-22 Thread Phil Mayers
On 17/08/16 23:43, Steve Morin wrote: Twisted Community Problem: How do you determine the buffer size of a transport, to know how much data is waiting to be transmitted from using transport.write? You haven't received many responses, so I'll add a short note here: The ideal way to do this

[Twisted-Python] Style/testing for log-related changes

2016-06-06 Thread Phil Mayers
All, I'd like to submit a patch to convert t.conch.ssh to the new logging. The main reason is that the conch code logs a *lot* of really, really, really boring crap that I want to throw away because it just clutters up the logs e.g.

Re: [Twisted-Python] twisted listening on UDP port, why?

2016-04-23 Thread Phil Mayers
On 23/04/16 03:36, Jonathan Vanasco wrote: Thanks for all this. A few quick notes: On Apr 20, 2016, at 9:15 PM, Glyph wrote: This isn't so much a feature of Python as it is a feature of the BSD sockets API. Sending traffic through a socket, whether it's TCP or UDP, has to bind a client

Re: [Twisted-Python] twisted listening on UDP port, why?

2016-04-20 Thread Phil Mayers
On 20/04/16 01:01, Glyph wrote: Perhaps this is libc's DNS client? Twisted doesn't do anything like this. It does something similar with win32reactor IIRC? http://twistedmatrix.com/trac/browser/tags/releases/twisted-16.1.1/twisted/internet/posixbase.py#L60 ...but that binds to 127.0.0.1

Re: [Twisted-Python] [Twisted-web] upcoming changes to twistedmatrix.com mail infrastructure

2016-03-19 Thread Phil Mayers
On 16/03/16 18:52, Glyph wrote: Over the last few months, twistedmatrix.com 's mailman installation has been used increasingly frequently to execute denial-of-service attacks against people's mailboxes. This is My sympathies; this exact problem was the reason we

Re: [Twisted-Python] Twisted + OpenSSL 1.0.2f issues resolved

2016-02-23 Thread Phil Mayers
On 22/02/16 21:18, Glyph Lefkowitz wrote: On Feb 22, 2016, at 09:26, Phil Mayers <p.may...@imperial.ac.uk> wrote: On 20/02/16 09:33, Glyph Lefkowitz wrote: I assume that they subscribed by accident (spammers seem to periodically attempt to mass-subscribe people using our listserv,

Re: [Twisted-Python] Twisted + OpenSSL 1.0.2f issues resolved

2016-02-22 Thread Phil Mayers
On 20/02/16 09:33, Glyph Lefkowitz wrote: I assume that they subscribed by accident (spammers seem to periodically attempt to mass-subscribe people using our listserv, I have no idea why, and some of them click the "yes subscribe me" link for some reason). FWIW, our local mailman install is

Re: [Twisted-Python] Python 2.7 on CentOS 6

2015-12-16 Thread Phil Mayers
On 15/12/2015 16:40, Ray Cote wrote: We have a fair bit of Python 2.7 Twisted code deployed on RHEL and CentOS 5 and 6. In each case, we build from source and do a make altinstall so we’re running a Python separate from the system’s. We build an RPM, but basically yes; put it in a different

[Twisted-Python] doc breakage

2015-11-27 Thread Phil Mayers
Does this look right? https://twistedmatrix.com/documents/current/api/twisted.internet.interfaces.IReadWriteDescriptor.html Looks like docs for logPrefix has stomped on docs for all the other interface methods? ___ Twisted-Python mailing list

Re: [Twisted-Python] Writing a low-level network debugging tool

2015-11-27 Thread Phil Mayers
On 27/11/15 14:05, Jonathan Ballet wrote: * how long does it take to resolv the domain name to (at least) one of its IP address - against a specified name server or using the system configured servers That is relatively straightforward. - how many tries did it require * if there

Re: [Twisted-Python] Writing a low-level network debugging tool

2015-11-27 Thread Phil Mayers
On 27/11/15 14:39, Phil Mayers wrote: But the info above may be a helpful start. You may also want to look at TCP_CC_INFO. See the kernel source: https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/tree/net/ipv4/tcp.c?id=refs/tags/v4.4-rc2 ...for an idea of what else

[Twisted-Python] List admin attention

2015-08-11 Thread Phil Mayers
Someone please un-sub this person? Forwarded Message Subject:Re: [Twisted-Python] ANN: Eliot 0.8, the logging system with causality Date: Mon, 10 Aug 2015 12:59:48 -0600 From: Judy Craig jcr...@gsacrd.ab.ca Reply-To: Twisted general discussion

Re: [Twisted-Python] Deprecating subproject packaging

2015-04-22 Thread Phil Mayers
On 22/04/15 09:04, HawkOwl wrote: Hi, I think that Twisted should deprecate subproject packaging -- they Agreed. It's largely pointless. ___ Twisted-Python mailing list Twisted-Python@twistedmatrix.com

Re: [Twisted-Python] Add support for Next Protocol Negotiation and Application Layer Protocol Negotiation

2015-04-21 Thread Phil Mayers
On 21/04/15 16:25, Adi Roiban wrote: Hi, I just want to let you know about this patch which is in work : https://twistedmatrix.com/trac/ticket/7860 Nice. I did an initial review but it would help to get more feedback for this new API. I would very, very much like to see something along

Re: [Twisted-Python] Adding support for Diameter protocol

2015-04-14 Thread Phil Mayers
On 14/04/15 06:42, Glyph wrote: On Apr 14, 2015, at 00:22, Hamza Sheikh fehr...@codeghar.com mailto:fehr...@codeghar.com wrote: I am new to Twisted and its community Welcome, we are happy to have you! and exploring adding Diameter support. What is Diameter? offtopic It's a bit like

Re: [Twisted-Python] Removing Python 2.6 Support after Twisted 15.1

2015-03-24 Thread Phil Mayers
On 20/03/15 00:23, David Ripton wrote: On 03/19/2015 08:05 AM, Phil Mayers wrote: On 18/03/15 23:57, Glyph Lefkowitz wrote: Rather than just suggest we preserve the status quo and stay on 2.6 forever to do indefinite free work to support Red Hat's obsolescence You *definitely* shouldn't do

Re: [Twisted-Python] Removing Python 2.6 Support after Twisted 15.1

2015-03-19 Thread Phil Mayers
On 19/03/15 00:42, Donald Stufft wrote: If you want newer than that you could possibly convince PyPy to build RPMs with COPR. I’m doing that for python-pip and co and it’s not very hard once you have the RPM spec file originally written, which could probably just be taken from Fedora. IME

Re: [Twisted-Python] Removing Python 2.6 Support after Twisted 15.1

2015-03-19 Thread Phil Mayers
On 18/03/15 23:57, Glyph Lefkowitz wrote: Rather than just suggest we preserve the status quo and stay on 2.6 forever to do indefinite free work to support Red Hat's obsolescence You *definitely* shouldn't do that. Push back on RedHat, and tell customers to push back on RedHat. I say this to

Re: [Twisted-Python] Removing Python 2.6 Support after Twisted 15.1

2015-03-18 Thread Phil Mayers
On 18/03/15 12:29, Donald Stufft wrote: Isn’t the RHEL answer here to just use SCLs to install Python 2.7? I've never actually come across the SCL stuff before. Thanks for the pointer. My latter point still stands - don't do it because others do it, do it because it's good for Twisted (or

Re: [Twisted-Python] Removing Python 2.6 Support after Twisted 15.1

2015-03-18 Thread Phil Mayers
On 18/03/15 10:45, HawkOwl wrote: Hi, As Python 2.6 has been officially abandoned for a year+ (and will receive no further official security updates) and Python 2.7 has been available for almost five years, it might be time to put Python 2.6 support to bed. The only currently supported distro

[Twisted-Python] Process pools and logging

2014-07-29 Thread Phil Mayers
Before I re-invent the wheel, is there a twisted library that will let me: 1. Fire up child worker processes 2. That log to a logObserver coming out in the parent 3. Manage the whole lot as a .tac file Note I *don't* need deferToProcess or similar in this situation. I just need to fire up N

Re: [Twisted-Python] some competition and hopefully inspiration for conch

2014-07-17 Thread Phil Mayers
On 16/07/14 22:40, Glyph Lefkowitz wrote: There's a new Python-based asynchronous SSH client and server in town: http://asyncssh.timeheart.net/# This looks to have a much more straightforward API and /way/ better The client endpoint API is great. It is what Conch should always have

Re: [Twisted-Python] FTP box disconnecting after 60 seconds

2014-07-08 Thread Phil Mayers
On 08/07/14 15:45, Paul Wiseman wrote: Hey, This is a bit of a stab in the dark, but I'm really not sure what to try next. Basically I've got a custom twisted FTP server, recently (not sure when it started) I've noticed that connections to it seem to disconnect after 60 seconds if they haven't

Re: [Twisted-Python] adbapi.ConnectionPool - reconnecting to postgresql

2014-06-10 Thread Phil Mayers
On 10/06/2014 19:24, Jonathan Vanasco wrote: I had to restart postgresql , and that triggered some endless errors in my logs. i don't have anything that can handle a suddenly dropped / resumed connection. does anyone have a recommendation for trying to reconnect or handle this in general

Re: [Twisted-Python] Fwd: Trouble with session id reuse/disabling with twisted TLS

2014-04-30 Thread Phil Mayers
On 30/04/14 17:43, Henrik Thostrup Jensen wrote: Hi I have a twisted service, which uses TLS and I seeing some odd behaviour. New connections are accepted fine, but if a client tries to re-use a TLS session id with a new connection, the services rejects the connection. This example:

Re: [Twisted-Python] t.w.client.Agent exceptions

2014-03-05 Thread Phil Mayers
On 05/03/2014 22:08, Glyph Lefkowitz wrote: You're right; this is a bug in Agent. http://twistedmatrix.com/trac/ticket/5310 And it must be said, really quite an infuriating one ;o) For right now, yes, you're going to have to import some crappy private APIs. Any chance I could convince

Re: [Twisted-Python] Configuration options for twisted code

2014-03-03 Thread Phil Mayers
On 04/03/2014 00:52, Itamar Turner-Trauring wrote: On 03/03/2014 01:09 PM, Adi Roiban wrote: What do you think? Should I go ahead and add options as __init__ arguments or think of a configuration system? A configuration system would take a while to design and meanwhile these unrelated

Re: [Twisted-Python] Exit all threads upon KeyboardInterrupt

2014-01-14 Thread Phil Mayers
On 14/01/14 14:27, Dustin J. Mitchell wrote: There are two things wrong with your scenario. First, in any production or production-ready environment, your software needs to correctly handle stuck TCP connections. With the proliferation of smart network equipment (session-tracking firewalls,

Re: [Twisted-Python] Exit all threads upon KeyboardInterrupt

2014-01-14 Thread Phil Mayers
On 14/01/14 15:10, Dustin J. Mitchell wrote: On Tue, Jan 14, 2014 at 10:05 AM, Phil Mayers p.may...@imperial.ac.uk wrote: I'm wondering if TCP keepalive isn't any use to you in this regard? It is, but only in cases where we can tweak kernel parameters appropriately so that the timeout

Re: [Twisted-Python] Twisted names client.getHostbyName dual-stack operation

2014-01-09 Thread Phil Mayers
On 08/01/14 23:05, Glyph Lefkowitz wrote: However, if you’re building a big service to run in the cloud, or on a VPN, on specially-tuned machines that you configured, using twisted.names can be more scalable and allow you to react more reasonably to high load situations. Or, at least, it will

Re: [Twisted-Python] Twisted names client.getHostbyName dual-stack operation

2014-01-06 Thread Phil Mayers
On 06/01/14 08:26, Maciej Wasilak wrote: Hello, I've tried to use Twisted names.client.getHostByName() method to resolve some addresses for my UDP based app. By default getHostByName() always returns IPv6 address. I don't always have end-to-end IPv6 connectivity, I'm not sure if t.n.client

Re: [Twisted-Python] Reliable way to check if Twisted has IPv6 support?

2013-12-13 Thread Phil Mayers
On 13/12/13 03:22, Amit Saha wrote: Is there a more reliable way (which works with the Twisted-8.0+) to check this? Check the Twisted version. You should also note that IPv6 features have appeared in multiple versions; HostnameEndpoint was added in 13.2.0 for example, whereas basic

Re: [Twisted-Python] Queries about connecting to a XML-RPC server over IPv6

2013-12-12 Thread Phil Mayers
- Original Message - From: Phil Mayers p.may...@imperial.ac.uk To: twisted-python@twistedmatrix.com Sent: Monday, December 9, 2013 7:33:17 PM Subject: Re: [Twisted-Python] Queries about connecting to a XML-RPC server over IPv6 On 09/12/13 05:28, Amit Saha wrote: proxy = Proxy('http

Re: [Twisted-Python] ISSLTransport.getPeerCertificate returning None?

2013-12-10 Thread Phil Mayers
On 09/12/13 22:19, Laurens Van Houtven wrote: ... but in the server's AMP protocol, self.transport.getPeerCertificate() is still None :/ Unless you set the appropriate verify options on the server side too, the client cert isn't available for inspection.

Re: [Twisted-Python] ISSLTransport.getPeerCertificate returning None?

2013-12-10 Thread Phil Mayers
On 10/12/13 13:21, exar...@twistedmatrix.com wrote: On 08:41 am, p.may...@imperial.ac.uk wrote: On 09/12/13 22:19, Laurens Van Houtven wrote: ... but in the server's AMP protocol, self.transport.getPeerCertificate() is still None :/ Unless you set the appropriate verify options on the server

Re: [Twisted-Python] Queries about connecting to a XML-RPC server over IPv6

2013-12-09 Thread Phil Mayers
On 09/12/13 05:28, Amit Saha wrote: proxy = Proxy('http://localhost6:8000') proxy.callRemote('my_proxy_method').addCallbacks(printValue, printError) When I run it, i get No route to host: 101, Network is unreachable. However, 'curl -6 localhost:8000' succeeds. What could be going on here?

Re: [Twisted-Python] Queries about connecting to a XML-RPC server over IPv6

2013-12-09 Thread Phil Mayers
On 09/12/13 13:28, Glyph wrote: On Dec 9, 2013, at 1:33 AM, Phil Mayers p.may...@imperial.ac.uk mailto:p.may...@imperial.ac.uk wrote: The IPv6 support in Twisted is very new - check your version even *has* it - and it's still a work in progress. You might find that you can't do this. I'd have

Re: [Twisted-Python] Queries about connecting to a XML-RPC server over IPv6

2013-12-09 Thread Phil Mayers
On 09/12/13 14:54, Phil Mayers wrote: On 09/12/13 13:28, Glyph wrote: On Dec 9, 2013, at 1:33 AM, Phil Mayers p.may...@imperial.ac.uk mailto:p.may...@imperial.ac.uk wrote: The IPv6 support in Twisted is very new - check your version even *has* it - and it's still a work in progress. You might

Re: [Twisted-Python] carbon-relay eating CPU - EAGAIN (Resource temporarily unavailable)?

2013-11-26 Thread Phil Mayers
On 26/11/13 04:05, Quan Tong Anh wrote: - Python 2.7.3 - [twisted, version 13.1.0] - xen-domU I assume xen-domU means Linux as the guest OS; which kernel version, out of interest. `atop` shows that `carbon-relay` is eating 80, 90% USRCPU. From the I don't know about anyone else,

Re: [Twisted-Python] txThings - simple library for CoAP protocol

2013-11-23 Thread Phil Mayers
On 23/11/13 12:03, Maciej Wasilak wrote: 3. There is a problem with txThings IPv6 server, because in most operating systems source address of datagram is determined in round robin fashion. It may cause the source address of the response to be different than destination address of the request.

Re: [Twisted-Python] epoll keep sharing state between process even after fork.

2013-10-23 Thread Phil Mayers
On 23/10/13 16:46, Flint wrote: Hi everybody I a came across a surprising problem when using the epoll based reactor. (ticket here https://twistedmatrix.com/trac/ticket/6796) As you can see on the ticket, the epoll object seems to share some state even after fork. Which means even after having

Re: [Twisted-Python] epoll keep sharing state between process even after fork.

2013-10-23 Thread Phil Mayers
On 23/10/13 17:39, Phil Mayers wrote: 2. Arrange for the epoll object (or FD) to be closed after fork, but before exec, so that the child process can't fiddle with it See also: http://bugs.python.org/issue8713 ...which suggests Python 3.4 added fork+exec support to multiprocessing

Re: [Twisted-Python] Twisted as a full solution for web hosting [WSGI + other]

2013-10-21 Thread Phil Mayers
Does the Twisted wsgi runner have support for process rather than threading models to avoid the gil? Because if so I should take a look at it... -- Sent from my phone with, please excuse brevity and typos___ Twisted-Python mailing list

Re: [Twisted-Python] AutobahnPython 0.6.3 - WebSocket compression and more

2013-10-07 Thread Phil Mayers
On 10/07/2013 08:51 AM, Tobias Oberstein wrote: I did some further looking around: turns out there is TLS-PGP http://tools.ietf.org/html/rfc6091 Does someone know whether OpenSSL supports that? There are *lots* of TLS extensions that eliminate or obviate the need for the (horrible) PKIX

Re: [Twisted-Python] AutobahnPython 0.6.3 - WebSocket compression and more

2013-10-07 Thread Phil Mayers
On 10/07/2013 09:50 AM, Phil Mayers wrote: Right now, none are useful in a browser, but personally I have high hopes for raw keys, trust-anchored by DNSSEC via RFC 6698. In this model, X.509 is essentially just a payload format for certs Sorry, payload format for keys

Re: [Twisted-Python] AutobahnPython 0.6.3 - WebSocket compression and more

2013-10-07 Thread Phil Mayers
On 07/10/13 11:56, Donald Stufft wrote: DNSSEC solves none of the problems with the CA system. It just moves the problem around. Disagree. However - there are other, better forums to have this argument in (and to be frank, I've no interest in having it at all) so I won't respond further.

Re: [Twisted-Python] AutobahnPython 0.6.3 - WebSocket compression and more

2013-10-07 Thread Phil Mayers
On 07/10/13 12:35, Tobias Oberstein wrote: DNSSEC seems to follow a centralized/hierachical trust model. Won't help. The NSA will (does?) own those. The default trust model is to have parent sign the child. Other models are not only possible, they're deployed. Google DLV and trust anchor.

Re: [Twisted-Python] AutobahnPython 0.6.3 - WebSocket compression and more

2013-10-07 Thread Phil Mayers
On 07/10/2013 18:58, Glyph wrote: If you have a disagreement, please say /what the disagreement is/ (not just disagree) and then link to resources instead of abstractly claiming people may find them themselves somehow. You don't have to get into a big back-and-forth, but I believe DNSSEC

Re: [Twisted-Python] twisted linux netfilter_log protocol

2013-10-02 Thread Phil Mayers
On 10/02/2013 07:14 AM, David Stainton wrote: Hi, I am wondering how I should combine various twisted interfaces in a way that makes sense. It probably shows here... that I'm new to twisted. The Linux iptables can log packets to the netfilter_log which can give access to user space. I wrote a

Re: [Twisted-Python] twisted linux netfilter_log protocol

2013-10-02 Thread Phil Mayers
On 02/10/13 09:25, David Stainton wrote: In examples of Twisted UDP clients they all do this: reactor.listenUDP(3000,MyProtocol()) What would I do instead? reactor.addReader makes sense to me since what I have is a file descriptor, and the reactor loop and use select or epoll find out when

Re: [Twisted-Python] Conch - Why does one piece of code fail while another works

2013-10-02 Thread Phil Mayers
On 02/10/13 15:00, exar...@twistedmatrix.com wrote: BTW, I'm not sure what you plan to do with this connection, but if you haven't seen `twisted.conch.endpoints` (and https://tm.tl/6617) then you probably want to look. ZOMG I had not seen the (existing) Conch endpoints before. Amazing, and

Re: [Twisted-Python] raw socket IWriteDescriptor

2013-10-01 Thread Phil Mayers
On 10/01/2013 08:30 AM, David Stainton wrote: Hi, I'm trying to implement an IWriteDescriptor using raw sockets. So far this is what I wrote... but it doesn't work: https://github.com/david415/hushTCP/blob/master/hush_writer.py Am I doing something obviously wrong here? I don't see you

Re: [Twisted-Python] question about subprocess

2013-09-27 Thread Phil Mayers
On 09/27/2013 02:51 AM, Jonathan Vanasco wrote: i was looking at reactor.SpawnProcess -- which I know is more correct. it just seems to be a bit annoying to use Are you aware of twisted.internet.utils.getProcessOutputAndValue? For simple spawn/check cases, that's pretty much always the best

Re: [Twisted-Python] Clean pb solution for two-way object sync?

2013-09-27 Thread Phil Mayers
On 09/27/2013 05:48 AM, Daniel Sank wrote: Upon re-reading the Cacheable docs I still don't understand how to use it. Have you seen this: http://twistedmatrix.com/documents/current/core/howto/pb-copyable.html#auto9 Essentially, you move all attribute access to accessor methods and do

Re: [Twisted-Python] Passing additional arguments to errback

2013-09-06 Thread Phil Mayers
Maciej Wasilak wasi...@gmail.com wrote: Hello, just one more question: Well, yes, you should, but still keep in mind that you can actually just pass the request like so: .addErrback(handleErrors, request) You don't really have to save the request itself anywhere as an attribute. if I

Re: [Twisted-Python] Twisted serialport dataReceived() provides fragmented data

2013-08-29 Thread Phil Mayers
On 29/08/13 17:15, Sivakumar Balasubramanian wrote: Dear Phil, I replaced thye dataReceived function by stringReceived, and ran the code. But when I do this, the program does not even enter the stringReceived function. That implies your protocol isn't an int16string-prefixed one. I assumed

Re: [Twisted-Python] Advice on porting Python application to Twisted

2013-08-28 Thread Phil Mayers
On 28/08/13 14:40, Tom Sheffler wrote: Hi Matthew - I have a couple of idioms I use for #2 and #3 in your message. Here they are. #2) For timer events, I create a function that when called, continuously schedules itself again in the reactor, does some work for the curren Are you aware of

Re: [Twisted-Python] Serial transport protocol logging on Raspberry Pi

2013-08-25 Thread Phil Mayers
On 08/24/2013 06:37 PM, Lucas Taylor wrote: 9600bps, using USB-Serial adapters (tried 3 different supported chipsets). Logging to local storage and also to stdout. But presumably stdout is going somewhere - either a local or network terminal or file redirect. Could you try a simple

Re: [Twisted-Python] Serial transport protocol logging on Raspberry Pi

2013-08-23 Thread Phil Mayers
On 08/23/2013 06:39 PM, Lucas Taylor wrote: I suppose the obvious answer may be that the Pi is underpowered for this task, but I am hoping to better understand why. I may be able to defer logging to a queue or find other workarounds, but I'd like to figure out why basic usage of logging could

Re: [Twisted-Python] Setting socket options before connect

2013-07-18 Thread Phil Mayers
On 18/07/13 13:10, exar...@twistedmatrix.com wrote: It wasn't so much an API as a Hey, I have an idea... endpoints... here is an example I can think of in 10 seconds. :) Understood! I guess it might be ok if there was a way to reliably inject unknown options with arbitrary payloads, but I'm

Re: [Twisted-Python] logging

2013-06-15 Thread Phil Mayers
On 06/15/2013 06:48 AM, Christopher Armstrong wrote: There's... a lot here. I'm overwhelmed by how complex this system would be, and I think that end users would be as well. I don't really want to put UUIDs into my source code, whether I type them or paste them, and I don't want to have to

Re: [Twisted-Python] github, again

2013-06-06 Thread Phil Mayers
On 06/06/13 17:08, Jonathan Vanasco wrote: the only downside to git, is that once something goes onto the server... it's there for good. it's possible to rebase a repo back to a specific commit , then replay without specific commits, and push -f to overwrite the history... but if anyone

Re: [Twisted-Python] twisted server blocking on MySQL read in main thread when using adbapi.ConnectionPool

2013-05-21 Thread Phil Mayers
On 05/21/2013 01:47 AM, Dan Williams wrote: The invocation is simply py-bt, but it only works if symbols are available, which aren't in my case. Really, surely Ubuntu LTS has debug symbol packages or something? A quick google suggests its packagename-dbg for stripped symbols. I meant to reply

Re: [Twisted-Python] twisted server blocking on MySQL read in main thread when using adbapi.ConnectionPool

2013-05-21 Thread Phil Mayers
On 05/21/2013 08:02 AM, Phil Mayers wrote: or it's python its/it's agh. It's early for me... ___ Twisted-Python mailing list Twisted-Python@twistedmatrix.com http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python

Re: [Twisted-Python] Release questions

2013-04-04 Thread Phil Mayers
On 04/03/2013 10:58 PM, Laurens Van Houtven wrote: Is the accidental corruption thing a real risk? I thought that was the point of, say, TCP checksums :) Perhaps I'm just mistaken as to how often his happens in the wild... TCP checksums absolutely can and do fail to protect you from in-flight

Re: [Twisted-Python] How to dispatch message to different servers

2013-03-02 Thread Phil Mayers
On 03/01/2013 10:27 PM, Glyph wrote: What is AMP too much of? Memory? CPU? Bandwidth? API complexity? Code size? As compared to what? FWIW, every time (all three of them...) I've looked at AMP I got rapidly bored and ended up using PB. My use-cases have usually been Twisted-Twisted,

Re: [Twisted-Python] How to dispatch message to different servers

2013-03-02 Thread Phil Mayers
On 03/02/2013 12:19 PM, Glyph wrote: I wrote a blog post some time ago explaining why you want static declarations, even if your programming language is all nice and dynamic: Being able to early drop bad PDUs is a fine notion, but it's not a property that comes with zero cost. If you feel

Re: [Twisted-Python] How to dispatch message to different servers

2013-03-02 Thread Phil Mayers
On 03/02/2013 03:24 PM, Tristan Seligmann wrote: I don't really understand how this is any easier with PB than with AMP, though. With AMP, you just need the same command definitions on both sides. With PB, you need the exact same Python code versions for every class you are sending over the

Re: [Twisted-Python] How to dispatch message to different servers

2013-03-02 Thread Phil Mayers
On 03/02/2013 04:36 PM, Phil Mayers wrote: My point is that, for the use-cases *I* have, those limitations have not proven to be a problem, so the effort Sorry, should have been: ...so the effort of deploying a protocol which avoids those limitations is not warranted

Re: [Twisted-Python] Building a TCP server, having issues

2013-02-18 Thread Phil Mayers
On 02/17/2013 01:09 AM, Adam Heller wrote: Glyph, I will definately look into that. As far as the server spec, it's over TOR (This part of the 'competition' has since closed, but feel free to catch up: http://uncovering-cicada.wikia.com/wiki/Uncovering_Cicada_Wiki and

Re: [Twisted-Python] Twisted client memory leak

2013-01-22 Thread Phil Mayers
On 22/01/13 13:54, Diego Woitasen wrote: Ok, that's work. Thanks. My question is now, why is this done automatically for EchoProtocol() and not for EchoFactory()? Looks like the references are dropped why Python is taking too much time to frees the memory. An explanation around this is

Re: [Twisted-Python] Twisted client memory leak

2013-01-22 Thread Phil Mayers
On 22/01/13 15:15, Tristan Seligmann wrote: On Tue, Jan 22, 2013 at 3:06 PM, Diego Woitasen di...@woitasen.com.ar wrote: I reproduce the problem with a modification of Echo client example from Twisted documentation: Adding __del__ methods causes the object to become uncollectable if it Ah

Re: [Twisted-Python] Twisted client memory leak

2013-01-22 Thread Phil Mayers
On 22/01/13 16:45, Facundo Batista wrote: Yes, but note that without the __del__ it had the same behaviour... Not quite. The OP said that: a) He had a problem with a Twisted app not freeing memory under load b) He had reproduced that problem with his example, that included __del__

Re: [Twisted-Python] Twisted client memory leak

2013-01-22 Thread Phil Mayers
On 22/01/13 17:06, Facundo Batista wrote: On Tue, Jan 22, 2013 at 2:02 PM, Phil Mayers p.may...@imperial.ac.uk wrote: On 22/01/13 16:45, Facundo Batista wrote: Yes, but note that without the __del__ it had the same behaviour... Not quite. The OP said that: a) He had a problem

Re: [Twisted-Python] Making ConnectionPool not pool

2012-11-27 Thread Phil Mayers
On 27/11/12 12:49, Hynek Schlawack wrote: Yep, and the connections *do* heal after dying. I don't have to restart twistd, it just takes a few failed requests to warm up again. Yes - one attempt per thread in the pool. It is a pain. But as per recent discussions on the list, there's no

Re: [Twisted-Python] Request for help: throttling serving of static content

2012-11-06 Thread Phil Mayers
On 05/11/12 22:26, Itamar Turner-Trauring wrote: There's also twisted.protocols.htb, although again it's old and possibly buggy and may not work. For demo purposes something like https://github.com/rflynn/dragnet might do. If you're on Linux, netem is also an option.

Re: [Twisted-Python] Create client in Server factory

2012-10-31 Thread Phil Mayers
On 10/31/2012 07:14 AM, Grégoire Leroy wrote: Hi, I have a server who receive data from clients A/B/C (remote machines). I want to use a client D (on the same machine than the server) to send this data to another server (remote). The difficulty is, I want to use the same client D connection

Re: [Twisted-Python] Create client in Server factory

2012-10-31 Thread Phil Mayers
On 10/31/2012 02:31 PM, Kevin Horn wrote: See also: http://twistedmatrix.com/trac/wiki/FrequentlyAskedQuestions#HowdoImakeinputononeconnectionresultinoutputonanother That example only uses a single connection in place of your clients A/B/C, but should be adaptable to your situation. In

Re: [Twisted-Python] a question about monotonic clock

2012-10-29 Thread Phil Mayers
On 10/28/2012 10:16 PM, Tristan Seligmann wrote: On Mon, Oct 29, 2012 at 12:05 AM, Phil Mayers p.may...@imperial.ac.uk wrote: This depends on how you're running ntpd. If you have -x on the command line, yes - ntpd will not step. If not, there are circumstances it will step - clock diffs

  1   2   3   >