Re: [tor-dev] May Tor proposal status, and proposal plans for 0.2.3

2011-05-16 Thread Karsten Loesing
On 5/9/11 6:54 PM, Nick Mathewson wrote: xxx-geoip-survey-plan.txt Here's an old document I wrote a while ago about tracking usage by country. Probably it should go into the metrics documentation somewhere (if we do this), or get thrown into old (if we won't do

Re: [tor-dev] Too many cooks spoil the broth---or: how about we clean up the wiki?

2011-06-11 Thread Karsten Loesing
On 6/11/11 2:41 PM, and...@torproject.org wrote: On Sat, Jun 11, 2011 at 08:17:35AM +0200, karsten.loes...@gmx.net wrote 2.5K bytes in 34 lines about: : Do you plan to fix links in the mailing list archives as well? How : about links in our e-mail inboxes? : : Nope. But we could add

Re: [tor-dev] Tor Relay Setup Wizard

2011-07-13 Thread Karsten Loesing
Hi Damian, On 7/13/11 7:01 PM, Damian Johnson wrote: Hi all. Over the last few weeks I've been working on a relay setup wizard for arm. Its purpose is to make volunteering to be a relay easy, narrowing the options to those most commonly used and giving nice descriptions/defaults to encourage

Re: [tor-dev] Tor Relay Setup Wizard

2011-07-13 Thread Karsten Loesing
On 7/14/11 5:52 AM, Damian Johnson wrote: In that case, setting Internal Relay as the default could be problematic. If people use arm on their clients, they shouldn't be tricked into becoming a relay only because that's the default. They should know what they're doing when setting up a

Re: [tor-dev] Unused -v and -F options in torperf/trivsocks-client?

2011-07-29 Thread Karsten Loesing
On 7/29/11 3:39 PM, Steven Murdoch wrote: Hi Karsten, David, On 29 Jul 2011, at 05:00, Karsten Loesing wrote: Hmm, for some reason I don't get those errors (or warnings) about unused variables. But I think you're right in that these variables can go away. This is Steven's code, so I'd

[tor-dev] Survey on Tor Trac usage and how you manage your tasks

2011-08-22 Thread Karsten Loesing
Hi everyone! At the last annual dev meeting in Waterloo we had a very productive discussion about managing the various channels of Tor communication: https://trac.torproject.org/projects/tor/wiki/org/meetings/2011TorAnnualDevMeeting/FirehoseOutput Related to that discussion, we should talk

[tor-dev] Sanitizing and publishing our web server logs

2011-08-25 Thread Karsten Loesing
Hi everyone, we have been discussing sanitizing and publishing our web server logs for quite a while now. The idea is to remove all potentially sensitive parts from the logs, publish them in monthly tarballs on the metrics website, and analyze them for top visited pages, top downloaded packages,

Re: [tor-dev] Survey on Tor Trac usage and how you manage your tasks

2011-08-29 Thread Karsten Loesing
On 8/22/11 2:29 PM, Karsten Loesing wrote: Hi everyone! At the last annual dev meeting in Waterloo we had a very productive discussion about managing the various channels of Tor communication: https://trac.torproject.org/projects/tor/wiki/org/meetings/2011TorAnnualDevMeeting

Re: [tor-dev] Sanitizing and publishing our web server logs

2011-09-02 Thread Karsten Loesing
Hi Andrew, On 9/2/11 2:18 AM, Andrew Lewman wrote: On Thursday, August 25, 2011 04:08:00 Karsten Loesing wrote: we have been discussing sanitizing and publishing our web server logs for quite a while now. The idea is to remove all potentially sensitive parts from the logs, publish them

Re: [tor-dev] Sanitizing and publishing our web server logs

2011-09-05 Thread Karsten Loesing
On 9/2/11 3:06 PM, Sebastian Hahn wrote: On Sep 2, 2011, at 2:46 PM, Karsten Loesing wrote: Hi Andrew, On 9/2/11 2:18 AM, Andrew Lewman wrote: On Thursday, August 25, 2011 04:08:00 Karsten Loesing wrote: we have been discussing sanitizing and publishing our web server logs for quite

Re: [tor-dev] Survey on Tor Trac usage and how you manage your tasks

2011-09-06 Thread Karsten Loesing
On 8/29/11 10:48 AM, Karsten Loesing wrote: The new deadline is Sunday, September 4, 2011 Dear Tor developers and volunteers who haven't responded yet: If you have an opinion on using Trac, please let us know! First of all, thanks to the 13 people for taking part in the survey

Re: [tor-dev] Survey on Tor Trac usage and how you manage your tasks

2011-09-12 Thread Karsten Loesing
On 9/6/11 12:06 PM, Christian Fromme wrote: [Suggestion: Backup and delete all reports with a component name in them. The current list of Available Reports list is mostly useless for newcomers who don't care much about components, but who are interested in finding something to work on.

Re: [tor-dev] Survey on Tor Trac usage and how you manage your tasks

2011-09-12 Thread Karsten Loesing
On 9/6/11 2:19 PM, Robert Ransom wrote: On 2011-09-06, Karsten Loesing karsten.loes...@gmx.net wrote: 1.1 Which of the reports (stored ticket queries) do you use most often? From all the replies, there's 1 person using 5 reports, 2 persons using 3 reports, 1 person using 2 reports, 4

Re: [tor-dev] Survey on Tor Trac usage and how you manage your tasks

2011-09-12 Thread Karsten Loesing
On 9/6/11 11:01 PM, katmagic wrote: Sorry for the late reply — I haven't checked my email in a while — but I'm replying anyway because I've some strong feelings on this issue. In short, Trac sucks. My issues with it are as follows: 1. The design sucks. You're right, it needs more green!

Re: [tor-dev] Survey on Tor Trac usage and how you manage your tasks

2011-09-12 Thread Karsten Loesing
On 9/12/11 3:51 PM, Roger Dingledine wrote: On Tue, Sep 06, 2011 at 10:44:11AM +0200, Karsten Loesing wrote: The Component field (10, 1, 1) is used to find/filter tickets and guess who's paying attention to a ticket. 1 person said that the many Tor components make it hard to refer

Re: [tor-dev] Survey on Tor Trac usage and how you manage your tasks

2011-09-13 Thread Karsten Loesing
On 9/13/11 5:20 AM, katmagic wrote: On Mon, 2011-09-12 at 15:57 +0200, Karsten Loesing wrote: On 9/6/11 11:01 PM, katmagic wrote: Sorry for the late reply — I haven't checked my email in a while — but I'm replying anyway because I've some strong feelings on this issue. In short, Trac sucks

Re: [tor-dev] Proposal 186: Multiple addresses for one OR or bridge

2011-09-22 Thread Karsten Loesing
Hi Nick, a few comments to proposal 186 below: On 9/21/11 8:13 PM, Nick Mathewson wrote: In consonance with our changes to the (Socks|Trans|NATD|DNS)Port options made in 0.2.3.x for proposal 171, I make a corresponding change to allow multiple SocksPort options and deprecate

Re: [tor-dev] Proposal 185: Directory caches without DirPort

2011-09-23 Thread Karsten Loesing
Looks like we lost tor-dev somewhere. Quoting Nick's reply without cutting out stuff I have no comments to. On 9/22/11 10:16 PM, Nick Mathewson wrote: On Thu, Sep 22, 2011 at 4:49 AM, Karsten Loesing karsten.loes...@gmx.net wrote: Hi Nick, and here are a few comments to your proposal 185

Re: [tor-dev] Sanitizing and publishing our web server logs

2011-10-18 Thread Karsten Loesing
On 8/25/11 10:08 AM, Karsten Loesing wrote: we have been discussing sanitizing and publishing our web server logs for quite a while now. The idea is to remove all potentially sensitive parts from the logs, publish them in monthly tarballs on the metrics website, and analyze them for top

Re: [tor-dev] Survey on Tor Trac usage and how you manage your tasks

2011-10-25 Thread Karsten Loesing
On 10/20/11 5:34 PM, Erinn Clark wrote: * Karsten Loesing karsten.loes...@gmx.net [2011:10:19 16:12 +0200]: 2. Try harder to include diffs in tor-wiki-changes notifications. I looked for an option that does this in Trac 0.12, but didn't find one. Erinn, do you know how we could implement

Re: [tor-dev] Sanitizing IPv6 addresses in bridge descriptors

2012-01-16 Thread Karsten Loesing
On 1/16/12 8:46 AM, Karsten Loesing wrote: On 1/11/12 10:34 AM, Linus Nordberg wrote: Alex Le Heux ale...@funk.org wrote Wed, 11 Jan 2012 09:57:00 +0100: | RFC 3849 defines the prefix 2001:DB8::/32 as being reserved for | documentation. That should be fine

[tor-dev] IRC meeting to discuss sponsor F July milestone on Thu Apr 12, 16:00--18:00 UTC in #tor-dev

2012-04-04 Thread Karsten Loesing
Hi everyone, we have an upcoming sponsor F milestone on July 1. Here's the list of deliverables: https://trac.torproject.org/projects/tor/wiki/org/sponsors/SponsorF/Year2#Phase2Nov152012 We need a ticket owner for all tickets in the July 1 milestone. We also need a schedule for each of those

[tor-dev] Can we stop sanitizing nicknames in bridge descriptors?

2012-05-02 Thread Karsten Loesing
Hi everybody, we're discussing in #5684 whether we can stop sanitizing nicknames in the bridge descriptors that we publish here: https://metrics.torproject.org/data.html#bridgedesc The sanitizing process is described here: https://metrics.torproject.org/formats.html#bridgedesc When we started

Re: [tor-dev] Can we stop sanitizing nicknames in bridge descriptors?

2012-05-04 Thread Karsten Loesing
On 5/3/12 7:22 PM, Sebastian G. bastik.tor wrote: The safest way is to ensure that bridge and relay operators are aware of the fact that their naming scheme should avoid correlations, wherever both are actually located. The question here is on how to ensure it?! This is a usability question.

Re: [tor-dev] Can we stop sanitizing nicknames in bridge descriptors?

2012-05-04 Thread Karsten Loesing
On 5/3/12 8:06 PM, Robert Ransom wrote: On 5/3/12, Karsten Loesing kars...@torproject.org wrote: How do we define similar and located where the relay is? I can see how a relay bastik1 and a bridge bastik2 have similar nicknames, but would we also teach a program that bastikrelay

Re: [tor-dev] Can we stop sanitizing nicknames in bridge descriptors?

2012-05-04 Thread Karsten Loesing
On 5/4/12 3:52 PM, Sebastian G. bastik.tor wrote: Karsten Loesing, 04.05.2012 12:31: Sounds like a fine approach. Want to do it (when the 2008 tarball is available)? It would be interesting to see a) what fraction of bridges you think you can derive IP addresses for and b) how accurate your

Re: [tor-dev] [tor-assistants] Python metrics-lib

2012-05-05 Thread Karsten Loesing
[Moving this thread to tor-dev as suggested by Damian in separate mail.] Hi Damian, hi Beck, On 5/4/12 6:59 PM, Damian Johnson wrote: Hi Beck. I noticed that stem has not been updated during the last ten days Yup, I've been busy for a while with a new arm release [1] and a variety of

Re: [tor-dev] [tor-assistants] Python metrics-lib

2012-05-07 Thread Karsten Loesing
On 5/6/12 3:36 AM, Damian Johnson wrote: First I'd like to make sure that I'm clear on what we're trying to do. The javadocs for VerifyDescriptors [1] says that it... Verify server descriptors using the contained signing key. Verify that 1) a contained fingerprint is actually a hash of the

Re: [tor-dev] [tor-assistants] Python metrics-lib

2012-05-07 Thread Karsten Loesing
On 5/7/12 7:49 PM, Beck Chen wrote: On Mon, May 7, 2012 at 5:13 PM, Karsten Loesing kars...@torproject.orgwrote: On 5/6/12 3:36 AM, Damian Johnson wrote: First I'd like to make sure that I'm clear on what we're trying to do. The javadocs for VerifyDescriptors [1] says that it... Verify

Re: [tor-dev] [tor-assistants] Python metrics-lib

2012-05-08 Thread Karsten Loesing
On 5/8/12 4:47 AM, Robert Ransom wrote: On 5/8/12, Beck Chen csyb...@gmail.com wrote: According to the outline, the long-term identity key should be different from the signing key, which changes every 3-12 months. Then why should the signing key become the identity key in the descriptor

[tor-dev] Proposal: Make bridges report statistics on daily v3 network status requests

2012-05-10 Thread Karsten Loesing
Hi Nick, here is the proposal as discussed in #5807 to improve our bridge usage statistics. Thanks, Karsten Filename: xxx-bridge-v3-reqs-stats.txt Title: Make bridges report statistics on daily v3 network status requests Author: Karsten Loesing Created: 10-May-2012 Status: Open Target: 0.2.4.x

Re: [tor-dev] [tor-assistants] Python metrics-lib

2012-05-14 Thread Karsten Loesing
On 5/14/12 2:30 AM, Damian Johnson wrote: Hi Karsten, hi Beck. Just pushed stem support for extrainfo descriptors (ye gods they have a lot of attributes)... * Implementation https://gitweb.torproject.org/stem.git/blob/HEAD:/stem/descriptor/extrainfo_descriptor.py * Unit Tests

Re: [tor-dev] Proposal: Make bridges report statistics on daily v3 network status requests

2012-05-15 Thread Karsten Loesing
On 5/10/12 5:46 PM, Nick Mathewson wrote: On Thu, May 10, 2012 at 4:31 AM, Karsten Loesing kars...@torproject.org wrote: here is the proposal as discussed in #5807 to improve our bridge usage statistics. This is now proposal 201. Thanks! Thanks for adding the proposal! However, I found

Re: [tor-dev] Can we stop sanitizing nicknames in bridge descriptors?

2012-05-21 Thread Karsten Loesing
On 5/19/12 11:41 AM, Sebastian G. bastik.tor wrote: Karsten Loesing, 16.05.2012 08:47: On 5/2/12 2:30 PM, Karsten Loesing wrote: If nobody objects within the next, say, two weeks, I'm going to make an old tarball from 2008 available with original nicknames. And if nobody screams, I'll

[tor-dev] Sanitized bridge descriptor format 1.0

2012-05-21 Thread Karsten Loesing
Hi Damian, I plan to make a few changes to the bridge descriptor sanitizer to implement changes discussed on this list and in various Trac tickets. The result will be format version 1.0. Here's what will change compared to the current (unversioned) format. Can you take a look whether stem would

Re: [tor-dev] Sanitized bridge descriptor format 1.0

2012-05-21 Thread Karsten Loesing
Hi Damian, On 5/21/12 5:55 PM, Damian Johnson wrote: Hi Karsten. - Bridge network statuses contain a published line Oh, I didn't realize that there was a consensus that included bridges. Mind explaining where they come from and what they're for? The bridge authority generates a bridge

Re: [tor-dev] Sanitized bridge descriptor format 1.0

2012-05-22 Thread Karsten Loesing
On 5/21/12 7:19 PM, Karsten Loesing wrote: On 5/21/12 5:55 PM, Damian Johnson wrote: I didn't realize that bridge extrainfo descriptors _were_ sanitized. What section of the format page details the scrubbing for those? Aha, good catch, that's not mentioned on the format page. Right now

Re: [tor-dev] Sanitized bridge descriptor format 1.0

2012-05-24 Thread Karsten Loesing
Hi Damian, On 5/23/12 7:27 PM, Damian Johnson wrote: The bridge descriptor tarballs contain bridge network statuses, server descriptors, and extra-info descriptors. See: https://metrics.torproject.org/data.html#bridgedesc Oops, I read 'contain similar documents as the relay descriptor

Re: [tor-dev] Fwd: Re: Can we stop sanitizing nicknames in bridge descriptors?

2012-05-29 Thread Karsten Loesing
On 5/26/12 9:30 AM, Sebastian G. bastik.tor wrote: Karsten Loesing, 22.05.2012 09:24: Unless one objects or you disagree I'm going to upload the files I created and explain how and maybe I can say even why. No objections at all. Open discussion is good. I created a Blog, just because I

Re: [tor-dev] Can we stop sanitizing nicknames in bridge descriptors?

2012-05-30 Thread Karsten Loesing
On 5/16/12 8:47 AM, Karsten Loesing wrote: On 5/2/12 2:30 PM, Karsten Loesing wrote: If nobody objects within the next, say, two weeks, I'm going to make an old tarball from 2008 available with original nicknames. And if nobody screams, I'll provide the remaining tarballs containing original

Re: [tor-dev] TorStatus

2012-06-04 Thread Karsten Loesing
Hi Felix, On 6/4/12 6:51 AM, Felix Ker wrote: I'm trying to use TorStatus and it took me almost 2 hours to set everything up and able to run tns_update.pl smoothly with no error. However, I am facing a problem that Google cannot help me. [0] starting... [0] mirror? [0] connecting to Tor

Re: [tor-dev] TorStatus

2012-06-04 Thread Karsten Loesing
On 6/4/12 8:40 AM, Felix Ker wrote: Thank you for sharing! Looks like there's too little information about how Atlas can be used to list the servers. Would you be able to share any documentation? Do you mean how Atlas can be used to display a list of the current relays and/or bridges rather

Re: [tor-dev] [tor-assistants] Stats on Amazon bridges

2012-06-06 Thread Karsten Loesing
On 6/6/12 5:49 PM, SiNA Rabbani wrote: I need to get a count of all the Amazon Tor images running bridges. The reason I need this data is so I can follow-up with acessnow.org about the campaign they are running at: https://www.globalproxycloud.net/ How should I go about that data? See the

Re: [tor-dev] stem test output

2012-06-27 Thread Karsten Loesing
On 6/25/12 3:45 AM, Damian Johnson wrote: Karsten, should the 'dirreq-v3-share' percentage values be able to go above 100%? The extra-info descriptors that I just fetched has one such entry, which makes stem's descriptor parser complain... extra-info siltornado

Re: [tor-dev] Stem Proc Integration Tests

2012-06-29 Thread Karsten Loesing
On 6/28/12 11:37 PM, Damian Johnson wrote: - integ tests are pretty short, and just run the parser against some test data from the metrics archive and the cached consensus Keep in mind that metrics tarballs can be huge. stem's tests probably shouldn't download one or more of these tarballs

Re: [tor-dev] Stem Descriptor Parsers

2012-07-06 Thread Karsten Loesing
On Fri, Jul 6, 2012 at 4:25 AM, Norman Danner ndan...@wesleyan.edu wrote: Do I understand Onionoo correctly to be basically a small webservice that returns a JSON formatted description of data read from a file based on the HTTP request parameters, along with a program that presumably runs with

Re: [tor-dev] Proposal 204: Subdomain support for Hidden Service addresses

2012-07-10 Thread Karsten Loesing
On 7/7/12 7:06 PM, Nick Mathewson wrote: The only part I'm worried about here is that we had once considered doing authenticated hidden services or some other kind of wacky hidden service with a design like b.aaa.onion, where b is some additional data to use in the

Re: [tor-dev] introduction and progress toward an interactive version of a Tor metrics website

2012-07-16 Thread Karsten Loesing
Hi Walter, On 7/5/12 6:21 PM, Walter Kim wrote: Oops, your mail got lost somewhere between the Florence trip and recovering from it. Sorry for the late reply. I'm a mathematician/coder/visualization person living in San Francisco. I've been in contact with Karsten Loesing about making more

Re: [tor-dev] First five Tor tech reports

2012-07-18 Thread Karsten Loesing
On 7/18/12 5:12 PM, Zack Weinberg wrote: On Thu, Jul 12, 2012 at 6:12 AM, Karsten Loesing kars...@torproject.org wrote: here are the first five metrics tech reports that I'd like to turn into Tor tech reports (see #5405 for the idea behind this). I'd like to offer some typographical

Re: [tor-dev] Pyonionoo Descriptors

2012-07-28 Thread Karsten Loesing
On 7/28/12 11:44 AM, Sathyanarayanan Gunasekaran wrote: If you want some sample summary, bandwidth, or details documents to see see how they look like, I can send you the ones I got from Karsten during the Tor dev meeting. Oh, I wasn't aware that Sathya is working on the backend and Megan and

Re: [tor-dev] introduction and progress toward an interactive version of a Tor metrics website

2012-07-31 Thread Karsten Loesing
Hi Walter, hi Arturo, On 7/31/12 4:35 AM, Walter Kim wrote: Hi Karsten, Arturo, and others, Sorry for being out of touch for a couple weeks; I had some day job deadlines. I've added more data (bandwidth, users) to site I'm working on: http://tigerpa.ws/tor_metrics/ And set the default

[tor-dev] Karsten's status report July 1--31

2012-08-03 Thread Karsten Loesing
Hi all, here's what I did in July. The numbers in [] are the ticket number and percentage of my total developer time in July. Best, Karsten Briefly looked into Maxmind's GeoIP database that started labeling relays as coming from the A1 -- Anonymous Proxy country. We'll need to fix that, or

Re: [tor-dev] OnionOO protocol questions

2012-08-03 Thread Karsten Loesing
Hi Norman, On 8/3/12 8:22 PM, Norman Danner wrote: A few questions on the Onionoo protocol specification: If multiple parameters are specified in the GET request, does that imply a logical and or a logical or (or something else)? E.g., suppose the GET request has type=relay and

Re: [tor-dev] OnionOO protocol questions

2012-08-04 Thread Karsten Loesing
Hi Norman, On 8/3/12 9:42 PM, Norman Danner wrote: If I understand the weights documents correctly, there is no one consensus weight for a given router. What exactly is the ordering we should use when the request asks to order by consensus weight? It seems like determining the consensus

[tor-dev] Next ten Tor Tech Reports (was: First five Tor tech reports)

2012-08-08 Thread Karsten Loesing
On 7/12/12 3:12 PM, Karsten Loesing wrote: here are the first five metrics tech reports that I'd like to turn into Tor tech reports (see #5405 for the idea behind this). The next batch of ten Tor Tech Reports is now available (all in the list except for the five from 2011 which I posted here

Re: [tor-dev] Next Tor release timeframes?

2012-08-08 Thread Karsten Loesing
On 8/8/12 8:38 PM, Nick Mathewson wrote: On Wed, Aug 8, 2012 at 5:04 AM, Roger Dingledine a...@mit.edu wrote: 1) Do we have any requirements to release an 0.2.4.1-alpha at any particular date? I haven't been following e.g. the latest SponsorG timelines. Yes, we should have tested packages by

Re: [tor-dev] Next ten Tor Tech Reports

2012-08-08 Thread Karsten Loesing
Hi Philipp, On 8/8/12 7:03 PM, Philipp Winter wrote: On Wed, Aug 08, 2012 at 12:22:16PM +0200, Karsten Loesing wrote: Feedback much appreciated! The pdf documents look really good now. I don't know if the tech reports get cited a lot but it might be worth adding BibTeX entries next

Re: [tor-dev] Next ten Tor Tech Reports

2012-08-09 Thread Karsten Loesing
Hi Paul, On 8/9/12 3:03 PM, Paul Syverson wrote: On Thu, Aug 09, 2012 at 08:29:25AM +0200, Karsten Loesing wrote: On 8/8/12 8:13 PM, Mike Perry wrote: Since HotPETS doesn't count as publishing perhaps this should be listed as a tech report: http://fscked.org/talks/TorFlow-HotPETS-final.pdf

Re: [tor-dev] Pyonionoo

2012-08-10 Thread Karsten Loesing
Hi Norman, On 8/10/12 3:15 AM, Norman Danner wrote: On 8/9/12 5:28 PM, Norman Danner wrote: Hi Karsten, We have a preliminary version of the Pyonionoo front-end at git://github.com/meganchang/pyonionoo.git Make sure to look at the database branch. We'd be happy to hear feedback.

Re: [tor-dev] Pyonionoo

2012-08-13 Thread Karsten Loesing
Hi Norman, On 8/10/12 4:10 PM, Norman Danner wrote: Oh dear; hadn't realized this was an issue. We installed Twisted and Cyclone from source. There is a debian package for twisted (python-twisted), but not for Cyclone. I managed to install Cyclone with Sathya's apt-get/pip instructions.

Re: [tor-dev] IRC meeting to plan sponsor L milestones on Wed July 18, 15:00 UTC in #tor-dev

2012-08-15 Thread Karsten Loesing
On 8/14/12 9:31 PM, Andrew Lewman wrote: On Tue, 14 Aug 2012 10:09:39 +0200 Karsten Loesing kars...@torproject.org wrote: Mike, Andrew, Roger, Runa: please update the wiki page with your feedback in this thread. Please keep the developer feedback per deliverable as short as possible, ideally

Re: [tor-dev] Next ten Tor Tech Reports

2012-08-20 Thread Karsten Loesing
On 8/9/12 8:29 AM, Karsten Loesing wrote: On 8/8/12 8:13 PM, Mike Perry wrote: Since HotPETS doesn't count as publishing perhaps this should be listed as a tech report: http://fscked.org/talks/TorFlow-HotPETS-final.pdf [...] How about we put the LaTeX sources in tech-reports.git, change

Re: [tor-dev] an alternate MyFamily definition

2012-08-24 Thread Karsten Loesing
On 8/23/12 10:12 PM, tagnaq wrote: True, but: If one relay disappears for a while then the family may break into two if it was the only joint. For the family (see #6662): 3cce3a91f6a625~8DE5 bc1245cbe16d5ee9b2~2D25 the connecting relay was down since 2012-04-04 and still karsten created

Re: [tor-dev] Next ten Tor Tech Reports

2012-08-27 Thread Karsten Loesing
On 8/20/12 11:06 AM, Karsten Loesing wrote: On 8/9/12 8:29 AM, Karsten Loesing wrote: On 8/8/12 8:13 PM, Mike Perry wrote: Since HotPETS doesn't count as publishing perhaps this should be listed as a tech report: http://fscked.org/talks/TorFlow-HotPETS-final.pdf [...] How about we put

[tor-dev] Karsten's status report August 1--31

2012-09-01 Thread Karsten Loesing
Hi everyone, August was a long month for me, and I feel like I spent more time reviewing other people's code than writing my own. That's really cool! We have a bunch of new metrics-related code now, and I hope there will be even more code contributions for me to review next month! So, below is

Re: [tor-dev] Extending Pyonionoo to provide statistics

2012-10-19 Thread Karsten Loesing
On 10/13/12 4:30 PM, Damian Johnson wrote: Hi Karsten. This is actually really good timing. As you probably noticed from tor-commits@ I just pushed support for network status documents (v2 and v3 votes, consensus, and microdescriptor consensuses). It's the combination of a month of work from

Re: [tor-dev] Automating Bridge Reachability Testing (#6414)

2012-10-23 Thread Karsten Loesing
Hi Isis! On 10/12/12 6:48 PM, Isis wrote: So, I am rushing to meet the final deadline, but I still think it is doable. I have mostly finished up my OONI work for the month, and I planned to spend the remainder of this month working on the bridge test. Sounds good. Does working include

Re: [tor-dev] Proposal 214: Allow 4-byte circuit IDs in a new link protocol

2012-11-10 Thread Karsten Loesing
On 11/10/12 11:50 AM, Tim Wilde wrote: On Tue, Nov 6, 2012 at 9:36 PM, Nick Mathewson ni...@freehaven.net wrote: 2.1. Better allocation of circuitID space In the current Tor design, circuit ID allocation is determined by whose RSA public key has the lower modulus. How ridiculous!

Re: [tor-dev] Affect of Proposal 207 on user metrics

2013-01-18 Thread Karsten Loesing
Hi Abel, On 1/17/13 9:00 PM, Abel Luck wrote: Question: How does proposal 207 (relay fetching through entry guards) affect the user metric data? Good thinking. AFAICS, accuracy of user estimates shouldn't be affected by the introduction of directory guards. It may be that some relays will

[tor-dev] Twisted-based Tor client performance measurement tool

2013-01-21 Thread Karsten Loesing
Hi everyone, you probably heard of Torperf [0], the tool that produces our Tor client performance graphs [1]. Torperf is mostly a bunch of scripts and lengthy HOWTOs, so setting it up and keeping it happy is not exactly trivial. The same applies to extending it, e.g., to make downloads using

Re: [tor-dev] Twisted-based Tor client performance measurement tool

2013-01-22 Thread Karsten Loesing
On 1/21/13 10:28 PM, Rob van der Hoeven wrote: Hi Karsten, Over a year ago I wrote a small measuring proxy called Monitor In The Middle. This proxy sits between the browser and Tor and examines all HTTP traffic. Results of the measurements like response times, timeouts etc can be viewed

Re: [tor-dev] Twisted-based Tor client performance measurement tool

2013-01-22 Thread Karsten Loesing
On 1/22/13 9:32 AM, Linus Nordberg wrote: meejah mee...@meejah.ca wrote Tue, 22 Jan 2013 11:32:39 +0400: | You'd need https://github.com/ln5/twisted-socks for a SOCKS client for | this (looks like V4 only?). There are some other ones floating around | out there, too, but nothing in core

Re: [tor-dev] Twisted-based Tor client performance measurement tool

2013-01-22 Thread Karsten Loesing
On 1/22/13 9:35 AM, Linus Nordberg wrote: Karsten Loesing kars...@torproject.org wrote Mon, 21 Jan 2013 21:06:38 +0100: | That's a lot, and to make things even more fun, there's a sponsor | deadline to have more realistic Torperf measurements by February 28. This is what stops me from

Re: [tor-dev] Twisted-based Tor client performance measurement tool

2013-01-23 Thread Karsten Loesing
On 1/22/13 10:35 PM, Linus Nordberg wrote: Karsten Loesing kars...@torproject.org wrote Tue, 22 Jan 2013 21:56:47 +0100: | | You'd need https://github.com/ln5/twisted-socks for a SOCKS client for | | this (looks like V4 only?). There are some other ones floating around | | out there, too

[tor-dev] Proposal: Controller events to better understand connection/circuit usage

2013-02-06 Thread Karsten Loesing
/karsten/tor.git/shortlog/refs/heads/morestats2 Feedback, to both proposal and code, much appreciated! Thanks, Karsten Filename: xxx-usage-controller-events.txt Title: Controller events to better understand connection/circuit usage Author: Rob Jansen, Karsten Loesing Created: 2013-02-06 Status

Re: [tor-dev] Proposal: Controller events to better understand connection/circuit usage

2013-02-09 Thread Karsten Loesing
Hi Damian! Thanks a lot for your feedback! The proposed event formats are not at all set in stone. If we can change formats to make events easier to parse, by all means let's do that. You probably have more experience with the control port than anyone at Tor, so I say let's listen to you. On

Re: [tor-dev] Proposal: Controller events to better understand connection/circuit usage

2013-02-09 Thread Karsten Loesing
On 2/7/13 5:45 PM, Nick Mathewson wrote: On Wed, Feb 6, 2013 at 11:14 AM, Karsten Loesing kars...@torproject.org wrote: Hi everyone, here's a proposal that defines three new controller events for the TestingTorNetwork mode that shall help us better understand connection and circuit usage

Re: [tor-dev] Proposal: Controller events to better understand connection/circuit usage

2013-02-11 Thread Karsten Loesing
On Sat, Feb 9, 2013 at 11:27 PM, Damian Johnson ata...@torproject.org wrote: I wonder if we should avoid restricting connection types in the spec by defining this argument as connection type _string_ as opposed to an enumeration. That depends on how volatile you think it'll be. If it's

Re: [tor-dev] Proposal: Controller events to better understand connection/circuit usage

2013-02-11 Thread Karsten Loesing
On Sun, Feb 10, 2013 at 7:08 AM, Andreas Krey a.k...@gmx.de wrote: On Sat, 09 Feb 2013 14:27:33 +, Damian Johnson wrote: ... I cringe a bit to suggest it, but maybe a mapping in a mapping? CELL_STATS PCircID=8 PConnID=47110 PAdded=created:1,relay:1 PRemoved=created:1,relay:1 You can as

Re: [tor-dev] Proposal: Controller events to better understand connection/circuit usage

2013-02-11 Thread Karsten Loesing
On Mon, Feb 11, 2013 at 3:35 PM, meejah mee...@meejah.ca wrote: I haven't looked at everything in proposal 218, but I would suggest maybe splitting the CELL_STATS into CELL_STATS_LOCAL and CELL_STATS_NETWORK: 650 SP CELL_STATS_NETWORK SP CircID SP ConnID SP Added SP

Re: [tor-dev] Proposal: Controller events to better understand connection/circuit usage

2013-02-11 Thread Karsten Loesing
On 2/11/13 5:37 PM, Damian Johnson wrote: Sure. Please find the revised proposal in branch proposal218 of my public torspec repository: https://gitweb.torproject.org/user/karsten/torspec.git/shortlog/refs/heads/proposal218 Hi Karsten. Looks good! Pushed some revisions to my proposal218

Re: [tor-dev] Proposal: Controller events to better understand connection/circuit usage

2013-02-19 Thread Karsten Loesing
On 2/12/13 4:54 PM, Damian Johnson wrote: AppWard and ExitWard indicate the direction of cell flow through the circuit. Previous cell events aggregated statistics for both directions and therefore did not capture information which I believe may be important. These are much more informative

Re: [tor-dev] Proposal: Controller events to better understand connection/circuit usage

2013-02-19 Thread Karsten Loesing
On 2/19/13 5:45 PM, Damian Johnson wrote: I think we should add two more fields InboundName and OutboundName to CELL_STATS events. These fields would contain LongName ($CC88FB3B78599580F1EE4F6F73E26A7EC3DF2CA1~tokenconn) or Target (like 60.1.0.0:10002) of the previous or next node in a

Re: [tor-dev] Proposal: Controller events to better understand connection/circuit usage

2013-02-20 Thread Karsten Loesing
On 2/20/13 5:13 PM, Damian Johnson wrote: In general, I agree. Here, I re-used the code that adds a LongName or Target to CIRC events. It's a single function call that returns the best information tor has about the remote end of a connection. I'm not sure that I follow. Do you mean the

Re: [tor-dev] Proposal: Controller events to better understand connection/circuit usage

2013-02-22 Thread Karsten Loesing
On 2/22/13 5:36 PM, Rob Jansen wrote: On Tue, Feb 19, 2013 at 10:20 AM, Karsten Loesing kars...@torproject.orgwrote: On 2/12/13 4:54 PM, Damian Johnson wrote: AppWard and ExitWard indicate the direction of cell flow through the circuit. Previous cell events aggregated statistics for both

Re: [tor-dev] Proposal: Controller events to better understand connection/circuit usage

2013-02-25 Thread Karsten Loesing
On 2/23/13 11:20 PM, Rob Jansen wrote: On Feb 23, 2013 4:22 PM, Karsten Loesing kars...@torproject.org wrote: Your understanding of n_circ_id and p_circ_id matches mine, but are you sure there's a UID for circuits other than origin circuits? I think you mean origin_circuit_t-global_identifier

Re: [tor-dev] Proposal: Controller events to better understand connection/circuit usage

2013-02-28 Thread Karsten Loesing
[Nick, can you merge my torspec proposal218 branch, please? Thanks!] On 2/28/13 2:08 AM, Rob Jansen wrote: On Mon, Feb 25, 2013 at 10:28 AM, Karsten Loesing kars...@torproject.org wrote: On 2/23/13 11:20 PM, Rob Jansen wrote: On Feb 23, 2013 4:22 PM, Karsten Loesing kars

Re: [tor-dev] Searchable Tor descriptor and Metrics data archive - GSoC 2013

2013-04-11 Thread Karsten Loesing
On 4/10/13 11:44 PM, Praveen Kumar wrote: I am Praveen Kumar from India. I want to work on the project Searchable Tor descriptor and Metrics data archive. I have participated in the past instances of GSoC with Melange and e-cidadania, and have an extensive experience in development with

Re: [tor-dev] Interested in getting involved with pyDoctor

2013-04-16 Thread Karsten Loesing
On 4/15/13 10:20 PM, Miłosz Gaczkowski wrote: Hi, Hi Miłosz, I'd like to get involved in the development of pyDoctor (https://www.torproject.org/getinvolved/volunteer.html.en#metrics-pyDoctor). I'm not too bothered about whether it'd be through GSoC or not (i.e. I obviously wouldn't mind

Re: [tor-dev] Interested in getting involved with pyDoctor

2013-04-17 Thread Karsten Loesing
(Adding tor-dev back to the cc.) On 4/16/13 9:31 PM, Miłosz Gaczkowski wrote: On 16/04/2013 07:28, Karsten Loesing wrote: Sounds great! Welcome to Tor! Thanks for the warm welcome :) In theory, you can start working on this project right now. The first step is probably to understand what

Re: [tor-dev] Tor Censorship Detector: Can I help?

2013-05-06 Thread Karsten Loesing
On 5/7/13 12:44 AM, Sam Burnett wrote: Hi, Hi Sam, I'd like to help improve the Tor Censorship Detector. I've read some background material and think I understand the basics of George Danezis' detection algorithm [1, 2]. Great! Trivial nitpick: here's a better URL for George's tech report:

Re: [tor-dev] Local onionoo cache

2013-05-13 Thread Karsten Loesing
On 5/12/13 12:38 PM, David Fifield wrote: Karsten, could I ask you to take a quick look at this code? https://trac.torproject.org/projects/tor/ticket/7549#comment:14 https://trac.torproject.org/projects/tor/attachment/ticket/7549/onionoo-querying-ver2.zip It's a daemon that keeps a local

Re: [tor-dev] Remote descriptor fetching

2013-05-28 Thread Karsten Loesing
On 5/28/13 1:50 AM, Damian Johnson wrote: Hi Karsten. I'm starting to look into remote descriptor fetching, a capability of metrics-lib that stem presently lacks [1][2]. The spec says that mirrors provide zlib compressed data [3], and the DirectoryDownloader handles this via a

Re: [tor-dev] Metrics Plans

2013-05-29 Thread Karsten Loesing
: Karsten Loesing kars...@torproject.org Date: Thu, May 23, 2013 at 11:37 AM Subject: Re: Metrics Plans To: Damian Johnson ata...@torproject.org Cc: Tor Assistants tor-assista...@lists.torproject.org On 5/23/13 7:22 PM, Damian Johnson wrote: Hi Karsten. I just finished reading over Kostas

Re: [tor-dev] [tor-talk] Client simulation

2013-06-07 Thread Karsten Loesing
(Sorry for cross-posting, but I think this is a topic for tor-dev@, not tor-talk@. If you agree, please reply on tor-dev@ only. tor-talk@ people can follow the thread here: https://lists.torproject.org/pipermail/tor-dev/2013-June/thread.html) On 6/6/13 7:32 PM, Norman Danner wrote: I have two

Re: [tor-dev] Client simulation

2013-06-10 Thread Karsten Loesing
On 6/7/13 8:04 PM, Norman Danner wrote: On 6/7/13 2:37 AM, Karsten Loesing wrote: (Sorry for cross-posting, but I think this is a topic for tor-dev@, not tor-talk@. If you agree, please reply on tor-dev@ only. tor-talk@ people can follow the thread here: OK, following up on tor-dev. I

[tor-dev] IRC meeting to discuss sponsor F progress on Wed July 3, 16:00 to 17:00 UTC in #tor-dev

2013-06-20 Thread Karsten Loesing
Hi all, I'd like to schedule an IRC meeting to discuss what progress we made on sponsor F deliverables in June. Suggested time and place are: Wed July 3, 16:00 to 17:00 UTC in #tor-dev That time in other timezones is: 9:00 in San Francisco 12:00 in Boston 18:00 in Berlin 19:00 in

Re: [tor-dev] IRC meeting to discuss sponsor F progress on Wed July 3, 16:00 to 17:00 UTC in #tor-dev

2013-06-27 Thread Karsten Loesing
On 6/20/13 7:44 PM, Karsten Loesing wrote: Hi all, I'd like to schedule an IRC meeting to discuss what progress we made on sponsor F deliverables in June. Suggested time and place are: Wed July 3, 16:00 to 17:00 UTC in #tor-dev That time in other timezones is: 9:00 in San

Re: [tor-dev] Client simulation

2013-06-27 Thread Karsten Loesing
On 6/26/13 5:59 PM, Norman Danner wrote: Continuing this discussion of client behavior simulation... I'm in the process of rewriting the data collection code.. One thing I need to do is make a reasonable guess as to whether a given connection is from a client. Is there a straightforward

Re: [tor-dev] atlas.torproject.org question

2013-07-01 Thread Karsten Loesing
On 6/29/13 7:19 PM, m...@rndm.de wrote: - Is this an Atlas fork or a rewrite? Are you planning to contribute your changes to Atlas, or do you want to run this as a new project? In the former case, please be sure to talk to Arturo or Sathya (both are on this list). In the latter case, please

  1   2   3   4   5   >