Re: [tor-bugs] #9316 [Obfuscation/BridgeDB]: BridgeDB should export statistics

[Tor Bug Tracker & Wiki]

#9316: BridgeDB should export statistics
---+---
 Reporter:  asn|  Owner:  phw
 Type:  task   | Status:  assigned
 Priority:  Medium |  Milestone:
Component:  Obfuscation/BridgeDB   |Version:
 Severity:  Normal | Resolution:
 Keywords:  metrics, bridgedb, prometheus  |  Actual Points:
Parent ID:  #19332 | Points:  3
 Reviewer: |Sponsor:  Sponsor19
---+---

Comment (by phw):

 I posted a draft proposal for Tor's research safety board
 [https://lists.torproject.org/pipermail/anti-censorship-
 team/2019-April/04.html on our mailing list].

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #9316 [Obfuscation/BridgeDB]: BridgeDB should export statistics

[Tor Bug Tracker & Wiki]

#9316: BridgeDB should export statistics
---+---
 Reporter:  asn|  Owner:  phw
 Type:  task   | Status:  assigned
 Priority:  Medium |  Milestone:
Component:  Obfuscation/BridgeDB   |Version:
 Severity:  Normal | Resolution:
 Keywords:  metrics, bridgedb, prometheus  |  Actual Points:
Parent ID:  #19332 | Points:  3
 Reviewer: |Sponsor:  Sponsor19
---+---
Changes (by phw):

 * owner:  dgoulet => phw


--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #9316 [Obfuscation/BridgeDB]: BridgeDB should export statistics

[Tor Bug Tracker & Wiki]

#9316: BridgeDB should export statistics
---+---
 Reporter:  asn|  Owner:  dgoulet
 Type:  task   | Status:  assigned
 Priority:  Medium |  Milestone:
Component:  Obfuscation/BridgeDB   |Version:
 Severity:  Normal | Resolution:
 Keywords:  metrics, bridgedb, prometheus  |  Actual Points:
Parent ID:  #19332 | Points:  3
 Reviewer: |Sponsor:  Sponsor19
---+---

Comment (by dcf):

 Replying to [comment:16 phw]:
 > Here's a preliminary list of statistics that we may want, and why we
 want them. Needless to say, we need to figure out how to collect these
 statistics safely.

 If it's possible, I would like to have a guess at what fraction of bridge
 requesters are bots. Proxy-distribution papers usually assume that an
 adversary controls some fraction of the users--it would be great to know
 what the fraction is in this case. For example
 [https://censorbib.nymity.ch/#Mahdian2010a Mahdian2010a] "''n'' users,
 ''k'' of whom [are] adversaries," [https://censorbib.nymity.ch/#Wang2013a
 Wang2013a] "Let ''f'' denote the fraction of malicious users among all
 potential bridge users We expect a typical value of ''f'' between 1%
 and 5%"

 Here are some possible ways to identify bots:
  * IP address clustering--for example if BridgeDB considers all addresses
 in a /24 the same, find the most commonly occurring /20
  * auto-generated email addresses following a pattern
* to start, you could make a histogram of the lengths of email
 addresses, and see if it's concentrated at a single point. or count the
 frequency of short prefixes and suffixes of email address local-parts, and
 see if there are any that appear overwhelmingly more often than others.
  * an anachronistic HTTP User-Agent (for example, Chrome from 2 years ago,
 when most real Chrome users auto-update)
  * inconsistent HTTP headers, for example Chrome or Firefox without
 `Accept-Encoding: gzip`

 With some sort of bot-classification heuristic, then it would be good to
 analyze the statistics you mentioned already (e.g. fraction
 allowed/denied) for bot and non-bot requests.

 I would like to see a graph that shows how long it takes for a single
 bridge to be given to ''n'' different requesters. When BridgeDB starts
 distributing a bridge, how long does it take before 5 people know about
 it? Before 50 people know about it?

 > * Approximate number of ''HTTPS'' requests coming from proxies.
 >   * This may be an indicator of people trying to game the system.

 On this point, specifically I would want to know what fraction of of
 requests have an `X-Forwarded-For` or `Via` header, ''and'' how many
 entries it contains. I mention this because not only can these headers
 indicate the use of a proxy, a client may spoof them. And I seem to
 remember that BridgeDB may process `X-Forwarded-For` incorrectly, like it
 reads the entries in the wrong order when there are multiple of them.

 For this analysis, you will have to be aware that requests via Moat always
 have at least one `X-Forwarded-For` (I believe), because Moat is
 implemented using an Apache `ProxyPass` reverse proxy and Apache adds that
 header.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #9316 [Obfuscation/BridgeDB]: BridgeDB should export statistics

[Tor Bug Tracker & Wiki]

#9316: BridgeDB should export statistics
---+---
 Reporter:  asn|  Owner:  dgoulet
 Type:  task   | Status:  assigned
 Priority:  Medium |  Milestone:
Component:  Obfuscation/BridgeDB   |Version:
 Severity:  Normal | Resolution:
 Keywords:  metrics, bridgedb, prometheus  |  Actual Points:
Parent ID:  #19332 | Points:  3
 Reviewer: |Sponsor:  Sponsor19
---+---
Changes (by gaba):

 * keywords:  metrics, bridgedb, network-team-roadmap-2019-Q1Q2, prometheus
 => metrics, bridgedb, prometheus


--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #9316 [Obfuscation/BridgeDB]: BridgeDB should export statistics

[Tor Bug Tracker & Wiki]

#9316: BridgeDB should export statistics
-+-
 Reporter:  asn  |  Owner:  dgoulet
 Type:  task | Status:
 |  assigned
 Priority:  Medium   |  Milestone:
Component:  Obfuscation/BridgeDB |Version:
 Severity:  Normal   | Resolution:
 Keywords:  metrics, bridgedb, network-team- |  Actual Points:
  roadmap-2019-Q1Q2, prometheus  |
Parent ID:  #19332   | Points:  3
 Reviewer:   |Sponsor:
 |  Sponsor19
-+-
Changes (by phw):

 * keywords:  metrics, bridgedb, network-team-roadmap-2019-Q1Q2 => metrics,
 bridgedb, network-team-roadmap-2019-Q1Q2, prometheus


Comment:

 I briefly discussed this with dgoulet and sysrqb.  dgoulet suggested that
 we may want to export these statistics to our prometheus instance.  The
 idea is to run an [https://prometheus.io/docs/instrumenting/exporters/
 exporter] on the BridgeDB host.  This exporter would only expose the
 latest BridgeDB stats.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #9316 [Obfuscation/BridgeDB]: BridgeDB should export statistics

[Tor Bug Tracker & Wiki]

#9316: BridgeDB should export statistics
-+-
 Reporter:  asn  |  Owner:  dgoulet
 Type:  task | Status:
 |  assigned
 Priority:  Medium   |  Milestone:
Component:  Obfuscation/BridgeDB |Version:
 Severity:  Normal   | Resolution:
 Keywords:  metrics, bridgedb, network-team- |  Actual Points:
  roadmap-2019-Q1Q2  |
Parent ID:  #19332   | Points:  3
 Reviewer:   |Sponsor:
 |  Sponsor19
-+-

Comment (by phw):

 Here's a preliminary list of statistics that we may want, and why we want
 them. Needless to say, we need to figure out how to collect these
 statistics safely.

 * Approximate number of ''successful'' requests per distribution
 mechanism, per country, per bridge type.
   * This shows us the demand for bridges over time, and how much use
 BridgeDB sees.
   * It also teaches us what distribution mechanisms are the most useful
 (or at least popular).

 * Approximate number of ''denied'' requests per distribution mechanism,
 per country, per bridge type.
   * This may show us if people are interacting with BridgeDB
 unsuccessfully, despite good intentions.
   * It may also show us if somebody is trying to game the system.
   * Unfortunately, it's difficult to tell apart well-intentioned misuse
 from ill-intentioned misuse.

 * Approximate number of ''email'' requests per provider, per bridge type.
   * This would help us decide what email providers we should pay attention
 to.
   * This would also teach us what providers we could safely retire. For
 example, over at #28496, we are thinking about removing Yahoo. What
 fraction of requests would be affected by this?

 * Approximate number of ''HTTPS'' requests coming from proxies.
   * This may be an indicator of people trying to game the system.

 * Maybe the number of bridges per transport in BridgeDB (see #14453).

 What am I forgetting?

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #9316 [Obfuscation/BridgeDB]: BridgeDB should export statistics

[Tor Bug Tracker & Wiki]

#9316: BridgeDB should export statistics
-+-
 Reporter:  asn  |  Owner:  dgoulet
 Type:  task | Status:
 |  assigned
 Priority:  Medium   |  Milestone:
Component:  Obfuscation/BridgeDB |Version:
 Severity:  Normal   | Resolution:
 Keywords:  metrics, bridgedb, network-team- |  Actual Points:
  roadmap-2019-Q1Q2  |
Parent ID:  #19332   | Points:  3
 Reviewer:   |Sponsor:
 |  Sponsor19
-+-
Changes (by phw):

 * cc: phw (added)


--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #9316 [Obfuscation/BridgeDB]: BridgeDB should export statistics

[Tor Bug Tracker & Wiki]

#9316: BridgeDB should export statistics
-+-
 Reporter:  asn  |  Owner:  dgoulet
 Type:  task | Status:
 |  assigned
 Priority:  Medium   |  Milestone:
Component:  Obfuscation/BridgeDB |Version:
 Severity:  Normal   | Resolution:
 Keywords:  metrics, bridgedb, network-team- |  Actual Points:
  roadmap-2019-Q1Q2  |
Parent ID:  #19332   | Points:  3
 Reviewer:   |Sponsor:
 |  Sponsor19
-+-
Changes (by gaba):

 * milestone:  Network Team 2019 Q1Q2 =>


--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #9316 [Obfuscation/BridgeDB]: BridgeDB should export statistics

[Tor Bug Tracker & Wiki]

#9316: BridgeDB should export statistics
--+
 Reporter:  asn   |  Owner:  dgoulet
 Type:  task  | Status:  assigned
 Priority:  Medium|  Milestone:  Network Team 2019 Q1Q2
Component:  Obfuscation/BridgeDB  |Version:
 Severity:  Normal| Resolution:
 Keywords:  metrics,bridgedb  |  Actual Points:
Parent ID:  #19332| Points:  3
 Reviewer:|Sponsor:  Sponsor19
--+
Changes (by gaba):

 * milestone:   => Network Team 2019 Q1Q2


--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #9316 [Obfuscation/BridgeDB]: BridgeDB should export statistics

[Tor Bug Tracker & Wiki]

#9316: BridgeDB should export statistics
--+---
 Reporter:  asn   |  Owner:  dgoulet
 Type:  task  | Status:  assigned
 Priority:  Medium|  Milestone:
Component:  Obfuscation/BridgeDB  |Version:
 Severity:  Normal| Resolution:
 Keywords:  metrics,bridgedb  |  Actual Points:
Parent ID:  #19332| Points:  3
 Reviewer:|Sponsor:  Sponsor19
--+---
Changes (by irl):

 * parent:   => #19332


Comment:

 This is required to exist before metrics team can archive them in
 CollecTor.

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #9316 [Obfuscation/BridgeDB]: BridgeDB should export statistics

[Tor Bug Tracker & Wiki]

#9316: BridgeDB should export statistics
--+---
 Reporter:  asn   |  Owner:  (none)
 Type:  task  | Status:  assigned
 Priority:  Medium|  Milestone:
Component:  Obfuscation/BridgeDB  |Version:
 Severity:  Normal| Resolution:
 Keywords:  metrics,bridgedb  |  Actual Points:
Parent ID:| Points:  3
 Reviewer:|Sponsor:  Sponsor19
--+---
Changes (by karsten):

 * cc: metrics-team (added)


Comment:

 sysrqb and I discussed this topic in Mexico City. IIRC, we said that
 sysrqb would send me 24 hours of logs, which can easily be non-recent and
 heavily obfuscated and use encrypted email, and I use those logs to
 suggest a possible statistics format on tor-dev@. sysrqb, want to send me
 those logs, and I move things forward as time permits?

--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs

Re: [tor-bugs] #9316 [Obfuscation/BridgeDB]: BridgeDB should export statistics

[Tor Bug Tracker & Wiki]

#9316: BridgeDB should export statistics
--+---
 Reporter:  asn   |  Owner:  (none)
 Type:  task  | Status:  assigned
 Priority:  Medium|  Milestone:
Component:  Obfuscation/BridgeDB  |Version:
 Severity:  Normal| Resolution:
 Keywords:  metrics,bridgedb  |  Actual Points:
Parent ID:| Points:  3
 Reviewer:|Sponsor:  Sponsor19
--+---
Changes (by gaba):

 * owner:  isis => (none)
 * cc: isis@… (removed)
 * points:   => 3
 * status:  needs_revision => assigned
 * sponsor:   => Sponsor19


--
Ticket URL: 
Tor Bug Tracker & Wiki 
The Tor Project: anonymity online
___
tor-bugs mailing list
tor-bugs@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs