Re: [tor-dev] Flag blocked websites

2017-03-10 Thread Boter42
 Original Message  On Mar 10, 2017, 11:49 PM, David Fifield 
wrote: On Fri, Mar 10, 2017 at 03:46:03PM -0500, Boter42 wrote: > I'm also 
trying to implement an automatic scan of specific lists of websites to > check 
their behaviour towards Tor. I'm using ooniprobe but I lack some > technical 
skills (mainly to filter out false positives), I'll see if I can set > up a 
team. You might be able to use/adapt some code we wrote to mine OONI reports 
for cases of Tor blocking: 
http://sec.cs.ucl.ac.uk/users/smurdoch/papers/ndss16doyousee.pdf 
https://archive.org/details/ndss16doyousee


I've already got my hands on this paper but I haven't studied yet. Thanks!


>The actual OONI-processing code is in a Git repo at: 
>https://www.bamsoftware.com/git/ooni-tor-blocks.git One catch, though, is that 
>you'll have to adapt the ooni.py file to handle OONI's web_connectivity tests. 
>The code was originally written before web_connectivity existed, so it only 
>works with the http_requests test. If you want to run your own active tests, 
>we have some patches on top of exitmap: git clone -b l7_tor_limits 
>https://www.bamsoftware.com/git/exitmap.git But you will need to do some work 
>to bring them up to date.

Not sure I have enough skills to deal with it, but I'll consider to join the 
OONI partnership program. Maybe I can set up something more organic.___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


Re: [tor-dev] Flag blocked websites

2017-03-10 Thread David Fifield
On Fri, Mar 10, 2017 at 03:46:03PM -0500, Boter42 wrote:
> I'm also trying to implement an automatic scan of specific lists of websites 
> to
> check their behaviour towards Tor. I'm using ooniprobe but I lack some
> technical skills (mainly to filter out false positives), I'll see if I can set
> up a team.

You might be able to use/adapt some code we wrote to mine OONI reports
for cases of Tor blocking:

http://sec.cs.ucl.ac.uk/users/smurdoch/papers/ndss16doyousee.pdf
https://archive.org/details/ndss16doyousee

The actual OONI-processing code is in a Git repo at:
https://www.bamsoftware.com/git/ooni-tor-blocks.git

One catch, though, is that you'll have to adapt the ooni.py file to
handle OONI's web_connectivity tests. The code was originally written
before web_connectivity existed, so it only works with the http_requests
test.

If you want to run your own active tests, we have some patches on top of
exitmap:
git clone -b l7_tor_limits https://www.bamsoftware.com/git/exitmap.git
But you will need to do some work to bring them up to date.
___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


Re: [tor-dev] Flag blocked websites

2017-03-10 Thread Boter42
 Original Message  On Mar 10, 2017, 9:21 PM, grarpamp wrote: > 
[1] Maybe from tor-talk or linked to your idea from the wiki page. You also see 
some discussions here https://lists.torproject.org/pipermail/tor-access/ and 
here https://lists.torproject.org/pipermail/tor-talk/ 
___ tor-dev mailing list 
tor-dev@lists.torproject.org 
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


Great! Thanks.

I'm also trying to implement an automatic scan of specific lists of websites to 
check their behaviour towards Tor. I'm using ooniprobe but I lack some 
technical skills (mainly to filter out false positives), I'll see if I can set 
up a team.___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


Re: [tor-dev] Flag blocked websites

2017-03-10 Thread grarpamp
> [1] Maybe from tor-talk or linked to your idea from the wiki page.

You also see some discussions here
https://lists.torproject.org/pipermail/tor-access/
and here
https://lists.torproject.org/pipermail/tor-talk/
___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


Re: [tor-dev] Flag blocked websites

2017-03-10 Thread grarpamp
On Fri, Mar 10, 2017 at 12:35 PM, Boter42  wrote:
> https://trac.torproject.org/projects/tor/wiki/org/doc/ListOfServicesBlockingTor

> It would be great to have an updated records of this kind of websites so that 
> we can push website owners to make the Tor user-experience as smooth as 
> possible.

Yes you will see page below that has this as exactly one of the goals.

> Thank you. Is the list updated manually? Cause I think a button to let users
> report websites could be really helpful too.

You will read at the top of the above page this link to the parent project...
https://trac.torproject.org/projects/tor/wiki/org/projects/DontBlockMe

They talk about 'user submissions to server' at bottom.
So definitely feel free to create and announce your ideas
for automatic submissions, to notify websites, to get some review
and even collect a team of people to work on it [1] :)

[1] Maybe from tor-talk or linked to your idea from the wiki page.
___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


Re: [tor-dev] Flag blocked websites

2017-03-10 Thread Boter42
 Original Message  On Mar 10, 2017, 5:45 PM, David Fifield 
wrote: On Fri, Mar 10, 2017 at 08:27:01AM -0500, Boter42 wrote: > I think it 
would be important to have a way to flag/report those websites that > can't be 
access by the users while they're using the tor browser. > > Is there already a 
solution to do this? Do you think it would be a good tool? > > It would be 
great to have an updated records of this kind of websites so that > we can push 
website owners to make the Tor user-experience as smooth as > possible. There's 
an informal yet quite large list here: 
https://trac.torproject.org/projects/tor/wiki/org/doc/ListOfServicesBlockingTor

Thank you. Is the list updated manually? Cause I think a button to let users 
report websites could be really helpful too.___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


Re: [tor-dev] Flag blocked websites

2017-03-10 Thread David Fifield
On Fri, Mar 10, 2017 at 08:27:01AM -0500, Boter42 wrote:
> I think it would be important to have a way to flag/report those websites that
> can't be access by the users while they're using the tor browser. 
> 
> Is there already a solution to do this? Do you think it would be a good tool? 
> 
> It would be great to have an updated records of this kind of websites so that
> we can push website owners to make the Tor user-experience as smooth as
> possible. 

There's an informal yet quite large list here:
https://trac.torproject.org/projects/tor/wiki/org/doc/ListOfServicesBlockingTor
___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev


[tor-dev] Flag blocked websites

2017-03-10 Thread Boter42
Hi,

I think it would be important to have a way to flag/report those websites that 
can't be access by the users while they're using the tor browser.

Is there already a solution to do this? Do you think it would be a good tool?

It would be great to have an updated records of this kind of websites so that 
we can push website owners to make the Tor user-experience as smooth as 
possible.

Thanks___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev