Re: [tor-talk] Ahmia search engine works normally again

2016-12-09 Thread Flipchan
Yeah thats true . How about some kind of load balancer? I suggest nginx :) then You can run multiple backends to speed up the process Juha Nurmi skrev: (9 december 2016 15:07:47 CET) >On 09.12.2016 15:56, Flipchan wrote: >> So all the user agent where just "randomly"

Re: [tor-talk] Ahmia search engine works normally again

2016-12-09 Thread Juha Nurmi
On 09.12.2016 15:56, Flipchan wrote: > So all the user agent where just "randomly" generated strings? Cant You But A > White list so only allow A certain useragents? It's possible although not very practical. Also whoever is flooding can change their useragent to some standard browser useragent

Re: [tor-talk] Ahmia search engine works normally again

2016-12-09 Thread Flipchan
So all the user agent where just "randomly" generated strings? Cant You But A White list so only allow A certain useragents? "Nurmi, Juha" skrev: (7 december 2016 16:40:58 CET) >Hi, > >Ahmia.fi and msydqstlz2kzerdg.onion went offline for a short while. >Someone >flooded the

Re: [tor-talk] Ahmia search engine works normally again

2016-12-08 Thread Juha Nurmi
On 08.12.2016 23:39, Alec Muffett wrote: > For general interest (perhaps to Juha, especially?): > > * I am building a 6-node, 24-core cluster, specifically to run an > Onion-traffic-serving experiment upon. > > * It's running a Debian variant - so the results/learnings should be > generally

Re: [tor-talk] Ahmia search engine works normally again

2016-12-08 Thread Alec Muffett
On 8 December 2016 at 20:09, scfith riseup wrote: > Thanks for the correction on that. My other two points still valid in > general? Recapping: >Second, if you do list .onion domains, know that they will be collected. Well, yes, onion addresses are like any other form of

Re: [tor-talk] Ahmia search engine works normally again

2016-12-08 Thread scfith riseup
Thanks for the correction on that. My other two points still valid in general? > On Dec 8, 2016, at 3:01 PM, Roger Dingledine wrote: > > On Thu, Dec 08, 2016 at 02:06:30PM -0500, scfith riseup wrote: >> First, not sure why you want to list .onion domains. The key here is that >>

Re: [tor-talk] Ahmia search engine works normally again

2016-12-08 Thread Roger Dingledine
On Thu, Dec 08, 2016 at 02:06:30PM -0500, scfith riseup wrote: > First, not sure why you want to list .onion domains. The key here is that > they are HIDDEN services. But I am sure you have reasons. Actually, that's part of the reason for the shift into calling them "onion services" -- many

Re: [tor-talk] Ahmia search engine works normally again

2016-12-08 Thread scfith riseup
First, not sure why you want to list .onion domains. The key here is that they are HIDDEN services. But I am sure you have reasons. Second, if you do list .onion domains, know that they will be collected. Third, provide a simple path of machine-readable content to download so that bots won’t