Re: [tor-talk] Funded search engine for onionspace?

2015-03-05 Thread Andreas Krey
On Thu, 05 Mar 2015 11:27:08 +, George Kadianakis wrote: ... FWIW, none of the above will actually help against a non-experienced user that uses tor2web to connect to an onion by mistake. Even with HS authorization or HTTP auth, the onion will forever be imprinted on that public list.

Re: [tor-talk] Funded search engine for onionspace?

2015-03-05 Thread George Kadianakis
grarpamp grarp...@gmail.com writes: On Wed, Mar 4, 2015 at 12:16 PM, George Kadianakis desnac...@riseup.net wrote: I find their concern very valid Respectfully... invalid. Onions are going to be mined, shared, leaked, indexed, and copied anyways. And most certainly by your adversaries. Do

Re: [tor-talk] Funded search engine for onionspace?

2015-03-05 Thread grarpamp
On Wed, Mar 4, 2015 at 12:16 PM, George Kadianakis desnac...@riseup.net wrote: I find their concern very valid Respectfully... invalid. Onions are going to be mined, shared, leaked, indexed, and copied anyways. And most certainly by your adversaries. Do we forget merely publishing an onion to

Re: [tor-talk] Funded search engine for onionspace?

2015-03-05 Thread Virgil Griffith
I'm not too surprised that list ruffled some feathers. Per your request, I'll take it down. :) If/when people get more used to the idea of being seen on the clear-net the Disallowed might be resurrected. Give the changes a few days to propagate. -V On Thu, Mar 5, 2015 at 1:16 AM, George

Re: [tor-talk] Funded search engine for onionspace?

2015-03-04 Thread George Kadianakis
Hello Virgil, I have received mails from a few people who are feeling bad about the disallowed.html list of onioncity. Some of them are afraid that it might list their private hidden service, just because an inexperienced user accidentally tried to access it over tor2web. I find their concern

Re: [tor-talk] Funded search engine for onionspace?

2015-02-13 Thread George Kadianakis
Virgil Griffith i...@virgil.gr writes: I present: http://onion.city currently searching ~348,000 pages according to site:onion.city on GOOG. -V Ah, exciting! The use of a custom google search is an interesting idea. I also like the motto and the logo! (although search engine logos are

Re: [tor-talk] Funded search engine for onionspace?

2015-02-13 Thread l.m
Alas no. I'm aware this is suboptimal. I see GOOG search engine as a temporary-ladder just to get the ball rolling. I am open to using any other index. For what it's worth I'm very pleased with GOOG's performance---right now it's searching an index of 650k onion pages and the number grows

Re: [tor-talk] Funded search engine for onionspace?

2015-02-13 Thread Virgil Griffith
- How does the custom google search thing works? Where does it get its index? You expose all the tor2web onions on your sitemap, so google crawls them and generates an index? Correct :) Everything available on the Google Custom Search is also available on a regular google search with the

Re: [tor-talk] Funded search engine for onionspace?

2015-02-13 Thread Dave Warren
On 2015-02-13 15:30, l.m wrote: If you instead use a google search appliance couldn't you use google engine for indexing without having to use google itself? Wouldn't that also avoid the problem of google queries being associated with the client making the request? It might, but it's licensed

Re: [tor-talk] Funded search engine for onionspace?

2015-02-13 Thread Virgil Griffith
Are OnionCity staff reviewing and redacting those lists to protect users from themselves? Or is redaction based only on complaints? We do both. For some privacy, users can instead search https://startpage.com/ with site:onion.city, and then view using the Ixquick Proxy. Could OnionCity script

Re: [tor-talk] Funded search engine for onionspace?

2015-02-13 Thread Mirimir
On 02/13/2015 03:19 PM, Virgil Griffith wrote: SNIP - How do you crawl for more onions? Right now I aggregate existing lists of onion sites and put them into the site map. * https://ahmia.fi/onions/ * http://skunksworkedp2cg.onion.city/sites.txt *

Re: [tor-talk] Funded search engine for onionspace?

2015-02-13 Thread l.m
Leeroy, to avoid being indexed by Googlebot et al, place the appropriate /robots.txt at your root. It's described in the FAQ. Yes I'm aware of the faq. It's just that in using google you'll always be incomplete compared to ahmia.fi but thats ok by me. --leeroy -- tor-talk mailing list -

Re: [tor-talk] Funded search engine for onionspace?

2015-02-11 Thread Alexandros
On 02/11/2015 11:10 PM, Virgil Griffith wrote: I present: http://onion.city currently searching ~348,000 pages according to site:onion.city on GOOG. -V Dear administrators of onion.city, please do deploy and enforce HTTPS -- tor-talk mailing list - tor-talk@lists.torproject.org To

Re: [tor-talk] Funded search engine for onionspace?

2015-02-11 Thread Virgil Griffith
See the FAQ. It's on the roadmap. On Feb 11, 2015 2:17 PM, Alexandros irregula...@riseup.net wrote: On 02/11/2015 11:10 PM, Virgil Griffith wrote: I present: http://onion.city currently searching ~348,000 pages according to site:onion.city on GOOG. -V Dear administrators of

Re: [tor-talk] Funded search engine for onionspace?

2015-02-11 Thread Josef 'veloc1ty' Stautner
+1 Nice project! Thanks for making it! And like Alexandros said: I would love to see HTTPS available! Am 11.02.2015 um 23:17 schrieb Alexandros: On 02/11/2015 11:10 PM, Virgil Griffith wrote: I present: http://onion.city currently searching ~348,000 pages according to site:onion.city on

Re: [tor-talk] Funded search engine for onionspace?

2015-02-11 Thread grarpamp
On Wed, Feb 11, 2015 at 4:10 PM, Virgil Griffith i...@virgil.gr wrote: http://onion.city currently searching ~348,000 pages according to site:onion.city on GOOG. Cool. A gpg key should be posted onsite. And an auto updating list of onions indexed.txt to serve as seeds to other projects. --