[freenet-dev] GSoC 2012
On Friday 17 Feb 2012 04:50:48 Mohammad Hoda wrote: > Hi Michael > Thanks for the reply. > I would indeed be going for GSOC. Could you please tell me a little > bit more about the coding part. BTW what is Tahrir Get the source code from git. There is a page on the website. Have a look at the wiki, new-wiki.freenetproject.org; this has a page about what package does what. And then pick a simple bug from the bug tracker and see if you can figure out how to fix it. Ask questions here, I'm very busy but others may be able to answer. Or log on to #freenet on irc.freenode.org with an IRC client, people may be able to help there too. > > Thanks > > On 17/02/2012, Michael Grube wrote: > > Hi Mohammed, > > > > The first thing you can do is educate yourself about exactly how Freenet > > works in detail if you haven't > > done so already. > > > > Generally speaking, you can help Freenet by: > > 1. Adding interesting content > > 2. Running a node, spreading awareness, getting people to use it > > 3. Making or contributing to useful Freenet applications(Freetalk, WoT, etc) > > 4. Fixing bugs (http://bugs.freenetproject.org) > > > > However, if you're going for GSoC anyway, you may want to make some code > > contributions to Tahrir. > > You could end up making a big impact and who knows, it might impress > > certain people! > > > > > > On Thu, Feb 16, 2012 at 10:52 PM, Mohammad Hoda > gmail.com>wrote: > > > >> Hi > >> Ild like to start helping freenet, GSoC or no GSoC. Can some one tell > >> me where to start > >> Thanks > >> > >> On 17/02/2012, Zlatin Balevsky wrote: > >> > +1 you might just have a winner > >> > > >> > On Thu, Feb 16, 2012 at 1:32 PM, Ian Clarke > >> wrote: > >> > > >> >> I'm not sure whether people would object to this, but I would quite > >> >> like > >> >> to mentor a student to work on Tahrir under the umbrella of the Freenet > >> >> project. > >> >> > >> >> Thoughts? Opinions? Insults? > >> >> > >> >> Ian. > >> >> > >> >> > >> >> On Thu, Feb 16, 2012 at 12:12 PM, Florent Daigniere < > >> >> nextgens at freenetproject.org> wrote: > >> >> > >> >>> Hi! > >> >>> > >> >>> Should Freenet take part to Google Summer of Code 2012? > >> >>> > >> >>> Is anyone motivated to mentor candidates? > >> >>> > >> >>> I'd like to mentor but probably won't do it if I'm the only one. > >> >>> > >> >>> Florent > >> >>> ___ > >> >>> Devl mailing list > >> >>> Devl at freenetproject.org > >> >>> http://freenetproject.org/cgi-bin/mailman/listinfo/devl > >> >>> > >> >> > >> >> > >> >> > >> >> -- > >> >> Ian Clarke > >> >> Founder, The Freenet Project > >> >> Email: ian at freenetproject.org > >> >> > >> >> ___ > >> >> Devl mailing list > >> >> Devl at freenetproject.org > >> >> http://freenetproject.org/cgi-bin/mailman/listinfo/devl > >> >> > >> > > >> > >> > >> -- > >> Mohammad Jamilish Shiyamul Hoda > >> Computer Science Engineer > >> Mobile:+91 829 624 0102 > >> ___ > >> Devl mailing list > >> Devl at freenetproject.org > >> http://freenetproject.org/cgi-bin/mailman/listinfo/devl > >> > > > > > -- > Mohammad Jamilish Shiyamul Hoda > Computer Science Engineer > Mobile:+91 829 624 0102 > ___ > Devl mailing list > Devl at freenetproject.org > http://freenetproject.org/cgi-bin/mailman/listinfo/devl > > -- next part -- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: This is a digitally signed message part. URL: <https://emu.freenetproject.org/pipermail/devl/attachments/20120217/1499dd3d/attachment.pgp>
[freenet-dev] Distributed keyword search was Re: GSoC 2012
On Friday 17 Feb 2012 09:49:59 Florent Daigniere wrote:
> On Thu, Feb 16, 2012 at 11:48:32PM +, Matthew Toseland wrote:
> > On Thursday 16 Feb 2012 23:26:03 Florent Daigniere wrote:
> > >
> > > Different codebase, arguably no active developpement (7months since last
> > > commit? - https://github.com/sanity/tahrir/commits/master), no release
> > > yet, no userbase, ... different goals
> > >
> > > I am not sure it's a good fit for GSoC tbh... but then again, it's up to
> > > Google to judge that.
> > > Why do you think Freenet would be the right umbrella? Is there any
> > > integration in between both planned on the roadmap?
> > >
> > > Why not presenting it as a mentoring organization on its own?
> >
> > Because setting up a nonprofit is a lot of work, and it's political enough
> > that it'd need its own nonprofit, the standard ones might not be
> > appropriate.
> >
>
> That's a valid point I'm happy with :)
>
> > And because its goals are broadly similar ideologically even if its
> > technical goals are, in the short term, somewhat divergent. And a lot of
> > the technology is similar too, although of course he's done everything in
> > New And Wonderful Ways.
> >
>
> Agreed
>
> > Long term, Freenet needs pub/sub (for chat e.g.), and a good microblogging
> > UI (well duh), and Tahrir needs routing and file storage (where are you
> > gonna put your suppressed pictures/phone footage?).
> >
>
> Yeah, I thought about that, hence I was asking about the roadmap.
>
> > Hence bringing it under the FPI organisational umbrella may make sense.
> > Having said that, I don't think it would be appropriate to call Tahrir
> > Freenet 2.0, at least not at present. :)
>
> You have convinced me :)
>
> My grumpy style probably suggested that I am against the idea... whereas I
> was just trying to build my opinion on the matter.
>
> Florent
Another thing they both have in common: Spam-proof fully distributed keyword
searching is hard. Tahrir needs this because Twitter-style services need
keyword searches as well as Follow. Freenet needs this for chat. Neither has a
plan for how to achieve it. IMHO we probably need some new semantics to enable
this in the long run. It has major security and technical issues though - e.g.
do you expect the node to know the full web of trust? How do you prevent DoS's?
What if it doesn't fit in RAM? Should we search with a generic identity, and
then filter client side, and if so how would we create one? What about
minorities which the generic identity distrusts?
Having said that, the simplest thing would be something like FASD
({keywords},{identities}) - or even just multi-SSKs. So identity + keyword -> {
multiple matches, limit, means to access more, preferably without needing to
keep state }. So the simplest form is multi-SSKs. Might want them to be even
smaller, so maybe you get DoS issues just with verification - but this ought to
be resolvable.
-- next part --
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 198 bytes
Desc: This is a digitally signed message part.
URL:
<https://emu.freenetproject.org/pipermail/devl/attachments/20120217/a3715dad/attachment.pgp>
[freenet-dev] GSoC 2012
Apparently I should have read the entire thread before replying, as Toad had already persuaded Nextgens, doh! Ian. On Fri, Feb 17, 2012 at 2:34 PM, Ian Clarke wrote: > On Thu, Feb 16, 2012 at 5:26 PM, Florent Daigniere < > nextgens at freenetproject.org> wrote: > >> Different codebase > > > Same language, many architectural similarities (use of small-world > routing, UDP messaging, UDP-hole-punching, etc) > > >> arguably no active developpement (7months since last commit? - >> https://github.com/sanity/tahrir/commits/master), no release yet, no >> userbase, ... > > > Exactly why I want to get someone to work on it! > > >> different goals >> > > Different non-competitive approaches to achieving the same broad goal. > > >> I am not sure it's a good fit for GSoC tbh... but then again, it's up to >> Google to judge that. >> > > I don't see why not, with appropriate mentorship, which I'm willing to > provide, I think it could be a great way for a student to learn about P2P > architectures, and without having to learn a vast codebase. They'd get > involved early enough that they could make a real difference, that is a > feature, not a bug. > > >> Why do you think Freenet would be the right umbrella? > > > Because it has a 501c3 and has a good track-record with GSoC. > > >> Is there any integration in between both planned on the roadmap? >> > > None planned, but it's possible. > > >> Why not presenting it as a mentoring organization on its own? > > > Because it would be a lot more work, with no advantage I can think of. > > What is the disadvantage of doing it under the Freenet umbrella? > > Ian. > > -- > Ian Clarke > Personal blog: http://blog.locut.us/ > -- Ian Clarke Personal blog: http://blog.locut.us/ -- next part -- An HTML attachment was scrubbed... URL: <https://emu.freenetproject.org/pipermail/devl/attachments/20120217/7119c67a/attachment.html>
[freenet-dev] GSoC 2012
On Thu, Feb 16, 2012 at 5:26 PM, Florent Daigniere < nextgens at freenetproject.org> wrote: > Different codebase Same language, many architectural similarities (use of small-world routing, UDP messaging, UDP-hole-punching, etc) > arguably no active developpement (7months since last commit? - > https://github.com/sanity/tahrir/commits/master), no release yet, no > userbase, ... Exactly why I want to get someone to work on it! > different goals > Different non-competitive approaches to achieving the same broad goal. > I am not sure it's a good fit for GSoC tbh... but then again, it's up to > Google to judge that. > I don't see why not, with appropriate mentorship, which I'm willing to provide, I think it could be a great way for a student to learn about P2P architectures, and without having to learn a vast codebase. They'd get involved early enough that they could make a real difference, that is a feature, not a bug. > Why do you think Freenet would be the right umbrella? Because it has a 501c3 and has a good track-record with GSoC. > Is there any integration in between both planned on the roadmap? > None planned, but it's possible. > Why not presenting it as a mentoring organization on its own? Because it would be a lot more work, with no advantage I can think of. What is the disadvantage of doing it under the Freenet umbrella? Ian. -- Ian Clarke Personal blog: http://blog.locut.us/ -- next part -- An HTML attachment was scrubbed... URL: <https://emu.freenetproject.org/pipermail/devl/attachments/20120217/9ba67263/attachment.html>
[freenet-dev] GSoC 2012
Hi Michael Thanks for the reply. I would indeed be going for GSOC. Could you please tell me a little bit more about the coding part. BTW what is Tahrir Thanks On 17/02/2012, Michael Grube wrote: > Hi Mohammed, > > The first thing you can do is educate yourself about exactly how Freenet > works in detail if you haven't > done so already. > > Generally speaking, you can help Freenet by: > 1. Adding interesting content > 2. Running a node, spreading awareness, getting people to use it > 3. Making or contributing to useful Freenet applications(Freetalk, WoT, etc) > 4. Fixing bugs (http://bugs.freenetproject.org) > > However, if you're going for GSoC anyway, you may want to make some code > contributions to Tahrir. > You could end up making a big impact and who knows, it might impress > certain people! > > > On Thu, Feb 16, 2012 at 10:52 PM, Mohammad Hoda gmail.com>wrote: > >> Hi >> Ild like to start helping freenet, GSoC or no GSoC. Can some one tell >> me where to start >> Thanks >> >> On 17/02/2012, Zlatin Balevsky wrote: >> > +1 you might just have a winner >> > >> > On Thu, Feb 16, 2012 at 1:32 PM, Ian Clarke >> wrote: >> > >> >> I'm not sure whether people would object to this, but I would quite >> >> like >> >> to mentor a student to work on Tahrir under the umbrella of the Freenet >> >> project. >> >> >> >> Thoughts? Opinions? Insults? >> >> >> >> Ian. >> >> >> >> >> >> On Thu, Feb 16, 2012 at 12:12 PM, Florent Daigniere < >> >> nextgens at freenetproject.org> wrote: >> >> >> >>> Hi! >> >>> >> >>> Should Freenet take part to Google Summer of Code 2012? >> >>> >> >>> Is anyone motivated to mentor candidates? >> >>> >> >>> I'd like to mentor but probably won't do it if I'm the only one. >> >>> >> >>> Florent >> >>> ___ >> >>> Devl mailing list >> >>> Devl at freenetproject.org >> >>> http://freenetproject.org/cgi-bin/mailman/listinfo/devl >> >>> >> >> >> >> >> >> >> >> -- >> >> Ian Clarke >> >> Founder, The Freenet Project >> >> Email: ian at freenetproject.org >> >> >> >> ___ >> >> Devl mailing list >> >> Devl at freenetproject.org >> >> http://freenetproject.org/cgi-bin/mailman/listinfo/devl >> >> >> > >> >> >> -- >> Mohammad Jamilish Shiyamul Hoda >> Computer Science Engineer >> Mobile:+91 829 624 0102 >> ___ >> Devl mailing list >> Devl at freenetproject.org >> http://freenetproject.org/cgi-bin/mailman/listinfo/devl >> > -- Mohammad Jamilish Shiyamul Hoda Computer Science Engineer Mobile:+91 829 624 0102
[freenet-dev] GSoC 2012
On Thu, Feb 16, 2012 at 11:48:32PM +, Matthew Toseland wrote: > On Thursday 16 Feb 2012 23:26:03 Florent Daigniere wrote: > > > > Different codebase, arguably no active developpement (7months since last > > commit? - https://github.com/sanity/tahrir/commits/master), no release yet, > > no userbase, ... different goals > > > > I am not sure it's a good fit for GSoC tbh... but then again, it's up to > > Google to judge that. > > Why do you think Freenet would be the right umbrella? Is there any > > integration in between both planned on the roadmap? > > > > Why not presenting it as a mentoring organization on its own? > > Because setting up a nonprofit is a lot of work, and it's political enough > that it'd need its own nonprofit, the standard ones might not be appropriate. > That's a valid point I'm happy with :) > And because its goals are broadly similar ideologically even if its technical > goals are, in the short term, somewhat divergent. And a lot of the technology > is similar too, although of course he's done everything in New And Wonderful > Ways. > Agreed > Long term, Freenet needs pub/sub (for chat e.g.), and a good microblogging > UI (well duh), and Tahrir needs routing and file storage (where are you gonna > put your suppressed pictures/phone footage?). > Yeah, I thought about that, hence I was asking about the roadmap. > Hence bringing it under the FPI organisational umbrella may make sense. > Having said that, I don't think it would be appropriate to call Tahrir > Freenet 2.0, at least not at present. :) You have convinced me :) My grumpy style probably suggested that I am against the idea... whereas I was just trying to build my opinion on the matter. Florent > > > > Florent > > > > On Thu, Feb 16, 2012 at 12:32:14PM -0600, Ian Clarke wrote: > > > I'm not sure whether people would object to this, but I would quite like > > > to > > > mentor a student to work on Tahrir under the umbrella of the Freenet > > > project. > > > > > > Thoughts? Opinions? Insults? > > > > > > Ian. > > > > > > On Thu, Feb 16, 2012 at 12:12 PM, Florent Daigniere < > > > nextgens at freenetproject.org> wrote: > > > > > > > Hi! > > > > > > > > Should Freenet take part to Google Summer of Code 2012? > > > > > > > > Is anyone motivated to mentor candidates? > > > > > > > > I'd like to mentor but probably won't do it if I'm the only one. > > > > > > > > Florent
[freenet-dev] GSoC 2012
Hi Ild like to start helping freenet, GSoC or no GSoC. Can some one tell me where to start Thanks On 17/02/2012, Zlatin Balevsky wrote: > +1 you might just have a winner > > On Thu, Feb 16, 2012 at 1:32 PM, Ian Clarke wrote: > >> I'm not sure whether people would object to this, but I would quite like >> to mentor a student to work on Tahrir under the umbrella of the Freenet >> project. >> >> Thoughts? Opinions? Insults? >> >> Ian. >> >> >> On Thu, Feb 16, 2012 at 12:12 PM, Florent Daigniere < >> nextgens at freenetproject.org> wrote: >> >>> Hi! >>> >>> Should Freenet take part to Google Summer of Code 2012? >>> >>> Is anyone motivated to mentor candidates? >>> >>> I'd like to mentor but probably won't do it if I'm the only one. >>> >>> Florent >>> ___ >>> Devl mailing list >>> Devl at freenetproject.org >>> http://freenetproject.org/cgi-bin/mailman/listinfo/devl >>> >> >> >> >> -- >> Ian Clarke >> Founder, The Freenet Project >> Email: ian at freenetproject.org >> >> ___ >> Devl mailing list >> Devl at freenetproject.org >> http://freenetproject.org/cgi-bin/mailman/listinfo/devl >> > -- Mohammad Jamilish Shiyamul Hoda Computer Science Engineer Mobile:+91 829 624 0102
[freenet-dev] GSoC 2012
On Thu, Feb 16, 2012 at 11:50 PM, Mohammad Hoda wrote: > Hi Michael > Thanks for the reply. > I would indeed be going for GSOC. Could you please tell me a little > bit more about the coding part. BTW what is Tahrir > Most of the development for Freenet is done in Java. Here are instructions for getting the source code for Freenet: http://freenetproject.org/developer.html Tahrir is a social media/filesharing application that uses small-world routing in the same way that Freenet does. Described here: https://github.com/sanity/tahrir/wiki > Thanks > > On 17/02/2012, Michael Grube wrote: > > Hi Mohammed, > > > > The first thing you can do is educate yourself about exactly how Freenet > > works in detail if you haven't > > done so already. > > > > Generally speaking, you can help Freenet by: > > 1. Adding interesting content > > 2. Running a node, spreading awareness, getting people to use it > > 3. Making or contributing to useful Freenet applications(Freetalk, WoT, > etc) > > 4. Fixing bugs (http://bugs.freenetproject.org) > > > > However, if you're going for GSoC anyway, you may want to make some code > > contributions to Tahrir. > > You could end up making a big impact and who knows, it might impress > > certain people! > > > > > > On Thu, Feb 16, 2012 at 10:52 PM, Mohammad Hoda >wrote: > > > >> Hi > >> Ild like to start helping freenet, GSoC or no GSoC. Can some one tell > >> me where to start > >> Thanks > >> > >> On 17/02/2012, Zlatin Balevsky wrote: > >> > +1 you might just have a winner > >> > > >> > On Thu, Feb 16, 2012 at 1:32 PM, Ian Clarke > >> wrote: > >> > > >> >> I'm not sure whether people would object to this, but I would quite > >> >> like > >> >> to mentor a student to work on Tahrir under the umbrella of the > Freenet > >> >> project. > >> >> > >> >> Thoughts? Opinions? Insults? > >> >> > >> >> Ian. > >> >> > >> >> > >> >> On Thu, Feb 16, 2012 at 12:12 PM, Florent Daigniere < > >> >> nextgens at freenetproject.org> wrote: > >> >> > >> >>> Hi! > >> >>> > >> >>> Should Freenet take part to Google Summer of Code 2012? > >> >>> > >> >>> Is anyone motivated to mentor candidates? > >> >>> > >> >>> I'd like to mentor but probably won't do it if I'm the only one. > >> >>> > >> >>> Florent > >> >>> ___ > >> >>> Devl mailing list > >> >>> Devl at freenetproject.org > >> >>> http://freenetproject.org/cgi-bin/mailman/listinfo/devl > >> >>> > >> >> > >> >> > >> >> > >> >> -- > >> >> Ian Clarke > >> >> Founder, The Freenet Project > >> >> Email: ian at freenetproject.org > >> >> > >> >> ___ > >> >> Devl mailing list > >> >> Devl at freenetproject.org > >> >> http://freenetproject.org/cgi-bin/mailman/listinfo/devl > >> >> > >> > > >> > >> > >> -- > >> Mohammad Jamilish Shiyamul Hoda > >> Computer Science Engineer > >> Mobile:+91 829 624 0102 > >> ___ > >> Devl mailing list > >> Devl at freenetproject.org > >> http://freenetproject.org/cgi-bin/mailman/listinfo/devl > >> > > > > > -- > Mohammad Jamilish Shiyamul Hoda > Computer Science Engineer > Mobile:+91 829 624 0102 > ___ > Devl mailing list > Devl at freenetproject.org > http://freenetproject.org/cgi-bin/mailman/listinfo/devl > -- next part -- An HTML attachment was scrubbed... URL: <https://emu.freenetproject.org/pipermail/devl/attachments/20120217/dcb4685c/attachment.html>
[freenet-dev] Website traffic increased substantially
On Wednesday 25 Jan 2012 14:47:22 Arne Babenhauserheide wrote: > At Tue, 24 Jan 2012 11:34:06 -0600, > Robert Hailey wrote: > > > > > > On 2012/01/23 (Jan), at 8:21 AM, Martin 'The Bishop' Scheffler wrote: > > > > > well, i see the megaupload-bust as a second factor to that. > > > we should thank the FBI for pushing users in our direction :-) > > > > And then we should push development of freenet into freenet itself before > > the FBI comes in our direction. :-) > > I already share the freenet sources as infocalypse repository within freenet, > so taking down github will not stop freenet. Yes but does it work? How much work, how many retries, how long, to bootstrap the repo off freenet on a fresh node? I guess this'd be an interesting performance metric ... IIRC infocalypse is fairly sophisticated so there should be relatively few lone keys that if they fail the whole repo fails... > > Best wishes, > Arne -- next part -- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: This is a digitally signed message part. URL: <https://emu.freenetproject.org/pipermail/devl/attachments/20120217/369c97bf/attachment.pgp>
[freenet-dev] website spanish translation
On Tuesday 14 Feb 2012 13:22:08 Flavio Heredia wrote: > i get you right. i hope make a pull request by the end of _week_ ;-) That would be awesome, good luck (both of you!). > > On Mon, Feb 13, 2012 at 7:03 PM, Steve Dougherty > wrote: > > Sorry, I fear I was unclear in my previous message. I meant that we hope > > to have localization support enabled on the server by the end of the > > month, not to impose time pressure. > > > > On 02/13/2012 07:35 AM, Flavio Heredia wrote: > >> good morning list. > >> > >> here i am boring with a couple of questions. > >> > >>> At the moment the l10n is turned off because none of the > >>> website translations is up to date > >> > >> how translators notice about changes...? > >> > >> > >>> There is commented out code in the website scripts, > >>> not sure when the apache l10n last worked > >> > >> what about a spanish mirror..? like http:// freenetproject.org.ar > >> i can setup it for you. > >> > >> ah, BTW, spanish translation is up to 80% and going faster :-) > >> > >> for a preview if interested, see http://merlinux.com.ar/freenetproject/ > >> > >> kind regards. > >> merlin > >> > >> On Fri, Feb 3, 2012 at 11:37 AM, Matthew Toseland > >> wrote: > >>> On Friday 03 Feb 2012 12:44:08 Flavio Heredia wrote: > >>>> good morning. > >>>> > >>>> i started a website spanish translation. > >>>> > >>>> https://github.com/merlinux/website-staging > >>> > >>> Cool! Let us know when this is ready to go. At the moment the l10n is > >>> turned off because none of the website translations is up to date. But if > >>> you keep it in a parallel folder it shouldn't be much work to roll it out > >>> when it's ready. Thanks! > >>> > >>> (Hopefully one of our volunteer admins can deal with this when ready? > >>> There is commented out code in the website scripts, not sure when the > >>> apache l10n last worked). -- next part -- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: This is a digitally signed message part. URL: <https://emu.freenetproject.org/pipermail/devl/attachments/20120217/4137e45f/attachment.pgp>
[freenet-dev] Heavy WebOfTrust optimization almost done
On Thursday 16 Feb 2012 17:15:59 xor wrote: > Hi, > > consider WebOfTrust as a graph, consisting of: > - The set of Identities, the vertexes of the graph. > - The set of Score values, the edges of the graph. For each pair of > OwnIdentity & Identity, such an edge exists. This mail assumes N to be the > number of those edges. > > Currently, a single WOT instance fetches all new trust lists which each of > the > known identities publishes. A new trust list is published whenever someone > changes a trust value or adds a new identity, etc. So there are MANY trust > lists published every day. > > For each fetched trust list, a score re-computation happens. > The score re-computation is effectively a graph algorithm. > Where N being the number of Score values, it does an amount of O(N) db4o- > queries of the type: getScore(Identity truster, Identity target) > > Obviously, such a query is theoretically executable in a time of O(1) by using > a Hashtable>. O(1) algorithms generally don't work well in on disk structures due to locality and size changing issues. Most databases use trees. > > HOWEVER, db4o does NOT execute it in O(1). It takes an average of O(N), where > N is the number of Score objects!!! [1] What actually happens is it looks up the index for both of the identities, and intersects them. Technically this is O(n) but it is only really slow when one of them (the in-set for an identity and the out-set for another identity) is huge. Or at least, that's what's supposed to happen - stack traces while db4o is running a query can be rather worrying, suggesting that sometimes it does in fact page in each full object, rather than simply intersecting two shortish lists of object ID's, for reasons that are unclear! Anyway, having said that, clearly it is much slower than it needs to be. > Therefore, the old implementation of the Score computation algorithm has > an average runtime of O(N^2 * ...) which is VERY bad, N^2 grows insanely fast. > > Now the good news is: > I have implemented a branch [2] which DOES reduce the average time of those > O(N) queries to O(1). It does this by creating a composite primary key (ID) > for > each Score object: > We construct a String ID which is equal to "ID of the truster concatenated > with the ID of the trustee". We create a db4o index upon those composite IDs. That's a very good idea. > > Now the getScore(Identity truster, Identity target) query does not have 2 > field-value constraints anymore, there is only 1. Therefore, due to the > index, > that query executes in O(1). It's a tree. It's O(log) or something close to it. > > We also do this for Trust-queries. This effectively should make WOT usable > again. That would be awesome. Did you do any benchmarks? > > The branch is already fully implemented and I'm doing a test run right now. > The topic of the mail says "almost" done because I have not written code to > upgrade old databases yet. This is a simple task however, maybe 30 lines of > code, and I will definitely do it with then next week. > > So we can see an optimized WOT build in two weeks I hope. > > Greetings, and THANKS FOR YOUR EPIC PATIENCE WITH ME, > xor > > > [1] I've written a db4o performance test which proves my theory that queries > which constrain upon two indexed fields take an average execution time of > O(N). > I will publish the test in my next flog update. That would be interesting. If it is in fact reading every object of that type into memory, as stack traces suggest it is doing, then something is seriously wrong, and we should look carefully at the API usage, the index setup code, and later versions of db4o. O() numbers here are only representative of the worst-case, what is important is what actually happens IMHO. -- next part -- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: This is a digitally signed message part. URL: <https://emu.freenetproject.org/pipermail/devl/attachments/20120217/fc3e40e4/attachment.pgp>
Re: [freenet-dev] GSoC 2012
On Thu, Feb 16, 2012 at 11:48:32PM +, Matthew Toseland wrote: On Thursday 16 Feb 2012 23:26:03 Florent Daigniere wrote: Different codebase, arguably no active developpement (7months since last commit? - https://github.com/sanity/tahrir/commits/master), no release yet, no userbase, ... different goals I am not sure it's a good fit for GSoC tbh... but then again, it's up to Google to judge that. Why do you think Freenet would be the right umbrella? Is there any integration in between both planned on the roadmap? Why not presenting it as a mentoring organization on its own? Because setting up a nonprofit is a lot of work, and it's political enough that it'd need its own nonprofit, the standard ones might not be appropriate. That's a valid point I'm happy with :) And because its goals are broadly similar ideologically even if its technical goals are, in the short term, somewhat divergent. And a lot of the technology is similar too, although of course he's done everything in New And Wonderful Ways. Agreed Long term, Freenet needs pub/sub (for chat e.g.), and a good microblogging UI (well duh), and Tahrir needs routing and file storage (where are you gonna put your suppressed pictures/phone footage?). Yeah, I thought about that, hence I was asking about the roadmap. Hence bringing it under the FPI organisational umbrella may make sense. Having said that, I don't think it would be appropriate to call Tahrir Freenet 2.0, at least not at present. :) You have convinced me :) My grumpy style probably suggested that I am against the idea... whereas I was just trying to build my opinion on the matter. Florent Florent On Thu, Feb 16, 2012 at 12:32:14PM -0600, Ian Clarke wrote: I'm not sure whether people would object to this, but I would quite like to mentor a student to work on Tahrir under the umbrella of the Freenet project. Thoughts? Opinions? Insults? Ian. On Thu, Feb 16, 2012 at 12:12 PM, Florent Daigniere nextg...@freenetproject.org wrote: Hi! Should Freenet take part to Google Summer of Code 2012? Is anyone motivated to mentor candidates? I'd like to mentor but probably won't do it if I'm the only one. Florent ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl
Re: [freenet-dev] GSoC 2012
On Thu, Feb 16, 2012 at 11:50 PM, Mohammad Hoda shiyamh...@gmail.comwrote: Hi Michael Thanks for the reply. I would indeed be going for GSOC. Could you please tell me a little bit more about the coding part. BTW what is Tahrir Most of the development for Freenet is done in Java. Here are instructions for getting the source code for Freenet: http://freenetproject.org/developer.html Tahrir is a social media/filesharing application that uses small-world routing in the same way that Freenet does. Described here: https://github.com/sanity/tahrir/wiki Thanks On 17/02/2012, Michael Grube michael.gr...@gmail.com wrote: Hi Mohammed, The first thing you can do is educate yourself about exactly how Freenet works in detail if you haven't done so already. Generally speaking, you can help Freenet by: 1. Adding interesting content 2. Running a node, spreading awareness, getting people to use it 3. Making or contributing to useful Freenet applications(Freetalk, WoT, etc) 4. Fixing bugs (http://bugs.freenetproject.org) However, if you're going for GSoC anyway, you may want to make some code contributions to Tahrir. You could end up making a big impact and who knows, it might impress certain people! On Thu, Feb 16, 2012 at 10:52 PM, Mohammad Hoda shiyamh...@gmail.com wrote: Hi Ild like to start helping freenet, GSoC or no GSoC. Can some one tell me where to start Thanks On 17/02/2012, Zlatin Balevsky zlat...@gmail.com wrote: +1 you might just have a winner On Thu, Feb 16, 2012 at 1:32 PM, Ian Clarke i...@freenetproject.org wrote: I'm not sure whether people would object to this, but I would quite like to mentor a student to work on Tahrir under the umbrella of the Freenet project. Thoughts? Opinions? Insults? Ian. On Thu, Feb 16, 2012 at 12:12 PM, Florent Daigniere nextg...@freenetproject.org wrote: Hi! Should Freenet take part to Google Summer of Code 2012? Is anyone motivated to mentor candidates? I'd like to mentor but probably won't do it if I'm the only one. Florent ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl -- Ian Clarke Founder, The Freenet Project Email: i...@freenetproject.org ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl -- Mohammad Jamilish Shiyamul Hoda Computer Science Engineer Mobile:+91 829 624 0102 ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl -- Mohammad Jamilish Shiyamul Hoda Computer Science Engineer Mobile:+91 829 624 0102 ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl
[freenet-dev] Distributed keyword search was Re: GSoC 2012
On Friday 17 Feb 2012 09:49:59 Florent Daigniere wrote:
On Thu, Feb 16, 2012 at 11:48:32PM +, Matthew Toseland wrote:
On Thursday 16 Feb 2012 23:26:03 Florent Daigniere wrote:
Different codebase, arguably no active developpement (7months since last
commit? - https://github.com/sanity/tahrir/commits/master), no release
yet, no userbase, ... different goals
I am not sure it's a good fit for GSoC tbh... but then again, it's up to
Google to judge that.
Why do you think Freenet would be the right umbrella? Is there any
integration in between both planned on the roadmap?
Why not presenting it as a mentoring organization on its own?
Because setting up a nonprofit is a lot of work, and it's political enough
that it'd need its own nonprofit, the standard ones might not be
appropriate.
That's a valid point I'm happy with :)
And because its goals are broadly similar ideologically even if its
technical goals are, in the short term, somewhat divergent. And a lot of
the technology is similar too, although of course he's done everything in
New And Wonderful Ways.
Agreed
Long term, Freenet needs pub/sub (for chat e.g.), and a good microblogging
UI (well duh), and Tahrir needs routing and file storage (where are you
gonna put your suppressed pictures/phone footage?).
Yeah, I thought about that, hence I was asking about the roadmap.
Hence bringing it under the FPI organisational umbrella may make sense.
Having said that, I don't think it would be appropriate to call Tahrir
Freenet 2.0, at least not at present. :)
You have convinced me :)
My grumpy style probably suggested that I am against the idea... whereas I
was just trying to build my opinion on the matter.
Florent
Another thing they both have in common: Spam-proof fully distributed keyword
searching is hard. Tahrir needs this because Twitter-style services need
keyword searches as well as Follow. Freenet needs this for chat. Neither has a
plan for how to achieve it. IMHO we probably need some new semantics to enable
this in the long run. It has major security and technical issues though - e.g.
do you expect the node to know the full web of trust? How do you prevent DoS's?
What if it doesn't fit in RAM? Should we search with a generic identity, and
then filter client side, and if so how would we create one? What about
minorities which the generic identity distrusts?
Having said that, the simplest thing would be something like FASD
({keywords},{identities}) - or even just multi-SSKs. So identity + keyword - {
multiple matches, limit, means to access more, preferably without needing to
keep state }. So the simplest form is multi-SSKs. Might want them to be even
smaller, so maybe you get DoS issues just with verification - but this ought to
be resolvable.
signature.asc
Description: This is a digitally signed message part.
___
Devl mailing list
Devl@freenetproject.org
http://freenetproject.org/cgi-bin/mailman/listinfo/devl
Re: [freenet-dev] GSoC 2012
On Friday 17 Feb 2012 04:50:48 Mohammad Hoda wrote: Hi Michael Thanks for the reply. I would indeed be going for GSOC. Could you please tell me a little bit more about the coding part. BTW what is Tahrir Get the source code from git. There is a page on the website. Have a look at the wiki, new-wiki.freenetproject.org; this has a page about what package does what. And then pick a simple bug from the bug tracker and see if you can figure out how to fix it. Ask questions here, I'm very busy but others may be able to answer. Or log on to #freenet on irc.freenode.org with an IRC client, people may be able to help there too. Thanks On 17/02/2012, Michael Grube michael.gr...@gmail.com wrote: Hi Mohammed, The first thing you can do is educate yourself about exactly how Freenet works in detail if you haven't done so already. Generally speaking, you can help Freenet by: 1. Adding interesting content 2. Running a node, spreading awareness, getting people to use it 3. Making or contributing to useful Freenet applications(Freetalk, WoT, etc) 4. Fixing bugs (http://bugs.freenetproject.org) However, if you're going for GSoC anyway, you may want to make some code contributions to Tahrir. You could end up making a big impact and who knows, it might impress certain people! On Thu, Feb 16, 2012 at 10:52 PM, Mohammad Hoda shiyamh...@gmail.comwrote: Hi Ild like to start helping freenet, GSoC or no GSoC. Can some one tell me where to start Thanks On 17/02/2012, Zlatin Balevsky zlat...@gmail.com wrote: +1 you might just have a winner On Thu, Feb 16, 2012 at 1:32 PM, Ian Clarke i...@freenetproject.org wrote: I'm not sure whether people would object to this, but I would quite like to mentor a student to work on Tahrir under the umbrella of the Freenet project. Thoughts? Opinions? Insults? Ian. On Thu, Feb 16, 2012 at 12:12 PM, Florent Daigniere nextg...@freenetproject.org wrote: Hi! Should Freenet take part to Google Summer of Code 2012? Is anyone motivated to mentor candidates? I'd like to mentor but probably won't do it if I'm the only one. Florent ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl -- Ian Clarke Founder, The Freenet Project Email: i...@freenetproject.org ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl -- Mohammad Jamilish Shiyamul Hoda Computer Science Engineer Mobile:+91 829 624 0102 ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl -- Mohammad Jamilish Shiyamul Hoda Computer Science Engineer Mobile:+91 829 624 0102 ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl signature.asc Description: This is a digitally signed message part. ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl
Re: [freenet-dev] GSoC 2012
On Thu, Feb 16, 2012 at 5:26 PM, Florent Daigniere nextg...@freenetproject.org wrote: Different codebase Same language, many architectural similarities (use of small-world routing, UDP messaging, UDP-hole-punching, etc) arguably no active developpement (7months since last commit? - https://github.com/sanity/tahrir/commits/master), no release yet, no userbase, ... Exactly why I want to get someone to work on it! different goals Different non-competitive approaches to achieving the same broad goal. I am not sure it's a good fit for GSoC tbh... but then again, it's up to Google to judge that. I don't see why not, with appropriate mentorship, which I'm willing to provide, I think it could be a great way for a student to learn about P2P architectures, and without having to learn a vast codebase. They'd get involved early enough that they could make a real difference, that is a feature, not a bug. Why do you think Freenet would be the right umbrella? Because it has a 501c3 and has a good track-record with GSoC. Is there any integration in between both planned on the roadmap? None planned, but it's possible. Why not presenting it as a mentoring organization on its own? Because it would be a lot more work, with no advantage I can think of. What is the disadvantage of doing it under the Freenet umbrella? Ian. -- Ian Clarke Personal blog: http://blog.locut.us/ ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl
Re: [freenet-dev] GSoC 2012
Apparently I should have read the entire thread before replying, as Toad had already persuaded Nextgens, doh! Ian. On Fri, Feb 17, 2012 at 2:34 PM, Ian Clarke i...@locut.us wrote: On Thu, Feb 16, 2012 at 5:26 PM, Florent Daigniere nextg...@freenetproject.org wrote: Different codebase Same language, many architectural similarities (use of small-world routing, UDP messaging, UDP-hole-punching, etc) arguably no active developpement (7months since last commit? - https://github.com/sanity/tahrir/commits/master), no release yet, no userbase, ... Exactly why I want to get someone to work on it! different goals Different non-competitive approaches to achieving the same broad goal. I am not sure it's a good fit for GSoC tbh... but then again, it's up to Google to judge that. I don't see why not, with appropriate mentorship, which I'm willing to provide, I think it could be a great way for a student to learn about P2P architectures, and without having to learn a vast codebase. They'd get involved early enough that they could make a real difference, that is a feature, not a bug. Why do you think Freenet would be the right umbrella? Because it has a 501c3 and has a good track-record with GSoC. Is there any integration in between both planned on the roadmap? None planned, but it's possible. Why not presenting it as a mentoring organization on its own? Because it would be a lot more work, with no advantage I can think of. What is the disadvantage of doing it under the Freenet umbrella? Ian. -- Ian Clarke Personal blog: http://blog.locut.us/ -- Ian Clarke Personal blog: http://blog.locut.us/ ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl
Re: [freenet-dev] Heavy WebOfTrust optimization almost done
Ok first benchmark result available for my heavily fragmented WOT main database: The full score recomputation which it does at startup took 373 seconds with the old code and 95s with the new code. Thats down by 75%, or in other words the old code was 4x as slow. Of course this is only a single measurement, but we are talking about minutes here so its unlikely that things like system load of the machine caused much bias. Also, 95 seconds is still very much. I suspect it will go down by a huge factor when I implement defragmentation (tomorrow hopefully): The database currently has a size of 312 MiB, which shows that it is really fragmented very much. ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl
Re: [freenet-dev] GSoC 2012
Thanks Michael and Matthew I ll try doing tha. I ll probably make a new thread and seek help when ever I am stuck On 18/02/2012, Ian Clarke i...@locut.us wrote: Apparently I should have read the entire thread before replying, as Toad had already persuaded Nextgens, doh! Ian. On Fri, Feb 17, 2012 at 2:34 PM, Ian Clarke i...@locut.us wrote: On Thu, Feb 16, 2012 at 5:26 PM, Florent Daigniere nextg...@freenetproject.org wrote: Different codebase Same language, many architectural similarities (use of small-world routing, UDP messaging, UDP-hole-punching, etc) arguably no active developpement (7months since last commit? - https://github.com/sanity/tahrir/commits/master), no release yet, no userbase, ... Exactly why I want to get someone to work on it! different goals Different non-competitive approaches to achieving the same broad goal. I am not sure it's a good fit for GSoC tbh... but then again, it's up to Google to judge that. I don't see why not, with appropriate mentorship, which I'm willing to provide, I think it could be a great way for a student to learn about P2P architectures, and without having to learn a vast codebase. They'd get involved early enough that they could make a real difference, that is a feature, not a bug. Why do you think Freenet would be the right umbrella? Because it has a 501c3 and has a good track-record with GSoC. Is there any integration in between both planned on the roadmap? None planned, but it's possible. Why not presenting it as a mentoring organization on its own? Because it would be a lot more work, with no advantage I can think of. What is the disadvantage of doing it under the Freenet umbrella? Ian. -- Ian Clarke Personal blog: http://blog.locut.us/ -- Ian Clarke Personal blog: http://blog.locut.us/ -- Mohammad Jamilish Shiyamul Hoda Computer Science Engineer Mobile:+91 829 624 0102 ___ Devl mailing list Devl@freenetproject.org http://freenetproject.org/cgi-bin/mailman/listinfo/devl
