Hi Mat,
filtering the content by tag (or in any other way) is rather easy
technically, but the difficulty lies in the heavy lifting of offline
scraping, I mean the computational power needed for the offline part.
This is not visible when you look at the resulting wiki, but behind the
scene the (full) wikis are downloaded as standalone html pages, then
converted to Node.js version: only these steps take about 10 to 15
minute on my machine for around 30 wikis. I configured a daily update,
which is enough for the current usage of the wiki, but it's ridiculous
compared to real time updates, which is probably what you need for
twitter-like behaviour. And of course the servers in charge would also
have to be able to deal with a much larger amount of tiddlers. So
basically I don't think the method is really scalable, but of course if
somebody wants to buy a massive amount of servers we could try! ;-)
Anyway this is only my very "DIY" approach, maybe Jeremy or others have
ideas about how to do this in a smarter way. I'm not at all an expert in
this domain to be honest :-)
Also thank you all wiki authors for your agreement and everybody for the
suggestions, this helps me figure out which direction to take. I did a
list of the next possible improvements at
https://github.com/erwanm/tw-aggregator/issues, don't hesitate to add or
comment (but please be very patient for things to be implemented!).
Regards
Erwan
On 27/12/14 16:54, Mat wrote:
Erwan,
do you think you (or anyone) could modify your search engine
<https://groups.google.com/forum/?fromgroups#%21topic/tiddlywiki/tJjhzDDvk4k>
to aggregate specific tiddlers, such as all tagged with #tag, or
@modifier ?
I think you can see where my question is going... can we make a
twitter type tool to to have tiddlywikis set up (e.g on tiddlyspot)
titled /#rocknroll.tiddlyspot.com/ that aggregates everything tagged such?
This would be absolutely fantastic.
<:-)
--
You received this message because you are subscribed to the Google
Groups "TiddlyWiki" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to [email protected]
<mailto:[email protected]>.
To post to this group, send email to [email protected]
<mailto:[email protected]>.
Visit this group at http://groups.google.com/group/tiddlywiki.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups
"TiddlyWiki" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/tiddlywiki.
For more options, visit https://groups.google.com/d/optout.
