One thing I’m noticing is that you have multiple $:/tags/Link entries pointing to the same URL. It doesn’t break the system or anything, but perhaps it would make more sense for the scraper to merge multiple entries with the same URL from the same contributor. We would merge the tags, and concatenate the descriptions. Alternately, I could make you a script that you could paste into the JS console to do that merging on your original bookmarks.
Best wishes Jeremy > On 24 Mar 2021, at 13:40, 'Mark S.' via TiddlyWiki > <[email protected]> wrote: > > Saq's page is very nice, but he didn't extract the url or apply tags, so it's > actually harder to use than the source MD. > > My methodology. I use an advanced text editor and split the original text > into fields with pipes. > I paste the text into an "incoming" tiddler. > I've written a tiddler that will split the incoming items, apply specified > tags, populate the url field, and add a unique identifier to avoid tiddler > name collisions. > Then I use a dashboard tiddler to browse the new entries. This makes it > easier to browse the new entries, change tags, long text, and url. I can also > click on a link to check if the link is working. Often I would tweak the link > to use the exact permalink. Tiddlers can then be approved or marked as a > problem. > > This is done in batches by sub-topics to help reduce errors. Rinse. Repeat. > > Of the various steps, it is checking the link that is slowest -- having to > look back and forth, and often authors "hide" the bit you want. I checked > each link for the first 218 submissions. After that I decided to mark items > for review and come back and double-check links later, like when I was really > bored. Of the next 50 I added, ONE had a missing url problem. > > > On Wednesday, March 24, 2021 at 3:19:19 AM UTC-7 Mohammad wrote: > On Wed, Mar 24, 2021 at 1:34 PM Saq Imtiaz <[email protected] > <applewebdata://462BF746-92D9-4216-953C-B8796ACAB2E2>> wrote: > @Birthe and @Mohammad: > > This is the same content but should be a lot less resource intensive to work > with: > https://saqimtiaz.github.io/sq-tw/streams-tiddlytoolmap2.html > <https://saqimtiaz.github.io/sq-tw/streams-tiddlytoolmap2.html> > > Thanks Saq! This is much suitable to create the entries for TW link > aggregator. > > > On Wednesday, March 24, 2021 at 8:24:06 AM UTC+1 [email protected] > <applewebdata://462BF746-92D9-4216-953C-B8796ACAB2E2> wrote: > Mohammad, > Is this the link? > https://saqimtiaz.github.io/sq-tw/streams-tiddlytoolmap.html > <https://saqimtiaz.github.io/sq-tw/streams-tiddlytoolmap.html> I do not > remember the link, but I think Mark S did something similar testing > notowritey. > > Birthe > > > onsdag den 24. marts 2021 kl. 06.05.51 UTC+1 skrev Mohammad: > Hi Mark, > I really appreciate your efforts! I think you should develop a small code to > do the conversion from Toolmap to link aggregator! I know Saq converted > Toolmaps entry to TW tiddlers sometimes ago, but I forgot the link to that > Tiddlywiki! > I know this work is tedious and like you I think the current configuration > is not the best! Like you I think Jeremy shall remove the restriction on > description, ... > > > > > > Best wishes > Mohammad > > > On Wed, Mar 24, 2021 at 9:03 AM 'Mark S.' via TiddlyWiki > <[email protected] <>> wrote: > Out of nearly 300 entries, less than 1% had url errors. I was hoping to do > follow-ups with the w3c link validator, but it doesn't recognize the site as > a document. The standard link-checker software said everything was ok, but > obviously that's wrong. > > I've removed the entry with a bad url. > > I will stop working for now. It's VERY tedious condensing descriptions to 10 > words and supplying tags. Mistakes are bound to happen. > > The last thing I need is to find people upset with my work. If requested, I > can roll back existing entrees. > > On Tuesday, March 23, 2021 at 6:25:32 PM UTC-7 [email protected] <> wrote: > There should also be a tag to indicate "highest supported version" or > something similar if relevant (for plugins, for example) and its known. > > On Tuesday, March 23, 2021 at 8:09:59 PM UTC-5 David Gifford wrote: > There should be a way to report dead links. LibreNote, for example, turns up > a 404. Someone is adding links without even checking them first. > > Also, giffmex.org <http://giffmex.org/> has been https:// since early 2020. > If those adding links to giffmex.org <http://giffmex.org/> could convert them > from http: to https:, that would be appreciated. > > > -- > You received this message because you are subscribed to the Google Groups > "TiddlyWiki" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected] <>. > To view this discussion on the web visit > https://groups.google.com/d/msgid/tiddlywiki/02dd9f80-b088-44d4-ae1b-c07f8d253130n%40googlegroups.com > > <https://groups.google.com/d/msgid/tiddlywiki/02dd9f80-b088-44d4-ae1b-c07f8d253130n%40googlegroups.com?utm_medium=email&utm_source=footer>. > > -- > You received this message because you are subscribed to the Google Groups > "TiddlyWiki" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected] > <applewebdata://462BF746-92D9-4216-953C-B8796ACAB2E2>. > To view this discussion on the web visit > https://groups.google.com/d/msgid/tiddlywiki/556e327f-0f2f-4636-8a78-3cc27d86040cn%40googlegroups.com > > <https://groups.google.com/d/msgid/tiddlywiki/556e327f-0f2f-4636-8a78-3cc27d86040cn%40googlegroups.com?utm_medium=email&utm_source=footer>. > > -- > You received this message because you are subscribed to the Google Groups > "TiddlyWiki" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected] > <mailto:[email protected]>. > To view this discussion on the web visit > https://groups.google.com/d/msgid/tiddlywiki/2a094dd7-1d08-44cc-bb7d-5a74a687199en%40googlegroups.com > > <https://groups.google.com/d/msgid/tiddlywiki/2a094dd7-1d08-44cc-bb7d-5a74a687199en%40googlegroups.com?utm_medium=email&utm_source=footer>. -- You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/tiddlywiki/9D067F06-ECBB-43F9-950B-617AE4410B1C%40gmail.com.
