Note that some links that have the same landing page actually have different descriptions and Tags. This is usually because the page was made before permalinks were available.
Older TW's didn't have the permalink button, but did they still have permalinks? Is their some backward compatible code that could generate them? Is there a handy filter that would detect duplicate url's without nesting? On Wednesday, March 24, 2021 at 6:53:20 AM UTC-7 [email protected] wrote: > One thing I’m noticing is that you have multiple $:/tags/Link entries > pointing to the same URL. It doesn’t break the system or anything, but > perhaps it would make more sense for the scraper to merge multiple entries > with the same URL from the same contributor. We would merge the tags, and > concatenate the descriptions. Alternately, I could make you a script that > you could paste into the JS console to do that merging on your original > bookmarks. > > Best wishes > > Jeremy > > On 24 Mar 2021, at 13:40, 'Mark S.' via TiddlyWiki < > [email protected]> wrote: > > Saq's page is very nice, but he didn't extract the url or apply tags, so > it's actually harder to use than the source MD. > > My methodology. I use an advanced text editor and split the original text > into fields with pipes. > I paste the text into an "incoming" tiddler. > I've written a tiddler that will split the incoming items, apply specified > tags, populate the url field, and add a unique identifier to avoid tiddler > name collisions. > Then I use a dashboard tiddler to browse the new entries. This makes it > easier to browse the new entries, change tags, long text, and url. I can > also click on a link to check if the link is working. Often I would tweak > the link to use the exact permalink. Tiddlers can then be approved or > marked as a problem. > > This is done in batches by sub-topics to help reduce errors. Rinse. Repeat. > > Of the various steps, it is checking the link that is slowest -- having to > look back and forth, and often authors "hide" the bit you want. I checked > each link for the first 218 submissions. After that I decided to mark items > for review and come back and double-check links later, like when I was > really bored. Of the next 50 I added, ONE had a missing url problem. > > > On Wednesday, March 24, 2021 at 3:19:19 AM UTC-7 Mohammad wrote: > >> On Wed, Mar 24, 2021 at 1:34 PM Saq Imtiaz <[email protected]> wrote: >> >>> @Birthe and @Mohammad: >>> >>> This is the same content but should be a lot less resource intensive to >>> work with: >>> https://saqimtiaz.github.io/sq-tw/streams-tiddlytoolmap2.html >>> >> >> Thanks Saq! This is much suitable to create the entries for TW link >> aggregator. >> >>> >>> >>> On Wednesday, March 24, 2021 at 8:24:06 AM UTC+1 [email protected] >>> wrote: >>> >>>> Mohammad, >>>> Is this the link? >>>> https://saqimtiaz.github.io/sq-tw/streams-tiddlytoolmap.html I do not >>>> remember the link, but I think Mark S did something similar testing >>>> notowritey. >>>> >>>> Birthe >>>> >>>> >>>> onsdag den 24. marts 2021 kl. 06.05.51 UTC+1 skrev Mohammad: >>>> >>>>> Hi Mark, >>>>> I really appreciate your efforts! I think you should develop a small >>>>> code to do the conversion from Toolmap to link aggregator! I know Saq >>>>> converted Toolmaps entry to TW tiddlers sometimes ago, but I forgot the >>>>> link to that Tiddlywiki! >>>>> I know this work is tedious and like you I think the current >>>>> configuration is not the best! Like you I think Jeremy shall remove the >>>>> restriction on description, ... >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> Best wishes >>>>> Mohammad >>>>> >>>>> >>>>> On Wed, Mar 24, 2021 at 9:03 AM 'Mark S.' via TiddlyWiki < >>>>> [email protected]> wrote: >>>>> >>>>>> Out of nearly 300 entries, less than 1% had url errors. I was hoping >>>>>> to do follow-ups with the w3c link validator, but it doesn't recognize >>>>>> the >>>>>> site as a document. The standard link-checker software said everything >>>>>> was >>>>>> ok, but obviously that's wrong. >>>>>> >>>>>> I've removed the entry with a bad url. >>>>>> >>>>>> I will stop working for now. It's VERY tedious condensing >>>>>> descriptions to 10 words and supplying tags. Mistakes are bound to >>>>>> happen. >>>>>> >>>>>> The last thing I need is to find people upset with my work. If >>>>>> requested, I can roll back existing entrees. >>>>>> >>>>>> On Tuesday, March 23, 2021 at 6:25:32 PM UTC-7 [email protected] >>>>>> wrote: >>>>>> >>>>>>> There should also be a tag to indicate "highest supported version" >>>>>>> or something similar if relevant (for plugins, for example) and its >>>>>>> known. >>>>>>> >>>>>>> On Tuesday, March 23, 2021 at 8:09:59 PM UTC-5 David Gifford wrote: >>>>>>> >>>>>>>> There should be a way to report dead links. LibreNote, for example, >>>>>>>> turns up a 404. Someone is adding links without even checking them >>>>>>>> first. >>>>>>>> >>>>>>>> Also, giffmex.org has been https:// since early 2020. If those >>>>>>>> adding links to giffmex.org could convert them from http: to >>>>>>>> https:, that would be appreciated. >>>>>>>> >>>>>>>> >>>>>> -- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "TiddlyWiki" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to [email protected]. >>>>>> >>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/tiddlywiki/02dd9f80-b088-44d4-ae1b-c07f8d253130n%40googlegroups.com >>>>>> >>>>>> <https://groups.google.com/d/msgid/tiddlywiki/02dd9f80-b088-44d4-ae1b-c07f8d253130n%40googlegroups.com?utm_medium=email&utm_source=footer> >>>>>> . >>>>>> >>>>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "TiddlyWiki" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> >> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/tiddlywiki/556e327f-0f2f-4636-8a78-3cc27d86040cn%40googlegroups.com >>> >>> <https://groups.google.com/d/msgid/tiddlywiki/556e327f-0f2f-4636-8a78-3cc27d86040cn%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> >> > -- > You received this message because you are subscribed to the Google Groups > "TiddlyWiki" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > > To view this discussion on the web visit > https://groups.google.com/d/msgid/tiddlywiki/2a094dd7-1d08-44cc-bb7d-5a74a687199en%40googlegroups.com > > <https://groups.google.com/d/msgid/tiddlywiki/2a094dd7-1d08-44cc-bb7d-5a74a687199en%40googlegroups.com?utm_medium=email&utm_source=footer> > . > > > -- You received this message because you are subscribed to the Google Groups "TiddlyWiki" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/tiddlywiki/873b83ef-bb1b-4255-a336-d5a4e93bc9d5n%40googlegroups.com.
