Re: [RFC] LKML Archive in Maildir Format
On Sun, Dec 16, 2018 at 02:55:05PM -0500, Konstantin Ryabitsev wrote: > On Sun, Dec 16, 2018 at 09:21:35AM -1000, Joey Pabalinas wrote: > > That was my first attempt, but the ducumentation for the public-inbox > > format is sort of terrible, > > I'm surprised you think so, because it's basically a simple file called > "m" that is updated on each commit and contains the body of the > message. > > > and after a few hours trying to convert it to Maildir I just gave up. > > It's as easy as something like this: > > for commit in $(git rev-list master); do: > git show $commit:m > maildir/new/$commit > done > > You have to do it per each of the shards for the complete archive. Ah dang, I was trying to use stuff like ssoma to split it, no wonder it didn't work. Not sure why I didn't think to try any git commands... Well, at least now I know, ha. Thanks! -- Cheers, Joey Pabalinas signature.asc Description: PGP signature ___ Kernelnewbies mailing list Kernelnewbies@kernelnewbies.org https://lists.kernelnewbies.org/mailman/listinfo/kernelnewbies
Re: [RFC] LKML Archive in Maildir Format
On Sun, Dec 16, 2018 at 02:46:49PM -0500, Konstantin Ryabitsev wrote: > On Sun, Dec 16, 2018 at 09:06:39AM -1000, Joey Pabalinas wrote: > > I spent a lot of time trying to find an LKML archive in Maildir format > > that I could use for local searches with nutmuch or something, but all > > the links I was able to find were all dead. > > > > I ended up just compiling one myself and I currently host it at: > > > > https://alyptik.org/lkml.tar.xz > > You seem to have duplicated a lot of effort that has already been done > to compile the archive on lore.kernel.org. Absolutely correct, haha. > > > It's possible I'm the only weirdo who finds this kind of thing useful, but > > I figured I should share it just in case I'm not. > > The maildir format is kind of terrible for LKML, because having millions > of messages in a single directory is very hard on the underlying FS. If > you break it up into multiple folders, then it becomes difficult to > search. This is the main reason why we have chosen to go with the > public-inbox format, which solves both of these problems and allows for > a very efficient archive updating and replication using git. > > > It's about 1.1 million files, I was wondering if anyone had an idea of a > > better way to host this? I've tried Github and GitLab, but they don't > > appreciate repos with that many files, hah. > > Like I said, you seem to be going down the road we've already tried and > rejected. :) Yes, I had a strong suspicion I might be the only crazy person who prefers this kind of format :) My only comment on the public-mailbox choice is that the documentation is very sparse and erratic. Myself and a couple other people just couldn't figure out how to convert that format to Maildir or some other format you could feed into a reader like neomutt. Do you have any advice on how to convert those public-inbox files correctly? -- Cheers, Joey Pabalinas signature.asc Description: PGP signature ___ Kernelnewbies mailing list Kernelnewbies@kernelnewbies.org https://lists.kernelnewbies.org/mailman/listinfo/kernelnewbies
Re: [RFC] LKML Archive in Maildir Format
On Sun, Dec 16, 2018 at 09:06:39AM -1000, Joey Pabalinas wrote: > I spent a lot of time trying to find an LKML archive in Maildir format > that I could use for local searches with nutmuch or something, but all > the links I was able to find were all dead. > > I ended up just compiling one myself and I currently host it at: > > https://alyptik.org/lkml.tar.xz You seem to have duplicated a lot of effort that has already been done to compile the archive on lore.kernel.org. > It's possible I'm the only weirdo who finds this kind of thing useful, but > I figured I should share it just in case I'm not. The maildir format is kind of terrible for LKML, because having millions of messages in a single directory is very hard on the underlying FS. If you break it up into multiple folders, then it becomes difficult to search. This is the main reason why we have chosen to go with the public-inbox format, which solves both of these problems and allows for a very efficient archive updating and replication using git. > It's about 1.1 million files, I was wondering if anyone had an idea of a > better way to host this? I've tried Github and GitLab, but they don't > appreciate repos with that many files, hah. Like I said, you seem to be going down the road we've already tried and rejected. :) -K ___ Kernelnewbies mailing list Kernelnewbies@kernelnewbies.org https://lists.kernelnewbies.org/mailman/listinfo/kernelnewbies
Re: [RFC] LKML Archive in Maildir Format
On Sun, Dec 16, 2018 at 11:17:34AM -0800, Joe Perches wrote: > On Sun, 2018-12-16 at 09:06 -1000, Joey Pabalinas wrote: > > I spent a lot of time trying to find an LKML archive in Maildir format > > that I could use for local searches with nutmuch or something, but all > > the links I was able to find were all dead. > > You might instead use > > https://www.kernel.org/lore.html > https://git.kernel.org/pub/scm/public-inbox/vger.kernel.org/git.git/ That was my first attempt, but the ducumentation for the public-inbox format is sort of terrible, and after a few hours trying to convert it to Maildir I just gave up. I ended up just slowly scraping lkml.org for a couple weeks so I wouldn't disrupt anything and it worked fairly well. Just looking for advice on where to host this now so others might be able to use it. -- Cheers, Joey Pabalinas signature.asc Description: PGP signature ___ Kernelnewbies mailing list Kernelnewbies@kernelnewbies.org https://lists.kernelnewbies.org/mailman/listinfo/kernelnewbies
Re: [RFC] LKML Archive in Maildir Format
On Sun, 2018-12-16 at 09:06 -1000, Joey Pabalinas wrote: > I spent a lot of time trying to find an LKML archive in Maildir format > that I could use for local searches with nutmuch or something, but all > the links I was able to find were all dead. You might instead use https://www.kernel.org/lore.html https://git.kernel.org/pub/scm/public-inbox/vger.kernel.org/git.git/ ___ Kernelnewbies mailing list Kernelnewbies@kernelnewbies.org https://lists.kernelnewbies.org/mailman/listinfo/kernelnewbies
[ANNOUNCE] New kernelnewbies mailing list archive
Hello everyone, I nearly forgot to announce on kernelnewbies list soon after linux-iio and coccinelle list got set up. So, kernelnewbies has a new archiving website with search, permalink, and other useful features available at: https://lore.kernel.org/kernelnewbies/ Other available list can be found at: https://www.kernel.org/lore.html I guess there is no other active archiving agent for kernelnewbies, not even marc.info with these features which is why I requested Konstantin Ryabitsev to set it up. Special thanks to Konstantin Ryabitsev from Linux Foundation! -- Himanshu Jha Undergraduate Student Department of Electronics & Communication Guru Tegh Bahadur Institute of Technology ___ Kernelnewbies mailing list Kernelnewbies@kernelnewbies.org https://lists.kernelnewbies.org/mailman/listinfo/kernelnewbies
Re: a specific question...
On Sun, 16 Dec 2018, R. Engür Pişirici wrote: > Hello All, > > Before starting to ask my question, I would like to apologize about > asking a silly question. Mostly, i always try to find answers by > reading, searching, digging, etc. However, i really couldnt find a > proper answer for my question. > > My question is about l2tp/pptp drivers in kernel. pptp driver is in > /drivers/net. But, l2tp driver is in /net I want to know why they > reside in different paths? What did i miss? typically, what you find under /net is code for general networking *protocols*, while drivers/net contains actual device drivers for physical devices. sometimes, the split is not perfect. rday -- Robert P. J. Day Ottawa, Ontario, CANADA http://crashcourse.ca/dokuwiki Twitter: http://twitter.com/rpjday LinkedIn: http://ca.linkedin.com/in/rpjday ___ Kernelnewbies mailing list Kernelnewbies@kernelnewbies.org https://lists.kernelnewbies.org/mailman/listinfo/kernelnewbies
a specific question...
Hello All, Before starting to ask my question, I would like to apologize about asking a silly question. Mostly, i always try to find answers by reading, searching, digging, etc. However, i really couldnt find a proper answer for my question. My question is about l2tp/pptp drivers in kernel. pptp driver is in /drivers/net. But, l2tp driver is in /net I want to know why they reside in different paths? What did i miss? Best Regards, -engur ___ Kernelnewbies mailing list Kernelnewbies@kernelnewbies.org https://lists.kernelnewbies.org/mailman/listinfo/kernelnewbies
