Re: Which importer is the best example to follow?

2018-05-24 Thread Brad Fitzpatrick
I guess it depends on what type of content you want to import, and which auth protocol (if any) the site uses. On Thu, May 24, 2018 at 1:36 PM, Joshua Poehls wrote: > If I were to play around with creating an importer, which existing importer > should I reference as a

Re: OT: new mails

2018-03-16 Thread Brad Fitzpatrick
We're working on a Gerrit migration to rename it. Maybe something went wrong. I'll ask the people working on it. Sorry for any spam. On Thu, Mar 15, 2018 at 11:52 PM, Gerard wrote: > I mean from Gerrit. > > > On Friday, March 16, 2018 at 7:51:26 AM UTC+1, Gerard wrote: >>

Perkeep status update (2018-03)

2018-03-07 Thread Brad Fitzpatrick
Keepers, This is your somewhat-regular status update on what's new in Perkeep. * the mailing list has been moved from camlistore@googlegroups.com to perk...@googlegroups.com. We're cross-posting this status update, but be sure to move to https://groups.google.com/group/perkeep if you haven't

Re: Hello and multi-stage Docker build

2018-02-21 Thread Brad Fitzpatrick
Nice! I can look more tomorrow or Friday, but sounds great. We've wanted this for awhile now (e.g. https://github.com/perkeep/perkeep/issues/986) Thanks! On Wed, Feb 21, 2018 at 7:40 PM, James Hillyerd wrote: > Hi! Long time gopher first time keeper. > > I wanted to run

Re: State of the Keep: Feb 2018

2018-02-02 Thread Brad Fitzpatrick
Oh, we also applied to present at Linuxfest Northwest again, but they haven't announced who's accepted yet. If approved, we'd also do a hackathon around the same time. Or we might anyway. On Fri, Feb 2, 2018 at 6:36 PM, Brad Fitzpatrick <b...@danga.com> wrote: > Keepers, > > I

State of the Keep: Feb 2018

2018-02-02 Thread Brad Fitzpatrick
Keepers, It's been awhile since we posted a Perkeep status update. (Actually, we never have, because the last time we did a status update it was called Camlistore :)) Anyway, here are some notable things recently done or in progress or on the horizon: *# Rename from Camlistore to Perkeep* (

Re: Migrate mailing list?

2018-01-30 Thread Brad Fitzpatrick
Or do we want to take this opportunity to decide whether mailing lists are still the right answer? I see a lot of people use this forum software; https://forum.golangbridge.org/ https://community.home-assistant.io/ Not sure what the software is called, though. Or maybe those are different. Do

Re: Per-contributor focuses for next major release, hack sessions

2018-01-13 Thread Brad Fitzpatrick
Rather than explicitly track generations, I'd just do consistent hashing, where each disk has a weight proportional to its size (by default) or explicit configuration. On read, try its ideal location. If you miss, search N shards in parallel looking for it. Optionally enqueue a migration task. On

Re: Per-contributor focuses for next major release, hack sessions

2018-01-07 Thread Brad Fitzpatrick
Also, just doing lots of cleanups, fixing ancient & embarrassing things in the code. :) On Sun, Jan 7, 2018 at 9:45 AM, Brad Fitzpatrick <b...@danga.com> wrote: > Good idea! > > First off, let's agree on the case of the new name: Perkeep, without a > capital 'K'.

Re: Per-contributor focuses for next major release, hack sessions

2018-01-07 Thread Brad Fitzpatrick
Good idea! First off, let's agree on the case of the new name: Perkeep, without a capital 'K'. :-) My priorities in the short term: -- finish the project rename -- be more aggressive at unblocking people and reviewing code, or fixing it up when it's stalled but close -- work on the website,

Re: heads-up: are you using MySQL (or other DBMS)?

2018-01-04 Thread Brad Fitzpatrick
We should at least fix the launcher case, which should be easy. We can special-case that, detecting we're a launcher config and changing the automatic config it builds at startup to use the old db names. On Thu, Jan 4, 2018 at 7:47 AM, Mathieu Lonjaret wrote: > Hi,

Re: Custom attribute collisions

2018-01-03 Thread Brad Fitzpatrick
t"} to the "scan" permanode to keep > attribute keys namespaced as well as values. > > On Wednesday, January 3, 2018 at 12:23:25 PM UTC-5, Brad Fitzpatrick wrote: >> >> Best practice is to prefix custom attributes with a domain name, like: >> >> https

Re: Custom attribute collisions

2018-01-03 Thread Brad Fitzpatrick
Best practice is to prefix custom attributes with a domain name, like: https://github.com/camlistore/camlistore/blob/master/pkg/importer/foursquare/foursquare.go (search for "foursquare.com:") On Wed, Jan 3, 2018 at 9:15 AM, Angel wrote: > Hello, > > I have a few ideas

Re: website: update logo/mascot/colors

2018-01-02 Thread Brad Fitzpatrick
On Tue, Jan 2, 2018 at 3:33 PM, Mathieu Lonjaret wrote: > you mean, as in something like > https://camlistore-review.googlesource.com/c/camlistore/+/10006 , but > more finely-grained? Something like that. But that one could use "Keep" for now. Later I imagine

Re: website: update logo/mascot/colors

2018-01-02 Thread Brad Fitzpatrick
et <mathieu.lonja...@gmail.com > wrote: > And once we have an animated Keepy, we can use it to replace pudgy in > the web UI. > Actually there probably are a couple of non-animated places in the web > UI where we can already do that. > > On 3 January 2018 at 00:24, Brad Fitzp

Re: Reducing blobserver fsync() calls?

2017-12-29 Thread Brad Fitzpatrick
Following up a year later, ... I filed https://github.com/camlistore/camlistore/issues/999 I'd like to work on this soon-ish. On Sun, Oct 2, 2016 at 11:48 AM, Theodore Ts'o wrote: > Hi, > > I was noticing that it was taking "a while" to do a test backup of 76 GB, > so

Re: Debugging and authentication

2017-12-28 Thread Brad Fitzpatrick
On Wed, Dec 27, 2017 at 12:21 AM, Norman Walsh <n...@nwalsh.com> wrote: > Brad Fitzpatrick <b...@danga.com> writes: > > When you said you waited to write a "backend", I assumed you meant a > > blob storage backend, but perhaps you meant something else

Re: Debugging and authentication

2017-12-26 Thread Brad Fitzpatrick
On Tue, Dec 26, 2017 at 2:45 AM, Norman Walsh <n...@nwalsh.com> wrote: > Brad Fitzpatrick <b...@danga.com> writes: > > Norman, implementing by mimicking can get you pretty far, but be > > sure to actually read the protocol docs as well. > > Absolutely. I am, h

Re: Custom Importers

2017-10-30 Thread Brad Fitzpatrick
Either way. The advantage of being in the main repo is code review & ongoing maintenance if we change things. On Mon, Oct 30, 2017 at 10:32 AM, Koushik Roy wrote: > If I wanted to write importers for other services (like Slack > conversations), what's the process? Right now

Re: backblaze b2 configuration

2017-10-26 Thread Brad Fitzpatrick
Yup. On Thu, Oct 26, 2017 at 1:25 PM Ty Ler wrote: > For creating a low level config do i just `camtool dumpconfig` and then > paste that file in place of current server config and manipulate? > > > On Thursday, October 26, 2017 at 6:44:10 AM UTC-7, mpl wrote: > >> Yes, it

Re: Moving from diskpacked to blobpacked

2017-05-21 Thread Brad Fitzpatrick
I think your email's subject line is the closest thing to a problem statement in your email. Is the problem that you want an efficient way to move from diskpacked to blobpacked? On Sat, May 20, 2017 at 12:41 AM, Tamás Gulácsi wrote: > Hi, > > I'm using diskpacked storage

Re: converting from self-signed cert to letsencrypt

2016-12-12 Thread Brad Fitzpatrick
Does LetsEncrypt support non-standard port numbers? I think it might have to be 443. On Mon, Dec 12, 2016 at 2:02 PM, Adrian Tritschler < adrian.tritsch...@gmail.com> wrote: > > My config file already has (and has had for months): > > "baseURL": "https://millpond.dyndns.org:3179;, > "listen":

Re: Web UI error when showing other than permanodes

2016-11-27 Thread Brad Fitzpatrick
Was this ever resolved? (cleaning inbox) Was there a bug filed? On Mon, Oct 10, 2016 at 2:15 AM, Attila Tajti wrote: > The web UI cannot show non-permanodes (eg. image files) anymore. I suspect > commit 95c4c90591b7570c460cf03fbb98c9380fbf8170 is the culprit. > > -- >

Re: blob server on AWS Lambda

2016-11-25 Thread Brad Fitzpatrick
That's definitely possible, but it's not currently supported. You'd have to do the work to wire it all up. On Wed, Nov 23, 2016 at 6:28 PM, Raffaele Sena wrote: > Well, the idea is that the blob server would run as a "Lambda" function > and would store the blobs in S3 (and

Re: Integrity Check and Blob location

2016-10-06 Thread Brad Fitzpatrick
I thought there was also a way to use camtool sync to a dummy /dev/null-ish check-hash-only target. Or maybe I'm thinking of the web interface to sync, which does have an integrity check for whether a configured sync pair (e.g. my home machine to AWS S3) is properly in sync. In any case, CLI

Re: command line tools show http2 issues

2016-07-16 Thread Brad Fitzpatrick
e CLI tools. > > > > > On 15 July 2016 at 19:48, Brad Fitzpatrick <b...@danga.com> wrote: > >> Instead of auto-detection, let's make this very opt-in and explicit and > add > >> a new client config option to "disabledHTTP2": true. > > Just a

My availability

2016-06-01 Thread Brad Fitzpatrick
I've spent the past few weeks with visiting family & getting married. I'm now spending the next few weeks with visiting family & going on a honeymoon. Mathieu is taking care of things while I'm away (as he usually does anyway). I'll be back to hacking on Camlistore around June 23rd. The good

Re: SDHC card as dumb blob storage?

2016-05-15 Thread Brad Fitzpatrick
Yeah, it's no different than using any other file system type. I'd use the blobpacked ("packBlobs": true) storage method to be nicest to the SD card. But I'd use blobpacked on any filesystem type, so it's not really different. On Fri, May 13, 2016 at 4:15 AM, Simon B.

Re: location info in DescribeResponse

2016-05-03 Thread Brad Fitzpatrick
Cool. I also want to see all my stuff on a map! On Fri, Apr 29, 2016 at 6:34 AM, Attila Tajti wrote: > I am playing with google maps and trying to show my photos on a map. I can > search for specific locations or list blobs having location data, but see > no way of