-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 To answer the file system question: the file blobserver stores lots of files (each blob in a separate file) which may impose some stress on the filesystem. But the diskpacked storage does not.
If you may delete files, use the blobpacked blobserver; if you not, then use diskpacked, or blobpacked with diskpacked for the large blobs and the local blobserver for the cache. This may or may not be configured with the high level server-config.json. If not, then configure everything you can with the high level config, then dump the low-level config with "pk dumpconfig", tweak it, and then use the low level config. With the low level config, the cond, overlay and union blobservers allow creating very complex topologies, too. Tamás ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐ On 2019. January 2., Wednesday 16:10, 'Albert Zeyer' via Perkeep <[email protected]> wrote: > I want to store several TB of data in the database. > > So given that you need 7GB of RAM for about 70GB of blobs, does that mean I > would have to assume maybe 100GB RAM usage for 1TB of blobs? > > It seems to me like this does not seem to scale. Is this a fundamental > problem of Perkeep? > > Best, > Albert > > On Wednesday, January 2, 2019 at 3:29:38 PM UTC+1, tgulacsi78 wrote: > > > -----BEGIN PGP SIGNED MESSAGE----- > > Hash: SHA256 > > > > AFAIK the disks can be slow, but plenty (for a home server) of RAM is > > needed, > > as the metadata index is kept in memory. > > > > perkeepd consumes about 7GB of RAM for > > > > Jan 02 15:27:48 tequila perkeepd[7308]: 2019/01/02 15:27:48 index/corpus: > > stats: 3354.762 MiB mem: 8111182 blobs (71.815 GiB) (7239923 schema (76206 > > permanode, 54526 file (53213 image), ...) > > Jan 02 15:27:48 tequila perkeepd[7308]: 2019/01/02 15:27:48 index/corpus: > > scanning CPU usage: 3m13.711292s > > > > Tamás > > ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐ > > On 2019. January 2., Wednesday 12:56, 'Albert Zeyer' via Perkeep > > <[email protected]> wrote: > > > > > I would like to run some kind of dedicated hardware/server just for > > > Perkeep, which both acts as a backup, but also as a data provider to e.g. > > > access my photos or other things. > > > > > > Are there suggestions what to run/use? I guess Linux? What file system? > > > And a hardware RAID? Or software RAID? Or is RAID kind of obsolete with > > > Perkeep, and I should do the duplication on the Perkeep level? > > > > > > I would also like to have this in my home, so it should be quiet > > > (preferably only passive cooling) and consume low energy. > > > > > > Best regards, > > > Albert > > > > > -- > You received this message because you are subscribed to the Google Groups > "Perkeep" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. -----BEGIN PGP SIGNATURE----- Version: ProtonMail Comment: https://protonmail.com wsBcBAEBCAAGBQJcLOB1AAoJELj70Bsqr19tzeQH/R+eKOHCUSapSiZzU9Q5 GisRcaoBtQseMdvonBxy5iyWm4i9zxxuX0CqmN7DAbvX6NI8jYHi5ZkcR8Ng S4sGhqxY7PmDp9Yed+vJXDXy1sXETAtwLhn64w4Dp3gQos8Mk3VmWZtyvPHF K9iRRKOtqiiFKtAB4Js0YDATC/BExVFwQprf6Jl0cpiK/dp1LQWIanJHQmb0 hfXjB90tm/1LkoJa3P3eqI38EtX0Dj0Q7utcawtRlqF51WT9ITjYvDQbSdow IdaBmiIxOWQ1g11ZkdtjrTgnLA4At0x44W5rqrjqkXNZtWUjDpm321xsSgkT tW0xSqRZ6kBlhymp1bCj5bg= =fr7S -----END PGP SIGNATURE----- -- You received this message because you are subscribed to the Google Groups "Perkeep" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
publickey - [email protected] - 0x78A4747D.asc
Description: application/pgp-keys
publickey - [email protected] - 0x78A4747D.asc.sig
Description: PGP signature
