Re: Anyone using object storage ceph?
No, not for lack of interest though. The former feels abandoned and has design issues IMHO. The later is a Dovecot Pro thing and when I talked with Timo 2(?) years ago he felt that Ceph with S3 or Swift wasn't a good fit and we didn't really want to go with Scality and simply can't do out of house/country stuff. The thing I said back then and I still think is valid is that I feel object storage with lots of small objects is going to require a fast and studly storage system below and due to the nature of the beast still loose against something like DRBD when it comes to both latency and overall costs. It also becomes more of a black box than maildir on a file system, but that's another and lesser issue. Christian On Tue, 14 May 2019 14:58:10 +0200 Marc Roos via dovecot wrote: > Just curious if there are already people actively using object storage? > > https://github.com/ceph-dovecot/dovecot-ceph-plugin > https://docplayer.net/docs-images/40/9935441/images/page_13.jpg > -- Christian BalzerNetwork/Systems Engineer ch...@gol.com Rakuten Communications
Anyone using object storage ceph?
Just curious if there are already people actively using object storage? https://github.com/ceph-dovecot/dovecot-ceph-plugin https://docplayer.net/docs-images/40/9935441/images/page_13.jpg
Re: object storage
Hi Timo, could you provide some contact information ? I've tried getting in touch with OpenXChange and i...@dovecot.fi but so far I haven't been lucky. I've got a project under way that will eventually grow to a couple million users if not more. Dimos On 26/09/2015 04:28 μμ, Timo Sirainen wrote: On 25 Sep 2015, at 17:56, Hans Morten Kind <k...@adm.uib.no> wrote: On Tue, Sep 15, 2015 at 12:31:25PM +0900, Timo Sirainen wrote: On 12 Sep 2015, at 04:45, Bradley Giesbrecht <pixi...@macports.org> wrote: Is the Dovecot Object Storage plugin still available for purchase? It's available, but at least for now we're only selling it to big customers. Well how big? Would a univeristy with 25.000 users count as BIG? Or are we talking about HUGE? Our typical projects have several million user accounts. I think 100k users is around the minimum.
Re: object storage
I went to them to discuss 300-500,000 users, right after dovecot was acquired by OpenXChange. The terms were onerous, to say the least. It was straight per-user pricing with no flexibility for non-standard usage patterns. Mostly they wanted to talk about OpenXChange, in which I have absolutely no interest. I walked away undecided: would I look at developing my own object storage back-end for dovecot and open-source it? Or would I abandon dovecot entirely? I'm still undecided. > On Sep 28, 2015, at 6:18 AM, Paolo Cravero <paolo.crav...@csi.it> wrote: > > >> Timo Sirainen wrote: >> Our typical projects have several million user accounts. I think 100k >> users is around the minimum. > > Interesting. So che choice for object storage is driven by the number of > accounts rather than the amount of data stored? For example I am heading > towards 10 TB online with "just" 10k users. It wouldn't be worth? > > Paolo
Re: object storage
> Timo Sirainen wrote: > Our typical projects have several million user accounts. I think 100k > users is around the minimum. Interesting. So che choice for object storage is driven by the number of accounts rather than the amount of data stored? For example I am heading towards 10 TB online with "just" 10k users. It wouldn't be worth? Paolo
Re: object storage
Le 2015-09-28 15:18, Paolo Cravero a écrit : Timo Sirainen wrote: Our typical projects have several million user accounts. I think 100k users is around the minimum. Interesting. So che choice for object storage is driven by the number of accounts rather than the amount of data stored? For example I am heading towards 10 TB online with "just" 10k users. It wouldn't be worth? Paolo Since they sell it with a pricing /user, the data stored should not matter to them.
Re: object storage
On 25 Sep 2015, at 17:56, Hans Morten Kind <k...@adm.uib.no> wrote: > > On Tue, Sep 15, 2015 at 12:31:25PM +0900, Timo Sirainen wrote: >> On 12 Sep 2015, at 04:45, Bradley Giesbrecht <pixi...@macports.org> wrote: >>> >>> Is the Dovecot Object Storage plugin still available for purchase? >>> >> >> It's available, but at least for now we're only selling it to big customers. > > Well how big? Would a univeristy with 25.000 users count as BIG? > Or are we talking about HUGE? Our typical projects have several million user accounts. I think 100k users is around the minimum.
Re: object storage
On Tue, Sep 15, 2015 at 12:31:25PM +0900, Timo Sirainen wrote: > On 12 Sep 2015, at 04:45, Bradley Giesbrecht <pixi...@macports.org> wrote: > > > > Is the Dovecot Object Storage plugin still available for purchase? > > > > It's available, but at least for now we're only selling it to big customers. Well how big? Would a univeristy with 25.000 users count as BIG? Or are we talking about HUGE? hmk
Re: object storage
On 12 Sep 2015, at 04:45, Bradley Giesbrecht <pixi...@macports.org> wrote: > > Is the Dovecot Object Storage plugin still available for purchase? > > Clicking the store link [2] from this page [1] does not show any info about > purchasing the plugin. > > [1] > http://www.dovecot.fi/dovecot-object-storage-plugins-available-for-online-purchase/ > [2] http://shop.dovecot.fi/ It's available, but at least for now we're only selling it to big customers.
object storage
Is the Dovecot Object Storage plugin still available for purchase? Clicking the store link [2] from this page [1] does not show any info about purchasing the plugin. [1] http://www.dovecot.fi/dovecot-object-storage-plugins-available-for-online-purchase/ [2] http://shop.dovecot.fi/ Regards, Bradley Giesbrecht (pixilla)
Re: Designing an Object Storage Plugin for a specific platform
Did someone has already developed something similar and have any tips for me? Thanks! -- Thiago Henrique Em 29-12-2014 13:09, Listas@Adminlinux escreveu: Hi! I'm planning to develop a OSP (Object Storage Plugin) to support a specific platform of my company. Is there any API documentation or sample code of a simple plugin that can be used as a basis for an implementation? Thanks! -- Thiago Henrique
Designing an Object Storage Plugin for a specific platform
Hi! I'm planning to develop a OSP (Object Storage Plugin) to support a specific platform of my company. Is there any API documentation or sample code of a simple plugin that can be used as a basis for an implementation? Thanks! -- Thiago Henrique
Object storage
Timo, We are contemplating building an S3 compatible cluster of storage servers using Pithos https://github.com/exoscale/pithos and Cassandra to get multi data center redundancy and availability. Would it be possible to have multiple Dovecot servers in disparate geographical locations all talking to the same object storage, assuming it's consistent between sites? From what I remember about obox the dovecot servers all keep a copy of the index locally and merge it with a file in the object storage at intervals, is this an issue with our concept? Also does your team have any performance analysis data on the obox plugin, or data on it's use in production?
[Dovecot] Questions about the upcoming Object Storage Plugin for 2.2
Hi Timo, I'm curious and have questions about the new Object Storage Plugin (OSP), and how it can be leveraged by an SMB like us. First, am I reading this right where it could be used as a kind of 'live/realtime backup' solution, where everything is stored *both* locally and in the cloud, with two-way syncing, ie, so local users could access the local server for faster access, and when outside the office, they'd access the cloud based storage and any changes made there are sync'd back to the local server? Or is it intended to be more as an alternative storage for storing older emails in a separate namespace? Or both/either? Second, is SIS fully supported by the OSP? Third - I'm a little confused by the Amazon S3 pricing page, especially on how to try to estimate the costs for usage (bandwidth, etc)... do you have any idea how to go about estimating that? Is there some kind of process we could use on our existing server to measure it over a given period of time that would give us an estimate of what to expect if we decided to switch over? Last - have you established pricing for the OSP? Will it be per user, or per MB/GB, per month (or per year), or just a one-time cost? And/or will you include/bundle it with any/all of your support tiers? Sorry if I'm jumping the gun here... Thanks, really looking forward to the 2.2 release! -- Best regards, Charles
Re: [Dovecot] Questions about the upcoming Object Storage Plugin for 2.2
On 2013-04-11 8:31 AM, Charles Marcus cmar...@media-brokers.com wrote: Third - I'm a little confused by the Amazon S3 pricing page, Specifically, the 'Request Pricing' shown here: http://aws.amazon.com/s3/pricing/ Also... Would the plugin support the ability to use two different storage 'namespaces', e.g., one for primary email storage (stored on S3's 'Standard' storage tier), and one for 'older or 'archived' emails stored on the much cheaper 'Glacier' system/tier? Probably not that big a deal though, since the cost for a TB of storage at the Standard tier is still only .095/GB/mo, which only comes to $95/mo... wow, this is looking better all the time... -- Best regards, Charles
Re: [Dovecot] Questions about the upcoming Object Storage Plugin for 2.2
On 2013-04-11 9:55 AM, Charles Marcus cmar...@media-brokers.com wrote: Would the plugin support the ability to use two different storage 'namespaces', e.g., one for primary email storage (stored on S3's 'Standard' storage tier), and one for 'older or 'archived' emails stored on the much cheaper 'Glacier' system/tier? Never mind about this, further reading on their Glacier storage reveals it isn't suited to email storage, but could definitely be used with Dovecots new 'Archive' feature for *permanent* email archival... So, the question is would the OSP support this? Mirroring/storing live email to the standard S3 filesystem, and storing permanent email archives to the Glacier system (maybe on some kind of scheduled nightly or weekly basis)? -- Best regards, Charles
Re: [Dovecot] Questions about the upcoming Object Storage Plugin for 2.2
On 11.4.2013, at 15.31, Charles Marcus cmar...@media-brokers.com wrote: I'm curious and have questions about the new Object Storage Plugin (OSP), and how it can be leveraged by an SMB like us. I'll give some more complete answers and examples and such within a few days.. Or probably better if I write down some scenarios to some web page or something. First, am I reading this right where it could be used as a kind of 'live/realtime backup' solution, where everything is stored *both* locally and in the cloud, with two-way syncing, ie, so local users could access the local server for faster access, and when outside the office, they'd access the cloud based storage and any changes made there are sync'd back to the local server? Or is it intended to be more as an alternative storage for storing older emails in a separate namespace? Or both/either? Currently you have a local cache (e.g. 100 GB total). You can also use dsync replication to replicate it somewhere, either locally or to another server. With dsync I think you can basically run it any way you want. Second, is SIS fully supported by the OSP? Not currently, but could be added. Third - I'm a little confused by the Amazon S3 pricing page, especially on how to try to estimate the costs for usage (bandwidth, etc)... do you have any idea how to go about estimating that? Is there some kind of process we could use on our existing server to measure it over a given period of time that would give us an estimate of what to expect if we decided to switch over? If you have large enough local cache, you're not really doing anything except uploading messages. Also index files are periodically being uploaded for each user (every 5 minutes if they have changed), but they are often also not full index files but smaller diffs for them (although upload bandwidth is free so doesn't really matter either). So ideally there would be no download costs at all, because nothing is downloaded. And the number of requests per user per day .. I haven't really counted, but I'd guess between a few hundred and a thousand. Lets say a thousand, which means with 100 users/year it's $182.50. Last - have you established pricing for the OSP? Will it be per user, or per MB/GB, per month (or per year), or just a one-time cost? And/or will you include/bundle it with any/all of your support tiers? All of the above, I think ;)
Re: [Dovecot] Commercial features in Dovecot future: Object storage, archive
On Mon, Nov 12, 2012 at 12:33 PM, Timo Sirainen t...@iki.fi wrote: Hi all, Dovecot Oy’s web pages at www.dovecot.fi have been updated. The products page lists two features that will be available for commercial licensing, extending the functionality of the basic open-source version of Dovecot. * Storing emails to (high-latency) object storage, initially supporting Amazon S3, Caringo CAStor and Scality. * Email archive storage. See http://www.dovecot.fi/products/index.html for details. 404 file not found, but it was not too difficult to guess where you meant. I'm not too interested in the extended functionality, but the extra tested, bugfix-only/mainly Enterprise Release sounds very interesting. That page isn't quite clear on if the enterprise release is meant to be free or not (Some features may require license fees). Could you please clarify? Is it available already? We're starting to be long overdue for an overhaul of our installation (currently on v2.0.14 + some fixes), so we need to do something soon... -jf
Re: [Dovecot] Commercial features in Dovecot future: Object storage, archive
Am 13.11.2012 10:17, schrieb Jan-Frode Myklebust: See http://www.dovecot.fi/products/index.html for details. 404 file not found, but it was not too difficult to guess where you meant. no problem here Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich
Re: [Dovecot] Commercial features in Dovecot future: Object storage, archive
Am 13.11.2012 12:32, schrieb Robert Schetterer: Am 13.11.2012 10:17, schrieb Jan-Frode Myklebust: See http://www.dovecot.fi/products/index.html for details. 404 file not found, but it was not too difficult to guess where you meant. no problem here having a shiny laout does not mean that you do not see a error page since it is one httpd-config-line read the page title titleWhoops! Page Not Found | The world#039;s most popular IMAP server!/title read the response-headers: HTTP/1.1 404 Not Found Date: Tue, 13 Nov 2012 11:36:40 GMT Server: Apache/2.2.3 (CentOS) X-Powered-By: PHP/5.3.3 scroll down: Whoops! Page Not Found Don't fret, you didn't do anything wrong. It appears that the page you are looking for does not exist or has been moved elsewhere. signature.asc Description: OpenPGP digital signature
Re: [Dovecot] Commercial features in Dovecot future: Object storage, archive
Am 13.11.2012 12:38, schrieb Reindl Harald: read the page title titleWhoops! Page Not Found | ok , i see youre right, i am rare looking in tab text Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstraße 15, 81669 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich
Re: [Dovecot] Commercial features in Dovecot future: Object storage, archive
On 13.11.2012, at 11.17, Jan-Frode Myklebust wrote: On Mon, Nov 12, 2012 at 12:33 PM, Timo Sirainen t...@iki.fi wrote: Hi all, Dovecot Oy’s web pages at www.dovecot.fi have been updated. The products page lists two features that will be available for commercial licensing, extending the functionality of the basic open-source version of Dovecot. * Storing emails to (high-latency) object storage, initially supporting Amazon S3, Caringo CAStor and Scality. * Email archive storage. See http://www.dovecot.fi/products/index.html for details. 404 file not found, but it was not too difficult to guess where you meant. It worked when I wrote the email, but broke since then :) I'm not too interested in the extended functionality, but the extra tested, bugfix-only/mainly Enterprise Release sounds very interesting. That page isn't quite clear on if the enterprise release is meant to be free or not (Some features may require license fees). Could you please clarify? Is it available already? It's currently available if you buy a support contract. (RPMs and source tarball, DEBs should come in somewhat near future.)
[Dovecot] Commercial features in Dovecot future: Object storage, archive
Hi all, Dovecot Oy’s web pages at www.dovecot.fi have been updated. The products page lists two features that will be available for commercial licensing, extending the functionality of the basic open-source version of Dovecot. * Storing emails to (high-latency) object storage, initially supporting Amazon S3, Caringo CAStor and Scality. * Email archive storage. See http://www.dovecot.fi/products/index.html for details. I’ve been developing Dovecot for over 10 years now. For a long time it was my primary motivation in life to create the best IMAP server available :) I think I've pretty much accomplished that by now. The future is looking very bright for Dovecot: we will continue the open source development stronger than ever, but in addition, for the long term it needs some additional licensed components that bring the money to cover the cost for future Dovecot development and to be able to build up the support in a professional way. These new features will be added as plugins on top of Dovecot to extend the functionality. Note that I’m not just randomly choosing which features will be open and which will be licensed. Only some specific features will be licensed where my company is going to make money with partnerships and in other measurable ways.
Re: [Dovecot] Commercial features in Dovecot future: Object storage, archive
Il 12/11/2012 12:33, Timo Sirainen ha scritto: Hi all, Dovecot Oy’s web pages at www.dovecot.fi have been updated. The products page lists two features that will be available for commercial licensing, extending the functionality of the basic open-source version of Dovecot. * Storing emails to (high-latency) object storage, initially supporting Amazon S3, Caringo CAStor and Scality. * Email archive storage. See http://www.dovecot.fi/products/index.html for details. I’ve been developing Dovecot for over 10 years now. For a long time it was my primary motivation in life to create the best IMAP server available :) I think I've pretty much accomplished that by now. The future is looking very bright for Dovecot: we will continue the open source development stronger than ever, but in addition, for the long term it needs some additional licensed components that bring the money to cover the cost for future Dovecot development and to be able to build up the support in a professional way. These new features will be added as plugins on top of Dovecot to extend the functionality. Note that I’m not just randomly choosing which features will be open and which will be licensed. Only some specific features will be licensed where my company is going to make money with partnerships and in other measurable ways. I'm really interesting in storing email into object storage, since our IaaS provider is using Scality we can simple buy dovecot's plugin for scality. I will contact Dovecot Oy for more informations. -- Alessio Cecchi is: @ ILS - http://www.linux.it/~alessice/ on LinkedIn - http://www.linkedin.com/in/alessice Assistenza Sistemi GNU/Linux - http://www.cecchi.biz/ @ PLUG - ex-Presidente, adesso senatore a vita, http://www.prato.linux.it
