For storage, I have an EMC VNX 5500, using FAST cache . I have 4 LUNs attached, one for the base OS and three more for the volume group that is storing the /var partition. The volume group is formatted ext3 since we're dealing with small files, it requires less CPU usage than Reiser or ext4, and do not plan on needing recovery for deleted files.
I decided to use a volume group to load balance out the mail data across multiple LUNs, and allowing for expansion as needed. Each LUN in the volume group is 1TB in size, with the vCenter server slicing out 800GB on each, currently making 2.4TB available. Here's the output from 'df -h': Filesystem Size Used Avail Use% Mounted on /dev/sda3 73G 2.3G 67G 4% / Udev 3.9G 4.0K 3.9G 1% /dev Tmpfs 1.6G 416K 1.6G 1% /run None 5.0M 0 5.0M 0% /run/lock None 3.9G 0 3.9G 0% /run/shm /dev/sda1 235M 36M 188M 16% /boot /dev/mapper/vg_piler-lv_piler_data 2.4T 11G 2.2T 1% /var In the long term I may try to find a way of exporting emails to tape backup after the retention policy has been reached, possibly by moving them to a separate instance of piler and mounting a tape partition as LTFS using our brand new LTO-6 drives. Steve Miller -----Original Message----- From: Janos SUTO [mailto:[email protected]] Sent: Monday, May 06, 2013 12:01 PM To: [email protected] Subject: RE: Piler scalability Hello Steve, On 2013-05-06 16:46, Steve Miller wrote: > Janos, > > I would like to put my personal experience into this question as well. > > I have been running piler over 6 days now, with a daily average of 10k > emails. Average message size is 0.2MB, metadata is 2k, and index size > is 6k. Average size per day is 2,402.7MB. > > I have received 68,640 emails, 1,758 of them have been marked as > duplicate. > > My current archive size is 16,721.1MB, which is just over 16GB. > > I am running a bit overkill on the virtual machine - Ubuntu 12.04.2 > LTS, 8 vCPUs, 8GB RAM, 80GB mounted on the root FS, and 2.4TB on the > /var FS. According to piler estimates, I will run out of space for > archiving in 2 years, 8 months, the usage trend is increasing, of > course. > > I'm sure that these numbers are typical of a single domain archive, we > do have a lot of emails with attachments and several outbound only > addresses. We're archiving everything that is sent or received through > our Exchange server. thanks for sharing your numbers. I think over time deduplication will also help reducing the required disk space. Btw. (just curious) what storage do you have under the VM? Janos ------------------------------------------------------------------------------------------- This email is the property of NACA and/or its relevant affiliate and may contain confidential and privileged material for the sole use of the intended recipient(s). Any review, use, distribution, or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender and delete all copies of the message. Any views expressed in this message are those of the individual sender, except where the sender specifies, and with authority, states them to be the views of NACA.
