We don't use DD or Exagrid but i can give you some numbers on that size. We do a NAS backup not through NDMP. 4.3TB ~5.6 mil files. NAS and backup media server are LACP'ed at 4Gig. We hit at least 2.4Gbps on the media server nightly We dedup at the mediaserver for the NAS
A new full takes ~2-3 days using one stream. Multi-streams i could get it under 1 day. Incr takes 9 hours single stream, pretty regular at 140GBs and 1.4 mil files We no longer do real fulls and instead do synthetic with take 16 hours to compile. Our Friday INCR which includes PST files takes 19 hours, ~1.4 mil files but the sized is increase to ~640GBs We have another file server with 12TB and some where close to 20 mil files We multi stream this server with Dedup at the client Incr backups of 1.6 mil files at ~36Gbs takes about 4 hours. A raw full takes almost a week. While backup technology is changing for the most part when an incremental is completed you are still scanning every file to check the modify date or archive bit. I am not sure about DD or Exagrid but for us Netbackup they started tracking file changes to dramatically decrease the full backups. Not that we have the latest version to take advantage of this. If network bandwidth is really a challenge and not file count then look to spreading out your fulls less often. Do a Full backup every 1-2 months, a differential every week and an incremental every day. We do this for our DNA sequencers which spit our 2TBs a patient. We do a twice a year, differential every month and incremental every day. On Wed, Apr 10, 2013 at 11:20 AM, Ben Scott <[email protected]> wrote: > On Wed, Apr 10, 2013 at 9:52 AM, Jon D <[email protected]> wrote: > >> That depends how fast the network you're running is, and how much > >> data you've got to worry about, and maybe other things. > > > > True. I'm trying to backup ~4TB in under 12 hours. 8 hours would be > nice... > > I think a single 1Gig Cat5 cable is going to get me around 23 hours at > > around 850Mbps > > This is where the "other things" come into play. If the > change-delta, de-dupe, compression, and other magic happens on the > agent side of the backup, you may see significant gains. > > For example, if you're backing up a bunch of small files, and churn > is low, and the backup solution uses the "maintain a full mirror of > original" model, and it only copies the changed files, your nightly > backup might only need to ship a tiny amount of data over the wire. > Or if they're large files but it has good change-delta handling. > > Even without such magic, you may also be able to do a longer full > backup on weekends, then an incremental/differential on weeknights. > > -- Ben > > ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ > ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ > > --- > To manage subscriptions click here: > http://lyris.sunbelt-software.com/read/my_forums/ > or send an email to [email protected] > with the body: unsubscribe ntsysadmin > ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ --- To manage subscriptions click here: http://lyris.sunbelt-software.com/read/my_forums/ or send an email to [email protected] with the body: unsubscribe ntsysadmin
