Re: Video fileserver - Need some input
At 14:21 09/05/2007, you wrote: >I'm planning a new fileserver for my post-production facility and need some >input regarding filesystems and network setup. I've been a FreeBSD fan for >almost 10 years now and will try to build this server based on the latest >stable FreeBSD version, allthough most machines here run WinXP. > >We have an internal 1 Gigabit network here and in addition to this the video >fileserver will have two direct NIC connections to two WinXP capture >stations. I will most likely be using a Raid-0 or a Raid-5 setup with SATA >drives. The system will have something like 4-8 TB of HDD space. > >I'm not so afraid of loosing data, but we need a system that is fast and >will allow capture from two external Windows XP machines through direct >Gigabit ethernet. The datarates are 8 bit @ 720 x 576 @ 25fps = 20 MB >per/sec, or 70 GB per/hr. >10 bit @ 720 x 576 @ 25fps = 26 MB per/sec, or 93 GB per/hr. Are you sure? 8 bits per pixel is too low. For RGB i suggest you use a 8 bit per color (R,G and B) or 24 bit per pixel. Or if you work under YUV/YcrCb spaces a 12bit as minimum (YUV12 or 4:2:0 space). Final numbers for PAL RGB are 24 x 720 x 576 x 25 = 29'96 MB/sec (Your 8x720x576x25 are 9'88MB/sec, not 20) and for YUV12 14'98 MB/sec. You can use a lossless videocodec for capture, huffyuv is the faster/better and you have a "native" Windows VfW version. All current computers can compress with it "on the fly" (my 3-4 years old 2Ghz Athlon shows 70 fps) and can halve the data rate. In the freebsd you can use ffmpeg based apps for decode it (and encode), that's all apps. If you can work with lossy video codec use x264 on the Windows side, tuned for "on the fly" / "live" compression, if not you will lost frames. Again, ffmpeg can decode it on freebsd. You can get 1 MB/sec or less. Check dirac (don't know if a freebsd port works) and if you want to pay, try VP7, the big brother of macromedia flash codec. >In addition to this 1-5 machines will have access to the fileserver through >a shared Gigabit network connection for making DVDs and use the files as >source for editing. In short: There will be two direct 1Gb network >connections and one shared 1Gb connection. Will the server hold up? Depends on how many readers attacks the files. It's more a bus problem than a OS. If video data is compressed the disk will read/write less and you can serve faster. >Any other recommendations are very welcome. Don't use RAID-0. If there is any problem everything become lost. >Thanks! > >Regards, >Andreas W. Andersen HTH N.B. huffyuv, x264 and dirac codecs are opensource. VP7 is On2 Tech. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Video fileserver - Need some input
The _main_ think I can think of, is windows in a SINGLE threaded movement of data via CIFS, is gonna limit you to about 17MB/sec. Andreas..have you tested this via CIFS/Redirector and been able to sustain the performance that you need before going with Samba (another performance layer issue) On 5/9/07, Chris Slothouber <[EMAIL PROTECTED]> wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 2007-05-09 10:12, Andreas Widerøe Andersen wrote: > On 5/9/07, Chris Slothouber <[EMAIL PROTECTED]> wrote: >> On 2007-05-09 08:21, Andreas Widerøe Andersen wrote: >>> I'm planning a new fileserver for my post-production facility and need >> some >>> input regarding filesystems and network setup. I've been a FreeBSD fan >> for >>> almost 10 years now and will try to build this server based on the >> latest >>> stable FreeBSD version, allthough most machines here run WinXP. >>> In addition to this 1-5 machines will have access to the fileserver >> through >>> a shared Gigabit network connection for making DVDs and use the files as >>> source for editing. In short: There will be two direct 1Gb network >>> connections and one shared 1Gb connection. Will the server hold up? >> Depending on the resolution and frame rate of your video, GigE is >> nowhere near fast enough a pipe for live video manipulation. This is >> certainly the case when dealing with broadcast video. > > > We're only working in Standard Definition PAL (see the datarates in my first > post). I have done DV capture tests before over the network and that worked > fine. We're already having three machines feeding from one server today and > that works fine too allthough it is a bit slow. We're mainly copying files > to local drives, but DVD creation happens straight from the server. My apologies, I totally glazed over that bit. Samba does have some performance issues out of the box (see Solon Luigi Lutz's thread from 04-10, similar situation but a little bit more later in the game). I believe there are a few tuning options for Samba<->FreeBSD that might be appropriate, esp. wrt. multi-threading CIFS. Google seems to show a lot of hits for that. Sorry again for missing the info you provided. I hope this helps. - -- Chris Slothouber ([EMAIL PROTECTED]) -=- Mercenary Sysadmin BIZ: http://www.hier7.com -=- building.better.ideas PGP: 7A83 F021 5AC3 4BD7 6738 21D8 B348 0B16 79C0 C27F -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.7 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGQd/0s0gLFnnAwn8RAvgsAJ9Dr2oFZMMt8sfPbsMtLBJZ3hBc8gCfVRVL 8tgP0nFuv881JKe/ZRkeOQI= =jq/3 -END PGP SIGNATURE- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to " [EMAIL PROTECTED]" ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Video fileserver - Need some input
Chris: Accept my fallin on my sword..I didnt see your reply before I sent. ;) On 5/9/07, Chris Slothouber <[EMAIL PROTECTED]> wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 2007-05-09 10:12, Andreas Widerøe Andersen wrote: > On 5/9/07, Chris Slothouber <[EMAIL PROTECTED]> wrote: >> On 2007-05-09 08:21, Andreas Widerøe Andersen wrote: >>> I'm planning a new fileserver for my post-production facility and need >> some >>> input regarding filesystems and network setup. I've been a FreeBSD fan >> for >>> almost 10 years now and will try to build this server based on the >> latest >>> stable FreeBSD version, allthough most machines here run WinXP. >>> In addition to this 1-5 machines will have access to the fileserver >> through >>> a shared Gigabit network connection for making DVDs and use the files as >>> source for editing. In short: There will be two direct 1Gb network >>> connections and one shared 1Gb connection. Will the server hold up? >> Depending on the resolution and frame rate of your video, GigE is >> nowhere near fast enough a pipe for live video manipulation. This is >> certainly the case when dealing with broadcast video. > > > We're only working in Standard Definition PAL (see the datarates in my first > post). I have done DV capture tests before over the network and that worked > fine. We're already having three machines feeding from one server today and > that works fine too allthough it is a bit slow. We're mainly copying files > to local drives, but DVD creation happens straight from the server. My apologies, I totally glazed over that bit. Samba does have some performance issues out of the box (see Solon Luigi Lutz's thread from 04-10, similar situation but a little bit more later in the game). I believe there are a few tuning options for Samba<->FreeBSD that might be appropriate, esp. wrt. multi-threading CIFS. Google seems to show a lot of hits for that. Sorry again for missing the info you provided. I hope this helps. - -- Chris Slothouber ([EMAIL PROTECTED]) -=- Mercenary Sysadmin BIZ: http://www.hier7.com -=- building.better.ideas PGP: 7A83 F021 5AC3 4BD7 6738 21D8 B348 0B16 79C0 C27F -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.7 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGQd/0s0gLFnnAwn8RAvgsAJ9Dr2oFZMMt8sfPbsMtLBJZ3hBc8gCfVRVL 8tgP0nFuv881JKe/ZRkeOQI= =jq/3 -END PGP SIGNATURE- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to " [EMAIL PROTECTED]" ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Video fileserver - Need some input
45MB/sec is too fast for GigE? Wha? On 5/9/07, Chris Slothouber <[EMAIL PROTECTED]> wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 2007-05-09 08:21, Andreas Widerøe Andersen wrote: > I'm planning a new fileserver for my post-production facility and need some > input regarding filesystems and network setup. I've been a FreeBSD fan for > almost 10 years now and will try to build this server based on the latest > stable FreeBSD version, allthough most machines here run WinXP. > In addition to this 1-5 machines will have access to the fileserver through > a shared Gigabit network connection for making DVDs and use the files as > source for editing. In short: There will be two direct 1Gb network > connections and one shared 1Gb connection. Will the server hold up? Depending on the resolution and frame rate of your video, GigE is nowhere near fast enough a pipe for live video manipulation. This is certainly the case when dealing with broadcast video. - -- Chris Slothouber ([EMAIL PROTECTED]) -=- Mercenary Sysadmin BIZ: http://www.hier7.com -=- building.better.ideas PGP: 7A83 F021 5AC3 4BD7 6738 21D8 B348 0B16 79C0 C27F -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.7 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGQc01s0gLFnnAwn8RAggtAKDYIRWT1iB0VjkmRxxJ8EzbjJxg+wCgmPuM /fHCEVtbOq2G50rXb91djtg= =lzTn -END PGP SIGNATURE- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to " [EMAIL PROTECTED]" ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Video fileserver - Need some input
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 2007-05-09 10:12, Andreas Widerøe Andersen wrote: > On 5/9/07, Chris Slothouber <[EMAIL PROTECTED]> wrote: >> On 2007-05-09 08:21, Andreas Widerøe Andersen wrote: >>> I'm planning a new fileserver for my post-production facility and need >> some >>> input regarding filesystems and network setup. I've been a FreeBSD fan >> for >>> almost 10 years now and will try to build this server based on the >> latest >>> stable FreeBSD version, allthough most machines here run WinXP. >>> In addition to this 1-5 machines will have access to the fileserver >> through >>> a shared Gigabit network connection for making DVDs and use the files as >>> source for editing. In short: There will be two direct 1Gb network >>> connections and one shared 1Gb connection. Will the server hold up? >> Depending on the resolution and frame rate of your video, GigE is >> nowhere near fast enough a pipe for live video manipulation. This is >> certainly the case when dealing with broadcast video. > > > We're only working in Standard Definition PAL (see the datarates in my first > post). I have done DV capture tests before over the network and that worked > fine. We're already having three machines feeding from one server today and > that works fine too allthough it is a bit slow. We're mainly copying files > to local drives, but DVD creation happens straight from the server. My apologies, I totally glazed over that bit. Samba does have some performance issues out of the box (see Solon Luigi Lutz's thread from 04-10, similar situation but a little bit more later in the game). I believe there are a few tuning options for Samba<->FreeBSD that might be appropriate, esp. wrt. multi-threading CIFS. Google seems to show a lot of hits for that. Sorry again for missing the info you provided. I hope this helps. - -- Chris Slothouber ([EMAIL PROTECTED]) -=- Mercenary Sysadmin BIZ: http://www.hier7.com -=- building.better.ideas PGP: 7A83 F021 5AC3 4BD7 6738 21D8 B348 0B16 79C0 C27F -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.7 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGQd/0s0gLFnnAwn8RAvgsAJ9Dr2oFZMMt8sfPbsMtLBJZ3hBc8gCfVRVL 8tgP0nFuv881JKe/ZRkeOQI= =jq/3 -END PGP SIGNATURE- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Video fileserver - Need some input
On 5/9/07, Chris Slothouber <[EMAIL PROTECTED]> wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 2007-05-09 08:21, Andreas Widerøe Andersen wrote: > I'm planning a new fileserver for my post-production facility and need some > input regarding filesystems and network setup. I've been a FreeBSD fan for > almost 10 years now and will try to build this server based on the latest > stable FreeBSD version, allthough most machines here run WinXP. > In addition to this 1-5 machines will have access to the fileserver through > a shared Gigabit network connection for making DVDs and use the files as > source for editing. In short: There will be two direct 1Gb network > connections and one shared 1Gb connection. Will the server hold up? Depending on the resolution and frame rate of your video, GigE is nowhere near fast enough a pipe for live video manipulation. This is certainly the case when dealing with broadcast video. We're only working in Standard Definition PAL (see the datarates in my first post). I have done DV capture tests before over the network and that worked fine. We're already having three machines feeding from one server today and that works fine too allthough it is a bit slow. We're mainly copying files to local drives, but DVD creation happens straight from the server. Cheers, Andreas ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Video fileserver - Need some input
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 2007-05-09 08:21, Andreas Widerøe Andersen wrote: > I'm planning a new fileserver for my post-production facility and need some > input regarding filesystems and network setup. I've been a FreeBSD fan for > almost 10 years now and will try to build this server based on the latest > stable FreeBSD version, allthough most machines here run WinXP. > In addition to this 1-5 machines will have access to the fileserver through > a shared Gigabit network connection for making DVDs and use the files as > source for editing. In short: There will be two direct 1Gb network > connections and one shared 1Gb connection. Will the server hold up? Depending on the resolution and frame rate of your video, GigE is nowhere near fast enough a pipe for live video manipulation. This is certainly the case when dealing with broadcast video. - -- Chris Slothouber ([EMAIL PROTECTED]) -=- Mercenary Sysadmin BIZ: http://www.hier7.com -=- building.better.ideas PGP: 7A83 F021 5AC3 4BD7 6738 21D8 B348 0B16 79C0 C27F -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.7 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGQc01s0gLFnnAwn8RAggtAKDYIRWT1iB0VjkmRxxJ8EzbjJxg+wCgmPuM /fHCEVtbOq2G50rXb91djtg= =lzTn -END PGP SIGNATURE- ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Video fileserver - Need some input
I'm planning a new fileserver for my post-production facility and need some input regarding filesystems and network setup. I've been a FreeBSD fan for almost 10 years now and will try to build this server based on the latest stable FreeBSD version, allthough most machines here run WinXP. We have an internal 1 Gigabit network here and in addition to this the video fileserver will have two direct NIC connections to two WinXP capture stations. I will most likely be using a Raid-0 or a Raid-5 setup with SATA drives. The system will have something like 4-8 TB of HDD space. I'm not so afraid of loosing data, but we need a system that is fast and will allow capture from two external Windows XP machines through direct Gigabit ethernet. The datarates are 8 bit @ 720 x 576 @ 25fps = 20 MB per/sec, or 70 GB per/hr. 10 bit @ 720 x 576 @ 25fps = 26 MB per/sec, or 93 GB per/hr. In addition to this 1-5 machines will have access to the fileserver through a shared Gigabit network connection for making DVDs and use the files as source for editing. In short: There will be two direct 1Gb network connections and one shared 1Gb connection. Will the server hold up? So, my questions are, will the default FreeBSD filesystem be fast enough? Are there any special settings I need to do during slice/partitioning? The files will be LARGE. :-) Samba will probably be ideal for the shared connection so users can browse the directories. Samba should be able to do this, right? Any other recommendations are very welcome. Thanks! Regards, Andreas W. Andersen ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
