That's really awesome Tim thanks a lot !  \o/  Hurray ! :))

Yes windows is here only for convenience and on this PC I use ubuntu only for editing vidéo, sound and graphics. I have another smaller PC for everyday use.

After editing, I transfer the hole project to an external drive. Keep there for some time and delete after.

I will only put 200 for RAID 10 instead of 250 and 100 for RAID 0 instead of 50 I think this will be enough. And I'll come back to tell how it works :))

I found these two videos which shows how to install an ubuntu on RAID0 with an alternate CD.

Well It's not the same thing because I will install ubuntu on separate drive and only home on RAID10 but it will certainly help to partition 2 300 Gig SAS disques and assign the partitions during the installation.

If that helps to anyone here are the links.

http://www.youtube.com/watch?v=-x2rZe2Z9as  (Part 1)

http://www.youtube.com/watch?feature=endscreen&NR=1&v=_rpHqFPglz0  (part 2)


It's great to be wiyh you guys here !

Thanks to Tim and others who cared about this.

Haldun


Le 03/05/2012 20:33, Tim Copeland a écrit :
When you say ATA I am assuming SATA. A quick note for those with PATA (IDE) drives. In order to get proper performance
out of any given RAID set, every drive in that array must be on a separate IDE channel. i.e.. you should not have 2 drives
attached to the same IDE cable and be in the same array.

Also no matter how many drives you place in an array, and no matter how fast those drives are, maximum IO throughput
is still limited by maximum system bus speed.

Another thing I need to point out. Linux supports partition level RAID. This means you don't need to configure the entire
drive to be part of a single array. You can have each partition on a disk assigned to a different array and/or none at all.

The short answer to your question is, yes, your suggested setup could work as you describe.

I don't know any thing about your work flow or the scale of the projects you have planned.
Creating a RAID 0 from 2 300 Gig drives would give you just under 600 Gig of space. That is a huge amount of space
to simply use as a temporary work area. It also sounds to me like all your work will be done in Linux, and the only reason
you keep Windows around is for convenience. If that is the case, I would not worry about backing up any window stuff. If
you do use Windows for work and need to backup its data you'll need a solution outside of this suggestion.

Here is what I would do with the hardware you describe.

Partition the 500 Gig ATA drive into 3 partitions.
100 G , 100 G , 300 G
Install windows to the first 100 G partition
Install Linux to the next 100 G
Use the 300 G as backup space

partition both SAS drives
2 G , 250 G , 50 G ( or what ever space remains )
set the 2 Gig partitions as swap ( make sure to set the same pri= in fstab )
assign both the 250 G to a RAID 10 and set that to mount as  /home with ext 4 file system type
assign both the 50 G to a RAID 0 to use as temporary high performance /work space

Then configure your backup solution to backup the /home to the 300 G partition on the ATA drive.

That would give you this.

Windows = 100 Gig
Linux       = 100 Gig
swap       = 4 Gig
/home     < 250 Gig - ALL important data lives here
/work       ~ 100 Gig - do not store here just use for high speed IO then copy to /home when done
backup    = 300 Gig - since /home is RAID 10 backing up here means you would have 3 copies of important data

This would keep your data relatively safe and give you the performance you seek.
Unless you are working with massive files, this setup should last you a good while before needing
to add more drives. I hope this helps.



On Thu, 2012-05-03 at 13:20 +0200, Haldun ALTAN wrote:
Very much thank you Tim,

For your time and knowledge about RAID.

Your information came out at the same moment I was going to ask a question before I begin my RAID experience.

My configuration is 2 SAS 300Go disks and a 500 Go ATA drive which I use for storage. On one SAS I have windows 7 (I use rarely) and on the other Ubuntu Studio 10,04 which I will up grade to 12,04

I was planning to partition the 500 Go on two to installe Ubuntu and Windows 7 and use two SAS 300 Go as RAID 0 for quick projects and back-up on an external drive or another disk ATA. Further when I can buy some more SAS hard drives i will try RAID 10 which seems the best configuration.

Can this plan work ? I mean can I have my OS on a ATA drive and use two SAS drives for the temporary work on RAID ? if yes I will begin the experience and find out how to do it with ubuntu.

Thanks a lot.

Haldun.


Le 02/05/2012 19:59, Tim Copeland a écrit :
Unless you are planning on spending many hundreds if not thousands of dollars on RAID hardware,
then you should simply use Linux RAID. My personal experience matches what others have documented
around the web. Linux RAID is not only more flexible, but substantially faster than commodity controller
cards. Not only that, but in some cases Linux RAID is on par with the performance of the expensive hardware
solutions.

Chances are good that 99.999% of the readers following this, should only be considering RAID levels 0 or 1 or 10.
Other RAID levels have their places in corporate environments, but are little use to normal users. For instance,
RAID 10 on 4 drives gives better performance and protection than RAID 5 on those same 4 drives. The reason
corporate environments use RAID 5 is because it scales well for those environments.

This may be old hat for many readers, but for those new to RAID.
0 = some times referred to as "Striped" . Very fast performance , storage capacity is slightly less than the sum total.
    Very dangerous because a single drive failure will cause total loss of all data.

1 = mirrored data is duplicated across all drives or partitions. The IO performance is the same as if using just one of those drives.
    Total storage capacity is slightly less than the size of a single drive or partition.
    Much safer because complete copies of the data exist, and data is safe if a single drive failure occurs.

10 = This combines both 1 and 0 together. This gives the speed and performance of 0 with the redundancy of 1.
    Total storage capacity is less than the size of a single drive or partition.
    Much safer because complete copies of the data exist, and data is safe if a single drive failure occurs.

I cant stress enough.
Unless you only want to use RAID 0 as a high performance temporary work space, I would recommend RAID 10.
In addition, I still recommend having a solid off site backup solution in place. This protects your data from lightning,
falling trees, flood, and theft. The list goes on ...




On Wed, 2012-05-02 at 09:12 +0200, Haldun ALTAN wrote:
I looked for XFS file system mine is ext 4. I have to make some more readings to understand the how to.

I checked for Raid enterprise. Is that about are the Intel solutions ? Is that means separated hardware solution.

Thanks,
Haldun.

Le 02/05/2012 00:49, E Chalaron a écrit :
Well,

Raid 0 is fast especially on XFS filesystem... You will see the difference.
However... If one disk packs up... that's it...
As for me it is not a problem : data are not supposed to stay, I grab frames, process, export then delete.
And if trouble happens : I rescan. Yes a pain but not dramatic.

Counterpart of XFS :  it gets fragmented. So you need to look after that.
There is a lot of tools for XFS.

http://www.linuxquestions.org/questions/linux-general-1/my-own-xfs-jfs-ext3-benchmark-809670/

Maybe a redundant array on XFS liek Raid 5 or 10 as suggested. But get your Os on a separate drive.
That will save you some big problems if a disk goes wrong.

More important than speed, I found that Raid enterprise edition of drives are way better.


Cheers
E


On 05/01/2012 11:27 PM, Haldun ALTAN wrote:
Thanks Edouard
No not yet. I thought 10 000 tours and SAS will be enough. And I hesitate between RAID 0 or 5 don't know exactly which one will be better ...

Thanks a lot.
Haldun

Le 01/05/2012 02:50, E Chalaron a écrit :
Haldun
Did you set up your 2 drives as Raid 0, you may well have a bottle neck there if not.
Careful that you may need a dedicated drive for your OS.

cheers
Edouard


On 04/28/2012 04:28 AM, Haldun ALTAN wrote:
Another great bunch of thanks to Rafealla and her grandma's advises without which i couldn't make the last work where DNxHD was not fluid enough. So i did it with proxy editing and that was great. I could use 6-7 video channels without any problème and render with DNxHD version on mjpega to get HD with handbrake.

Anyway proxy is great even if you have to do everything twice at tjhe end you earn a lot of time when you're editing.

in fact I don't understand why it's so slow. I bought recently a second hand PC with two xeon 5460 3,1 ghz 4 cwith 6 go ram and nvdia quadro  fx4600 and two hard drive sas 10000 tours with 300 go each.
cpu is working 100% memory is saturated at 6 Gio

Tell me just if it's normal that i have to wait 6 minutes for 1 min vidéo on  background rendering with jpeg quality at 20 % ?

Thanks

Haldun. _______________________________________________ Cinelerra mailing list [email protected] https://init.linpro.no/mailman/skolelinux.no/listinfo/cinelerra
_______________________________________________ Cinelerra mailing list [email protected] https://init.linpro.no/mailman/skolelinux.no/listinfo/cinelerra
_______________________________________________ Cinelerra mailing list [email protected] https://init.linpro.no/mailman/skolelinux.no/listinfo/cinelerra

_______________________________________________ Cinelerra mailing list [email protected] https://init.linpro.no/mailman/skolelinux.no/listinfo/cinelerra

_______________________________________________ Cinelerra mailing list [email protected] https://init.linpro.no/mailman/skolelinux.no/listinfo/cinelerra

Reply via email to