RE: GPU boxes
Hi All For those interested in Octane. Their GTC talk from earlier. https://www.periscope.tv/OTOY/1OyKAqQrYgOKb From: Angus Davidson [mailto:angus.david...@wits.ac.za] Sent: Tuesday, 05 April 2016 7:00 PM To: softimage@listproc.autodesk.com Subject: RE: GPU boxes The is also the amfeltec gpu cluster and the http://www.hwtools.net/Adapter/PE4C%20V3.0.html for the more do it yourself approach. We rendered our student short out using Octane standalone via the network between 3 machines and it positively flew. Some usbC external gpu chassis that are now coming out (announced at GDC). For my MA project I am extending our current machine (which has one 980ti) with two additional ones using PE4C adapters. (mostly because most of our available money was spent on the cards) I have seen cases running 4 air cooled 980tis in a well ventilated case with no issues. Water cooled does offer performance gains but as has been pointed out can be a bit of a bugger if you have a card go down. Kind regards Angus From: Matt Morris [mailto:matt...@gmail.com] Sent: Tuesday, 05 April 2016 3:47 PM To: softimage@listproc.autodesk.com<mailto:softimage@listproc.autodesk.com> Subject: Re: GPU boxes External gpu boxes work great with octane, not so well with redshift, due to the increased communication between cpu, gpu and system memory, it really needs a decent number of pcie 3 lanes to run at full speed. On 5 April 2016 at 13:46, Ognjen Vukovic <ognj...@gmail.com<mailto:ognj...@gmail.com>> wrote: Why doesn't someone start building these things directly in an air condition unit? That would make sense. And it would produce some pretty cool renders... On Tue, Apr 5, 2016 at 2:32 PM, Mirko Jankovic <mirkoj.anima...@gmail.com<mailto:mirkoj.anima...@gmail.com>> wrote: Yes but also need a bit more custom case so that placeholders for 4 radiators are near cards :))) On Tue, Apr 5, 2016 at 2:29 PM, Cristobal Infante <cgc...@gmail.com<mailto:cgc...@gmail.com>> wrote: The other option is to get some of this hybrid cards, with cooling included. There are more expensive, but I guess you won't melt them so easily ;) http://www.fudzilla.com/news/graphics/37369-evga-announces-new-gtx-980-hybrid-graphics-card https://www.instagram.com/p/BCPYR7DmAZp/ On 5 April 2016 at 13:18, Mirko Jankovic <mirkoj.anima...@gmail.com<mailto:mirkoj.anima...@gmail.com>> wrote: Also keep in mind that 8 GPU server requires also 2 Xeons which are lot more expensive then i7 CPUs. Put everything on paper and see the math. Btw I advise highly against water cooling cards for GPU. First it adds to a price a lot which would better be used on better GPUs, CPU, more ram Also in any case of card failure you are out of whole machine for hours till you drain system and all the process around it. With standard air cooled you just plug faulty card out and back to rendering till you replace or fix. On Tue, Apr 5, 2016 at 2:09 PM, Cristobal Infante <cgc...@gmail.com<mailto:cgc...@gmail.com>> wrote: Hi Adam, You 2 routes, DIY/MOD or getting a SERVER chassis (more expensive). SERVER https://www.youtube.com/watch?v=DhZJ66l82r8=youtu.be If you are any good at building/modding computers, than you can try buidling one yourself with the help of geeks from the internerds.. http://dabarti.com/vfx/building-4xgpu-rack-mount-rendering-node/ One other options is to ask someone like Tom Glimps to build you one: https://twitter.com/tomglimps/status/710959378799730688 This stuff is watercooled and cards are modded, so not trivial. I would recommend you could ask on the otoy forum, and join the octane facebook page. Good luck, and keep us updated! Cris On 5 April 2016 at 12:12, Mirko Jankovic <mirkoj.anima...@gmail.com<mailto:mirkoj.anima...@gmail.com>> wrote: Also not much experience with GPU boxes but what I don;t really get is what takes care of rendering with so many GPUs on single CPU? For example you have single 5960x CPU and 64GB ram. Even with 4 cards I've bin locking down CPU at 100% from time to time and also RAM as well. Talking about computer RAM not GPU RAM. As it works it renders 4 frames at once, each on 1 GPU. I really don;t see much room to add fro example another 4 GPUs in attached GPU box when there is still some work on CPU to be done and RAM requirements for scenes and all to load. How would high end CPU that is already maxed out handle additional load? On Tue, Apr 5, 2016 at 1:06 PM, Ognjen Vukovic <ognj...@gmail.com<mailto:ognj...@gmail.com>> wrote: I dont know much about the gpu boxes, but i would advise you to wait a bit for pascal to be released. I saw yesterday that amazon was doing clearances on "games" hardware so i presume it wont be long now as they seem to be clearing out the shelves. On Tue, Apr 5, 2016 at 1:00 PM, Adam Seeley <adammsee...@gmail.com<mailto:adammsee...@gmail.com>> wrote: Hi
RE: GPU boxes
The is also the amfeltec gpu cluster and the http://www.hwtools.net/Adapter/PE4C%20V3.0.html for the more do it yourself approach. We rendered our student short out using Octane standalone via the network between 3 machines and it positively flew. Some usbC external gpu chassis that are now coming out (announced at GDC). For my MA project I am extending our current machine (which has one 980ti) with two additional ones using PE4C adapters. (mostly because most of our available money was spent on the cards) I have seen cases running 4 air cooled 980tis in a well ventilated case with no issues. Water cooled does offer performance gains but as has been pointed out can be a bit of a bugger if you have a card go down. Kind regards Angus From: Matt Morris [mailto:matt...@gmail.com] Sent: Tuesday, 05 April 2016 3:47 PM To: softimage@listproc.autodesk.com Subject: Re: GPU boxes External gpu boxes work great with octane, not so well with redshift, due to the increased communication between cpu, gpu and system memory, it really needs a decent number of pcie 3 lanes to run at full speed. On 5 April 2016 at 13:46, Ognjen Vukovic <ognj...@gmail.com<mailto:ognj...@gmail.com>> wrote: Why doesn't someone start building these things directly in an air condition unit? That would make sense. And it would produce some pretty cool renders... On Tue, Apr 5, 2016 at 2:32 PM, Mirko Jankovic <mirkoj.anima...@gmail.com<mailto:mirkoj.anima...@gmail.com>> wrote: Yes but also need a bit more custom case so that placeholders for 4 radiators are near cards :))) On Tue, Apr 5, 2016 at 2:29 PM, Cristobal Infante <cgc...@gmail.com<mailto:cgc...@gmail.com>> wrote: The other option is to get some of this hybrid cards, with cooling included. There are more expensive, but I guess you won't melt them so easily ;) http://www.fudzilla.com/news/graphics/37369-evga-announces-new-gtx-980-hybrid-graphics-card https://www.instagram.com/p/BCPYR7DmAZp/ On 5 April 2016 at 13:18, Mirko Jankovic <mirkoj.anima...@gmail.com<mailto:mirkoj.anima...@gmail.com>> wrote: Also keep in mind that 8 GPU server requires also 2 Xeons which are lot more expensive then i7 CPUs. Put everything on paper and see the math. Btw I advise highly against water cooling cards for GPU. First it adds to a price a lot which would better be used on better GPUs, CPU, more ram Also in any case of card failure you are out of whole machine for hours till you drain system and all the process around it. With standard air cooled you just plug faulty card out and back to rendering till you replace or fix. On Tue, Apr 5, 2016 at 2:09 PM, Cristobal Infante <cgc...@gmail.com<mailto:cgc...@gmail.com>> wrote: Hi Adam, You 2 routes, DIY/MOD or getting a SERVER chassis (more expensive). SERVER https://www.youtube.com/watch?v=DhZJ66l82r8=youtu.be If you are any good at building/modding computers, than you can try buidling one yourself with the help of geeks from the internerds.. http://dabarti.com/vfx/building-4xgpu-rack-mount-rendering-node/ One other options is to ask someone like Tom Glimps to build you one: https://twitter.com/tomglimps/status/710959378799730688 This stuff is watercooled and cards are modded, so not trivial. I would recommend you could ask on the otoy forum, and join the octane facebook page. Good luck, and keep us updated! Cris On 5 April 2016 at 12:12, Mirko Jankovic <mirkoj.anima...@gmail.com<mailto:mirkoj.anima...@gmail.com>> wrote: Also not much experience with GPU boxes but what I don;t really get is what takes care of rendering with so many GPUs on single CPU? For example you have single 5960x CPU and 64GB ram. Even with 4 cards I've bin locking down CPU at 100% from time to time and also RAM as well. Talking about computer RAM not GPU RAM. As it works it renders 4 frames at once, each on 1 GPU. I really don;t see much room to add fro example another 4 GPUs in attached GPU box when there is still some work on CPU to be done and RAM requirements for scenes and all to load. How would high end CPU that is already maxed out handle additional load? On Tue, Apr 5, 2016 at 1:06 PM, Ognjen Vukovic <ognj...@gmail.com<mailto:ognj...@gmail.com>> wrote: I dont know much about the gpu boxes, but i would advise you to wait a bit for pascal to be released. I saw yesterday that amazon was doing clearances on "games" hardware so i presume it wont be long now as they seem to be clearing out the shelves. On Tue, Apr 5, 2016 at 1:00 PM, Adam Seeley <adammsee...@gmail.com<mailto:adammsee...@gmail.com>> wrote: Hi Softies/Blendies/Houdies etc. I was thinking about boosting Redshift render power a bit with a gtx980ti or two. Does anyone have experience with using external GPU boxes that can be plugged into their workstations? It seems like a cleaner, more scaleable and more flexible solution than stuffing the c
Re: GPU boxes
External gpu boxes work great with octane, not so well with redshift, due to the increased communication between cpu, gpu and system memory, it really needs a decent number of pcie 3 lanes to run at full speed. On 5 April 2016 at 13:46, Ognjen Vukovic <ognj...@gmail.com> wrote: > Why doesn't someone start building these things directly in an air > condition unit? That would make sense. And it would produce some pretty > cool renders... > > On Tue, Apr 5, 2016 at 2:32 PM, Mirko Jankovic <mirkoj.anima...@gmail.com> > wrote: > >> Yes but also need a bit more custom case so that placeholders for 4 >> radiators are near cards :))) >> >> On Tue, Apr 5, 2016 at 2:29 PM, Cristobal Infante <cgc...@gmail.com> >> wrote: >> >>> The other option is to get some of this hybrid cards, with cooling >>> included. There are more expensive, but I guess you won't melt them so >>> easily ;) >>> >>> >>> http://www.fudzilla.com/news/graphics/37369-evga-announces-new-gtx-980-hybrid-graphics-card >>> >>> https://www.instagram.com/p/BCPYR7DmAZp/ >>> >>> On 5 April 2016 at 13:18, Mirko Jankovic <mirkoj.anima...@gmail.com> >>> wrote: >>> >>>> Also keep in mind that 8 GPU server requires also 2 Xeons which are lot >>>> more expensive then i7 CPUs. >>>> Put everything on paper and see the math. >>>> >>>> Btw I advise highly against water cooling cards for GPU. >>>> First it adds to a price a lot which would better be used on better >>>> GPUs, CPU, more ram >>>> Also in any case of card failure you are out of whole machine for hours >>>> till you drain system and all the process around it. >>>> With standard air cooled you just plug faulty card out and back to >>>> rendering till you replace or fix. >>>> >>>> On Tue, Apr 5, 2016 at 2:09 PM, Cristobal Infante <cgc...@gmail.com> >>>> wrote: >>>> >>>>> Hi Adam, >>>>> >>>>> You 2 routes, DIY/MOD or getting a SERVER chassis (more expensive). >>>>> >>>>> SERVER >>>>> https://www.youtube.com/watch?v=DhZJ66l82r8=youtu.be >>>>> >>>>> If you are any good at building/modding computers, than you can try >>>>> buidling one yourself with the help of geeks from >>>>> the internerds.. >>>>> >>>>> http://dabarti.com/vfx/building-4xgpu-rack-mount-rendering-node/ >>>>> >>>>> One other options is to ask someone like Tom Glimps to build you one: >>>>> https://twitter.com/tomglimps/status/710959378799730688 >>>>> >>>>> This stuff is watercooled and cards are modded, so not trivial. >>>>> >>>>> I would recommend you could ask on the otoy forum, and join the octane >>>>> facebook page. >>>>> >>>>> Good luck, and keep us updated! >>>>> >>>>> Cris >>>>> >>>>> >>>>> >>>>> On 5 April 2016 at 12:12, Mirko Jankovic <mirkoj.anima...@gmail.com> >>>>> wrote: >>>>> >>>>>> Also not much experience with GPU boxes but what I don;t really get >>>>>> is what takes care of rendering with so many GPUs on single CPU? >>>>>> >>>>>> For example you have single 5960x CPU and 64GB ram. >>>>>> Even with 4 cards I've bin locking down CPU at 100% from time to time >>>>>> and also RAM as well. Talking about computer RAM not GPU RAM. >>>>>> As it works it renders 4 frames at once, each on 1 GPU. >>>>>> I really don;t see much room to add fro example another 4 GPUs in >>>>>> attached GPU box when there is still some work on CPU to be done and RAM >>>>>> requirements for scenes and all to load. >>>>>> How would high end CPU that is already maxed out handle additional >>>>>> load? >>>>>> >>>>>> On Tue, Apr 5, 2016 at 1:06 PM, Ognjen Vukovic <ognj...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> I dont know much about the gpu boxes, but i would advise you to wait >>>>>>> a bit for pascal to be released. I saw yesterday that amazon was doing >>>>>>> clearances on "games" hardware so i presume it wont be long now as they >>>>>>>
Re: GPU boxes
Why doesn't someone start building these things directly in an air condition unit? That would make sense. And it would produce some pretty cool renders... On Tue, Apr 5, 2016 at 2:32 PM, Mirko Jankovic <mirkoj.anima...@gmail.com> wrote: > Yes but also need a bit more custom case so that placeholders for 4 > radiators are near cards :))) > > On Tue, Apr 5, 2016 at 2:29 PM, Cristobal Infante <cgc...@gmail.com> > wrote: > >> The other option is to get some of this hybrid cards, with cooling >> included. There are more expensive, but I guess you won't melt them so >> easily ;) >> >> >> http://www.fudzilla.com/news/graphics/37369-evga-announces-new-gtx-980-hybrid-graphics-card >> >> https://www.instagram.com/p/BCPYR7DmAZp/ >> >> On 5 April 2016 at 13:18, Mirko Jankovic <mirkoj.anima...@gmail.com> >> wrote: >> >>> Also keep in mind that 8 GPU server requires also 2 Xeons which are lot >>> more expensive then i7 CPUs. >>> Put everything on paper and see the math. >>> >>> Btw I advise highly against water cooling cards for GPU. >>> First it adds to a price a lot which would better be used on better >>> GPUs, CPU, more ram >>> Also in any case of card failure you are out of whole machine for hours >>> till you drain system and all the process around it. >>> With standard air cooled you just plug faulty card out and back to >>> rendering till you replace or fix. >>> >>> On Tue, Apr 5, 2016 at 2:09 PM, Cristobal Infante <cgc...@gmail.com> >>> wrote: >>> >>>> Hi Adam, >>>> >>>> You 2 routes, DIY/MOD or getting a SERVER chassis (more expensive). >>>> >>>> SERVER >>>> https://www.youtube.com/watch?v=DhZJ66l82r8=youtu.be >>>> >>>> If you are any good at building/modding computers, than you can try >>>> buidling one yourself with the help of geeks from >>>> the internerds.. >>>> >>>> http://dabarti.com/vfx/building-4xgpu-rack-mount-rendering-node/ >>>> >>>> One other options is to ask someone like Tom Glimps to build you one: >>>> https://twitter.com/tomglimps/status/710959378799730688 >>>> >>>> This stuff is watercooled and cards are modded, so not trivial. >>>> >>>> I would recommend you could ask on the otoy forum, and join the octane >>>> facebook page. >>>> >>>> Good luck, and keep us updated! >>>> >>>> Cris >>>> >>>> >>>> >>>> On 5 April 2016 at 12:12, Mirko Jankovic <mirkoj.anima...@gmail.com> >>>> wrote: >>>> >>>>> Also not much experience with GPU boxes but what I don;t really get is >>>>> what takes care of rendering with so many GPUs on single CPU? >>>>> >>>>> For example you have single 5960x CPU and 64GB ram. >>>>> Even with 4 cards I've bin locking down CPU at 100% from time to time >>>>> and also RAM as well. Talking about computer RAM not GPU RAM. >>>>> As it works it renders 4 frames at once, each on 1 GPU. >>>>> I really don;t see much room to add fro example another 4 GPUs in >>>>> attached GPU box when there is still some work on CPU to be done and RAM >>>>> requirements for scenes and all to load. >>>>> How would high end CPU that is already maxed out handle additional >>>>> load? >>>>> >>>>> On Tue, Apr 5, 2016 at 1:06 PM, Ognjen Vukovic <ognj...@gmail.com> >>>>> wrote: >>>>> >>>>>> I dont know much about the gpu boxes, but i would advise you to wait >>>>>> a bit for pascal to be released. I saw yesterday that amazon was doing >>>>>> clearances on "games" hardware so i presume it wont be long now as they >>>>>> seem to be clearing out the shelves. >>>>>> >>>>>> On Tue, Apr 5, 2016 at 1:00 PM, Adam Seeley <adammsee...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Hi Softies/Blendies/Houdies etc. >>>>>>> >>>>>>> I was thinking about boosting Redshift render power a bit with a >>>>>>> gtx980ti or two. >>>>>>> >>>>>>> Does anyone have experience with using external GPU boxes that can >>>>>>> be plugged into their workstations? >>>>>>&
Re: GPU boxes
Yes but also need a bit more custom case so that placeholders for 4 radiators are near cards :))) On Tue, Apr 5, 2016 at 2:29 PM, Cristobal Infante <cgc...@gmail.com> wrote: > The other option is to get some of this hybrid cards, with cooling > included. There are more expensive, but I guess you won't melt them so > easily ;) > > > http://www.fudzilla.com/news/graphics/37369-evga-announces-new-gtx-980-hybrid-graphics-card > > https://www.instagram.com/p/BCPYR7DmAZp/ > > On 5 April 2016 at 13:18, Mirko Jankovic <mirkoj.anima...@gmail.com> > wrote: > >> Also keep in mind that 8 GPU server requires also 2 Xeons which are lot >> more expensive then i7 CPUs. >> Put everything on paper and see the math. >> >> Btw I advise highly against water cooling cards for GPU. >> First it adds to a price a lot which would better be used on better GPUs, >> CPU, more ram >> Also in any case of card failure you are out of whole machine for hours >> till you drain system and all the process around it. >> With standard air cooled you just plug faulty card out and back to >> rendering till you replace or fix. >> >> On Tue, Apr 5, 2016 at 2:09 PM, Cristobal Infante <cgc...@gmail.com> >> wrote: >> >>> Hi Adam, >>> >>> You 2 routes, DIY/MOD or getting a SERVER chassis (more expensive). >>> >>> SERVER >>> https://www.youtube.com/watch?v=DhZJ66l82r8=youtu.be >>> >>> If you are any good at building/modding computers, than you can try >>> buidling one yourself with the help of geeks from >>> the internerds.. >>> >>> http://dabarti.com/vfx/building-4xgpu-rack-mount-rendering-node/ >>> >>> One other options is to ask someone like Tom Glimps to build you one: >>> https://twitter.com/tomglimps/status/710959378799730688 >>> >>> This stuff is watercooled and cards are modded, so not trivial. >>> >>> I would recommend you could ask on the otoy forum, and join the octane >>> facebook page. >>> >>> Good luck, and keep us updated! >>> >>> Cris >>> >>> >>> >>> On 5 April 2016 at 12:12, Mirko Jankovic <mirkoj.anima...@gmail.com> >>> wrote: >>> >>>> Also not much experience with GPU boxes but what I don;t really get is >>>> what takes care of rendering with so many GPUs on single CPU? >>>> >>>> For example you have single 5960x CPU and 64GB ram. >>>> Even with 4 cards I've bin locking down CPU at 100% from time to time >>>> and also RAM as well. Talking about computer RAM not GPU RAM. >>>> As it works it renders 4 frames at once, each on 1 GPU. >>>> I really don;t see much room to add fro example another 4 GPUs in >>>> attached GPU box when there is still some work on CPU to be done and RAM >>>> requirements for scenes and all to load. >>>> How would high end CPU that is already maxed out handle additional load? >>>> >>>> On Tue, Apr 5, 2016 at 1:06 PM, Ognjen Vukovic <ognj...@gmail.com> >>>> wrote: >>>> >>>>> I dont know much about the gpu boxes, but i would advise you to wait a >>>>> bit for pascal to be released. I saw yesterday that amazon was doing >>>>> clearances on "games" hardware so i presume it wont be long now as they >>>>> seem to be clearing out the shelves. >>>>> >>>>> On Tue, Apr 5, 2016 at 1:00 PM, Adam Seeley <adammsee...@gmail.com> >>>>> wrote: >>>>> >>>>>> Hi Softies/Blendies/Houdies etc. >>>>>> >>>>>> I was thinking about boosting Redshift render power a bit with a >>>>>> gtx980ti or two. >>>>>> >>>>>> Does anyone have experience with using external GPU boxes that can be >>>>>> plugged into their workstations? >>>>>> >>>>>> It seems like a cleaner, more scaleable and more flexible solution >>>>>> than stuffing the cards right into the workstation itself. >>>>>> >>>>>> Any recommendations or advice gratefully received. >>>>>> >>>>>> Cheers, >>>>>> >>>>>> Adam. >>>>>> _ >>>>>> Adam Seeley >>>>>> Love Vfx Ltd. >>>>>> www.LoveVfx.co.uk <http://www.lovevfx.co.uk/> >>>>>> www.linkedin.com/in/adamseeley
Re: GPU boxes
The other option is to get some of this hybrid cards, with cooling included. There are more expensive, but I guess you won't melt them so easily ;) http://www.fudzilla.com/news/graphics/37369-evga-announces-new-gtx-980-hybrid-graphics-card https://www.instagram.com/p/BCPYR7DmAZp/ On 5 April 2016 at 13:18, Mirko Jankovic <mirkoj.anima...@gmail.com> wrote: > Also keep in mind that 8 GPU server requires also 2 Xeons which are lot > more expensive then i7 CPUs. > Put everything on paper and see the math. > > Btw I advise highly against water cooling cards for GPU. > First it adds to a price a lot which would better be used on better GPUs, > CPU, more ram > Also in any case of card failure you are out of whole machine for hours > till you drain system and all the process around it. > With standard air cooled you just plug faulty card out and back to > rendering till you replace or fix. > > On Tue, Apr 5, 2016 at 2:09 PM, Cristobal Infante <cgc...@gmail.com> > wrote: > >> Hi Adam, >> >> You 2 routes, DIY/MOD or getting a SERVER chassis (more expensive). >> >> SERVER >> https://www.youtube.com/watch?v=DhZJ66l82r8=youtu.be >> >> If you are any good at building/modding computers, than you can try >> buidling one yourself with the help of geeks from >> the internerds.. >> >> http://dabarti.com/vfx/building-4xgpu-rack-mount-rendering-node/ >> >> One other options is to ask someone like Tom Glimps to build you one: >> https://twitter.com/tomglimps/status/710959378799730688 >> >> This stuff is watercooled and cards are modded, so not trivial. >> >> I would recommend you could ask on the otoy forum, and join the octane >> facebook page. >> >> Good luck, and keep us updated! >> >> Cris >> >> >> >> On 5 April 2016 at 12:12, Mirko Jankovic <mirkoj.anima...@gmail.com> >> wrote: >> >>> Also not much experience with GPU boxes but what I don;t really get is >>> what takes care of rendering with so many GPUs on single CPU? >>> >>> For example you have single 5960x CPU and 64GB ram. >>> Even with 4 cards I've bin locking down CPU at 100% from time to time >>> and also RAM as well. Talking about computer RAM not GPU RAM. >>> As it works it renders 4 frames at once, each on 1 GPU. >>> I really don;t see much room to add fro example another 4 GPUs in >>> attached GPU box when there is still some work on CPU to be done and RAM >>> requirements for scenes and all to load. >>> How would high end CPU that is already maxed out handle additional load? >>> >>> On Tue, Apr 5, 2016 at 1:06 PM, Ognjen Vukovic <ognj...@gmail.com> >>> wrote: >>> >>>> I dont know much about the gpu boxes, but i would advise you to wait a >>>> bit for pascal to be released. I saw yesterday that amazon was doing >>>> clearances on "games" hardware so i presume it wont be long now as they >>>> seem to be clearing out the shelves. >>>> >>>> On Tue, Apr 5, 2016 at 1:00 PM, Adam Seeley <adammsee...@gmail.com> >>>> wrote: >>>> >>>>> Hi Softies/Blendies/Houdies etc. >>>>> >>>>> I was thinking about boosting Redshift render power a bit with a >>>>> gtx980ti or two. >>>>> >>>>> Does anyone have experience with using external GPU boxes that can be >>>>> plugged into their workstations? >>>>> >>>>> It seems like a cleaner, more scaleable and more flexible solution >>>>> than stuffing the cards right into the workstation itself. >>>>> >>>>> Any recommendations or advice gratefully received. >>>>> >>>>> Cheers, >>>>> >>>>> Adam. >>>>> _ >>>>> Adam Seeley >>>>> Love Vfx Ltd. >>>>> www.LoveVfx.co.uk <http://www.lovevfx.co.uk/> >>>>> www.linkedin.com/in/adamseeleyuk >>>>> www.vimeo.com/adamseeley <https://vimeo.com/adamseeley> >>>>> >>>>> -- >>>>> Softimage Mailing List. >>>>> To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com >>>>> with "unsubscribe" in the subject, and reply to confirm. >>>>> >>>> >>>> >>>> -- >>>> Softimage Mailing List. >>>> To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com >>>> wi
Re: GPU boxes
Also keep in mind that 8 GPU server requires also 2 Xeons which are lot more expensive then i7 CPUs. Put everything on paper and see the math. Btw I advise highly against water cooling cards for GPU. First it adds to a price a lot which would better be used on better GPUs, CPU, more ram Also in any case of card failure you are out of whole machine for hours till you drain system and all the process around it. With standard air cooled you just plug faulty card out and back to rendering till you replace or fix. On Tue, Apr 5, 2016 at 2:09 PM, Cristobal Infante <cgc...@gmail.com> wrote: > Hi Adam, > > You 2 routes, DIY/MOD or getting a SERVER chassis (more expensive). > > SERVER > https://www.youtube.com/watch?v=DhZJ66l82r8=youtu.be > > If you are any good at building/modding computers, than you can try > buidling one yourself with the help of geeks from > the internerds.. > > http://dabarti.com/vfx/building-4xgpu-rack-mount-rendering-node/ > > One other options is to ask someone like Tom Glimps to build you one: > https://twitter.com/tomglimps/status/710959378799730688 > > This stuff is watercooled and cards are modded, so not trivial. > > I would recommend you could ask on the otoy forum, and join the octane > facebook page. > > Good luck, and keep us updated! > > Cris > > > > On 5 April 2016 at 12:12, Mirko Jankovic <mirkoj.anima...@gmail.com> > wrote: > >> Also not much experience with GPU boxes but what I don;t really get is >> what takes care of rendering with so many GPUs on single CPU? >> >> For example you have single 5960x CPU and 64GB ram. >> Even with 4 cards I've bin locking down CPU at 100% from time to time and >> also RAM as well. Talking about computer RAM not GPU RAM. >> As it works it renders 4 frames at once, each on 1 GPU. >> I really don;t see much room to add fro example another 4 GPUs in >> attached GPU box when there is still some work on CPU to be done and RAM >> requirements for scenes and all to load. >> How would high end CPU that is already maxed out handle additional load? >> >> On Tue, Apr 5, 2016 at 1:06 PM, Ognjen Vukovic <ognj...@gmail.com> wrote: >> >>> I dont know much about the gpu boxes, but i would advise you to wait a >>> bit for pascal to be released. I saw yesterday that amazon was doing >>> clearances on "games" hardware so i presume it wont be long now as they >>> seem to be clearing out the shelves. >>> >>> On Tue, Apr 5, 2016 at 1:00 PM, Adam Seeley <adammsee...@gmail.com> >>> wrote: >>> >>>> Hi Softies/Blendies/Houdies etc. >>>> >>>> I was thinking about boosting Redshift render power a bit with a >>>> gtx980ti or two. >>>> >>>> Does anyone have experience with using external GPU boxes that can be >>>> plugged into their workstations? >>>> >>>> It seems like a cleaner, more scaleable and more flexible solution than >>>> stuffing the cards right into the workstation itself. >>>> >>>> Any recommendations or advice gratefully received. >>>> >>>> Cheers, >>>> >>>> Adam. >>>> _ >>>> Adam Seeley >>>> Love Vfx Ltd. >>>> www.LoveVfx.co.uk <http://www.lovevfx.co.uk/> >>>> www.linkedin.com/in/adamseeleyuk >>>> www.vimeo.com/adamseeley <https://vimeo.com/adamseeley> >>>> >>>> -- >>>> Softimage Mailing List. >>>> To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com >>>> with "unsubscribe" in the subject, and reply to confirm. >>>> >>> >>> >>> -- >>> Softimage Mailing List. >>> To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com >>> with "unsubscribe" in the subject, and reply to confirm. >>> >> >> >> >> -- >> Mirko Jankovic >> skype: mirko-jankovic >> https://vimeo.com/mirkoj >> >> Need some help with rendering an Redshift project? >> http://www.gpuoven.com/ >> >> -- >> Softimage Mailing List. >> To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com >> with "unsubscribe" in the subject, and reply to confirm. >> > > > -- > Softimage Mailing List. > To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com > with "unsubscribe" in the subject, and reply to confirm. > -- Mirko Jankovic skype: mirko-jankovic https://vimeo.com/mirkoj Need some help with rendering an Redshift project? http://www.gpuoven.com/ -- Softimage Mailing List. To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com with "unsubscribe" in the subject, and reply to confirm.
Re: GPU boxes
Hi Adam, You 2 routes, DIY/MOD or getting a SERVER chassis (more expensive). SERVER https://www.youtube.com/watch?v=DhZJ66l82r8=youtu.be If you are any good at building/modding computers, than you can try buidling one yourself with the help of geeks from the internerds.. http://dabarti.com/vfx/building-4xgpu-rack-mount-rendering-node/ One other options is to ask someone like Tom Glimps to build you one: https://twitter.com/tomglimps/status/710959378799730688 This stuff is watercooled and cards are modded, so not trivial. I would recommend you could ask on the otoy forum, and join the octane facebook page. Good luck, and keep us updated! Cris On 5 April 2016 at 12:12, Mirko Jankovic <mirkoj.anima...@gmail.com> wrote: > Also not much experience with GPU boxes but what I don;t really get is > what takes care of rendering with so many GPUs on single CPU? > > For example you have single 5960x CPU and 64GB ram. > Even with 4 cards I've bin locking down CPU at 100% from time to time and > also RAM as well. Talking about computer RAM not GPU RAM. > As it works it renders 4 frames at once, each on 1 GPU. > I really don;t see much room to add fro example another 4 GPUs in attached > GPU box when there is still some work on CPU to be done and RAM > requirements for scenes and all to load. > How would high end CPU that is already maxed out handle additional load? > > On Tue, Apr 5, 2016 at 1:06 PM, Ognjen Vukovic <ognj...@gmail.com> wrote: > >> I dont know much about the gpu boxes, but i would advise you to wait a >> bit for pascal to be released. I saw yesterday that amazon was doing >> clearances on "games" hardware so i presume it wont be long now as they >> seem to be clearing out the shelves. >> >> On Tue, Apr 5, 2016 at 1:00 PM, Adam Seeley <adammsee...@gmail.com> >> wrote: >> >>> Hi Softies/Blendies/Houdies etc. >>> >>> I was thinking about boosting Redshift render power a bit with a >>> gtx980ti or two. >>> >>> Does anyone have experience with using external GPU boxes that can be >>> plugged into their workstations? >>> >>> It seems like a cleaner, more scaleable and more flexible solution than >>> stuffing the cards right into the workstation itself. >>> >>> Any recommendations or advice gratefully received. >>> >>> Cheers, >>> >>> Adam. >>> _ >>> Adam Seeley >>> Love Vfx Ltd. >>> www.LoveVfx.co.uk <http://www.lovevfx.co.uk/> >>> www.linkedin.com/in/adamseeleyuk >>> www.vimeo.com/adamseeley <https://vimeo.com/adamseeley> >>> >>> -- >>> Softimage Mailing List. >>> To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com >>> with "unsubscribe" in the subject, and reply to confirm. >>> >> >> >> -- >> Softimage Mailing List. >> To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com >> with "unsubscribe" in the subject, and reply to confirm. >> > > > > -- > Mirko Jankovic > skype: mirko-jankovic > https://vimeo.com/mirkoj > > Need some help with rendering an Redshift project? > http://www.gpuoven.com/ > > -- > Softimage Mailing List. > To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com > with "unsubscribe" in the subject, and reply to confirm. > -- Softimage Mailing List. To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com with "unsubscribe" in the subject, and reply to confirm.
Re: GPU boxes
Also not much experience with GPU boxes but what I don;t really get is what takes care of rendering with so many GPUs on single CPU? For example you have single 5960x CPU and 64GB ram. Even with 4 cards I've bin locking down CPU at 100% from time to time and also RAM as well. Talking about computer RAM not GPU RAM. As it works it renders 4 frames at once, each on 1 GPU. I really don;t see much room to add fro example another 4 GPUs in attached GPU box when there is still some work on CPU to be done and RAM requirements for scenes and all to load. How would high end CPU that is already maxed out handle additional load? On Tue, Apr 5, 2016 at 1:06 PM, Ognjen Vukovic <ognj...@gmail.com> wrote: > I dont know much about the gpu boxes, but i would advise you to wait a bit > for pascal to be released. I saw yesterday that amazon was doing clearances > on "games" hardware so i presume it wont be long now as they seem to be > clearing out the shelves. > > On Tue, Apr 5, 2016 at 1:00 PM, Adam Seeley <adammsee...@gmail.com> wrote: > >> Hi Softies/Blendies/Houdies etc. >> >> I was thinking about boosting Redshift render power a bit with a gtx980ti >> or two. >> >> Does anyone have experience with using external GPU boxes that can be >> plugged into their workstations? >> >> It seems like a cleaner, more scaleable and more flexible solution than >> stuffing the cards right into the workstation itself. >> >> Any recommendations or advice gratefully received. >> >> Cheers, >> >> Adam. >> _ >> Adam Seeley >> Love Vfx Ltd. >> www.LoveVfx.co.uk <http://www.lovevfx.co.uk/> >> www.linkedin.com/in/adamseeleyuk >> www.vimeo.com/adamseeley <https://vimeo.com/adamseeley> >> >> -- >> Softimage Mailing List. >> To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com >> with "unsubscribe" in the subject, and reply to confirm. >> > > > -- > Softimage Mailing List. > To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com > with "unsubscribe" in the subject, and reply to confirm. > -- Mirko Jankovic skype: mirko-jankovic https://vimeo.com/mirkoj Need some help with rendering an Redshift project? http://www.gpuoven.com/ -- Softimage Mailing List. To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com with "unsubscribe" in the subject, and reply to confirm.
Re: GPU boxes
I dont know much about the gpu boxes, but i would advise you to wait a bit for pascal to be released. I saw yesterday that amazon was doing clearances on "games" hardware so i presume it wont be long now as they seem to be clearing out the shelves. On Tue, Apr 5, 2016 at 1:00 PM, Adam Seeley <adammsee...@gmail.com> wrote: > Hi Softies/Blendies/Houdies etc. > > I was thinking about boosting Redshift render power a bit with a gtx980ti > or two. > > Does anyone have experience with using external GPU boxes that can be > plugged into their workstations? > > It seems like a cleaner, more scaleable and more flexible solution than > stuffing the cards right into the workstation itself. > > Any recommendations or advice gratefully received. > > Cheers, > > Adam. > _ > Adam Seeley > Love Vfx Ltd. > www.LoveVfx.co.uk <http://www.lovevfx.co.uk/> > www.linkedin.com/in/adamseeleyuk > www.vimeo.com/adamseeley <https://vimeo.com/adamseeley> > > -- > Softimage Mailing List. > To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com > with "unsubscribe" in the subject, and reply to confirm. > -- Softimage Mailing List. To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com with "unsubscribe" in the subject, and reply to confirm.
GPU boxes
Hi Softies/Blendies/Houdies etc. I was thinking about boosting Redshift render power a bit with a gtx980ti or two. Does anyone have experience with using external GPU boxes that can be plugged into their workstations? It seems like a cleaner, more scaleable and more flexible solution than stuffing the cards right into the workstation itself. Any recommendations or advice gratefully received. Cheers, Adam. _ Adam Seeley Love Vfx Ltd. www.LoveVfx.co.uk <http://www.lovevfx.co.uk/> www.linkedin.com/in/adamseeleyuk www.vimeo.com/adamseeley <https://vimeo.com/adamseeley> -- Softimage Mailing List. To unsubscribe, send a mail to softimage-requ...@listproc.autodesk.com with "unsubscribe" in the subject, and reply to confirm.
