Dear Maxim,
I did some tests today. Since two of my cluster nodes are not working
properly, I just test with single node, 2 nodes, and 4 nodes. Turns out I
was wrong about 4 nodes performance before, in retrospect, I think I set the
window size to be small when I did the 4nodes test. Anyway, the result I got
today is:
single node: 16 fps
2nodes: 10 fps
4nodes: 6 fps
I also found that in my test, DS compound doesn't improve overall
performance.
I tried to remove the compound by commenting out all the inputframe,
outframe lines in my config file. (I did remove the whole compound at first,
but found out I must set the range info for each node, otherwise the data
weren't distributed. )
The compound looks like this:
compound
{
channel "channel0"
buffer [ COLOR DEPTH ]
wall
{
bottom_left [ -.5 -.5 -.75 ]
bottom_right [ .5 -.5 -.75 ]
top_left [ -.5 .5 -.75 ]
}
compound
{
range [ 0 .25 ]
}
compound
{
channel "channel1"
range [ .25 .5 ]
#outputframe {}
}
compound
{
channel "channel2"
range [ .5 .75 ]
#outputframe {}
}
compound
{
channel "channel3"
range [ .75 1 ]
#outputframe {}
}
#inputframe { name "frame.channel1" }
#inputframe { name "frame.channel2" }
#inputframe { name "frame.channel3" }
}
The result is about 7fps. I believe the way I did the compound there are
still network transfers going around, just no final compositing. But I am
not sure how to disable all of the network traffic by editing the config
file. Please give more advice here. Thanks!!
JInghua
On Mon, Feb 16, 2009 at 10:22 AM, Jinghua Ge <[email protected]> wrote:
> Hi Maxim,
> These tests you suggested in your email really make a lot sense. I will try
> them today and hopefully find the bottleneck. Thanks so much!
>
> Jinghua
>
>
> On Mon, Feb 16, 2009 at 9:58 AM, Maxim Makhinya <[email protected]>wrote:
>
>>
>> Hello Jinghua,
>>
>>
>> That sound weird. Are you sure the problem is not with one of your
>> machines?
>> I think you should figure out first where is your performance
>> bottleneck, and
>> why this happens. You could try following and write back what you will
>> get:
>>
>> 1) remove all compositing paths, i.e. leave only rendering. As all
>> nodes will
>> render the same amount of data without compositing it should not
>> really
>> matter how many you use - 4 nodes for 1 Gb or 8 nodes for 2 Gb.
>> Speed
>> should remain roughly the same as there is no pictures transferred.
>>
>> 2) try to split config in to two independent parts - i.e. 4 nodes for
>> first
>> 1 Gb of data, another 4 nodes for second Gb, without final
>> compositing of
>> this two parts. Again, it should be symmetric and speed shouldn't
>> change
>> much.
>>
>> 3) if in the second path you will get your 10-12 fps, than just try to
>> combine
>> those results in one additional compositing on top.
>>
>>
>> Best regards,
>>
>> Makhinya Maxim
>>
>>
>> On Feb 16, 2009, at 4:01 PM, jinghua wrote:
>>
>> >
>> > Dear Stefan,
>> >
>> > I have tried Equalizer's eVolve volume renderer to render a
>> > 1kx1kx2k, ubyte
>> > volume over a remote 8-node cluster. I have changed the evolve code
>> > and
>> > shader to read in the original volume with one byte per voxel, and
>> > it all
>> > worked fine. My cluster has a Nvidia GeForce-9500 card with 1G
>> > memory on
>> > each node, and infiband private network among the nodes. I used
>> > direct send
>> > compound. Each node get 1kx1kx256 subvolume. Each node renders the
>> > 256M
>> > volume locally at 16-20fps. When I used 4nodes to render the 1G
>> > volume, the
>> > overall performance is about 10-12 fps. But when I used 8nodes to
>> > render the
>> > whole 2G volume, the frame rate drops down to 2fps. I have tried to
>> > use both
>> > DB and direct send compound, with ethernet and IB network, it's all
>> > very
>> > consistent 2fps performance. Are there something I can do to improve
>> > the
>> > performance? Thanks a lot!
>> >
>> > Jinghua http://n2.nabble.com/file/n2335264/test-8node.res.infi
>> > test-8node.res.infi
>> >
>> > Attached is my config file.
>> > --
>> > View this message in context:
>> http://n2.nabble.com/eVolve-render-2G-volume-on-8nodes-at-2fps-tp2335264p2335264.html
>> > Sent from the Equalizer - Parallel Rendering mailing list archive at
>> > Nabble.com.
>> >
>> >
>> > _______________________________________________
>> > eq-dev mailing list
>> > [email protected]
>> > http://www.equalizergraphics.com/cgi-bin/mailman/listinfo/eq-dev
>> > http://www.equalizergraphics.com
>> >
>>
>>
>> _______________________________________________
>> eq-dev mailing list
>> [email protected]
>> http://www.equalizergraphics.com/cgi-bin/mailman/listinfo/eq-dev
>> http://www.equalizergraphics.com
>>
>
>
>
> --
> Jinghua Ge, Ph.D
> Visualization Consultant, CCT
> 331 Frey Computing Services Center
> Louisiana State University
> Phone: (225) 578-7789
> Fax: (225) 334-2061
>
>
>
--
Jinghua Ge, Ph.D
Visualization Consultant, CCT
331 Frey Computing Services Center
Louisiana State University
Phone: (225) 578-7789
Fax: (225) 334-2061
_______________________________________________
eq-dev mailing list
[email protected]
http://www.equalizergraphics.com/cgi-bin/mailman/listinfo/eq-dev
http://www.equalizergraphics.com
