Hi.
We found the Matlab program performance is slower when it runs through
Storm worker.
Does anyone have experience on this kind of issue?
Any suggest is appreciated.
Issue
1. Run Matlab java program from shell, 1000 tuples need 71 sec
2. Run Matlab java program through Storm cluster, 1000 tuples need
90~170sec,
Hardware
7 servers , 16 CPU cores, 128GB RAM, Redhat 6.5 (Santiago), Linux kernel
2.6.32-431.el6.x86_64
5 Server installed with zookeeper 3.4.5
6 Server installed with supervisor
1 server installed with Nimbus & UI
Software
Storm: 0.8.2
Matlab MCR: 2012b
Java: Oracle JDK 1.6.0_26 64-bit
Storm Topology configuration
topology.message.timeout.secs: 3000
topology.max.spout.pending: 192
worker.childopts: -Xmx2048m -Xms1024m
Config.TOPOLOGY_RECEIVER_BUFFER_SIZE: 8
TOPOLOGY_TRANSFER_BUFFER_SIZE: 32
TOPOLOGY_EXECUTOR_RECEIVE_BUFFER_SIZE: 16384
TOPOLOGY_EXECUTOR_SEND_BUFFER_SIZE: 16384
Best Regards!
shin-meei
---------------------------------------------------------------------------
TSMC PROPERTY
This email communication (and any attachments) is proprietary information
for the sole use of its
intended recipient. Any unauthorized review, use or distribution by anyone
other than the intended
recipient is strictly prohibited. If you are not the intended recipient,
please notify the sender by
replying to this email, and then delete this email and any copies of it
immediately. Thank you.
---------------------------------------------------------------------------
