Hi Li Li, MPI is included in our schedule for v0.3 https://issues.apache.org/jira/browse/SINGA-133. Please stay tuned, or join us to implement this ticket.
Zookeeper is important for distributed training, as it keeps running data for failure recovery. Best, Wei On Mon, Jan 18, 2016 at 4:56 PM, Li Li <[email protected]> wrote: > I have access to a HPC cluster with hundreds of nodes with thousands > cores. I found there are many deep learning framework can train using > multiple gpu in a single node. very few frameworks can train in > multiple nodes using gpu. Is there any framework can train with MPI? I > can't install long run service like zookeeper or spark in the cluster. >
