svn commit: r1678280 - /incubator/singa/site/trunk/lib/path.pm

2015-05-07 Thread wangsh
Author: wangsh Date: Fri May 8 03:33:10 2015 New Revision: 1678280 URL: http://svn.apache.org/r1678280 Log: test to trigger cms site build Modified: incubator/singa/site/trunk/lib/path.pm Modified: incubator/singa/site/trunk/lib/path.pm URL: http://svn.apache.org/viewvc/incubator/singa

svn commit: r1679502 - /incubator/singa/site/trunk/content/markdown/community/contribute-docs.md

2015-05-15 Thread wangsh
Author: wangsh Date: Fri May 15 06:40:05 2015 New Revision: 1679502 URL: http://svn.apache.org/r1679502 Log: add video tutorial links for using CMS Modified: incubator/singa/site/trunk/content/markdown/community/contribute-docs.md Modified: incubator/singa/site/trunk/content/markdown

svn commit: r1679328 - in /incubator/singa/site/trunk: ./ content/ content/markdown/ content/markdown/community/

2015-05-14 Thread wangsh
Author: wangsh Date: Thu May 14 09:17:15 2015 New Revision: 1679328 URL: http://svn.apache.org/r1679328 Log: add community information Added: incubator/singa/site/trunk/content/markdown/community/ incubator/singa/site/trunk/content/markdown/community/issue-tracking.md incubator/singa

svn commit: r1678942 - in /incubator/singa/site/trunk/content: resources/images/singa-title.png site.xml

2015-05-12 Thread wangsh
Author: wangsh Date: Tue May 12 13:25:10 2015 New Revision: 1678942 URL: http://svn.apache.org/r1678942 Log: adjust title size Modified: incubator/singa/site/trunk/content/resources/images/singa-title.png incubator/singa/site/trunk/content/site.xml Modified: incubator/singa/site/trunk

incubator-singa git commit: ensure the callback function used in ZKClusterRT.sWatchGroup cannot be NULL

2015-06-10 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 6bc4d - 56fe4b85b ensure the callback function used in ZKClusterRT.sWatchGroup cannot be NULL Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[1/3] incubator-singa git commit: SINGA-19 Slice large Param objects for load-balance Tested with single worker, two worker group and two worker groups TODO test with multiple servers and server group

2015-06-23 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 2bbed5fc1 - 56d32e8a0 SINGA-19 Slice large Param objects for load-balance Tested with single worker, two worker group and two worker groups TODO test with multiple servers and server groups for distributed hogwild and allreduce.

[6/6] incubator-singa git commit: SINGA-8 Implement distributed Hogwild

2015-06-25 Thread wangsh
SINGA-8 Implement distributed Hogwild handle zookeeper disconnection. change zookeeper log level to ERROR. close #14 Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/c51f9264 Tree:

[1/6] incubator-singa git commit: fixbugs; todo wait master to merge feature-sliceparam

2015-06-25 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master a0199588c - c51f9264b fixbugs; todo wait master to merge feature-sliceparam Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/ad13d038

[5/6] incubator-singa git commit: SINGA-8 Implement distributed Hogwild

2015-06-25 Thread wangsh
SINGA-8 Implement distributed Hogwild Fixbug from parameter synchronization among server groups. Interprocs dealer cannot send messages to other process if the endpoint is hostname, e.g., blob-pc. Replaced hostname to host IP in binding/connecting endpoint. But the GetHostIP method is specific

[3/6] incubator-singa git commit: SINGA-8 Implement distributed Hogwild Have replaced hard-code enpoints with RegistPocs() and GetProcHost() implemented with the help of zookeeper. TODO slice large Pa

2015-06-25 Thread wangsh
SINGA-8 Implement distributed Hogwild Have replaced hard-code enpoints with RegistPocs() and GetProcHost() implemented with the help of zookeeper. TODO slice large Param objects in a separate branch. Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[1/2] incubator-singa git commit: SINGA-25 - Setup glog output path

2015-06-27 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 14ce5d9ae - f234c4972 SINGA-25 - Setup glog output path Set the output files of glog to workspace/glog. Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[1/2] incubator-singa git commit: SINGA-15 Fixg a bug from ConnectStub function which gets stuck for connecting layer_dealer_

2015-06-16 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 280d5d6be - 6019905e7 SINGA-15 Fixg a bug from ConnectStub function which gets stuck for connecting layer_dealer_ Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[02/10] incubator-singa git commit: implement shared memory hogwild. update param at worker side

2015-06-15 Thread wangsh
http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/806826eb/src/proto/model.pb.h -- diff --git a/src/proto/model.pb.h b/src/proto/model.pb.h index 6f1dc1d..9ac1e54 100644 --- a/src/proto/model.pb.h +++

[06/10] incubator-singa git commit: SINGA-7 Implement shared memory Hogwild algorithm

2015-06-15 Thread wangsh
http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/d5f9b9cd/src/proto/model.pb.h -- diff --git a/src/proto/model.pb.h b/src/proto/model.pb.h deleted file mode 100644 index 9ac1e54..000 --- a/src/proto/model.pb.h +++

[03/10] incubator-singa git commit: implement shared memory hogwild. update param at worker side

2015-06-15 Thread wangsh
implement shared memory hogwild. update param at worker side Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/806826eb Tree: http://git-wip-us.apache.org/repos/asf/incubator-singa/tree/806826eb Diff:

[09/10] incubator-singa git commit: SINGA-7 Implement shared memory Hogwild algorithm

2015-06-15 Thread wangsh
SINGA-7 Implement shared memory Hogwild algorithm add .conf files Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/bd87c7a5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-singa/tree/bd87c7a5 Diff:

[4/4] incubator-singa git commit: Merge branch 'SINGA-17'

2015-06-18 Thread wangsh
Merge branch 'SINGA-17' Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/81f7a12e Tree: http://git-wip-us.apache.org/repos/asf/incubator-singa/tree/81f7a12e Diff:

[2/4] incubator-singa git commit: support installing czmq in default path while zeromq library path is specified

2015-06-18 Thread wangsh
support installing czmq in default path while zeromq library path is specified Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/69cf6cbd Tree:

[1/4] incubator-singa git commit: add root permission while install in default path

2015-06-18 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 51a924dad - 81f7a12eb add root permission while install in default path Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/65afb1a1 Tree:

svn commit: r954975 - /websites/production/singa/content/

2015-06-15 Thread wangsh
Author: wangsh Date: Tue Jun 16 02:34:16 2015 New Revision: 954975 Log: Publishing svnmucc operation to singa site by wangsh Added: websites/production/singa/content/ - copied from r954974, websites/staging/singa/trunk/content/

[3/3] incubator-singa git commit: add zookeeper check in configure script

2015-06-14 Thread wangsh
add zookeeper check in configure script Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/f13e3a75 Tree: http://git-wip-us.apache.org/repos/asf/incubator-singa/tree/f13e3a75 Diff:

[2/3] incubator-singa git commit: SINGA-6 Update the implementation of Singleton to make it thread-safe (using C++11's static construction). The ASingleton (constructor with Argument) was used for sha

2015-06-14 Thread wangsh
SINGA-6 Update the implementation of Singleton to make it thread-safe (using C++11's static construction). The ASingleton (constructor with Argument) was used for sharing the Mshadow::Random among Layers and Params. To make it thread-safe 1. we change it to TSingleton (Thread specfic singlton).

svn commit: r1682143 - in /incubator/singa/site/trunk/content: markdown/docs/installation.md resources/files/ resources/files/mm_opensource.zip

2015-05-27 Thread wangsh
Author: wangsh Date: Thu May 28 03:47:19 2015 New Revision: 1682143 URL: http://svn.apache.org/r1682143 Log: update installation page Added: incubator/singa/site/trunk/content/resources/files/ incubator/singa/site/trunk/content/resources/files/mm_opensource.zip (with props) Modified

incubator-singa git commit: SINGA-28 Fix a bug from toplogy sort of Graph

2015-07-06 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master cce3aebef - ea7cfea49 SINGA-28 Fix a bug from toplogy sort of Graph There is a bug in the Sort function of graph.cc, which would push one node into the 'tmp' queue for multiple times if this node has multiple source nodes.

[2/2] incubator-singa git commit: SINGA-45 Set openblas num threads in job configuration

2015-08-13 Thread wangsh
SINGA-45 Set openblas num threads in job configuration test and merge to master Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/da844afd Tree:

[1/7] incubator-singa git commit: SINGA-59 Remove dependency on gflags

2015-08-17 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 2498ff135 - f2b0aef12 http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/f2b0aef1/configure.ac -- diff --git a/configure.ac b/configure.ac index

incubator-singa git commit: SINGA-42 Issue when loading checkpoints

2015-08-02 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 06163950b - a92a1c778 SINGA-42 Issue when loading checkpoints Update default value for ModelProto::reset_param_version to true. It will reset all parameter version to ModelProto::step. For resuming training from checkpoints, if

[02/12] incubator-singa git commit: SINGA-50 Improve the code of ParseUpdateMsgs function

2015-08-15 Thread wangsh
SINGA-50 Improve the code of ParseUpdateMsgs function refactored the code by using the memory of one message or one local worker's grad blob to store the aggregated parameter gradients. Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[09/12] incubator-singa git commit: SINGA-55 Refactor main.cc and singa.h

2015-08-15 Thread wangsh
http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/2498ff13/config/ltmain.sh -- diff --cc config/ltmain.sh index c2852d8,c2852d8..a72f2fd mode 100644,100644..100755 --- a/config/ltmain.sh +++ b/config/ltmain.sh @@@ -1,9

[01/12] incubator-singa git commit: SINGA-55 Refactor main.cc and singa.h

2015-08-15 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master f3cc20a90 - 2498ff135 SINGA-55 Refactor main.cc and singa.h A Driver class is implemented for initializing SINGA including parsing job ID, and registering built-in subclasses of Layer, Updater, Worker and Param. May use it to

[08/12] incubator-singa git commit: SINGA-55 Refactor main.cc and singa.h

2015-08-15 Thread wangsh
http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/2498ff13/config/ltoptions.m4 -- diff --cc config/ltoptions.m4 index 5d9acd8,5d9acd8..34151a3 --- a/config/ltoptions.m4 +++ b/config/ltoptions.m4 @@@ -1,14 -1,14 +1,13 @@@

[05/12] incubator-singa git commit: SINGA-54 Refactor job configuration to move fields in ModelProto out

2015-08-15 Thread wangsh
SINGA-54 Refactor job configuration to move fields in ModelProto out Corrent some fields which were reverted during rebase. Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/75b2e047 Tree:

incubator-singa git commit: SINGA-49 Fix a bug in HandlePutMsg func that sets param fields to invalid values

2015-08-12 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master a92a1c778 - d5b6a30d0 SINGA-49 Fix a bug in HandlePutMsg func that sets param fields to invalid values The Param::HandlePutMsg doesn't set the weight decay multiplier and learning rate multiplier correctly. The previous code

[1/2] incubator-singa git commit: SINGA-44 A bug when reseting metric values

2015-08-12 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master d5b6a30d0 - a8c8211f4 SINGA-44 A bug when reseting metric values When reseting the values of Metric object, we didn't use reference which made the resetting invalid. Fixed the bug by using reference. Project:

[2/2] incubator-singa git commit: SINGA-46 Fix a bug in updater.cc to scale the gradients

2015-08-12 Thread wangsh
SINGA-46 Fix a bug in updater.cc to scale the gradients merge to master Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/538736c4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-singa/tree/538736c4

[1/2] incubator-singa git commit: SINGA-46 Fix a bug in updater.cc to scale the gradients

2015-08-12 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master a8c8211f4 - 538736c4a SINGA-46 Fix a bug in updater.cc to scale the gradients Scale gradients in Updater::Update() before updating parameters. Format code in updater.h and updater.cc. Project:

incubator-singa git commit: SINGA-47 Fix a bug in data layers that leads to out-of-memory when group size is too large

2015-08-12 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 538736c4a - 7a61a687c SINGA-47 Fix a bug in data layers that leads to out-of-memory when group size is too large The bug is fixed by closing the data source (e.g., lmdb or datashard) after reading a sample record in the Setup

incubator-singa git commit: SINGA-39 Avoid ssh in scripts for single node environment

2015-07-24 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master c3a248a4b - e8e592f1e SINGA-39 Avoid ssh in scripts for single node environment singa-console.sh check local_procs flags before ssh tool.cc change printed job id from job-X to X Project:

[1/3] incubator-singa git commit: SINGA-36 Clean ModelProto, ClusterProto, JobProto and driver program

2015-07-23 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 29de86337 - c3a248a4b http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/0478e8cf/src/proto/job.proto -- diff --git a/src/proto/job.proto

[2/3] incubator-singa git commit: SINGA-32 Implement Synchronous training frameworks

2015-07-18 Thread wangsh
SINGA-32 Implement Synchronous training frameworks For the synchronous training frameworks, one worker group and one server group are launched. Gradients for the same Param are aggregated locally at each process's stub. The server conducts update until receive all gradients for the same Param

[1/2] incubator-singa git commit: SINGA-12 Supprt Checkpoint and Restore

2015-07-21 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 96bedb226 - 189261f0e SINGA-12 Supprt Checkpoint and Restore The checkpoint is done in the Worker class and controlled by two model configuration fields: checkpoint_after and checkpoint_frequency. Only do checkpoint for the

[1/2] incubator-singa git commit: SINGA-37 Enable users to set parameter sharing in model configuration

2015-07-21 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 189261f0e - 5bf1c9280 SINGA-37 Enable users to set parameter sharing in model configuration A share_from field is added into the ParamProto. It indicates the name of the Param that owns the values of this param. The NeuralNet

[1/5] incubator-singa git commit: SINGA-82 Refactor input layers using data store abstraction

2015-10-07 Thread wangsh
true) { +fin.read(reinterpret_cast<char*>(), sizeof(len)); +if (!fin.good()) break; +fin.read(buf, len); +buf[len] = '\0'; +if (!fin.good()) break; +fin.read(reinterpret_cast<char*>(), sizeof(len)); +if (!fin.good()) break; +fin.seekg(len, std::ios_base::cur); +

[2/5] incubator-singa git commit: SINGA-82 Refactor input layers using data store abstraction

2015-10-07 Thread wangsh
http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/5f010caa/src/neuralnet/input_layer.cc -- diff --git a/src/neuralnet/input_layer.cc b/src/neuralnet/input_layer.cc index f89369c..b4743f4 100644 ---

[4/5] incubator-singa git commit: SINGA-82 Refactor input layers using data store abstraction

2015-10-07 Thread wangsh
SINGA-82 Refactor input layers using data store abstraction add header guard for textfile_store.h, image_transform.h format code Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/dc7f1996 Tree:

[5/5] incubator-singa git commit: SINGA-82 Refactor input layers using data store abstraction

2015-10-07 Thread wangsh
SINGA-82 Refactor input layers using data store abstraction * Enable StoreInputLayer to partition on dim = 0. * Add random skip for StoreInputLayer, which randomly skip some records at the beginning to make sure workers within the same group and running in the same process train over different

[3/3] incubator-singa git commit: SINGA-94 Move call to google::InitGoogleLogging() from Driver::Init() to main()

2015-10-20 Thread wangsh
SINGA-94 Move call to google::InitGoogleLogging() from Driver::Init() to main() merge to master branch Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/316c65bc Tree:

[2/3] incubator-singa git commit: SINGA-94 Move call to google::InitGoogleLogging() from Driver::Init() to main()

2015-10-20 Thread wangsh
SINGA-94 Move call to google::InitGoogleLogging() from Driver::Init() to main() update rnnlm example to init glog in its main.cc Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/e5e679f8 Tree:

[1/2] incubator-singa git commit: SINGA-91 - Add SoftmaxLayer and ArgSortLayer

2015-10-18 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 497dafc71 -> 0a228c8cc SINGA-91 - Add SoftmaxLayer and ArgSortLayer SoftmaxLayer applies the Softmax function against its source layer to compute its probability distribution over all labels. ArgSortLayer sorts labels based on

[4/4] incubator-singa git commit: SINGA-85 Add functions for extracting features and test new data

2015-10-11 Thread wangsh
SINGA-85 Add functions for extracting features and test new data Make cpplint remove duplicated SINGA in header guard Change checkpoint path in examples/cifar10/job.conf All modified files passed cpplint Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[1/4] incubator-singa git commit: SINGA-85 Add functions for extracting features and test new data

2015-10-11 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master f90e4dcdc -> 288a2ab94 http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/e928ebba/src/test/test_csv_input_layer.cc -- diff --git

[3/4] incubator-singa git commit: SINGA-85 Add functions for extracting features and test new data

2015-10-11 Thread wangsh
SINGA-85 Add functions for extracting features and test new data Add singatest into gitignore comment checkpoint path in cifar10/job.conf Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/584a8494 Tree:

[1/3] incubator-singa git commit: SINGA-29 Update NeuralNet class to enable customizing layer partition type

2015-07-11 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master ea7cfea49 - 9a6e09fa2 http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/9a6e09fa/src/utils/graph.cc -- diff --git a/src/utils/graph.cc

[2/3] incubator-singa git commit: SINGA-29 Update NeuralNet class to enable customizing layer partition type

2015-07-11 Thread wangsh
http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/9a6e09fa/src/neuralnet/layer.cc -- diff --git a/src/neuralnet/layer.cc b/src/neuralnet/layer.cc index db13824..b40b676 100644 --- a/src/neuralnet/layer.cc +++

[3/3] incubator-singa git commit: SINGA-29 Update NeuralNet class to enable customizing layer partition type

2015-07-11 Thread wangsh
SINGA-29 Update NeuralNet class to enable customizing layer partition type 1. Clean the code for NeuralNet and Graph classes. Graph class only provides functions about Node and Edge management, e.g., add, remove and toplogy sort. NeuralNet provides one function (CreateGraph) to convert net

[3/3] incubator-singa git commit: SINGA-51 Improve the convolution and pooling operations

2015-09-14 Thread wangsh
SINGA-51 Improve the convolution and pooling operations minor changes - format test_common.cc - format include patterns in driver, layers all cc file include own h file in first line Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[2/3] incubator-singa git commit: SINGA-51 Improve the convolution and pooling operations

2015-09-14 Thread wangsh
SINGA-51 Improve the convolution and pooling operations merge with pull request #64 Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/e7691422 Tree:

[1/3] incubator-singa git commit: SINGA-51 Improve the convolution and pooling operations

2015-09-14 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 077d3804f -> d5d817e14 SINGA-51 Improve the convolution and pooling operations Caffe's im2col is adopted to speed up the convolution operation. The max pooling operation is accelerated by book-keeping the max neuron position like

[08/13] incubator-singa git commit: SINGA-70 Refactor API of Layer, Worker, Server and Driver

2015-09-27 Thread wangsh
http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/321ef96a/include/neuralnet/neuron_layer.h -- diff --git a/include/neuralnet/neuron_layer.h b/include/neuralnet/neuron_layer.h index 6c4647d..51ba304 100644 ---

[13/13] incubator-singa git commit: SINGA-72 Minor updates to be consisten with documentation

2015-09-27 Thread wangsh
SINGA-72 Minor updates to be consisten with documentation format driver.cc, rnnl.h, param.cc close #69 close #65 close #63 close #39 Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/2f665370 Tree:

[09/13] incubator-singa git commit: SINGA-70 Refactor API of Layer, Worker, Server and Driver

2015-09-27 Thread wangsh
SINGA-70 Refactor API of Layer, Worker, Server and Driver For Layer class * Setup, ComputeFeature and ComputeGradient are updated to accept one argument which represents all source layers. * DebugString() is changed to ToString() for displaying debug info and other info. For example, the

[06/13] incubator-singa git commit: SINGA-70 Refactor API of Layer, Worker, Server and Driver

2015-09-27 Thread wangsh
.step()); -if (!job_conf_.reset_param_version()) - LOG(ERROR) << "better reset version of params from checkpoints " -<< "to the same as other newly initialized params!"; - } - -Metric perf; -// warmup training before put params t

[12/13] incubator-singa git commit: SINGA-72 Minor updates to be consisten with documentation

2015-09-27 Thread wangsh
SINGA-72 Minor updates to be consisten with documentation Polish text of README.md by Anh. Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/45e50261 Tree:

[04/13] incubator-singa git commit: SINGA-72 Minor updates to be consisten with documentation

2015-09-27 Thread wangsh
SINGA-72 Minor updates to be consisten with documentation Add OpenBLAS installation details to FAQ of README.md. Remove compiling flags (-O2, gdwarf-2, gstric-dwarf, -Woverloaded-virtual) that hinder debug. Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[05/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
SINGA-100 Implement layers using CUDNN for GPU training Add some gpu functions: gpu_scale(); gpu_asum(); gpu_sample_gaussian(); gpu_sample_uniform(); Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[06/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
SINGA-100 Implement layers using CUDNN for GPU training Fix the error from wrong accuracy caused by inner-product layer. The MMDot accpets two dimension Blob, but inner-product passes 4-d blob. The error is fixed by assuming the Blob is of shape (shape[0], count()/shape[0]). The cifar10 example

[04/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
SINGA-100 Implement layers using CUDNN for GPU training * Add cudnn layers, including convoltuion, pooling, lrn, and activation (relu, sigmoid, tanh) * move declarations of layers from single file into _layer.h under include/singa/neuralnet/ TODO compile the code with '#' will be ignored, and

[07/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
SINGA-100 Implement layers using CUDNN for GPU training fix compilation errors. pass all gtest files. tmp commit; 1. CudnnSoftmaxloss class ComputeFeature(): computer loss ComputeGradient(): compute gradient 2. Add cuda math kernel functions 1) singa_gpu_softmax_loss(): computer loss kernel

[11/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
SINGA-100 Implement layers using CUDNN for GPU training test with multi-gpus on cifar10; setting batchszie=500, it takes one iteration 3s on single gpu, and 2s on 2 gpus fix bug from cudnnsoftmax and cudnnsoftmaxloss; todo debug accuracy problem. the accuracy improves slower than that from

[09/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
SINGA-100 Implement layers using CUDNN for GPU training tmp commit; setup device in driver.cc, register cudnn layers; tmp commit; 1.Add kernel_sum_by_row() cuda kernel functions 2.Fixed neuron_layer.h bug: cudnn.h should be placed outside the namespace 3.Register CudnnSoftmaxLoss class

[01/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 1981874fc -> 8ac511c70 SINGA-100 Implement layers using CUDNN for GPU training Update dropout layer to run for both cudnn and cpu training mode. Update the cpu part of math_blob and math_addr to use Context class for getting cpu

[08/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
SINGA-100 Implement layers using CUDNN for GPU training Pass cublas handle from math_blob to math_addr. Test configure-make for cpu code. Compile success for Makefile.gpu. Todo set up Context when creating worker threads. Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo

[16/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
SINGA-100 Implement layers using CUDNN for GPU training Automatically add library path when using `--with-cuda' and `--with-cudnn'. Users can pass the lib check even if they do not set cuda/cudnn library path in environment variables. Project:

[03/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/af1bf509/include/singa/neuralnet/output_layer/csv.h -- diff --git a/include/singa/neuralnet/output_layer/csv.h b/include/singa/neuralnet/output_layer/csv.h deleted file

[18/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
SINGA-100 Implement layers using CUDNN for GPU training Replace CopyFrom with Copy in softmax loss layers. CopyFrom copies both cpu and gpu memory, while Copy copies either cpu or gpu memory. Rename CudnnLayer to CudnnBase, which was changed but missed during rebase.. Fix bugs from getting

[15/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
SINGA-100 Implement layers using CUDNN for GPU training Fixs include path problems on cudnn. A reminder: Users should configure their library path(LD_LIBRARY_PATH & LIBRARY_PATH) after they install cudnn libs. Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[13/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
SINGA-100 Implement layers using CUDNN for GPU training Support compiling with cudnn related code. Please run: ./configure --enable-cuda --with-cuda=/CUDA/PATH --enable-cudnn --with-cudnn=/CUDNN/PATH to generate makefile. Fix a bug that CPU compilation will detect nvcc existence. There

[02/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
SINGA-100 Implement layers using CUDNN for GPU training Fix errors from compiling cpu code and cudnn code. tmp commit. Trying to run cudnn for gpu training and Mshadow for cpu training. 1. finish the CudnnSoftmaxLossLayer 2. finish the DropoutLayer 3. add ActivationLayer, which leads to link

[14/19] incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-16 Thread wangsh
SINGA-100 Implement layers using CUDNN for GPU training Fix a bug: a failed test when running "make test",caused by src/test/test_math.cc:349. modified file: math_kernel.cu: singa_gpu_sum_row() and singa_gpu_sum_col() set threads_per_block and num_blocks wrong value Project:

[5/5] incubator-singa git commit: SINGA-120 - Implemented GRU and BPTT

2016-01-06 Thread wangsh
SINGA-120 - Implemented GRU and BPTT check with cpplint Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/24a1be9a Tree: http://git-wip-us.apache.org/repos/asf/incubator-singa/tree/24a1be9a Diff:

[1/5] incubator-singa git commit: SINGA-120 - Implemented GRU and BPTT

2016-01-06 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 4ebf0bcd6 -> 24a1be9aa SINGA-120 - Implemented GRU and BPTT Refined the code for readability Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[4/5] incubator-singa git commit: SINGA-120 - Implemented GRU and BPTT

2016-01-06 Thread wangsh
SINGA-120 - Implemented GRU and BPTT Improve the code for computing \hat{h_t}, i.e., the new memory of gru unit. The loss decreases under 2 per unit. Update test files, including test for unrolling and gru unit (ComputeFeature part) Project:

[2/5] incubator-singa git commit: SINGA-120 - Implemented GRU and BPTT

2016-01-06 Thread wangsh
SINGA-120 - Implemented GRU and BPTT Fixed the bug of computing new memory Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/d5e991c4 Tree:

[3/5] incubator-singa git commit: SINGA-120 - Implemented GRU and BPTT

2016-01-06 Thread wangsh
SINGA-120 - Implemented GRU and BPTT Add configuration fields (vocab_size) for OneHotLayer. Configure gpu to 0 for all examples. Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/c72ef0fc Tree:

svn commit: r1723842 - in /incubator/singa/site/trunk/content: markdown/docs/architecture.md markdown/docs/distributed-training.md markdown/docs/hybrid.md site.xml

2016-01-09 Thread wangsh
Author: wangsh Date: Sat Jan 9 10:21:49 2016 New Revision: 1723842 URL: http://svn.apache.org/viewvc?rev=1723842=rev Log: add docs for hybrid partition Added: incubator/singa/site/trunk/content/markdown/docs/hybrid.md Modified: incubator/singa/site/trunk/content/markdown/docs

[1/3] incubator-singa git commit: SINGA-115 - Print layer debug information in the neural net graph file

2015-12-25 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master b0033533d -> 138599fd1 SINGA-115 - Print layer debug information in the neural net graph file Updated the Graph class to format the string representation in ToJson function. The Layer::ToString function is updated to generate

[3/3] incubator-singa git commit: SINGA-115 - Print layer debug information in the neural net graph file

2015-12-25 Thread wangsh
SINGA-115 - Print layer debug information in the neural net graph file check with cpplint Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/138599fd Tree:

[2/3] incubator-singa git commit: SINGA-115 - Print layer debug information in the neural net graph file

2015-12-25 Thread wangsh
SINGA-115 - Print layer debug information in the neural net graph file Overrride the ToString function in SliceLayer and SplitLayer. These two layers need to print the norm of multiple blobs as they have multiple out-going connections. Project:

[4/5] incubator-singa git commit: SINGA-113 Model/Hybrid Partition Support

2015-12-27 Thread wangsh
/connection_layer/slice.cc +++ b/src/neuralnet/connection_layer/slice.cc @@ -21,6 +21,8 @@ #include "singa/neuralnet/connection_layer.h" #include "singa/utils/math_blob.h" +#include "singa/utils/singleton.h" +#include "singa/utils/context.h" namespa

[1/5] incubator-singa git commit: SINGA-113 Model/Hybrid Partition Support

2015-12-27 Thread wangsh
node->name] = node; -} - -Node* Graph::AddNode(const string& name) { - Node* node = new Node(name); - AddNode(node); return node; } @@ -140,64 +137,6 @@ void Graph::RemoveEdge(const string , const string& dst) { RemoveEdge(srcnode->second, dstnode->second); } -str

incubator-singa git commit: SINGA-100 Implement layers using CUDNN for GPU training

2015-12-17 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/master 8ac511c70 -> b0033533d SINGA-100 Implement layers using CUDNN for GPU training fix a bug in stub.cc Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[5/6] incubator-singa git commit: SINGA-104 Add Context Class

2015-11-26 Thread wangsh
SINGA-104 Add Context Class Add cuda_utils.h; Add comments for context.h Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-singa/commit/e3bda08d Tree: http://git-wip-us.apache.org/repos/asf/incubator-singa/tree/e3bda08d

[3/6] incubator-singa git commit: SINGA-104 Add Context Class

2015-11-26 Thread wangsh
SINGA-104 Add Context Class Update the Context class: 1. function, variable names. 2. add random generators for CPU threads. TODO run test for test_context.cu. Add implicit/automatic init (using device 0). Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[24/60] incubator-singa git commit: SINGA-165 Add cross-platform timer API to singa Add timer class with cmake compilation. How to test: (in singa main folder) mkdir build && cd build cmake .. make ./

2016-06-03 Thread wangsh
SINGA-165 Add cross-platform timer API to singa Add timer class with cmake compilation. How to test: (in singa main folder) mkdir build && cd build cmake .. make ./bin/timer Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[04/60] incubator-singa git commit: SINGA-163 - Reorganize the project folder layout

2016-06-03 Thread wangsh
http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/dd1e4afa/src/utils/updater.cc -- diff --git a/src/utils/updater.cc b/src/utils/updater.cc deleted file mode 100644 index a2180d3..000 --- a/src/utils/updater.cc +++

[01/60] incubator-singa git commit: SINGA-163 - Reorganize the project folder layout

2016-06-03 Thread wangsh
Repository: incubator-singa Updated Branches: refs/heads/dev [created] 04e23d1a6 http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/dd1e4afa/test/gtest/gtest_main.cc -- diff --git a/test/gtest/gtest_main.cc

[29/60] incubator-singa git commit: SINGA-167 - Add Tensor Math function APIs

2016-06-03 Thread wangsh
SINGA-167 - Add Tensor Math function APIs Add APIs in math.h including linear algebra and random functions. TODO 1. add APIs for nn functions. 2. Implement Tensor math functions using APIs from math.h. Project: http://git-wip-us.apache.org/repos/asf/incubator-singa/repo Commit:

[02/60] incubator-singa git commit: SINGA-163 - Reorganize the project folder layout

2016-06-03 Thread wangsh
http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/dd1e4afa/test/gtest/gtest.h -- diff --git a/test/gtest/gtest.h b/test/gtest/gtest.h new file mode 100644 index 000..4f3804f --- /dev/null +++ b/test/gtest/gtest.h @@

[03/60] incubator-singa git commit: SINGA-163 - Reorganize the project folder layout

2016-06-03 Thread wangsh
http://git-wip-us.apache.org/repos/asf/incubator-singa/blob/dd1e4afa/test/gtest/gtest-all.cc -- diff --git a/test/gtest/gtest-all.cc b/test/gtest/gtest-all.cc new file mode 100644 index 000..a9a03b2 --- /dev/null +++

[37/60] incubator-singa git commit: SINGA-171 - Create CppDevice and CudaDevice

2016-06-03 Thread wangsh
SINGA-171 - Create CppDevice and CudaDevice Implement CudaDevice. (zhongle) Fix erorrs for cudnn and cuda by adding cuda & cudnn libs to singa_linker_libs. NOTE: set cudnn include path before cuda include path, as some platforms may include cudnn.h in cuda/include, but the cudnn.h is not the

  1   2   >