This is an automated email from the ASF dual-hosted git repository.
wangwei pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-singa.git
The following commit(s) were added to refs/heads/master by this push:
new 9f64fd0 SINGA-433 Update the website with benchmark figure
9f64fd0 is described below
commit 9f64fd085d59ac636de87180a4dafd30085551bd
Author: Wang Wei <[email protected]>
AuthorDate: Fri Apr 26 12:09:58 2019 +0800
SINGA-433 Update the website with benchmark figure
and fix the format of some pages.
---
doc/_static/images/benchmark.png | Bin 0 -> 125210 bytes
doc/en/docs/benchmark.md | 33 +++++++++++++++++++++++++++++++++
examples/imagenet/densenet/README.md | 7 +------
examples/imagenet/googlenet/README.md | 11 ++---------
examples/imagenet/inception/README.md | 10 +---------
examples/imagenet/resnet/README.md | 10 ++--------
examples/imagenet/vgg/README.md | 6 ------
7 files changed, 39 insertions(+), 38 deletions(-)
diff --git a/doc/_static/images/benchmark.png b/doc/_static/images/benchmark.png
new file mode 100644
index 0000000..8182931
Binary files /dev/null and b/doc/_static/images/benchmark.png differ
diff --git a/doc/en/docs/benchmark.md b/doc/en/docs/benchmark.md
new file mode 100644
index 0000000..0cb793f
--- /dev/null
+++ b/doc/en/docs/benchmark.md
@@ -0,0 +1,33 @@
+<!--
+ Licensed to the Apache Software Foundation (ASF) under one
+ or more contributor license agreements. See the NOTICE file
+ distributed with this work for additional information
+ regarding copyright ownership. The ASF licenses this file
+ to you under the Apache License, Version 2.0 (the
+ "License"); you may not use this file except in compliance
+ with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing,
+ software distributed under the License is distributed on an
+ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ KIND, either express or implied. See the License for the
+ specific language governing permissions and limitations
+ under the License.
+-->
+
+
+# Benchmark for Distributed training
+
+
+Workload: we use a deep convolutional neural network,
[ResNet-50](https://github.com/apache/incubator-singa/blob/master/examples/autograd/resnet.py)
as the application. ResNet-50 is has 50 convolution layers for image
classification. It requires 3.8 GFLOPs to pass a single image (of size 224x224)
through the network. The input image size is 224x224.
+
+
+Hardware: we use p2.8xlarge instances from AWS, each of which has 8 Nvidia
Tesla K80 GPUs, 96 GB GPU memory in total, 32 vCPU, 488 GB main memory, 10 Gbps
network bandwidth.
+
+Metric: we measure the time per iteration for different number of workers to
evaluate the scalability of SINGA. The batch size is fixed to be 32 per GPU.
Synchronous training scheme is applied. As a result, the effective batch size
is $32N$, where N is the number of GPUs. We compare with a popular open source
system which uses the parameter server topology. The first GPU is selected as
the server.
+
+<img src="../_static/images/benchmark.png" align="center" width="500px"/>
+<br/>
+<span><strong>Scalability test. Bars are for the throughput; lines are for the
communication cost.</strong></span>
\ No newline at end of file
diff --git a/examples/imagenet/densenet/README.md
b/examples/imagenet/densenet/README.md
index 1ddef0c..5238ce9 100644
--- a/examples/imagenet/densenet/README.md
+++ b/examples/imagenet/densenet/README.md
@@ -16,12 +16,7 @@
specific language governing permissions and limitations
under the License.
-->
----
-name: DenseNet models on ImageNet
-SINGA version: 1.1.1
-SINGA commit:
-license:
https://github.com/pytorch/vision/blob/master/torchvision/models/densenet.py
----
+
# Image Classification using DenseNet
diff --git a/examples/imagenet/googlenet/README.md
b/examples/imagenet/googlenet/README.md
index 4a1335b..a1ea8bd 100644
--- a/examples/imagenet/googlenet/README.md
+++ b/examples/imagenet/googlenet/README.md
@@ -16,19 +16,12 @@
specific language governing permissions and limitations
under the License.
-->
----
-name: GoogleNet on ImageNet
-SINGA version: 1.0.1
-SINGA commit: 8c990f7da2de220e8a012c6a8ecc897dc7532744
-parameter_url:
https://s3-ap-southeast-1.amazonaws.com/dlfile/bvlc_googlenet.tar.gz
-parameter_sha1: 0a88e8948b1abca3badfd8d090d6be03f8d7655d
-license: unrestricted
https://github.com/BVLC/caffe/tree/master/models/bvlc_googlenet
----
+
# Image Classification using GoogleNet
-In this example, we convert GoogleNet trained on Caffe to SINGA for image
classification.
+In this example, we convert GoogleNet trained on Caffe to SINGA for image
classification. Tested on [SINGA
commit](8c990f7da2de220e8a012c6a8ecc897dc7532744) with [the
parameters](https://s3-ap-southeast-1.amazonaws.com/dlfile/bvlc_googlenet.tar.gz).
## Instructions
diff --git a/examples/imagenet/inception/README.md
b/examples/imagenet/inception/README.md
index 0f5c317..54aaaa1 100644
--- a/examples/imagenet/inception/README.md
+++ b/examples/imagenet/inception/README.md
@@ -16,18 +16,10 @@
specific language governing permissions and limitations
under the License.
-->
----
-name: Inception V4 on ImageNet
-SINGA version: 1.1.1
-SINGA commit:
-parameter_url:
https://s3-ap-southeast-1.amazonaws.com/dlfile/inception_v4.tar.gz
-parameter_sha1: 5fdd6f5d8af8fd10e7321d9b38bb87ef14e80d56
-license: https://github.com/tensorflow/models/tree/master/slim
----
# Image Classification using Inception V4
-In this example, we convert Inception V4 trained on Tensorflow to SINGA for
image classification.
+In this example, we convert Inception V4 trained on Tensorflow to SINGA for
image classification. Tested on SINGA version 1.1.1 with [parameters pretrained
by
tensorflow](https://s3-ap-southeast-1.amazonaws.com/dlfile/inception_v4.tar.gz).
## Instructions
diff --git a/examples/imagenet/resnet/README.md
b/examples/imagenet/resnet/README.md
index 75fb215..eb317b8 100644
--- a/examples/imagenet/resnet/README.md
+++ b/examples/imagenet/resnet/README.md
@@ -16,18 +16,12 @@
specific language governing permissions and limitations
under the License.
-->
----
-name: Resnets on ImageNet
-SINGA version: 1.1
-SINGA commit: 45ec92d8ffc1fa1385a9307fdf07e21da939ee2f
-parameter_url:
https://s3-ap-southeast-1.amazonaws.com/dlfile/resnet/resnet-18.tar.gz
-license: Apache V2,
https://github.com/facebook/fb.resnet.torch/blob/master/LICENSE
----
+
# Image Classification using Residual Networks
-In this example, we convert Residual Networks trained on
[Torch](https://github.com/facebook/fb.resnet.torch) to SINGA for image
classification.
+In this example, we convert Residual Networks trained on
[Torch](https://github.com/facebook/fb.resnet.torch) to SINGA for image
classification. Tested on [SINGA commit] with the [parameters pretrained by
Torch](https://s3-ap-southeast-1.amazonaws.com/dlfile/resnet/resnet-18.tar.gz)
## Instructions
diff --git a/examples/imagenet/vgg/README.md b/examples/imagenet/vgg/README.md
index 12aeacc..dbf7ccd 100644
--- a/examples/imagenet/vgg/README.md
+++ b/examples/imagenet/vgg/README.md
@@ -16,12 +16,6 @@
specific language governing permissions and limitations
under the License.
-->
----
-name: VGG models on ImageNet
-SINGA version: 1.1.1
-SINGA commit:
-license:
https://github.com/pytorch/vision/blob/master/torchvision/models/vgg.py
----
# Image Classification using VGG
