[GitHub] [incubator-tvm] tmoreau89 commented on a change in pull request #4366: [DOCS] add benchmark log format doc
tmoreau89 commented on a change in pull request #4366: [DOCS] add benchmark log
format doc
URL: https://github.com/apache/incubator-tvm/pull/4366#discussion_r349741832
##
File path: docs/dev/benchmark.rst
##
@@ -0,0 +1,116 @@
+.. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+..http://www.apache.org/licenses/LICENSE-2.0
+
+.. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+
+
+Benchmark Performance Log Format
+
+This page details schema v0.1 for a unified benchmark log format. This schema
will allow easier cross-references with other frameworks/runs, experiment
reproduction, data for nightly perf regression, and the separation of
logging/visualization efforts.
+
+Log Format Overview
+~~~
+
++---++--+--+
+| header| examples
| category | notes/justification
|
++===++==+==+
+| timestamp | 1572282699.6
| metadata | indicates when this record is logged
|
++---++--+--+
+| schema\_version | 0.1
| metadata | ensure reproducibility as we iterate on
this schema |
++---++--+--+
+| metadata | { "docker\_tag":"gcr.io/.../0a680", ... }
| metadata | ``docker_tag`` is required
|
++---++--+--+
+| workload | resnet-18
| workload | name of workload
|
++---++--+--+
+| workload\_args| {“input\_name”: "Input3", “input\_shape”:
[list\_of\_shape], “data\_layout”: NHCW}
| workload |
|
[GitHub] [incubator-tvm] tmoreau89 commented on a change in pull request #4366: [DOCS] add benchmark log format doc
tmoreau89 commented on a change in pull request #4366: [DOCS] add benchmark log
format doc
URL: https://github.com/apache/incubator-tvm/pull/4366#discussion_r349731153
##
File path: docs/dev/benchmark.rst
##
@@ -0,0 +1,116 @@
+.. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+..http://www.apache.org/licenses/LICENSE-2.0
+
+.. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+
+
+Benchmark Performance Log Format
+
+This page details schema v0.1 for a unified benchmark log format. This schema
will allow easier cross-references with other frameworks/runs, experiment
reproduction, data for nightly perf regression, and the separation of
logging/visualization efforts.
+
+Log Format Overview
+~~~
+
++---++--+--+
+| header| examples
| category | notes/justification
|
++===++==+==+
+| timestamp | 1572282699.6
| metadata | indicates when this record is logged
|
++---++--+--+
+| schema\_version | 0.1
| metadata | ensure reproducibility as we iterate on
this schema |
++---++--+--+
+| metadata | { "docker\_tag":"gcr.io/.../0a680", ... }
| metadata | ``docker_tag`` is required
|
++---++--+--+
+| workload | resnet-18
| workload | name of workload
|
++---++--+--+
+| workload\_args| {“input\_name”: "Input3", “input\_shape”:
[list\_of\_shape], “data\_layout”: NHCW}
| workload |
|
[GitHub] [incubator-tvm] tmoreau89 commented on a change in pull request #4366: [DOCS] add benchmark log format doc
tmoreau89 commented on a change in pull request #4366: [DOCS] add benchmark log
format doc
URL: https://github.com/apache/incubator-tvm/pull/4366#discussion_r349462188
##
File path: docs/dev/benchmark.rst
##
@@ -0,0 +1,116 @@
+.. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements. See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership. The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License. You may obtain a copy of the License at
+
+..http://www.apache.org/licenses/LICENSE-2.0
+
+.. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied. See the License for the
+specific language governing permissions and limitations
+under the License.
+
+
+Benchmark Performance Log Format
+
+This page details schema v0.1 for a unified benchmark log format. This schema
will allow easier cross-references with other frameworks/runs, experiment
reproduction, data for nightly perf regression, and the separation of
logging/visualization efforts.
+
+Log Format Overview
+~~~
+
++---++--+--+
+| header| examples
| category | notes/justification
|
++===++==+==+
+| timestamp | 1572282699.6
| metadata | indicates when this record is logged
|
++---++--+--+
+| schema\_version | 0.1
| metadata | ensure reproducibility as we iterate on
this schema |
++---++--+--+
+| metadata | { "docker\_tag":"gcr.io/.../0a680", ... }
| metadata | ``docker_tag`` is required
|
++---++--+--+
+| workload | resnet-18
| workload | name of workload
|
++---++--+--+
+| workload\_args| {“input\_name”: "Input3", “input\_shape”:
[list\_of\_shape], “data\_layout”: NHCW}
| workload |
|
