wuxun-zhang commented on issue #15757: [Discussion] Unified performance tests and dashboard URL: https://github.com/apache/incubator-mxnet/issues/15757#issuecomment-525640786 Hi @ChaiBapchya , is there has some updates for this [large tensor benchmark script](https://github.com/ChaiBapchya/incubator-mxnet/blob/opperf_lts/benchmark/opperf/opperf_large_tensor.py)? I tried to run this script with [this commit](https://github.com/apache/incubator-mxnet/commit/ab602142d97681401526e2278effcdff43bec31a) and will get such an error below. Look that this error is caused by incomplete input arguments (missing `num_hidden` for FC). BTW, this script works well for other operators but FC from my side. Thanks for your help in advance. ``` (mxnet_p36) ubuntu@ip-172-31-18-141:~/github/incubator-mxnet/benchmark/opperf$ python opperf_large_tensor.py --ctx=cpu -p python Large tensor support : OFF INFO:root:Running Large tensor benchmarks with the following options: Namespace(ctx='cpu', dtype='float32', mkldnn_option='mkldnn', output_file='./mxnet_operator_benchmarks.json', output_format='json', profiler='python') [{'data': (1024, 1024), 'weight': (1024, 1024)}, {'data': (10000, 1), 'weight': (10000, 1)}, {'data': (10000, 100), 'weight': (10000, 100)}] Traceback (most recent call last): File "opperf_large_tensor.py", line 114, in <module> sys.exit(main()) File "opperf_large_tensor.py", line 103, in main final_benchmark_results = run_large_test_benchmarks(args.profiler, ctx=ctx, dtype=dtype) File "opperf_large_tensor.py", line 46, in run_large_test_benchmarks mx_large_tensor_results = run_op_benchmarks(mx_large_tensor_ops, dtype, ctx, profiler, warmup=10, runs=100) File "/home/ubuntu/github/incubator-mxnet/benchmark/opperf/utils/benchmark_utils.py", line 157, in run_op_benchmarks warmup=warmup, runs=runs) File "/home/ubuntu/github/incubator-mxnet/benchmark/opperf/utils/benchmark_utils.py", line 137, in run_performance_test benchmark_result = _run_nd_operator_performance_test(op, inputs, run_backward, warmup, runs, args_list, kwargs_list, profiler) File "/home/ubuntu/github/incubator-mxnet/benchmark/opperf/utils/benchmark_utils.py", line 69, in _run_nd_operator_performance_test _, _ = benchmark_helper_func(op, warmup, [], **kwargs_list[0]) File "/home/ubuntu/github/incubator-mxnet/benchmark/opperf/utils/profiler_utils.py", line 241, in python_profile_it res = func(*modified_args, **kwargs) File "/home/ubuntu/github/incubator-mxnet/benchmark/opperf/utils/ndarray_utils.py", line 48, in nd_forward_backward_and_profile res = op(**kwargs) File "<string>", line 86, in FullyConnected File "/home/ubuntu/github/incubator-mxnet/python/mxnet/_ctypes/ndarray.py", line 100, in _imperative_invoke ctypes.byref(out_stypes))) File "/home/ubuntu/github/incubator-mxnet/python/mxnet/base.py", line 254, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: Required parameter num_hidden of int is not presented, in operator FullyConnected(name="") ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
