RuRo commented on pull request #18054: URL: https://github.com/apache/incubator-mxnet/pull/18054#issuecomment-634998080
@szha Did you check the CI logs, that I've attached in my previous comment? <blockquote> For example, [here](http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-cpu/detail/master/1983/pipeline/376) ([raw](http://jenkins.mxnet-ci.amazon-ml.com/blue/rest/organizations/jenkins/pipelines/mxnet-validation/pipelines/unix-cpu/branches/master/runs/1983/nodes/376/log/?start=0)) you can see that there are a lot of ONNX tests failing, but the pipeline is still marked as green. <details> ``` .s.s.sEsEs.s.sssssssssssssssss.s.s.s.s.s.s.s.s.s.s.s.s.s.sEsEs.s.sEsEs.sssss.sss.sssss.sssss.s.sssssssssss.s.s.s.s.s.sEs.s.s.s.s.s.s.s.s.s.s.sssssss.s.s.s.s.s.sss.sssssssssssssssssssssssssssssss.s.sEsEs.s.sss.s.s.s.s.s.s.s.s.sssssss.s.sssssssssssssssssss.s.s.s.s.sssss.s.s.s.sssssssssss.s.s.s.s.s.s.s.s.s.s.s.sssssssss.s.s.sssss.s.sssssssssssssssssssssss.s.s.sEs.s.s.sssssssssssssssssssssssssssssssss.s.s.s.s.s.sssssssss.s.s.sssss.s.sssssssssssssssssssssssssssssssssssssssssssssss.sss.s.sssssssssssss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sssssssssssssssssssssssssssssssssssssss.sss.s.sssss.s.sssssss.s.sEsEs.s.sEsssssEsEsEsssssss.sss.s.s.s.s.s.s.s.s.sssssss.s.s.sssssssssssss.s.s.s.s.s.s.s.s.s.sssssssssssssssssssssssssEs.s.s.s.s.s.s.s.sssssssssssssssssssss.s.sssss.sss.s.s.sssssssssssss.sssssssssssssssssssssssssss.s.s.s.s.sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss.s.s.s.s.s.s.s.s.s.s.s.sssssssssssssss.sssssssssss.s.s.s.sssssssssssssssssssssssssssssssss.sssssssss.s.sssssssssssssssssssssssss [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_acosh_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator [2020-05-27T04:58:58.762Z] raise NotImplementedError("Operator {} not implemented.".format(op_name)) [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Acosh not implemented. [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_acosh_example_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator [2020-05-27T04:58:58.762Z] raise NotImplementedError("Operator {} not implemented.".format(op_name)) [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Acosh not implemented. [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_asinh_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator [2020-05-27T04:58:58.762Z] raise NotImplementedError("Operator {} not implemented.".format(op_name)) [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Asinh not implemented. [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_asinh_example_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator [2020-05-27T04:58:58.762Z] raise NotImplementedError("Operator {} not implemented.".format(op_name)) [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Asinh not implemented. [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_atanh_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator [2020-05-27T04:58:58.762Z] raise NotImplementedError("Operator {} not implemented.".format(op_name)) [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Atanh not implemented. [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_atanh_example_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator [2020-05-27T04:58:58.762Z] raise NotImplementedError("Operator {} not implemented.".format(op_name)) [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Atanh not implemented. [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_cast_FLOAT_to_STRING_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 69, in _convert_operator [2020-05-27T04:58:58.762Z] mxnet_sym = new_op(*inputs, **new_attrs) [2020-05-27T04:58:58.762Z] File "<string>", line 65, in cast [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/_ctypes/symbol.py", line 132, in _symbol_creator [2020-05-27T04:58:58.762Z] ctypes.byref(sym_handle))) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/base.py", line 246, in check_call [2020-05-27T04:58:58.762Z] raise get_last_ffi_error() [2020-05-27T04:58:58.762Z] mxnet.base.MXNetError: MXNetError: Invalid Input: 'object', valid values are: {'bfloat16', 'bool', 'float16', 'float32', 'float64', 'int32', 'int64', 'int8', 'uint8'}, in operator Cast(name="", __profiler_scope__="<unk>:", dtype="object") [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_cosh_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator [2020-05-27T04:58:58.762Z] raise NotImplementedError("Operator {} not implemented.".format(op_name)) [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Cosh not implemented. [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_cosh_example_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator [2020-05-27T04:58:58.762Z] raise NotImplementedError("Operator {} not implemented.".format(op_name)) [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Cosh not implemented. [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_matmulinteger_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator [2020-05-27T04:58:58.762Z] raise NotImplementedError("Operator {} not implemented.".format(op_name)) [2020-05-27T04:58:58.762Z] NotImplementedError: Operator MatMulInteger not implemented. [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_sinh_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator [2020-05-27T04:58:58.762Z] raise NotImplementedError("Operator {} not implemented.".format(op_name)) [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Sinh not implemented. [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_sinh_example_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator [2020-05-27T04:58:58.762Z] raise NotImplementedError("Operator {} not implemented.".format(op_name)) [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Sinh not implemented. [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_slice_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 61, in _convert_operator [2020-05-27T04:58:58.762Z] op_name, new_attrs, inputs = convert_map[op_name](attrs, inputs, self) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/_op_translations.py", line 511, in _slice [2020-05-27T04:58:58.762Z] end = list(new_attrs.get('end')) [2020-05-27T04:58:58.762Z] TypeError: 'NoneType' object is not iterable [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_slice_end_out_of_bounds_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 61, in _convert_operator [2020-05-27T04:58:58.762Z] op_name, new_attrs, inputs = convert_map[op_name](attrs, inputs, self) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/_op_translations.py", line 511, in _slice [2020-05-27T04:58:58.762Z] end = list(new_attrs.get('end')) [2020-05-27T04:58:58.762Z] TypeError: 'NoneType' object is not iterable [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_slice_neg_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 61, in _convert_operator [2020-05-27T04:58:58.762Z] op_name, new_attrs, inputs = convert_map[op_name](attrs, inputs, self) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/_op_translations.py", line 511, in _slice [2020-05-27T04:58:58.762Z] end = list(new_attrs.get('end')) [2020-05-27T04:58:58.762Z] TypeError: 'NoneType' object is not iterable [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_slice_neg_steps_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 61, in _convert_operator [2020-05-27T04:58:58.762Z] op_name, new_attrs, inputs = convert_map[op_name](attrs, inputs, self) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/_op_translations.py", line 511, in _slice [2020-05-27T04:58:58.762Z] end = list(new_attrs.get('end')) [2020-05-27T04:58:58.762Z] TypeError: 'NoneType' object is not iterable [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ====================================================================== [2020-05-27T04:58:58.762Z] ERROR: test_top_k_cpu (__main__.OnnxBackendNodeModelTest) [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Traceback (most recent call last): [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func [2020-05-27T04:58:58.762Z] return test_func(*args, device=device, **kwargs) [2020-05-27T04:58:58.762Z] File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run [2020-05-27T04:58:58.762Z] prepared_model = self.backend.prepare(model, device) [2020-05-27T04:58:58.762Z] File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare [2020-05-27T04:58:58.762Z] sym, arg_params, aux_params = graph.from_onnx(model.graph) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx [2020-05-27T04:58:58.762Z] mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 69, in _convert_operator [2020-05-27T04:58:58.762Z] mxnet_sym = new_op(*inputs, **new_attrs) [2020-05-27T04:58:58.762Z] File "<string>", line 106, in topk [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/_ctypes/symbol.py", line 132, in _symbol_creator [2020-05-27T04:58:58.762Z] ctypes.byref(sym_handle))) [2020-05-27T04:58:58.762Z] File "/work/mxnet/python/mxnet/base.py", line 246, in check_call [2020-05-27T04:58:58.762Z] raise get_last_ffi_error() [2020-05-27T04:58:58.762Z] mxnet.base.MXNetError: MXNetError: Invalid Parameter format for axis expect int or None but value='<Symbol k>', in operator topk(name="", __profiler_scope__="<unk>:", axis="<Symbol k>", dtype="int64", ret_typ="both") [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] ---------------------------------------------------------------------- [2020-05-27T04:58:58.762Z] Ran 1116 tests in 603.735s [2020-05-27T04:58:58.762Z] [2020-05-27T04:58:58.762Z] FAILED (errors=17, skipped=853) ``` </details> </blockquote> These are logs from a pretty recent commit from master. You can clearly see that the pipeline is green, but there are a lot of failed tests in `mxnet/tests/python/unittest/onnx`. It seems to me, that 18025 just bumped the onnx version without updating the tests. Not sure, why the pipeline is marked as green in the Jenkins UI. Maybe there is a missing `set -ex` somewhere or something. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
