[GitHub] Soonhwan-Kwon commented on issue #9156: float64 data backward error using gluon
Soonhwan-Kwon commented on issue #9156: float64 data backward error using gluon URL: https://github.com/apache/incubator-mxnet/issues/9156#issuecomment-361166849 Same error occurs when I use float16 and I'm not using gluon. `"mxnet.base.MXNetError: [05:42:23] include/mxnet/././tensor_blob.h:217: Check failed: mshadow::DataType::kFlag == type_flag_ TBlob.get_with_shape: data type do not match specified type.Expected: 0 v.s. given 2"` And also when it's on backward and ok with forward. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] Soonhwan-Kwon commented on issue #9156: float64 data backward error using gluon
Soonhwan-Kwon commented on issue #9156: float64 data backward error using gluon URL: https://github.com/apache/incubator-mxnet/issues/9156#issuecomment-361167158 ``` ... File "/data/ecg_2018/train.py", line 93, in do_training module.forward_backward(data_batch) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/module/base_module.py", line 192, in forward_backward self.backward() File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/module/bucketing_module.py", line 444, in backward self._curr_module.backward(out_grads=out_grads) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/module/module.py", line 627, in backward self._exec_group.backward(out_grads=out_grads) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/module/executor_group.py", line 580, in backward exec_.backward(out_grads=out_grads_slice) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/executor.py", line 234, in backward ctypes.c_int(is_train))) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/base.py", line 146, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [05:42:23] include/mxnet/././tensor_blob.h:217: Check failed: mshadow::DataType::kFlag == type_flag_ TBlob.get_with_shape: data type do not match specified type.Expected: 0 v.s. given 2 Stack trace returned 10 entries: [bt] (0) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(dmlc::StackTrace[abi:cxx11]()+0x5a) [0x7f03ecd9bcda] [bt] (1) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(dmlc::LogMessageFatal::~LogMessageFatal()+0x28) [0x7f03ecd9c878] [bt] (2) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mshadow::half::half_t* mxnet::TBlob::dptr() const+0xd7) [0x7f03ecdb74a7] [bt] (3) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mshadow::Tensor mxnet::TBlob::get_with_shape(mshadow::Shape<3> const&, mshadow::Stream*) const+0x56c) [0x7f03ef94f84c] [bt] (4) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mxnet::op::SliceChannelOp::Backward(mxnet::OpContext const&, std::vector > const&, std::vector > const&, std::vector > const&, std::vector > const&, std::vector > const&, std::vector > const&)+0x9a7) [0x7f03f0ab9be7] [bt] (5) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mxnet::op::OperatorState::Backward(mxnet::OpContext const&, std::vector > const&, std::vector > const&, std::vector > const&)+0x767) [0x7f03ef2f18a7] [bt] (6) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mxnet::exec::StatefulComputeExecutor::Run(mxnet::RunContext, bool)+0x69) [0x7f03ef876429] [bt] (7) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(+0x339a050) [0x7f03ef849050] [bt] (8) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(std::_Function_handler::_M_invoke(std::_Any_data const&, mxnet::RunContext&&, mxnet::engine::CallbackOnComplete&&)+0x61) [0x7f03ef79ef61] [bt] (9) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mxnet::engine::NaiveEngine::PushAsync(std::function, mxnet::Context, std::vector > const&, std::vector > const&, mxnet::FnProperty, int, char const*)+0x4da) [0x7f03ef7aac8a] ``` This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] Soonhwan-Kwon commented on issue #9156: float64 data backward error using gluon
Soonhwan-Kwon commented on issue #9156: float64 data backward error using gluon URL: https://github.com/apache/incubator-mxnet/issues/9156#issuecomment-361166849 Same error occurs when I use float16 and I'm not using gluon. "mxnet.base.MXNetError: [05:42:23] include/mxnet/././tensor_blob.h:217: Check failed: mshadow::DataType::kFlag == type_flag_ TBlob.get_with_shape: data type do not match specified type.Expected: 0 v.s. given 2" And also when it's on backward and ok with forward. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] Soonhwan-Kwon commented on issue #9156: float64 data backward error using gluon
Soonhwan-Kwon commented on issue #9156: float64 data backward error using gluon URL: https://github.com/apache/incubator-mxnet/issues/9156#issuecomment-361167158 ... File "/data/ecg_2018/train.py", line 93, in do_training module.forward_backward(data_batch) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/module/base_module.py", line 192, in forward_backward self.backward() File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/module/bucketing_module.py", line 444, in backward self._curr_module.backward(out_grads=out_grads) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/module/module.py", line 627, in backward self._exec_group.backward(out_grads=out_grads) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/module/executor_group.py", line 580, in backward exec_.backward(out_grads=out_grads_slice) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/executor.py", line 234, in backward ctypes.c_int(is_train))) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/base.py", line 146, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [05:42:23] include/mxnet/././tensor_blob.h:217: Check failed: mshadow::DataType::kFlag == type_flag_ TBlob.get_with_shape: data type do not match specified type.Expected: 0 v.s. given 2 Stack trace returned 10 entries: [bt] (0) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(dmlc::StackTrace[abi:cxx11]()+0x5a) [0x7f03ecd9bcda] [bt] (1) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(dmlc::LogMessageFatal::~LogMessageFatal()+0x28) [0x7f03ecd9c878] [bt] (2) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mshadow::half::half_t* mxnet::TBlob::dptr() const+0xd7) [0x7f03ecdb74a7] [bt] (3) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mshadow::Tensor mxnet::TBlob::get_with_shape(mshadow::Shape<3> const&, mshadow::Stream*) const+0x56c) [0x7f03ef94f84c] [bt] (4) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mxnet::op::SliceChannelOp::Backward(mxnet::OpContext const&, std::vector > const&, std::vector > const&, std::vector > const&, std::vector > const&, std::vector > const&, std::vector > const&)+0x9a7) [0x7f03f0ab9be7] [bt] (5) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mxnet::op::OperatorState::Backward(mxnet::OpContext const&, std::vector > const&, std::vector > const&, std::vector > const&)+0x767) [0x7f03ef2f18a7] [bt] (6) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mxnet::exec::StatefulComputeExecutor::Run(mxnet::RunContext, bool)+0x69) [0x7f03ef876429] [bt] (7) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(+0x339a050) [0x7f03ef849050] [bt] (8) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(std::_Function_handler::_M_invoke(std::_Any_data const&, mxnet::RunContext&&, mxnet::engine::CallbackOnComplete&&)+0x61) [0x7f03ef79ef61] [bt] (9) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mxnet::engine::NaiveEngine::PushAsync(std::function, mxnet::Context, std::vector > const&, std::vector > const&, mxnet::FnProperty, int, char const*)+0x4da) [0x7f03ef7aac8a] This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] Soonhwan-Kwon commented on issue #9156: float64 data backward error using gluon
Soonhwan-Kwon commented on issue #9156: float64 data backward error using gluon URL: https://github.com/apache/incubator-mxnet/issues/9156#issuecomment-361167158 File "main.py", line 55, in MxnetModel().run(train_freqs=train_freqs, train_labels=train_labels, test_freqs=test_freqs, test_labels=test_labels) File "/data/ecg_2018/ecg_script_frequency.py", line 266, in run do_training(args, self.module, data_train, data_test) File "/data/ecg_2018/train.py", line 93, in do_training module.forward_backward(data_batch) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/module/base_module.py", line 192, in forward_backward self.backward() File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/module/bucketing_module.py", line 444, in backward self._curr_module.backward(out_grads=out_grads) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/module/module.py", line 627, in backward self._exec_group.backward(out_grads=out_grads) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/module/executor_group.py", line 580, in backward exec_.backward(out_grads=out_grads_slice) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/executor.py", line 234, in backward ctypes.c_int(is_train))) File "/usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/base.py", line 146, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [05:42:23] include/mxnet/././tensor_blob.h:217: Check failed: mshadow::DataType::kFlag == type_flag_ TBlob.get_with_shape: data type do not match specified type.Expected: 0 v.s. given 2 Stack trace returned 10 entries: [bt] (0) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(dmlc::StackTrace[abi:cxx11]()+0x5a) [0x7f03ecd9bcda] [bt] (1) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(dmlc::LogMessageFatal::~LogMessageFatal()+0x28) [0x7f03ecd9c878] [bt] (2) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mshadow::half::half_t* mxnet::TBlob::dptr() const+0xd7) [0x7f03ecdb74a7] [bt] (3) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mshadow::Tensor mxnet::TBlob::get_with_shape(mshadow::Shape<3> const&, mshadow::Stream*) const+0x56c) [0x7f03ef94f84c] [bt] (4) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mxnet::op::SliceChannelOp::Backward(mxnet::OpContext const&, std::vector > const&, std::vector > const&, std::vector > const&, std::vector > const&, std::vector > const&, std::vector > const&)+0x9a7) [0x7f03f0ab9be7] [bt] (5) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mxnet::op::OperatorState::Backward(mxnet::OpContext const&, std::vector > const&, std::vector > const&, std::vector > const&)+0x767) [0x7f03ef2f18a7] [bt] (6) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mxnet::exec::StatefulComputeExecutor::Run(mxnet::RunContext, bool)+0x69) [0x7f03ef876429] [bt] (7) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(+0x339a050) [0x7f03ef849050] [bt] (8) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(std::_Function_handler::_M_invoke(std::_Any_data const&, mxnet::RunContext&&, mxnet::engine::CallbackOnComplete&&)+0x61) [0x7f03ef79ef61] [bt] (9) /usr/local/lib/python2.7/dist-packages/mxnet-1.0.1-py2.7.egg/mxnet/libmxnet.so(mxnet::engine::NaiveEngine::PushAsync(std::function, mxnet::Context, std::vector > const&, std::vector > const&, mxnet::FnProperty, int, char const*)+0x4da) [0x7f03ef7aac8a] This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] Soonhwan-Kwon commented on issue #9156: float64 data backward error using gluon
Soonhwan-Kwon commented on issue #9156: float64 data backward error using gluon URL: https://github.com/apache/incubator-mxnet/issues/9156#issuecomment-361166849 Same error occurs when I use float16. "mxnet.base.MXNetError: [05:42:23] include/mxnet/././tensor_blob.h:217: Check failed: mshadow::DataType::kFlag == type_flag_ TBlob.get_with_shape: data type do not match specified type.Expected: 0 v.s. given 2" And also when it's on backward and ok with forward. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
