jpf888 commented on issue #17176:
URL: https://github.com/apache/tvm/issues/17176#issuecomment-2260713905
@Lunderberg @Cookiee235
hi, When I try to use **cudnn dispatch**, I encounter the same problem as
you during runtime. After replacing with the code changes you submitted, I
still have the same problem. Could you please give me some suggestions?
Actual behavior：
`vm::runtime::Optional<tvm::runtime::Session> const&,
bool&>(tvm::runtime::String&, tvm::runtime::String&,
picojson::object_with_ordered_keys const&, DLDevice&,
tvm::runtime::Optional<tvm::runtime::Session> const&, bool&)
at mlc-llm/3rdparty/tvm/include/tvm/runtime/memory.h:196
5: tvm::runtime::ObjectPtr<mlc::llm::serve::ModelImpl>
tvm::runtime::ObjAllocatorBase<tvm::runtime::SimpleObjAllocator>::make_object<mlc::llm::serve::ModelImpl,
tvm::runtime::String&, tvm::runtime::String&,
picojson::object_with_ordered_keys const&, DLDevice&,
tvm::runtime::Optional<tvm::runtime::Session> const&,
bool&>(tvm::runtime::String&, tvm::runtime::String&,
picojson::object_with_ordered_keys const&, DLDevice&,
tvm::runtime::Optional<tvm::runtime::Session> const&, bool&)
at mlc-llm/3rdparty/tvm/include/tvm/runtime/memory.h:72
4: mlc::llm::serve::ModelImpl*
tvm::runtime::SimpleObjAllocator::Handler<mlc::llm::serve::ModelImpl>::New<tvm::runtime::String&,
tvm::runtime::String&, picojson::object_with_ordered_keys const&, DLDevice&,
tvm::runtime::Optional<tvm::runtime::Session> const&,
bool&>(tvm::runtime::SimpleObjAllocator*, tvm::runtime::String&,
tvm::runtime::String&, picojson::object_with_ordered_keys const&, DLDevice&,
tvm::runtime::Optional<tvm::runtime::Session> const&, bool&)
at mlc-llm/3rdparty/tvm/include/tvm/runtime/memory.h:122
3: mlc::llm::serve::ModelImpl::ModelImpl(tvm::runtime::String,
tvm::runtime::String, picojson::object_with_ordered_keys, DLDevice,
tvm::runtime::Optional<tvm::runtime::Session> const&, bool)
at /mlc-llm/cpp/serve/model.cc:66
2: mlc::llm::serve::FunctionTable::Init(tvm::runtime::String, DLDevice,
picojson::object_with_ordered_keys,
tvm::runtime::Optional<tvm::runtime::Session>)
at /mlc-llm/cpp/serve/function_table.cc:133
1:
tvm::runtime::relax_vm::VirtualMachineImpl::_Init(tvm::runtime::TVMArgs,
tvm::runtime::TVMRetValue*)
0: tvm::runtime::relax_vm::VirtualMachineImpl::InitFuncPool()
File "/mlc-llm/3rdparty/tvm/src/runtime/relax_vm/vm.cc", line 707
InternalError: **Check failed: (func.defined()) is false: Error: Cannot find
PackedFunc fused_relax_nn_conv2d_cudnn in either Relax VM kernel library, or in
TVM runtime PackedFunc registry, or in global Relax functions of the VM
executable**`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
