Aharrypotter commented on issue #19505: URL: https://github.com/apache/tvm/issues/19505#issuecomment-4387299407
I've started working on this and have a preliminary PoC ready. **What it does:** - Introduces a test runner that feeds ONNX Backend Test node-level cases into `relax.frontend.onnx.from_onnx` - Compiles the imported Relax module with the VM and compares against ONNX's expected protobuf outputs - Restricts the runner to `NodeModel` tests only (filters out real/simple/PyTorch model tests via `BackendTest._test_items` with layout validation) - Adds `onnx_backend` pytest marker and `SKIP_SLOW_TESTS` support **Current status:** - 2406 node tests collected - Representative subset (add, relu, gemm, conv, top_k, optional_get_element) passes; 1 xfail on `test_top_k_cpu` (dynamic k not yet supported) - Full suite will be run in CI; known xfails are documented per importer gap category **Approach note:** ONNX does not expose a public API to select only node tests, so the runner localizes `_test_items` access in one helper with assertions that fail collection if ONNX changes the internal layout. I'll submit a Draft PR tonight for early feedback on the integration strategy. The PR will intentionally not fix importer gaps—those will be addressed in follow-ups so each change stays reviewable. cc @KJlaccHoeUM9l @junrushao -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
