[tvm] branch main updated: [CI] Allow Limit CPUs in Docker (#15668)

This is an automated email from the ASF dual-hosted git repository. junrushao pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/main by this push: new ea388e5e74 [CI] Allow Limit CPUs in Docker (#15668)

[GitHub] [tvm] junrushao merged pull request #15668: [CI] Allow Limit CPUs in Docker

junrushao merged PR #15668: URL: https://github.com/apache/tvm/pull/15668 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [tvm] abhikran-quic opened a new pull request, #15678: [UNITY][Pass] Optimize redundant layout transform ops

abhikran-quic opened a new pull request, #15678: URL: https://github.com/apache/tvm/pull/15678 Relax `AlterOpImpl` pass introduces `layout_transform` operations. If the layouts match for consecutive `layout_transform` operations, they can be cancelled out. This pass tries to optimize

[tvm] branch nightly updated (476d9d1d41 -> d26fdcf3d1)

This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch nightly in repository https://gitbox.apache.org/repos/asf/tvm.git from 476d9d1d41 Add output_data_sec section in corstone300.ld (#15649) add 04ee895d8d [IR] Use structural equal for

[GitHub] [tvm] MasterJH5574 opened a new pull request, #15677: [BugFix][Arith] IterMapRewriter abort rewriting once failure

MasterJH5574 opened a new pull request, #15677: URL: https://github.com/apache/tvm/pull/15677 This PR fixes an issue of the IterMapRewriter. Prior to this PR, the mutation function of the rewriter class returns the mutation results even when an invalid PrimExpr pattern was detected.

[GitHub] [tvm] jikechao closed issue #15004: [Bug][Relay] func ` _expr.const(c)` get an unexpected crash: 'NoneType' object has no attribute 'dtype'

jikechao closed issue #15004: [Bug][Relay] func ` _expr.const(c)` get an unexpected crash: 'NoneType' object has no attribute 'dtype' URL: https://github.com/apache/tvm/issues/15004 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[tvm] branch unity updated (a0e0390f0b -> 37ad0497fe)

This is an automated email from the ASF dual-hosted git repository. bohan pushed a change to branch unity in repository https://gitbox.apache.org/repos/asf/tvm.git from a0e0390f0b [Unity] RealizeVDevice pass (#15636) add 37ad0497fe [Unity] Add support for Google Pixel OpenCL (#15675)

[GitHub] [tvm] spectrometerHBH merged pull request #15675: [Unity] Add support for Google Pixel OpenCL

spectrometerHBH merged PR #15675: URL: https://github.com/apache/tvm/pull/15675 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [tvm] jinhongyii commented on a diff in pull request #15674: [Unity][Disco] Minor change for MLC+Disco integration

jinhongyii commented on code in PR #15674: URL: https://github.com/apache/tvm/pull/15674#discussion_r1316539990 ## include/tvm/runtime/disco/session.h: ## @@ -195,6 +195,18 @@ class SessionObj : public Object { * \param host_array The array to be copied to worker-0 *

[GitHub] [tvm] jinhongyii commented on a diff in pull request #15674: [Unity][Disco] Minor change for MLC+Disco integration

jinhongyii commented on code in PR #15674: URL: https://github.com/apache/tvm/pull/15674#discussion_r1316538803 ## include/tvm/runtime/disco/session.h: ## @@ -236,7 +248,7 @@ class Session : public ObjectRef { public: /*! \brief Create a session backed by a thread pool of

[GitHub] [tvm] junrushao commented on a diff in pull request #15674: [Unity][Disco] Minor change for MLC+Disco integration

junrushao commented on code in PR #15674: URL: https://github.com/apache/tvm/pull/15674#discussion_r1316532945 ## include/tvm/runtime/disco/session.h: ## @@ -236,7 +248,7 @@ class Session : public ObjectRef { public: /*! \brief Create a session backed by a thread pool of

[GitHub] [tvm] jinhongyii commented on a diff in pull request #15674: [Unity][Disco] Minor change for MLC+Disco integration

jinhongyii commented on code in PR #15674: URL: https://github.com/apache/tvm/pull/15674#discussion_r1316518795 ## include/tvm/runtime/disco/session.h: ## @@ -236,7 +248,7 @@ class Session : public ObjectRef { public: /*! \brief Create a session backed by a thread pool of

[GitHub] [tvm] jinhongyii commented on a diff in pull request #15674: [Unity][Disco] Minor change for MLC+Disco integration

jinhongyii commented on code in PR #15674: URL: https://github.com/apache/tvm/pull/15674#discussion_r1316518795 ## include/tvm/runtime/disco/session.h: ## @@ -236,7 +248,7 @@ class Session : public ObjectRef { public: /*! \brief Create a session backed by a thread pool of

[GitHub] [tvm] csullivan opened a new pull request, #15676: [Disco] Add loader for presharded params.

csullivan opened a new pull request, #15676: URL: https://github.com/apache/tvm/pull/15676 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[GitHub] [tvm] junrushao commented on a diff in pull request #15674: [Unity][Disco] Minor change for MLC+Disco integration

junrushao commented on code in PR #15674: URL: https://github.com/apache/tvm/pull/15674#discussion_r1316514867 ## include/tvm/runtime/disco/session.h: ## @@ -155,7 +155,7 @@ class DRefObj : public Object { */ class DRef : public ObjectRef { public: -

[GitHub] [tvm] junrushao commented on a diff in pull request #15674: [Unity][Disco] Minor change for MLC+Disco integration

junrushao commented on code in PR #15674: URL: https://github.com/apache/tvm/pull/15674#discussion_r1316514183 ## include/tvm/runtime/disco/session.h: ## @@ -195,6 +195,18 @@ class SessionObj : public Object { * \param host_array The array to be copied to worker-0 *

[GitHub] [tvm] junrushao commented on a diff in pull request #15674: [Unity][Disco] Minor change for MLC+Disco integration

junrushao commented on code in PR #15674: URL: https://github.com/apache/tvm/pull/15674#discussion_r1316513189 ## include/tvm/runtime/disco/session.h: ## @@ -236,7 +248,7 @@ class Session : public ObjectRef { public: /*! \brief Create a session backed by a thread pool of

[GitHub] [tvm] tqchen commented on a diff in pull request #15674: [Unity][Disco] Minor change for MLC+Disco integration

tqchen commented on code in PR #15674: URL: https://github.com/apache/tvm/pull/15674#discussion_r1316512081 ## include/tvm/runtime/disco/session.h: ## @@ -195,6 +195,18 @@ class SessionObj : public Object { * \param host_array The array to be copied to worker-0 * \param

[GitHub] [tvm] junrushao commented on pull request #14460: [Unity][Frontend] Translate StableHLO to Relax

junrushao commented on PR #14460: URL: https://github.com/apache/tvm/pull/14460#issuecomment-1707430345 Note on unittests: in the future, we want to migrate `check_correctness`-based numerical tests to IR structural equality test, which is much more accurate and to-the-point -- This is

[GitHub] [tvm] cyx-6 opened a new pull request, #15675: [Unity] Add support for Google Pixel OpenCL

cyx-6 opened a new pull request, #15675: URL: https://github.com/apache/tvm/pull/15675 This is a cherry pick commit from https://github.com/mlc-ai/relax/pull/282, to enable OpenCL on Google Pixel device. cc: @alex4o -- This is an automated message from the Apache Git Service. To

[tvm] branch main updated: [Hopper TMA] Add CUDA codegen support for bulk asynchronous copy (#15656)

This is an automated email from the ASF dual-hosted git repository. masahi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/main by this push: new d26fdcf3d1 [Hopper TMA] Add CUDA codegen support for

[GitHub] [tvm] masahi merged pull request #15656: [Hopper TMA] Add CUDA codegen support for bulk asynchronous copy

masahi merged PR #15656: URL: https://github.com/apache/tvm/pull/15656 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [tvm] jinhongyii commented on a diff in pull request #15673: [Unity][Disco] Refactor shard loader

jinhongyii commented on code in PR #15673: URL: https://github.com/apache/tvm/pull/15673#discussion_r1316425796 ## src/runtime/disco/loader.cc: ## @@ -43,7 +43,7 @@ class ShardLoaderObj : public Object { /*! \brief Create a shard loader. */ static ObjectRef Create(const

[GitHub] [tvm] junrushao commented on a diff in pull request #15673: [Unity][Disco] Refactor shard loader

junrushao commented on code in PR #15673: URL: https://github.com/apache/tvm/pull/15673#discussion_r1316423495 ## src/runtime/disco/loader.cc: ## @@ -43,7 +43,7 @@ class ShardLoaderObj : public Object { /*! \brief Create a shard loader. */ static ObjectRef Create(const

[GitHub] [tvm] junrushao commented on a diff in pull request #15673: [Unity][Disco] Refactor shard loader

junrushao commented on code in PR #15673: URL: https://github.com/apache/tvm/pull/15673#discussion_r1316421990 ## src/runtime/disco/loader.cc: ## @@ -93,9 +93,18 @@ inline std::vector ShardShape(const ShapeTuple& shape, i return result; } +class ShardInfoCompare { +

[GitHub] [tvm] jinhongyii commented on pull request #15674: [Unity][Disco] Minor change for MLC+Disco integration

jinhongyii commented on PR #15674: URL: https://github.com/apache/tvm/pull/15674#issuecomment-1707327306 cc: @junrushao @tqchen -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [tvm] jinhongyii opened a new pull request, #15674: [Unity][Disco] Minor change for MLC+Disco integration

jinhongyii opened a new pull request, #15674: URL: https://github.com/apache/tvm/pull/15674 1. Add wrapper for copytoworker0 2. change DRef and Session to nullable for easy initlialization 3. add a "func_exists" function in executable -- This is an automated message from the Apache

[GitHub] [tvm] jinhongyii opened a new pull request, #15673: [Unity][Disco] Refactor shard loader

jinhongyii opened a new pull request, #15673: URL: https://github.com/apache/tvm/pull/15673 1. support default f_shard 2. add API ShardLoaderLoadAll 3. broadcast when no sharding dim is specified -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [tvm] jinhongyii commented on pull request #15673: [Unity][Disco] Refactor shard loader

jinhongyii commented on PR #15673: URL: https://github.com/apache/tvm/pull/15673#issuecomment-1707323862 cc: @junrushao @tqchen -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[tvm-vta] branch disco-integration deleted (was 0a75b2c)

This is an automated email from the ASF dual-hosted git repository. hongyij pushed a change to branch disco-integration in repository https://gitbox.apache.org/repos/asf/tvm-vta.git was 0a75b2c get vocab size from config This change permanently discards the following revisions: discard

[tvm-vta] branch disco-integration created (now 0a75b2c)

This is an automated email from the ASF dual-hosted git repository. hongyij pushed a change to branch disco-integration in repository https://gitbox.apache.org/repos/asf/tvm-vta.git at 0a75b2c get vocab size from config This branch includes the following new commits: new cea09f2

[GitHub] [tvm] junrushao commented on a diff in pull request #15670: [Unity][Frontend][NN] Enable tuple/list input

junrushao commented on code in PR #15670: URL: https://github.com/apache/tvm/pull/15670#discussion_r1316271852 ## python/tvm/relax/frontend/nn/core.py: ## @@ -39,6 +39,7 @@ import numpy as np +import tvm Review Comment: don't import tvm directly inside the tvm pacakge

[GitHub] [tvm] junrushao commented on pull request #15636: [Unity] RealizeVDevice pass

junrushao commented on PR #15636: URL: https://github.com/apache/tvm/pull/15636#issuecomment-1707119861 This is awesome work! Thanks @yongwww! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [tvm] csullivan commented on issue #15101: [Unity] [Tracking Issue] Heterogeneous execution for Relax

csullivan commented on issue #15101: URL: https://github.com/apache/tvm/issues/15101#issuecomment-1707069136 Thank you for bringing support for heterogeneous graphs @yongwww! Shall we close this as completed? -- This is an automated message from the Apache Git Service. To respond to the

[tvm] branch unity updated: [Unity] RealizeVDevice pass (#15636)

This is an automated email from the ASF dual-hosted git repository. csullivan pushed a commit to branch unity in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/unity by this push: new a0e0390f0b [Unity] RealizeVDevice pass (#15636)

[GitHub] [tvm] csullivan merged pull request #15636: [Unity] RealizeVDevice pass

csullivan merged PR #15636: URL: https://github.com/apache/tvm/pull/15636 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[tvm] branch main updated: [IR] Use structural equal for Range equality (#15664)

This is an automated email from the ASF dual-hosted git repository. kparzysz pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm.git The following commit(s) were added to refs/heads/main by this push: new 04ee895d8d [IR] Use structural equal for Range

[GitHub] [tvm] kparzysz-quic merged pull request #15664: [IR] Use structural equal for Range equality

kparzysz-quic merged PR #15664: URL: https://github.com/apache/tvm/pull/15664 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [tvm] ashutosh-arm commented on a diff in pull request #15667: [microTVM] Check the output of microNPU demos in CI

ashutosh-arm commented on code in PR #15667: URL: https://github.com/apache/tvm/pull/15667#discussion_r1316163715 ## tests/scripts/task_demo_microtvm.sh: ## @@ -20,6 +20,12 @@ set -euxo pipefail source tests/scripts/setup-pytest-env.sh +cleanup() +{ +rm -f out.log +}

[GitHub] [tvm] yongwww commented on pull request #15636: [Unity] RealizeVDevice pass

yongwww commented on PR #15636: URL: https://github.com/apache/tvm/pull/15636#issuecomment-1706957074 I will land it if no further comments. cc: @psrivas2 @junrushao @csullivan @Lunderberg -- This is an automated message from the Apache Git Service. To respond to the message, please log

[tvm-site] branch asf-site updated: Add doap

This is an automated email from the ASF dual-hosted git repository. tqchen pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/tvm-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 1cd8d3ba5a Add doap 1cd8d3ba5a is

[tvm-site] branch main updated: Add doap

This is an automated email from the ASF dual-hosted git repository. tqchen pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/tvm-site.git The following commit(s) were added to refs/heads/main by this push: new 45276ae4ef Add doap 45276ae4ef is described below

[GitHub] [tvm] Lunderberg opened a new pull request, #15672: [IR] Implemented Variant<...> container

Lunderberg opened a new pull request, #15672: URL: https://github.com/apache/tvm/pull/15672 This commit introduces a new container, `Variant`, which is analogous to the `std::variant` introduced in C++17, the `enum` in Rust, or a tagged union in C. The `Variant` class is templated over

[GitHub] [tvm] Lunderberg commented on pull request #15627: [Unity][Analysis] Improve handling of symbolic variables

Lunderberg commented on PR #15627: URL: https://github.com/apache/tvm/pull/15627#issuecomment-1706744358 > Thanks @Lunderberg . One thing that we should consider is the overall overhead of simplifier and code simplicity. Ideally the deduction should be a fast path Thank you for the

[GitHub] [tvm] Thrsu commented on issue #15669: [Bug] [Unity] Error with 'munmap_chunk(): invalid pointer' when importing 'torch' after importing 'tvm'

Thrsu commented on issue #15669: URL: https://github.com/apache/tvm/issues/15669#issuecomment-1706694799 > Hi @Thrsu perhaps you can try the suggestion here: [#9362 (comment)](https://github.com/apache/tvm/issues/9362#issuecomment-955263494) Thank you for your prompt response! --

[GitHub] [tvm] adstraw commented on a diff in pull request #15656: [Hopper TMA] Add CUDA codegen support for bulk asynchronous copy

adstraw commented on code in PR #15656: URL: https://github.com/apache/tvm/pull/15656#discussion_r1315918041 ## include/tvm/tir/builtin.h: ## @@ -645,14 +645,29 @@ TVM_DLL const Op& ptx_mma_sp(); TVM_DLL const Op& ptx_ldmatrix(); /*! - * \brief tvm intrinsics for ptx async

[GitHub] [tvm] lhutton1 commented on pull request #15648: [Relay][TOPI] Remove input padding for arm_cpu conv2d int8 native schedule in Legalize pass

lhutton1 commented on PR #15648: URL: https://github.com/apache/tvm/pull/15648#issuecomment-1706540666 Awesome, thanks for checking! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [tvm] Anndrey24 commented on pull request #15648: [Relay][TOPI] Remove input padding for arm_cpu conv2d int8 native schedule in Legalize pass

Anndrey24 commented on PR #15648: URL: https://github.com/apache/tvm/pull/15648#issuecomment-1706406306 Regarding the tests, it seems that all of the padding cases are already visited at least once in:

[GitHub] [tvm] Anndrey24 commented on a diff in pull request #15648: [Relay][TOPI] Remove input padding for arm_cpu conv2d int8 native schedule in Legalize pass

Anndrey24 commented on code in PR #15648: URL: https://github.com/apache/tvm/pull/15648#discussion_r1315722536 ## python/tvm/topi/arm_cpu/conv2d_gemm.py: ## @@ -326,7 +328,12 @@ def schedule_conv2d_gemm_interleaved(cfg, s, out, final_out): b, m, n = data_im2col.op.axis

[GitHub] [tvm] lhutton1 commented on a diff in pull request #15648: [Relay][TOPI] Remove input padding for arm_cpu conv2d int8 native schedule in Legalize pass

lhutton1 commented on code in PR #15648: URL: https://github.com/apache/tvm/pull/15648#discussion_r1315667771 ## python/tvm/topi/arm_cpu/conv2d_gemm.py: ## @@ -428,12 +435,29 @@ def schedule_conv2d_gemm_native(cfg, s, out, final_out): b, m, n = data_im2col.op.axis

[GitHub] [tvm] masahi commented on a diff in pull request #15656: [Hopper TMA] Add CUDA codegen support for bulk asynchronous copy

masahi commented on code in PR #15656: URL: https://github.com/apache/tvm/pull/15656#discussion_r1315592599 ## include/tvm/tir/builtin.h: ## @@ -645,14 +645,29 @@ TVM_DLL const Op& ptx_mma_sp(); TVM_DLL const Op& ptx_ldmatrix(); /*! - * \brief tvm intrinsics for ptx async

[GitHub] [tvm] masahi commented on a diff in pull request #15656: [Hopper TMA] Add CUDA codegen support for bulk asynchronous copy

masahi commented on code in PR #15656: URL: https://github.com/apache/tvm/pull/15656#discussion_r1315572243 ## python/tvm/tir/op.py: ## @@ -1458,16 +1512,42 @@ def ptx_arrive_barrier(barrier_arr, barrier_id): return call_intrin("", "tir.ptx_arrive_barrier", barrier_arr,

[GitHub] [tvm] echuraev opened a new pull request, #15671: [VM][Adreno] Fix using buffers for weights in VM

echuraev opened a new pull request, #15671: URL: https://github.com/apache/tvm/pull/15671 In VM `fn->attrs` doesn't contain information about `kernel_layout`. So we can get this value from `expr_attrib`. In this PR function `CanUseBuffers` was modified to work with VM. A new test

[GitHub] [tvm] xiaolong18 commented on pull request #13728: [Relay][Frontend] Span Filling TensorFlow 1

xiaolong18 commented on PR #13728: URL: https://github.com/apache/tvm/pull/13728#issuecomment-1706144376 @chunit-quic Thank you for your work，I want to ask you a question， I tested the tests/python/frontend/tensorflow/test_forward.py::test_forward_dynmaic_rnn_lstmblockcell and report

[GitHub] [tvm] lhutton1 commented on issue #15669: [Bug] [Unity] Error with 'munmap_chunk(): invalid pointer' when importing 'torch' after importing 'tvm'

lhutton1 commented on issue #15669: URL: https://github.com/apache/tvm/issues/15669#issuecomment-1706123357 Hi @Thrsu perhaps you can try the suggestion here: https://github.com/apache/tvm/issues/9362#issuecomment-955263494 -- This is an automated message from the Apache Git Service. To

[GitHub] [tvm] LeshengJin opened a new pull request, #15670: [Unity][Frontend][NN] Enable tuple/list input

LeshengJin opened a new pull request, #15670: URL: https://github.com/apache/tvm/pull/15670 - Enable tuple/list input for models, with nesting support. - Add GPU schedule Pass when `device` is not cpu. - Correct the order of inputs for JIT execution. -- This is an automated message