There will be a conflict if we use ip_conntrack_destroyed() to handle it, for ONLY one single function can register on it. AFAIK, it is used by the NAT...
I think if it is necessary to make a handle for it, then I can release the private data in my module with ease, or I should repeated implement the destroy algorithm. Any IDEA is welcome, Thanks