Hello, I've implemented support for my DSv2 plugin to back its storage with ArrowColumnVectors, which necessarily means using off-heap memory. Is it possible to somehow grab either a reference to the current MemoryManager so that the off-heap memory usage is properly accounted for and to prevent inadvertently OOM-ing the system?
Thanks Andrew --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org