HI folks, I have been looking into you guys’ work for a long time and it is great to see Crail accepted as an Apache Incubator project.
I authored the GPU Direct RDMA transport for TensorFlow (https://github.com/tensorflow/tensorflow/pull/11392), and I would love to see how we could design an end-to-end zero-copy dataflow from Crail to various deep learning framework such as TensorFlow (https://dl.acm.org/citation.cfm?doid=3123878.3131975). Is there any roadmap for Crail as a standalone language-independent FileSystem/Cache service with C API? That would really ease the integration into non-JVM based third party system. It does not have to be HDFS compatible if that brings extra performance cost. Best, Bairen
