In the documenation I was looking for a linkage to Apache Arrow for example to do similar things like this: A gentle introduction to Apache Arrow with Apache Spark and Pandas | by Antonio Cachuan | Towards Data Science <https://towardsdatascience.com/a-gentle-introduction-to-apache-arrow-with-apache-spark-and-pandas-bb19ffe0ddae>
So would indeed be a neat feature to support Apache Arrow specification directly: Apache Arrow | Apache Arrow <https://arrow.apache.org/> Specs: Arrow Columnar Format — Apache Arrow v7.0.0 <https://arrow.apache.org/docs/format/Columnar.html> So for instance that dataframes can be accessed directly via Python, R or other programming languages. What do you think? Regards, otluk
