devin-petersohn commented on PR #53391: URL: https://github.com/apache/spark/pull/53391#issuecomment-3634868653
Thanks for the comment @gaogaotiantian. From my understanding, `__arrow_c_stream__` is the interface for exporting PyCapsule objects (which this PR does) - https://arrow.apache.org/docs/format/CDataInterface/PyCapsuleInterface.html. Please feel free to suggest and alternative title, I am not tied to any title, as long as it is accurate. I am okay removing `__dataframe__` from this PR altogether, since that seems to be where the concerns are. In fact, `__dataframe__` is already legacy and on its way toward being deprecated in `pandas` and many other libraries, but a lot of libraries still rely on it. Moving forward, projects are expected to conform to the PyCapsule interface (https://github.com/pandas-dev/pandas/commit/865ae1dc1e4fa986ba654f72ab347b612516d353). What do you think about removing `__dataframe__` from this PR and focusing on the PyCapsule interface @gaogaotiantian? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
