Github user icexelloss commented on the issue:
    Sorry I am late to the party. Does look 
like a bug to me. However, I am a bit concerned that such magic behavior would 
be not ideal to some users. At least from python users at Two Sigma, most of 
they would prefer a "fail fast" exception rather than fall back to non-Arrow 
path as non-Arrow path, because the non-Arrow path could often take a long time 
to complete, or worse, "fail slow". Implementing this behavior and not having a 
way to turn it off could be problematic for users that transfers non trivial 
amounts of data from Spark to Pandas.


To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to