conversion between pyspark.DataFrame and pyarrow.Table

[Radu Teodorescu]

Hi,
I noticed that arrow is mentioned as an optional intermediary format for 
converting between pandas DFs and spark DFs. Is there a way to explicitly 
convert an pyarrow Table to a spark DataFrame and the other way around.
Absent that, going pysprak->pandas->pyarrow and back works but it’s obviously 
suboptimal.
Thank you
Radu