Hi, I'd like to suggest this change to the PySpark code. I haven't contributed before so https://spark.apache.org/contributing.html suggested emailing here first.
In the error raised here https://github.com/apache/spark/blob/b2bfe985e8adf55e5df5887340fd862776033a06/python/pyspark/worker.py#L141, the columns returned can be difficult to identify. The error would be more helpful and clear if the columns returned were included in the error message like so, [image: image.png] Happy to help make this happen if I can. Thanks! Josh