How to measure IO time in Spark over S3

[Gili Nachum]

Hi!

How can I tell IO duration for a Spark application doing R/W from S3 (using
S3 as a filesystem sc.textFile("s3a://...")?
I would like to know the % of time doing IO of the overall app execution
time.

Gili.