How can I determine the size (in bytes) of a broadcast variable? Do I need to use the .dump method and then look at the size of the result, or is there an easier way?
Using PySpark with Spark 1.6. Thanks! Apu
How can I determine the size (in bytes) of a broadcast variable? Do I need to use the .dump method and then look at the size of the result, or is there an easier way?
Using PySpark with Spark 1.6. Thanks! Apu