https://spark.apache.org/docs/latest/tuning.html#memory-management-overview
What is the meaning of : "Execution may evict storage if necessary, but only until total storage memory usage falls under a certain threshold (R). In other words, R describes a subregion within M where cached blocks are never evicted. " This seems contradictory, in simple terms I find the meaning that once total memory usage crosses a threshold(R) Spark will start evicting storage in a LRU fashion. But the line: "In other words, R describes a subregion within M where cached blocks are never evicted." Seems contradictory, what is going on? -- Regards, Sreyan Chakravarty
