spark version? Are you using tungsten? > On 14 Nov 2016, at 10:05, Prithish <prith...@gmail.com> wrote: > > Can someone please explain why this happens? > > When I read a 600kb AVRO file and cache this in memory (using cacheTable), it > shows up as 11mb (storage tab in Spark UI). I have tried this with different > file sizes, and the size in-memory is always proportionate. I thought Spark > compresses when using cacheTable.
--------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
