Darshan Singh Mon, 11 Apr 2016 11:47:37 -0700
Hi, I would like to know if there is any max limit of union of data-frames. How does performance of say 10000 data frame union will be in spark of which all the data will be in cache?
Other option is 10000 partitions of a single dataframe. Thanks