What would you do with it once you get it into driver in a Dataset[Row]? Sent from my iPhone
> On Apr 22, 2020, at 3:06 AM, maqy <454618...@qq.com> wrote: > > > When the data is stored in the Dataset [Row] format, the memory usage is very > small. > When I use collect () to collect data to the driver, each line of the dataset > will be converted to Row and stored in an array, which will bring great > memory overhead. > So, can I collect Dataset[Row] to driver and keep its data format? > > Best regards, > maqy >
