> On Jan 10, 2023, at 3:21 PM, Hinko Kocevar <hinko.koce...@ess.eu> wrote: > > >> On 10 Jan 2023, at 19:16, Dain Sundstrom <d...@iq80.com> wrote: >> >> 50,000 * 4 bytes ~= 200 kB, so this shouldn’t be a problem. Generally, >> large values can be a problem for some compute engines, but 200 kB isn’t >> that large. > > Thanks for the input! What counts as ”large” in your opinion?
Megabytes for a single row. > I plan on using Spark + python on the read / process side. I doubt it will be a problem. -dain
