We would like to use ParquetIO but limit individual files written out a maximum size. Don’t see any easy way to do this, and it seems like default behavior is to split based on parallelism? Anyone have any guidance on this?
- ParquetIO - max file size? [email protected]
- Re: ParquetIO - max file size? Chamikara Jayalath
