Hi,
All I want to do is that,
1. read from some source
2. do some calculation to get some byte array
3. write the byte array to hdfs
In hadoop, I can share an ImmutableByteWritable, and do some
System.arrayCopy, it will prevent the application from creating a lot of
small objects which will improve the gc latency.
*However I was wondering if there is any solution like above in spark
that can avoid creating small objects*
- avoid creating small objects 周千昊
- Re: avoid creating small objects 周千昊
- Re: avoid creating small objects Reynold Xin
