Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/2706#discussion_r217049111
--- Diff:
processing/src/main/java/org/apache/carbondata/processing/loading/sort/unsafe/UnsafeSortDataRows.java
---
@@ -94,21 +94,30 @@
private final long taskId;
- public UnsafeSortDataRows(SortParameters parameters,
- UnsafeIntermediateMerger unsafeInMemoryIntermediateFileMerger, int
inMemoryChunkSize) {
- this.parameters = parameters;
- this.tableFieldStat = new TableFieldStat(parameters);
- this.rowBuffer = new ThreadLocal<ByteBuffer>() {
+ public static ThreadLocal<ByteBuffer> getRowBuffer() {
+ return rowBuffer;
+ }
+
+ static {
+ rowBuffer = new ThreadLocal<ByteBuffer>() {
--- End diff --
Please try using DataOutSteam backed by ByteOutPutStream, it can expand
dynamically.
---