jinchengchenghh commented on issue #5766:
URL:
https://github.com/apache/incubator-gluten/issues/5766#issuecomment-2126691925
I could not reproduce this issue, I test TPCH Q6 with data 600G, and print
the peak every time arrow reserve memory.
```
public void reserve(long size) {
synchronized (this) {
sharedUsage.inc(size);
}
System.out.println(sharedUsage.peak());
}
```
This is the test result
```
18350080
17825792:============================================> (94 + 18) /
116]
18350080
17825792
18350080
17825792
18350080
17825792
18350080
17825792:=============================================> (95 + 18) /
116]
18350080
17825792
18350080
17825792:=============================================> (97 + 18) /
116]
18350080
17825792:==============================================> (98 + 18) /
116]
18350080
17825792
```
After I change the --master from local[18] to local[2], same peak memory
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
