gortiz commented on issue #12286: URL: https://github.com/apache/pinot/issues/12286#issuecomment-2314997416
Larray can be used to create buffers larger than >2GBs, but Larray is not maintained and not safe (see more in https://github.com/apache/pinot/issues/12810). With not safe I mean that there is no offset check when accessing memory with LArray, which means that: 1. it can be used to execute buffer overflow attacks (something we are not used in Java) 2. an error in an offset usually means that an illegal memory address is accessed which means that a SEGSEV is produced. For the context I'm not 100% sure this is the actual reason that produces the specific error reported here. In fact in some very strange scenarios we have seen SEGSEV errors even when using ByteBuffers when code is compiled with C2. But in general we recommend to do not use LArray and in fact Pinot 1.2.0 does not use LArray by default. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
