alamb opened a new issue, #10014:
URL: https://github.com/apache/arrow-datafusion/issues/10014

   ### Is your feature request related to a problem or challenge?
   
   Reported by @crepererum 
   
   The state is initialized ONCE for all partitions. However this may take a 
short while (on a very busy system 1ms or more). It is quite likely that 
multiple threads call execute at the same time, because we have just fanned out 
to the number "target partitions" which is likely set to the number of CPU 
cores which now all try to start to execute the plan at the same time.
   
   
   
   ### Describe the solution you'd like
   
   Minimize the lock contention
   
   ### Describe alternatives you've considered
   
   _No response_
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to