alamb commented on issue #2427:
URL: 
https://github.com/apache/arrow-datafusion/issues/2427#issuecomment-1165903697

   Here is a trace from IOx showing a lot of time being spent sorting batches...
   
   ```
   22.02 s   22.7%      0 s                                                     
                   
iox_query::provider::deduplicate::deduplicate::_$u7b$$u7b$closure$u7d$$u7d$::hf3d0d2543c390834
   19.25 s   19.9%      0 s                                                     
                    
_$LT$futures_util..stream..stream..next..Next$LT$St$GT$$u20$as$u20$core..future..future..Future$GT$::poll::h6e92074c50cc7f69
   19.25 s   19.9%      0 s                                                     
                     
futures_util::stream::stream::StreamExt::poll_next_unpin::h0a7d4570974377a3
   19.25 s   19.9%      0 s                                                     
                      
_$LT$core..pin..Pin$LT$P$GT$$u20$as$u20$futures_core..stream..Stream$GT$::poll_next::hee2bdbc79b3020cf
   19.25 s   19.9%      0 s                                                     
                       
_$LT$datafusion..physical_plan..union..ObservedStream$u20$as$u20$futures_core..stream..Stream$GT$::poll_next::hf4bd36dcc3490171
   19.25 s   19.9%      0 s                                                     
                        
futures_util::stream::stream::StreamExt::poll_next_unpin::h0a7d4570974377a3
   19.25 s   19.9%      0 s                                                     
                         
_$LT$core..pin..Pin$LT$P$GT$$u20$as$u20$futures_core..stream..Stream$GT$::poll_next::hee2bdbc79b3020cf
   19.25 s   19.9%      0 s                                                     
                          
_$LT$datafusion..physical_plan..stream..RecordBatchStreamAdapter$LT$S$GT$$u20$as$u20$futures_core..stream..Stream$GT$::poll_next::h2cb791419b210a88
   19.25 s   19.9%      0 s                                                     
                           
_$LT$futures_util..stream..try_stream..try_flatten..TryFlatten$LT$St$GT$$u20$as$u20$futures_core..stream..Stream$GT$::poll_next::hecbc974d417753bb
   19.25 s   19.9%      0 s                                                     
                            
_$LT$S$u20$as$u20$futures_core..stream..TryStream$GT$::try_poll_next::ha20467981653b215
   19.25 s   19.9%      0 s                                                     
                             
_$LT$futures_util..stream..once..Once$LT$Fut$GT$$u20$as$u20$futures_core..stream..Stream$GT$::poll_next::h95fb74a12fffeea3
   19.25 s   19.9%      0 s                                                     
                              
_$LT$futures_util..future..try_future..MapErr$LT$Fut$C$F$GT$$u20$as$u20$core..future..future..Future$GT$::poll::h3230513ec689705a
   19.25 s   19.9%      0 s                                                     
                               
_$LT$futures_util..future..future..Map$LT$Fut$C$F$GT$$u20$as$u20$core..future..future..Future$GT$::poll::h464940ca2f951951
   19.25 s   19.9%      0 s                                                     
                                
_$LT$futures_util..future..future..map..Map$LT$Fut$C$F$GT$$u20$as$u20$core..future..future..Future$GT$::poll::heb35220cf8b84857
   19.25 s   19.9%      0 s                                                     
                                 
_$LT$futures_util..future..try_future..into_future..IntoFuture$LT$Fut$GT$$u20$as$u20$core..future..future..Future$GT$::poll::h55a6d3f5af84763f
   19.25 s   19.9%      0 s                                                     
                                  
_$LT$F$u20$as$u20$futures_core..future..TryFuture$GT$::try_poll::hf219144ea170e2c8
   19.25 s   19.9%      0 s                                                     
                                   
_$LT$core..future..from_generator..GenFuture$LT$T$GT$$u20$as$u20$core..future..future..Future$GT$::poll::h79164ac5d2444444
   19.25 s   19.9%      0 s                                                     
                                    
datafusion::physical_plan::sorts::sort::do_sort::_$u7b$$u7b$closure$u7d$$u7d$::h40cf3c40db84fa17
   19.24 s   19.9%      0 s                                                     
                                     
_$LT$core..future..from_generator..GenFuture$LT$T$GT$$u20$as$u20$core..future..future..Future$GT$::poll::hf5dad25a12c01571
   19.24 s   19.9%      0 s                                                     
                                      
datafusion::physical_plan::sorts::sort::ExternalSorter::insert_batch::_$u7b$$u7b$closure$u7d$$u7d$::h09bf6567368d0832
   19.24 s   19.9%      0 s                                                     
                                       
datafusion::physical_plan::sorts::sort::sort_batch::h7b6b5407071c4f46
   18.64 s   19.2%      0 s                                                     
                                        
arrow::compute::kernels::sort::lexsort_to_indices::h4e2ca9dbf2774da6
   18.61 s   19.2%      0 s                                                     
                                         
arrow::compute::kernels::sort::sort_unstable_by::h492ca4aa0dad4bef
   18.61 s   19.2%      0 s                                                     
                                          
core::slice::_$LT$impl$u20$$u5b$T$u5d$$GT$::sort_unstable_by::he9ab2244924b2cf3
   18.61 s   19.2%      0 s                                                     
                                           
core::slice::sort::quicksort::h2837f00ef0d13950
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to