paleolimbot commented on PR #14582:
URL: https://github.com/apache/arrow/pull/14582#issuecomment-1355173130
A more detailed investigation of the threads present when the hang occurs.
The first problem is that there is one more exec plan than I expect....I
expected there to be one, but it seems like there are two.
The R code. Run this from a terminal (not from RStudio). Conceptually I
expect
this to create one exec plan for `open_dataset() |> filter()`. The resulting
`RecordBatchReader` will get read into a `Table`; no evaluation of the
ExecPlan
should occur before the `reader->ToTable();` call. That call should occur on
a non main-R thread launched by `RunWithCapturedR()`. Currently that thread
is borrowed from the IO thread pool.
```r
library(arrow, warn.conflicts = FALSE)
# Information you need to attach LLDB
Sys.getpid()
dataset_dir <- tempfile()
write_dataset(mtcars, dataset_dir)
# change to set_cpu_count(1) to reproduce the deadlock
set_cpu_count(1)
open_dataset(dataset_dir) |>
dplyr::filter(mpg > 30) |>
head() |>
dplyr::collect()
```
This will hang. Attach LLDB in VSCode or a terminal.
## Thread 1
The main R thread, waiting for SafeCallIntoR jobs to be submitted. This seems
normal.
<details>
```
bt
* thread #1, queue = 'com.apple.main-thread', stop reason = signal SIGSTOP
* frame #0: 0x00000001a1cba5e4 libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x00000001a1cf6638 libsystem_pthread.dylib`_pthread_cond_wait
+ 1232
frame #2: 0x00000001a1c43ac4
libc++.1.dylib`std::__1::condition_variable::wait(std::__1::unique_lock<std::__1::mutex>&)
+ 28
frame #3: 0x0000000280806520 libarrow.1100.0.0.dylib`void
std::__1::condition_variable::wait<arrow::internal::SerialExecutor::RunLoop()::$_0>(this=0x0000600000a88208,
__lk=0x000000016afcece8, __pred=(0x000000016afced58))::$_0) at
__mutex_base:404:9
frame #4: 0x0000000280805b74
libarrow.1100.0.0.dylib`arrow::internal::SerialExecutor::RunLoop(this=0x000000016afced58)
at thread_pool.cc:174:28
frame #5: 0x000000010948a324
arrow.so`arrow::Future<std::__1::shared_ptr<arrow::Table>>
arrow::internal::SerialExecutor::Run<std::__1::shared_ptr<arrow::Table>,
arrow::Result<std::__1::shared_ptr<arrow::Table>>>(this=0x000000016afced58,
initial_task=arrow::internal::SerialExecutor::TopLevelTask<std::__1::shared_ptr<arrow::Table>
> @ 0x000000016afced50)>) at thread_pool.h:392:5 [opt]
frame #6: 0x0000000109489efc
arrow.so`arrow::Result<std::__1::shared_ptr<arrow::Table>>
arrow::internal::SerialExecutor::RunInSerialExecutor<std::__1::shared_ptr<arrow::Table>,
arrow::Future<std::__1::shared_ptr<arrow::Table>>,
arrow::Result<std::__1::shared_ptr<arrow::Table>>>(initial_task=arrow::internal::SerialExecutor::TopLevelTask<std::__1::shared_ptr<arrow::Table>
> @ 0x000000016afcedb0)>) at thread_pool.h:289:38 [opt]
frame #7: 0x0000000109489ca4
arrow.so`arrow::Result<std::__1::shared_ptr<arrow::Table>>
RunWithCapturedR<std::__1::shared_ptr<arrow::Table>>(make_arrow_call=function<arrow::Future<std::__1::shared_ptr<arrow::Table>
> ()> @ 0x000000016afcee48)>) at safe-call-into-r.h:287:29 [opt]
frame #8: 0x000000010947a8dc
arrow.so`arrow::Result<std::__1::shared_ptr<arrow::Table>>
RunWithCapturedRIfPossible<std::__1::shared_ptr<arrow::Table>>(make_arrow_call=function<arrow::Result<std::__1::shared_ptr<arrow::Table>
> ()> @ 0x000000016afceea0)>) at safe-call-into-r.h:314:12 [opt]
frame #9: 0x000000010947a784
arrow.so`Table__from_ExecPlanReader(reader=<unavailable>) at
compute-exec.cpp:195:17 [opt]
(omitting higher up frames involved in the R code that calls this C++
function)
```
</details>
## Thread 2
This one seems like a signal handler of some kind but doesn't have any Arrow
(R or C++) in the backtrace. It doesn't seem suspicious.
<details>
```
thread #2
frame #0: 0x00000001a1cba3e0 libsystem_kernel.dylib`__semwait_signal + 8
frame #1: 0x00000001a1bc45b0 libsystem_c.dylib`nanosleep + 220
frame #2: 0x000000010764bf70 cli.so`clic_thread_func(arg=<unavailable>)
at thread.c:37:5 [opt]
frame #3: 0x00000001a1cf606c libsystem_pthread.dylib`_pthread_start + 148
```
</details>
## Thread 3
Has some calls that I would expect to occur. Notably,
`RecordBatchReaderHead::ReadNext()`,
which in turn calls `ExecPlanReader::ReadNext()`. The top level of the call
stack
seems to indicate that there is a BackgroundGenerator involved. That
suggests to
me that an `ExecPlan` is somehow involved in the `RecordBatchReader` to
`Table` collection, which I didn't expect. This thread is waiting on
`ExecPlanReader::ReadNext()`.
<details>
```
bt
thread #3
frame #0: 0x00000001a1cba5e4 libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x00000001a1cf6638 libsystem_pthread.dylib`_pthread_cond_wait
+ 1232
frame #2: 0x00000001a1c43ac4
libc++.1.dylib`std::__1::condition_variable::wait(std::__1::unique_lock<std::__1::mutex>&)
+ 28
frame #3: 0x000000028079288c libarrow.1100.0.0.dylib`void
std::__1::condition_variable::wait<arrow::ConcreteFutureImpl::DoWait()::'lambda'()>(this=0x0000600000a9a908,
__lk=0x000000016b3226e8, __pred=(0x0000600000a9a880))::'lambda'()) at
__mutex_base:404:9
frame #4: 0x0000000280790ef8
libarrow.1100.0.0.dylib`arrow::ConcreteFutureImpl::DoWait(this=0x0000600000a9a880)
at future.cc:154:9
frame #5: 0x0000000280790e84
libarrow.1100.0.0.dylib`arrow::FutureImpl::Wait(this=0x0000600000a9a880) at
future.cc:189:52
frame #6: 0x000000010948c478
arrow.so`ExecPlanReader::ReadNext(std::__1::shared_ptr<arrow::RecordBatch>*)
[inlined]
arrow::Future<std::__1::optional<arrow::compute::ExecBatch>>::Wait(this=0x000000016b322740)
const at future.h:385:12 [opt]
frame #7: 0x000000010948c470
arrow.so`ExecPlanReader::ReadNext(std::__1::shared_ptr<arrow::RecordBatch>*)
[inlined]
arrow::Future<std::__1::optional<arrow::compute::ExecBatch>>::result(this=0x000000016b322740)
const & at future.h:356:5 [opt]
frame #8: 0x000000010948c470
arrow.so`ExecPlanReader::ReadNext(this=0x00006000011bc518,
batch_out=0x000000016b322880) at compute-exec.cpp:118:28 [opt]
frame #9: 0x000000010952f5c4
arrow.so`RecordBatchReaderHead::ReadNext(this=0x0000600001cbcf18,
batch_out=0x000000016b322880) at recordbatchreader.cpp:142:5 [opt]
frame #10: 0x000000010cbb839c
libarrow_dataset.1100.0.0.dylib`arrow::RecordBatchReader::Next(this=0x0000600001cbcf18)
at record_batch.h:243:5
frame #11: 0x000000010cdb47d8
libarrow_dataset.1100.0.0.dylib`arrow::Iterator<arrow::RecordBatchReader::ValueType>
arrow::MakeIteratorFromReader<arrow::RecordBatchReader>(this=(std::__1::shared_ptr<arrow::RecordBatchReader>::element_type
@ 0x0000600001cbcf18 strong=2 weak=1))::'lambda'()::operator()() const at
iterator.h:565:57
frame #12: 0x000000010cdb47a4
libarrow_dataset.1100.0.0.dylib`arrow::FunctionIterator<arrow::Iterator<arrow::RecordBatchReader::ValueType>
arrow::MakeIteratorFromReader<arrow::RecordBatchReader>(std::__1::shared_ptr<arrow::RecordBatchReader>
const&)::'lambda'(),
std::__1::shared_ptr<arrow::RecordBatch>>::Next(this=0x0000600003da1e00) at
iterator.h:346:29
frame #13: 0x000000010cdb4744
libarrow_dataset.1100.0.0.dylib`arrow::Result<std::__1::shared_ptr<arrow::RecordBatch>>
arrow::Iterator<std::__1::shared_ptr<arrow::RecordBatch>>::Next<arrow::FunctionIterator<arrow::Iterator<arrow::RecordBatchReader::ValueType>
arrow::MakeIteratorFromReader<arrow::RecordBatchReader>(ptr=0x0000600003da1e00)::'lambda'(),
std::__1::shared_ptr<arrow::RecordBatch>>>(void*) at iterator.h:200:40
frame #14: 0x000000010cbdf628
libarrow_dataset.1100.0.0.dylib`arrow::Iterator<std::__1::shared_ptr<arrow::RecordBatch>>::Next(this=0x0000600003f9cde8)
at iterator.h:110:29
frame #15: 0x0000000280c819dc
libarrow.1100.0.0.dylib`arrow::MapIterator<arrow::compute::MakeReaderGenerator(std::__1::shared_ptr<arrow::RecordBatchReader>,
arrow::internal::Executor*, int, int)::$_5,
std::__1::shared_ptr<arrow::RecordBatch>,
std::__1::optional<arrow::compute::ExecBatch>>::Next(this=0x0000600003f9cde0)
at iterator.h:428:5
frame #16: 0x0000000280c81950
libarrow.1100.0.0.dylib`arrow::Result<std::__1::optional<arrow::compute::ExecBatch>>
arrow::Iterator<std::__1::optional<arrow::compute::ExecBatch>>::Next<arrow::MapIterator<arrow::compute::MakeReaderGenerator(ptr=0x0000600003f9cde0)::$_5,
std::__1::shared_ptr<arrow::RecordBatch>,
std::__1::optional<arrow::compute::ExecBatch>>>(void*) at iterator.h:200:40
frame #17: 0x0000000280c5e784
libarrow.1100.0.0.dylib`arrow::Iterator<std::__1::optional<arrow::compute::ExecBatch>>::Next(this=0x0000600000a9ed28)
at iterator.h:110:29
frame #18: 0x0000000280c8a448
libarrow.1100.0.0.dylib`arrow::BackgroundGenerator<std::__1::optional<arrow::compute::ExecBatch>>::WorkerTask(state=std::__1::shared_ptr<arrow::BackgroundGenerator<std::__1::optional<arrow::compute::ExecBatch>
>::State>::element_type @ 0x0000600000a9ed18 strong=3 weak=1) at
async_generator.h:1759:29
frame #19: 0x0000000280c8a3a0
libarrow.1100.0.0.dylib`arrow::BackgroundGenerator<std::__1::optional<arrow::compute::ExecBatch>>::State::DoRestartTask(this=(std::__1::shared_ptr<arrow::BackgroundGenerator<std::__1::optional<arrow::compute::ExecBatch>
>::State>::element_type @ 0x0000600000a9ed18 strong=3
weak=1))::'lambda'()::operator()() const at async_generator.h:1666:23
frame #20: 0x0000000280c8a31c
libarrow.1100.0.0.dylib`arrow::internal::FnOnce<void
()>::FnImpl<arrow::BackgroundGenerator<std::__1::optional<arrow::compute::ExecBatch>>::State::DoRestartTask(this=0x0000600003f9cd60)::'lambda'()>::invoke()
at functional.h:152:42
frame #21: 0x00000002808063f0
libarrow.1100.0.0.dylib`arrow::internal::FnOnce<void
()>::operator(this=0x000000016b322e38)() && at functional.h:140:17
frame #22: 0x0000000280818ef0
libarrow.1100.0.0.dylib`arrow::internal::WorkerLoop(state=std::__1::shared_ptr<arrow::internal::ThreadPool::State>::element_type
@ 0x00000001508b32e8 strong=3 weak=2, it=std::__1::list<std::__1::thread,
std::__1::allocator<std::__1::thread> >::iterator @ 0x000000016b322ed8) at
thread_pool.cc:262:11
frame #23: 0x0000000280818bfc
libarrow.1100.0.0.dylib`arrow::internal::ThreadPool::LaunchWorkersUnlocked(this=(0x00006000031b8420,
std::__1::shared_ptr<arrow::internal::ThreadPool::State>::element_type @
0x00000001508b32e8 strong=3 weak=2, {...}))::$_6::operator()() const at
thread_pool.cc:423:7
frame #24: 0x0000000280818b58
libarrow.1100.0.0.dylib`decltype(__f=(0x00006000031b8420,
std::__1::shared_ptr<arrow::internal::ThreadPool::State>::element_type @
0x00000001508b32e8 strong=3 weak=2, {...}))::$_6>(fp)())
std::__1::__invoke<arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6>(arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6&&)
at type_traits:3918:1
frame #25: 0x0000000280818af4 libarrow.1100.0.0.dylib`void
std::__1::__thread_execute<std::__1::unique_ptr<std::__1::__thread_struct,
std::__1::default_delete<std::__1::__thread_struct>>,
arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6>(__t=size=2,
(null)=__tuple_indices<> @ 0x000000016b322f7f)::$_6>&,
std::__1::__tuple_indices<>) at thread:287:5
frame #26: 0x0000000280818290 libarrow.1100.0.0.dylib`void*
std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct,
std::__1::default_delete<std::__1::__thread_struct>>,
arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6>>(__vp=0x0000600003185c50)
at thread:298:5
frame #27: 0x00000001a1cf606c libsystem_pthread.dylib`_pthread_start +
148
```
</details>
## Thread 4
This is the signal stop source waiting for input from a signal handler? I
don't know
the details but I am guessing this stop source would always be waiting for
input
as long as there is a signal handler registered.
<details>
```
bt
thread #4
frame #0: 0x00000001a1cb79ac libsystem_kernel.dylib`read + 8
frame #1: 0x00000002807d2844
libarrow.1100.0.0.dylib`arrow::internal::(anonymous
namespace)::SelfPipeImpl::Wait(this=0x0000600001cbcbf8) at io_util.cc:1268:24
frame #2: 0x000000028076fc04 libarrow.1100.0.0.dylib`arrow::(anonymous
namespace)::SignalStopState::ReceiveSignals(self_pipe=std::__1::shared_ptr<arrow::internal::SelfPipe>::element_type
@ 0x0000600001cbcbf8 strong=2 weak=3) at cancel.cc:246:39
frame #3: 0x0000000280770ba4
libarrow.1100.0.0.dylib`decltype(__f=0x0000600003f9c6a8,
__args=nullptr)(static_cast<std::__1::shared_ptr<arrow::internal::SelfPipe>>(fp0)))
std::__1::__invoke<void (*)(std::__1::shared_ptr<arrow::internal::SelfPipe>),
std::__1::shared_ptr<arrow::internal::SelfPipe>>(void
(*&&)(std::__1::shared_ptr<arrow::internal::SelfPipe>),
std::__1::shared_ptr<arrow::internal::SelfPipe>&&) at type_traits:3918:1
frame #4: 0x0000000280770b1c libarrow.1100.0.0.dylib`void
std::__1::__thread_execute<std::__1::unique_ptr<std::__1::__thread_struct,
std::__1::default_delete<std::__1::__thread_struct>>, void
(*)(std::__1::shared_ptr<arrow::internal::SelfPipe>),
std::__1::shared_ptr<arrow::internal::SelfPipe>, 2ul>(__t=size=3,
(null)=__tuple_indices<2> @
0x000000016b552f7f)(std::__1::shared_ptr<arrow::internal::SelfPipe>),
std::__1::shared_ptr<arrow::internal::SelfPipe>>&,
std::__1::__tuple_indices<2ul>) at thread:287:5
frame #5: 0x00000002807701bc libarrow.1100.0.0.dylib`void*
std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct,
std::__1::default_delete<std::__1::__thread_struct>>, void
(*)(std::__1::shared_ptr<arrow::internal::SelfPipe>),
std::__1::shared_ptr<arrow::internal::SelfPipe>>>(__vp=0x0000600003f9c6a0) at
thread:298:5
frame #6: 0x00000001a1cf606c libsystem_pthread.dylib`_pthread_start + 148
```
</details>
## Thread 5
A thread pool worker loop. This seems like it's looping and sleeping which
seems
fine?
<details>
```
bt
thread #5
frame #0: 0x00000001a1cba5e4 libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x00000001a1cf6638 libsystem_pthread.dylib`_pthread_cond_wait
+ 1232
frame #2: 0x00000001a1c43ac4
libc++.1.dylib`std::__1::condition_variable::wait(std::__1::unique_lock<std::__1::mutex>&)
+ 28
frame #3: 0x0000000280819040
libarrow.1100.0.0.dylib`arrow::internal::WorkerLoop(state=std::__1::shared_ptr<arrow::internal::ThreadPool::State>::element_type
@ 0x000000012f694238 strong=7 weak=2, it=std::__1::list<std::__1::thread,
std::__1::allocator<std::__1::thread> >::iterator @ 0x000000016b5deed8) at
thread_pool.cc:280:16
frame #4: 0x0000000280818bfc
libarrow.1100.0.0.dylib`arrow::internal::ThreadPool::LaunchWorkersUnlocked(this=(0x00006000031bc3c0,
std::__1::shared_ptr<arrow::internal::ThreadPool::State>::element_type @
0x000000012f694238 strong=7 weak=2, {...}))::$_6::operator()() const at
thread_pool.cc:423:7
frame #5: 0x0000000280818b58
libarrow.1100.0.0.dylib`decltype(__f=(0x00006000031bc3c0,
std::__1::shared_ptr<arrow::internal::ThreadPool::State>::element_type @
0x000000012f694238 strong=7 weak=2, {...}))::$_6>(fp)())
std::__1::__invoke<arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6>(arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6&&)
at type_traits:3918:1
frame #6: 0x0000000280818af4 libarrow.1100.0.0.dylib`void
std::__1::__thread_execute<std::__1::unique_ptr<std::__1::__thread_struct,
std::__1::default_delete<std::__1::__thread_struct>>,
arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6>(__t=size=2,
(null)=__tuple_indices<> @ 0x000000016b5def7f)::$_6>&,
std::__1::__tuple_indices<>) at thread:287:5
frame #7: 0x0000000280818290 libarrow.1100.0.0.dylib`void*
std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct,
std::__1::default_delete<std::__1::__thread_struct>>,
arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6>>(__vp=0x00006000031bc510)
at thread:298:5
frame #8: 0x00000001a1cf606c libsystem_pthread.dylib`_pthread_start + 148
```
</details>
## Thread 6
This is the call to `RecordBatchReader::ToTable()`...probably the one that
was
launched by Thread #1. This seems to be reading an `ExecPlanReader`, so maybe
there was an extra `ExecPlan` that was created that I did not expect.
<details>
```
bt
thread #6
frame #0: 0x00000001a1cba5e4 libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x00000001a1cf6638 libsystem_pthread.dylib`_pthread_cond_wait
+ 1232
frame #2: 0x00000001a1c43ac4
libc++.1.dylib`std::__1::condition_variable::wait(std::__1::unique_lock<std::__1::mutex>&)
+ 28
frame #3: 0x000000028079288c libarrow.1100.0.0.dylib`void
std::__1::condition_variable::wait<arrow::ConcreteFutureImpl::DoWait()::'lambda'()>(this=0x0000600000a88a48,
__lk=0x000000016b66aa28, __pred=(0x0000600000a889c0))::'lambda'()) at
__mutex_base:404:9
frame #4: 0x0000000280790ef8
libarrow.1100.0.0.dylib`arrow::ConcreteFutureImpl::DoWait(this=0x0000600000a889c0)
at future.cc:154:9
frame #5: 0x0000000280790e84
libarrow.1100.0.0.dylib`arrow::FutureImpl::Wait(this=0x0000600000a889c0) at
future.cc:189:52
frame #6: 0x000000010948c478
arrow.so`ExecPlanReader::ReadNext(std::__1::shared_ptr<arrow::RecordBatch>*)
[inlined]
arrow::Future<std::__1::optional<arrow::compute::ExecBatch>>::Wait(this=0x000000016b66aa80)
const at future.h:385:12 [opt]
frame #7: 0x000000010948c470
arrow.so`ExecPlanReader::ReadNext(std::__1::shared_ptr<arrow::RecordBatch>*)
[inlined]
arrow::Future<std::__1::optional<arrow::compute::ExecBatch>>::result(this=0x000000016b66aa80)
const & at future.h:356:5 [opt]
frame #8: 0x000000010948c470
arrow.so`ExecPlanReader::ReadNext(this=0x00006000011bc618,
batch_out=0x000000016b66ab88) at compute-exec.cpp:118:28 [opt]
frame #9: 0x00000002804b56c4
libarrow.1100.0.0.dylib`arrow::RecordBatchReader::ToRecordBatches(this=0x00006000011bc618)
at record_batch.cc:334:5
frame #10: 0x00000002804b5bcc
libarrow.1100.0.0.dylib`arrow::RecordBatchReader::ToTable(this=0x00006000011bc618)
at record_batch.cc:348:3
frame #11: 0x000000010948b750 arrow.so`arrow::internal::FnOnce<void
()>::FnImpl<std::__1::__bind<arrow::detail::ContinueFuture,
arrow::Future<std::__1::shared_ptr<arrow::Table>>&,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>>
()>>>::invoke() [inlined]
std::__1::__function::__value_func<arrow::Result<std::__1::shared_ptr<arrow::Table>>
()>::operator(this=<unavailable>)() const at function.h:505:16 [opt]
frame #12: 0x000000010948b738 arrow.so`arrow::internal::FnOnce<void
()>::FnImpl<std::__1::__bind<arrow::detail::ContinueFuture,
arrow::Future<std::__1::shared_ptr<arrow::Table>>&,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>>
()>>>::invoke() [inlined]
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>>
()>::operator(this=<unavailable>)() const at function.h:1182:12 [opt]
frame #13: 0x000000010948b738 arrow.so`arrow::internal::FnOnce<void
()>::FnImpl<std::__1::__bind<arrow::detail::ContinueFuture,
arrow::Future<std::__1::shared_ptr<arrow::Table>>&,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>>
()>>>::invoke() [inlined]
std::__1::enable_if<!std::is_void<arrow::Result<std::__1::shared_ptr<arrow::Table>>>::value
&& !is_future<arrow::Result<std::__1::shared_ptr<arrow::Table>>>::value &&
(!arrow::Future<std::__1::shared_ptr<arrow::Table>>::is_empty ||
std::is_same<arrow::Result<std::__1::shared_ptr<arrow::Table>>,
arrow::Status>::value), void>::type
arrow::detail::ContinueFuture::operator(this=<unavailable>,
next=Future<std::__1::shared_ptr<arrow::Table> > @ 0x000000016b66aca0,
f=<unavailable>)<std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>>
()>&, arrow::Result<std::__1::shared_ptr<arrow::Table>>,
arrow::Future<std::__1::shared_ptr<arrow::Table>>>(arrow::Future<std::__1::shared_ptr<arrow::Table>>,
std::__1
::function<arrow::Result<std::__1::shared_ptr<arrow::Table>> ()>&) const at
future.h:150:23 [opt]
frame #14: 0x000000010948b738 arrow.so`arrow::internal::FnOnce<void
()>::FnImpl<std::__1::__bind<arrow::detail::ContinueFuture,
arrow::Future<std::__1::shared_ptr<arrow::Table>>&,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>>
()>>>::invoke() [inlined] decltype(__f=<unavailable>, __args=<unavailable>,
__args=<unavailable>)(static_cast<arrow::Future<std::__1::shared_ptr<arrow::Table>>&>(fp0),
static_cast<std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>>
()>&>(fp0))) std::__1::__invoke<arrow::detail::ContinueFuture&,
arrow::Future<std::__1::shared_ptr<arrow::Table>>&,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>>
()>&>(arrow::detail::ContinueFuture&,
arrow::Future<std::__1::shared_ptr<arrow::Table>>&,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>> ()>&) at
type_traits:3918:1 [opt]
frame #15: 0x000000010948b720 arrow.so`arrow::internal::FnOnce<void
()>::FnImpl<std::__1::__bind<arrow::detail::ContinueFuture,
arrow::Future<std::__1::shared_ptr<arrow::Table>>&,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>>
()>>>::invoke() [inlined]
std::__1::__bind_return<arrow::detail::ContinueFuture,
std::__1::tuple<arrow::Future<std::__1::shared_ptr<arrow::Table>>,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>> ()>>,
std::__1::tuple<>, __is_valid_bind_return<arrow::detail::ContinueFuture,
std::__1::tuple<arrow::Future<std::__1::shared_ptr<arrow::Table>>,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>> ()>>,
std::__1::tuple<>>::value>::type
std::__1::__apply_functor<arrow::detail::ContinueFuture,
std::__1::tuple<arrow::Future<std::__1::shared_ptr<arrow::Table>>,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>>
(__f=<unavailable>, __bound_args=<unavailable>, (null)=<unavailable>, __args=<
unavailable>)>>, 0ul, 1ul, std::__1::tuple<>>(arrow::detail::ContinueFuture&,
std::__1::tuple<arrow::Future<std::__1::shared_ptr<arrow::Table>>,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>> ()>>&,
std::__1::__tuple_indices<0ul, 1ul>, std::__1::tuple<>&&) at bind.h:257:12 [opt]
frame #16: 0x000000010948b720 arrow.so`arrow::internal::FnOnce<void
()>::FnImpl<std::__1::__bind<arrow::detail::ContinueFuture,
arrow::Future<std::__1::shared_ptr<arrow::Table>>&,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>>
()>>>::invoke() [inlined]
std::__1::__bind_return<arrow::detail::ContinueFuture,
std::__1::tuple<arrow::Future<std::__1::shared_ptr<arrow::Table>>,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>> ()>>,
std::__1::tuple<>, __is_valid_bind_return<arrow::detail::ContinueFuture,
std::__1::tuple<arrow::Future<std::__1::shared_ptr<arrow::Table>>,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>> ()>>,
std::__1::tuple<>>::value>::type
std::__1::__bind<arrow::detail::ContinueFuture,
arrow::Future<std::__1::shared_ptr<arrow::Table>>&,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>>
(this=<unavailable>)>>::operator()<>() at bind.h:292:20 [opt]
frame #17: 0x000000010948b720 arrow.so`arrow::internal::FnOnce<void
()>::FnImpl<std::__1::__bind<arrow::detail::ContinueFuture,
arrow::Future<std::__1::shared_ptr<arrow::Table>>&,
std::__1::function<arrow::Result<std::__1::shared_ptr<arrow::Table>>
(this=<unavailable>)>>>::invoke() at functional.h:152:42 [opt]
frame #18: 0x00000002808063f0
libarrow.1100.0.0.dylib`arrow::internal::FnOnce<void
()>::operator(this=0x000000016b66ae38)() && at functional.h:140:17
frame #19: 0x0000000280818ef0
libarrow.1100.0.0.dylib`arrow::internal::WorkerLoop(state=std::__1::shared_ptr<arrow::internal::ThreadPool::State>::element_type
@ 0x000000012f694238 strong=7 weak=2, it=std::__1::list<std::__1::thread,
std::__1::allocator<std::__1::thread> >::iterator @ 0x000000016b66aed8) at
thread_pool.cc:262:11
frame #20: 0x0000000280818bfc
libarrow.1100.0.0.dylib`arrow::internal::ThreadPool::LaunchWorkersUnlocked(this=(0x00006000031bc3c0,
std::__1::shared_ptr<arrow::internal::ThreadPool::State>::element_type @
0x000000012f694238 strong=7 weak=2, {...}))::$_6::operator()() const at
thread_pool.cc:423:7
frame #21: 0x0000000280818b58
libarrow.1100.0.0.dylib`decltype(__f=(0x00006000031bc3c0,
std::__1::shared_ptr<arrow::internal::ThreadPool::State>::element_type @
0x000000012f694238 strong=7 weak=2, {...}))::$_6>(fp)())
std::__1::__invoke<arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6>(arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6&&)
at type_traits:3918:1
frame #22: 0x0000000280818af4 libarrow.1100.0.0.dylib`void
std::__1::__thread_execute<std::__1::unique_ptr<std::__1::__thread_struct,
std::__1::default_delete<std::__1::__thread_struct>>,
arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6>(__t=size=2,
(null)=__tuple_indices<> @ 0x000000016b66af7f)::$_6>&,
std::__1::__tuple_indices<>) at thread:287:5
frame #23: 0x0000000280818290 libarrow.1100.0.0.dylib`void*
std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct,
std::__1::default_delete<std::__1::__thread_struct>>,
arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6>>(__vp=0x0000600003186040)
at thread:298:5
frame #24: 0x00000001a1cf606c libsystem_pthread.dylib`_pthread_start +
148
```
</details>
## Thread 7
Another thread pool worker loop. Also looping and sleeping.
<details>
```
bt
thread #7
frame #0: 0x00000001a1cba5e4 libsystem_kernel.dylib`__psynch_cvwait + 8
frame #1: 0x00000001a1cf6638 libsystem_pthread.dylib`_pthread_cond_wait
+ 1232
frame #2: 0x00000001a1c43ac4
libc++.1.dylib`std::__1::condition_variable::wait(std::__1::unique_lock<std::__1::mutex>&)
+ 28
frame #3: 0x0000000280819040
libarrow.1100.0.0.dylib`arrow::internal::WorkerLoop(state=std::__1::shared_ptr<arrow::internal::ThreadPool::State>::element_type
@ 0x000000012f694238 strong=7 weak=2, it=std::__1::list<std::__1::thread,
std::__1::allocator<std::__1::thread> >::iterator @ 0x000000016b6f6ed8) at
thread_pool.cc:280:16
frame #4: 0x0000000280818bfc
libarrow.1100.0.0.dylib`arrow::internal::ThreadPool::LaunchWorkersUnlocked(this=(0x00006000031bc3c0,
std::__1::shared_ptr<arrow::internal::ThreadPool::State>::element_type @
0x000000012f694238 strong=7 weak=2, {...}))::$_6::operator()() const at
thread_pool.cc:423:7
frame #5: 0x0000000280818b58
libarrow.1100.0.0.dylib`decltype(__f=(0x00006000031bc3c0,
std::__1::shared_ptr<arrow::internal::ThreadPool::State>::element_type @
0x000000012f694238 strong=7 weak=2, {...}))::$_6>(fp)())
std::__1::__invoke<arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6>(arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6&&)
at type_traits:3918:1
frame #6: 0x0000000280818af4 libarrow.1100.0.0.dylib`void
std::__1::__thread_execute<std::__1::unique_ptr<std::__1::__thread_struct,
std::__1::default_delete<std::__1::__thread_struct>>,
arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6>(__t=size=2,
(null)=__tuple_indices<> @ 0x000000016b6f6f7f)::$_6>&,
std::__1::__tuple_indices<>) at thread:287:5
frame #7: 0x0000000280818290 libarrow.1100.0.0.dylib`void*
std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct,
std::__1::default_delete<std::__1::__thread_struct>>,
arrow::internal::ThreadPool::LaunchWorkersUnlocked(int)::$_6>>(__vp=0x00006000031bc570)
at thread:298:5
frame #8: 0x00000001a1cf606c libsystem_pthread.dylib`_pthread_start + 148
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
