[
https://issues.apache.org/jira/browse/ARROW-17927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17613635#comment-17613635
]
Weston Pace commented on ARROW-17927:
-------------------------------------
{quote}
I'll note that more than 400 threads are started in that test. That doesn't
sound right at all.
https://gist.github.com/pitrou/6c43e11724179f39d531bfaeb836524d
{quote}
That is more or less intentional. The goal of the test is to have every batch
delivered by its own thread for maximum chaos. The test itself has 16
fragments, each with 128 batches so I think 2048 threads will be created during
the lifetime of the test.
> [C++] Sporadic crashes in arrow-dataset-scanner-test
> ----------------------------------------------------
>
> Key: ARROW-17927
> URL: https://issues.apache.org/jira/browse/ARROW-17927
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Continuous Integration
> Reporter: Antoine Pitrou
> Assignee: Antoine Pitrou
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 10.0.0
>
> Time Spent: 4h 40m
> Remaining Estimate: 0h
>
> Seen e.g. on this PR:
> https://github.com/apache/arrow/actions/runs/3181284056/jobs/5185859816#step:11:255
> {code}
> [----------] 8 tests from BasicNewScannerTests/TestScannerBase
> [ RUN ] BasicNewScannerTests/TestScannerBase.ScanOrdered/0fast1f128b
> [ OK ] BasicNewScannerTests/TestScannerBase.ScanOrdered/0fast1f128b (33
> ms)
> [ RUN ] BasicNewScannerTests/TestScannerBase.ScanOrdered/1fast16f128b
> [ OK ] BasicNewScannerTests/TestScannerBase.ScanOrdered/1fast16f128b
> (582 ms)
> [ RUN ] BasicNewScannerTests/TestScannerBase.ScanOrdered/2slow1f128b
> [ OK ] BasicNewScannerTests/TestScannerBase.ScanOrdered/2slow1f128b (65
> ms)
> [ RUN ] BasicNewScannerTests/TestScannerBase.ScanOrdered/3slow16f128b
> terminate called after throwing an instance of 'std::system_error'
> what(): Resource temporarily unavailable
> terminate called recursively
> terminate called recursively
> terminate called recursively
> terminate called recursively
> terminate called recursively
> terminate called recursively
> terminate called recursively
> terminate called recursively
> terminate called recursively
> terminate called recursively
> terminate called recursively
> terminate called recursively
> terminate called recursively
> terminate called recursively
> terminate called recursively
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
