[
https://issues.apache.org/jira/browse/PDFBOX-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17908859#comment-17908859
]
Tilman Hausherr commented on PDFBOX-3429:
-----------------------------------------
I did the tests again, with 1.8 I got 80% CPU load, with 2.0 and 3.0 I got 100%
CPU load using 16 cores (pc from 2017 that still works great):
1.8.17:
Benchmark is running
10000 pdf strips with 16 thread(s).
Finished all jobs. 24378 ms
2.0.33:
Benchmark is running
10000 pdf strips with 16 thread(s).
Finished all jobs. 18306 ms
trunk (like 3.0.4):
Benchmark is running
10000 pdf strips with 16 thread(s).
Finished all jobs. 12156 ms
So can we say this issue has been resolved?
> Improve ExtractText Concurrency
> -------------------------------
>
> Key: PDFBOX-3429
> URL: https://issues.apache.org/jira/browse/PDFBOX-3429
> Project: PDFBox
> Issue Type: Improvement
> Components: Text extraction
> Affects Versions: 2.0.1
> Environment: Win7, jdk1.8.0_60 x64
> Reporter: Luís Filipe Nassif
> Priority: Minor
> Labels: optimization
> Attachments: 000000000000B265.pdf, cpu-pdfbox-2.0.2.png,
> cpu-pdfbox1.8.10.png, cpu_pdfbox_2.0.3_and_1.8.10.png, tilman-combined-cpu.png
>
>
> While testing Tika 1.13, which uses PDFBox 2.0.1, from a multithreaded text
> extraction application, I noted cpu usage aroung 80% in my 6 core computer
> when processing a dataset of ~75 thousands of pdfs (18GB). It took 5min25sec
> to complete the text extraction. With Tika 1.10, which uses PDFBox 1.8.10,
> cpu usage stays aroung 100%. It took 4min37sec to complete. The dataset is
> read from a ramdrive, so there is no i/o bottleneck. I suspect there is some
> new synchronization code that blocks the threads for a non trivial amount of
> time, resulting in less cpu usage than before.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@pdfbox.apache.org
For additional commands, e-mail: dev-h...@pdfbox.apache.org
