Am 31.07.2020 um 08:05 schrieb Andreas Lehmkuehler:
Am 30.07.20 um 20:22 schrieb Tilman Hausherr:
I've looked at all the files I had highlighted yesterday. All
differences except two are related to the metadata problem.
The other two have a problem with spaces, i.e. glyphs not being near
each other.
commoncrawl3_refetched/PK/PKI7PHOBREMT7QBJIL5KZNVE2EVAFLBQ
commoncrawl3_refetched/WZ/WZTGH3ACJPLKXD5JBAH2AONGOMYNYDUJ
This doesn't have to be a bug, I've seen many files where the
extraction is better, so whatever change there is may have improved
more things.
Thanks, for the analysis. IMHO we are good to cut a new release,
aren't we?
Yeah we could.
But if the bug gets solved it would be nice to have a new diff output to
see if anything else gets shown more clearly.
Tilman
Tilman
Am 30.07.2020 um 18:05 schrieb Tilman Hausherr:
Hi,
I started with 3AXKIR2SX6TIFMLGSRTLOM2SDOPLBJ5P.pdf
There's something with the XMP metadata extraction. dc:title: is
empty (or an empty line and maybe spaces) in tika 1.25 but not in
tika 1.24.
I thought this could be related to some minor xmpbox changes but
tika doesn't use it. So I searched and found some changes in
PDMetadataExtractor.
I'm not yet sure if that is the cause, although I played around with
that one.
If it is, then it is related to
https://issues.apache.org/jira/browse/TIKA-3101
Tilman
Am 30.07.2020 um 12:43 schrieb Tim Allison:
Looks like there may be some issues with Japanese...don't know if
this is
related to your observation?
It feels like when I sort by ascending order of
NUM_COMMON_TOKENS_DIFF_IN_B, there are quite a few jpn->jpn
language pairs
in the "lost common tokens".
Will look a bit more.
On Thu, Jul 30, 2020 at 2:26 AM Tilman Hausherr
<thaush...@t-online.de>
wrote:
Am 28.07.2020 um 23:51 schrieb Tim Allison:
Reports are here:
https://corpora.tika.apache.org/base/reports/pdfbox-2.0.21-SNAPSHOT.tgz
Thank you. Besides the exceptions, there are a few cases in content
extraction where "TOP_10_MORE_IN_B" is empty and
"TOP_10_MORE_IN_A" has
meaningful content, that is suspicious and needs further
investigation.
Tilman
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@pdfbox.apache.org
For additional commands, e-mail: dev-h...@pdfbox.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@pdfbox.apache.org
For additional commands, e-mail: dev-h...@pdfbox.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@pdfbox.apache.org
For additional commands, e-mail: dev-h...@pdfbox.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@pdfbox.apache.org
For additional commands, e-mail: dev-h...@pdfbox.apache.org
