[
https://issues.apache.org/jira/browse/TIKA-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17755235#comment-17755235
]
Hudson commented on TIKA-4048:
------------------------------
SUCCESS: Integrated in Jenkins build Tika » tika-main-jdk11 #1208 (See
[https://ci-builds.apache.org/job/Tika/job/tika-main-jdk11/1208/])
TIKA-4048 -- revert change in default decompressConcatenated and add a gzip
subtype detector for warc+gz (#1290) (github:
[https://github.com/apache/tika/commit/0ed9f8a0be00ae9b83cfb2f5f7d6e3d84f5b9fd3])
* (edit) CHANGES.txt
* (edit) tika-core/src/test/java/org/apache/tika/TikaTest.java
* (add)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-pkg-module/src/main/java/org/apache/tika/detect/gzip/GZipSpecializationDetector.java
* (add)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-webarchive-module/src/test/resources/test-documents/testWARC_multiple.warc.gz
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-webarchive-module/src/main/java/org/apache/tika/parser/warc/WARCParser.java
* (add)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-webarchive-module/src/test/resources/test-documents/testWARC_multiple.warc
* (edit) tika-core/src/main/resources/org/apache/tika/mime/tika-mimetypes.xml
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-pkg-module/src/main/java/org/apache/tika/parser/pkg/CompressorParser.java
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-webarchive-module/src/test/java/org/apache/tika/parser/warc/WARCParserTest.java
* (add)
tika-parsers/tika-parsers-standard/tika-parsers-standard-package/src/test/resources/configs/tika-config-multiple-gz.xml
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-package/src/test/java/org/apache/tika/detect/TestDetectorLoading.java
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-package/src/test/java/org/apache/tika/parser/pkg/GzipParserTest.java
* (add)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-pkg-module/src/main/resources/META-INF/services/org.apache.tika.detect.Detector
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-webarchive-module/pom.xml
> Gzipped WARC not identifying all assets
> ---------------------------------------
>
> Key: TIKA-4048
> URL: https://issues.apache.org/jira/browse/TIKA-4048
> Project: Tika
> Issue Type: Bug
> Reporter: Gregory Lepore
> Assignee: Tim Allison
> Priority: Blocker
> Fix For: 2.9.0
>
> Attachments: Screenshot 2023-05-30 at 3.49.19 PM.png, Screenshot
> 2023-05-30 at 3.50.41 PM.png, rec-20230518121844489398-5335604b8b23.warc,
> rec-20230518121844489398-5335604b8b23.warc.gz,
> rec-20230518121844489398-5335604b8b23.warc.gz.json,
> rec-20230518121844489398-5335604b8b23.warc.json
>
>
> The WARC parser works for non GZipped WARC files, but for GZipped WARC files
> it appears not all embedded files are being identified.
>
> Processing a WARC.GZ file should return identical JSON output as the plain
> WARC file, with the addition of the GZ file metadata. However, in the
> attached JSON outputs, the JPEG present in the plain WARC file is not
> represented in the WARC.GZ.json file.
>
> Additionally, the warc: metadata is not being returned for all files,
> although this may be by design.
>
> Attached are two JSON files, one for the GZipped WARC file and one for the
> plain WARC file. And the two original files.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
