[
https://issues.apache.org/jira/browse/COMPRESS-623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Weiss updated COMPRESS-623:
-
Description:
I have a somewhat odd use case with gigabytes of ZIP files, each with thousands
[
https://issues.apache.org/jira/browse/COMPRESS-623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Weiss updated COMPRESS-623:
-
Summary: make ZipFile's getRawInputStream usable when local headers are not
read (was: Speed
[
https://issues.apache.org/jira/browse/COMPRESS-623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Weiss updated COMPRESS-623:
-
Description:
I have a somewhat odd use case with gigabytes of ZIP files, each with thousands
Dawid Weiss created COMPRESS-623:
Summary: Speed up ZipFile's raw stream copying by not seeking for
local headers until they're needed
Key: COMPRESS-623
URL: https://issues.apache.org/jira/browse/COMPRESS-623
[
https://issues.apache.org/jira/browse/COMPRESS-413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355425#comment-16355425
]
Dawid Weiss edited comment on COMPRESS-413 at 2/7/18 1:26 PM:
--
This issue
[
https://issues.apache.org/jira/browse/COMPRESS-413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355425#comment-16355425
]
Dawid Weiss commented on COMPRESS-413:
--
This commit introduced a transitive POM dependency on
[
https://issues.apache.org/jira/browse/COMPRESS-441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325520#comment-16325520
]
Dawid Weiss commented on COMPRESS-441:
--
I provided a PR for this... forgot to link it to the issue?
Dawid Weiss created COMPRESS-441:
Summary: Remove dummyByte workaround from BoundedInputStream and
use SequentialInputStream instead
Key: COMPRESS-441
URL: https://issues.apache.org/jira/browse/COMPRESS-441
[
https://issues.apache.org/jira/browse/COMPRESS-440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Weiss updated COMPRESS-440:
-
Description:
With the buffer applied in COMPRESS-438 the decompression speed is actually
quite
Dawid Weiss created COMPRESS-440:
Summary: Speed up decoder for deflate64
Key: COMPRESS-440
URL: https://issues.apache.org/jira/browse/COMPRESS-440
Project: Commons Compress
Issue Type:
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319873#comment-16319873
]
Dawid Weiss commented on COMPRESS-380:
--
I agree with you, Stefan. I was only talking about a buffer
[
https://issues.apache.org/jira/browse/COMPRESS-438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319219#comment-16319219
]
Dawid Weiss commented on COMPRESS-438:
--
COMPRESS-333 wasn't actually that much different to this
[
https://issues.apache.org/jira/browse/COMPRESS-438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Weiss updated COMPRESS-438:
-
Description:
When decoders read from a raw underlying stream (such as a file channel), the
[
https://issues.apache.org/jira/browse/COMPRESS-438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Weiss updated COMPRESS-438:
-
Attachment: Check.java
> ZipFile should create a buffered input stream for decoders inside
>
[
https://issues.apache.org/jira/browse/COMPRESS-438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Weiss updated COMPRESS-438:
-
Attachment: (was: Check.java)
> ZipFile should create a buffered input stream for decoders
[
https://issues.apache.org/jira/browse/COMPRESS-438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Weiss updated COMPRESS-438:
-
Description:
When decoders read from a raw underlying stream (such as a file channel), the
[
https://issues.apache.org/jira/browse/COMPRESS-438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Weiss updated COMPRESS-438:
-
Attachment: Check.java
The code used for "benchmarking".
> ZipFile should create a buffered
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319080#comment-16319080
]
Dawid Weiss edited comment on COMPRESS-380 at 1/9/18 9:00 PM:
--
The thing
Dawid Weiss created COMPRESS-438:
Summary: ZipFile should create a buffered input stream for
decoders inside getInputStream(ZipArchiveEntry)
Key: COMPRESS-438
URL:
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319085#comment-16319085
]
Dawid Weiss commented on COMPRESS-380:
--
I'll file another issue for this, I think it's worth an
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319080#comment-16319080
]
Dawid Weiss commented on COMPRESS-380:
--
The thing is: I really like when the compiler makes it
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318920#comment-16318920
]
Dawid Weiss commented on COMPRESS-380:
--
Yeah... I bet there'll be lots of people (like me) who
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318796#comment-16318796
]
Dawid Weiss commented on COMPRESS-380:
--
In fact, I just decompressed the whole 6 gig archive in
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318790#comment-16318790
]
Dawid Weiss commented on COMPRESS-380:
--
Also... it's really bad if the input stream is not buffered
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318776#comment-16318776
]
Dawid Weiss commented on COMPRESS-380:
--
Yup, much better.
{code}
before throughput: 826,371
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317237#comment-16317237
]
Dawid Weiss commented on COMPRESS-380:
--
I just realized that a *lot* of data in that archive is
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317203#comment-16317203
]
Dawid Weiss commented on COMPRESS-380:
--
Yup, I realize that. I wasn't trying to suggest to just
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317182#comment-16317182
]
Dawid Weiss commented on COMPRESS-380:
--
I've decompressed the entire ~6GB archive without any
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316165#comment-16316165
]
Dawid Weiss commented on COMPRESS-380:
--
Sure, I'll experiment and if it shows any improvement, I'll
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315853#comment-16315853
]
Dawid Weiss commented on COMPRESS-380:
--
I'll check again once I get back home, thanks Stefan. I did
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315460#comment-16315460
]
Dawid Weiss commented on COMPRESS-380:
--
Hi Stefan. Seems to be this assertion causing this
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314733#comment-16314733
]
Dawid Weiss commented on COMPRESS-380:
--
Just an additional comment -- the large archive's stats of
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314726#comment-16314726
]
Dawid Weiss edited comment on COMPRESS-380 at 1/6/18 4:19 PM:
--
I isolated a
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314726#comment-16314726
]
Dawid Weiss commented on COMPRESS-380:
--
I isolated a smaller example file that still fails at
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314000#comment-16314000
]
Dawid Weiss commented on COMPRESS-380:
--
Ran a super-quick sanity check on a huge zip of my local
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313959#comment-16313959
]
Dawid Weiss commented on COMPRESS-380:
--
I'll take a look and run some tests over the weekend,
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16312024#comment-16312024
]
Dawid Weiss commented on COMPRESS-380:
--
Looks good to me. I thought you'd just return 0 and be done
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311128#comment-16311128
]
Dawid Weiss commented on COMPRESS-380:
--
Makes sense to me. Available must not block -- that's the
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305302#comment-16305302
]
Dawid Weiss edited comment on COMPRESS-380 at 12/28/17 10:25 AM:
-
These
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Weiss updated COMPRESS-380:
-
Attachment: archive.zip
archive64.zip
input2
These streams
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Weiss updated COMPRESS-380:
-
Attachment: archive-deflate.zip
archive-deflate64.zip
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16289544#comment-16289544
]
Dawid Weiss commented on COMPRESS-380:
--
Unless it's some kind of vulnerability (which should be
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288026#comment-16288026
]
Dawid Weiss commented on COMPRESS-380:
--
I'm not a committer, but I looked at the patch and while I
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275481#comment-16275481
]
Dawid Weiss commented on COMPRESS-380:
--
The workflow would be to provide a patch file (diff) or
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839531#comment-15839531
]
Dawid Weiss commented on COMPRESS-380:
--
Not necessarily bad wording -- I may be slow in the
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839517#comment-15839517
]
Dawid Weiss commented on COMPRESS-380:
--
zip4j doesn't support DEFLATE64 either, just checked.
>
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839507#comment-15839507
]
Dawid Weiss commented on COMPRESS-380:
--
bq. A pure Java DEFLATE64 will certainly be slower than the
[
https://issues.apache.org/jira/browse/COMPRESS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838156#comment-15838156
]
Dawid Weiss commented on COMPRESS-380:
--
Thanks Stefan! I don't know if I'll have the time to look
Dawid Weiss created COMPRESS-380:
Summary: Support for ENHANCED_DEFLATED (Deflate64) in ZIP files
Key: COMPRESS-380
URL: https://issues.apache.org/jira/browse/COMPRESS-380
Project: Commons Compress
[
https://issues.apache.org/jira/browse/COMPRESS-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196233#comment-15196233
]
Dawid Weiss commented on COMPRESS-333:
--
For completeness, COMPRESS-327 talks about seeking through
[
https://issues.apache.org/jira/browse/COMPRESS-320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196144#comment-15196144
]
Dawid Weiss edited comment on COMPRESS-320 at 3/15/16 8:16 PM:
---
You're
[
https://issues.apache.org/jira/browse/COMPRESS-320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196144#comment-15196144
]
Dawid Weiss commented on COMPRESS-320:
--
You're right. I still the confusion is partly because we
[
https://issues.apache.org/jira/browse/COMPRESS-320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193121#comment-15193121
]
Dawid Weiss commented on COMPRESS-320:
--
Stefan, I think this issue should have an updated "fix
[
https://issues.apache.org/jira/browse/COMPRESS-320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171157#comment-15171157
]
Dawid Weiss commented on COMPRESS-320:
--
Oh, I didn't take it the wrong way, no worries at all. I
[
https://issues.apache.org/jira/browse/COMPRESS-320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163522#comment-15163522
]
Dawid Weiss commented on COMPRESS-320:
--
True random access would be possible, but at some costs.
Dawid Weiss created COMPRESS-339:
Summary: deprecate get() methods on SevenZFile and add
getNextEntry().getInputStream() instead
Key: COMPRESS-339
URL: https://issues.apache.org/jira/browse/COMPRESS-339
[
https://issues.apache.org/jira/browse/COMPRESS-320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15159073#comment-15159073
]
Dawid Weiss commented on COMPRESS-320:
--
I created a pull request on github, here:
[
https://issues.apache.org/jira/browse/COMPRESS-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158703#comment-15158703
]
Dawid Weiss commented on COMPRESS-291:
--
Adding a link to decompression buffering issue (partially
[
https://issues.apache.org/jira/browse/COMPRESS-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134945#comment-15134945
]
Dawid Weiss commented on COMPRESS-333:
--
I couldn't see much difference between the code you
Dawid Weiss created COMPRESS-333:
Summary: bz2 stream decompressor is 10x slower than it could be
Key: COMPRESS-333
URL: https://issues.apache.org/jira/browse/COMPRESS-333
Project: Commons Compress
[
https://issues.apache.org/jira/browse/COMPRESS-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130396#comment-15130396
]
Dawid Weiss edited comment on COMPRESS-333 at 2/3/16 1:41 PM:
--
It's even
[
https://issues.apache.org/jira/browse/COMPRESS-333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dawid Weiss updated COMPRESS-333:
-
Description:
This is related to COMPRESS-291. In short: decompressing 7z archives was an
order
[
https://issues.apache.org/jira/browse/COMPRESS-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130396#comment-15130396
]
Dawid Weiss commented on COMPRESS-333:
--
It's even better than I thought... So I wondered why the
[
https://issues.apache.org/jira/browse/COMPRESS-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130328#comment-15130328
]
Dawid Weiss commented on COMPRESS-291:
--
Just a note -- I toyed with Hadoop's bz2 decompressor and
[
https://issues.apache.org/jira/browse/COMPRESS-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108171#comment-15108171
]
Dawid Weiss commented on COMPRESS-291:
--
I don't think it's lzma in my case -- the 7z archive I
[
https://issues.apache.org/jira/browse/COMPRESS-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15105219#comment-15105219
]
Dawid Weiss commented on COMPRESS-291:
--
You're right, I just checked out of curiosity -- it is
[
https://issues.apache.org/jira/browse/COMPRESS-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102338#comment-15102338
]
Dawid Weiss commented on COMPRESS-291:
--
No, it's not going to make it any faster. I'm guessing your
[
https://issues.apache.org/jira/browse/COMPRESS-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102535#comment-15102535
]
Dawid Weiss commented on COMPRESS-291:
--
This isn't related to the jira issue... perhaps the
[
https://issues.apache.org/jira/browse/COMPRESS-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098071#comment-15098071
]
Dawid Weiss commented on COMPRESS-291:
--
Looked at the code again. I do understand the
[
https://issues.apache.org/jira/browse/COMPRESS-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101375#comment-15101375
]
Dawid Weiss commented on COMPRESS-291:
--
No problem at all, Stefan. I dug into the code, it's
[
https://issues.apache.org/jira/browse/COMPRESS-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15096193#comment-15096193
]
Dawid Weiss commented on COMPRESS-291:
--
This bit us too. I looked through the code. Indeed, I don't
[
https://issues.apache.org/jira/browse/COMPRESS-320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15096198#comment-15096198
]
Dawid Weiss commented on COMPRESS-320:
--
Related issue concerning listing all entries of a 7z
[
https://issues.apache.org/jira/browse/COMPRESS-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272680#comment-14272680
]
Dawid Weiss commented on COMPRESS-297:
--
That close field should be declared
73 matches
Mail list logo
