[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated HADOOP-13126:
---
Attachment: HADOOP-13126.4.patch
Adding a patch that fixes the checkstyle issues.
> Add Brotli
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated HADOOP-13126:
---
Attachment: HADOOP-13126.3.patch
> Add Brotli compression codec
>
>
>
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328619#comment-15328619
]
Ryan Blue commented on HADOOP-13126:
I'm attaching a new version of this patch that depends on
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated HADOOP-13126:
---
Comment: was deleted
(was: I'm attaching a new version of this patch that depends on [~marki]'s
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328634#comment-15328634
]
Ryan Blue commented on HADOOP-13126:
I'm attaching a new patch that depends on jbrotli 0.5.0. That
Ryan Blue created HADOOP-12810:
--
Summary: FileSystem#listLocatedStatus causes unnecessary RPC calls
Key: HADOOP-12810
URL: https://issues.apache.org/jira/browse/HADOOP-12810
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-12810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated HADOOP-12810:
---
Attachment: HADOOP-12810.1.patch
Adding a patch that fixes the problem.
>
[
https://issues.apache.org/jira/browse/HADOOP-12810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated HADOOP-12810:
---
Status: Patch Available (was: Open)
> FileSystem#listLocatedStatus causes unnecessary RPC calls
>
[
https://issues.apache.org/jira/browse/HADOOP-12810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150751#comment-15150751
]
Ryan Blue commented on HADOOP-12810:
Thanks for reviewing and commiting this so quickly,
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278653#comment-15278653
]
Ryan Blue commented on HADOOP-13126:
[~marki], could you review this patch also?
> Add Brotli
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated HADOOP-13126:
---
Status: Patch Available (was: Open)
> Add Brotli compression codec
>
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278659#comment-15278659
]
Ryan Blue commented on HADOOP-13126:
[~andrew.wang], you guys are probably interested in this.
>
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278673#comment-15278673
]
Ryan Blue commented on HADOOP-13126:
The results above show the comparison with Snappy. The file is
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated HADOOP-13126:
---
Attachment: HADOOP-13126.1.patch
> Add Brotli compression codec
>
>
>
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated HADOOP-13126:
---
Attachment: (was: HADOOP-13126.1.patch)
> Add Brotli compression codec
>
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated HADOOP-13126:
---
Attachment: HADOOP-13126.1.patch
> Add Brotli compression codec
>
>
>
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated HADOOP-13126:
---
Attachment: HADOOP-13126.2.patch
> Add Brotli compression codec
>
>
>
Ryan Blue created HADOOP-13126:
--
Summary: Add Brotli compression codec
Key: HADOOP-13126
URL: https://issues.apache.org/jira/browse/HADOOP-13126
Project: Hadoop Common
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/HADOOP-12878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365275#comment-15365275
]
Ryan Blue commented on HADOOP-12878:
FileInputFormat works slightly differently. First, the [split
[
https://issues.apache.org/jira/browse/HADOOP-12878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365275#comment-15365275
]
Ryan Blue edited comment on HADOOP-12878 at 7/6/16 10:55 PM:
-
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15550286#comment-15550286
]
Ryan Blue commented on HADOOP-13126:
Brotli compression isn't splittable, but can be used with
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated HADOOP-13126:
---
Attachment: HADOOP-13126.5.patch
> Add Brotli compression codec
>
>
>
[
https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927084#comment-15927084
]
Ryan Blue commented on HADOOP-13786:
On metrics: our layer on top of the staging committer tracks
[
https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903352#comment-15903352
]
Ryan Blue commented on HADOOP-13786:
Is there a branch where I can take a look at the S3A test
[
https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901663#comment-15901663
]
Ryan Blue commented on HADOOP-13786:
Thanks for doing so much to get this in! Let me know when it is
[
https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905498#comment-15905498
]
Ryan Blue commented on HADOOP-13786:
For the staging committer drawbacks, I think there's a clear
[
https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905876#comment-15905876
]
Ryan Blue commented on HADOOP-13786:
On UUID suffixes: the option is needed for the "append"
[
https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Blue updated HADOOP-13786:
---
Attachment: s3committer-master.zip
I'm attaching the S3 committer code to show intent to
[
https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202748#comment-16202748
]
Ryan Blue commented on HADOOP-13786:
I'll try to take a look as well.
> Add S3Guard committer for
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16295256#comment-16295256
]
Ryan Blue commented on HADOOP-13126:
Support for brotli, zstd, and lz4 is in Parquet master. It will
[
https://issues.apache.org/jira/browse/HADOOP-15003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244232#comment-16244232
]
Ryan Blue commented on HADOOP-15003:
I don't think the partitioned committer should continue the
[
https://issues.apache.org/jira/browse/HADOOP-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16280469#comment-16280469
]
Ryan Blue commented on HADOOP-13126:
I'm happy to if there is interest from reviewers.
> Add Brotli
[
https://issues.apache.org/jira/browse/HADOOP-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286673#comment-16286673
]
Ryan Blue commented on HADOOP-15107:
For the definition of correctness, I think we will need two
[
https://issues.apache.org/jira/browse/HADOOP-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503612#comment-16503612
]
Ryan Blue commented on HADOOP-15421:
+1 for the committer's full classname. Enough classes are
[
https://issues.apache.org/jira/browse/HADOOP-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458794#comment-16458794
]
Ryan Blue commented on HADOOP-15421:
I think this makes sense. As long as there is a _SUCCESS file,
35 matches
Mail list logo
