[
https://issues.apache.org/jira/browse/HADOOP-17197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17175017#comment-17175017
]
Sahil Takiar commented on HADOOP-17197:
---
I'm not proposing that S3A should stop using the
[
https://issues.apache.org/jira/browse/HADOOP-17197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174935#comment-17174935
]
Sahil Takiar commented on HADOOP-17197:
---
CC: [~ste...@apache.org] if you have any thoughts here
Sahil Takiar created HADOOP-17197:
-
Summary: Decrease size of s3a dependencies
Key: HADOOP-17197
URL: https://issues.apache.org/jira/browse/HADOOP-17197
Project: Hadoop Common
Issue Type:
[
https://issues.apache.org/jira/browse/HADOOP-17139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160169#comment-17160169
]
Sahil Takiar commented on HADOOP-17139:
---
eh maybe not necessary to support multi-part uploads
[
https://issues.apache.org/jira/browse/HADOOP-17139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160166#comment-17160166
]
Sahil Takiar commented on HADOOP-17139:
---
I can't tell if multi-part uploads are enabled for
Sahil Takiar created HADOOP-17139:
-
Summary: Re-enable optimized copyFromLocal implementation in
S3AFileSystem
Key: HADOOP-17139
URL: https://issues.apache.org/jira/browse/HADOOP-17139
Project:
[
https://issues.apache.org/jira/browse/HADOOP-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar resolved HADOOP-16859.
---
Fix Version/s: 3.4.0
Resolution: Fixed
> ABFS: Add unbuffer support to
[
https://issues.apache.org/jira/browse/HADOOP-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036402#comment-17036402
]
Sahil Takiar commented on HADOOP-16859:
---
[~ste...@apache.org], [~gabor.bota] created a PR:
Sahil Takiar created HADOOP-16859:
-
Summary: ABFS: Add unbuffer support to AbfsInputStream
Key: HADOOP-16859
URL: https://issues.apache.org/jira/browse/HADOOP-16859
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-16685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar resolved HADOOP-16685.
---
Fix Version/s: 3.3.0
Resolution: Fixed
> FileSystem#listStatusIterator does not
[
https://issues.apache.org/jira/browse/HADOOP-16346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982667#comment-16982667
]
Sahil Takiar commented on HADOOP-16346:
---
Good news. It looks like post Wildfly + AWS SDK upgrade
[
https://issues.apache.org/jira/browse/HADOOP-16346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978655#comment-16978655
]
Sahil Takiar commented on HADOOP-16346:
---
I'm going to take another stab at testing this. Will run
[
https://issues.apache.org/jira/browse/HADOOP-16346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar reassigned HADOOP-16346:
-
Assignee: Sahil Takiar
> Stabilize S3A OpenSSL support
>
[
https://issues.apache.org/jira/browse/HADOOP-16685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968007#comment-16968007
]
Sahil Takiar commented on HADOOP-16685:
---
Looks like pre-commit is passing now. The one failing
[
https://issues.apache.org/jira/browse/HADOOP-16685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967816#comment-16967816
]
Sahil Takiar commented on HADOOP-16685:
---
{quote}What is the expectation? a fast failure?
{quote}
Sahil Takiar created HADOOP-16685:
-
Summary: FileSystem#listStatusIterator does not check if given
path exists
Key: HADOOP-16685
URL: https://issues.apache.org/jira/browse/HADOOP-16685
Project:
[
https://issues.apache.org/jira/browse/HADOOP-16569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929292#comment-16929292
]
Sahil Takiar commented on HADOOP-16569:
---
Hey [~Steven Rand], thanks for tagging me. Yeah,
[
https://issues.apache.org/jira/browse/HADOOP-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated HADOOP-16379:
--
Summary: S3AInputStream#unbuffer should merge input stream stats into
fs-wide stats (was:
Sahil Takiar created HADOOP-16379:
-
Summary: S3AInputStream#unbuffer should merge input stream stats
fs-wide stats
Key: HADOOP-16379
URL: https://issues.apache.org/jira/browse/HADOOP-16379
Project:
[
https://issues.apache.org/jira/browse/HADOOP-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865897#comment-16865897
]
Sahil Takiar commented on HADOOP-16371:
---
[~ste...@apache.org] PR is ready for review:
[
https://issues.apache.org/jira/browse/HADOOP-16346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864182#comment-16864182
]
Sahil Takiar commented on HADOOP-16346:
---
Filed HADOOP-16371
> Stabilize S3A OpenSSL support
>
[
https://issues.apache.org/jira/browse/HADOOP-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863400#comment-16863400
]
Sahil Takiar commented on HADOOP-16371:
---
I'm thinking we can use most of the changes from
Sahil Takiar created HADOOP-16371:
-
Summary: Option to disable GCM for SSL connections when running on
Java 8
Key: HADOOP-16371
URL: https://issues.apache.org/jira/browse/HADOOP-16371
Project: Hadoop
[
https://issues.apache.org/jira/browse/HADOOP-16346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862480#comment-16862480
]
Sahil Takiar commented on HADOOP-16346:
---
HADOOP-16050 also disabled the GCM cipher when running
[
https://issues.apache.org/jira/browse/HADOOP-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844593#comment-16844593
]
Sahil Takiar commented on HADOOP-16321:
---
PR: https://github.com/apache/hadoop/pull/838
CC:
[
https://issues.apache.org/jira/browse/HADOOP-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844090#comment-16844090
]
Sahil Takiar commented on HADOOP-16321:
---
I don't actually know why the {{UnsatisfiedLinkError}}
[
https://issues.apache.org/jira/browse/HADOOP-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844045#comment-16844045
]
Sahil Takiar commented on HADOOP-16321:
---
Can confirm this is environmental, since Hadoop QA is
[
https://issues.apache.org/jira/browse/HADOOP-16321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar reassigned HADOOP-16321:
-
Assignee: Sahil Takiar
> ITestS3ASSL+TestOpenSSLSocketFactory failing with
>
[
https://issues.apache.org/jira/browse/HADOOP-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar resolved HADOOP-16050.
---
Resolution: Fixed
Fix Version/s: 3.3.0
Closing. Thanks for the reviews everyone!
>
[
https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar reassigned HADOOP-13600:
-
Assignee: (was: Sahil Takiar)
> S3a rename() to copy files in a directory in
[
https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841467#comment-16841467
]
Sahil Takiar commented on HADOOP-13600:
---
No longer working on this, so marking as unassigned.
>
[
https://issues.apache.org/jira/browse/HADOOP-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833878#comment-16833878
]
Sahil Takiar commented on HADOOP-16050:
---
[~ste...@apache.org] address the comments on the PR.
[
https://issues.apache.org/jira/browse/HADOOP-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16829361#comment-16829361
]
Sahil Takiar commented on HADOOP-16241:
---
Responding to the rest of Steve's comments:
{quote}
The
[
https://issues.apache.org/jira/browse/HADOOP-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated HADOOP-16050:
--
Status: Open (was: Patch Available)
> s3a SSL connections should use OpenSSL
>
[
https://issues.apache.org/jira/browse/HADOOP-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HADOOP-16050 started by Sahil Takiar.
-
> s3a SSL connections should use OpenSSL
>
[
https://issues.apache.org/jira/browse/HADOOP-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated HADOOP-16050:
--
Status: Patch Available (was: Open)
> s3a SSL connections should use OpenSSL
>
[
https://issues.apache.org/jira/browse/HADOOP-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated HADOOP-16050:
--
Summary: s3a SSL connections should use OpenSSL (was: Support setting
cipher suites for s3a
[
https://issues.apache.org/jira/browse/HADOOP-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16829315#comment-16829315
]
Sahil Takiar commented on HADOOP-16050:
---
Assigning to myself as I have seen similar overhead in
[
https://issues.apache.org/jira/browse/HADOOP-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar reassigned HADOOP-16050:
-
Assignee: Sahil Takiar
> Support setting cipher suites for s3a file system
>
[
https://issues.apache.org/jira/browse/HADOOP-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated HADOOP-16241:
--
Attachment: impala-web_returns-scan-flamegraph.svg
> S3AInputStream PositionReadable should
[
https://issues.apache.org/jira/browse/HADOOP-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828863#comment-16828863
]
Sahil Takiar commented on HADOOP-16241:
---
Attached a flamegraph of an Impala full table scan of
[
https://issues.apache.org/jira/browse/HADOOP-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825610#comment-16825610
]
Sahil Takiar edited comment on HADOOP-16241 at 4/25/19 12:48 AM:
-
[
https://issues.apache.org/jira/browse/HADOOP-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated HADOOP-16241:
--
Attachment: Impala-TPCDS-scans.zip
> S3AInputStream PositionReadable should perform ranged
[
https://issues.apache.org/jira/browse/HADOOP-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825610#comment-16825610
]
Sahil Takiar commented on HADOOP-16241:
---
Thanks for taking a look a this [~ste...@apache.org],
[
https://issues.apache.org/jira/browse/HADOOP-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813736#comment-16813736
]
Sahil Takiar commented on HADOOP-16241:
---
Taking another look at the code, I misunderstood the
[
https://issues.apache.org/jira/browse/HADOOP-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812779#comment-16812779
]
Sahil Takiar commented on HADOOP-16241:
---
CC: [~ste...@apache.org] if you have any thoughts on
Sahil Takiar created HADOOP-16241:
-
Summary: S3AInputStream PositionReadable should perform ranged
read on dedicated stream
Key: HADOOP-16241
URL: https://issues.apache.org/jira/browse/HADOOP-16241
[
https://issues.apache.org/jira/browse/HADOOP-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809513#comment-16809513
]
Sahil Takiar commented on HADOOP-14747:
---
[~ste...@apache.org] opened a PR:
[
https://issues.apache.org/jira/browse/HADOOP-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated HADOOP-14747:
--
Status: Patch Available (was: Open)
> S3AInputStream to implement CanUnbuffer
>
[
https://issues.apache.org/jira/browse/HADOOP-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807918#comment-16807918
]
Sahil Takiar commented on HADOOP-14747:
---
Assigning to myself as I am planning to work on this. I
[
https://issues.apache.org/jira/browse/HADOOP-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar reassigned HADOOP-14747:
-
Assignee: Sahil Takiar
> S3AInputStream to implement CanUnbuffer
>
[
https://issues.apache.org/jira/browse/HADOOP-14603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771190#comment-16771190
]
Sahil Takiar edited comment on HADOOP-14603 at 3/7/19 3:35 PM:
---
Looked
[
https://issues.apache.org/jira/browse/HADOOP-14603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771190#comment-16771190
]
Sahil Takiar commented on HADOOP-14603:
---
Looked into this a bit while working on HDFS-3246, as
[
https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated HADOOP-13600:
--
Target Version/s: 3.1.0
Status: Patch Available (was: Open)
> S3a rename() to
[
https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated HADOOP-13600:
--
Status: Open (was: Patch Available)
> S3a rename() to copy files in a directory in parallel
[
https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163348#comment-16163348
]
Sahil Takiar commented on HADOOP-13600:
---
[~ste...@apache.org] thanks for taking a look!
* Thanks
[
https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated HADOOP-13600:
--
Status: Patch Available (was: Open)
> S3a rename() to copy files in a directory in parallel
[
https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sahil Takiar updated HADOOP-13600:
--
Attachment: HADOOP-13600.001.patch
> S3a rename() to copy files in a directory in parallel
>
[
https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16159377#comment-16159377
]
Sahil Takiar commented on HADOOP-13600:
---
Rebased this patch and made some bug fixes:
* Details of
[
https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752159#comment-15752159
]
Sahil Takiar commented on HADOOP-13600:
---
[~ste...@apache.org], [~thodemoor]
Do you both have some
[
https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707670#comment-15707670
]
Sahil Takiar commented on HADOOP-13600:
---
Sounds good Steve. I rebased the PR and created a
[
https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704351#comment-15704351
]
Sahil Takiar commented on HADOOP-13600:
---
Will take a look at HADOOP-13823
Addressed a few of the
[
https://issues.apache.org/jira/browse/HADOOP-13826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703679#comment-15703679
]
Sahil Takiar commented on HADOOP-13826:
---
Interesting, did not know that about mutli-part uploads.
[
https://issues.apache.org/jira/browse/HADOOP-13826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687214#comment-15687214
]
Sahil Takiar commented on HADOOP-13826:
---
[~ste...@apache.org] I think Sean may have meant
[
https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15654993#comment-15654993
]
Sahil Takiar commented on HADOOP-13600:
---
[~ste...@apache.org] I created a Pull Request:
65 matches
Mail list logo
