[jira] [Commented] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile() + S3 Select

2019-01-18 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16746835#comment-16746835 ] Aaron Fabbri commented on HADOOP-15229: --- Thanks for the discussion [~ste...@apach

[jira] [Commented] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile() + S3 Select

2019-01-24 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751744#comment-16751744 ] Aaron Fabbri commented on HADOOP-15229: --- I looked at the latest large patch today

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

2019-01-31 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16757837#comment-16757837 ] Aaron Fabbri commented on HADOOP-16085: --- Hi guys. We've thought about this issue

[jira] [Commented] (HADOOP-16085) S3Guard: use object version to protect against inconsistent read after replace/overwrite

2019-02-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16763078#comment-16763078 ] Aaron Fabbri commented on HADOOP-16085: --- {quote}My other concern is that this req

[jira] [Commented] (HADOOP-16119) KMS on Hadoop RPC Engine

2019-02-28 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780873#comment-16780873 ] Aaron Fabbri commented on HADOOP-16119: --- Thank you for writing this up [~jojochua

[jira] [Commented] (HADOOP-16169) ABFS: Bug fix for getPathProperties

2019-03-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787507#comment-16787507 ] Aaron Fabbri commented on HADOOP-16169: --- +1 Patch looks good to me [~DanielZhou].

[jira] [Commented] (HADOOP-16188) s3a rename failed during copy, "Unable to copy part" + 200 error code

2019-03-14 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793058#comment-16793058 ] Aaron Fabbri commented on HADOOP-16188: --- uhhh.. I'm shaking my head here. S3 is s

[jira] [Commented] (HADOOP-16798) job commit failure in S3A MR magic committer test

2020-07-07 Thread Aaron Fabbri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153199#comment-17153199 ] Aaron Fabbri commented on HADOOP-16798: --- I missed the party on this one, but just

[jira] [Commented] (HADOOP-16830) Add public IOStatistics API; S3A to support

2020-07-22 Thread Aaron Fabbri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163131#comment-17163131 ] Aaron Fabbri commented on HADOOP-16830: --- Been following along. I should be able t

[jira] [Commented] (HADOOP-16193) add extra S3A MPU test to see what happens if a file is created during the MPU

2019-04-04 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16810320#comment-16810320 ] Aaron Fabbri commented on HADOOP-16193: --- Patch looks good to me but I had a failu

[jira] [Commented] (HADOOP-16118) S3Guard to support on-demand DDB tables

2019-04-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815057#comment-16815057 ] Aaron Fabbri commented on HADOOP-16118: --- +1 on the patch. Thank you for the contr

[jira] [Commented] (HADOOP-16252) Use configurable dynamo table name prefix in S3Guard tests

2019-04-17 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820403#comment-16820403 ] Aaron Fabbri commented on HADOOP-16252: --- +1 LGTM. You're only affecting the table

[jira] [Commented] (HADOOP-16221) S3Guard: fail write that doesn't update metadata store

2019-04-30 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830848#comment-16830848 ] Aaron Fabbri commented on HADOOP-16221: --- Sorry I didn't see this until now. Thank

[jira] [Commented] (HADOOP-16251) ABFS: add FSMainOperationsBaseTest

2019-05-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831936#comment-16831936 ] Aaron Fabbri commented on HADOOP-16251: --- Thanks for the patch [~DanielZhou]. We r

[jira] [Comment Edited] (HADOOP-16251) ABFS: add FSMainOperationsBaseTest

2019-05-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831936#comment-16831936 ] Aaron Fabbri edited comment on HADOOP-16251 at 5/2/19 8:31 PM: --

[jira] [Updated] (HADOOP-16291) HDFS Permissions Guide appears incorrect about getFileStatus()/getFileInfo()

2019-05-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-16291: -- Labels: newbie (was: ) > HDFS Permissions Guide appears incorrect about getFileStatus()/getF

[jira] [Created] (HADOOP-16291) HDFS Permissions Guide appears incorrect about getFileStatus()/getFileInfo()

2019-05-02 Thread Aaron Fabbri (JIRA)
Aaron Fabbri created HADOOP-16291: - Summary: HDFS Permissions Guide appears incorrect about getFileStatus()/getFileInfo() Key: HADOOP-16291 URL: https://issues.apache.org/jira/browse/HADOOP-16291 Proj

[jira] [Commented] (HADOOP-16251) ABFS: add FSMainOperationsBaseTest

2019-05-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831967#comment-16831967 ] Aaron Fabbri commented on HADOOP-16251: --- FYI: Filed HADOOP-16291 to address the e

[jira] [Commented] (HADOOP-16291) HDFS Permissions Guide appears incorrect about getFileStatus()/getFileInfo()

2019-05-03 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16832644#comment-16832644 ] Aaron Fabbri commented on HADOOP-16291: --- Thanks [~daryn]. Thought it was strange

[jira] [Commented] (HADOOP-16269) ABFS: add listFileStatus with StartFrom

2019-05-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835778#comment-16835778 ] Aaron Fabbri commented on HADOOP-16269: --- This was on my todo list today but [~ste

[jira] [Comment Edited] (HADOOP-16278) With S3A Filesystem, Long Running services End up Doing lot of GC and eventually die

2019-05-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835783#comment-16835783 ] Aaron Fabbri edited comment on HADOOP-16278 at 5/8/19 5:47 PM: --

[jira] [Commented] (HADOOP-16278) With S3A Filesystem, Long Running services End up Doing lot of GC and eventually die

2019-05-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835783#comment-16835783 ] Aaron Fabbri commented on HADOOP-16278: --- Agreed, +1 this simple patch stopping th

[jira] [Commented] (HADOOP-16279) S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

2019-05-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835785#comment-16835785 ] Aaron Fabbri commented on HADOOP-16279: --- [~ste...@apache.org] I'd argue LocalMeta

[jira] [Commented] (HADOOP-16279) S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

2019-05-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835944#comment-16835944 ] Aaron Fabbri commented on HADOOP-16279: --- Thanks for the work on this stuff [~gabo

[jira] [Commented] (HADOOP-16251) ABFS: add FSMainOperationsBaseTest

2019-05-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835999#comment-16835999 ] Aaron Fabbri commented on HADOOP-16251: --- Sorry for the confusion [~DanielZhou]. I

[jira] [Comment Edited] (HADOOP-16251) ABFS: add FSMainOperationsBaseTest

2019-05-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16831936#comment-16831936 ] Aaron Fabbri edited comment on HADOOP-16251 at 5/9/19 1:04 AM: --

[jira] [Commented] (HADOOP-16251) ABFS: add FSMainOperationsBaseTest

2019-05-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16836626#comment-16836626 ] Aaron Fabbri commented on HADOOP-16251: --- I had one remaining question on your Ign

[jira] [Commented] (HADOOP-16251) ABFS: add FSMainOperationsBaseTest

2019-05-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16837600#comment-16837600 ] Aaron Fabbri commented on HADOOP-16251: --- Committed to trunk. Thank you for the co

[jira] [Resolved] (HADOOP-16251) ABFS: add FSMainOperationsBaseTest

2019-05-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri resolved HADOOP-16251. --- Resolution: Fixed Fix Version/s: 3.2.1 > ABFS: add FSMainOperationsBaseTest > --

[jira] [Commented] (HADOOP-16279) S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

2019-05-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840799#comment-16840799 ] Aaron Fabbri commented on HADOOP-16279: --- {quote}with HADOOP-15999 we changed a bi

[jira] [Comment Edited] (HADOOP-16279) S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

2019-05-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840799#comment-16840799 ] Aaron Fabbri edited comment on HADOOP-16279 at 5/15/19 9:34 PM: -

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-05-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840844#comment-16840844 ] Aaron Fabbri commented on HADOOP-15999: --- What about in-band delete (create tombst

[jira] [Commented] (HADOOP-16279) S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

2019-05-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840849#comment-16840849 ] Aaron Fabbri commented on HADOOP-16279: --- {quote}With HADOOP-15999 we changed a bi

[jira] [Commented] (HADOOP-16279) S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

2019-05-22 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846116#comment-16846116 ] Aaron Fabbri commented on HADOOP-16279: --- Good discussion, thanks. {quote}AF> ...

[jira] [Commented] (HADOOP-16279) S3Guard: Implement time-based (TTL) expiry for entries (and tombstones)

2019-05-22 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846126#comment-16846126 ] Aaron Fabbri commented on HADOOP-16279: --- {quote}GB>I'm having a hard time impleme

[jira] [Commented] (HADOOP-16324) S3A Delegation Token code to spell "Marshalled" as Marshaled

2019-05-22 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846140#comment-16846140 ] Aaron Fabbri commented on HADOOP-16324: --- Blimey this one is easy peasy. Either op

[jira] [Commented] (HADOOP-15183) S3Guard store becomes inconsistent after partial failure of rename

2019-05-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851518#comment-16851518 ] Aaron Fabbri commented on HADOOP-15183: --- Looking good [~ste...@apache.org]. A lot

[jira] [Commented] (HADOOP-16547) s3guard prune command doesn't get AWS auth chain from FS

2019-09-17 Thread Aaron Fabbri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16931680#comment-16931680 ] Aaron Fabbri commented on HADOOP-16547: --- Current patch +1 LTGM after you address

[jira] [Commented] (HADOOP-15691) Add PathCapabilities to FS and FC to complement StreamCapabilities

2019-09-20 Thread Aaron Fabbri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934199#comment-16934199 ] Aaron Fabbri commented on HADOOP-15691: --- +1 on latest pull request pending clean

[jira] [Commented] (HADOOP-16605) NPE in TestAdlSdkConfiguration failing in yetus

2019-10-02 Thread Aaron Fabbri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16943302#comment-16943302 ] Aaron Fabbri commented on HADOOP-16605: --- PR looks good to me. +1 > NPE in TestAd

[jira] [Commented] (HADOOP-16725) s3guard prune can delete directories -leaving orphan children.

2019-11-25 Thread Aaron Fabbri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16981786#comment-16981786 ] Aaron Fabbri commented on HADOOP-16725: --- Sounds good. Thanks for running through

[jira] [Commented] (HADOOP-16430) S3AFilesystem.delete to incrementally update s3guard with deletions

2019-08-28 Thread Aaron Fabbri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918167#comment-16918167 ] Aaron Fabbri commented on HADOOP-16430: --- Thanks for the work on this. Looks prett

[jira] [Commented] (HADOOP-16430) S3AFilesystem.delete to incrementally update s3guard with deletions

2019-08-29 Thread Aaron Fabbri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918773#comment-16918773 ] Aaron Fabbri commented on HADOOP-16430: --- +1 LGTM after your clarifying comments..

[jira] [Commented] (HADOOP-16430) S3AFilesystem.delete to incrementally update s3guard with deletions

2019-09-04 Thread Aaron Fabbri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16922903#comment-16922903 ] Aaron Fabbri commented on HADOOP-16430: --- Latest PR commits reviewed (+1). Aside:

[jira] [Commented] (HADOOP-16792) Let s3 clients configure request timeout

2020-01-08 Thread Aaron Fabbri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011401#comment-17011401 ] Aaron Fabbri commented on HADOOP-16792: --- Hi [~mustafaiman] . All the site docs li

[jira] [Commented] (HADOOP-13230) S3A to optionally retain directory markers; look under a marker for files when needEmptyDir=true

2020-03-10 Thread Aaron Fabbri (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056471#comment-17056471 ] Aaron Fabbri commented on HADOOP-13230: --- [~ste...@apache.org] I'll take a look if

[jira] [Updated] (HADOOP-14738) Remove S3N and obsolete bits of S3A; rework docs

2017-09-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14738: -- Attachment: HADOOP-14738-006.patch Attaching v6 patch.. Just the v5 patch rebased (and whitesp

[jira] [Updated] (HADOOP-14738) Remove S3N and obsolete bits of S3A; rework docs

2017-09-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14738: -- Status: Patch Available (was: Open) > Remove S3N and obsolete bits of S3A; rework docs >

[jira] [Commented] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-09-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165549#comment-16165549 ] Aaron Fabbri commented on HADOOP-14553: --- Coming back to test and review this again

[jira] [Commented] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-09-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165663#comment-16165663 ] Aaron Fabbri commented on HADOOP-14553: --- Just noticed your comment above which ans

[jira] [Commented] (HADOOP-14738) Remove S3N and obsolete bits of S3A; rework docs

2017-09-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165668#comment-16165668 ] Aaron Fabbri commented on HADOOP-14738: --- javac warning is existing FAST_UPLOAD con

[jira] [Comment Edited] (HADOOP-14738) Remove S3N and obsolete bits of S3A; rework docs

2017-09-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165668#comment-16165668 ] Aaron Fabbri edited comment on HADOOP-14738 at 9/14/17 3:38 AM: --

[jira] [Commented] (HADOOP-14738) Remove S3N and obsolete bits of S3A; rework docs

2017-09-14 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16166597#comment-16166597 ] Aaron Fabbri commented on HADOOP-14738: --- Yep I'd relaunched the jenkins run and th

[jira] [Updated] (HADOOP-14738) Remove S3N and obsolete bits of S3A; rework docs

2017-09-14 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14738: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Av

[jira] [Commented] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-09-14 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167002#comment-16167002 ] Aaron Fabbri commented on HADOOP-14553: --- Thanks [~ste...@apache.org]. I re-ran al

[jira] [Commented] (HADOOP-14738) Remove S3N and obsolete bits of S3A; rework docs

2017-09-14 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167055#comment-16167055 ] Aaron Fabbri commented on HADOOP-14738: --- Thanks [~andrew.wang]. I'm re-running te

[jira] [Commented] (HADOOP-14738) Remove S3N and obsolete bits of S3A; rework docs

2017-09-14 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16167102#comment-16167102 ] Aaron Fabbri commented on HADOOP-14738: --- Committed to branch-3.0 as well. > Remov

[jira] [Comment Edited] (HADOOP-14220) Enhance S3GuardTool with bucket-info and set-capacity commands, tests

2017-09-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168258#comment-16168258 ] Aaron Fabbri edited comment on HADOOP-14220 at 9/15/17 5:53 PM: --

[jira] [Commented] (HADOOP-14220) Enhance S3GuardTool with bucket-info and set-capacity commands, tests

2017-09-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168258#comment-16168258 ] Aaron Fabbri commented on HADOOP-14220: --- Thanks for an update. I will try to test

[jira] [Updated] (HADOOP-14220) Enhance S3GuardTool with bucket-info and set-capacity commands, tests

2017-09-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14220: -- Status: Open (was: Patch Available) > Enhance S3GuardTool with bucket-info and set-capacity c

[jira] [Commented] (HADOOP-14220) Enhance S3GuardTool with bucket-info and set-capacity commands, tests

2017-09-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168547#comment-16168547 ] Aaron Fabbri commented on HADOOP-14220: --- Looking at v12 patch. {noformat} + +

[jira] [Updated] (HADOOP-14220) Enhance S3GuardTool with bucket-info and set-capacity commands, tests

2017-09-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14220: -- Attachment: HADOOP-14220-013.patch Attaching v13 patch as mentioned above. > Enhance S3GuardT

[jira] [Updated] (HADOOP-14220) Enhance S3GuardTool with bucket-info and set-capacity commands, tests

2017-09-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14220: -- Status: Patch Available (was: Open) > Enhance S3GuardTool with bucket-info and set-capacity c

[jira] [Commented] (HADOOP-14220) Enhance S3GuardTool with bucket-info and set-capacity commands, tests

2017-09-15 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168622#comment-16168622 ] Aaron Fabbri commented on HADOOP-14220: --- Testing v13 patch ran into three failures

[jira] [Commented] (HADOOP-14220) Enhance S3GuardTool with bucket-info and set-capacity commands, tests

2017-09-22 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16177400#comment-16177400 ] Aaron Fabbri commented on HADOOP-14220: --- Getting around to this again [~ste...@apa

[jira] [Updated] (HADOOP-14220) Enhance S3GuardTool with bucket-info and set-capacity commands, tests

2017-09-25 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14220: -- Status: Patch Available (was: Open) > Enhance S3GuardTool with bucket-info and set-capacity c

[jira] [Updated] (HADOOP-14220) Enhance S3GuardTool with bucket-info and set-capacity commands, tests

2017-09-25 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14220: -- Attachment: HADOOP-14220-016.patch Took v15 patch and tested in us-west-2; all clear. Attachi

[jira] [Commented] (HADOOP-14220) Enhance S3GuardTool with bucket-info and set-capacity commands, tests

2017-09-25 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16179924#comment-16179924 ] Aaron Fabbri commented on HADOOP-14220: --- Committed to trunk and branch-3.0. Thank

[jira] [Updated] (HADOOP-14220) Enhance S3GuardTool with bucket-info and set-capacity commands, tests

2017-09-25 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14220: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Enhance S3GuardTool with

[jira] [Commented] (HADOOP-14890) Move up to AWS SDK 1.11.199

2017-09-25 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16179944#comment-16179944 ] Aaron Fabbri commented on HADOOP-14890: --- Testing this now (unit, integration, scal

[jira] [Updated] (HADOOP-14890) Move up to AWS SDK 1.11.199

2017-09-25 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14890: -- Fix Version/s: (was: 2.8.0) 3.0.0 > Move up to AWS SDK 1.11.199 > -

[jira] [Updated] (HADOOP-14890) Move up to AWS SDK 1.11.199

2017-09-25 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14890: -- Release Note: (was: Committed to trunk and branch-3.0. Scale, unit, and integration tests a

[jira] [Updated] (HADOOP-14890) Move up to AWS SDK 1.11.199

2017-09-25 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14890: -- Resolution: Fixed Release Note: Committed to trunk and branch-3.0. Scale, unit, and int

[jira] [Commented] (HADOOP-14890) Move up to AWS SDK 1.11.199

2017-09-25 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16179998#comment-16179998 ] Aaron Fabbri commented on HADOOP-14890: --- Committed to trunk and branch-3.0. Scale

[jira] [Commented] (HADOOP-14890) Move up to AWS SDK 1.11.199

2017-09-26 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181272#comment-16181272 ] Aaron Fabbri commented on HADOOP-14890: --- +1 on branch-2 patch, LGTM. > Move up to

[jira] [Commented] (HADOOP-14918) remove the Local Dynamo DB test option

2017-10-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189188#comment-16189188 ] Aaron Fabbri commented on HADOOP-14918: --- The local dynamo lib was useful during de

[jira] [Created] (HADOOP-14927) ITestS3GuardTool failures in testDestroyNoBucket()

2017-10-03 Thread Aaron Fabbri (JIRA)
Aaron Fabbri created HADOOP-14927: - Summary: ITestS3GuardTool failures in testDestroyNoBucket() Key: HADOOP-14927 URL: https://issues.apache.org/jira/browse/HADOOP-14927 Project: Hadoop Common

[jira] [Commented] (HADOOP-14927) ITestS3GuardTool failures in testDestroyNoBucket()

2017-10-03 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190506#comment-16190506 ] Aaron Fabbri commented on HADOOP-14927: --- [~ste...@apache.org] looking at the code

[jira] [Assigned] (HADOOP-13974) S3a CLI to support list/purge of pending multipart commits

2017-10-03 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri reassigned HADOOP-13974: - Assignee: Aaron Fabbri > S3a CLI to support list/purge of pending multipart commits > -

[jira] [Commented] (HADOOP-13974) S3a CLI to support list/purge of pending multipart commits

2017-10-03 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190577#comment-16190577 ] Aaron Fabbri commented on HADOOP-13974: --- I'll try to throw something together this

[jira] [Resolved] (HADOOP-14746) Cut S3AOutputStream

2017-10-04 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri resolved HADOOP-14746. --- Resolution: Duplicate Fix Version/s: 3.0.0-beta1 Resolving this.. it was covered by H

[jira] [Created] (HADOOP-14936) S3Guard: remove "experimental" from documentation

2017-10-06 Thread Aaron Fabbri (JIRA)
Aaron Fabbri created HADOOP-14936: - Summary: S3Guard: remove "experimental" from documentation Key: HADOOP-14936 URL: https://issues.apache.org/jira/browse/HADOOP-14936 Project: Hadoop Common

[jira] [Commented] (HADOOP-13974) S3a CLI to support list/purge of pending multipart commits

2017-10-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16195441#comment-16195441 ] Aaron Fabbri commented on HADOOP-13974: --- Thanks [~ste...@apache.org]. I was think

[jira] [Updated] (HADOOP-13974) S3a CLI to support list/purge of pending multipart commits

2017-10-11 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13974: -- Attachment: HADOOP-13974.001.patch Attaching v1 patch. Some caveats I'd like feedback on: -

[jira] [Comment Edited] (HADOOP-13974) S3a CLI to support list/purge of pending multipart commits

2017-10-11 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16201032#comment-16201032 ] Aaron Fabbri edited comment on HADOOP-13974 at 10/11/17 9:51 PM: -

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to S3 endpoints

2017-10-11 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16201197#comment-16201197 ] Aaron Fabbri commented on HADOOP-13786: --- Thanks [~ste...@apache.org]. I'll bug any

[jira] [Updated] (HADOOP-13974) S3a CLI to support list/purge of pending multipart commits

2017-10-11 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13974: -- Attachment: HADOOP-13974.002.patch v2 patch: - Adds "-expect" option as suggested above by [~

[jira] [Updated] (HADOOP-13974) S3a CLI to support list/purge of pending multipart commits

2017-10-12 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13974: -- Status: Patch Available (was: Open) > S3a CLI to support list/purge of pending multipart comm

[jira] [Updated] (HADOOP-13974) S3a CLI to support list/purge of pending multipart commits

2017-10-12 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13974: -- Attachment: HADOOP-13974.003.patch v3 patch. - Adds "are you sure" prompt any time `-abort` i

[jira] [Commented] (HADOOP-13974) S3a CLI to support list/purge of pending multipart commits

2017-10-12 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202612#comment-16202612 ] Aaron Fabbri commented on HADOOP-13974: --- Yes, [~ste...@apache.org] happy to focus

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to S3 endpoints

2017-10-12 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202674#comment-16202674 ] Aaron Fabbri commented on HADOOP-13786: --- Wow great work. I will re-review and do m

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to S3 endpoints

2017-10-16 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16207046#comment-16207046 ] Aaron Fabbri commented on HADOOP-13786: --- I'm still reviewing and testing this stuf

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to S3 endpoints

2017-10-17 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16208734#comment-16208734 ] Aaron Fabbri commented on HADOOP-13786: --- Going to start posting some comments on v

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to S3 endpoints

2017-10-17 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16208754#comment-16208754 ] Aaron Fabbri commented on HADOOP-13786: --- Feeling another wave coming on.. Documen

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to S3 endpoints

2017-10-18 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210344#comment-16210344 ] Aaron Fabbri commented on HADOOP-13786: --- In terms of testing, one issue I'm hittin

[jira] [Commented] (HADOOP-14965) s3a input stream "normal" fadvise mode to be adaptive

2017-10-19 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211405#comment-16211405 ] Aaron Fabbri commented on HADOOP-14965: --- Seems like a good idea to make it adaptiv

[jira] [Commented] (HADOOP-14098) AliyunOSS: improve the performance of object metadata operation

2017-10-19 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211442#comment-16211442 ] Aaron Fabbri commented on HADOOP-14098: --- I made efforts to keep the MetadataStore

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to S3 endpoints

2017-10-19 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211899#comment-16211899 ] Aaron Fabbri commented on HADOOP-13786: --- I was unable to reproduce the du failure

[jira] [Comment Edited] (HADOOP-13786) Add S3Guard committer for zero-rename commits to S3 endpoints

2017-10-19 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211899#comment-16211899 ] Aaron Fabbri edited comment on HADOOP-13786 at 10/20/17 1:14 AM: -

[jira] [Commented] (HADOOP-14973) [s3a] Log StorageStatistics

2017-10-26 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16220862#comment-16220862 ] Aaron Fabbri commented on HADOOP-14973: --- I've seen the toString() stuff, but it do

  1   2   3   4   5   6   7   8   9   10   >