[jira] [Updated] (HADOOP-14722) Azure: BlockBlobInputStream position incorrect after seek

2017-08-01 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14722: -- Attachment: HADOOP-14722-001.patch Attaching HADOOP-14722-001.patch. The fix

[jira] [Updated] (HADOOP-14722) Azure: BlockBlobInputStream position incorrect after seek

2017-08-01 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14722: -- Status: Patch Available (was: Open) > Azure: BlockBlobInputStream position incorrect

[jira] [Updated] (HADOOP-14722) Azure: BlockBlobInputStream position incorrect after seek

2017-08-02 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14722: -- Attachment: HADOOP-14722-002.patch Attaching HADOOP-14722-002.patch. This addresses

[jira] [Created] (HADOOP-14722) Azure: BlockBlobInputStream position incorrect after seek

2017-08-01 Thread Thomas Marquardt (JIRA)
Thomas Marquardt created HADOOP-14722: - Summary: Azure: BlockBlobInputStream position incorrect after seek Key: HADOOP-14722 URL: https://issues.apache.org/jira/browse/HADOOP-14722 Project: Hadoop

[jira] [Commented] (HADOOP-14715) TestWasbRemoteCallHelper failing

2017-08-03 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113195#comment-16113195 ] Thomas Marquardt commented on HADOOP-14715: --- Thanks Steve, +1 from me. I will also follow up

[jira] [Commented] (HADOOP-14722) Azure: BlockBlobInputStream position incorrect after seek

2017-08-03 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113754#comment-16113754 ] Thomas Marquardt commented on HADOOP-14722: --- Let me also add the following responses to

[jira] [Updated] (HADOOP-14722) Azure: BlockBlobInputStream position incorrect after seek

2017-08-03 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14722: -- Attachment: HADOOP-14722-003.patch Attaching patch HADOOP-14722-003.patch. This

[jira] [Commented] (HADOOP-14715) TestWasbRemoteCallHelper failing

2017-08-03 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113738#comment-16113738 ] Thomas Marquardt commented on HADOOP-14715: --- Esfandiar, thanks for finding the regression! In

[jira] [Updated] (HADOOP-14660) wasb: improve throughput by 34% when account limit exceeded

2017-08-15 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14660: -- Attachment: (was: HADOOP-14660-branch-2.patch) > wasb: improve throughput by 34%

[jira] [Commented] (HADOOP-14769) WASB: delete recursive should not fail if a file is deleted

2017-08-15 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127651#comment-16127651 ] Thomas Marquardt commented on HADOOP-14769: --- This patch fixes issues encountered with HBASE

[jira] [Updated] (HADOOP-14660) wasb: improve throughput by 34% when account limit exceeded

2017-08-15 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14660: -- Attachment: HADOOP-14660-branch-2-001.patch Re-attaching

[jira] [Commented] (HADOOP-14583) wasb throws an exception if you try to create a file and there's no parent directory

2017-08-15 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128133#comment-16128133 ] Thomas Marquardt commented on HADOOP-14583: --- I usually make targeted fixes, like you have

[jira] [Updated] (HADOOP-14662) Update azure-storage sdk to version 5.4.0

2017-08-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14662: -- Attachment: HADOOP-14662-branch-2.patch Attaching HADOOP-14662-branch-2.patch This

[jira] [Updated] (HADOOP-14660) wasb: improve throughput by 34% when account limit exceeded

2017-08-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14660: -- Attachment: HADOOP-14660-branch-2.patch Attaching HADOOP-14660-branch-2.patch. This

[jira] [Updated] (HADOOP-14769) WASB: delete recursive should not fail if a file is deleted

2017-08-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14769: -- Status: Patch Available (was: Open) > WASB: delete recursive should not fail if a

[jira] [Updated] (HADOOP-14769) WASB: delete recursive should not fail if a file is deleted

2017-08-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14769: -- Attachment: HADOOP-14769-001.patch Attaching HADOOP-14769-001.patch. This fixes

[jira] [Created] (HADOOP-14769) WASB: delete recursive should not fail if a file is deleted

2017-08-13 Thread Thomas Marquardt (JIRA)
Thomas Marquardt created HADOOP-14769: - Summary: WASB: delete recursive should not fail if a file is deleted Key: HADOOP-14769 URL: https://issues.apache.org/jira/browse/HADOOP-14769 Project:

[jira] [Updated] (HADOOP-14520) WASB: Block compaction for Azure Block Blobs

2017-08-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14520: -- Attachment: HADOOP-14520-006.patch Attaching HADOOP-14520-006.patch. Thanks for the

[jira] [Updated] (HADOOP-14769) WASB: delete recursive should not fail if a file is deleted

2017-08-16 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14769: -- Attachment: HADOOP-14769-002.patch Attaching HADOOP-14769-002.patch. This is only a

[jira] [Commented] (HADOOP-14680) Azure: IndexOutOfBoundsException in BlockBlobInputStream

2017-07-25 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100504#comment-16100504 ] Thomas Marquardt commented on HADOOP-14680: --- I'm looking at it now... > Azure:

[jira] [Updated] (HADOOP-14680) Azure: IndexOutOfBoundsException in BlockBlobInputStream

2017-07-25 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14680: -- Attachment: HADOOP-14680-001.patch Attaching HADOOP-14680-001.patch. This fixes

[jira] [Updated] (HADOOP-14680) Azure: IndexOutOfBoundsException in BlockBlobInputStream

2017-07-25 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14680: -- Assignee: Thomas Marquardt Release Note: Bug fix to Azure Filesystem

[jira] [Commented] (HADOOP-14680) Azure: IndexOutOfBoundsException in BlockBlobInputStream

2017-07-25 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100789#comment-16100789 ] Thomas Marquardt commented on HADOOP-14680: --- All WASB tests are passing with the

[jira] [Updated] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-08-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14553: -- Description: The Azure tests are slow to run as they are serialized, as they are all

[jira] [Updated] (HADOOP-14722) Azure: BlockBlobInputStream position incorrect after seek

2017-08-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14722: -- Attachment: HADOOP-14722-006.patch Attaching HADOOP-14722-006.patch. Thanks for the

[jira] [Commented] (HADOOP-14535) wasb: implement high-performance random access and seek of block blobs

2017-08-01 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109480#comment-16109480 ] Thomas Marquardt commented on HADOOP-14535: --- HADOOP-14535 and HADOOP-14680 depend on each

[jira] [Commented] (HADOOP-14569) NativeAzureFileSystem, AzureBlobStorageTestAccount to have useful toString() values

2017-08-02 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111444#comment-16111444 ] Thomas Marquardt commented on HADOOP-14569: --- Trying to understand this better. How would this

[jira] [Commented] (HADOOP-14715) TestWasbRemoteCallHelper failing

2017-08-07 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117055#comment-16117055 ] Thomas Marquardt commented on HADOOP-14715: --- *TestWasbRemoteCallHelper.java*: *L62* - I

[jira] [Commented] (HADOOP-14715) TestWasbRemoteCallHelper failing

2017-08-07 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117486#comment-16117486 ] Thomas Marquardt commented on HADOOP-14715: --- Looks good. +1 > TestWasbRemoteCallHelper

[jira] [Comment Edited] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-08-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131213#comment-16131213 ] Thomas Marquardt edited comment on HADOOP-14553 at 8/17/17 8:32 PM:

[jira] [Commented] (HADOOP-14520) WASB: Block compaction for Azure Block Blobs

2017-08-16 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129216#comment-16129216 ] Thomas Marquardt commented on HADOOP-14520: --- I started working on an update yesterday, since

[jira] [Commented] (HADOOP-14520) WASB: Block compaction for Azure Block Blobs

2017-08-18 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133912#comment-16133912 ] Thomas Marquardt commented on HADOOP-14520: --- I will hand this off to Georgi, as he is

[jira] [Updated] (HADOOP-14583) wasb throws an exception if you try to create a file and there's no parent directory

2017-08-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-14583: -- Attachment: HADOOP-14583-003.patch Attaching HADOOP-14583-003.patch. This updates

[jira] [Commented] (HADOOP-14768) Honoring sticky bit during Deletion when authorization is enabled in WASB

2017-09-21 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16175083#comment-16175083 ] Thomas Marquardt commented on HADOOP-14768: --- I think the risk of regression is medium, on a

[jira] [Commented] (HADOOP-14768) Honoring sticky bit during Deletion when authorization is enabled in WASB

2017-09-22 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176798#comment-16176798 ] Thomas Marquardt commented on HADOOP-14768: --- I opened HADOOP-14768.005.patch and still see

[jira] [Commented] (HADOOP-14768) Honoring sticky bit during Deletion when authorization is enabled in WASB

2017-09-21 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16175178#comment-16175178 ] Thomas Marquardt commented on HADOOP-14768: --- Yes, lets make it so if "fs.azure.authorization"

[jira] [Commented] (HADOOP-14768) Honoring sticky bit during Deletion when authorization is enabled in WASB

2017-09-22 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176913#comment-16176913 ] Thomas Marquardt commented on HADOOP-14768: --- I had two goals: 1) reduce risk and 2) allow you

[jira] [Commented] (HADOOP-14768) Honoring sticky bit during Deletion when authorization is enabled in WASB

2017-09-19 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172143#comment-16172143 ] Thomas Marquardt commented on HADOOP-14768: --- Looks good overall, but does not fully implement

[jira] [Commented] (HADOOP-14935) Azure: POSIX permissions are taking effect in access() method even when authorization is enabled

2017-10-12 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202282#comment-16202282 ] Thomas Marquardt commented on HADOOP-14935: --- The new config option for getFileStatus should be

[jira] [Commented] (HADOOP-14935) Azure: POSIX permissions are taking effect in access() method even when authorization is enabled

2017-10-12 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202682#comment-16202682 ] Thomas Marquardt commented on HADOOP-14935: --- Steve, I read the description for HADOOP-14845

[jira] [Commented] (HADOOP-14820) Fix for HDFS semantics parity for mkdirs -p

2017-08-30 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147860#comment-16147860 ] Thomas Marquardt commented on HADOOP-14820: --- Looks good. I have the following feedback:

[jira] [Commented] (HADOOP-14768) Honoring sticky bit during Deletion when authorization is enabled in WASB

2017-09-25 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179886#comment-16179886 ] Thomas Marquardt commented on HADOOP-14768: --- +1, thanks for removing the risk from the change.

[jira] [Commented] (HADOOP-13327) Add OutputStream + Syncable to the Filesystem Specification

2017-08-25 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142064#comment-16142064 ] Thomas Marquardt commented on HADOOP-13327: --- Thanks, cleaning up the specification and

[jira] [Comment Edited] (HADOOP-13327) Add OutputStream + Syncable to the Filesystem Specification

2017-08-25 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142064#comment-16142064 ] Thomas Marquardt edited comment on HADOOP-13327 at 8/25/17 7:30 PM:

[jira] [Commented] (HADOOP-14553) Add (parallelized) integration tests to hadoop-azure

2017-08-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131213#comment-16131213 ] Thomas Marquardt commented on HADOOP-14553: --- It is great to see the work that has been done

[jira] [Commented] (HADOOP-13327) Add OutputStream + Syncable to the Filesystem Specification

2017-08-31 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149273#comment-16149273 ] Thomas Marquardt commented on HADOOP-13327: --- The notation documentation makes sense. We

[jira] [Commented] (HADOOP-14935) Azure: POSIX permissions are taking effect in access() method even when authorization is enabled

2017-10-11 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201270#comment-16201270 ] Thomas Marquardt commented on HADOOP-14935: --- Some feedback on HADOOP-14935-003.patch.

[jira] [Commented] (HADOOP-14820) Wasb mkdirs security checks inconsistent with HDFS

2017-11-30 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273707#comment-16273707 ] Thomas Marquardt commented on HADOOP-14820: --- It was ported to branch-2. Who is using 2.8.x?

[jira] [Created] (HADOOP-14996) wasb: ReadFully occasionally fails when using page blobs

2017-10-30 Thread Thomas Marquardt (JIRA)
Thomas Marquardt created HADOOP-14996: - Summary: wasb: ReadFully occasionally fails when using page blobs Key: HADOOP-14996 URL: https://issues.apache.org/jira/browse/HADOOP-14996 Project: Hadoop

[jira] [Assigned] (HADOOP-15086) NativeAzureFileSystem file rename is not atomic

2017-12-20 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt reassigned HADOOP-15086: - Assignee: Thomas Marquardt > NativeAzureFileSystem file rename is not atomic >

[jira] [Updated] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15446: -- Attachment: HADOOP-15446-002.patch > WASB: PageBlobInputStream.skip breaks HBASE

[jira] [Commented] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464138#comment-16464138 ] Thomas Marquardt commented on HADOOP-15446: --- I've attached HADOOP-15446-002.patch with the

[jira] [Updated] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15446: -- Status: Patch Available (was: In Progress) Submitting patch HADOOP-15446-002.patch

[jira] [Updated] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15446: -- Status: In Progress (was: Patch Available) Resuming progress with

[jira] [Commented] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464483#comment-16464483 ] Thomas Marquardt commented on HADOOP-15446: --- Hi Steve, I have attached

[jira] [Updated] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15446: -- Attachment: HADOOP-15446-003.patch > WASB: PageBlobInputStream.skip breaks HBASE

[jira] [Commented] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-07 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466557#comment-16466557 ] Thomas Marquardt commented on HADOOP-15446: --- Yes, I will submit a branch-2 patch later today.

[jira] [Commented] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-07 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466846#comment-16466846 ] Thomas Marquardt commented on HADOOP-15446: --- FYI, the same changes apply to both branch-2 and

[jira] [Updated] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-07 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15446: -- Attachment: HADOOP-15446-branch-2.001.patch > WASB: PageBlobInputStream.skip breaks

[jira] [Commented] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-07 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466843#comment-16466843 ] Thomas Marquardt commented on HADOOP-15446: --- For branch-2, I've attached

[jira] [Created] (HADOOP-15478) WASB: hflush() and hsync() regression

2018-05-18 Thread Thomas Marquardt (JIRA)
Thomas Marquardt created HADOOP-15478: - Summary: WASB: hflush() and hsync() regression Key: HADOOP-15478 URL: https://issues.apache.org/jira/browse/HADOOP-15478 Project: Hadoop Common

[jira] [Commented] (HADOOP-15478) WASB: hflush() and hsync() regression

2018-05-19 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481743#comment-16481743 ] Thomas Marquardt commented on HADOOP-15478: --- My storage account in West US.  Test results are

[jira] [Commented] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-05-23 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488207#comment-16488207 ] Thomas Marquardt commented on HADOOP-15407: --- Thanks, we are validating the initial patch. 

[jira] [Commented] (HADOOP-15478) WASB: hflush() and hsync() regression

2018-05-18 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481157#comment-16481157 ] Thomas Marquardt commented on HADOOP-15478: --- I've attached HADOOP-15478.001.patch with the fix

[jira] [Updated] (HADOOP-15478) WASB: hflush() and hsync() regression

2018-05-18 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15478: -- Status: Patch Available (was: Open) Submitting patch HADOOP-15478.001.patch > WASB:

[jira] [Updated] (HADOOP-15478) WASB: hflush() and hsync() regression

2018-05-18 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15478: -- Attachment: HADOOP-15478.001.patch > WASB: hflush() and hsync() regression >

[jira] [Updated] (HADOOP-15547) WASB: listStatus performance

2018-06-18 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15547: -- Attachment: HADOOP-15547.003.patch > WASB: listStatus performance >

[jira] [Commented] (HADOOP-15547) WASB: listStatus performance

2018-06-18 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516181#comment-16516181 ] Thomas Marquardt commented on HADOOP-15547: --- Attached HADOOP-15547.003.patch with fixes for

[jira] [Updated] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-06-12 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15407: -- Status: Open (was: Patch Available) > Support Windows Azure Storage - Blob file

[jira] [Updated] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-06-12 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15407: -- Status: Patch Available (was: Open) > Support Windows Azure Storage - Blob file

[jira] [Updated] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-06-12 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15407: -- Attachment: (was: HADOOP-15407-patch-atop-patch-007.patch) > Support Windows

[jira] [Commented] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-06-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512784#comment-16512784 ] Thomas Marquardt commented on HADOOP-15407: --- The plan sounds good to me. Credit for this

[jira] [Comment Edited] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-06-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512784#comment-16512784 ] Thomas Marquardt edited comment on HADOOP-15407 at 6/14/18 5:32 PM:

[jira] [Created] (HADOOP-15547) WASB: listStatus performance

2018-06-17 Thread Thomas Marquardt (JIRA)
Thomas Marquardt created HADOOP-15547: - Summary: WASB: listStatus performance Key: HADOOP-15547 URL: https://issues.apache.org/jira/browse/HADOOP-15547 Project: Hadoop Common Issue Type:

[jira] [Updated] (HADOOP-15547) WASB: listStatus performance

2018-06-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15547: -- Attachment: HADOOP-15547.001.patch > WASB: listStatus performance >

[jira] [Commented] (HADOOP-15547) WASB: listStatus performance

2018-06-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515328#comment-16515328 ] Thomas Marquardt commented on HADOOP-15547: ---  Attaching patch HADOOP-15547.001.patch.  This

[jira] [Updated] (HADOOP-15547) WASB: listStatus performance

2018-06-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15547: -- Status: Patch Available (was: Open) See comments above on the change and test

[jira] [Updated] (HADOOP-15478) WASB: hflush() and hsync() regression

2018-06-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15478: -- Attachment: HADOOP-15547.002.patch > WASB: hflush() and hsync() regression >

[jira] [Commented] (HADOOP-15547) WASB: listStatus performance

2018-06-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515368#comment-16515368 ] Thomas Marquardt commented on HADOOP-15547: --- Attaching HADOOP-15547.002.patch with fixes for

[jira] [Updated] (HADOOP-15547) WASB: listStatus performance

2018-06-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15547: -- Attachment: HADOOP-15547.002.patch > WASB: listStatus performance >

[jira] [Updated] (HADOOP-15478) WASB: hflush() and hsync() regression

2018-06-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15478: -- Attachment: (was: HADOOP-15547.002.patch) > WASB: hflush() and hsync()

[jira] [Updated] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-06-03 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15407: -- Attachment: HADOOP-15407-HADOOP-15407.007.patch > Support Windows Azure Storage -

[jira] [Updated] (HADOOP-15506) Upgrading Azure Storage Sdk version and updated corresponding code blocks

2018-05-31 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15506: -- Release Note: WASB: Fix Spark process hang at shutdown due to use of non-daemon

[jira] [Updated] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-05-31 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15407: -- Attachment: HADOOP-15407-HADOOP-15407.006.patch > Support Windows Azure Storage -

[jira] [Updated] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-05-31 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15407: -- Status: Patch Available (was: Open) Submitting HADOOP-15407-HADOOP-15407.006.patch

[jira] [Commented] (HADOOP-15506) Upgrading Azure Storage Sdk version and updated corresponding code blocks

2018-05-31 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497337#comment-16497337 ] Thomas Marquardt commented on HADOOP-15506: --- +1 > Upgrading Azure Storage Sdk version and

[jira] [Comment Edited] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-05-31 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497218#comment-16497218 ] Thomas Marquardt edited comment on HADOOP-15407 at 5/31/18 9:35 PM:

[jira] [Commented] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-06-06 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503686#comment-16503686 ] Thomas Marquardt commented on HADOOP-15407: --- We updated the patch recently and removed all

[jira] [Updated] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-03 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15446: -- Attachment: HADOOP-15446-001.patch > WASB: PageBlobInputStream.skip breaks HBASE

[jira] [Updated] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-03 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15446: -- Release Note: WASB: Bug fix to support non-sequential page blob reads. Required for

[jira] [Created] (HADOOP-15446) WASB: PageBlobInputStream.skip breaks HBASE replication

2018-05-03 Thread Thomas Marquardt (JIRA)
Thomas Marquardt created HADOOP-15446: - Summary: WASB: PageBlobInputStream.skip breaks HBASE replication Key: HADOOP-15446 URL: https://issues.apache.org/jira/browse/HADOOP-15446 Project: Hadoop

[jira] [Updated] (HADOOP-15156) backport HADOOP-15086 rename fix to branch-2

2018-01-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15156: -- Attachment: (was: HADOOP-15156-001.patch) > backport HADOOP-15086 rename fix to

[jira] [Updated] (HADOOP-15156) backport HADOOP-15086 rename fix to branch-2

2018-01-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15156: -- Attachment: HADOOP-15156-001.patch Attaching branch-2 patch HADOOP-15156-001.patch.

[jira] [Updated] (HADOOP-15156) backport HADOOP-15086 rename fix to branch-2

2018-01-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15156: -- Target Version/s: 2.7.5, 2.9.0 (was: 2.9.0, 2.7.5) Status: Patch

[jira] [Updated] (HADOOP-15156) backport HADOOP-15086 rename fix to branch-2

2018-01-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15156: -- Attachment: HADOOP-15156-branch-2-001.patch Correcting the name of the patch:

[jira] [Updated] (HADOOP-15086) NativeAzureFileSystem file rename is not atomic

2017-12-20 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15086: -- Target Version/s: 2.7.5, 3.0.0-beta1, 2.9.0 > NativeAzureFileSystem file rename is

[jira] [Updated] (HADOOP-15086) NativeAzureFileSystem file rename is not atomic

2017-12-21 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15086: -- Affects Version/s: (was: 2.7.3) Target Version/s: 2.7.5, 3.0.0-beta1, 2.9.0

[jira] [Updated] (HADOOP-15086) NativeAzureFileSystem file rename is not atomic

2017-12-21 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15086: -- Attachment: HADOOP-15086-002.patch Attaching HADOOP-15086-002.patch. Steve, this

[jira] [Updated] (HADOOP-15086) NativeAzureFileSystem file rename is not atomic

2017-12-20 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15086: -- Attachment: HADOOP-15086-001.patch Attaching HADOOP-15086-001.patch. The scope of

[jira] [Created] (HADOOP-15156) backport HADOOP-15086 rename fix to branch-2

2018-01-03 Thread Thomas Marquardt (JIRA)
Thomas Marquardt created HADOOP-15156: - Summary: backport HADOOP-15086 rename fix to branch-2 Key: HADOOP-15156 URL: https://issues.apache.org/jira/browse/HADOOP-15156 Project: Hadoop Common

  1   2   3   >