[jira] [Commented] (HADOOP-18759) [ABFS][Backoff-Optimization] Have a Static retry policy for connection timeout failures

[ https://issues.apache.org/jira/browse/HADOOP-18759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825140#comment-17825140 ] Anoop Sam John commented on HADOOP-18759: - PR link :

[jira] [Commented] (HADOOP-17643) WASB : Make metadata checks case insensitive

[ https://issues.apache.org/jira/browse/HADOOP-17643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17455104#comment-17455104 ] Anoop Sam John commented on HADOOP-17643: - I put up PRs so that the merge is easier. Good to

[jira] [Commented] (HADOOP-17848) Hadoop NativeAzureFileSystem append removes ownership set on the file

[ https://issues.apache.org/jira/browse/HADOOP-17848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402737#comment-17402737 ] Anoop Sam John commented on HADOOP-17848: - The call fs.setPermission(filePath, new

[jira] [Commented] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17385411#comment-17385411 ] Anoop Sam John commented on HADOOP-17770: - Still many existing customers on WASB based storage.

[jira] [Comment Edited] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375234#comment-17375234 ] Anoop Sam John edited comment on HADOOP-17770 at 7/6/21, 5:38 AM: -- Ran

[jira] [Commented] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375234#comment-17375234 ] Anoop Sam John commented on HADOOP-17770: - Ran below perf test with an HBase usage Have a 3 RS

[jira] [Updated] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17770: Attachment: AvgLatency_50% cache hit.png > WASB : Support disabling buffered reads in

[jira] [Updated] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17770: Attachment: Throughput_50% cache hit.png > WASB : Support disabling buffered reads in

[jira] [Updated] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17770: Attachment: AvgLatency_0 cache hit.png > WASB : Support disabling buffered reads in

[jira] [Updated] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17770: Attachment: Throughput_0 cache hit.png > WASB : Support disabling buffered reads in

[jira] [Updated] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17770: Fix Version/s: 3.4.0 > WASB : Support disabling buffered reads in positional reads >

[jira] [Updated] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17770: Description: This is just like HADOOP-17038 Right now it will do a seek to the position

[jira] [Created] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

Anoop Sam John created HADOOP-17770: --- Summary: WASB : Support disabling buffered reads in positional reads Key: HADOOP-17770 URL: https://issues.apache.org/jira/browse/HADOOP-17770 Project: Hadoop

[jira] [Commented] (HADOOP-17691) Abfs directory delete times out on large directory tree: OperationTimedOut

[ https://issues.apache.org/jira/browse/HADOOP-17691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17345735#comment-17345735 ] Anoop Sam John commented on HADOOP-17691: - Ping [~sneha_varma] > Abfs directory delete times

[jira] [Comment Edited] (HADOOP-17687) ABFS: delete call sets Socket timeout lesser than query timeout leading to failures

[ https://issues.apache.org/jira/browse/HADOOP-17687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343031#comment-17343031 ] Anoop Sam John edited comment on HADOOP-17687 at 5/12/21, 7:43 AM: ---

[jira] [Commented] (HADOOP-17691) Abfs directory delete times out on large directory tree: OperationTimedOut

[ https://issues.apache.org/jira/browse/HADOOP-17691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343086#comment-17343086 ] Anoop Sam John commented on HADOOP-17691: - >From driver the operation time out been hard coded

[jira] [Commented] (HADOOP-17691) Abfs directory delete times out on large directory tree: OperationTimedOut

[ https://issues.apache.org/jira/browse/HADOOP-17691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343032#comment-17343032 ] Anoop Sam John commented on HADOOP-17691: - cc [~snvijaya] > Abfs directory delete times out on

[jira] [Commented] (HADOOP-17687) ABFS: delete call sets Socket timeout lesser than query timeout leading to failures

[ https://issues.apache.org/jira/browse/HADOOP-17687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343031#comment-17343031 ] Anoop Sam John commented on HADOOP-17687: - >From drive the operation time out been hard coded

[jira] [Assigned] (HADOOP-17640) ABFS: transient failure of TestAzureBlobFileSystemFileStatus.testLastModifiedTime

[ https://issues.apache.org/jira/browse/HADOOP-17640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John reassigned HADOOP-17640: --- Assignee: Anoop Sam John > ABFS: transient failure of >

[jira] [Assigned] (HADOOP-17637) ABFS: rename ListResultSchemaTest to TestListResultSchema so maven tests run it

[ https://issues.apache.org/jira/browse/HADOOP-17637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John reassigned HADOOP-17637: --- Assignee: Anoop Sam John > ABFS: rename ListResultSchemaTest to

[jira] [Commented] (HADOOP-17645) Fix test failures in org.apache.hadoop.fs.azure.ITestOutputStreamSemantics

[ https://issues.apache.org/jira/browse/HADOOP-17645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17333135#comment-17333135 ] Anoop Sam John commented on HADOOP-17645: - I was checking more on the WASB tests

[jira] [Commented] (HADOOP-17645) Fix test failures in org.apache.hadoop.fs.azure.ITestOutputStreamSemantics

[ https://issues.apache.org/jira/browse/HADOOP-17645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324977#comment-17324977 ] Anoop Sam John commented on HADOOP-17645: - Thanks. Moved the discuss on

[jira] [Commented] (HADOOP-17641) ITestWasbUriAndConfiguration.testCanonicalServiceName() failing now mockaccount exists

[ https://issues.apache.org/jira/browse/HADOOP-17641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324976#comment-17324976 ] Anoop Sam John commented on HADOOP-17641: - Should we remove this part in test? {code}

[jira] [Commented] (HADOOP-17645) Fix test failures in org.apache.hadoop.fs.azure.ITestOutputStreamSemantics

[ https://issues.apache.org/jira/browse/HADOOP-17645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324683#comment-17324683 ] Anoop Sam John commented on HADOOP-17645: - Noticed one more consistent fail in

[jira] [Commented] (HADOOP-17645) Fix test failures in org.apache.hadoop.fs.azure.ITestOutputStreamSemantics

[ https://issues.apache.org/jira/browse/HADOOP-17645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324481#comment-17324481 ] Anoop Sam John commented on HADOOP-17645: - Ping [~ste...@apache.org]. Simple test fix. Noticed

[jira] [Created] (HADOOP-17645) Fix test failures in org.apache.hadoop.fs.azure.ITestOutputStreamSemantics

Anoop Sam John created HADOOP-17645: --- Summary: Fix test failures in org.apache.hadoop.fs.azure.ITestOutputStreamSemantics Key: HADOOP-17645 URL: https://issues.apache.org/jira/browse/HADOOP-17645

[jira] [Updated] (HADOOP-17643) WASB : Make metadata checks case insensitive

[ https://issues.apache.org/jira/browse/HADOOP-17643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17643: Affects Version/s: 2.7.0 > WASB : Make metadata checks case insensitive >

[jira] [Created] (HADOOP-17643) WASB : Make metadata checks case insensitive

Anoop Sam John created HADOOP-17643: --- Summary: WASB : Make metadata checks case insensitive Key: HADOOP-17643 URL: https://issues.apache.org/jira/browse/HADOOP-17643 Project: Hadoop Common

[jira] [Commented] (HADOOP-14748) Wasb input streams to implement CanUnbuffer

[ https://issues.apache.org/jira/browse/HADOOP-14748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296779#comment-17296779 ] Anoop Sam John commented on HADOOP-14748: - [~ste...@apache.org] This was closed because of

[jira] [Commented] (HADOOP-17038) Support disabling buffered reads in ABFS positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224696#comment-17224696 ] Anoop Sam John commented on HADOOP-17038: - [~ste...@apache.org] Can u pls help review the PR.

[jira] [Updated] (HADOOP-17308) WASB : PageBlobOutputStream succeeding flush even when underlying flush to storage failed

[ https://issues.apache.org/jira/browse/HADOOP-17308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17308: Affects Version/s: 2.7.0 > WASB : PageBlobOutputStream succeeding flush even when

[jira] [Updated] (HADOOP-17308) WASB : PageBlobOutputStream succeeding flush even when underlying flush to storage failed

[ https://issues.apache.org/jira/browse/HADOOP-17308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17308: Labels: HBASE (was: ) > WASB : PageBlobOutputStream succeeding flush even when

[jira] [Created] (HADOOP-17308) WASB : PageBlobOutputStream succeeding flush even when underlying flush to storage failed

Anoop Sam John created HADOOP-17308: --- Summary: WASB : PageBlobOutputStream succeeding flush even when underlying flush to storage failed Key: HADOOP-17308 URL:

[jira] [Commented] (HADOOP-17038) Support disabling buffered reads in ABFS positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17213859#comment-17213859 ] Anoop Sam John commented on HADOOP-17038: - As of now disabling buffered pread alone is possible

[jira] [Commented] (HADOOP-17038) Support disabling buffered reads in ABFS positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212916#comment-17212916 ] Anoop Sam John commented on HADOOP-17038: - New PR based on the suggestion from

[jira] [Updated] (HADOOP-17038) Support disabling buffered reads in ABFS positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17038: Description: Right now it will do a seek to the position , read and then seek back to

[jira] [Updated] (HADOOP-17038) Support disabling buffered reads in ABFS positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17038: Summary: Support disabling buffered reads in ABFS positional reads (was: Support

[jira] [Commented] (HADOOP-17038) Support positional read in AbfsInputStream

[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177430#comment-17177430 ] Anoop Sam John commented on HADOOP-17038: - bq.The option should be going into hbase-site, not

[jira] [Commented] (HADOOP-17038) Support positional read in AbfsInputStream

[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177422#comment-17177422 ] Anoop Sam John commented on HADOOP-17038: - Thanks [~ste...@apache.org] for those Qs. I agree

[jira] [Updated] (HADOOP-17038) Support positional read in AbfsInputStream

[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17038: Attachment: screenshot-1.png > Support positional read in AbfsInputStream >

[jira] [Commented] (HADOOP-17038) Support positional read in AbfsInputStream

[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174117#comment-17174117 ] Anoop Sam John commented on HADOOP-17038: - !screenshot-1.png! > Support positional read in

[jira] [Updated] (HADOOP-17038) Support positional read in AbfsInputStream

[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17038: Attachment: HBase Perf Test Report.xlsx > Support positional read in AbfsInputStream >

[jira] [Commented] (HADOOP-17038) Support positional read in AbfsInputStream

[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174116#comment-17174116 ] Anoop Sam John commented on HADOOP-17038: - Attached below is pert test done on an HBase

[jira] [Commented] (HADOOP-17038) Support positional read in AbfsInputStream

[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174098#comment-17174098 ] Anoop Sam John commented on HADOOP-17038: - As mentioned in the desc, its main adv is with HBase

[jira] [Updated] (HADOOP-17038) Support positional read in AbfsInputStream

[ https://issues.apache.org/jira/browse/HADOOP-17038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-17038: Labels: HBase abfsactive (was: abfsactive) > Support positional read in AbfsInputStream

[jira] [Commented] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141305#comment-17141305 ] Anoop Sam John commented on HADOOP-16998: - Thanks all for the reviews.. Fixed the comments in

[jira] [Commented] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134913#comment-17134913 ] Anoop Sam John commented on HADOOP-16998: - PR raised https://github.com/apache/hadoop/pull/2073

[jira] [Created] (HADOOP-17038) Support positional read in AbfsInputStream

Anoop Sam John created HADOOP-17038: --- Summary: Support positional read in AbfsInputStream Key: HADOOP-17038 URL: https://issues.apache.org/jira/browse/HADOOP-17038 Project: Hadoop Common

[jira] [Comment Edited] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087871#comment-17087871 ] Anoop Sam John edited comment on HADOOP-16998 at 4/20/20, 5:30 PM: ---

[jira] [Commented] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087873#comment-17087873 ] Anoop Sam John commented on HADOOP-16998: - bq.Patches up on github as PRs for review Bit busy

[jira] [Commented] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087871#comment-17087871 ] Anoop Sam John commented on HADOOP-16998: - Thanks Steve. The version on which this was observed

[jira] [Commented] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087375#comment-17087375 ] Anoop Sam John commented on HADOOP-16998: - Thanks for having a look. Sure I will work on it..

[jira] [Commented] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087354#comment-17087354 ] Anoop Sam John commented on HADOOP-16998: - Just attached the patch. I need to work with the PR.

[jira] [Updated] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Sam John updated HADOOP-16998: Attachment: HADOOP-16998.patch > WASB : NativeAzureFsOutputStream#close() throwing >

[jira] [Commented] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

[ https://issues.apache.org/jira/browse/HADOOP-16998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087352#comment-17087352 ] Anoop Sam John commented on HADOOP-16998: - Yes same way. Seems in some versions of JDK,

[jira] [Created] (HADOOP-16998) WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted

Anoop Sam John created HADOOP-16998: --- Summary: WASB : NativeAzureFsOutputStream#close() throwing java.lang.IllegalArgumentException instead of IOE which causes HBase RS to get aborted Key: HADOOP-16998 URL:

[jira] [Commented] (HADOOP-15643) Review/implement ABFS support for the extra fs ops which some apps (HBase) expects

[ https://issues.apache.org/jira/browse/HADOOP-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029085#comment-17029085 ] Anoop Sam John commented on HADOOP-15643: - HBase now having ByteBufferReadable usage also. >