[
https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16270034#comment-16270034
]
Aaron Fabbri commented on HADOOP-14475:
---------------------------------------
Testing v15 patch I'm seeing occasional NPEs in test shutdown hooks where stats
are incremented:
{noformat}
2017-11-28 18:35:32,936 [JUnit] INFO v2.MiniMRYarnCluster
(MiniMRYarnCluster.java:serviceStart(222)) - MiniMRYARN HistoryServer address:
fabbri-mbp.lan:57551
2017-11-28 18:35:32,936 [JUnit] INFO v2.MiniMRYarnCluster
(MiniMRYarnCluster.java:serviceStart(224)) - MiniMRYARN HistoryServer web
address: fabbri-MBP.lan:57550
2017-11-28 18:35:32,945 [Thread-1372] DEBUG s3a.S3ATestUtils
(S3ATestUtils.java:maybeEnableS3Guard(402)) - Enabling S3Guard,
authoritative=false,
implementation=org.apache.hadoop.fs.s3a.s3guard.LocalMetadataStore
2017-11-28 18:35:32,945 [Thread-1372] INFO s3a.S3ATestUtils
(S3ATestUtils.java:enableInconsistentS3Client(793)) - Enabling inconsistent S3
client
2017-11-28 18:35:32,952 [Thread-1372] INFO contract.AbstractFSContractTestBase
(AbstractFSContractTestBase.java:setup(184)) - Test filesystem =
s3a://fabbri-new implemented by S3AFileSystem{uri=s3a://fabbri-new,
workingDir=s3a://fabbri-new/user/fabbri, inputPolicy=normal, partSize=5242880,
enableMultiObjectsDelete=true, maxKeys=5000, readAhead=65536,
blockSize=33554432, multiPartThreshold=5242880,
serverSideEncryptionAlgorithm='NONE',
blockFactory=org.apache.hadoop.fs.s3a.S3ADataBlocks$ArrayBlockFactory@11923456,
metastore=null, authoritative=false, useListV1=false, magicCommitter=true,
boundedExecutor=BlockingThreadPoolExecutorService{SemaphoredDelegatingExecutor{permitCount=25,
available=25, waiting=0}, activeCount=0},
unboundedExecutor=java.util.concurrent.ThreadPoolExecutor@771d93da[Terminated,
pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0],
statistics {75761784 bytes read, 75796134 bytes written, 1197 read ops, 0 large
read ops, 2330 write ops}}
2017-11-28 18:35:32,953 [Thread-1372] DEBUG s3a.S3AFileSystem
(S3AFileSystem.java:innerMkdirs(1978)) - Making directory: s3a://fabbri-new/test
2017-11-28 18:35:32,953 [Thread-1372] ERROR contract.ContractTestUtils
(ContractTestUtils.java:cleanup(376)) - Error deleting in TEARDOWN - /test:
java.lang.NullPointerException
java.lang.NullPointerException
at
org.apache.hadoop.fs.s3a.S3AFileSystem.incrementStatistic(S3AFileSystem.java:1109)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.incrementStatistic(S3AFileSystem.java:1100)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.exists(S3AFileSystem.java:2879)
at
org.apache.hadoop.fs.contract.ContractTestUtils.rm(ContractTestUtils.java:397)
at
org.apache.hadoop.fs.contract.ContractTestUtils.cleanup(ContractTestUtils.java:374)
at
org.apache.hadoop.fs.contract.AbstractFSContractTestBase.deleteTestDirInTeardown(AbstractFSContractTestBase.java:213)
at
org.apache.hadoop.fs.contract.AbstractFSContractTestBase.teardown(AbstractFSContractTestBase.java:204)
at
org.apache.hadoop.fs.s3a.AbstractS3ATestBase.teardown(AbstractS3ATestBase.java:56)
at
org.apache.hadoop.fs.s3a.commit.AbstractCommitITest.teardown(AbstractCommitITest.java:185)
at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
{noformat}
Quick glance at code, looks like {{instrumentation}} is null. It gets set in
{{initialize()}} and closed / set to null in {{close()}}, so I wonder if this
is test code using the FS after close()? Would be easy enough to test.
> Metrics of S3A don't print out when enable it in Hadoop metrics property file
> ------------------------------------------------------------------------------
>
> Key: HADOOP-14475
> URL: https://issues.apache.org/jira/browse/HADOOP-14475
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 2.8.0
> Environment: uname -a
> Linux client01 4.4.0-74-generic #95-Ubuntu SMP Wed Apr 12 09:50:34 UTC 2017
> x86_64 x86_64 x86_64 GNU/Linux
> cat /etc/issue
> Ubuntu 16.04.2 LTS \n \l
> Reporter: Yonger
> Assignee: Yonger
> Attachments: HADOOP-14475-003.patch, HADOOP-14475.002.patch,
> HADOOP-14475.005.patch, HADOOP-14475.006.patch, HADOOP-14475.008.patch,
> HADOOP-14475.009.patch, HADOOP-14475.010.patch, HADOOP-14475.011.patch,
> HADOOP-14475.012.patch, HADOOP-14475.013.patch, HADOOP-14475.014.patch,
> HADOOP-14475.015.patch, HADOOP-14775.007.patch, failsafe-report-s3a-it.html,
> failsafe-report-s3a-scale.html, failsafe-report-scale.html,
> failsafe-report-scale.zip, s3a-metrics.patch1, stdout.zip
>
>
> *.sink.file.class=org.apache.hadoop.metrics2.sink.FileSink
> #*.sink.file.class=org.apache.hadoop.metrics2.sink.influxdb.InfluxdbSink
> #*.sink.influxdb.url=http:/xxxxxxxxxx
> #*.sink.influxdb.influxdb_port=8086
> #*.sink.influxdb.database=hadoop
> #*.sink.influxdb.influxdb_username=hadoop
> #*.sink.influxdb.influxdb_password=hadoop
> #*.sink.ingluxdb.cluster=c1
> *.period=10
> #namenode.sink.influxdb.class=org.apache.hadoop.metrics2.sink.influxdb.InfluxdbSink
> #S3AFileSystem.sink.influxdb.class=org.apache.hadoop.metrics2.sink.influxdb.InfluxdbSink
> S3AFileSystem.sink.file.filename=s3afilesystem-metrics.out
> I can't find the out put file even i run a MR job which should be used s3.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
