ctubbsii opened a new issue #1793:
URL: https://github.com/apache/accumulo/issues/1793
**Test name(s)**
- org.apache.accumulo.test.functional.MasterMetricsIT.compactionMetrics
**Describe the failure observed**
Test timed out after 240 seconds
```java
org.junit.runners.model.TestTimedOutException: test timed out after 240
seconds
at [email protected]/java.lang.Thread.sleep(Native Method)
at
app//org.apache.accumulo.test.functional.MasterMetricsIT.blockForRequiredTables(MasterMetricsIT.java:229)
at
app//org.apache.accumulo.test.functional.MasterMetricsIT.compactionMetrics(MasterMetricsIT.java:171)
at
[email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
```
<details>
<summary>STDOUT had a curious comment about tasks remaining in a threadpool
when stopped (click to expand)</summary>
```
2020-11-17T06:49:27,348 [conf.AccumuloClusterPropertyConfiguration] DEBUG:
No properties file found in accumulo.it.properties
2020-11-17T06:49:27,354 [conf.AccumuloClusterPropertyConfiguration] INFO :
Using MINI cluster type from system properties
2020-11-17T06:49:27,356 [conf.AccumuloMiniClusterConfiguration] DEBUG: SASL
is not enabled
2020-11-17T06:49:45,679 [miniclusterImpl.MiniAccumuloClusterImpl] INFO :
Starting MAC against instance miniInstance and zookeeper(s) localhost:41755.
2020-11-17T06:49:49,916 [zookeeper.ZooSession] DEBUG: Connecting to
localhost:41755 with timeout 30000 with auth
2020-11-17T06:49:49,942 [common.X509Util] INFO : Setting -D
jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS
renegotiation
2020-11-17T06:49:51,197 [rpc.SaslConnectionParams] DEBUG: Kerberos krb5
configuration not found, setting default realm to empty
2020-11-17T06:50:05,351 [util.SlowOps] INFO : Created table id: 1, name
'MasterMetricsIT_compactionMetrics0_0'
2020-11-17T06:50:06,055 [util.SlowOps] INFO : Starting compaction. Attempt 1
2020-11-17T06:50:09,114 [util.SlowOps] DEBUG: Compaction running for
MasterMetricsIT_compactionMetrics0_0
2020-11-17T06:50:09,114 [functional.MasterMetricsIT] INFO : Received metrics
LineUpdate{lastUpdate=17612465191, line='1605595803974 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:50:14,125 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=22614571878, line='1605595808974 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:50:24,126 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=32620141516, line='1605595818973 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:50:34,128 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=42626257486, line='1605595828974 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:50:44,129 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=52632010832, line='1605595838974 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:50:54,130 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=62637517121, line='1605595848975 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:51:04,131 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=72643292369, line='1605595858974 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:51:14,132 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=82648823492, line='1605595868975 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:51:24,133 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=92654217724, line='1605595878974 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:51:34,134 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=102659397669, line='1605595888975 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:51:44,135 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=112664955896, line='1605595898974 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:51:54,136 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=122670547662, line='1605595908974 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:52:04,137 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=132676153586, line='1605595918975 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:52:06,760 [clientImpl.ThriftTransportPool] WARN : Thread
"pool-3-thread-1" stuck on IO to asf923.gq1.ygridcore.net:40501 (0) for at
least 120050 ms
2020-11-17T06:52:14,138 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=142681699199, line='1605595928977 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:52:24,140 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=152687328299, line='1605595938974 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:52:34,141 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=162692910829, line='1605595948975 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:52:44,142 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=172698527676, line='1605595958975 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:52:54,143 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=182704184766, line='1605595968975 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:53:04,144 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=192709622162, line='1605595978974 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:53:14,145 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=202715340702, line='1605595988974 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:53:24,146 [functional.MasterMetricsIT] INFO : Received metrics
update LineUpdate{lastUpdate=212721040707, line='1605595998974 master.fate:
Context=master, ProcessName=Master, Hostname=asf923.gq1.ygridcore.net,
currentFateOps=0, totalFateOps=4, totalZkConnErrors=0, FateTxState_NEW=0,
FateTxState_IN_PROGRESS=0, FateTxState_FAILED_IN_PROGRESS=0,
FateTxState_FAILED=0, FateTxState_SUCCESSFUL=0, FateTxState_UNKNOWN=0'}
2020-11-17T06:53:27,377 [miniclusterImpl.MiniAccumuloClusterImpl] WARN :
Unexpectedly had 4 task(s) remaining in threadpool for execution when being
stopped
```
</details>
**Testing Environment:**
- Version of this project: 2.1.0-SNAPSHOT
- First commit known to fail (or current commit):
28ba8434334293d4bff9683464b293cd4540c245
- Jenkins:
```
Executing Maven: -B -f /home/jenkins/workspace/Accumulo/main/pom.xml -V -e
-ntp clean verify -Dstyle.color=always -Dfailsafe.rerunFailingTestsCount=5
-Dsurefire.forkCount=2C
Apache Maven 3.6.3 (cecedd343002696d0abb50b32b541b8a6ba2883f)
Maven home: /usr/local/asfpackages/maven/apache-maven-3.6.3
Java version: 11.0.6, vendor: Oracle Corporation, runtime:
/usr/local/asfpackages/java/jdk-11.0.6
Default locale: en_US, platform encoding: ISO-8859-1
OS name: "linux", version: "4.15.0-74-generic", arch: "amd64", family: "unix"
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
