[
https://issues.apache.org/jira/browse/ACCUMULO-2862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14019418#comment-14019418
]
Josh Elser commented on ACCUMULO-2862:
--------------------------------------
It appears this may be caused by a split, trying to happen when a MajC is
running.
{noformat}
2014-06-05 19:29:17,722 [tablet.Compactor] DEBUG: Compaction 2<;60079 1,425,087
read | 1,425,087 written | 191,286 entries/sec | 7.450 secs
2014-06-05 19:29:17,724 [tablet.Tablet] DEBUG: Logs for memory compacted:
2<;60079
192.168.2.21:52059/hdfs://localhost:8020/accumulo17/wal/192.168.2.21+52059/f3018455-29c8-49ab-bb6d-b8c4720fdf18
2014-06-05 19:29:17,724 [tablet.Tablet] DEBUG: Logs for memory compacted:
2<;60079
192.168.2.21:52059/hdfs://localhost:8020/accumulo17/wal/192.168.2.21+52059/d8855654-40c5-4ed7-bafb-c0a8104be55d
2014-06-05 19:29:17,724 [tablet.Tablet] DEBUG: Logs for current memory:
2<;60079
192.168.2.21:52059/hdfs://localhost:8020/accumulo17/wal/192.168.2.21+52059/f3018455-29c8-49ab-bb6d-b8c4720fdf18
2014-06-05 19:29:17,726 [log.TabletServerLogger] DEBUG: wrote MinC finish
3244: writeTime:0ms
2014-06-05 19:29:17,727 [tablet.DatafileManager] TABLET_HIST: 2<;60079 MinC
[memory] -> hdfs://localhost:8020/accumulo17/tables/2/default_tablet/F00002dp.rf
2014-06-05 19:29:17,727 [tablet.DatafileManager] DEBUG: MinC finish lock 0.00
secs 2<;60079
2014-06-05 19:29:17,727 [tserver.NativeMap] DEBUG: Deallocating native map
0x00007fe53aa99610
2014-06-05 19:29:17,766 [tserver.TabletServerResourceManager] DEBUG: Commits
held for 3.51 secs
2014-06-05 19:29:17,768 [tserver.TabletServer] DEBUG: UpSess 192.168.2.21:53501
39 in 1.242s, at=[0 0 0.00 1] ft=1.241s(pt=1.241s lt=0.000s ct=0.000s)
2014-06-05 19:29:17,878 [util.FileUtil] DEBUG: Found midPoint from indexes in
0.11 secs.
2014-06-05 19:29:17,929 [tablet.Tablet] DEBUG: initiateClose(saveState=true
queueMinC=false disableWrites=false) 2<;60079
2014-06-05 19:29:17,966 [tablet.Tablet] DEBUG: Major compaction canceled,
extent = 2<;60079
2014-06-05 19:29:17,967 [util.NamingThreadFactory] ERROR: Thread "major
compactor 4" died
org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
java.lang.RuntimeException:
org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
at
org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1970)
at
org.apache.accumulo.tserver.tablet.CompactionRunner.run(CompactionRunner.java:42)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at
org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:745)
Caused by:
org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
at
org.apache.accumulo.tserver.tablet.Compactor.compactLocalityGroup(Compactor.java:370)
at org.apache.accumulo.tserver.tablet.Compactor.call(Compactor.java:206)
at
org.apache.accumulo.tserver.tablet.Tablet._majorCompact(Tablet.java:1853)
at
org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1962)
... 7 more
2014-06-05 19:29:17,967 [tserver.NativeMap] DEBUG: Allocated native map
0x00007fe53ac406d0
2014-06-05 19:29:18,016 [tablet.MinorCompactor] DEBUG: Begin minor compaction
hdfs://localhost:8020/accumulo17/tables/2/default_tablet/F00002ds.rf_tmp
2<;60079
{noformat}
I can't say I know why it's happening yet, though.
> Major Compaction issues
> -----------------------
>
> Key: ACCUMULO-2862
> URL: https://issues.apache.org/jira/browse/ACCUMULO-2862
> Project: Accumulo
> Issue Type: Bug
> Components: tserver
> Reporter: Josh Elser
> Assignee: Eric Newton
> Fix For: 1.7.0
>
> Attachments: eric-proposed-changes.diff
>
>
> Since the last round of tserver/tablet refactoring, I've been getting some
> spurious errors while running two tservers on a single node with a single
> continuous ingest client.
> {noformat}
> java.lang.RuntimeException: java.lang.IllegalStateException: Major compacting
> files not empty [...]
> at
> org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1998)
> at
> org.apache.accumulo.tserver.tablet.CompactionRunner.run(CompactionRunner.java:42)
> at
> org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at
> org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
> at
> org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalStateException: Major compacting files not empty
> [...]
> at
> org.apache.accumulo.tserver.tablet.DatafileManager.reserveMajorCompactingFiles(DatafileManager.java:484)
> at
> org.apache.accumulo.tserver.tablet.Tablet._majorCompact(Tablet.java:1797)
> at
> org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1986)
> ... 7 more
> 2014-06-05 16:46:
> {noformat}
> As well as some CompactionCanceledExceptions.
> {noformat}
> Thread "major compactor 2" died
> org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
> java.lang.RuntimeException:
> org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
> at
> org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1970)
> at
> org.apache.accumulo.tserver.tablet.CompactionRunner.run(CompactionRunner.java:42)
> at
> org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at
> org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
> at
> org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
> at java.lang.Thread.run(Thread.java:745)
> Caused by:
> org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
> at
> org.apache.accumulo.tserver.tablet.Compactor.compactLocalityGroup(Compactor.java:370)
> at
> org.apache.accumulo.tserver.tablet.Compactor.call(Compactor.java:206)
> at
> org.apache.accumulo.tserver.tablet.Tablet._majorCompact(Tablet.java:1853)
> at
> org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1962)
> ... 7 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
