[
https://issues.apache.org/jira/browse/IGNITE-22515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nikita Amelchev updated IGNITE-22515:
-------------------------------------
Fix Version/s: 2.17
> Control utility: refactor errors output
> ---------------------------------------
>
> Key: IGNITE-22515
> URL: https://issues.apache.org/jira/browse/IGNITE-22515
> Project: Ignite
> Issue Type: Improvement
> Reporter: Nikita Amelchev
> Assignee: Nikita Amelchev
> Priority: Major
> Fix For: 2.17
>
>
> When a command fails, its output is unreadable. These are long stack traces
> where it is difficult to find the original source of the problem. I suggest
> displaying only exception messages thrown by the management task. The output
> should provide original task error and should be filtered of
> `ComputeUserUndeclaredException` etc wrappers.
> Example of current output:
> {noformat}
> Command [CDC] started
> Arguments: --cdc delete_lost_segment_links --node-id
> 65d372de-0b02-4611-adf8-eba90af00000 --yes
> --------------------------------------------------------------------------------
> Failed to perform operation.
> Failed to reduce job results due to undeclared user exception
> [task=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask@4ec4f53b,
> err=class org.apache.ignite.IgniteException: Failed to delete lost segment
> CDC links on a node [nodeId=65d372de-0b02-4611-adf8-eba90af00000]],
> trace=class org.apache.ignite.IgniteCheckedException: Failed to reduce job
> results due to undeclared user exception
> [task=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask@4ec4f53b,
> err=class org.apache.ignite.IgniteException: Failed to delete lost segment
> CDC links on a node [nodeId=65d372de-0b02-4611-adf8-eba90af00000]]
> at
> org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7985)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:263)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:175)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:144)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler$2.apply(GridTaskCommandHandler.java:256)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler$2.apply(GridTaskCommandHandler.java:250)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:474)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.listen(GridFutureAdapter.java:357)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler.handleAsyncUnsafe(GridTaskCommandHandler.java:250)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler.handleAsync(GridTaskCommandHandler.java:161)
> at
> org.apache.ignite.internal.processors.rest.GridRestProcessor.handleRequest0(GridRestProcessor.java:333)
> at
> org.apache.ignite.internal.processors.rest.GridRestProcessor.handleRequest(GridRestProcessor.java:309)
> at
> org.apache.ignite.internal.processors.rest.GridRestProcessor$2.body(GridRestProcessor.java:192)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: class org.apache.ignite.compute.ComputeUserUndeclaredException:
> Failed to reduce job results due to undeclared user exception
> [task=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask@4ec4f53b,
> err=class org.apache.ignite.IgniteException: Failed to delete lost segment
> CDC links on a node [nodeId=65d372de-0b02-4611-adf8-eba90af00000]]
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.reduce(GridTaskWorker.java:1193)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.onResponse(GridTaskWorker.java:981)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.processDelayedResponses(GridTaskWorker.java:716)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.body(GridTaskWorker.java:539)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
> at
> org.apache.ignite.internal.processors.task.GridTaskProcessor.startTask(GridTaskProcessor.java:755)
> at
> org.apache.ignite.internal.processors.task.GridTaskProcessor.execute(GridTaskProcessor.java:508)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler.handleAsyncUnsafe(GridTaskCommandHandler.java:220)
> ... 8 more
> Caused by: class org.apache.ignite.IgniteException: Failed to delete lost
> segment CDC links on a node [nodeId=65d372de-0b02-4611-adf8-eba90af00000]
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask.reduce0(CdcDeleteLostSegmentsTask.java:65)
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask.reduce0(CdcDeleteLostSegmentsTask.java:50)
> at
> org.apache.ignite.internal.visor.VisorMultiNodeTask.reduce(VisorMultiNodeTask.java:140)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker$5.call(GridTaskWorker.java:1154)
> at
> org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7474)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.reduce(GridTaskWorker.java:1152)
> ... 15 more
> Caused by: class org.apache.ignite.compute.ComputeUserUndeclaredException:
> Failed to execute job due to unexpected runtime exception
> [jobId=b9f85fb1091-65d372de-0b02-4611-adf8-eba90af00000,
> ses=GridJobSessionImpl [ses=GridTaskSessionImpl
> [taskName=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask,
> dep=GridDeployment [ts=1718455997111, depMode=SHARED,
> clsLdr=jdk.internal.loader.ClassLoaders$AppClassLoader@16f65612,
> clsLdrId=48f85fb1091-65d372de-0b02-4611-adf8-eba90af00000, userVer=0,
> loc=true,
> sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap,
> pendingUndeploy=false, undeployed=false, usage=2],
> taskClsName=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask,
> sesId=a9f85fb1091-65d372de-0b02-4611-adf8-eba90af00000,
> startTime=1718455997381, endTime=9223372036854775807,
> taskNodeId=65d372de-0b02-4611-adf8-eba90af00000,
> clsLdr=jdk.internal.loader.ClassLoaders$AppClassLoader@16f65612,
> closed=false, cpSpi=null, failSpi=null, loadSpi=null, usage=1, fullSup=false,
> internal=true, topPred=null, mapFut=IgniteFuture [orig=GridFutureAdapter
> [ignoreInterrupts=false, state=INIT, res=null, hash=192257268]],
> execName=null, secCtx=null],
> jobId=b9f85fb1091-65d372de-0b02-4611-adf8-eba90af00000], err=Failed to delete
> lost segment CDC links. Unable to acquire lock to lock CDC folder. Make sure
> a CDC app is shut down
> [dir=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0,
> reason=Failed to acquire file lock [holder=[consumerId=cdc.lock,
> [email protected]], time=0 sec,
> path=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0/lock]]]
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.handleThrowable(GridJobWorker.java:753)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:683)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.body(GridJobWorker.java:547)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
> at
> org.apache.ignite.internal.processors.job.GridJobProcessor.processJobExecuteRequest(GridJobProcessor.java:1367)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.sendRequest(GridTaskWorker.java:1440)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.processMappedJobs(GridTaskWorker.java:669)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.body(GridTaskWorker.java:533)
> ... 12 more
> Caused by: java.lang.RuntimeException: Failed to delete lost segment CDC
> links. Unable to acquire lock to lock CDC folder. Make sure a CDC app is shut
> down
> [dir=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0,
> reason=Failed to acquire file lock [holder=[consumerId=cdc.lock,
> [email protected]], time=0 sec,
> path=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0/lock]]
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask$CdcDeleteLostSegmentsJob.run(CdcDeleteLostSegmentsTask.java:161)
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask$CdcDeleteLostSegmentsJob.run(CdcDeleteLostSegmentsTask.java:73)
> at org.apache.ignite.internal.visor.VisorJob.execute(VisorJob.java:73)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker$1.call(GridJobWorker.java:628)
> at
> org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7474)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:622)
> ... 18 more
> Failed to reduce job results due to undeclared user exception
> [task=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask@4ec4f53b,
> err=class org.apache.ignite.IgniteException: Failed to delete lost segment
> CDC links on a node [nodeId=65d372de-0b02-4611-adf8-eba90af00000]],
> trace=class org.apache.ignite.IgniteCheckedException: Failed to reduce job
> results due to undeclared user exception
> [task=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask@4ec4f53b,
> err=class org.apache.ignite.IgniteException: Failed to delete lost segment
> CDC links on a node [nodeId=65d372de-0b02-4611-adf8-eba90af00000]]
> at
> org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7985)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:263)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:175)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:144)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler$2.apply(GridTaskCommandHandler.java:256)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler$2.apply(GridTaskCommandHandler.java:250)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:474)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.listen(GridFutureAdapter.java:357)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler.handleAsyncUnsafe(GridTaskCommandHandler.java:250)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler.handleAsync(GridTaskCommandHandler.java:161)
> at
> org.apache.ignite.internal.processors.rest.GridRestProcessor.handleRequest0(GridRestProcessor.java:333)
> at
> org.apache.ignite.internal.processors.rest.GridRestProcessor.handleRequest(GridRestProcessor.java:309)
> at
> org.apache.ignite.internal.processors.rest.GridRestProcessor$2.body(GridRestProcessor.java:192)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: class org.apache.ignite.compute.ComputeUserUndeclaredException:
> Failed to reduce job results due to undeclared user exception
> [task=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask@4ec4f53b,
> err=class org.apache.ignite.IgniteException: Failed to delete lost segment
> CDC links on a node [nodeId=65d372de-0b02-4611-adf8-eba90af00000]]
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.reduce(GridTaskWorker.java:1193)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.onResponse(GridTaskWorker.java:981)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.processDelayedResponses(GridTaskWorker.java:716)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.body(GridTaskWorker.java:539)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
> at
> org.apache.ignite.internal.processors.task.GridTaskProcessor.startTask(GridTaskProcessor.java:755)
> at
> org.apache.ignite.internal.processors.task.GridTaskProcessor.execute(GridTaskProcessor.java:508)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler.handleAsyncUnsafe(GridTaskCommandHandler.java:220)
> ... 8 more
> Caused by: class org.apache.ignite.IgniteException: Failed to delete lost
> segment CDC links on a node [nodeId=65d372de-0b02-4611-adf8-eba90af00000]
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask.reduce0(CdcDeleteLostSegmentsTask.java:65)
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask.reduce0(CdcDeleteLostSegmentsTask.java:50)
> at
> org.apache.ignite.internal.visor.VisorMultiNodeTask.reduce(VisorMultiNodeTask.java:140)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker$5.call(GridTaskWorker.java:1154)
> at
> org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7474)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.reduce(GridTaskWorker.java:1152)
> ... 15 more
> Caused by: class org.apache.ignite.compute.ComputeUserUndeclaredException:
> Failed to execute job due to unexpected runtime exception
> [jobId=b9f85fb1091-65d372de-0b02-4611-adf8-eba90af00000,
> ses=GridJobSessionImpl [ses=GridTaskSessionImpl
> [taskName=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask,
> dep=GridDeployment [ts=1718455997111, depMode=SHARED,
> clsLdr=jdk.internal.loader.ClassLoaders$AppClassLoader@16f65612,
> clsLdrId=48f85fb1091-65d372de-0b02-4611-adf8-eba90af00000, userVer=0,
> loc=true,
> sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap,
> pendingUndeploy=false, undeployed=false, usage=2],
> taskClsName=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask,
> sesId=a9f85fb1091-65d372de-0b02-4611-adf8-eba90af00000,
> startTime=1718455997381, endTime=9223372036854775807,
> taskNodeId=65d372de-0b02-4611-adf8-eba90af00000,
> clsLdr=jdk.internal.loader.ClassLoaders$AppClassLoader@16f65612,
> closed=false, cpSpi=null, failSpi=null, loadSpi=null, usage=1, fullSup=false,
> internal=true, topPred=null, mapFut=IgniteFuture [orig=GridFutureAdapter
> [ignoreInterrupts=false, state=INIT, res=null, hash=192257268]],
> execName=null, secCtx=null],
> jobId=b9f85fb1091-65d372de-0b02-4611-adf8-eba90af00000], err=Failed to delete
> lost segment CDC links. Unable to acquire lock to lock CDC folder. Make sure
> a CDC app is shut down
> [dir=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0,
> reason=Failed to acquire file lock [holder=[consumerId=cdc.lock,
> [email protected]], time=0 sec,
> path=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0/lock]]]
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.handleThrowable(GridJobWorker.java:753)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:683)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.body(GridJobWorker.java:547)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
> at
> org.apache.ignite.internal.processors.job.GridJobProcessor.processJobExecuteRequest(GridJobProcessor.java:1367)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.sendRequest(GridTaskWorker.java:1440)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.processMappedJobs(GridTaskWorker.java:669)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.body(GridTaskWorker.java:533)
> ... 12 more
> Caused by: java.lang.RuntimeException: Failed to delete lost segment CDC
> links. Unable to acquire lock to lock CDC folder. Make sure a CDC app is shut
> down
> [dir=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0,
> reason=Failed to acquire file lock [holder=[consumerId=cdc.lock,
> [email protected]], time=0 sec,
> path=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0/lock]]
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask$CdcDeleteLostSegmentsJob.run(CdcDeleteLostSegmentsTask.java:161)
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask$CdcDeleteLostSegmentsJob.run(CdcDeleteLostSegmentsTask.java:73)
> at org.apache.ignite.internal.visor.VisorJob.execute(VisorJob.java:73)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker$1.call(GridJobWorker.java:628)
> at
> org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7474)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:622)
> ... 18 more
> Command [CDC] finished with code: 4
> Error stack trace:
> class org.apache.ignite.internal.client.GridClientException: Failed to handle
> request: [req=EXE,
> taskName=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask,
> params=[VisorTaskArgument [debug=false]], err=Failed to reduce job results
> due to undeclared user exception
> [task=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask@4ec4f53b,
> err=class org.apache.ignite.IgniteException: Failed to delete lost segment
> CDC links on a node [nodeId=65d372de-0b02-4611-adf8-eba90af00000]],
> trace=class org.apache.ignite.IgniteCheckedException: Failed to reduce job
> results due to undeclared user exception
> [task=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask@4ec4f53b,
> err=class org.apache.ignite.IgniteException: Failed to delete lost segment
> CDC links on a node [nodeId=65d372de-0b02-4611-adf8-eba90af00000]]
> at
> org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7985)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:263)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:175)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:144)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler$2.apply(GridTaskCommandHandler.java:256)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler$2.apply(GridTaskCommandHandler.java:250)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:474)
> at
> org.apache.ignite.internal.util.future.GridFutureAdapter.listen(GridFutureAdapter.java:357)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler.handleAsyncUnsafe(GridTaskCommandHandler.java:250)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler.handleAsync(GridTaskCommandHandler.java:161)
> at
> org.apache.ignite.internal.processors.rest.GridRestProcessor.handleRequest0(GridRestProcessor.java:333)
> at
> org.apache.ignite.internal.processors.rest.GridRestProcessor.handleRequest(GridRestProcessor.java:309)
> at
> org.apache.ignite.internal.processors.rest.GridRestProcessor$2.body(GridRestProcessor.java:192)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: class org.apache.ignite.compute.ComputeUserUndeclaredException:
> Failed to reduce job results due to undeclared user exception
> [task=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask@4ec4f53b,
> err=class org.apache.ignite.IgniteException: Failed to delete lost segment
> CDC links on a node [nodeId=65d372de-0b02-4611-adf8-eba90af00000]]
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.reduce(GridTaskWorker.java:1193)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.onResponse(GridTaskWorker.java:981)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.processDelayedResponses(GridTaskWorker.java:716)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.body(GridTaskWorker.java:539)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
> at
> org.apache.ignite.internal.processors.task.GridTaskProcessor.startTask(GridTaskProcessor.java:755)
> at
> org.apache.ignite.internal.processors.task.GridTaskProcessor.execute(GridTaskProcessor.java:508)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler.handleAsyncUnsafe(GridTaskCommandHandler.java:220)
> ... 8 more
> Caused by: class org.apache.ignite.IgniteException: Failed to delete lost
> segment CDC links on a node [nodeId=65d372de-0b02-4611-adf8-eba90af00000]
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask.reduce0(CdcDeleteLostSegmentsTask.java:65)
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask.reduce0(CdcDeleteLostSegmentsTask.java:50)
> at
> org.apache.ignite.internal.visor.VisorMultiNodeTask.reduce(VisorMultiNodeTask.java:140)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker$5.call(GridTaskWorker.java:1154)
> at
> org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7474)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.reduce(GridTaskWorker.java:1152)
> ... 15 more
> Caused by: class org.apache.ignite.compute.ComputeUserUndeclaredException:
> Failed to execute job due to unexpected runtime exception
> [jobId=b9f85fb1091-65d372de-0b02-4611-adf8-eba90af00000,
> ses=GridJobSessionImpl [ses=GridTaskSessionImpl
> [taskName=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask,
> dep=GridDeployment [ts=1718455997111, depMode=SHARED,
> clsLdr=jdk.internal.loader.ClassLoaders$AppClassLoader@16f65612,
> clsLdrId=48f85fb1091-65d372de-0b02-4611-adf8-eba90af00000, userVer=0,
> loc=true,
> sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap,
> pendingUndeploy=false, undeployed=false, usage=2],
> taskClsName=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask,
> sesId=a9f85fb1091-65d372de-0b02-4611-adf8-eba90af00000,
> startTime=1718455997381, endTime=9223372036854775807,
> taskNodeId=65d372de-0b02-4611-adf8-eba90af00000,
> clsLdr=jdk.internal.loader.ClassLoaders$AppClassLoader@16f65612,
> closed=false, cpSpi=null, failSpi=null, loadSpi=null, usage=1, fullSup=false,
> internal=true, topPred=null, mapFut=IgniteFuture [orig=GridFutureAdapter
> [ignoreInterrupts=false, state=INIT, res=null, hash=192257268]],
> execName=null, secCtx=null],
> jobId=b9f85fb1091-65d372de-0b02-4611-adf8-eba90af00000], err=Failed to delete
> lost segment CDC links. Unable to acquire lock to lock CDC folder. Make sure
> a CDC app is shut down
> [dir=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0,
> reason=Failed to acquire file lock [holder=[consumerId=cdc.lock,
> [email protected]], time=0 sec,
> path=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0/lock]]]
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.handleThrowable(GridJobWorker.java:753)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:683)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.body(GridJobWorker.java:547)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
> at
> org.apache.ignite.internal.processors.job.GridJobProcessor.processJobExecuteRequest(GridJobProcessor.java:1367)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.sendRequest(GridTaskWorker.java:1440)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.processMappedJobs(GridTaskWorker.java:669)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.body(GridTaskWorker.java:533)
> ... 12 more
> Caused by: java.lang.RuntimeException: Failed to delete lost segment CDC
> links. Unable to acquire lock to lock CDC folder. Make sure a CDC app is shut
> down
> [dir=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0,
> reason=Failed to acquire file lock [holder=[consumerId=cdc.lock,
> [email protected]], time=0 sec,
> path=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0/lock]]
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask$CdcDeleteLostSegmentsJob.run(CdcDeleteLostSegmentsTask.java:161)
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask$CdcDeleteLostSegmentsJob.run(CdcDeleteLostSegmentsTask.java:73)
> at org.apache.ignite.internal.visor.VisorJob.execute(VisorJob.java:73)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker$1.call(GridJobWorker.java:628)
> at
> org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7474)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:622)
> ... 18 more
> ]
> at
> org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection.handleClientResponse(GridClientNioTcpConnection.java:634)
> at
> org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection.handleResponse(GridClientNioTcpConnection.java:565)
> at
> org.apache.ignite.internal.client.impl.connection.GridClientConnectionManagerAdapter$NioListener.onMessage(GridClientConnectionManagerAdapter.java:691)
> at
> org.apache.ignite.internal.util.nio.GridNioFilterChain$TailFilter.onMessageReceived(GridNioFilterChain.java:279)
> at
> org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109)
> at
> org.apache.ignite.internal.util.nio.GridNioCodecFilter.onMessageReceived(GridNioCodecFilter.java:116)
> at
> org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109)
> at
> org.apache.ignite.internal.util.nio.GridNioServer$HeadFilter.onMessageReceived(GridNioServer.java:3752)
> at
> org.apache.ignite.internal.util.nio.GridNioFilterChain.onMessageReceived(GridNioFilterChain.java:175)
> at
> org.apache.ignite.internal.util.nio.GridNioServer$ByteBufferNioClientWorker.processRead(GridNioServer.java:1211)
> at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2526)
> at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2281)
> at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Control utility has completed execution at: 2024-06-15T15:53:18.435
> Execution time: 1112 ms
> {noformat}
> Example of refactored output:
> {noformat}
> Command [CDC] started
> Arguments: --cdc delete_lost_segment_links --node-id
> e1ba8324-3ac0-44d7-8a2d-b6f2d2c00000 --yes
> --------------------------------------------------------------------------------
> Failed to perform operation.
> Failed to delete lost segment CDC links on a node
> [nodeId=e1ba8324-3ac0-44d7-8a2d-b6f2d2c00000]
> Failed to delete lost segment CDC links. Unable to acquire lock to lock CDC
> folder. Make sure a CDC app is shut down
> [dir=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0,
> reason=Failed to acquire file lock [holder=[consumerId=cdc.lock,
> [email protected]], time=0 sec,
> path=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0/lock]]
> Command [CDC] finished with code: 4
> Error stack trace:
> class org.apache.ignite.IgniteException: Failed to delete lost segment CDC
> links on a node [nodeId=e1ba8324-3ac0-44d7-8a2d-b6f2d2c00000]
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask.reduce0(CdcDeleteLostSegmentsTask.java:65)
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask.reduce0(CdcDeleteLostSegmentsTask.java:50)
> at
> org.apache.ignite.internal.visor.VisorMultiNodeTask.reduce(VisorMultiNodeTask.java:140)
> at
> org.apache.ignite.internal.visor.VisorMultiNodeTask.reduce(VisorMultiNodeTask.java:47)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker$5.call(GridTaskWorker.java:1154)
> at
> org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7474)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.reduce(GridTaskWorker.java:1152)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.onResponse(GridTaskWorker.java:981)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.processDelayedResponses(GridTaskWorker.java:716)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.body(GridTaskWorker.java:539)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
> at
> org.apache.ignite.internal.processors.task.GridTaskProcessor.startTask(GridTaskProcessor.java:755)
> at
> org.apache.ignite.internal.processors.task.GridTaskProcessor.execute(GridTaskProcessor.java:508)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler.handleAsyncUnsafe(GridTaskCommandHandler.java:220)
> at
> org.apache.ignite.internal.processors.rest.handlers.task.GridTaskCommandHandler.handleAsync(GridTaskCommandHandler.java:161)
> at
> org.apache.ignite.internal.processors.rest.GridRestProcessor.handleRequest0(GridRestProcessor.java:333)
> at
> org.apache.ignite.internal.processors.rest.GridRestProcessor.handleRequest(GridRestProcessor.java:309)
> at
> org.apache.ignite.internal.processors.rest.GridRestProcessor$2.body(GridRestProcessor.java:192)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: class org.apache.ignite.compute.ComputeUserUndeclaredException:
> Failed to execute job due to unexpected runtime exception
> [jobId=3838e0c1091-e1ba8324-3ac0-44d7-8a2d-b6f2d2c00000,
> ses=GridJobSessionImpl [ses=GridTaskSessionImpl
> [taskName=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask,
> dep=GridDeployment [ts=1718457632226, depMode=SHARED,
> clsLdr=jdk.internal.loader.ClassLoaders$AppClassLoader@16f65612,
> clsLdrId=c638e0c1091-e1ba8324-3ac0-44d7-8a2d-b6f2d2c00000, userVer=0,
> loc=true,
> sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionMap,
> pendingUndeploy=false, undeployed=false, usage=2],
> taskClsName=org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask,
> sesId=2838e0c1091-e1ba8324-3ac0-44d7-8a2d-b6f2d2c00000,
> startTime=1718457632531, endTime=9223372036854775807,
> taskNodeId=e1ba8324-3ac0-44d7-8a2d-b6f2d2c00000,
> clsLdr=jdk.internal.loader.ClassLoaders$AppClassLoader@16f65612,
> closed=false, cpSpi=null, failSpi=null, loadSpi=null, usage=1, fullSup=false,
> internal=true, topPred=null, mapFut=IgniteFuture [orig=GridFutureAdapter
> [ignoreInterrupts=false, state=INIT, res=null, hash=929967168]],
> execName=null, secCtx=null],
> jobId=3838e0c1091-e1ba8324-3ac0-44d7-8a2d-b6f2d2c00000], err=Failed to delete
> lost segment CDC links. Unable to acquire lock to lock CDC folder. Make sure
> a CDC app is shut down
> [dir=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0,
> reason=Failed to acquire file lock [holder=[consumerId=cdc.lock,
> [email protected]], time=0 sec,
> path=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0/lock]]]
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.handleThrowable(GridJobWorker.java:753)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:683)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.body(GridJobWorker.java:547)
> at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:125)
> at
> org.apache.ignite.internal.processors.job.GridJobProcessor.processJobExecuteRequest(GridJobProcessor.java:1367)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.sendRequest(GridTaskWorker.java:1440)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.processMappedJobs(GridTaskWorker.java:669)
> at
> org.apache.ignite.internal.processors.task.GridTaskWorker.body(GridTaskWorker.java:533)
> ... 12 more
> Caused by: java.lang.RuntimeException: Failed to delete lost segment CDC
> links. Unable to acquire lock to lock CDC folder. Make sure a CDC app is shut
> down
> [dir=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0,
> reason=Failed to acquire file lock [holder=[consumerId=cdc.lock,
> [email protected]], time=0 sec,
> path=/Users/sbt-amelchev-ns/work/ignite-public/work/db/wal/cdc/gridCommandHandlerTest0/lock]]
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask$CdcDeleteLostSegmentsJob.run(CdcDeleteLostSegmentsTask.java:161)
> at
> org.apache.ignite.internal.management.cdc.CdcDeleteLostSegmentsTask$CdcDeleteLostSegmentsJob.run(CdcDeleteLostSegmentsTask.java:73)
> at org.apache.ignite.internal.visor.VisorJob.execute(VisorJob.java:73)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker$1.call(GridJobWorker.java:628)
> at
> org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7474)
> at
> org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:622)
> ... 18 more
> Control utility has completed execution at: 2024-06-15T16:20:33.577
> Execution time: 1076 ms
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
