NiFi 1.0.0
I have a cluster where one of the nodes ran out of space and left the
cluster. Is there a way to delete archived content to free up space? Can the
unprocessed data be recovered somehow or do I have to delete the
repositories and replay the data from our Kafka topic?
I looked through the admin and user guides, but could not find anything on
this topic.
Here is the error I am getting:
2017-01-31 14:00:00,002 ERROR [Timer-Driven Process Thread-2]
o.a.n.p.standard.RouteOnAttribute
RouteOnAttribute[id=464e0e04-5acd-498d-1fc5-af23c1b86ccd] Failed to process
session due to org.apache.nifi.processor.exception.ProcessException:
FlowFile Repository failed to update:
org.apache.nifi.processor.exception.ProcessException: FlowFile Repository
failed to update
2017-01-31 14:00:00,002 ERROR [Timer-Driven Process Thread-9]
o.a.n.p.standard.EvaluateJsonPath
org.apache.nifi.processor.exception.ProcessException: FlowFile Repository
failed to update
at
org.apache.nifi.controller.repository.StandardProcessSession.commit(StandardProcessSession.java:363)
~[nifi-framework-core-1.0.0.jar:1.0.0]
at
org.apache.nifi.controller.repository.StandardProcessSession.commit(StandardProcessSession.java:299)
~[nifi-framework-core-1.0.0.jar:1.0.0]
at
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:28)
~[nifi-api-1.0.0.jar:1.0.0]
at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1064)
[nifi-framework-core-1.0.0.jar:1.0.0]
at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136)
[nifi-framework-core-1.0.0.jar:1.0.0]
at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
[nifi-framework-core-1.0.0.jar:1.0.0]
at
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
[nifi-framework-core-1.0.0.jar:1.0.0]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[na:1.8.0_65]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
[na:1.8.0_65]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
[na:1.8.0_65]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
[na:1.8.0_65]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_65]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_65]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_65]
Caused by: java.io.IOException: All Partitions have been blacklisted due to
failures when attempting to update. If the Write-Ahead Log is able to
perform a checkpoint, this issue may resolve itself. Otherwise, manual
intervention will be required.
at
org.wali.MinimalLockingWriteAheadLog.update(MinimalLockingWriteAheadLog.java:212)
~[nifi-write-ahead-log-1.0.0.jar:1.0.0]
at
org.apache.nifi.controller.repository.WriteAheadFlowFileRepository.updateRepository(WriteAheadFlowFileRepository.java:219)
~[nifi-framework-core-1.0.0.jar:1.0.0]
at
org.apache.nifi.controller.repository.WriteAheadFlowFileRepository.updateRepository(WriteAheadFlowFileRepository.java:187)
~[nifi-framework-core-1.0.0.jar:1.0.0]
at
org.apache.nifi.controller.repository.StandardProcessSession.commit(StandardProcessSession.java:357)
~[nifi-framework-core-1.0.0.jar:1.0.0]
... 13 common frames omitted
--
View this message in context:
http://apache-nifi-developer-list.39713.n7.nabble.com/Data-recovery-with-full-disk-tp14553.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.
