Hi, I think you're hitting the maximum size of the data you can store in a single attribute. How big is the information you want to store? What is your use case?
Please note that attributes shouldn't be used to store a lot of content as this information is stored in NiFi's memory. Pierre 2017-10-20 1:50 GMT+02:00 Jay Kim <[email protected]>: > Hi all, > > Encountering a "java.io.UTFDataFormatException: encoded string too > long: 75504 bytess" when running an UpdateAttribute processor on NiFi > 1.3.0. > > I believe issue should not occur according to > https://issues.apache.org/jira/browse/NIFI-3055 and > https://issues.apache.org/jira/browse/NIFI-3389 which was resolved in > NiFi 1.2.0. > > Any suggestions? > > nifi-app.log: > > 2017-10-19 23:01:05,493 ERROR [Timer-Driven Process Thread-3] > o.a.n.p.attributes.UpdateAttribute > UpdateAttribute[id=38777a21-f46d-3f2d-855a-6725c672445a] Failed to set > the state after succes > sfully processing > StandardFlowFileRecord[uuid=4bc47d22-5bd9-4df7-9b36-b0a529f973ec,claim= > StandardContentClaim > [resourceClaim=StandardResourceClaim[id=1508454065479-8, > container=default, sect > ion=8], offset=0, > length=2367611],offset=0,name=<redacted>.csv,size=2367611] due a > failure when setting the state. This is normally due to multiple thr > eads running at once; transferring to 'set state fail': > java.io.UTFDataFormatException: encoded string too long: 75504 bytes > java.io.UTFDataFormatException: encoded string too long: 75504 bytes > at java.io.DataOutputStream.writeUTF(DataOutputStream.java:364) > at java.io.DataOutputStream.writeUTF(DataOutputStream.java:323) > at org.apache.nifi.controller.state.StateMapSerDe. > serializeRecord(StateMapSerDe.java:62) > at org.apache.nifi.controller.state.StateMapSerDe. > serializeEdit(StateMapSerDe.java:35) > at org.apache.nifi.controller.state.StateMapSerDe. > serializeEdit(StateMapSerDe.java:30) > at org.wali.MinimalLockingWriteAheadLog$Partition.update( > MinimalLockingWriteAheadLog.java:933) > at org.wali.MinimalLockingWriteAheadLog.update( > MinimalLockingWriteAheadLog.java:238) > at org.apache.nifi.controller.state.providers.local. > WriteAheadLocalStateProvider$ComponentProvider.replace( > WriteAheadLocalStateProvider.java:269) > at org.apache.nifi.controller.state.providers.local. > WriteAheadLocalStateProvider.replace(WriteAheadLocalStateProvider. > java:207) > at org.apache.nifi.controller.state.StandardStateManager. > replace(StandardStateManager.java:71) > at org.apache.nifi.processors.attributes.UpdateAttribute. > onTrigger(UpdateAttribute.java:485) > at org.apache.nifi.processor.AbstractProcessor.onTrigger( > AbstractProcessor.java:27) > at org.apache.nifi.controller.StandardProcessorNode.onTrigger( > StandardProcessorNode.java:1120) > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:147) > at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask. > call(ContinuallyRunProcessorTask.java:47) > at org.apache.nifi.controller.scheduling. > TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132) > at java.util.concurrent.Executors$RunnableAdapter. > call(Executors.java:511) > at java.util.concurrent.FutureTask.runAndReset( > FutureTask.java:308) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > at java.util.concurrent.ScheduledThreadPoolExecutor$ > ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:748) > > Version: > > 1.3.0 > > 06/05/2017 12:31:48 UTC > > Tagged nifi-1.3.0-RC1 > > > Regards > Jay >
