believe it is with the local state provider rather than flowfile attribute.
On Oct 20, 2017 3:40 AM, "Pierre Villard" <[email protected]> wrote: > Hi, > > I think you're hitting the maximum size of the data you can store in a > single attribute. > How big is the information you want to store? What is your use case? > > Please note that attributes shouldn't be used to store a lot of content as > this information is stored in NiFi's memory. > > Pierre > > > > 2017-10-20 1:50 GMT+02:00 Jay Kim <[email protected]>: > >> Hi all, >> >> Encountering a "java.io.UTFDataFormatException: encoded string too >> long: 75504 bytess" when running an UpdateAttribute processor on NiFi >> 1.3.0. >> >> I believe issue should not occur according to >> https://issues.apache.org/jira/browse/NIFI-3055 and >> https://issues.apache.org/jira/browse/NIFI-3389 which was resolved in >> NiFi 1.2.0. >> >> Any suggestions? >> >> nifi-app.log: >> >> 2017-10-19 23:01:05,493 ERROR [Timer-Driven Process Thread-3] >> o.a.n.p.attributes.UpdateAttribute >> UpdateAttribute[id=38777a21-f46d-3f2d-855a-6725c672445a] Failed to set >> the state after succes >> sfully processing >> StandardFlowFileRecord[uuid=4bc47d22-5bd9-4df7-9b36-b0a529f9 >> 73ec,claim=StandardContentClaim >> [resourceClaim=StandardResourceClaim[id=1508454065479-8, >> container=default, sect >> ion=8], offset=0, >> length=2367611],offset=0,name=<redacted>.csv,size=2367611] due a >> failure when setting the state. This is normally due to multiple thr >> eads running at once; transferring to 'set state fail': >> java.io.UTFDataFormatException: encoded string too long: 75504 bytes >> java.io.UTFDataFormatException: encoded string too long: 75504 bytes >> at java.io.DataOutputStream.writeUTF(DataOutputStream.java:364) >> at java.io.DataOutputStream.writeUTF(DataOutputStream.java:323) >> at org.apache.nifi.controller.state.StateMapSerDe.serializeReco >> rd(StateMapSerDe.java:62) >> at org.apache.nifi.controller.state.StateMapSerDe.serializeEdit >> (StateMapSerDe.java:35) >> at org.apache.nifi.controller.state.StateMapSerDe.serializeEdit >> (StateMapSerDe.java:30) >> at org.wali.MinimalLockingWriteAheadLog$Partition.update(Minima >> lLockingWriteAheadLog.java:933) >> at org.wali.MinimalLockingWriteAheadLog.update(MinimalLockingWr >> iteAheadLog.java:238) >> at org.apache.nifi.controller.state.providers.local.WriteAheadL >> ocalStateProvider$ComponentProvider.replace(WriteAheadLocalS >> tateProvider.java:269) >> at org.apache.nifi.controller.state.providers.local.WriteAheadL >> ocalStateProvider.replace(WriteAheadLocalStateProvider.java:207) >> at org.apache.nifi.controller.state.StandardStateManager.replac >> e(StandardStateManager.java:71) >> at org.apache.nifi.processors.attributes.UpdateAttribute.onTrig >> ger(UpdateAttribute.java:485) >> at org.apache.nifi.processor.AbstractProcessor.onTrigger(Abstra >> ctProcessor.java:27) >> at org.apache.nifi.controller.StandardProcessorNode.onTrigger(S >> tandardProcessorNode.java:1120) >> at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask >> .call(ContinuallyRunProcessorTask.java:147) >> at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask >> .call(ContinuallyRunProcessorTask.java:47) >> at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingA >> gent$1.run(TimerDrivenSchedulingAgent.java:132) >> at java.util.concurrent.Executors$RunnableAdapter.call( >> Executors.java:511) >> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java: >> 308) >> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu >> tureTask.access$301(ScheduledThreadPoolExecutor.java:180) >> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFu >> tureTask.run(ScheduledThreadPoolExecutor.java:294) >> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPool >> Executor.java:1142) >> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo >> lExecutor.java:617) >> at java.lang.Thread.run(Thread.java:748) >> >> Version: >> >> 1.3.0 >> >> 06/05/2017 12:31:48 UTC >> >> Tagged nifi-1.3.0-RC1 >> >> >> Regards >> Jay >> > >
