[
https://issues.apache.org/jira/browse/NIFI-210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15125736#comment-15125736
]
Joseph Witt commented on NIFI-210:
----------------------------------
reviewing. full clean build w/contrib check passes. Running a series of
flows. I am noticing that Scala is really problematic as-is.
2016-01-31 23:23:28,795 WARN [Timer-Driven Process Thread-4]
o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding
ExecuteScript[id=5fa72d15-391c-4890-82c4-e3e2d349a251] due to uncaught
Exception: java.lang.OutOfMemoryError: GC overhead limit exceeded
2016-01-31 23:23:28,797 WARN [Timer-Driven Process Thread-4]
o.a.n.c.t.ContinuallyRunProcessorTask
java.lang.OutOfMemoryError: GC overhead limit exceeded
at scala.tools.asm.ByteVector.enlarge(ByteVector.java:335) ~[na:na]
at scala.tools.asm.ByteVector.putUTF8(ByteVector.java:217) ~[na:na]
at scala.tools.asm.ClassWriter.newUTF8(ClassWriter.java:1092) ~[na:na]
at scala.tools.asm.ClassWriter.newClassItem(ClassWriter.java:1113) ~[na:na]
at scala.tools.asm.ClassWriter.visitInnerClass(ClassWriter.java:769) ~[na:na]
at
scala.tools.nsc.backend.jvm.GenASM$JBuilder.addInnerClasses(GenASM.scala:751)
~[na:na]
at scala.tools.nsc.backend.jvm.GenASM$JPlainBuilder.genClass(GenASM.scala:1339)
~[na:na]
at scala.tools.nsc.backend.jvm.GenASM$AsmPhase.emitFor$1(GenASM.scala:198)
~[na:na]
at scala.tools.nsc.backend.jvm.GenASM$AsmPhase.run(GenASM.scala:204) ~[na:na]
at scala.tools.nsc.Global$Run.compileUnitsInternal(Global.scala:1501) ~[na:na]
at scala.tools.nsc.Global$Run.compileUnits(Global.scala:1486) ~[na:na]
at scala.tools.nsc.Global$Run.compileSources(Global.scala:1481) ~[na:na]
at scala.tools.nsc.interpreter.IMain.compileSourcesKeepingRun(IMain.scala:434)
~[na:na]
at
scala.tools.nsc.interpreter.IMain$ReadEvalPrint.compileAndSaveRun(IMain.scala:853)
~[na:na]
at scala.tools.nsc.interpreter.IMain$ReadEvalPrint.compile(IMain.scala:811)
~[na:na]
at
scala.tools.nsc.interpreter.IMain$Request.compile$lzycompute(IMain.scala:995)
~[na:na]
at scala.tools.nsc.interpreter.IMain$Request.compile(IMain.scala:990) ~[na:na]
at scala.tools.nsc.interpreter.IMain.compile(IMain.scala:577) ~[na:na]
at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:565) ~[na:na]
at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:563) ~[na:na]
at scala.tools.nsc.interpreter.IMain.bind(IMain.scala:689) ~[na:na]
at scala.tools.nsc.interpreter.IMain.bind(IMain.scala:710) ~[na:na]
at scala.tools.nsc.interpreter.IMain$$anon$2.put(IMain.scala:1054) ~[na:na]
at
org.apache.nifi.processors.script.ExecuteScript.onTrigger(ExecuteScript.java:166)
~[na:na]
at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1139)
~[na:na]
at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:139)
~[na:na]
at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:49)
~[na:na]
at
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:119)
~[na:na]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[na:1.8.0_66]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
~[na:1.8.0_66]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
~[na:1.8.0_66]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
~[na:1.8.0_66]
It might be worth removing support for Scala for now. I'd say mark it
expertimental but it seems to cause GC/Heap problems. Has signs of memory
leakage.
> Provide an ExecuteScript processor
> ----------------------------------
>
> Key: NIFI-210
> URL: https://issues.apache.org/jira/browse/NIFI-210
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Core Framework
> Affects Versions: 0.0.1
> Reporter: A. Steven Anderson
> Assignee: Matt Burgess
> Labels: processor, scala
> Fix For: 0.5.0
>
> Attachments:
> 0001-NIFI-210-few-tweaks-to-drop-static-reference-and-fix.patch
>
>
> Add latest Scala version support for ExcecuteScript processor.
> Should also support Clojure as per discussion and request on mailing list
> http://mail-archives.apache.org/mod_mbox/nifi-dev/201506.mbox/%3CCAMpSqch4GK1gnw6M1u8tH6AN8e_miXZN5SNkAeMjBujXYGqJiw%40mail.gmail.com%3E
> UPDATE: The ScriptEngine for Clojure is not being maintained and is not
> currently available via Maven Central or a public repository. Recommend
> adding Clojure as a separate Improvement Jira case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
