Hello,
I'm experimenting with tiny pipeline. It seems every time exception occurs,
threads stuck in livelock(iirc). I put some logs and stacks below.
Question:
- do you pursue usability perfection for GUI, or it's a dead end and you
move toward web UI?
- is it worth to raise an issue?
Here's an error that's not a problem:
2023/05/20 14:22:12 - solr-docs - Execution started for pipeline [solr-docs]
2023/05/20 14:22:13 - Generate rows.0 - Finished processing (I=0, O=0, R=0,
W=10, U=0, E=0)
org.apache.hop.core.exception.HopException:
The specified field '{0}' could not be found in the input.
2023/05/20 14:22:13 - Fake data - products.0 - Finished processing (I=0,
O=0, R=10, W=10, U=0, E=0)
at
org.apache.hop.pipeline.transforms.jsonoutput.JsonOutput.processRow(JsonOutput.java:202)
at
org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:55)
at java.base/java.lang.Thread.run(Thread.java:833)
2023/05/20 14:22:13 - JSON output.0 - ERROR: Unexpected error
2023/05/20 14:22:13 - JSON output.0 - ERROR:
org.apache.hop.core.exception.HopException:
2023/05/20 14:22:13 - JSON output.0 - The specified field '{0}' could not
be found in the input.
2023/05/20 14:22:13 - JSON output.0 -
2023/05/20 14:22:13 - JSON output.0 - at
org.apache.hop.pipeline.transforms.jsonoutput.JsonOutput.processRow(JsonOutput.java:202)
2023/05/20 14:22:13 - JSON output.0 - at
org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:55)
2023/05/20 14:22:13 - JSON output.0 - at
java.base/java.lang.Thread.run(Thread.java:833)
2023/05/20 14:22:13 - JSON output.0 - Finished processing (I=0, O=0, R=1,
W=0, U=0, E=1)
2023/05/20 14:22:13 - solr-docs - Pipeline detected one or more transforms
with errors.
2023/05/20 14:22:13 - solr-docs - Pipeline is killing the other transforms!
2023/05/20 14:22:13 - solr-docs - Pipeline duration : 1.035 seconds [
1.034" ]
but it causes thread stuck (find 0x0000000092b2e408):
"main" #1 prio=5 os_prio=0 cpu=196921.88ms elapsed=50520.47s
tid=0x00000198b9c56250 nid=0x6454 waiting for monitor entry
[0x00000083d1eff000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.hop.pipeline.Pipeline.getEngineMetrics(Pipeline.java:3284)
- waiting to lock <0x0000000092b2e408> (a
org.apache.hop.pipeline.engines.local.LocalPipelineEngine)
at org.apache.hop.pipeline.Pipeline.getEngineMetrics(Pipeline.java:3279)
at
org.apache.hop.ui.hopgui.file.pipeline.delegates.HopGuiPipelineGridDelegate.refreshView(HopGuiPipelineGridDelegate.java:352)
at
org.apache.hop.ui.hopgui.file.pipeline.delegates.HopGuiPipelineGridDelegate$1.lambda$run$0(HopGuiPipelineGridDelegate.java:259)
at
org.apache.hop.ui.hopgui.file.pipeline.delegates.HopGuiPipelineGridDelegate$1$$Lambda$350/0x000000080112bd80.run(Unknown
Source)
at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:40)
at
org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:132)
- locked <0x0000000096284228> (a org.eclipse.swt.widgets.RunnableLock)
at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4029)
at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3645)
at org.apache.hop.ui.hopgui.HopGui.open(HopGui.java:474)
at org.apache.hop.ui.hopgui.HopGui.main(HopGui.java:352)
"solr-docs - REST client" #282 prio=5 os_prio=0 cpu=15.62ms elapsed=165.46s
tid=0x00000198e17bd250 nid=0x37ec in Object.wait() [0x00000083d42fe000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at java.lang.Object.wait(java.base@17.0.6/Object.java:338)
at org.eclipse.swt.widgets.Synchronizer.syncExec(Synchronizer.java:200)
- locked <0x00000000915845d0> (a org.eclipse.swt.widgets.RunnableLock)
at org.eclipse.swt.widgets.Display.syncExec(Display.java:4785)
at
org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.checkErrorVisuals(HopGuiPipelineGraph.java:4647)
at
org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.lambda$startThreads$17(HopGuiPipelineGraph.java:4546)
at
org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph$$Lambda$374/0x0000000801150f20.finished(Unknown
Source)
at
org.apache.hop.pipeline.Pipeline.firePipelineExecutionFinishedListeners(Pipeline.java:1326)
- locked <0x0000000092b2e600> (a
java.util.Collections$SynchronizedRandomAccessList)
at
org.apache.hop.pipeline.Pipeline.lambda$startThreads$0(Pipeline.java:1142)
- locked <0x0000000092b2e408> (a
org.apache.hop.pipeline.engines.local.LocalPipelineEngine)
at
org.apache.hop.pipeline.Pipeline$$Lambda$381/0x00000008011523d8.transformFinished(Unknown
Source)
at
org.apache.hop.pipeline.transform.BaseTransform.fireTransformFinishedListeners(BaseTransform.java:2779)
- locked <0x0000000092026e60> (a
java.util.Collections$SynchronizedRandomAccessList)
- locked <0x00000000922d0390> (a
org.apache.hop.pipeline.transforms.rest.Rest)
at
org.apache.hop.pipeline.transform.BaseTransform.markStop(BaseTransform.java:2768)
- locked <0x00000000922d0390> (a
org.apache.hop.pipeline.transforms.rest.Rest)
at org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:142)
at java.lang.Thread.run(java.base@17.0.6/Thread.java:833)
Attaching these files.
--
Sincerely yours
Mikhail Khludnev
2023-05-20 14:24:59
Full thread dump OpenJDK 64-Bit Server VM (17.0.6+10 mixed mode, sharing):
Threads class SMR info:
_java_thread_list=0x00000198e1d19060, length=23, elements={
0x00000198b9c56250, 0x00000198d9748320, 0x00000198d974a110, 0x00000198d9760930,
0x00000198d97613f0, 0x00000198d9764930, 0x00000198d9769260, 0x00000198d976e550,
0x00000198d976ef00, 0x00000198d977ab50, 0x00000198da30a980, 0x00000198da30d000,
0x00000198da30b320, 0x00000198da30b7f0, 0x00000198da30a4b0, 0x00000198da30c660,
0x00000198da30ae50, 0x00000198da30d9a0, 0x00000198dfdd7510, 0x00000198dfddbd40,
0x00000198dfdd79e0, 0x00000198dfdda530, 0x00000198e17bd250
}
"main" #1 prio=5 os_prio=0 cpu=196921.88ms elapsed=50520.47s
tid=0x00000198b9c56250 nid=0x6454 waiting for monitor entry
[0x00000083d1eff000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.hop.pipeline.Pipeline.getEngineMetrics(Pipeline.java:3284)
- waiting to lock <0x0000000092b2e408> (a
org.apache.hop.pipeline.engines.local.LocalPipelineEngine)
at org.apache.hop.pipeline.Pipeline.getEngineMetrics(Pipeline.java:3279)
at
org.apache.hop.ui.hopgui.file.pipeline.delegates.HopGuiPipelineGridDelegate.refreshView(HopGuiPipelineGridDelegate.java:352)
at
org.apache.hop.ui.hopgui.file.pipeline.delegates.HopGuiPipelineGridDelegate$1.lambda$run$0(HopGuiPipelineGridDelegate.java:259)
at
org.apache.hop.ui.hopgui.file.pipeline.delegates.HopGuiPipelineGridDelegate$1$$Lambda$350/0x000000080112bd80.run(Unknown
Source)
at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:40)
at
org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:132)
- locked <0x0000000096284228> (a org.eclipse.swt.widgets.RunnableLock)
at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4029)
at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3645)
at org.apache.hop.ui.hopgui.HopGui.open(HopGui.java:474)
at org.apache.hop.ui.hopgui.HopGui.main(HopGui.java:352)
"Reference Handler" #2 daemon prio=10 os_prio=2 cpu=0.00ms elapsed=50520.36s
tid=0x00000198d9748320 nid=0x5028 waiting on condition [0x00000083d25ff000]
java.lang.Thread.State: RUNNABLE
at
java.lang.ref.Reference.waitForReferencePendingList(java.base@17.0.6/Native
Method)
at
java.lang.ref.Reference.processPendingReferences(java.base@17.0.6/Reference.java:253)
at
java.lang.ref.Reference$ReferenceHandler.run(java.base@17.0.6/Reference.java:215)
"Finalizer" #3 daemon prio=8 os_prio=1 cpu=0.00ms elapsed=50520.36s
tid=0x00000198d974a110 nid=0x6bfc in Object.wait() [0x00000083d26ff000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:155)
- locked <0x00000000808da6b8> (a java.lang.ref.ReferenceQueue$Lock)
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:176)
at
java.lang.ref.Finalizer$FinalizerThread.run(java.base@17.0.6/Finalizer.java:172)
"Signal Dispatcher" #4 daemon prio=9 os_prio=2 cpu=0.00ms elapsed=50520.32s
tid=0x00000198d9760930 nid=0x613c waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Attach Listener" #5 daemon prio=5 os_prio=2 cpu=15.62ms elapsed=50520.32s
tid=0x00000198d97613f0 nid=0x4138 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Service Thread" #6 daemon prio=9 os_prio=0 cpu=46.88ms elapsed=50520.32s
tid=0x00000198d9764930 nid=0x39cc runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Monitor Deflation Thread" #7 daemon prio=9 os_prio=0 cpu=93.75ms
elapsed=50520.32s tid=0x00000198d9769260 nid=0x6464 runnable
[0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread0" #8 daemon prio=9 os_prio=2 cpu=59265.62ms
elapsed=50520.32s tid=0x00000198d976e550 nid=0x5cf8 waiting on condition
[0x0000000000000000]
java.lang.Thread.State: RUNNABLE
No compile task
"C1 CompilerThread0" #10 daemon prio=9 os_prio=2 cpu=8203.12ms
elapsed=50520.32s tid=0x00000198d976ef00 nid=0x6190 waiting on condition
[0x0000000000000000]
java.lang.Thread.State: RUNNABLE
No compile task
"Sweeper thread" #11 daemon prio=9 os_prio=2 cpu=968.75ms elapsed=50520.32s
tid=0x00000198d977ab50 nid=0x2438 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Notification Thread" #12 daemon prio=9 os_prio=0 cpu=0.00ms elapsed=50520.11s
tid=0x00000198da30a980 nid=0x6bc4 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Common-Cleaner" #13 daemon prio=8 os_prio=1 cpu=109.38ms elapsed=50520.10s
tid=0x00000198da30d000 nid=0x4810 in Object.wait() [0x00000083d30fe000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:155)
- locked <0x00000000808da9d0> (a java.lang.ref.ReferenceQueue$Lock)
at
jdk.internal.ref.CleanerImpl.run(java.base@17.0.6/CleanerImpl.java:140)
at java.lang.Thread.run(java.base@17.0.6/Thread.java:833)
at
jdk.internal.misc.InnocuousThread.run(java.base@17.0.6/InnocuousThread.java:162)
"org.apache.commons.vfs2.cache.SoftRefFilesCache$ReleaseThread" #17 daemon
prio=5 os_prio=0 cpu=0.00ms elapsed=50457.96s tid=0x00000198da30b320 nid=0x69d8
in Object.wait() [0x00000083d33fe000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <0x0000000085334fa0> (a java.lang.ref.ReferenceQueue$Lock)
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:155)
- locked <0x0000000085334fa0> (a java.lang.ref.ReferenceQueue$Lock)
at
org.apache.commons.vfs2.cache.SoftRefFilesCache$ReleaseThread.run(SoftRefFilesCache.java:54)
"Timer-1" #18 daemon prio=5 os_prio=0 cpu=15.62ms elapsed=50457.39s
tid=0x00000198da30b7f0 nid=0x61c0 in Object.wait() [0x00000083d39ff000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at java.util.TimerThread.mainLoop(java.base@17.0.6/Timer.java:563)
- locked <0x0000000085335170> (a java.util.TaskQueue)
at java.util.TimerThread.run(java.base@17.0.6/Timer.java:516)
"Thread-4" #19 daemon prio=1 os_prio=-2 cpu=2687.50ms elapsed=50457.34s
tid=0x00000198da30a4b0 nid=0x65f4 waiting on condition [0x00000083d36ff000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(java.base@17.0.6/Native Method)
at
org.apache.commons.vfs2.impl.DefaultFileMonitor.run(DefaultFileMonitor.java:344)
at java.lang.Thread.run(java.base@17.0.6/Thread.java:833)
"Java2D Disposer" #20 daemon prio=10 os_prio=2 cpu=15.62ms elapsed=50453.84s
tid=0x00000198da30c660 nid=0xd78 in Object.wait() [0x00000083d3aff000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:155)
- locked <0x00000000822716c0> (a java.lang.ref.ReferenceQueue$Lock)
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:176)
at sun.java2d.Disposer.run(java.desktop@17.0.6/Disposer.java:145)
at java.lang.Thread.run(java.base@17.0.6/Thread.java:833)
"AWT-Windows" #22 daemon prio=6 os_prio=0 cpu=437.50ms elapsed=50453.78s
tid=0x00000198da30ae50 nid=0x5ec0 runnable [0x00000083d3cff000]
java.lang.Thread.State: RUNNABLE
at sun.awt.windows.WToolkit.eventLoop(java.desktop@17.0.6/Native Method)
at sun.awt.windows.WToolkit.run(java.desktop@17.0.6/WToolkit.java:365)
at java.lang.Thread.run(java.base@17.0.6/Thread.java:833)
"Batik CleanerThread" #25 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=50453.15s
tid=0x00000198da30d9a0 nid=0x3a3c in Object.wait() [0x00000083d3eff000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <0x0000000082271d88> (a java.lang.ref.ReferenceQueue$Lock)
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:155)
- locked <0x0000000082271d88> (a java.lang.ref.ReferenceQueue$Lock)
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:176)
at org.apache.batik.util.CleanerThread.run(CleanerThread.java:106)
"HopGuiPipelineGraph: solr-docs" #32 prio=5 os_prio=0 cpu=531.25ms
elapsed=50063.59s tid=0x00000198dfdd7510 nid=0x61fc in Object.wait()
[0x00000083d3bff000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at java.util.TimerThread.mainLoop(java.base@17.0.6/Timer.java:563)
- locked <0x0000000087d66528> (a java.util.TaskQueue)
at java.util.TimerThread.run(java.base@17.0.6/Timer.java:516)
"log sniffer Timer" #33 prio=5 os_prio=0 cpu=406.25ms elapsed=50063.53s
tid=0x00000198dfddbd40 nid=0x61e0 in Object.wait() [0x00000083d3fff000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at java.util.TimerThread.mainLoop(java.base@17.0.6/Timer.java:563)
- locked <0x000000008c600190> (a java.util.TaskQueue)
at java.util.TimerThread.run(java.base@17.0.6/Timer.java:516)
"HopGuiPipelineGraph: redraw timer" #277 prio=5 os_prio=0 cpu=15.62ms
elapsed=165.57s tid=0x00000198dfdd79e0 nid=0x4c98 in Object.wait()
[0x00000083d1bfe000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at java.util.TimerThread.mainLoop(java.base@17.0.6/Timer.java:563)
- locked <0x0000000091c29a90> (a java.util.TaskQueue)
at java.util.TimerThread.run(java.base@17.0.6/Timer.java:516)
"Thread-92" #278 prio=5 os_prio=0 cpu=203.12ms elapsed=165.48s
tid=0x00000198dfdda530 nid=0x2d04 waiting on condition [0x00000083d1cff000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@17.0.6/Native Method)
- parking to wait for <0x0000000091908e90> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at
java.util.concurrent.locks.LockSupport.parkNanos(java.base@17.0.6/LockSupport.java:252)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@17.0.6/AbstractQueuedSynchronizer.java:1672)
at
java.util.concurrent.ArrayBlockingQueue.poll(java.base@17.0.6/ArrayBlockingQueue.java:435)
at
org.apache.hop.pipeline.Pipeline.waitUntilFinished(Pipeline.java:1458)
at
org.apache.hop.pipeline.engines.local.LocalPipelineEngine.waitUntilFinished(LocalPipelineEngine.java:359)
at
org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.lambda$startThreads$18(HopGuiPipelineGraph.java:4558)
at
org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph$$Lambda$380/0x0000000801151fc0.run(Unknown
Source)
at java.lang.Thread.run(java.base@17.0.6/Thread.java:833)
"solr-docs - REST client" #282 prio=5 os_prio=0 cpu=15.62ms elapsed=165.46s
tid=0x00000198e17bd250 nid=0x37ec in Object.wait() [0x00000083d42fe000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at java.lang.Object.wait(java.base@17.0.6/Object.java:338)
at org.eclipse.swt.widgets.Synchronizer.syncExec(Synchronizer.java:200)
- locked <0x00000000915845d0> (a org.eclipse.swt.widgets.RunnableLock)
at org.eclipse.swt.widgets.Display.syncExec(Display.java:4785)
at
org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.checkErrorVisuals(HopGuiPipelineGraph.java:4647)
at
org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.lambda$startThreads$17(HopGuiPipelineGraph.java:4546)
at
org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph$$Lambda$374/0x0000000801150f20.finished(Unknown
Source)
at
org.apache.hop.pipeline.Pipeline.firePipelineExecutionFinishedListeners(Pipeline.java:1326)
- locked <0x0000000092b2e600> (a
java.util.Collections$SynchronizedRandomAccessList)
at
org.apache.hop.pipeline.Pipeline.lambda$startThreads$0(Pipeline.java:1142)
- locked <0x0000000092b2e408> (a
org.apache.hop.pipeline.engines.local.LocalPipelineEngine)
at
org.apache.hop.pipeline.Pipeline$$Lambda$381/0x00000008011523d8.transformFinished(Unknown
Source)
at
org.apache.hop.pipeline.transform.BaseTransform.fireTransformFinishedListeners(BaseTransform.java:2779)
- locked <0x0000000092026e60> (a
java.util.Collections$SynchronizedRandomAccessList)
- locked <0x00000000922d0390> (a
org.apache.hop.pipeline.transforms.rest.Rest)
at
org.apache.hop.pipeline.transform.BaseTransform.markStop(BaseTransform.java:2768)
- locked <0x00000000922d0390> (a
org.apache.hop.pipeline.transforms.rest.Rest)
at org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:142)
at java.lang.Thread.run(java.base@17.0.6/Thread.java:833)
"VM Thread" os_prio=2 cpu=156.25ms elapsed=50520.39s tid=0x00000198d9743740
nid=0x65e4 runnable
"GC Thread#0" os_prio=2 cpu=296.88ms elapsed=50520.44s tid=0x00000198b9cb0fa0
nid=0x4a80 runnable
"GC Thread#1" os_prio=2 cpu=328.12ms elapsed=50506.76s tid=0x00000198daa64690
nid=0x6338 runnable
"GC Thread#2" os_prio=2 cpu=265.62ms elapsed=50506.76s tid=0x00000198daa64940
nid=0x3a8 runnable
"GC Thread#3" os_prio=2 cpu=296.88ms elapsed=50506.00s tid=0x00000198db494c10
nid=0x5edc runnable
"G1 Main Marker" os_prio=2 cpu=0.00ms elapsed=50520.44s tid=0x00000198b9cc1df0
nid=0x595c runnable
"G1 Conc#0" os_prio=2 cpu=875.00ms elapsed=50520.44s tid=0x00000198b9cc2710
nid=0x5b90 runnable
"G1 Refine#0" os_prio=2 cpu=78.12ms elapsed=50520.44s tid=0x00000198b9d08b50
nid=0x6828 runnable
"G1 Refine#1" os_prio=2 cpu=0.00ms elapsed=50502.30s tid=0x00000198db35edd0
nid=0x5b7c runnable
"G1 Refine#2" os_prio=2 cpu=0.00ms elapsed=50502.30s tid=0x00000198db8a6400
nid=0x3b78 runnable
"G1 Refine#3" os_prio=2 cpu=0.00ms elapsed=50502.30s tid=0x00000198db8a6af0
nid=0x4694 runnable
"G1 Service" os_prio=2 cpu=265.62ms elapsed=50520.44s tid=0x00000198d9602610
nid=0x1b8 runnable
"VM Periodic Task Thread" os_prio=2 cpu=546.88ms elapsed=50520.11s
tid=0x00000198da3147a0 nid=0x1008 waiting on condition
JNI global refs: 210, weak refs: 56
2023-05-20 23:34:29
Full thread dump OpenJDK 64-Bit Server VM (17.0.6+10 mixed mode, sharing):
Threads class SMR info:
_java_thread_list=0x000002e3aaac1de0, length=23, elements={
0x000002e381e570e0, 0x000002e39f9e1d90, 0x000002e39f9e4c10, 0x000002e39f9fb710,
0x000002e39f9fc1d0, 0x000002e39f9fcd80, 0x000002e39f9ff740, 0x000002e39fa04930,
0x000002e39fa11340, 0x000002e39fa13d40, 0x000002e3a06203d0, 0x000002e3a062ddd0,
0x000002e3a155e830, 0x000002e381e58090, 0x000002e3a1708030, 0x000002e3b0408ca0,
0x000002e3a14e36f0, 0x000002e3b02900f0, 0x000002e3a6531080, 0x000002e3a65370c0,
0x000002e3a6534a40, 0x000002e3a6531a20, 0x000002e3a6536720
}
"main" #1 prio=5 os_prio=0 cpu=253656.25ms elapsed=32809.95s
tid=0x000002e381e570e0 nid=0x6f8 waiting for monitor entry [0x000000f73d2ff000]
java.lang.Thread.State: BLOCKED (on object monitor)
at org.apache.hop.pipeline.Pipeline.getEngineMetrics(Pipeline.java:3284)
- waiting to lock <0x000000008a2012a8> (a
org.apache.hop.pipeline.engines.local.LocalPipelineEngine)
at org.apache.hop.pipeline.Pipeline.getEngineMetrics(Pipeline.java:3279)
at
org.apache.hop.ui.hopgui.file.pipeline.delegates.HopGuiPipelineGridDelegate.refreshView(HopGuiPipelineGridDelegate.java:352)
at
org.apache.hop.ui.hopgui.file.pipeline.delegates.HopGuiPipelineGridDelegate$1.lambda$run$0(HopGuiPipelineGridDelegate.java:259)
at
org.apache.hop.ui.hopgui.file.pipeline.delegates.HopGuiPipelineGridDelegate$1$$Lambda$336/0x0000000801126500.run(Unknown
Source)
at org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:40)
at
org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:132)
- locked <0x000000008a217fb8> (a org.eclipse.swt.widgets.RunnableLock)
at org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4029)
at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3645)
at org.apache.hop.ui.hopgui.HopGui.open(HopGui.java:474)
at org.apache.hop.ui.hopgui.HopGui.main(HopGui.java:352)
"Reference Handler" #2 daemon prio=10 os_prio=2 cpu=31.25ms elapsed=32809.92s
tid=0x000002e39f9e1d90 nid=0x1c20 waiting on condition [0x000000f73d9ff000]
java.lang.Thread.State: RUNNABLE
at
java.lang.ref.Reference.waitForReferencePendingList(java.base@17.0.6/Native
Method)
at
java.lang.ref.Reference.processPendingReferences(java.base@17.0.6/Reference.java:253)
at
java.lang.ref.Reference$ReferenceHandler.run(java.base@17.0.6/Reference.java:215)
"Finalizer" #3 daemon prio=8 os_prio=1 cpu=0.00ms elapsed=32809.92s
tid=0x000002e39f9e4c10 nid=0x5db0 in Object.wait() [0x000000f73daff000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:155)
- locked <0x000000008088bbd0> (a java.lang.ref.ReferenceQueue$Lock)
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:176)
at
java.lang.ref.Finalizer$FinalizerThread.run(java.base@17.0.6/Finalizer.java:172)
"Signal Dispatcher" #4 daemon prio=9 os_prio=2 cpu=0.00ms elapsed=32809.89s
tid=0x000002e39f9fb710 nid=0x20f4 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Attach Listener" #5 daemon prio=5 os_prio=2 cpu=0.00ms elapsed=32809.89s
tid=0x000002e39f9fc1d0 nid=0x38e8 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Service Thread" #6 daemon prio=9 os_prio=0 cpu=46.88ms elapsed=32809.89s
tid=0x000002e39f9fcd80 nid=0x69f4 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Monitor Deflation Thread" #7 daemon prio=9 os_prio=0 cpu=234.38ms
elapsed=32809.89s tid=0x000002e39f9ff740 nid=0x670 runnable
[0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread0" #8 daemon prio=9 os_prio=2 cpu=99140.62ms
elapsed=32809.89s tid=0x000002e39fa04930 nid=0x147c waiting on condition
[0x0000000000000000]
java.lang.Thread.State: RUNNABLE
No compile task
"C1 CompilerThread0" #10 daemon prio=9 os_prio=2 cpu=12500.00ms
elapsed=32809.89s tid=0x000002e39fa11340 nid=0x30dc waiting on condition
[0x0000000000000000]
java.lang.Thread.State: RUNNABLE
No compile task
"Sweeper thread" #11 daemon prio=9 os_prio=2 cpu=890.62ms elapsed=32809.89s
tid=0x000002e39fa13d40 nid=0x3930 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Notification Thread" #12 daemon prio=9 os_prio=0 cpu=0.00ms elapsed=32809.41s
tid=0x000002e3a06203d0 nid=0x5ac4 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Common-Cleaner" #13 daemon prio=8 os_prio=1 cpu=171.88ms elapsed=32809.39s
tid=0x000002e3a062ddd0 nid=0x68a0 in Object.wait() [0x000000f73e4ff000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:155)
- locked <0x000000008088c5b0> (a java.lang.ref.ReferenceQueue$Lock)
at
jdk.internal.ref.CleanerImpl.run(java.base@17.0.6/CleanerImpl.java:140)
at java.lang.Thread.run(java.base@17.0.6/Thread.java:833)
at
jdk.internal.misc.InnocuousThread.run(java.base@17.0.6/InnocuousThread.java:162)
"org.apache.commons.vfs2.cache.SoftRefFilesCache$ReleaseThread" #17 daemon
prio=5 os_prio=0 cpu=0.00ms elapsed=32779.57s tid=0x000002e3a155e830 nid=0x41e0
in Object.wait() [0x000000f73cfff000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:155)
- locked <0x0000000085f55778> (a java.lang.ref.ReferenceQueue$Lock)
at
org.apache.commons.vfs2.cache.SoftRefFilesCache$ReleaseThread.run(SoftRefFilesCache.java:54)
"Timer-1" #18 daemon prio=5 os_prio=0 cpu=109.38ms elapsed=32779.07s
tid=0x000002e381e58090 nid=0x269c in Object.wait() [0x000000f73d0ff000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at java.util.TimerThread.mainLoop(java.base@17.0.6/Timer.java:563)
- locked <0x0000000085f78840> (a java.util.TaskQueue)
at java.util.TimerThread.run(java.base@17.0.6/Timer.java:516)
"Thread-4" #19 daemon prio=1 os_prio=-2 cpu=4984.38ms elapsed=32779.01s
tid=0x000002e3a1708030 nid=0x2684 waiting on condition [0x000000f73d1ff000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(java.base@17.0.6/Native Method)
at
org.apache.commons.vfs2.impl.DefaultFileMonitor.run(DefaultFileMonitor.java:344)
at java.lang.Thread.run(java.base@17.0.6/Thread.java:833)
"Java2D Disposer" #20 daemon prio=10 os_prio=2 cpu=0.00ms elapsed=32773.08s
tid=0x000002e3b0408ca0 nid=0x5ab4 in Object.wait() [0x000000f73edfe000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:155)
- locked <0x00000000868af450> (a java.lang.ref.ReferenceQueue$Lock)
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:176)
at sun.java2d.Disposer.run(java.desktop@17.0.6/Disposer.java:145)
at java.lang.Thread.run(java.base@17.0.6/Thread.java:833)
"AWT-Windows" #22 daemon prio=6 os_prio=0 cpu=203.12ms elapsed=32773.07s
tid=0x000002e3a14e36f0 nid=0x37cc runnable [0x000000f73efff000]
java.lang.Thread.State: RUNNABLE
at sun.awt.windows.WToolkit.eventLoop(java.desktop@17.0.6/Native Method)
at sun.awt.windows.WToolkit.run(java.desktop@17.0.6/WToolkit.java:365)
at java.lang.Thread.run(java.base@17.0.6/Thread.java:833)
"Batik CleanerThread" #25 daemon prio=5 os_prio=0 cpu=0.00ms elapsed=32771.83s
tid=0x000002e3b02900f0 nid=0x4fdc in Object.wait() [0x000000f73eefe000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <0x000000008689b480> (a java.lang.ref.ReferenceQueue$Lock)
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:155)
- locked <0x000000008689b480> (a java.lang.ref.ReferenceQueue$Lock)
at
java.lang.ref.ReferenceQueue.remove(java.base@17.0.6/ReferenceQueue.java:176)
at org.apache.batik.util.CleanerThread.run(CleanerThread.java:106)
"HopGuiPipelineGraph: solr-docs" #30 prio=5 os_prio=0 cpu=734.38ms
elapsed=32640.52s tid=0x000002e3a6531080 nid=0x3e08 in Object.wait()
[0x000000f73eaff000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at java.util.TimerThread.mainLoop(java.base@17.0.6/Timer.java:563)
- locked <0x0000000088723b78> (a java.util.TaskQueue)
at java.util.TimerThread.run(java.base@17.0.6/Timer.java:516)
"log sniffer Timer" #31 prio=5 os_prio=0 cpu=750.00ms elapsed=32640.46s
tid=0x000002e3a65370c0 nid=0x3d68 in Object.wait() [0x000000f73f1ff000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at java.util.TimerThread.mainLoop(java.base@17.0.6/Timer.java:563)
- locked <0x0000000088929578> (a java.util.TaskQueue)
at java.util.TimerThread.run(java.base@17.0.6/Timer.java:516)
"HopGuiPipelineGraph: redraw timer" #125 prio=5 os_prio=0 cpu=31.25ms
elapsed=92.36s tid=0x000002e3a6534a40 nid=0x3dbc in Object.wait()
[0x000000f73f0ff000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at java.util.TimerThread.mainLoop(java.base@17.0.6/Timer.java:563)
- locked <0x000000008a200190> (a java.util.TaskQueue)
at java.util.TimerThread.run(java.base@17.0.6/Timer.java:516)
"Thread-74" #126 prio=5 os_prio=0 cpu=218.75ms elapsed=92.26s
tid=0x000002e3a6531a20 nid=0x561c waiting on condition [0x000000f73f3fe000]
java.lang.Thread.State: TIMED_WAITING (parking)
at jdk.internal.misc.Unsafe.park(java.base@17.0.6/Native Method)
- parking to wait for <0x000000008a201230> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at
java.util.concurrent.locks.LockSupport.parkNanos(java.base@17.0.6/LockSupport.java:252)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@17.0.6/AbstractQueuedSynchronizer.java:1672)
at
java.util.concurrent.ArrayBlockingQueue.poll(java.base@17.0.6/ArrayBlockingQueue.java:435)
at
org.apache.hop.pipeline.Pipeline.waitUntilFinished(Pipeline.java:1458)
at
org.apache.hop.pipeline.engines.local.LocalPipelineEngine.waitUntilFinished(LocalPipelineEngine.java:359)
at
org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.lambda$startThreads$18(HopGuiPipelineGraph.java:4558)
at
org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph$$Lambda$387/0x0000000801151aa0.run(Unknown
Source)
at java.lang.Thread.run(java.base@17.0.6/Thread.java:833)
"solr-docs - Script" #131 prio=5 os_prio=0 cpu=0.00ms elapsed=92.23s
tid=0x000002e3a6536720 nid=0x388c in Object.wait() [0x000000f73f8fe000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(java.base@17.0.6/Native Method)
- waiting on <no object reference available>
at java.lang.Object.wait(java.base@17.0.6/Object.java:338)
at org.eclipse.swt.widgets.Synchronizer.syncExec(Synchronizer.java:200)
- locked <0x000000008b57f8c0> (a org.eclipse.swt.widgets.RunnableLock)
at org.eclipse.swt.widgets.Display.syncExec(Display.java:4785)
at
org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.checkErrorVisuals(HopGuiPipelineGraph.java:4647)
at
org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.lambda$startThreads$17(HopGuiPipelineGraph.java:4546)
at
org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph$$Lambda$383/0x0000000801151220.finished(Unknown
Source)
at
org.apache.hop.pipeline.Pipeline.firePipelineExecutionFinishedListeners(Pipeline.java:1326)
- locked <0x000000008a245de8> (a
java.util.Collections$SynchronizedRandomAccessList)
at
org.apache.hop.pipeline.Pipeline.lambda$startThreads$0(Pipeline.java:1142)
- locked <0x000000008a2012a8> (a
org.apache.hop.pipeline.engines.local.LocalPipelineEngine)
at
org.apache.hop.pipeline.Pipeline$$Lambda$388/0x0000000801150800.transformFinished(Unknown
Source)
at
org.apache.hop.pipeline.transform.BaseTransform.fireTransformFinishedListeners(BaseTransform.java:2779)
- locked <0x000000008a23ae08> (a
java.util.Collections$SynchronizedRandomAccessList)
- locked <0x000000008a2372c8> (a
org.apache.hop.pipeline.transforms.script.Script)
at
org.apache.hop.pipeline.transform.BaseTransform.markStop(BaseTransform.java:2768)
- locked <0x000000008a2372c8> (a
org.apache.hop.pipeline.transforms.script.Script)
at org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:142)
at java.lang.Thread.run(java.base@17.0.6/Thread.java:833)
"VM Thread" os_prio=2 cpu=265.62ms elapsed=32809.92s tid=0x000002e39f9de190
nid=0x4c70 runnable
"GC Thread#0" os_prio=2 cpu=640.62ms elapsed=32809.94s tid=0x000002e381eb2350
nid=0x619c runnable
"GC Thread#1" os_prio=2 cpu=640.62ms elapsed=32808.25s tid=0x000002e3a0daf150
nid=0xf70 runnable
"GC Thread#2" os_prio=2 cpu=484.38ms elapsed=32808.24s tid=0x000002e3a0dd7940
nid=0x6b3c runnable
"GC Thread#3" os_prio=2 cpu=546.88ms elapsed=32807.30s tid=0x000002e3a139fca0
nid=0x544 runnable
"G1 Main Marker" os_prio=2 cpu=0.00ms elapsed=32809.94s tid=0x000002e381ec3290
nid=0x6790 runnable
"G1 Conc#0" os_prio=2 cpu=1187.50ms elapsed=32809.94s tid=0x000002e381ec4810
nid=0x11fc runnable
"G1 Refine#0" os_prio=2 cpu=46.88ms elapsed=32809.94s tid=0x000002e381f0e950
nid=0x5784 runnable
"G1 Refine#1" os_prio=2 cpu=31.25ms elapsed=32802.58s tid=0x000002e3a1b7a9d0
nid=0x40d0 runnable
"G1 Refine#2" os_prio=2 cpu=15.62ms elapsed=32802.58s tid=0x000002e3a1d947c0
nid=0x5c10 runnable
"G1 Refine#3" os_prio=2 cpu=0.00ms elapsed=32797.77s tid=0x000002e3a351daa0
nid=0x6168 runnable
"G1 Service" os_prio=2 cpu=656.25ms elapsed=32809.94s tid=0x000002e39f8924b0
nid=0x399c runnable
"VM Periodic Task Thread" os_prio=2 cpu=1984.38ms elapsed=32809.41s
tid=0x000002e381ed6a10 nid=0x5a14 waiting on condition
JNI global refs: 228, weak refs: 24
2023/05/20 23:32:57 - solr-docs - Execution started for pipeline [solr-docs]
2023/05/20 23:32:57 - Script.0 - ERROR: Error obtaining scripting engine for
language null
2023/05/20 23:32:57 - Script.0 - ERROR:
org.apache.hop.core.exception.HopException:
2023/05/20 23:32:57 - Script.0 - Unable to find script engine for language
'null'
2023/05/20 23:32:57 - Script.0 -
2023/05/20 23:32:57 - Script.0 - at
org.apache.hop.pipeline.transforms.script.ScriptUtils.createNewScriptEngineByLanguage(ScriptUtils.java:82)
2023/05/20 23:32:57 - Script.0 - at
org.apache.hop.pipeline.transforms.script.Script.init(Script.java:691)
2023/05/20 23:32:57 - Script.0 - at
org.apache.hop.pipeline.transform.TransformInitThread.run(TransformInitThread.java:66)
2023/05/20 23:32:57 - Script.0 - at
java.base/java.lang.Thread.run(Thread.java:833)
2023/05/20 23:32:57 - Generate rows.0 - Finished processing (I=0, O=0, R=0,
W=10, U=0, E=0)
java.lang.NullPointerException: Cannot invoke
"javax.script.ScriptEngine.getContext()" because "this.data.engine" is null
2023/05/20 23:32:57 - Fake data - products.0 - Finished processing (I=0, O=0,
R=10, W=10, U=0, E=0)
2023/05/20 23:32:57 - JSON output.0 - Finished processing (I=0, O=3, R=10, W=3,
U=0, E=0)
at
org.apache.hop.pipeline.transforms.script.Script.addValues(Script.java:191)
at
org.apache.hop.pipeline.transforms.script.Script.processRow(Script.java:638)
at org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:55)
at java.base/java.lang.Thread.run(Thread.java:833)
2023/05/20 23:32:57 - Script.0 - ERROR: Unexpected error
2023/05/20 23:32:57 - Script.0 - ERROR: java.lang.NullPointerException: Cannot
invoke "javax.script.ScriptEngine.getContext()" because "this.data.engine" is
null
2023/05/20 23:32:57 - Script.0 - at
org.apache.hop.pipeline.transforms.script.Script.addValues(Script.java:191)
2023/05/20 23:32:57 - Script.0 - at
org.apache.hop.pipeline.transforms.script.Script.processRow(Script.java:638)
2023/05/20 23:32:57 - Script.0 - at
org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:55)
2023/05/20 23:32:57 - Script.0 - at
java.base/java.lang.Thread.run(Thread.java:833)
2023/05/20 23:32:57 - Script.0 - Finished processing (I=0, O=0, R=0, W=0, U=0,
E=1)
2023/05/20 23:32:57 - solr-docs - Pipeline duration : 0.614 seconds [ 0.614" ]
