Joe,
Please find trace enclosed.
Martin wrote it works for him with 1.15.1 nar.
Regards,
Mike
-----Original Message-----
From: Bryan Bende <[email protected]>
Sent: Friday, January 21, 2022 3:29 PM
To: [email protected]
Subject: Re: nifi 15.3 - puthive3streaming
This is a known issue starting with the 1.15.0 release.
It was introduced by this change:
https://issues.apache.org/jira/browse/NIFI-9248
The JIRA to correct the problem is:
https://issues.apache.org/jira/browse/NIFI-9392
On Fri, Jan 21, 2022 at 9:17 AM Joe Witt <[email protected]> wrote:
>
> Hello
>
> We need to see the full stack trace. Most likely involves log4j
>
> Thanks
>
> On Fri, Jan 21, 2022 at 7:14 AM Hengesbach, Martin
> <[email protected]> wrote:
>>
>> Hi Mike,
>>
>>
>>
>> I have downloaded the compiled version of nifi-hive3-nar-1.15.3.nar and have
>> the same problem as you. In my NiFi 15.3 installation I have replaced the
>> nifi-hive3-nar-1.15.3.nar through the nifi-hive3-nar-1.15.1.nar and it
>> worked again. So it must be a problem with the 15.3 version and not a
>> compilation problem on your side.
>>
>>
>>
>> Kind regards
>>
>> Martin
>>
>>
>>
>> Von: Michal Tomaszewski [mailto:[email protected]]
>> Gesendet: Freitag, 21. Januar 2022 13:30
>> An: [email protected]
>> Betreff: nifi 15.3 - puthive3streaming
>>
>>
>>
>> Hi again,
>>
>>
>>
>> After compiling 15.3 with hive3 using options:
>>
>> mvn -T C2.0 clean install -DskipTests -Dhive.version=3.1.0
>> -Dhbase.version=2.0.2
>>
>>
>>
>> processor puthive3streaming is not working with error message:
>>
>> „java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost”
>>
>>
>>
>> Isn’t it related to this change:
>>
>> https://github.com/apache/nifi/commit/b7c81d6007852d933961d0067030bc807363e2ee
>>
>> ?
>>
>>
>>
>> What should we change to make puthive3streaming working?
>>
>>
>>
>> Regards,
>>
>> Mike
>>
>> ________________________________
>>
>> FIZ Karlsruhe - Leibniz-Institut für Informationsinfrastruktur GmbH.
>> Sitz der Gesellschaft: Eggenstein-Leopoldshafen, Amtsgericht Mannheim HRB
>> 101892.
>> Geschäftsführerin: Sabine Brünger-Weilandt.
>> Vorsitzender des Aufsichtsrats: MinR Dr. Hans-Josef Linkens.
>>
>> FIZ Karlsruhe ist zertifiziert mit dem Siegel "audit berufundfamilie".
2022-01-21 11:59:22,585 INFO [Heartbeat Monitor Thread-1]
o.a.n.c.c.h.AbstractHeartbeatMonitor Finished processing 3 heartbeats in 27500
nanos
2022-01-21 11:59:23,621 WARN [Timer-Driven Process Thread-6]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.hook.proto.base-directory does not exist
2022-01-21 11:59:23,621 WARN [Timer-Driven Process Thread-6]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.strict.managed.tables does not exist
2022-01-21 11:59:23,621 WARN [Timer-Driven Process Thread-6]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.stats.fetch.partition.stats does not exist
2022-01-21 11:59:23,621 WARN [Timer-Driven Process Thread-6]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name hive.heapsize does not
exist
2022-01-21 11:59:23,646 ERROR [Timer-Driven Process Thread-6]
o.a.n.processors.hive.PutHive3Streaming
PutHive3Streaming[id=fa6c395f-0164-1000-0000-00005f4bf9b4] Failed to properly
initialize Processor. If still scheduled to run, NiFi will attempt to
initialize and run the Processor again after the 'Administrative Yield
Duration' has elapsed. Failure is due to java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost: java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost
java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3354)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3403)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3371)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:477)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
at
org.apache.nifi.util.hive.HiveConfigurator.preload(HiveConfigurator.java:75)
at
org.apache.nifi.processors.hive.PutHive3Streaming.setup(PutHive3Streaming.java:372)
at sun.reflect.GeneratedMethodAccessor932.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:133)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:78)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:55)
at
org.apache.nifi.controller.StandardProcessorNode.lambda$initiateStart$6(StandardProcessorNode.java:1653)
at org.apache.nifi.engine.FlowEngine$3.call(FlowEngine.java:123)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022-01-21 11:59:24,104 WARN [Timer-Driven Process Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.hook.proto.base-directory does not exist
2022-01-21 11:59:24,104 WARN [Timer-Driven Process Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.strict.managed.tables does not exist
2022-01-21 11:59:24,104 WARN [Timer-Driven Process Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.stats.fetch.partition.stats does not exist
2022-01-21 11:59:24,104 WARN [Timer-Driven Process Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name hive.heapsize does not
exist
2022-01-21 11:59:24,127 ERROR [Timer-Driven Process Thread-3]
o.a.n.processors.hive.PutHive3Streaming
PutHive3Streaming[id=1a73ba2d-0170-1000-0000-0000604dc09b] Failed to properly
initialize Processor. If still scheduled to run, NiFi will attempt to
initialize and run the Processor again after the 'Administrative Yield
Duration' has elapsed. Failure is due to java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost: java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost
java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3354)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3403)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3371)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:477)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
at
org.apache.nifi.util.hive.HiveConfigurator.preload(HiveConfigurator.java:75)
at
org.apache.nifi.processors.hive.PutHive3Streaming.setup(PutHive3Streaming.java:372)
at sun.reflect.GeneratedMethodAccessor934.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:133)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:78)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:55)
at
org.apache.nifi.controller.StandardProcessorNode.lambda$initiateStart$6(StandardProcessorNode.java:1653)
at org.apache.nifi.engine.FlowEngine$3.call(FlowEngine.java:123)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022-01-21 11:59:24,599 INFO [Process Cluster Protocol Request-47]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
63ba305c-944f-49fa-a7c5-e0c60242e005 (type=HEARTBEAT, length=4179 bytes) from
dc1-hadoop-a3.local:8443 in 123 millis
2022-01-21 11:59:24,663 WARN [Timer-Driven Process Thread-7]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.hook.proto.base-directory does not exist
2022-01-21 11:59:24,663 WARN [Timer-Driven Process Thread-7]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.strict.managed.tables does not exist
2022-01-21 11:59:24,663 WARN [Timer-Driven Process Thread-7]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.stats.fetch.partition.stats does not exist
2022-01-21 11:59:24,663 WARN [Timer-Driven Process Thread-7]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name hive.heapsize does not
exist
2022-01-21 11:59:24,689 ERROR [Timer-Driven Process Thread-7]
o.a.n.processors.hive.PutHive3Streaming
PutHive3Streaming[id=f9bfa375-0164-1000-0000-000020c04c26] Failed to properly
initialize Processor. If still scheduled to run, NiFi will attempt to
initialize and run the Processor again after the 'Administrative Yield
Duration' has elapsed. Failure is due to java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost: java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost
java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3354)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3403)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3371)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:477)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
at
org.apache.nifi.util.hive.HiveConfigurator.preload(HiveConfigurator.java:75)
at
org.apache.nifi.processors.hive.PutHive3Streaming.setup(PutHive3Streaming.java:372)
at sun.reflect.GeneratedMethodAccessor938.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:133)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:78)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:55)
at
org.apache.nifi.controller.StandardProcessorNode.lambda$initiateStart$6(StandardProcessorNode.java:1653)
at org.apache.nifi.engine.FlowEngine$3.call(FlowEngine.java:123)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022-01-21 11:59:24,855 WARN [Timer-Driven Process Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.hook.proto.base-directory does not exist
2022-01-21 11:59:24,856 WARN [Timer-Driven Process Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.strict.managed.tables does not exist
2022-01-21 11:59:24,856 WARN [Timer-Driven Process Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.stats.fetch.partition.stats does not exist
2022-01-21 11:59:24,856 WARN [Timer-Driven Process Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name hive.heapsize does not
exist
2022-01-21 11:59:24,882 ERROR [Timer-Driven Process Thread-3]
o.a.n.processors.hive.PutHive3Streaming
PutHive3Streaming[id=325112be-0165-1000-0000-00002a76f8f1] Failed to properly
initialize Processor. If still scheduled to run, NiFi will attempt to
initialize and run the Processor again after the 'Administrative Yield
Duration' has elapsed. Failure is due to java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost: java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost
java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3354)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3403)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3371)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:477)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
at
org.apache.nifi.util.hive.HiveConfigurator.preload(HiveConfigurator.java:75)
at
org.apache.nifi.processors.hive.PutHive3Streaming.setup(PutHive3Streaming.java:372)
at sun.reflect.GeneratedMethodAccessor939.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:133)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:78)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:55)
at
org.apache.nifi.controller.StandardProcessorNode.lambda$initiateStart$6(StandardProcessorNode.java:1653)
at org.apache.nifi.engine.FlowEngine$3.call(FlowEngine.java:123)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022-01-21 11:59:24,905 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.hook.proto.base-directory does not exist
2022-01-21 11:59:24,905 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.strict.managed.tables does not exist
2022-01-21 11:59:24,905 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.stats.fetch.partition.stats does not exist
2022-01-21 11:59:24,905 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name hive.heapsize does not
exist
2022-01-21 11:59:24,990 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.hook.proto.base-directory does not exist
2022-01-21 11:59:24,990 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.strict.managed.tables does not exist
2022-01-21 11:59:24,990 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.stats.fetch.partition.stats does not exist
2022-01-21 11:59:24,990 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name hive.heapsize does not
exist
2022-01-21 11:59:25,072 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.hook.proto.base-directory does not exist
2022-01-21 11:59:25,072 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.strict.managed.tables does not exist
2022-01-21 11:59:25,072 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.stats.fetch.partition.stats does not exist
2022-01-21 11:59:25,072 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name hive.heapsize does not
exist
2022-01-21 11:59:25,161 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.hook.proto.base-directory does not exist
2022-01-21 11:59:25,161 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.strict.managed.tables does not exist
2022-01-21 11:59:25,161 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.stats.fetch.partition.stats does not exist
2022-01-21 11:59:25,161 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name hive.heapsize does not
exist
2022-01-21 11:59:25,588 INFO [Process Cluster Protocol Request-46]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
540f174d-b6bd-4b16-854c-769f66fd5951 (type=HEARTBEAT, length=4183 bytes) from
dc1-hadoop-a2.local:8443 in 114 millis
2022-01-21 11:59:26,383 INFO [Process Cluster Protocol Request-48]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
31407ca9-11db-4e4c-91a9-68608253cd46 (type=HEARTBEAT, length=4179 bytes) from
dc1-hadoop-a1.local:8443 in 157 millis
2022-01-21 11:59:26,386 INFO [Clustering Tasks Thread-1]
o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2022-01-21
11:59:26,222 and sent to dc1-hadoop-a1.local:10002 at 2022-01-21 11:59:26,386;
send took 163 millis
2022-01-21 11:59:26,631 INFO [pool-12-thread-1]
o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile
Repository
2022-01-21 11:59:26,632 INFO [pool-12-thread-1]
o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile
Repository with 0 records in 0 milliseconds
2022-01-21 11:59:27,585 INFO [Heartbeat Monitor Thread-1]
o.a.n.c.c.h.AbstractHeartbeatMonitor Finished processing 3 heartbeats in 24000
nanos
2022-01-21 11:59:29,720 INFO [Process Cluster Protocol Request-49]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
4369a66d-4cce-4ab7-b4e7-6b0e8fbdb675 (type=HEARTBEAT, length=4179 bytes) from
dc1-hadoop-a3.local:8443 in 112 millis
2022-01-21 11:59:30,707 INFO [Process Cluster Protocol Request-50]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
2f06f4c3-01fd-4c2f-a887-677a2eac36a2 (type=HEARTBEAT, length=4183 bytes) from
dc1-hadoop-a2.local:8443 in 109 millis
2022-01-21 11:59:31,555 INFO [Process Cluster Protocol Request-1]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
e2f2e395-5755-4120-930d-137621ab1cb0 (type=HEARTBEAT, length=4179 bytes) from
dc1-hadoop-a1.local:8443 in 162 millis
2022-01-21 11:59:31,558 INFO [Clustering Tasks Thread-1]
o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2022-01-21
11:59:31,386 and sent to dc1-hadoop-a1.local:10002 at 2022-01-21 11:59:31,558;
send took 171 millis
2022-01-21 11:59:32,586 INFO [Heartbeat Monitor Thread-1]
o.a.n.c.c.h.AbstractHeartbeatMonitor Finished processing 3 heartbeats in 25401
nanos
2022-01-21 11:59:34,836 INFO [Process Cluster Protocol Request-2]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
a2842828-2bfe-4ff8-b000-31a104df8c24 (type=HEARTBEAT, length=4179 bytes) from
dc1-hadoop-a3.local:8443 in 108 millis
2022-01-21 11:59:35,836 INFO [Process Cluster Protocol Request-4]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
2c58a3b8-5f4b-467d-b19d-e1de8e5a24bf (type=HEARTBEAT, length=4183 bytes) from
dc1-hadoop-a2.local:8443 in 119 millis
2022-01-21 11:59:36,187 ERROR [Timer-Driven Process Thread-4]
o.a.n.c.s.StandardControllerServiceNode
StandardControllerServiceNode[service=DistributedMapCacheServer[id=4eb98132-016a-1000-0000-000038f6de0f],
name=DistributedMapCacheServer, active=true] Failed to invoke @OnEnabled
method due to java.net.BindException: Address already in use: {}
java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:438)
at sun.nio.ch.Net.bind(Net.java:430)
at
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:225)
at
java.nio.channels.ServerSocketChannel.bind(ServerSocketChannel.java:157)
at
org.apache.nifi.distributed.cache.server.AbstractCacheServer.start(AbstractCacheServer.java:76)
at
org.apache.nifi.distributed.cache.server.DistributedCacheServer.startServer(DistributedCacheServer.java:98)
at sun.reflect.GeneratedMethodAccessor928.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:133)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:78)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:55)
at
org.apache.nifi.controller.service.StandardControllerServiceNode$2.run(StandardControllerServiceNode.java:549)
at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022-01-21 11:59:36,188 ERROR [Timer-Driven Process Thread-4]
o.a.n.c.s.StandardControllerServiceNode Failed to invoke @OnEnabled method of
DistributedMapCacheServer[id=4eb98132-016a-1000-0000-000038f6de0f] due to
java.net.BindException: Address already in use
2022-01-21 11:59:36,188 INFO [Timer-Driven Process Thread-4]
o.a.n.d.cache.server.AbstractCacheServer Stopping CacheServer
4eb98132-016a-1000-0000-000038f6de0f
2022-01-21 11:59:36,723 INFO [Process Cluster Protocol Request-3]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
ec0409c6-4ccf-4927-8e8a-1ea2553b624a (type=HEARTBEAT, length=4179 bytes) from
dc1-hadoop-a1.local:8443 in 161 millis
2022-01-21 11:59:36,726 INFO [Clustering Tasks Thread-1]
o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2022-01-21
11:59:36,558 and sent to dc1-hadoop-a1.local:10002 at 2022-01-21 11:59:36,726;
send took 167 millis
2022-01-21 11:59:37,586 INFO [Heartbeat Monitor Thread-1]
o.a.n.c.c.h.AbstractHeartbeatMonitor Finished processing 3 heartbeats in 24900
nanos
2022-01-21 11:59:39,956 INFO [Process Cluster Protocol Request-7]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
1bfef377-875c-4d73-a5e0-d0f685a0dd43 (type=HEARTBEAT, length=4179 bytes) from
dc1-hadoop-a3.local:8443 in 111 millis
2022-01-21 11:59:40,955 INFO [Process Cluster Protocol Request-6]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
c6e4c147-0a8d-413b-b823-241f4b60e380 (type=HEARTBEAT, length=4183 bytes) from
dc1-hadoop-a2.local:8443 in 109 millis
2022-01-21 11:59:41,887 INFO [Process Cluster Protocol Request-5]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
bb9e154d-2ced-4a6d-9037-96e5236e6de7 (type=HEARTBEAT, length=4179 bytes) from
dc1-hadoop-a1.local:8443 in 158 millis
2022-01-21 11:59:41,889 INFO [Clustering Tasks Thread-1]
o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2022-01-21
11:59:41,726 and sent to dc1-hadoop-a1.local:10002 at 2022-01-21 11:59:41,889;
send took 163 millis
2022-01-21 11:59:42,586 INFO [Heartbeat Monitor Thread-1]
o.a.n.c.c.h.AbstractHeartbeatMonitor Finished processing 3 heartbeats in 22800
nanos
2022-01-21 11:59:45,076 INFO [Process Cluster Protocol Request-8]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
a2c7ae7c-9261-477e-a085-16f27a79f7c8 (type=HEARTBEAT, length=4179 bytes) from
dc1-hadoop-a3.local:8443 in 112 millis
2022-01-21 11:59:46,077 INFO [Process Cluster Protocol Request-9]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
fd509de6-758c-4cb9-867a-27eca7f21731 (type=HEARTBEAT, length=4183 bytes) from
dc1-hadoop-a2.local:8443 in 113 millis
2022-01-21 11:59:46,632 INFO [pool-12-thread-1]
o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile
Repository
2022-01-21 11:59:46,632 INFO [pool-12-thread-1]
o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile
Repository with 0 records in 0 milliseconds
2022-01-21 11:59:47,059 INFO [Process Cluster Protocol Request-10]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
0cc8474c-22db-4aaf-8208-e550f040fec4 (type=HEARTBEAT, length=4179 bytes) from
dc1-hadoop-a1.local:8443 in 165 millis
2022-01-21 11:59:47,062 INFO [Clustering Tasks Thread-1]
o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2022-01-21
11:59:46,890 and sent to dc1-hadoop-a1.local:10002 at 2022-01-21 11:59:47,062;
send took 171 millis
2022-01-21 11:59:47,587 INFO [Heartbeat Monitor Thread-1]
o.a.n.c.c.h.AbstractHeartbeatMonitor Finished processing 3 heartbeats in 25800
nanos
2022-01-21 11:59:50,201 INFO [Process Cluster Protocol Request-11]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
7e195023-bab8-4108-955b-17db0d1ba59a (type=HEARTBEAT, length=4179 bytes) from
dc1-hadoop-a3.local:8443 in 116 millis
2022-01-21 11:59:51,200 INFO [Process Cluster Protocol Request-12]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
5350adda-5400-46a6-8c0e-f335d2d5e61b (type=HEARTBEAT, length=4183 bytes) from
dc1-hadoop-a2.local:8443 in 111 millis
2022-01-21 11:59:52,223 INFO [Process Cluster Protocol Request-13]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
9be44d74-f422-4dc5-91d1-4b15f17fc40a (type=HEARTBEAT, length=4179 bytes) from
dc1-hadoop-a1.local:8443 in 157 millis
2022-01-21 11:59:52,226 INFO [Clustering Tasks Thread-1]
o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2022-01-21
11:59:52,062 and sent to dc1-hadoop-a1.local:10002 at 2022-01-21 11:59:52,226;
send took 163 millis
2022-01-21 11:59:52,587 INFO [Heartbeat Monitor Thread-1]
o.a.n.c.c.h.AbstractHeartbeatMonitor Finished processing 3 heartbeats in 39201
nanos
2022-01-21 11:59:53,711 WARN [Timer-Driven Process Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.hook.proto.base-directory does not exist
2022-01-21 11:59:53,711 WARN [Timer-Driven Process Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.strict.managed.tables does not exist
2022-01-21 11:59:53,711 WARN [Timer-Driven Process Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.stats.fetch.partition.stats does not exist
2022-01-21 11:59:53,711 WARN [Timer-Driven Process Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name hive.heapsize does not
exist
2022-01-21 11:59:53,737 ERROR [Timer-Driven Process Thread-3]
o.a.n.processors.hive.PutHive3Streaming
PutHive3Streaming[id=fa6c395f-0164-1000-0000-00005f4bf9b4] Failed to properly
initialize Processor. If still scheduled to run, NiFi will attempt to
initialize and run the Processor again after the 'Administrative Yield
Duration' has elapsed. Failure is due to java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost: java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost
java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3354)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3403)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3371)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:477)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
at
org.apache.nifi.util.hive.HiveConfigurator.preload(HiveConfigurator.java:75)
at
org.apache.nifi.processors.hive.PutHive3Streaming.setup(PutHive3Streaming.java:372)
at sun.reflect.GeneratedMethodAccessor932.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:133)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:78)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:55)
at
org.apache.nifi.controller.StandardProcessorNode.lambda$initiateStart$6(StandardProcessorNode.java:1653)
at org.apache.nifi.engine.FlowEngine$3.call(FlowEngine.java:123)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022-01-21 11:59:54,197 WARN [Timer-Driven Process Thread-7]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.hook.proto.base-directory does not exist
2022-01-21 11:59:54,197 WARN [Timer-Driven Process Thread-7]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.strict.managed.tables does not exist
2022-01-21 11:59:54,197 WARN [Timer-Driven Process Thread-7]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.stats.fetch.partition.stats does not exist
2022-01-21 11:59:54,197 WARN [Timer-Driven Process Thread-7]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name hive.heapsize does not
exist
2022-01-21 11:59:54,223 ERROR [Timer-Driven Process Thread-7]
o.a.n.processors.hive.PutHive3Streaming
PutHive3Streaming[id=1a73ba2d-0170-1000-0000-0000604dc09b] Failed to properly
initialize Processor. If still scheduled to run, NiFi will attempt to
initialize and run the Processor again after the 'Administrative Yield
Duration' has elapsed. Failure is due to java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost: java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost
java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3354)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3403)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3371)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:477)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
at
org.apache.nifi.util.hive.HiveConfigurator.preload(HiveConfigurator.java:75)
at
org.apache.nifi.processors.hive.PutHive3Streaming.setup(PutHive3Streaming.java:372)
at sun.reflect.GeneratedMethodAccessor934.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:133)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:78)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:55)
at
org.apache.nifi.controller.StandardProcessorNode.lambda$initiateStart$6(StandardProcessorNode.java:1653)
at org.apache.nifi.engine.FlowEngine$3.call(FlowEngine.java:123)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022-01-21 11:59:54,756 WARN [Timer-Driven Process Thread-6]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.hook.proto.base-directory does not exist
2022-01-21 11:59:54,757 WARN [Timer-Driven Process Thread-6]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.strict.managed.tables does not exist
2022-01-21 11:59:54,757 WARN [Timer-Driven Process Thread-6]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.stats.fetch.partition.stats does not exist
2022-01-21 11:59:54,757 WARN [Timer-Driven Process Thread-6]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name hive.heapsize does not
exist
2022-01-21 11:59:54,780 ERROR [Timer-Driven Process Thread-6]
o.a.n.processors.hive.PutHive3Streaming
PutHive3Streaming[id=f9bfa375-0164-1000-0000-000020c04c26] Failed to properly
initialize Processor. If still scheduled to run, NiFi will attempt to
initialize and run the Processor again after the 'Administrative Yield
Duration' has elapsed. Failure is due to java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost: java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost
java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3354)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3403)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3371)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:477)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
at
org.apache.nifi.util.hive.HiveConfigurator.preload(HiveConfigurator.java:75)
at
org.apache.nifi.processors.hive.PutHive3Streaming.setup(PutHive3Streaming.java:372)
at sun.reflect.GeneratedMethodAccessor938.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:133)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:78)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:55)
at
org.apache.nifi.controller.StandardProcessorNode.lambda$initiateStart$6(StandardProcessorNode.java:1653)
at org.apache.nifi.engine.FlowEngine$3.call(FlowEngine.java:123)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022-01-21 11:59:54,943 WARN [Timer-Driven Process Thread-7]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.hook.proto.base-directory does not exist
2022-01-21 11:59:54,943 WARN [Timer-Driven Process Thread-7]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.strict.managed.tables does not exist
2022-01-21 11:59:54,943 WARN [Timer-Driven Process Thread-7]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.stats.fetch.partition.stats does not exist
2022-01-21 11:59:54,943 WARN [Timer-Driven Process Thread-7]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name hive.heapsize does not
exist
2022-01-21 11:59:54,964 ERROR [Timer-Driven Process Thread-7]
o.a.n.processors.hive.PutHive3Streaming
PutHive3Streaming[id=325112be-0165-1000-0000-00002a76f8f1] Failed to properly
initialize Processor. If still scheduled to run, NiFi will attempt to
initialize and run the Processor again after the 'Administrative Yield
Duration' has elapsed. Failure is due to java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost: java.lang.NoClassDefFoundError:
org/apache/hadoop/tracing/SpanReceiverHost
java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3354)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3403)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3371)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:477)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
at
org.apache.nifi.util.hive.HiveConfigurator.preload(HiveConfigurator.java:75)
at
org.apache.nifi.processors.hive.PutHive3Streaming.setup(PutHive3Streaming.java:372)
at sun.reflect.GeneratedMethodAccessor939.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:133)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:78)
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:55)
at
org.apache.nifi.controller.StandardProcessorNode.lambda$initiateStart$6(StandardProcessorNode.java:1653)
at org.apache.nifi.engine.FlowEngine$3.call(FlowEngine.java:123)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022-01-21 11:59:55,311 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.hook.proto.base-directory does not exist
2022-01-21 11:59:55,311 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.strict.managed.tables does not exist
2022-01-21 11:59:55,311 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name
hive.stats.fetch.partition.stats does not exist
2022-01-21 11:59:55,312 WARN [Validate Components Thread-3]
org.apache.hadoop.hive.conf.HiveConf HiveConf of name hive.heapsize does not
exist
2022-01-21 11:59:55,325 INFO [Process Cluster Protocol Request-14]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
725b8af7-eeb6-4d40-8e9f-094b6f5192a5 (type=HEARTBEAT, length=4179 bytes) from
dc1-hadoop-a3.local:8443 in 116 millis
