Hey Andrew, I just wanted to check and see if you were able to come up with anything else for me on this matter?
Thanks, Aaron Smith Global Solutions Engineer EG WW HQ Presales [email protected]<mailto:[email protected]> T +1 832 502 8829 Houston, Texas USA [http://graphics8.nytimes.com/images/2015/06/03/technology/03bits-hp/03bits-hp-master315.png] From: Andrew Psaltis [mailto:[email protected]] Sent: Tuesday, August 9, 2016 12:46 PM To: [email protected] Subject: Re: putazureeventhub error Aaron, Sorry about that -- the notion of using the IP address was certainly an error between my seat and keyboard. I will try and get things going with the 0.7.0 release and see if I can reproduce the error. Thanks, Andrew On Tue, Aug 9, 2016 at 12:04 PM, Smith, Aaron <[email protected]<mailto:[email protected]>> wrote: I have not, where would I actually put that IP? From my understanding of the processor, its stringing together the information I gave it for the location of the event hub, to get the URL that its sending information to. Thanks, Aaron Smith Global Solutions Engineer EG WW HQ Presales [email protected]<mailto:[email protected]> T +1 832 502 8829<tel:%2B1%20832%20502%208829> Houston, Texas USA [http://graphics8.nytimes.com/images/2015/06/03/technology/03bits-hp/03bits-hp-master315.png] From: Andrew Psaltis [mailto:[email protected]<mailto:[email protected]>] Sent: Tuesday, August 9, 2016 10:54 AM To: [email protected]<mailto:[email protected]> Subject: Re: putazureeventhub error Aaron, It seems like that may be coming from this line: https://github.com/apache/nifi/blob/rel/nifi-0.7.0/nifi-nar-bundles/nifi-azure-bundle/nifi-azure-processors/src/main/java/org/apache/nifi/processors/azure/eventhub/PutAzureEventHub.java#L137 Have tried using the public IP address? FYI -- the 0.7.0 code uses an old Azure client and in 1.0.0 the new and recommended client is used. Not that I am indicating this one won't work, just point it out. I need to step away, but can try and looking into it closer when I return. Thanks, Andrew On Tue, Aug 9, 2016 at 11:34 AM, Smith, Aaron <[email protected]<mailto:[email protected]>> wrote: Hi Andrew, I was able to resolve it from the machine NiFi is running on, by adding the name server. Now my error looks like: 2016-08-09 10:29:26,981 ERROR [StandardProcessScheduler Thread-1] o.a.n.p.azure.eventhub.PutAzureEventHub PutAzureEventHub[id=e6a62157-b3f8-4de0-921f-0a5e1b7678d6] PutAzureEventHub[id=e6a62157-b3f8-4de0-921f-0a5e1b7678d6] failed to invoke @OnScheduled method due to java.lang.RuntimeException: Timed out while executing one of processor's OnScheduled task.; processor will not be scheduled to run for 30000 milliseconds: java.lang.RuntimeException: Timed out while executing one of processor's OnScheduled task. 2016-08-09 10:29:26,982 ERROR [StandardProcessScheduler Thread-1] o.a.n.p.azure.eventhub.PutAzureEventHub java.lang.RuntimeException: Timed out while executing one of processor's OnScheduled task. at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1390) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode.access$100(StandardProcessorNode.java:90) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode$1.run(StandardProcessorNode.java:1230) ~[na:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_91] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_91] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_91] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91] 8.0_91] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_91] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91] Caused by: java.util.concurrent.TimeoutException: null at java.util.concurrent.FutureTask.get(FutureTask.java:205) [na:1.8.0_91] at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1375) ~[na:na] ... 9 common frames omitted 2016-08-09 10:29:26,983 ERROR [StandardProcessScheduler Thread-1] o.a.n.controller.StandardProcessorNode Failed to invoke @OnScheduled method due to java.lang.RuntimeException: Timed out while executing one of processor's OnScheduled task. java.lang.RuntimeException: Timed out while executing one of processor's OnScheduled task. at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1390) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode.access$100(StandardProcessorNode.java:90) ~[na:na] From: Oxenberg, Jeff Sent: Tuesday, August 09, 2016 10:27 AM To: Smith, Aaron <[email protected]<mailto:[email protected]>> Subject: 2016-08-09 10:00:10,143 ERROR [StandardProcessScheduler Thread-7] o.a.n.p.azure.eventhub.PutAzureEventHub PutAzureEventHub[id=e6a62157-b3f8-4de0-921f-0a5e1b7678d6] PutAzureEventHub[id=e6a62157-b3f8-4de0-921f-0a5e1b7678d6] failed to invoke @OnScheduled method due to java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.; processor will not be scheduled to run for 30000 milliseconds: java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task. 2016-08-09 10:00:10,147 ERROR [StandardProcessScheduler Thread-3] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[na:1.8.0_91] at java.util.concurrent.FutureTask.get(FutureTask.java:192) ~[na:1.8.0_91] at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100) ~[na:na] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1150) [na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91] Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.GeneratedMethodAccessor404.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_91] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_91] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:137) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:125) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:70) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1234) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1230) ~[na:na] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_91] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_91] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91] ... 2 common frames omitted Caused by: com.microsoft.eventhubs.client.EventHubException: org.apache.qpid.amqp_1_0.client.ConnectionException: java.net.UnknownHostException: iot-cloud-ns.servicebus.windows.net<http://iot-cloud-ns.servicebus.windows.net> at com.microsoft.eventhubs.client.EventHubClient.createConnection(EventHubClient.java:99) ~[na:na] at com.microsoft.eventhubs.client.EventHubClient.<init>(EventHubClient.java:36) ~[na:na] at com.microsoft.eventhubs.client.EventHubClient.create(EventHubClient.java:60) ~[na:na] at org.apache.nifi.processors.azure.eventhub.PutAzureEventHub.setupClient(PutAzureEventHub.java:137) ~[na:na] ... 14 common frames omitted Caused by: org.apache.qpid.amqp_1_0.client.ConnectionException: java.net.UnknownHostException: iot-cloud-ns.servicebus.windows.net<http://iot-cloud-ns.servicebus.windows.net> at org.apache.qpid.amqp_1_0.client.TCPTransportProvider.connect(TCPTransportProvider.java:203) ~[na:na] at org.apache.qpid.amqp_1_0.client.Connection.<init>(Connection.java:278) ~[na:na] at org.apache.qpid.amqp_1_0.client.Connection.<init>(Connection.java:182) ~[na:na] at org.apache.qpid.amqp_1_0.client.Connection.<init>(Connection.java:125) ~[na:na] at com.microsoft.eventhubs.client.EventHubClient.createConnection(EventHubClient.java:91) ~[na:na] ... 17 common frames omitted Caused by: java.net.UnknownHostException: iot-cloud-ns.servicebus.windows.net<http://iot-cloud-ns.servicebus.windows.net> at java.net<http://java.net>.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184) ~[na:1.8.0_91] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[na:1.8.0_91] at java.net.Socket.connect(Socket.java:589) ~[na:1.8.0_91] at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:668) ~[na:1.8.0_91] at sun.security.ssl.SSLSocketImpl.<init>(SSLSocketImpl.java:427) ~[na:1.8.0_91] at sun.security.ssl.SSLSocketFactoryImpl.createSocket(SSLSocketFactoryImpl.java:88) ~[na:1.8.0_91] at org.apache.qpid.amqp_1_0.client.TCPTransportProvider.connect(TCPTransportProvider.java:81) ~[na:na] ... 21 common frames omitted 2016-08-09 10:00:10,147 ERROR [StandardProcessScheduler Thread-7] o.a.n.p.azure.eventhub.PutAzureEventHub java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task. at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1392) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode.access$100(StandardProcessorNode.java:90) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode$1.run(StandardProcessorNode.java:1230) ~[na:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_91] nslookup iot-cloud-ns.servicebus.windows.net<http://iot-cloud-ns.servicebus.windows.net> Server: 10.82.0.1 Address: 10.82.0.1#53 Non-authoritative answer: iot-cloud-ns.servicebus.windows.net<http://iot-cloud-ns.servicebus.windows.net> canonical name = ns-sb2-prod-dm2-011.cloudapp.net<http://ns-sb2-prod-dm2-011.cloudapp.net>. Name: ns-sb2-prod-dm2-011.cloudapp.net<http://ns-sb2-prod-dm2-011.cloudapp.net> Address: 40.86.102.100 Thanks, Aaron Smith Global Solutions Engineer EG WW HQ Presales [email protected]<mailto:[email protected]> T +1 832 502 8829<tel:%2B1%20832%20502%208829> Houston, Texas USA [http://graphics8.nytimes.com/images/2015/06/03/technology/03bits-hp/03bits-hp-master315.png] From: Andrew Psaltis [mailto:[email protected]<mailto:[email protected]>] Sent: Tuesday, August 9, 2016 10:30 AM To: [email protected]<mailto:[email protected]> Subject: Re: putazureeventhub error Aaron, It looks like the source of the error is this line: "org.apache.qpid.amqp_1_0.client.ConnectionException: java.net.UnknownHostException: iot-cloud-ns.servicebus.windows.net<http://iot-cloud-ns.servicebus.windows.net>" Are you able to resolve that DNS name from the machine you are running NiFi on? If not you can also try the public IP address. Thanks, Andrew On Tue, Aug 9, 2016 at 11:27 AM, Smith, Aaron <[email protected]<mailto:[email protected]>> wrote: Hi Mark, Here is what was in the log: 2016-08-09 10:00:10,143 ERROR [StandardProcessScheduler Thread-7] o.a.n.p.azure.eventhub.PutAzureEventHub PutAzureEventHub[id=e6a62157-b3f8-4de0-921f-0a5e1b7678d6] PutAzureEventHub[id=e6a62157-b3f8-4de0-921f-0a5e1b7678d6] failed to invoke @OnScheduled method due to java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.; processor will not be scheduled to run for 30000 milliseconds: java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task. 2016-08-09 10:00:10,147 ERROR [StandardProcessScheduler Thread-3] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[na:1.8.0_91] at java.util.concurrent.FutureTask.get(FutureTask.java:192) ~[na:1.8.0_91] at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100) ~[na:na] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1150) [na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91] Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.GeneratedMethodAccessor404.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_91] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_91] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:137) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:125) ~[na:na] at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:70) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1234) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1230) ~[na:na] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_91] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_91] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91] ... 2 common frames omitted Caused by: com.microsoft.eventhubs.client.EventHubException: org.apache.qpid.amqp_1_0.client.ConnectionException: java.net.UnknownHostException: iot-cloud-ns.servicebus.windows.net<http://iot-cloud-ns.servicebus.windows.net> at com.microsoft.eventhubs.client.EventHubClient.createConnection(EventHubClient.java:99) ~[na:na] at com.microsoft.eventhubs.client.EventHubClient.<init>(EventHubClient.java:36) ~[na:na] at com.microsoft.eventhubs.client.EventHubClient.create(EventHubClient.java:60) ~[na:na] at org.apache.nifi.processors.azure.eventhub.PutAzureEventHub.setupClient(PutAzureEventHub.java:137) ~[na:na] ... 14 common frames omitted Caused by: org.apache.qpid.amqp_1_0.client.ConnectionException: java.net.UnknownHostException: iot-cloud-ns.servicebus.windows.net<http://iot-cloud-ns.servicebus.windows.net> at org.apache.qpid.amqp_1_0.client.TCPTransportProvider.connect(TCPTransportProvider.java:203) ~[na:na] at org.apache.qpid.amqp_1_0.client.Connection.<init>(Connection.java:278) ~[na:na] at org.apache.qpid.amqp_1_0.client.Connection.<init>(Connection.java:182) ~[na:na] at org.apache.qpid.amqp_1_0.client.Connection.<init>(Connection.java:125) ~[na:na] at com.microsoft.eventhubs.client.EventHubClient.createConnection(EventHubClient.java:91) ~[na:na] ... 17 common frames omitted Caused by: java.net.UnknownHostException: iot-cloud-ns.servicebus.windows.net<http://iot-cloud-ns.servicebus.windows.net> at java.net<http://java.net>.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184) ~[na:1.8.0_91] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[na:1.8.0_91] at java.net.Socket.connect(Socket.java:589) ~[na:1.8.0_91] at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:668) ~[na:1.8.0_91] at sun.security.ssl.SSLSocketImpl.<init>(SSLSocketImpl.java:427) ~[na:1.8.0_91] at sun.security.ssl.SSLSocketFactoryImpl.createSocket(SSLSocketFactoryImpl.java:88) ~[na:1.8.0_91] at org.apache.qpid.amqp_1_0.client.TCPTransportProvider.connect(TCPTransportProvider.java:81) ~[na:na] ... 21 common frames omitted 2016-08-09 10:00:10,147 ERROR [StandardProcessScheduler Thread-7] o.a.n.p.azure.eventhub.PutAzureEventHub java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task. at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1392) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode.access$100(StandardProcessorNode.java:90) ~[na:na] at org.apache.nifi.controller.StandardProcessorNode$1.run(StandardProcessorNode.java:1230) ~[na:na] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_91] nslookup iot-cloud-ns.servicebus.windows.net<http://iot-cloud-ns.servicebus.windows.net> Server: 10.82.0.1 Address: 10.82.0.1#53 Non-authoritative answer: iot-cloud-ns.servicebus.windows.net<http://iot-cloud-ns.servicebus.windows.net> canonical name = ns-sb2-prod-dm2-011.cloudapp.net<http://ns-sb2-prod-dm2-011.cloudapp.net>. Name: ns-sb2-prod-dm2-011.cloudapp.net<http://ns-sb2-prod-dm2-011.cloudapp.net> Address: 40.86.102.100 Thanks, Aaron Smith Global Solutions Engineer EG WW HQ Presales [email protected]<mailto:[email protected]> T +1 832 502 8829<tel:%2B1%20832%20502%208829> Houston, Texas USA [http://graphics8.nytimes.com/images/2015/06/03/technology/03bits-hp/03bits-hp-master315.png] From: Mark Payne [mailto:[email protected]<mailto:[email protected]>] Sent: Tuesday, August 9, 2016 10:05 AM To: [email protected]<mailto:[email protected]> Subject: Re: putazureeventhub error Hi Aaron, Can you check the logs to see if there is any more information? Thanks -Mark On Aug 9, 2016, at 10:58 AM, Smith, Aaron <[email protected]<mailto:[email protected]>> wrote: I am trying to use the put azure event hub processor in nifi .7 and am getting the below error: PutAzureEventHub[id=e6a62157-b3f8-4de0-921f-0a5e1b7678d6] PutAzureEventHub[id=e6a62157-b3f8-4de0-921f-0a5e1b7678d6] failed to invoke @OnScheduled method due to java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task.; processor will not be scheduled to run for 30000 milliseconds: java.lang.RuntimeException: Failed while executing one of processor's OnScheduled task. Please let me know if anyone has encountered this error and how you fixed it. Thanks, Aaron Smith Global Solutions Engineer EG WW HQ Presales [email protected]<mailto:[email protected]> T +1 832 502 8829<tel:%2B1%20832%20502%208829> Houston, Texas USA <image001.png> -- Thanks, Andrew Subscribe to my book: Streaming Data<http://manning.com/psaltis> twiiter: @itmdata<https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> -- <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> Thanks,<https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> Andrew<https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> <https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> Subscribe to my book: Streaming Data<https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> [https://static.licdn.com/scds/common/u/img/webpromo/btn_viewmy_160x25.png]<https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata<https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> -- Thanks, Andrew Subscribe to my book: Streaming Data<http://manning.com/psaltis> [https://static.licdn.com/scds/common/u/img/webpromo/btn_viewmy_160x25.png]<https://www.linkedin.com/pub/andrew-psaltis/1/17b/306> twiiter: @itmdata<http://twitter.com/intent/user?screen_name=itmdata>
