[
https://issues.apache.org/jira/browse/METRON-527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15622981#comment-15622981
]
ASF GitHub Bot commented on METRON-527:
---------------------------------------
GitHub user justinleet opened a pull request:
https://github.com/apache/incubator-metron/pull/332
METRON-527: Connection pool shut down seen when running threatintel_t…
…axii_load.sh script
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/justinleet/incubator-metron METRON-527
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-metron/pull/332.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #332
----
commit ba69ceb124003b6a0d4dc4b404b4f9da48ebf52c
Author: justinjleet <[email protected]>
Date: 2016-10-31T16:47:09Z
METRON-527: Connection pool shut down seen when running
threatintel_taxii_load.sh script
----
> Connection pool shut down seen when running threatintel_taxii_load.sh script
> ----------------------------------------------------------------------------
>
> Key: METRON-527
> URL: https://issues.apache.org/jira/browse/METRON-527
> Project: Metron
> Issue Type: Bug
> Reporter: Justin Leet
> Assignee: Justin Leet
>
> Discovered by [~anandsubbu]:
> I have setup opentaxii server on a 12-node metron cluster. I was able to scan
> and pull records into the taxi server.
> {code}
> [root@metron-test2-8 ~]# service opentaxii status
> Checking opentaxii... Running
> guest.phishtank_com 5891
> guest.Abuse_ch 49
> guest.CyberCrime_Tracker 0
> guest.EmergingThreats_rules 0
> guest.Lehigh_edu 2025
> guest.MalwareDomainList_Hostlist 50
> guest.blutmagie_de_torExits 14897
> guest.dataForLast_7daysOnly 23210
> guest.dshield_BlockList 0
> {code}
> When I ran the threatintel_taxii_load.sh script, it is able to push some of
> the records into hbase 'threatintel' table, but fails with a "Connection pool
> shut down" error shortly after. This was observed for all the subscriptions
> that I attempted.
> Here is the command that was used:
> {code}
> [root@metron-test2-8 ~]# /usr/metron/0.2.0BETA/bin//threatintel_taxii_load.sh
> -b "2015-01-01 00:00:00" -c ~/connection_config.json -e ~/extractor.json -p
> 300000
> {code}
> The error message is pasted below.
> {code}
> 16/08/30 09:24:14 ERROR taxii.TaxiiHandler: Connection pool shut down
> java.lang.IllegalStateException: Connection pool shut down
> at
> org.apache.metron.httpcore.dataload.util.Asserts.check(Asserts.java:34)
> at
> org.apache.metron.httpcore.dataload.pool.AbstractConnPool.lease(AbstractConnPool.java:169)
> at
> org.apache.metron.httpcore.dataload.impl.conn.PoolingHttpClientConnectionManager.requestConnection(PoolingHttpClientConnectionManager.java:217)
> at
> org.apache.metron.httpcore.dataload.impl.execchain.MainClientExec.execute(MainClientExec.java:158)
> at
> org.apache.metron.httpcore.dataload.impl.execchain.ProtocolExec.execute(ProtocolExec.java:195)
> at
> org.apache.metron.httpcore.dataload.impl.execchain.RetryExec.execute(RetryExec.java:85)
> at
> org.apache.metron.httpcore.dataload.impl.execchain.RedirectExec.execute(RedirectExec.java:108)
> at
> org.apache.metron.httpcore.dataload.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:186)
> at
> org.apache.metron.httpcore.dataload.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
> at
> org.mitre.taxii.client.HttpClient.callTaxiiService(HttpClient.java:297)
> at
> org.apache.metron.dataloads.nonbulk.taxii.TaxiiHandler.call(TaxiiHandler.java:336)
> at
> org.apache.metron.dataloads.nonbulk.taxii.TaxiiHandler.call(TaxiiHandler.java:242)
> at
> org.apache.metron.dataloads.nonbulk.taxii.TaxiiHandler.run(TaxiiHandler.java:171)
> at java.util.TimerThread.mainLoop(Timer.java:555)
> at java.util.TimerThread.run(Timer.java:505)
> Exception in thread "Timer-0" java.lang.RuntimeException: Unable to make
> request
> at
> org.apache.metron.dataloads.nonbulk.taxii.TaxiiHandler.run(TaxiiHandler.java:214)
> at java.util.TimerThread.mainLoop(Timer.java:555)
> at java.util.TimerThread.run(Timer.java:505)
> Caused by: java.lang.IllegalStateException: Connection pool shut down
> at
> org.apache.metron.httpcore.dataload.util.Asserts.check(Asserts.java:34)
> at
> org.apache.metron.httpcore.dataload.pool.AbstractConnPool.lease(AbstractConnPool.java:169)
> at
> org.apache.metron.httpcore.dataload.impl.conn.PoolingHttpClientConnectionManager.requestConnection(PoolingHttpClientConnectionManager.java:217)
> at
> org.apache.metron.httpcore.dataload.impl.execchain.MainClientExec.execute(MainClientExec.java:158)
> at
> org.apache.metron.httpcore.dataload.impl.execchain.ProtocolExec.execute(ProtocolExec.java:195)
> at
> org.apache.metron.httpcore.dataload.impl.execchain.RetryExec.execute(RetryExec.java:85)
> at
> org.apache.metron.httpcore.dataload.impl.execchain.RedirectExec.execute(RedirectExec.java:108)
> at
> org.apache.metron.httpcore.dataload.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:186)
> at
> org.apache.metron.httpcore.dataload.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
> at
> org.mitre.taxii.client.HttpClient.callTaxiiService(HttpClient.java:297)
> at
> org.apache.metron.dataloads.nonbulk.taxii.TaxiiHandler.call(TaxiiHandler.java:336)
> at
> org.apache.metron.dataloads.nonbulk.taxii.TaxiiHandler.call(TaxiiHandler.java:242)
> at
> org.apache.metron.dataloads.nonbulk.taxii.TaxiiHandler.run(TaxiiHandler.java:171)
> ... 2 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
