Hi, As you've already pointed out, the test setup script is trying to access http://opennlp.sourceforge.net/models-1.5/en-ner-person.bin and failing because of lack of connection. Maybe the README can also list 'access to opennlp.sourceforge.net' as a requirement to inform the users who use proxies.
If we could build a small model (and I mean really small) and package it with Tika, we wouldn't have to worry about http connectivity outside of the usual maven stuff. I think this is a neat solution. However, for this we need to push the model binaries to source control. Instead, if we can package OpenNLP ( english) models as a maven artifact and deploy to the central repo, it will make the OpenNLP usage easy. Tika is using this for NamedEntityParser and its tests. Which is better? 1. List 'access to opennlp.sourceforge.net' as a requirement 2. Package and deploy models as a maven artifact Regards, TG -- *Thamme Gowda N. <http://www-scf.usc.edu/~tnarayan/>* Grad Student @USC <http://usc.edu> | Co-Founder @Datoin.com |Twitter: @thammegowda <http://twitter.com/thammegowda> On Mon, Nov 23, 2015 at 8:10 AM, Mattmann, Chris A (3980) < [email protected]> wrote: > Hey Tyler it’s only part of the tests.. > > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > Chris Mattmann, Ph.D. > Chief Architect > Instrument Software and Science Data Systems Section (398) > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA > Office: 168-519, Mailstop: 168-527 > Email: [email protected] > WWW: http://sunset.usc.edu/~mattmann/ > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > Adjunct Associate Professor, Computer Science Department > University of Southern California, Los Angeles, CA 90089 USA > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > > > > > -----Original Message----- > From: Tyler Palsulich <[email protected]> > Reply-To: "[email protected]" <[email protected]> > Date: Monday, November 23, 2015 at 8:08 AM > To: "[email protected]" <[email protected]> > Cc: ThammeGowda Narayanaswamy <[email protected]> > Subject: RE: NER Parser tests behind proxy? > > >Apologies if i missed a discussion about this earlier, but should we be > >downloading a model by default? > > > >Tyler > >On Nov 23, 2015 8:03 AM, "Allison, Timothy B." <[email protected]> > wrote: > > > >> The problem comes down to: ModelGetter.groovy which is trying to grab: > >> > >>${basedir}/src/test/resources/org/apache/tika/parser/ner/opennlp/ner-pers > >>on.bin > >> > >> If we could build a small model (and I mean really small) and package it > >> with Tika, we wouldn't have to worry about http connectivity outside of > >>the > >> usual maven stuff. > >> > >> -----Original Message----- > >> From: Mattmann, Chris A (3980) [mailto:[email protected]] > >> Sent: Monday, November 23, 2015 10:52 AM > >> To: [email protected] > >> Cc: ThammeGowda Narayanaswamy <[email protected]> > >> Subject: Re: NER Parser tests behind proxy? > >> > >> Hey Tim, > >> > >> I’m not seeing these of course b/c I’m not behind a proxy. Thamme, any > >> ideas? > >> > >> Cheers, > >> Chris > >> > >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > >> Chris Mattmann, Ph.D. > >> Chief Architect > >> Instrument Software and Science Data Systems Section (398) NASA Jet > >> Propulsion Laboratory Pasadena, CA 91109 USA > >> Office: 168-519, Mailstop: 168-527 > >> Email: [email protected] > >> WWW: http://sunset.usc.edu/~mattmann/ > >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > >> Adjunct Associate Professor, Computer Science Department University of > >> Southern California, Los Angeles, CA 90089 USA > >> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > >> > >> > >> > >> > >> > >> -----Original Message----- > >> From: "Allison, Timothy B." <[email protected]> > >> Reply-To: "[email protected]" <[email protected]> > >> Date: Thursday, November 19, 2015 at 5:36 PM > >> To: "[email protected]" <[email protected]> > >> Subject: NER Parser tests behind proxy? > >> > >> >My proxy is configured for git/maven/etc, but how do I configure it > >> >within the test so that I don't get this? > >> > > >> >GET : http://opennlp.sourceforge.net/models-1.5/en-ner-person.bin -> > >> >tika-parsers\src\test\resources\org\apache\tika\parser\ner\opennlp\ner- > >> >per > >> >son.bin > >> >[INFO] > >> >----------------------------------------------------------------------- > >> >- > >> >[INFO] Reactor Summary: > >> >[INFO] > >> >[INFO] Apache Tika parent ................................ SUCCESS > >> >[3.264s] [INFO] Apache Tika core .................................. > >> >SUCCESS [44.470s] [INFO] Apache Tika parsers > >> >............................... FAILURE [1:56.462s] [INFO] Apache Tika > >> >XMP ................................... SKIPPED [INFO] Apache Tika > >> >serialization ......................... SKIPPED [INFO] Apache Tika > >> >batch ................................. SKIPPED [INFO] Apache Tika > >> >application ........................... SKIPPED [INFO] Apache Tika OSGi > >> >bundle ........................... SKIPPED [INFO] Apache Tika translate > >> >............................. SKIPPED [INFO] Apache Tika server > >> >................................ SKIPPED [INFO] Apache Tika examples > >> >.............................. SKIPPED [INFO] Apache Tika Java-7 > >> >Components ..................... SKIPPED [INFO] Apache Tika > >> >....................................... SKIPPED [INFO] > >> >----------------------------------------------------------------------- > >> >- > >> >[INFO] BUILD FAILURE > >> >[INFO] > >> >----------------------------------------------------------------------- > >> >- > >> >[INFO] Total time: 2:45.245s > >> >[INFO] Finished at: Thu Nov 19 20:29:34 EST 2015 [INFO] Final Memory: > >> >52M/482M [INFO] > >> >----------------------------------------------------------------------- > >> >- > >> >[ERROR] Failed to execute goal > >> >org.codehaus.groovy.maven:gmaven-plugin:1.0:execute (testSetup) on > >> >project tika-parsers: java.net.ConnectException: Connection refused: > >> >connect -> [Help 1] > >> >org.apache.maven.lifecycle.LifecycleExecutionException: Failed to > >> >execute goal org.codehaus.groovy.maven:gmaven-plugin:1.0:execute > >> >(testSetup) on project tika-parsers: java.net.ConnectException: > >> Connection refused: > >> >connect > >> > at > >> >org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.j > >> >ava > >> >:217) > >> > at > >> >org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.j > >> >ava > >> >:153) > >> > at > >> >org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.j > >> >ava > >> >:145) > >> > at > >> >org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject > >> >(Li > >> >fecycleModuleBuilder.java:84) > >> > at > >> >org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject > >> >(Li > >> >fecycleModuleBuilder.java:59) > >> > at > >> >org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuil > >> >d(L > >> >ifecycleStarter.java:183) > >> > at > >> >org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleS > >> >tar > >> >ter.java:161) > >> > at > >>org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) > >> > at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) > >> > at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537) > >> > at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196) > >> > at org.apache.maven.cli.MavenCli.main(MavenCli.java:141) > >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >> > at > >> > >>>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav > >>>a: > >> >62) > >> > at > >> >sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso > >> >rIm > >> >pl.java:43) > >> > at java.lang.reflect.Method.invoke(Method.java:497) > >> > at > >> > >>>org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launche > >>>r. > >> >java:290) > >> > at > >> >org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java: > >> >230 > >> >) > >> > at > >> >org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Laun > >> >che > >> >r.java:409) > >> > at > >> > >>>org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352 > >>>) > >> > at org.codehaus.classworlds.Launcher.main(Launcher.java:47) > >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >> > at > >> > >>>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav > >>>a: > >> >62) > >> > at > >> >sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso > >> >rIm > >> >pl.java:43) > >> > at java.lang.reflect.Method.invoke(Method.java:497) > >> > at > >> >com.intellij.rt.execution.application.AppMain.main(AppMain.java:144) > >> >Caused by: org.apache.maven.plugin.MojoExecutionException: > >> >java.net.ConnectException: Connection refused: connect > >> > at > >> > >>>org.codehaus.groovy.maven.plugin.MojoSupport.execute(MojoSupport.java:85 > >>>) > >> > at > >> >org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBu > >> >ild > >> >PluginManager.java:101) > >> > at > >> >org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.j > >> >ava > >> >:209) > >> > ... 25 more > >> >Caused by: org.codehaus.groovy.maven.feature.ComponentException: > >> >java.net.ConnectException: Connection refused: connect > >> > at > >> >org.codehaus.groovy.maven.runtime.support.ScriptExecutorSupport.invokeM > >> >eth > >> >od(ScriptExecutorSupport.java:162) > >> > at > >> >org.codehaus.groovy.maven.runtime.support.ScriptExecutorSupport.execute > >> >(Sc > >> >riptExecutorSupport.java:126) > >> > at > >> >org.codehaus.groovy.maven.runtime.support.ScriptExecutorSupport.execute > >> >(Sc > >> >riptExecutorSupport.java:73) > >> > at > >> >org.codehaus.groovy.maven.plugin.execute.ExecuteMojo.process(ExecuteMoj > >> >o.j > >> >ava:249) > >> > at > >> >org.codehaus.groovy.maven.plugin.ComponentMojoSupport.doExecute(Compone > >> >ntM > >> >ojoSupport.java:60) > >> > at > >> > >>>org.codehaus.groovy.maven.plugin.MojoSupport.execute(MojoSupport.java:69 > >>>) > >> > ... 27 more > >> >Caused by: java.net.ConnectException: Connection refused: connect > >> > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > >> Method) > >> > at > >> >sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructor > >> >Acc > >> >essorImpl.java:62) > >> > at > >> >sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingCon > >> >str > >> >uctorAccessorImpl.java:45) > >> > at > >>java.lang.reflect.Constructor.newInstance(Constructor.java:422) > >> > at > >> > >>>sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.jav > >>>a: > >> >1890) > >> > at > >> > >>>sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.jav > >>>a: > >> >1885) > >> > at java.security.AccessController.doPrivileged(Native Method) > >> > at > >> >sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURL > >> >Con > >> >nection.java:1884) > >> > at > >> >sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConn > >> >ect > >> >ion.java:1457) > >> > at > >> >sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConne > >> >cti > >> >on.java:1441) > >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >> > at > >> > >>>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav > >>>a: > >> >62) > >> > at > >> >sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso > >> >rIm > >> >pl.java:43) > >> > at java.lang.reflect.Method.invoke(Method.java:497) > >> > at > >> >org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoCachedMetho > >> >dSi > >> >teNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:229) > >> > at > >> >org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMe > >> >tho > >> >dSite.java:52) > >> > at > >> >org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSite > >> >Arr > >> >ay.java:43) > >> > at > >> >org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCall > >> >Sit > >> >e.java:116) > >> > at > >> >org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCall > >> >Sit > >> >e.java:120) > >> > at ModelGetter.downloadFile(ModelGetter.groovy:64) > >> > at ModelGetter$downloadFile.callCurrent(Unknown Source) > >> > at > >> >org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(C > >> >all > >> >SiteArray.java:47) > >> > at > >> >org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(Abstr > >> >act > >> >CallSite.java:142) > >> > at > >> >org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(Abstr > >> >act > >> >CallSite.java:154) > >> > at ModelGetter.run(ModelGetter.groovy:91) > >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >> > at > >> > >>>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav > >>>a: > >> >62) > >> > at > >> >sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso > >> >rIm > >> >pl.java:43) > >> > at java.lang.reflect.Method.invoke(Method.java:497) > >> > at > >> >org.codehaus.groovy.maven.runtime.support.ScriptExecutorSupport.invokeM > >> >eth > >> >od(ScriptExecutorSupport.java:158) > >> > ... 32 more > >> >Caused by: java.net.ConnectException: Connection refused: connect > >> > at java.net.DualStackPlainSocketImpl.connect0(Native Method) > >> > at > >> >java.net.DualStackPlainSocketImpl.socketConnect(DualStackPlainSocketImp > >> >l.j > >> >ava:79) > >> > at > >> >java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java > >> >:35 > >> >0) > >> > at > >> > >>>java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImp > >>>l. > >> >java:206) > >> > at > >> > >>>java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:18 > >>>8) > >> > at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:172) > >> > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > >> > at java.net.Socket.connect(Socket.java:589) > >> > at java.net.Socket.connect(Socket.java:538) > >> > at sun.net.NetworkClient.doConnect(NetworkClient.java:180) > >> > at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) > >> > at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) > >> > at sun.net.www.http.HttpClient.<init>(HttpClient.java:211) > >> > at sun.net.www.http.HttpClient.New(HttpClient.java:308) > >> > at sun.net.www.http.HttpClient.New(HttpClient.java:326) > >> > at > >> >sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLCon > >> >nec > >> >tion.java:1169) > >> > at > >> >sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnec > >> >tio > >> >n.java:1105) > >> > at > >> >sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnect > >> >ion > >> >.java:999) > >> > at > >> >sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.j > >> >ava > >> >:933) > >> > at > >> >sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConn > >> >ect > >> >ion.java:1513) > >> > at > >> >sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConne > >> >cti > >> >on.java:1441) > >> > at > >> >sun.net.www.protocol.http.HttpURLConnection.getHeaderField(HttpURLConne > >> >cti > >> >on.java:2943) > >> > at > >> java.net.URLConnection.getHeaderFieldLong(URLConnection.java:629) > >> > at > >> java.net.URLConnection.getContentLengthLong(URLConnection.java:501) > >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >> > at > >> > >>>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav > >>>a: > >> >62) > >> > at > >> >sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso > >> >rIm > >> >pl.java:43) > >> > at java.lang.reflect.Method.invoke(Method.java:497) > >> > at > >> >org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoCachedMetho > >> >dSi > >> >teNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:229) > >> > at > >> >org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMe > >> >tho > >> >dSite.java:52) > >> > at > >> >org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSite > >> >Arr > >> >ay.java:43) > >> > at > >> >org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCall > >> >Sit > >> >e.java:116) > >> > at > >> >org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCall > >> >Sit > >> >e.java:120) > >> > at ModelGetter.downloadFile(ModelGetter.groovy:61) > >> > ... 42 more > >> > > >> >-----Original Message----- > >> >From: Nick Burch [mailto:[email protected]] > >> >Sent: Thursday, November 19, 2015 7:41 PM > >> >To: [email protected] > >> >Subject: Re: [DISCUSS] Moving to Git > >> > > >> >On Thu, 19 Nov 2015, Mattmann, Chris A (3980) wrote: > >> >> I’ll be happy to update our docs and to write a wiki page on using > >> >> Tika & Git that we can refer folks to. I think I’ve demonstrated > >> >> documenting things on the Tika wiki :) > >> > > >> >Great stuff! Scribble something sensible down, and I can vote +1 to the > >> >move, plus learn more about Git at the same time :) > >> > > >> >Nick > >> > >> > >
