Hey Thomas, Thanks for reporting the discrepancy so thoroughly! The API "/extract" API used by "post.jar" still exists but was removed from default configurations starting back around 8.4. The tutorial in Solr's Ref Guide should have been updated around the same time, but it looks like a few necessary edits were missed.
Can you confirm that you're using Solr 8.8.2, and provide a link to the tutorial you were following please? Best, Jason On Thu, Apr 29, 2021 at 10:08 AM Thomas Hühn <t...@2uo.de> wrote: > Hello, > > I'm trying to follow the Solr Tutorial and need some pointers where I'm > going wrong. > > In exercise 3 I cannot import any documents in my localDocs collection, > neither using the example\exampledocs\post.jar helper, nor the File > Upload in the Admin UI. Neither PDF, nor XML, nor plain text. > > The /update endpoint doesn't seem to be reachable. If so, why? > > This is on Windows 10. All command line input and output is a > transcript, so no copy&paste errors. > > First, the Java version: > > ---------------------------------------------------------------------- > PS D:\Solr\solr-8.8.2> java -version > openjdk version "16.0.1" 2021-04-20 > OpenJDK Runtime Environment AdoptOpenJDK-16.0.1+9 (build 16.0.1+9) > OpenJDK 64-Bit Server VM AdoptOpenJDK-16.0.1+9 (build 16.0.1+9, mixed > mode, sharing) > ---------------------------------------------------------------------- > > I'm not comfortable taking shortcuts, so I'm starting Solr, creating > collections etc. from exercises 1 and 2, as well. > > ---------------------------------------------------------------------- > PS D:\Solr\solr-8.8.2> .\bin\solr start -e cloud > "java version info is 16.0.1" > "Extracted major version is 16" > > Welcome to the SolrCloud example! > > This interactive session will help you launch a SolrCloud cluster on > your local workstation. > To begin, how many Solr nodes would you like to run in your local > cluster? (specify 1-4 nodes) [2]: > > Ok, let's start up 2 Solr nodes for your example SolrCloud cluster. > Please enter the port for node1 [8983]: > > Please enter the port for node2 [7574]: > > Creating Solr home directory D:\Solr\solr-8.8.2\example\cloud\node1\solr > Cloning D:\Solr\solr-8.8.2\example\cloud\node1 into > D:\Solr\solr-8.8.2\example\cloud\node2 > > Starting up Solr on port 8983 using command: > "D:\Solr\solr-8.8.2\bin\solr.cmd" start -cloud -p 8983 -s > "D:\Solr\solr-8.8.2\example\cloud\node1\solr" > > "java version info is 16.0.1" > "Extracted major version is 16" > OpenJDK 64-Bit Server VM warning: JVM cannot use large page memory > because it does not have enough privilege to lock pag > es in memory. > Waiting up to 30 to see Solr running on port 8983 > Started Solr server on port 8983. Happy searching! > > Starting up Solr on port 7574 using command: > "D:\Solr\solr-8.8.2\bin\solr.cmd" start -cloud -p 7574 -s > "D:\Solr\solr-8.8.2\example\cloud\node2\solr" -z localhost:998 > 3 > > "java version info is 16.0.1" > "Extracted major version is 16" > OpenJDK 64-Bit Server VM warning: JVM cannot use large page memory > because it does not have enough privilege to lock pag > es in memory. > Waiting up to 30 to see Solr running on port 7574 > Started Solr server on port 7574. Happy searching! > INFO - 2021-04-29 15:22:53.249; > org.apache.solr.common.cloud.ConnectionManager; Waiting for client to > connect to ZooKee > per > INFO - 2021-04-29 15:22:53.275; > org.apache.solr.common.cloud.ConnectionManager; zkClient has connected > INFO - 2021-04-29 15:22:53.275; > org.apache.solr.common.cloud.ConnectionManager; Client is connected to > ZooKeeper > INFO - 2021-04-29 15:22:53.290; > org.apache.solr.common.cloud.ZkStateReader; Updated live nodes from > ZooKeeper... (0) -> > (2) > INFO - 2021-04-29 15:22:53.290; > org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider; Cluster > at localhost:99 > 83 ready > > Now let's create a new collection for indexing documents in your 2-node > cluster. > Please provide a name for your new collection: [gettingstarted] > techproducts > How many shards would you like to split techproducts into? [2] > > How many replicas per shard would you like to create? [2] > > Please choose a configuration for the techproducts collection, available > options are: > _default or sample_techproducts_configs [_default] > sample_techproducts_configs > Created collection 'techproducts' with 2 shard(s), 2 replica(s) with > config-set 'techproducts' > > Enabling auto soft-commits with maxTime 3 secs using the Config API > > POSTing request to Config API: > http://localhost:8983/solr/techproducts/config > {"set-property":{"updateHandler.autoSoftCommit.maxTime":"3000"}} > Successfully set-property updateHandler.autoSoftCommit.maxTime to 3000 > > > SolrCloud example running, please visit: http://localhost:8983/solr > ---------------------------------------------------------------------- > > Now I'm deleting it again, as documented in the wrap-up: > > ---------------------------------------------------------------------- > PS D:\Solr\solr-8.8.2> .\bin\solr delete -c techproducts > "java version info is 16.0.1" > "Extracted major version is 16" > { > "responseHeader":{ > "status":0, > "QTime":237}, > "success":{ > "192.168.178.59:8983_solr":{"responseHeader":{ > "status":0, > "QTime":45}}, > "192.168.178.59:7574_solr":{"responseHeader":{ > "status":0, > "QTime":60}}}} > > > Deleted collection 'techproducts' using command: > > http://192.168.178.59:7574/solr/admin/collections?action=DELETE&name=techproducts > ---------------------------------------------------------------------- > > Enriching the schema: > > ---------------------------------------------------------------------- > PS D:\Solr\solr-8.8.2> c:\bin\curl -X POST -H > 'Content-type:application/json' --data-binary '{"add-field": > {"name":"name", "type":"text_general", "multiValued":false, > "stored":true}}' http://localhost:8983/solr/films/schema > { > "responseHeader":{ > "status":0, > "QTime":655}} > ---------------------------------------------------------------------- > > BTW, PowerShell has 'curl' as an alias to an internal command. That took > me a minute to figure out… maybe add a note in the Tutorial? > > For some reason I cannot use curl to add the copy field, so I did that > in the Admin UI, as documented. > > Maybe a problem with escaping? I don't know. > > ---------------------------------------------------------------------- > PS D:\Solr\solr-8.8.2> c:\bin\curl -X POST -H > 'Content-type:application/json' --data-binary '{"add-copy-field" : > {"source":"*","dest":"_text_"}}' http://localhost:8983/solr/films/schema > { > "responseHeader":{ > "status":500, > "QTime":0}, > "error":{ > "msg":"JSON Parse Error: char=*,position=26 AFTER='{add-copy-field > : {source:*' BEFORE=',dest:_text_}}'", > "trace":"org.noggit.JSONParser$ParseException: JSON Parse Error: > char=*,position=26 AFTER='{add-copy-field : {source > :*' BEFORE=',dest:_text_}}'\r\n\tat > org.noggit.JSONParser.err(JSONParser.java:452)\r\n\tat > org.noggit.JSONParser.handleN > onDoubleQuoteString(JSONParser.java:819)\r\n\tat > org.noggit.JSONParser.next(JSONParser.java:1026)\r\n\tat org.noggit.JSO > NParser.nextEvent(JSONParser.java:1108)\r\n\tat > org.noggit.ObjectBuilder.getObject(ObjectBuilder.java:180)\r\n\tat org.n > oggit.ObjectBuilder.getVal(ObjectBuilder.java:104)\r\n\tat > org.apache.solr.common.util.CommandOperation.parse(CommandOpe > ration.java:293)\r\n\tat > org.apache.solr.common.util.CommandOperation.readCommands(CommandOperation.java:362)\r\n\tat > > or > g.apache.solr.common.util.CommandOperation.readCommands(CommandOperation.java:336)\r\n\tat > > org.apache.solr.api.ApiBag.ge > tCommandOperations(ApiBag.java:318)\r\n\tat > > org.apache.solr.servlet.HttpSolrCall.getCommands(HttpSolrCall.java:1190)\r\n > \tat > org.apache.solr.servlet.SolrRequestParsers$1.getCommands(SolrRequestParsers.java:252)\r\n\tat > > org.apache.solr.schem > a.SchemaManager.performOperations(SchemaManager.java:87)\r\n\tat > org.apache.solr.handler.SchemaHandler.handleRequestBody > (SchemaHandler.java:95)\r\n\tat > > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)\r\ > n\tat org.apache.solr.core.SolrCore.execute(SolrCore.java:2646)\r\n\tat > org.apache.solr.servlet.HttpSolrCall.execute(Htt > pSolrCall.java:794)\r\n\tat > org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:567)\r\n\tat > org.apache.solr.ser > vlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)\r\n\tat > org.apache.solr.servlet.SolrDispatchFilter.doFilte > r(SolrDispatchFilter.java:357)\r\n\tat > org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:201)\r\n\tat > > or > g.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)\r\n\tat > > org.eclipse.jetty.servlet.Servle > tHandler.doHandle(ServletHandler.java:548)\r\n\tat > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.j > ava:143)\r\n\tat > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602)\r\n\tat > > org.eclipse.jetty.s > erver.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\r\n\tat > org.eclipse.jetty.server.handler.ScopedHandler.next > Handle(ScopedHandler.java:235)\r\n\tat > > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612 > )\r\n\tat > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)\r\n\tat > > org.eclipse.jetty.se > rver.handler.ContextHandler.doHandle(ContextHandler.java:1434)\r\n\tat > org.eclipse.jetty.server.handler.ScopedHandler.ne > xtScope(ScopedHandler.java:188)\r\n\tat > > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)\r\n\ta > t > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582)\r\n\tat > > org.eclipse.jetty.server.han > dler.ScopedHandler.nextScope(ScopedHandler.java:186)\r\n\tat > org.eclipse.jetty.server.handler.ContextHandler.doScope(Con > textHandler.java:1349)\r\n\tat > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\r\n\tat > > org > .eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191)\r\n\tat > > org.eclipse.jet > ty.server.handler.InetAccessHandler.handle(InetAccessHandler.java:177)\r\n\tat > > org.eclipse.jetty.server.handler.HandlerC > ollection.handle(HandlerCollection.java:146)\r\n\tat > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapp > er.java:127)\r\n\tat > org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)\r\n\tat > > org.eclips > e.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\r\n\tat > > org.eclipse.jetty.server.Server.handle(Ser > ver.java:516)\r\n\tat > org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)\r\n\tat > > org.eclipse.jet > ty.server.HttpChannel.dispatch(HttpChannel.java:556)\r\n\tat > org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.jav > a:375)\r\n\tat > org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)\r\n\tat > > org.eclipse.jetty.io. > AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\r\n\tat > > org.eclipse.jetty.io.FillInterest.fillabl > e(FillInterest.java:105)\r\n\tat > org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)\r\n\tat > > org.eclips > e.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)\r\n\tat > > org.eclipse.jetty.util.thread.strat > egy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)\r\n\tat > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryP > roduce(EatWhatYouKill.java:171)\r\n\tat > > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:12 > 9)\r\n\tat > > org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375)\r\n\ > tat > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773)\r\n\tat > > org.eclipse.jetty.util.thre > ad.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905)\r\n\tat > java.base/java.lang.Thread.run(Thread.java:831)\r\n", > "code":500}} > ---------------------------------------------------------------------- > > I can successfully POST here in exercise 2: > > ---------------------------------------------------------------------- > PS D:\Solr\solr-8.8.2> java -jar -Dc=films -Dauto > example\exampledocs\post.jar example\films\*.xml > SimplePostTool version 5.0.0 > Posting files to [base] url http://localhost:8983/solr/films/update... > Entering auto mode. File endings considered are > xml,json,jsonl,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ot > s,rtf,htm,html,txt,log > POSTing file films.xml (application/xml) to [base] > 1 files indexed. > COMMITting Solr index changes to http://localhost:8983/solr/films/update. > .. > Time spent: 0:00:02.395 > ---------------------------------------------------------------------- > > So far, so good, let's delete the collection: > > ---------------------------------------------------------------------- > PS D:\Solr\solr-8.8.2> .\bin\solr delete -c films > "java version info is 16.0.1" > "Extracted major version is 16" > { > "responseHeader":{ > "status":0, > "QTime":226}, > "success":{ > "192.168.178.59:8983_solr":{"responseHeader":{ > "status":0, > "QTime":43}}, > "192.168.178.59:7574_solr":{"responseHeader":{ > "status":0, > "QTime":55}}}} > > > Deleted collection 'films' using command: > http://192.168.178.59:7574/solr/admin/collections?action=DELETE&name=films > ---------------------------------------------------------------------- > > Finally, exercise 3. Create a new collection: > > ---------------------------------------------------------------------- > PS D:\Solr\solr-8.8.2> .\bin\solr create -c localDocs -s 2 -rf 2 > "java version info is 16.0.1" > "Extracted major version is 16" > WARNING: Using _default configset with data driven schema functionality. > NOT RECOMMENDED for production use. > To turn off: bin\solr config -c localDocs -p 8983 -action > set-user-property -property update.autoCreateFields - > value false > Created collection 'localDocs' with 2 shard(s), 2 replica(s) with > config-set 'localDocs' > ---------------------------------------------------------------------- > > And POST: > > ---------------------------------------------------------------------- > PS D:\Solr\solr-8.8.2> java -jar -Dc=localDocs -Dauto > example\exampledocs\post.jar .\example\exampledocs\solr-word.pdf > SimplePostTool version 5.0.0 > Posting files to [base] url http://localhost:8983/solr/localDocs/update... > Entering auto mode. File endings considered are > xml,json,jsonl,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ot > s,rtf,htm,html,txt,log > POSTing file solr-word.pdf (application/pdf) to [base]/extract > SimplePostTool: WARNING: Solr returned an error #404 (Not Found) for > url: http://localhost:8983/solr/localDocs/update/ex > tract?resource.name > =D%3A%5CSolr%5Csolr-8.8.2%5C.%5Cexample%5Cexampledocs%5Csolr-word.pdf& > literal.id=D%3A%5CSolr%5Csolr-8 > .8.2%5C.%5Cexample%5Cexampledocs%5Csolr-word.pdf > SimplePostTool: WARNING: Response: <html> > <head> > <meta http-equiv="Content-Type" content="text/html;charset=utf-8"/> > <title>Error 404 Not Found</title> > </head> > <body><h2>HTTP ERROR 404 Not Found</h2> > <table> > <tr><th>URI:</th><td>/solr/localDocs/update/extract</td></tr> > <tr><th>STATUS:</th><td>404</td></tr> > <tr><th>MESSAGE:</th><td>Not Found</td></tr> > <tr><th>SERVLET:</th><td>default</td></tr> > </table> > > </body> > </html> > SimplePostTool: WARNING: IOException while reading response: > java.io.FileNotFoundException: http://localhost:8983/solr/l > ocalDocs/update/extract?resource.name > =D%3A%5CSolr%5Csolr-8.8.2%5C.%5Cexample%5Cexampledocs%5Csolr-word.pdf& > literal.id=D% > 3A%5CSolr%5Csolr-8.8.2%5C.%5Cexample%5Cexampledocs%5Csolr-word.pdf > 1 files indexed. > COMMITting Solr index changes to > http://localhost:8983/solr/localDocs/update... > Time spent: 0:00:00.059 > ---------------------------------------------------------------------- > > No luck. > > I then tried to upload example\exampledocs\solr-word.pdf in the Admin UI > (Document, File Upload), but got the error message: > > "Unsupported ContentType: application/pdf Not in: [application/xml, > […cut here…]]. > > Then I tried uploading films.xml from the example earlier, but got the > error message: > > "Async exception during distributed update: Error from server at > http://192.168.178".59:8983/solr/localDocs_shard2_replica_n4/: null > request: http://192.168.178.59:8983/solr/localDocs_shard2_replica_n4/ > Remote error message: ERROR [doc=/en/quien_es_el_senor_lopez] Error > adding field 'name'='¿Quién es el señor López?' msg=For input string: > "¿Quién es el señor López?" > > Can you help me out? > -- > Wunderschön illustrierte Kinderbücher: > https://www.schoene-kinderbuecher.de > Weblog: > https://www.thomas-huehn.de >
