Hi, In solrindex-mapping.xml, try changing the values for "source" to metatag.keywords and metatag.description. Or change the fields Solr is expecting to metatag.keywords and metatag.description. Hope that helps!
On Tue, Dec 2, 2014 at 4:52 AM, [email protected] < [email protected]> wrote: > Hi, > > I am new to Nutch and Solr, please help!! > > I am using Nutch-1.9, solr-4.10.2 and Hadoop-2.4.1, > > It always returns "org.apache.solr.common.SolrException: Bad Request” > (I have already copied [nutch]conf/schema.xml to > [solr]/collection1/conf/schema.xml and restarted solr) > > Below is about my settings, some questions: > Q1: Do I need to manually copy some .jar files to notch’s lib folder or > solr’s lib folder? (e.g. need to copy hadoop’s jar files to nutch ir sold?) > Q2: Would it be something wrong in my Plugin setup? > > > regards > Arthur > > > My Nutch command: > ./bin/crawl input_url/ output_url/ > http://192.168.0.1:8983/solr/collection1 2 > > > input_url/seed.txt: > http://nutch.apache.org/ > > > > conf/regex-urlfilter.txt > # skip file: ftp: and mailto: urls > -^(file|ftp|mailto): > # skip image and other suffixes we can't yet parse > # for a more extensive coverage use the urlfilter-suffix plugin > > -\.(gif|GIF|jpg|JPG|png|PNG|ico|ICO|css|CSS|sit|SIT|eps|EPS|wmf|WMF|zip|ZIP|ppt|PPT|mpg|MPG|xls|XLS|gz|GZ|rpm|RPM|tgz|TGZ|mov|MOV|exe|EXE|jpeg|JPEG|bmp|BMP|js|JS)$ > # skip URLs containing certain characters as probable queries, etc. > -[?*!@=] > # skip URLs with slash-delimited segment that repeats 3+ times, to break > loops > -.*(/[^/]+)/[^/]+\1/[^/]+\1/ > # accept anything else > #+. > +^http://([a-z0-9]*\.)*nutch.apache.org/ > > > > conf/nutch-site.xml > <?xml version="1.0"?> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> > <configuration> > <property> > <name>http.agent.name</name> > <value>MyBot</value> > </property> > <property> > <name>http.robots.agents</name> > <value>MyBot,*</value> > </property> > <property> > <name>fetcher.store.content</name> > <value>true</value> > </property> > <property> > <name>fetcher.max.crawl.delay</name> > <value>-1</value> > </property> > <property> > <name>plugin.includes</name> > > <value>protocol-http|urlfilter-regex|parse-(html|tika|metatags)|index-(basic|anchor|metadata)|query-(basic|site|url)|response-(json|xml)|summary-basic|scoring-opic|indexer-solr|urlnormalizer-(pass|regex|basic)</value> > </property> > <property> > <name>mapred.temp.dir</name> > <value>/tmp</value> > <description>A shared directory for temporary files.</description> > </property> > <!-- Used only if plugin parse-metatags is enabled. --> > <property> > <name>metatags.names</name> > <value>metatag.keywords;metatag.description</value> > </property> > <property> > <name>index.parse.md</name> > <value>metatag.description,metatag.keywords</value> > </property> > </configuration> > > > > conf/solrindex-mapping.xml > <?xml version="1.0" encoding="UTF-8"?> > <mapping> > <fields> > <field dest="content" source="content"/> > <field dest="title" source="title"/> > <field dest="host" source="host"/> > <field dest="segment" source="segment"/> > <field dest="boost" source="boost"/> > <field dest="digest" source="digest"/> > <field dest="tstamp" source="tstamp"/> > > <field dest="description" source="description"/> > <field dest="keywords" source="keywords"/> > </fields> > <uniqueKey>id</uniqueKey> > </mapping> > > > > conf/schema.xml > <?xml version="1.0" encoding="UTF-8" ?> > <schema name="nutch" version="1.5"> > <types> > <fieldType name="string" class="solr.StrField" > sortMissingLast="true" > omitNorms="true"/> > <fieldType name="long" class="solr.TrieLongField" precisionStep="0" > omitNorms="true" positionIncrementGap="0"/> > <fieldType name="float" class="solr.TrieFloatField" > precisionStep="0" > omitNorms="true" positionIncrementGap="0"/> > <fieldType name="date" class="solr.TrieDateField" precisionStep="0" > omitNorms="true" positionIncrementGap="0"/> > > <fieldType name="text" class="solr.TextField" > positionIncrementGap="100"> > <analyzer> > <tokenizer class="solr.WhitespaceTokenizerFactory"/> > <filter class="solr.StopFilterFactory" > ignoreCase="true" words="stopwords.txt"/> > <filter class="solr.WordDelimiterFilterFactory" > generateWordParts="1" generateNumberParts="1" > catenateWords="1" catenateNumbers="1" catenateAll="0" > splitOnCaseChange="1"/> > <filter class="solr.LowerCaseFilterFactory"/> > <filter class="solr.EnglishPorterFilterFactory" > protected="protwords.txt"/> > <filter class="solr.RemoveDuplicatesTokenFilterFactory"/> > </analyzer> > </fieldType> > <fieldType name="url" class="solr.TextField" > positionIncrementGap="100"> > <analyzer> > <tokenizer class="solr.StandardTokenizerFactory"/> > <filter class="solr.LowerCaseFilterFactory"/> > <filter class="solr.WordDelimiterFilterFactory" > generateWordParts="1" generateNumberParts="1"/> > </analyzer> > </fieldType> > </types> > <fields> > > <field name="_root_" type="string" indexed="true" stored="false"/> > <field name="id" type="string" stored="true" indexed="true" > required="true"/> > > <!-- core fields --> > <field name="_version_" type="long" indexed="true" stored="true"/> > <field name="host" type="string" stored="false" indexed="true"/> > <field name="digest" type="string" stored="true" indexed="false"/> > <field name="segment" type="string" stored="true" indexed="false"/> > <field name="boost" type="float" stored="true" indexed="false"/> > <field name="tstamp" type="date" stored="true" indexed="false"/> > > <field name="url" type="text" indexed="true" stored="true" > required="true"/> > <field name="content_type" type="string" indexed="true" > stored="true" multiValued="true"/> > <field name="last_modified" type="date" indexed="true" > stored="true"/> > <field name="links" type="string" indexed="true" stored="true" > multiValued="true"/> > > <!-- fields for the metatags plugin --> > <field name="metatag.description" type="text" stored="true" > indexed="true"/> > <field name="metatag.keywords" type="text" stored="true" > indexed="true"/> > > <!-- fields for index-basic plugin --> > <field name="content" type="text" indexed="true" stored="true" > multiValued="true"/> > <field name="title" type="text" stored="true" indexed="true"/> > <field name="cache" type="string" stored="true" indexed="false"/> > > <!-- fields for index-anchor plugin --> > <field name="anchor" type="string" stored="true" indexed="true" > multiValued="true"/> > > <!-- fields for index-more plugin --> > <field name="type" type="string" stored="true" indexed="true" > multiValued="true"/> > <field name="contentLength" type="long" stored="true" > indexed="false"/> > <field name="lastModified" type="date" stored="true" > indexed="false"/> > <field name="date" type="date" stored="true" indexed="true"/> > > <!-- fields for languageidentifier plugin --> > <field name="lang" type="string" stored="true" indexed="true"/> > > <!-- fields for subcollection plugin --> > <field name="subcollection" type="string" stored="true" > indexed="true" multiValued="true"/> > > <!-- fields for feed plugin (tag is also used by > microformats-reltag)--> > <field name="author" type="string" stored="true" indexed="true"/> > <field name="tag" type="string" stored="true" indexed="true" > multiValued="true"/> > <field name="feed" type="string" stored="true" indexed="true"/> > <field name="publishedDate" type="date" stored="true" > indexed="true"/> > <field name="updatedDate" type="date" stored="true" > indexed="true"/> > > <!-- fields for creativecommons plugin --> > <field name="cc" type="string" stored="true" indexed="true" > multiValued="true"/> > > <!-- fields for tld plugin --> > <field name="tld" type="string" stored="false" indexed="false"/> > </fields> > <uniqueKey>id</uniqueKey> > <defaultSearchField>content</defaultSearchField> > <solrQueryParser defaultOperator="OR"/> > </schema> > > > > Nutch logs/hadoop.log: > org.apache.solr.common.SolrException: Bad Request > Bad Request > request: > http://192.168.0.1:8983/solr/collection1/update?wt=javabin&version=2 > at > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:430) > at > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244) > at > org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:105) > at > org.apache.nutch.indexwriter.solr.SolrIndexWriter.close(SolrIndexWriter.java:155) > at > org.apache.nutch.indexer.IndexWriters.close(IndexWriters.java:118) > at > org.apache.nutch.indexer.IndexerOutputFormat$1.close(IndexerOutputFormat.java:44) > at > org.apache.hadoop.mapred.ReduceTask$OldTrackingRecordWriter.close(ReduceTask.java:467) > at > org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:535) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:421) > at > org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:398) > 2014-12-02 17:16:55,021 ERROR indexer.IndexingJob - Indexer: > java.io.IOException: Job failed! > at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1357) > at org.apache.nutch.indexer.IndexingJob.index(IndexingJob.java:114) > at org.apache.nutch.indexer.IndexingJob.run(IndexingJob.java:176) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at org.apache.nutch.indexer.IndexingJob.main(IndexingJob.java:186) > > > > Solr logs/solr.log: > INFO - 2014-12-02 17:08:32.650; > org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state > numShards=null message={ > "operation":"state", > "core_node_name":"core_node1", > "shard":"shard1", > "roles":null, > "state":"active", > "core":"collection1", > "collection":"collection1", > "node_name":"192.168.0.1:8983_solr", > "base_url":"http://192.168.0.1:8983/solr"} > INFO - 2014-12-02 17:08:32.675; > org.apache.solr.cloud.DistributedQueue$LatchChildWatcher; LatchChildWatcher > fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged > INFO - 2014-12-02 17:08:32.686; > org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: > WatchedEvent state:SyncConnected type:NodeDataChanged > path:/clusterstate.json, has occurred - updating... (live nodes size: 1) > INFO - 2014-12-02 17:08:38.556; > org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null > path=/admin/cores params={indexInfo=false&_=1417511318548&wt=json} status=0 > QTime=2 > INFO - 2014-12-02 17:08:38.680; > org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null > path=/admin/info/system params={_=1417511318656&wt=json} status=0 QTime=5 > INFO - 2014-12-02 17:08:39.270; org.apache.solr.core.SolrCore; > [collection1] webapp=/solr path=/admin/file/ > params={file=admin-extra.menu-bottom.html&_=1417511319050&contentType=text/html;charset%3Dutf-8} > status=0 QTime=7 > INFO - 2014-12-02 17:08:39.270; org.apache.solr.core.SolrCore; > [collection1] webapp=/solr path=/admin/file/ > params={file=admin-extra.menu-top.html&_=1417511319041&contentType=text/html;charset%3Dutf-8} > status=0 QTime=12 > INFO - 2014-12-02 17:08:39.374; org.apache.solr.core.SolrCore; > [collection1] webapp=/solr path=/admin/luke > params={numTerms=0&_=1417511319348&show=index&wt=json} status=0 QTime=1 > INFO - 2014-12-02 17:08:39.387; org.apache.solr.core.SolrCore; > [collection1] webapp=/solr path=/replication > params={command=details&_=1417511319355&wt=json} status=0 QTime=8 > INFO - 2014-12-02 17:08:39.388; org.apache.solr.core.SolrCore; > [collection1] webapp=/solr path=/admin/system > params={_=1417511319358&wt=json} status=0 QTime=4 > INFO - 2014-12-02 17:08:39.388; org.apache.solr.core.SolrCore; > [collection1] webapp=/solr path=/admin/ping > params={action=status&_=1417511319368&wt=json} status=503 QTime=2 > INFO - 2014-12-02 17:08:39.388; org.apache.solr.core.SolrCore; > [collection1] webapp=/solr path=/admin/file/ > params={file=admin-extra.html&_=1417511319363} status=0 QTime=0 > INFO - 2014-12-02 17:09:08.990; > org.apache.solr.update.processor.LogUpdateProcessor; [collection1] > webapp=/solr path=/update params={wt=javabin&version=2} {} 0 29 > ERROR - 2014-12-02 17:09:08.990; org.apache.solr.common.SolrException; > org.apache.solr.common.SolrException: ERROR: [doc=http://nutch.apache.org/] > unknown field 'metatag.keywords' > at > org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:185) > at > org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpdateCommand.java:78) > at > org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238) > at > org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:164) > at > org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) > at > org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:926) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1080) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:692) > at > org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100) > at > org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:247) > at > org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174) > at > org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:99) > at > org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) > at > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1967) > at > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207) > at > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) > at > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) > at > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) > at > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) > at > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) > at > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) > at > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) > at > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) > at > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) > at > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) > at > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) > at org.eclipse.jetty.server.Server.handle(Server.java:368) > at > org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) > at > org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) > at > org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) > at > org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953) > at > org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) > at > org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) > at > org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) > at > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) > at > org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) > at java.lang.Thread.run(Thread.java:745) > > INFO - 2014-12-02 17:09:08.999; > org.apache.solr.update.processor.LogUpdateProcessor; [collection1] > webapp=/solr path=/update params={wt=javabin&version=2} {} 0 1 > ERROR - 2014-12-02 17:09:09.000; org.apache.solr.common.SolrException; > org.apache.solr.common.SolrException: ERROR: [doc=http://nutch.apache.org/] > unknown field 'metatag.keywords' > at > org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:185) > at > org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpdateCommand.java:78) > at > org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238) > at > org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:164) > at > org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) > at > org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:926) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1080) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:692) > at > org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100) > at > org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:247) > at > org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174) > at > org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:99) > at > org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) > at > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1967) > at > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207) > at > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) > at > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) > at > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) > at > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) > at > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) > at > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) > at > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) > at > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) > at > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) > at > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) > at > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) > at org.eclipse.jetty.server.Server.handle(Server.java:368) > at > org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) > at > org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) > at > org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) > at > org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953) > at > org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) > at > org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) > at > org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) > at > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) > at > org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) > at java.lang.Thread.run(Thread.java:745) > > INFO - 2014-12-02 17:16:54.284; > org.apache.solr.update.processor.LogUpdateProcessor; [collection1] > webapp=/solr path=/update params={wt=javabin&version=2} {} 0 5 > ERROR - 2014-12-02 17:16:54.285; org.apache.solr.common.SolrException; > org.apache.solr.common.SolrException: ERROR: [doc=http://nutch.apache.org/] > unknown field 'host' > at > org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:185) > at > org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpdateCommand.java:78) > at > org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238) > at > org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:164) > at > org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) > at > org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:926) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1080) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:692) > at > org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100) > at > org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:247) > at > org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174) > at > org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:99) > at > org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) > at > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1967) > at > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207) > at > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) > at > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) > at > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) > at > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) > at > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) > at > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) > at > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) > at > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) > at > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) > at > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) > at > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) > at org.eclipse.jetty.server.Server.handle(Server.java:368) > at > org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) > at > org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) > at > org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) > at > org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953) > at > org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) > at > org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) > at > org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) > at > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) > at > org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) > at java.lang.Thread.run(Thread.java:745) > INFO - 2014-12-02 17:16:54.292; > org.apache.solr.update.processor.LogUpdateProcessor; [collection1] > webapp=/solr path=/update params={wt=javabin&version=2} {} 0 1 > ERROR - 2014-12-02 17:16:54.292; org.apache.solr.common.SolrException; > org.apache.solr.common.SolrException: ERROR: [doc=http://nutch.apache.org/] > unknown field 'host' > at > org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:185) > at > org.apache.solr.update.AddUpdateCommand.getLuceneDocument(AddUpdateCommand.java:78) > at > org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:238) > at > org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:164) > at > org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:69) > at > org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:51) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:926) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1080) > at > org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:692) > at > org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100) > at > org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:247) > at > org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:174) > at > org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:99) > at > org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) > at > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1967) > at > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207) > at > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) > at > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) > at > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) > at > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) > at > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) > at > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) > at > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) > at > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) > at > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) > at > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) > at > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) > at org.eclipse.jetty.server.Server.handle(Server.java:368) > at > org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) > at > org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) > at > org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) > at > org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953) > at > org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) > at > org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) > at > org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) > at > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) > at > org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) > at java.lang.Thread.run(Thread.java:745) > > > -- Jonathan Cooper-Ellis *Data Engineer* myVBO, LLC dba Ziftr
