You still seem to have 'fieldtype' with wrong case. Can you try that simple thing before doing other complicated steps? And yes, restart Solr after you change schema.xml
Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is the quality of nature that keeps events from happening all at once. Lately, it doesn't seem to be working. (Anonymous - via GTD book) On Wed, Apr 24, 2013 at 6:50 PM, Furkan KAMACI <furkankam...@gmail.com> wrote: > Here is my definition for handler: > > <requestHandler name="/update/extract" class="solr.extraction. > ExtractingRequestHandler" > > <lst name="defaults"> > <str name="fmap.content">text</str> > <str name="lowernames">true</str> > <str name="uprefix">attr_</str> > <str name="captureAttr">true</str> > </lst> > </requestHandler> > > > > > 2013/4/25 Furkan KAMACI <furkankam...@gmail.com> > >> I just want to search on rich documents but I still get same error. I have >> copied example folder into anywhere else at my computer. I have copied dist >> and contrib folders from my build folder into that copy of example folder >> (because solr-cell etc. are within that folders) However I still get same >> error. If any of you could help me you are welcome. Here is my schema: >> >> >> <?xml version="1.0" encoding="UTF-8" ?> >> <!-- >> Licensed to the Apache Software Foundation (ASF) under one or more >> contributor license agreements. See the NOTICE file distributed with >> this work for additional information regarding copyright ownership. >> The ASF licenses this file to You under the Apache License, Version 2.0 >> (the "License"); you may not use this file except in compliance with >> the License. You may obtain a copy of the License at >> >> http://www.apache.org/licenses/LICENSE-2.0 >> >> Unless required by applicable law or agreed to in writing, software >> distributed under the License is distributed on an "AS IS" BASIS, >> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. >> See the License for the specific language governing permissions and >> limitations under the License. >> --> >> <!-- >> Description: This document contains Solr 4.x schema definition to >> be used with Solr integration currently build into Nutch. >> This schema is not minimal, there are some useful field type definitions >> left, >> and the set of fields and their flags (indexed/stored/term vectors) can be >> further optimized depending on needs. See >> >> http://svn.apache.org/viewvc/lucene/dev/trunk/solr/example/solr/conf/schema.xml?view=markup >> for more info. >> --> >> >> <schema name="nutch" version="1.5"> >> >> <types> >> >> <!-- The StrField type is not analyzed, but indexed/stored verbatim. --> >> <fieldType name="string" class="solr.StrField" sortMissingLast="true" >> omitNorms="true"/> >> >> >> <!-- >> Default numeric field types. For faster range queries, consider the >> tint/tfloat/tlong/tdouble types. >> --> >> <fieldType name="int" class="solr.TrieIntField" precisionStep="0" >> omitNorms="true" positionIncrementGap="0"/> >> <fieldType name="float" class="solr.TrieFloatField" precisionStep="0" >> omitNorms="true" positionIncrementGap="0"/> >> <fieldType name="long" class="solr.TrieLongField" precisionStep="0" >> omitNorms="true" positionIncrementGap="0"/> >> <fieldType name="double" class="solr.TrieDoubleField" precisionStep="0" >> omitNorms="true" positionIncrementGap="0"/> >> >> <!-- >> Numeric field types that index each value at various levels of precision >> to accelerate range queries when the number of values between the range >> endpoints is large. See the javadoc for NumericRangeQuery for internal >> implementation details. >> >> Smaller precisionStep values (specified in bits) will lead to more tokens >> indexed per value, slightly larger index size, and faster range queries. >> A precisionStep of 0 disables indexing at different precision levels. >> --> >> <fieldType name="tint" class="solr.TrieIntField" precisionStep="8" >> omitNorms="true" positionIncrementGap="0"/> >> <fieldType name="tfloat" class="solr.TrieFloatField" precisionStep="8" >> omitNorms="true" positionIncrementGap="0"/> >> <fieldType name="tlong" class="solr.TrieLongField" precisionStep="8" >> omitNorms="true" positionIncrementGap="0"/> >> <fieldType name="tdouble" class="solr.TrieDoubleField" precisionStep="8" >> omitNorms="true" positionIncrementGap="0"/> >> >> <!-- The format for this date field is of the form 1995-12-31T23:59:59Z, >> and >> is a more restricted form of the canonical representation of dateTime >> http://www.w3.org/TR/xmlschema-2/#dateTime >> The trailing "Z" designates UTC time and is mandatory. >> Optional fractional seconds are allowed: 1995-12-31T23:59:59.999Z >> All other components are mandatory. >> >> Expressions can also be used to denote calculations that should be >> performed relative to "NOW" to determine the value, ie... >> >> NOW/HOUR >> ... Round to the start of the current hour >> NOW-1DAY >> ... Exactly 1 day prior to now >> NOW/DAY+6MONTHS+3DAYS >> ... 6 months and 3 days in the future from the start of >> the current day >> >> Consult the DateField javadocs for more information. >> >> Note: For faster range queries, consider the tdate type >> --> >> <fieldType name="date" class="solr.TrieDateField" omitNorms="true" >> precisionStep="0" positionIncrementGap="0"/> >> >> <!-- A Trie based date field for faster date range queries and date >> faceting. --> >> <fieldType name="tdate" class="solr.TrieDateField" omitNorms="true" >> precisionStep="6" positionIncrementGap="0"/> >> >> >> <!-- solr.TextField allows the specification of custom text analyzers >> specified as a tokenizer and a list of token filters. Different >> analyzers may be specified for indexing and querying. >> >> The optional positionIncrementGap puts space between multiple fields of >> this type on the same document, with the purpose of preventing false phrase >> matching across fields. >> >> For more info on customizing your analyzer chain, please see >> http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters >> --> >> >> <!-- A general text field that has reasonable, generic >> cross-language defaults: it tokenizes with StandardTokenizer, >> removes stop words from case-insensitive "stopwords.txt" >> (empty by default), and down cases. At query time only, it >> also applies synonyms. --> >> <fieldType name="text_general" class="solr.TextField" >> positionIncrementGap="100"> >> <analyzer type="index"> >> <tokenizer class="solr.StandardTokenizerFactory"/> >> <filter class="solr.StopFilterFactory" ignoreCase="true" >> words="stopwords.txt" enablePositionIncrements="true" /> >> <!-- in this example, we will only use synonyms at query time >> <filter class="solr.SynonymFilterFactory" synonyms="index_synonyms.txt" >> ignoreCase="true" expand="false"/> >> --> >> <filter class="solr.LowerCaseFilterFactory"/> >> </analyzer> >> <analyzer type="query"> >> <tokenizer class="solr.StandardTokenizerFactory"/> >> <filter class="solr.StopFilterFactory" ignoreCase="true" >> words="stopwords.txt" enablePositionIncrements="true" /> >> <filter class="solr.SynonymFilterFactory" synonyms="synonyms.txt" >> ignoreCase="true" expand="true"/> >> <filter class="solr.LowerCaseFilterFactory"/> >> </analyzer> >> </fieldType> >> >> <!-- A text field with defaults appropriate for English: it >> tokenizes with StandardTokenizer, removes English stop words >> (stopwords.txt), down cases, protects words from protwords.txt, and >> finally applies Porter's stemming. The query time analyzer >> also applies synonyms from synonyms.txt. --> >> <fieldType name="text_en" class="solr.TextField" >> positionIncrementGap="100"> >> <analyzer type="index"> >> <tokenizer class="solr.StandardTokenizerFactory"/> >> <!-- in this example, we will only use synonyms at query time >> <filter class="solr.SynonymFilterFactory" synonyms="index_synonyms.txt" >> ignoreCase="true" expand="false"/> >> --> >> <!-- Case insensitive stop word removal. >> add enablePositionIncrements=true in both the index and query >> analyzers to leave a 'gap' for more accurate phrase queries. >> --> >> <filter class="solr.StopFilterFactory" >> ignoreCase="true" >> words="stopwords.txt" >> enablePositionIncrements="true" >> /> >> <filter class="solr.LowerCaseFilterFactory"/> >> <filter class="solr.EnglishPossessiveFilterFactory"/> >> <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/> >> <!-- Optionally you may want to use this less aggressive stemmer instead >> of PorterStemFilterFactory: >> <filter class="solr.EnglishMinimalStemFilterFactory"/> >> --> >> <filter class="solr.PorterStemFilterFactory"/> >> </analyzer> >> <analyzer type="query"> >> <tokenizer class="solr.StandardTokenizerFactory"/> >> <filter class="solr.SynonymFilterFactory" synonyms="synonyms.txt" >> ignoreCase="true" expand="true"/> >> <filter class="solr.StopFilterFactory" >> ignoreCase="true" >> words="stopwords.txt" >> enablePositionIncrements="true" >> /> >> <filter class="solr.LowerCaseFilterFactory"/> >> <filter class="solr.EnglishPossessiveFilterFactory"/> >> <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/> >> <!-- Optionally you may want to use this less aggressive stemmer instead >> of PorterStemFilterFactory: >> <filter class="solr.EnglishMinimalStemFilterFactory"/> >> --> >> <filter class="solr.PorterStemFilterFactory"/> >> </analyzer> >> </fieldType> >> >> <!-- A text field with defaults appropriate for English, plus >> aggressive word-splitting and autophrase features enabled. >> This field is just like text_en, except it adds >> WordDelimiterFilter to enable splitting and matching of >> words on case-change, alpha numeric boundaries, and >> non-alphanumeric chars. This means certain compound word >> cases will work, for example query "wi fi" will match >> document "WiFi" or "wi-fi". However, other cases will still >> not match, for example if the query is "wifi" and the >> document is "wi fi" or if the query is "wi-fi" and the >> document is "wifi". >> --> >> <fieldType name="text_en_splitting" class="solr.TextField" >> positionIncrementGap="100" autoGeneratePhraseQueries="true"> >> <analyzer type="index"> >> <tokenizer class="solr.WhitespaceTokenizerFactory"/> >> <!-- in this example, we will only use synonyms at query time >> <filter class="solr.SynonymFilterFactory" synonyms="index_synonyms.txt" >> ignoreCase="true" expand="false"/> >> --> >> <!-- Case insensitive stop word removal. >> add enablePositionIncrements=true in both the index and query >> analyzers to leave a 'gap' for more accurate phrase queries. >> --> >> <filter class="solr.StopFilterFactory" >> ignoreCase="true" >> words="stopwords.txt" >> enablePositionIncrements="true" >> /> >> <filter class="solr.WordDelimiterFilterFactory" generateWordParts="1" >> generateNumberParts="1" catenateWords="1" catenateNumbers="1" >> catenateAll="0" splitOnCaseChange="1"/> >> <filter class="solr.LowerCaseFilterFactory"/> >> <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/> >> <filter class="solr.PorterStemFilterFactory"/> >> </analyzer> >> <analyzer type="query"> >> <tokenizer class="solr.WhitespaceTokenizerFactory"/> >> <filter class="solr.SynonymFilterFactory" synonyms="synonyms.txt" >> ignoreCase="true" expand="true"/> >> <filter class="solr.StopFilterFactory" >> ignoreCase="true" >> words="stopwords.txt" >> enablePositionIncrements="true" >> /> >> <filter class="solr.WordDelimiterFilterFactory" generateWordParts="1" >> generateNumberParts="1" catenateWords="0" catenateNumbers="0" >> catenateAll="0" splitOnCaseChange="1"/> >> <filter class="solr.LowerCaseFilterFactory"/> >> <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/> >> <filter class="solr.PorterStemFilterFactory"/> >> </analyzer> >> </fieldType> >> >> <!-- Less flexible matching, but less false matches. Probably not ideal >> for product names, >> but may be good for SKUs. Can insert dashes in the wrong place and still >> match. --> >> <fieldType name="text_en_splitting_tight" class="solr.TextField" >> positionIncrementGap="100" autoGeneratePhraseQueries="true"> >> <analyzer> >> <tokenizer class="solr.WhitespaceTokenizerFactory"/> >> <filter class="solr.SynonymFilterFactory" synonyms="synonyms.txt" >> ignoreCase="true" expand="false"/> >> <filter class="solr.StopFilterFactory" ignoreCase="true" >> words="stopwords.txt"/> >> <filter class="solr.WordDelimiterFilterFactory" generateWordParts="0" >> generateNumberParts="0" catenateWords="1" catenateNumbers="1" >> catenateAll="0"/> >> <filter class="solr.LowerCaseFilterFactory"/> >> <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/> >> <filter class="solr.EnglishMinimalStemFilterFactory"/> >> <!-- this filter can remove any duplicate tokens that appear at the same >> position - sometimes >> possible with WordDelimiterFilter in conjuncton with stemming. --> >> <filter class="solr.RemoveDuplicatesTokenFilterFactory"/> >> </analyzer> >> </fieldType> >> >> <!-- Just like text_general except it reverses the characters of >> each token, to enable more efficient leading wildcard queries. --> >> <fieldType name="text_general_rev" class="solr.TextField" >> positionIncrementGap="100"> >> <analyzer type="index"> >> <tokenizer class="solr.StandardTokenizerFactory"/> >> <filter class="solr.StopFilterFactory" ignoreCase="true" >> words="stopwords.txt" enablePositionIncrements="true" /> >> <filter class="solr.LowerCaseFilterFactory"/> >> <filter class="solr.ReversedWildcardFilterFactory" withOriginal="true" >> maxPosAsterisk="3" maxPosQuestion="2" maxFractionAsterisk="0.33"/> >> </analyzer> >> <analyzer type="query"> >> <tokenizer class="solr.StandardTokenizerFactory"/> >> <filter class="solr.SynonymFilterFactory" synonyms="synonyms.txt" >> ignoreCase="true" expand="true"/> >> <filter class="solr.StopFilterFactory" ignoreCase="true" >> words="stopwords.txt" enablePositionIncrements="true" /> >> <filter class="solr.LowerCaseFilterFactory"/> >> </analyzer> >> </fieldType> >> >> <fieldtype name="phonetic" stored="false" indexed="true" >> class="solr.TextField" > >> <analyzer> >> <tokenizer class="solr.StandardTokenizerFactory"/> >> <filter class="solr.DoubleMetaphoneFilterFactory" inject="false"/> >> </analyzer> >> </fieldtype> >> >> <fieldtype name="payloads" stored="false" indexed="true" >> class="solr.TextField" > >> <analyzer> >> <tokenizer class="solr.WhitespaceTokenizerFactory"/> >> <!-- >> The DelimitedPayloadTokenFilter can put payloads on tokens... for example, >> a token of "foo|1.4" would be indexed as "foo" with a payload of 1.4f >> Attributes of the DelimitedPayloadTokenFilterFactory : >> "delimiter" - a one character delimiter. Default is | (pipe) >> "encoder" - how to encode the following value into a playload >> float -> org.apache.lucene.analysis.payloads.FloatEncoder, >> integer -> o.a.l.a.p.IntegerEncoder >> identity -> o.a.l.a.p.IdentityEncoder >> Fully Qualified class name implementing PayloadEncoder, Encoder must have >> a no arg constructor. >> --> >> <filter class="solr.DelimitedPayloadTokenFilterFactory" encoder="float"/> >> </analyzer> >> </fieldtype> >> >> <!-- lowercases the entire field value, keeping it as a single token. --> >> <fieldType name="lowercase" class="solr.TextField" >> positionIncrementGap="100"> >> <analyzer> >> <tokenizer class="solr.KeywordTokenizerFactory"/> >> <filter class="solr.LowerCaseFilterFactory" /> >> </analyzer> >> </fieldType> >> >> <fieldType name="url" class="solr.TextField" positionIncrementGap="100"> >> <analyzer> >> <tokenizer class="solr.StandardTokenizerFactory"/> >> <filter class="solr.LowerCaseFilterFactory"/> >> <filter class="solr.WordDelimiterFilterFactory" generateWordParts="1" >> generateNumberParts="1"/> >> </analyzer> >> </fieldType> >> >> >> <fieldType name="text_path" class="solr.TextField" >> positionIncrementGap="100"> >> <analyzer> >> <tokenizer class="solr.PathHierarchyTokenizerFactory"/> >> </analyzer> >> </fieldType> >> >> <!-- since fields of this type are by default not stored or indexed, >> any data added to them will be ignored outright. --> >> <fieldtype name="ignored" stored="false" indexed="false" >> multiValued="true" class="solr.StrField" /> >> >> </types> >> >> <fields> >> <field name="id" type="string" indexed="true" stored="true" >> required="true" multiValued="false" /> >> <field name="text" type="text_general" indexed="true" stored="true"/> >> <dynamicField name="attr_*" type="text_general" indexed="true" >> stored="true" multiValued="true"/> >> <!-- Common metadata fields, named specifically to match up with >> SolrCell metadata when parsing rich documents such as Word, PDF. >> Some fields are multiValued only because Tika currently may return >> multiple values for them. Some metadata is parsed from the documents, >> but there are some which come from the client context: >> "content_type": From the HTTP headers of incoming stream >> "resourcename": From SolrCell request param resource.name >> --> >> <field name="title" type="text_general" indexed="true" stored="true" >> multiValued="true"/> >> <field name="subject" type="text_general" indexed="true" stored="true"/> >> <field name="description" type="text_general" indexed="true" >> stored="true"/> >> <field name="comments" type="text_general" indexed="true" stored="true"/> >> <field name="author" type="text_general" indexed="true" stored="true"/> >> <field name="keywords" type="text_general" indexed="true" stored="true"/> >> <field name="category" type="text_general" indexed="true" stored="true"/> >> <field name="resourcename" type="text_general" indexed="true" >> stored="true"/> >> <field name="url" type="text_general" indexed="true" stored="true"/> >> <field name="content_type" type="string" indexed="true" stored="true" >> multiValued="true"/> >> <field name="last_modified" type="date" indexed="true" stored="true"/> >> <field name="links" type="string" indexed="true" stored="true" >> multiValued="true"/> >> >> <!-- Main body of document extracted by SolrCell. >> NOTE: This field is not indexed by default, since it is also copied to >> "text" >> using copyField below. This is to save space. Use this field for returning >> and >> highlighting document content. Use the "text" field to search the content. >> --> >> <field name="content" type="text_general" indexed="false" stored="true" >> multiValued="true"/> >> >> <field name="_version_" type="long" indexed="true" stored="true"/> >> >> <dynamicField name="*" type="ignored" multiValued="true"/> >> </fields> >> >> <uniqueKey>id</uniqueKey> >> <defaultSearchField>text</defaultSearchField> >> <solrQueryParser defaultOperator="OR"/> >> >> <!-- Text fields from SolrCell to search by default in our catch-all field >> --> >> <copyField source="title" dest="text"/> >> <copyField source="author" dest="text"/> >> <copyField source="description" dest="text"/> >> <copyField source="keywords" dest="text"/> >> <copyField source="content" dest="text"/> >> <copyField source="content_type" dest="text"/> >> <copyField source="resourcename" dest="text"/> >> <copyField source="url" dest="text"/> >> >> <!-- Create a string version of author for faceting --> >> <copyField source="author" dest="author_s"/> >> >> </schema> >> >> >> >> >> 2013/4/25 Erik Hatcher <erik.hatc...@gmail.com> >> >>> Did you restart after adding those fields and types? >>> >>> On Apr 24, 2013, at 16:59, Furkan KAMACI <furkankam...@gmail.com> wrote: >>> >>> > I have added that fields: >>> > >>> > <field name="text" type="text_general" indexed="true" stored="true"/> >>> > <dynamicField name="attr_*" type="text_general" indexed="true" >>> > stored="true" multiValued="true"/> >>> > <dynamicField name="ignored_*" type="ignored"/> >>> > >>> > and I have that definition: >>> > >>> > <fieldtype name="ignored" stored="false" indexed="false" >>> multiValued="true" >>> > class="solr.StrField" /> >>> > >>> > here is my error: >>> > >>> > <?xml version="1.0" encoding="UTF-8"?> >>> > <response> >>> > <lst name="responseHeader"> >>> > <int name="status">400</int> >>> > <int name="QTime">4154</int> >>> > </lst> >>> > <lst name="error"> >>> > <str name="msg">ERROR: [doc=1] unknown field 'ignored_meta'</str> >>> > <int name="code">400</int> >>> > </lst> >>> > </response> >>> > >>> > What should I do more? >>> > >>> > 2013/4/24 Erik Hatcher <erik.hatc...@gmail.com> >>> > >>> >> Also, at Solr startup time it logs what it loads from those <lib> >>> >> elements, so you can see whether it is loading the files you intend to >>> or >>> >> not. >>> >> >>> >> Erik >>> >> >>> >> On Apr 24, 2013, at 10:05 , Alexandre Rafalovitch wrote: >>> >> >>> >>> Have you tried using absolute path to the relevant urls? That will >>> >>> cleanly split the problem into 'still not working' and 'wrong relative >>> >>> path'. >>> >>> >>> >>> Regards, >>> >>> Alex. >>> >>> On Wed, Apr 24, 2013 at 9:02 AM, Furkan KAMACI < >>> furkankam...@gmail.com> >>> >> wrote: >>> >>>> <lib dir="../../../contrib/extraction/lib" regex=".*\.jar" /> >>> >>>> <lib dir="../../../dist/" regex="solr-cell-\d.*\.jar" /> >>> >>> >>> >>> >>> >>> >>> >>> Personal blog: http://blog.outerthoughts.com/ >>> >>> LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch >>> >>> - Time is the quality of nature that keeps events from happening all >>> >>> at once. Lately, it doesn't seem to be working. (Anonymous - via GTD >>> >>> book) >>> >> >>> >> >>> >> >>
