Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-05 Thread Ryan McKinley
: I had silent a error that I can't remember the details of, but it : was something like putting the for boost functions outside : the . It didn't blow up, but it was a nonsense config that : was accepted. again, there's nothing erroneous about having a outside of a when specifing the init par

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-05 Thread Chris Hostetter
: I had (minimum match) blow up at query time with a number : format exception (this is from memory). That's a RequestHandler specific request param that can also be specified as a default/invarient/appended init param ... i'm not sure that SolrCore could do much to validate that when parsing th

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-04 Thread Walter Underwood
On 3/4/07 3:01 PM, "Chris Hostetter" <[EMAIL PROTECTED]> wrote: > I'm actaully haven't a hard time thinking of what kinds of "just in time" > DOM walking is delayed until request ... all of the feld names are already > known, the analyzers are built, the requesthandlers and responsewriters > all e

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-04 Thread Chris Hostetter
: : > : Right now, Solr accesses the DOM as needed (at runtime) to fetch : > : information. There isn't much up-front checking beyond the XML : > : parser. : I was thinking of translating the config file into internal config : properties when it was read, and logging Solr specific errors then. : T

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-04 Thread Walter Underwood
On 3/3/07 1:43 PM, "Chris Hostetter" <[EMAIL PROTECTED]> wrote: > : Right now, Solr accesses the DOM as needed (at runtime) to fetch > : information. There isn't much up-front checking beyond the XML > : parser. > > bingo, and adding more upfront checking is hard for at least two reasons i > can

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Jed Reynolds
Chris Hostetter wrote: : I almost didn't notice the exception fly by because there's s much : log output, and I can see why I might not have noticed. Yay for you should be able to configure it to put WARNING and SEVERE messages in a seperate log file even. Certainly! I learned to r

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Ryan McKinley
On 3/3/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 3/3/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: > But MANY of the SolrExceptions use a status > code '1'. Hmmm, I did an audit of the exceptions before we entered the incubator, and I thought I caught all the ones that generated anything out

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Yonik Seeley
On 3/3/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: But MANY of the SolrExceptions use a status code '1'. Hmmm, I did an audit of the exceptions before we entered the incubator, and I thought I caught all the ones that generated anything out of the 400 and 500 range and could be thrown during a

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Ryan McKinley
For anyone not on the dev list, I just posted: http://issues.apache.org/jira/browse/SOLR-179 so it is not lost, I also posted Otis' bug report: http://issues.apache.org/jira/browse/SOLR-180

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Ryan McKinley
/update does send 200 even if there was an error. after SOLR-173 we may want to change the default solrconfig to map /update so that everything has a consistent error format. On 3/3/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 3/3/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: > Is there enou

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Ryan McKinley
On 3/3/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 3/3/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: > Is there enough general interest in having error response codes to > change the standard web.xml config to let the SolrDispatchFilter > handle /select? /select should already use HTTP error c

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Yonik Seeley
On 3/3/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: Is there enough general interest in having error response codes to change the standard web.xml config to let the SolrDispatchFilter handle /select? /select should already use HTTP error codes, right? -Yonik

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Ryan McKinley
There still may be a bug that Ryan mentioned about unknown fields simply being ignored, but that should be fixed if true. I just looked into this - /trunk code is fine. I wasn't noticing the errors because the response code is always 200 with an error included in the xml. My code was only ch

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Chris Hostetter
: Right now, Solr accesses the DOM as needed (at runtime) to fetch : information. There isn't much up-front checking beyond the XML : parser. bingo, and adding more upfront checking is hard for at least two reasons i can think of... 1) keeping a DTD up to date is a pain sa new features are added

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Chris Hostetter
: > I spent a long time tracking down an error with a document set with an : > uppercase field name to something configured with a lowercase field. : Isn't this the kind of error that XML validation is supposed to address? it could be ... except that: 1) we can't using standard DTD/XSD style v

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Chris Hostetter
: I almost didn't notice the exception fly by because there's s much : log output, and I can see why I might not have noticed. Yay for : scrollback! (Hrm, I might not have wanted to watch logging for 4 : instances of solr all at once. Might explain why so much logging.) FYI: Solr logs a lot o

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Yonik Seeley
On 3/3/07, Jed Reynolds <[EMAIL PROTECTED]> wrote: If dynamicField definitions are removed from the schema.xml file (and your fields are not referencing them), does this have the same effect of disabling unknown-field generation? Yes. You should get an error if you add a document with a field

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Jed Reynolds
Yonik Seeley wrote: On 3/2/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: How do you all feel about returning an error when you add a document with unknown fields? +1 dynamicField definitions can be used if desired (including "*" to match every undefined field). If dynamicField definitions ar

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Yonik Seeley
On 3/2/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: How do you all feel about returning an error when you add a document with unknown fields? +1 dynamicField definitions can be used if desired (including "*" to match every undefined field). -Yonik

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Walter Underwood
I was bit by this, tool. It made getting started a lot harder. I think I had something outside of an instead of inside. More recently, I got a query time exception from a mis-formatted field. Right now, Solr accesses the DOM as needed (at runtime) to fetch information. There isn't much up-front

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Jed Reynolds
Bertrand Delacretaz wrote: On 3/3/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: ...The rationale with the solrconfig stuff is that a broken config should behave as best it can. This is great if you are running a real site with people actively using it - it is a pain in the ass if you are getti

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-03 Thread Bertrand Delacretaz
On 3/3/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: ...The rationale with the solrconfig stuff is that a broken config should behave as best it can. This is great if you are running a real site with people actively using it - it is a pain in the ass if you are getting started and don't notice e

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-02 Thread Jed Reynolds
Ryan McKinley wrote: On 3/2/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 3/2/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: > The rationale with the solrconfig stuff is that a broken config should > behave as best it can. I don't think that's what I was actually going for in this instance (the

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-02 Thread Jed Reynolds
Ryan McKinley wrote: I almost didn't notice the exception fly by because there's s much log output, and I can see why I might not have noticed. Yay for scrollback! (Hrm, I might not have wanted to watch logging for 4 instances of solr all at once. Might explain why so much logging.) This h

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-02 Thread Ryan McKinley
On 3/2/07, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 3/2/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: > The rationale with the solrconfig stuff is that a broken config should > behave as best it can. I don't think that's what I was actually going for in this instance (the schema). I was focused

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-02 Thread Yonik Seeley
On 3/2/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: The rationale with the solrconfig stuff is that a broken config should behave as best it can. I don't think that's what I was actually going for in this instance (the schema). I was focused on getting correct stuff to work correctly, and worry

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-02 Thread Ryan McKinley
I almost didn't notice the exception fly by because there's s much log output, and I can see why I might not have noticed. Yay for scrollback! (Hrm, I might not have wanted to watch logging for 4 instances of solr all at once. Might explain why so much logging.) This has bitten me more then

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-02 Thread Jed Reynolds
Yonik Seeley wrote: If the actual schema was null, then that was probably some problem parsing the schema. If that's the case, hopefully you saw an exception in the logs on startup? Using apache-solr-1.1.0-incubating. Actually not at first, but now I do. But I've gone back and re-created

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-02 Thread Otis Gospodnetic
ers. Otis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Simpy -- http://www.simpy.com/ - Tag - Search - Share - Original Message From: Yonik Seeley <[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Sent: Friday, March 2, 2007 10:28:31 AM Subject: Re: merely a suggestion: schema.xml validator

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-02 Thread Yonik Seeley
Hi Jed, NullPointerException when adding a document w/o the uniqueKey field is a known bug, and should be fixed shortly. If the actual schema was null, then that was probably some problem parsing the schema. If that's the case, hopefully you saw an exception in the logs on startup? Anyway, I ag

Re: merely a suggestion: schema.xml validator or better schema validation logging

2007-03-01 Thread Bertrand Delacretaz
On 3/2/07, Jed Reynolds <[EMAIL PROTECTED]> wrote: ...my first try at defining a schema.xml file was tough because my only feedback for a long time was "NullPointerException" from SolrCore when I was trying to add content... Can you give us enough information to reproduce the problem? What was

merely a suggestion: schema.xml validator or better schema validation logging

2007-03-01 Thread Jed Reynolds
First time user. Not interested in flamewar, just making a suggestion. I just got Solr working with my own schema and it was only a little more mysterious than I expected, having previously dealth with Nutch. Solr is exactly what I wanted in terms of (theoretical) ease of configurability. How