Definitely a separate query log. solrconfig.xml could have a tag <queryLog
format="plain">${solr.query.log}</queryLog>
For me the one-line request-log format with Solr extensions works well enough.
But perhaps have a way to specify what IP address to log in the file. It's not
that useful to log the web frontend's address, so an option to pick up the
X-Forwarded-For header or similar would be nice.
By default the query logs could end up in ${solr.data.dir} with name
<core>-querylog-YYMMDD.log and auto rotate daily. For back compat there should
be a way to continue logging queries through slf4j as today, but that should be
off by default.
--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com
Solr Training - www.solrtraining.com
20. mars 2013 kl. 01:03 skrev Ryan McKinley <[email protected]>:
> > And we need to move the query logging to it's own structured log :)
>
> What are your thoughts here? This is something I have toyed with at the
> application level -- actually indexing each query+result count. Do you think
> this is appropriate infrastructure in solr?
>
>
>
> On Tue, Mar 19, 2013 at 4:57 PM, Mark Miller <[email protected]> wrote:
> I think we do too much logging on doc adds by default, but that a lot of the
> other stuff is much less frequent and much the information more useful than
> not when people run into trouble and can't just reproduce after turning on
> debug logging.
>
> I'm for removing stuff that's too chatty, but it sounds like you probably
> have a more minimalist stance than I do. I prefer somewhat verbose logs for
> the user mailing list when the events are not common. There is a risk of that
> being too much for sure, but I see a risk in it being too little as well.
>
> And we need to move the query logging to it's own structured log :)
>
> - Mark
>
> On Mar 19, 2013, at 7:43 PM, Jan Høydahl <[email protected]> wrote:
>
> > Hi,
> >
> > I think Solr is too verbose on default INFO logging.
> > Time to do a major cleanup and move a bunch of INFO --> DEBUG and probably
> > ERROR-->WARN, WARN-->INFO too...
> >
> > What we need on INFO is mostly major things, like
> > * Solr/Lucene version, JRE version
> > * Echo startup params and java opts
> > * SOLR_HOME location
> > * Core x (re)loaded with X documents
> > * Whether in ZK mode or local mode, name of zkHosts
> > * plus some more
> >
> >
> > There's a whole lot of stuff printed on INFO which could go to DEBUG if you
> > need it:
> >
> > Mar 20, 2013 12:25:37 AM org.apache.solr.common.cloud.SolrZkClient makePath
> > INFO: makePath: /configs/lab/addresssynonyms.txt
> > Mar 20, 2013 12:25:37 AM org.apache.solr.common.cloud.SolrZkClient makePath
> > INFO: makePath: /configs/lab/admin-extra.html
> > Mar 20, 2013 12:25:37 AM org.apache.solr.common.cloud.SolrZkClient makePath
> > INFO: makePath: /configs/lab/admin-extra.menu-bottom.html
> > Mar 20, 2013 12:25:37 AM org.apache.solr.common.cloud.SolrZkClient makePath
> > INFO: makePath: /configs/lab/admin-extra.menu-top.html
> > ...
> > ...
> > Mar 20, 2013 12:25:30 AM
> > org.apache.solr.handler.component.HttpShardHandlerFactory getParameter
> > INFO: Setting socketTimeout to: 0
> > Mar 20, 2013 12:25:30 AM
> > org.apache.solr.handler.component.HttpShardHandlerFactory getParameter
> > INFO: Setting urlScheme to: http://
> > Mar 20, 2013 12:25:30 AM
> > org.apache.solr.handler.component.HttpShardHandlerFactory getParameter
> > INFO: Setting connTimeout to: 0
> > Mar 20, 2013 12:25:30 AM
> > org.apache.solr.handler.component.HttpShardHandlerFactory getParameter
> > INFO: Setting maxConnectionsPerHost to: 20
> > Mar 20, 2013 12:25:30 AM
> > org.apache.solr.handler.component.HttpShardHandlerFactory getParameter
> > INFO: Setting corePoolSize to: 0
> > ...
> > ...
> > Mar 20, 2013 12:25:30 AM org.apache.zookeeper.Environment logEnv
> > INFO: Server
> > environment:java.io.tmpdir=/var/folders/sg/zdchfvbs7k5c4hcg374z45_40000gp/T/
> > Mar 20, 2013 12:25:30 AM org.apache.zookeeper.Environment logEnv
> > INFO: Server environment:java.compiler=<NA>
> > Mar 20, 2013 12:25:30 AM org.apache.zookeeper.Environment logEnv
> > INFO: Server environment:os.name=Mac OS X
> > Mar 20, 2013 12:25:30 AM org.apache.zookeeper.Environment logEnv
> > INFO: Server environment:os.arch=x86_64
> > ...
> >
> >
> > --
> > Jan Høydahl, search solution architect
> > Cominvent AS - www.cominvent.com
> > Solr Training - www.solrtraining.com
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: [email protected]
> > For additional commands, e-mail: [email protected]
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [email protected]
> For additional commands, e-mail: [email protected]
>
>
