I'd have to put some thought into this. The problem with timeAllowed is that it won't return all the results. So if you're using timeAllowed and performing a join or aggregation it will just give incorrect answers. I'm not we want to have that.
Joel Bernstein http://joelsolr.blogspot.com/ On Sat, Jan 21, 2017 at 9:51 PM, radha krishnan <[email protected]> wrote: > can you give some estimate on when they will be compatible . with out this, > we cannot use timeAllowed with the map reduce mode of /sql handler right > > Thanks, > Radhakrishnan D > > > On Sat, Jan 21, 2017 at 6:03 PM, Joel Bernstein <[email protected]> > wrote: > > > I'm pretty sure that time allowed and the /export handler are not > currently > > compatible. > > > > Joel Bernstein > > http://joelsolr.blogspot.com/ > > > > On Fri, Jan 20, 2017 at 8:57 PM, radha krishnan < > > [email protected]> > > wrote: > > > > > Hi, > > > > > > am trying to query a core with 60 million docs by specifying > timeAllowed > > as > > > 100 ms just to test the timeAllowed feature. > > > > > > This is the query > > > > > > http://10.20.132.162:8983/solr/large_core/export?indent= > > > on&q=*:*&distrib=false&fl=logtype&timeAllowed=100&sort= > > > logtype+asc&wt=json&version=2.2 > > > > > > when i ran in the browser, i got the below NPE > > > > > > the /export query has 17 million docs has hits but there was an NPE > > after > > > the /export was called. > > > > > > Can you tell if any thing is wrong in the query or is there is a known > > bug > > > for the NPE > > > > > > HTTP ERROR 500 > > > > > > Problem accessing /solr/logs_core_new/export. Reason: > > > > > > {trace=java.lang.NullPointerException > > > at org.apache.lucene.util.BitSetIterator.<init>( > > > BitSetIterator.java:61) > > > at org.apache.solr.response.SortingResponseWriter.write( > > > SortingResponseWriter.java:176) > > > at org.apache.solr.response.QueryResponseWriterUtil. > > > writeQueryResponse(QueryResponseWriterUtil.java:65) > > > at org.apache.solr.servlet.HttpSolrCall.writeResponse( > > > HttpSolrCall.java:728) > > > at org.apache.solr.servlet.HttpSolrCall.call( > > > HttpSolrCall.java:469) > > > at org.apache.solr.servlet.SolrDispatchFilter.doFilter( > > > SolrDispatchFilter.java:303) > > > at org.apache.solr.servlet.SolrDispatchFilter.doFilter( > > > SolrDispatchFilter.java:254) > > > at org.eclipse.jetty.servlet.ServletHandler$CachedChain. > > > doFilter(ServletHandler.java:1668) > > > at org.eclipse.jetty.servlet.ServletHandler.doHandle( > > > ServletHandler.java:581) > > > at org.eclipse.jetty.server.handler.ScopedHandler.handle( > > > ScopedHandler.java:143) > > > at org.eclipse.jetty.security.SecurityHandler.handle( > > > SecurityHandler.java:548) > > > at org.eclipse.jetty.server.session.SessionHandler. > > > doHandle(SessionHandler.java:226) > > > at org.eclipse.jetty.server.handler.ContextHandler. > > > doHandle(ContextHandler.java:1160) > > > at org.eclipse.jetty.servlet.ServletHandler.doScope( > > > ServletHandler.java:511) > > > at org.eclipse.jetty.server.session.SessionHandler. > > > doScope(SessionHandler.java:185) > > > at org.eclipse.jetty.server.handler.ContextHandler. > > > doScope(ContextHandler.java:1092) > > > at org.eclipse.jetty.server.handler.ScopedHandler.handle( > > > ScopedHandler.java:141) > > > at org.eclipse.jetty.server.handler.ContextHandlerCollection. > > > handle(ContextHandlerCollection.java:213) > > > at org.eclipse.jetty.server.handler.HandlerCollection. > > > handle(HandlerCollection.java:119) > > > at org.eclipse.jetty.server.handler.HandlerWrapper.handle( > > > HandlerWrapper.java:134) > > > at org.eclipse.jetty.server.Server.handle(Server.java:518) > > > at org.eclipse.jetty.server.HttpChannel.handle( > > > HttpChannel.java:308) > > > at org.eclipse.jetty.server.HttpConnection.onFillable( > > > HttpConnection.java:244) > > > at org.eclipse.jetty.io.AbstractConnection$ > > ReadCallback.succeeded( > > > AbstractConnection.java:273) > > > at org.eclipse.jetty.io.FillInterest.fillable( > > > FillInterest.java:95) > > > at org.eclipse.jetty.io.SelectChannelEndPoint$2.run( > > > SelectChannelEndPoint.java:93) > > > at org.eclipse.jetty.util.thread.strategy. > ExecuteProduceConsume. > > > produceAndRun(ExecuteProduceConsume.java:246) > > > at org.eclipse.jetty.util.thread.strategy. > > > ExecuteProduceConsume.run(ExecuteProduceConsume.java:156) > > > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob( > > > QueuedThreadPool.java:654) > > > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run( > > > QueuedThreadPool.java:572) > > > at java.lang.Thread.run(Thread.java:745) > > > ,code=500} > > > > > > > > > > > > RELATED SERVER LOGS > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > 2017-01-21 01:55:12.257 WARN (qtp1397616978-21) [ x:logs_core_new] > > > org.apache.solr.search.SolrIndexSearcher Query: []; Elapsed time: 120. > > > Exceeded allowed search time: 100 ms. > > > > > > 2017-01-21 01:55:12.258 INFO (qtp1397616978-21) [ x:logs_core_new] > > > org.apache.solr.core.SolrCore.Request [logs_core_new] webapp=/solr > > > path=/export params={q=*:*&distrib=false&indent=on&fl=vmw_vr_ops_ > > > logtype&timeAllowed=100&sort=vmw_vr_ops_logtype+asc&wt= > json&version=2.2} > > > hits=17579862 status=0 QTime=120 > > > > > > 2017-01-21 01:55:12.718 ERROR (qtp1397616978-21) [ x:logs_core_new] > > > org.apache.solr.servlet.HttpSolrCall > > > null:java.lang.NullPointerException > > > > > > at org.apache.lucene.util.BitSetIterator.<init>( > > > BitSetIterator.java:61) > > > > > > at org.apache.solr.response.SortingResponseWriter.write( > > > SortingResponseWriter.java:176) > > > > > > at org.apache.solr.response.QueryResponseWriterUtil. > > > writeQueryResponse(QueryResponseWriterUtil.java:65) > > > > > > at org.apache.solr.servlet.HttpSolrCall.writeResponse( > > > HttpSolrCall.java:728) > > > > > > at org.apache.solr.servlet.HttpSolrCall.call( > > > HttpSolrCall.java:469) > > > > > > at org.apache.solr.servlet.SolrDispatchFilter.doFilter( > > > SolrDispatchFilter.java:303) > > > > > > at org.apache.solr.servlet.SolrDispatchFilter.doFilter( > > > SolrDispatchFilter.java:254) > > > > > > at org.eclipse.jetty.servlet.ServletHandler$CachedChain. > > > doFilter(ServletHandler.java:1668) > > > > > > at org.eclipse.jetty.servlet.ServletHandler.doHandle( > > > ServletHandler.java:581) > > > > > > at org.eclipse.jetty.server.handler.ScopedHandler.handle( > > > ScopedHandler.java:143) > > > > > > at org.eclipse.jetty.security.SecurityHandler.handle( > > > SecurityHandler.java:548) > > > > > > at org.eclipse.jetty.server.session.SessionHandler. > > > doHandle(SessionHandler.java:226) > > > > > > at org.eclipse.jetty.server.handler.ContextHandler. > > > doHandle(ContextHandler.java:1160) > > > > > > at org.eclipse.jetty.servlet.ServletHandler.doScope( > > > ServletHandler.java:511) > > > > > > at org.eclipse.jetty.server.session.SessionHandler. > > > doScope(SessionHandler.java:185) > > > > > > at org.eclipse.jetty.server.handler.ContextHandler. > > > doScope(ContextHandler.java:1092) > > > > > > at org.eclipse.jetty.server.handler.ScopedHandler.handle( > > > ScopedHandler.java:141) > > > > > > at org.eclipse.jetty.server.handler.ContextHandlerCollection. > > > handle(ContextHandlerCollection.java:213) > > > > > > at org.eclipse.jetty.server.handler.HandlerCollection. > > > handle(HandlerCollection.java:119) > > > > > > at org.eclipse.jetty.server.handler.HandlerWrapper.handle( > > > HandlerWrapper.java:134) > > > > > > at org.eclipse.jetty.server.Server.handle(Server.java:518) > > > > > > at org.eclipse.jetty.server.HttpChannel.handle( > > > HttpChannel.java:308) > > > > > > at org.eclipse.jetty.server.HttpConnection.onFillable( > > > HttpConnection.java:244) > > > > > > at org.eclipse.jetty.io.AbstractConnection$ > > ReadCallback.succeeded( > > > AbstractConnection.java:273) > > > > > > at org.eclipse.jetty.io.FillInterest.fillable( > > > FillInterest.java:95) > > > > > > at org.eclipse.jetty.io.SelectChannelEndPoint$2.run( > > > SelectChannelEndPoint.java:93) > > > > > > at org.eclipse.jetty.util.thread.strategy. > ExecuteProduceConsume. > > > produceAndRun(ExecuteProduceConsume.java:246) > > > > > > at org.eclipse.jetty.util.thread.strategy. > > > ExecuteProduceConsume.run(ExecuteProduceConsume.java:156) > > > > > > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob( > > > QueuedThreadPool.java:654) > > > > > > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run( > > > QueuedThreadPool.java:572) > > > > > > at java.lang.Thread.run(Thread.java:745) > > > > > > > > > 2017-01-21 01:55:12.719 ERROR (qtp1397616978-21) [ x:logs_core_new] > > > org.apache.solr.servlet.HttpSolrCall > > > null:java.lang.NullPointerException > > > > > > at org.apache.lucene.util.BitSetIterator.<init>( > > > BitSetIterator.java:61) > > > > > > at org.apache.solr.response.SortingResponseWriter.write( > > > SortingResponseWriter.java:176) > > > > > > at org.apache.solr.response.QueryResponseWriterUtil. > > > writeQueryResponse(QueryResponseWriterUtil.java:65) > > > > > > at org.apache.solr.servlet.HttpSolrCall.writeResponse( > > > HttpSolrCall.java:728) > > > > > > at org.apache.solr.servlet.HttpSolrCall.call( > > > HttpSolrCall.java:469) > > > > > > at org.apache.solr.servlet.SolrDispatchFilter.doFilter( > > > SolrDispatchFilter.java:303) > > > > > > at org.apache.solr.servlet.SolrDispatchFilter.doFilter( > > > SolrDispatchFilter.java:254) > > > > > > at org.eclipse.jetty.servlet.ServletHandler$CachedChain. > > > doFilter(ServletHandler.java:1668) > > > > > > at org.eclipse.jetty.servlet.ServletHandler.doHandle( > > > ServletHandler.java:581) > > > > > > at org.eclipse.jetty.server.handler.ScopedHandler.handle( > > > ScopedHandler.java:143) > > > > > > at org.eclipse.jetty.security.SecurityHandler.handle( > > > SecurityHandler.java:548) > > > > > > at org.eclipse.jetty.server.session.SessionHandler. > > > doHandle(SessionHandler.java:226) > > > > > > at org.eclipse.jetty.server.handler.ContextHandler. > > > doHandle(ContextHandler.java:1160) > > > > > > at org.eclipse.jetty.servlet.ServletHandler.doScope( > > > ServletHandler.java:511) > > > > > > at org.eclipse.jetty.server.session.SessionHandler. > > > doScope(SessionHandler.java:185) > > > > > > at org.eclipse.jetty.server.handler.ContextHandler. > > > doScope(ContextHandler.java:1092) > > > > > > at org.eclipse.jetty.server.handler.ScopedHandler.handle( > > > ScopedHandler.java:141) > > > > > > at org.eclipse.jetty.server.handler.ContextHandlerCollection. > > > handle(ContextHandlerCollection.java:213) > > > > > > at org.eclipse.jetty.server.handler.HandlerCollection. > > > handle(HandlerCollection.java:119) > > > > > > at org.eclipse.jetty.server.handler.HandlerWrapper.handle( > > > HandlerWrapper.java:134) > > > > > > at org.eclipse.jetty.server.Server.handle(Server.java:518) > > > > > > at org.eclipse.jetty.server.HttpChannel.handle( > > > HttpChannel.java:308) > > > > > > at org.eclipse.jetty.server.HttpConnection.onFillable( > > > HttpConnection.java:244) > > > > > > at org.eclipse.jetty.io.AbstractConnection$ > > ReadCallback.succeeded( > > > AbstractConnection.java:273) > > > > > > at org.eclipse.jetty.io.FillInterest.fillable( > > > FillInterest.java:95) > > > > > > at org.eclipse.jetty.io.SelectChannelEndPoint$2.run( > > > SelectChannelEndPoint.java:93) > > > > > > at org.eclipse.jetty.util.thread.strategy. > ExecuteProduceConsume. > > > produceAndRun(ExecuteProduceConsume.java:246) > > > > > > at org.eclipse.jetty.util.thread.strategy. > > > ExecuteProduceConsume.run(ExecuteProduceConsume.java:156) > > > > > > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob( > > > QueuedThreadPool.java:654) > > > > > > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run( > > > QueuedThreadPool.java:572) > > > > > > at java.lang.Thread.run(Thread.java:745) > > > > > > > > > > > > Thanks, > > > > > > Radhakrishnan D > > > > > >
