Re: Exporting Error in 4.10.1
Hi, Luke has a feature of index exporting, given that output format suits your needs (xml). https://github.com/DmitryKey/luke/releases/tag/luke-4.10.1 http://dmitrykan.blogspot.fi/2014/09/exporting-lucene-index-to-xml-with-luke.html It does not have the option to export select fields only, though. Dmitry On Thu, Oct 30, 2014 at 12:39 AM, Joseph Obernberger joseph.obernber...@gmail.com wrote: Hi - I'm trying to use 4.10.1 with /export. I've defined a field as follows: field name=DocumentId type=string indexed=true stored=true required=true multiValued=false docValues=true/ I then call: http://server:port /solr/COLLECT1/export?q=Collection:COLLECT2000sort=DocumentId descfl=DocumentId The error I receive is: java.io.IOException: DocumentId must have DocValues to use this feature. at org.apache.solr.response.SortingResponseWriter.getFieldWriters(SortingResponseWriter.java:228) at org.apache.solr.response.SortingResponseWriter.write(SortingResponseWriter.java:119) at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:765) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:426) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) Any ideas what I'm doing wrong? Thank you! -Joe Obernberger -- Dmitry Kan Blog: http://dmitrykan.blogspot.com Twitter: http://twitter.com/dmitrykan SemanticAnalyzer: www.semanticanalyzer.info
Re: Exporting Error in 4.10.1
Thank you Dmitry. Any ideas why the Solr /export is not working for me? I forgot to mention that this is Solr Cloud. I believe I've defined the field correctly, and I've also tried using another field (title), but I get the same error: Title must have DocValues to use this feature.. My goal is a high-speed method of getting a list of IDs out of Solr Cloud - perhaps faster than using cursormark. Thank you! On Thu, Oct 30, 2014 at 7:24 AM, Dmitry Kan solrexp...@gmail.com wrote: Hi, Luke has a feature of index exporting, given that output format suits your needs (xml). https://github.com/DmitryKey/luke/releases/tag/luke-4.10.1 http://dmitrykan.blogspot.fi/2014/09/exporting-lucene-index-to-xml-with-luke.html It does not have the option to export select fields only, though. Dmitry On Thu, Oct 30, 2014 at 12:39 AM, Joseph Obernberger joseph.obernber...@gmail.com wrote: Hi - I'm trying to use 4.10.1 with /export. I've defined a field as follows: field name=DocumentId type=string indexed=true stored=true required=true multiValued=false docValues=true/ I then call: http://server:port /solr/COLLECT1/export?q=Collection:COLLECT2000sort=DocumentId descfl=DocumentId The error I receive is: java.io.IOException: DocumentId must have DocValues to use this feature. at org.apache.solr.response.SortingResponseWriter.getFieldWriters(SortingResponseWriter.java:228) at org.apache.solr.response.SortingResponseWriter.write(SortingResponseWriter.java:119) at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:765) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:426) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) Any ideas what I'm doing wrong? Thank you! -Joe Obernberger -- Dmitry Kan Blog: http://dmitrykan.blogspot.com Twitter: http://twitter.com/dmitrykan SemanticAnalyzer: www.semanticanalyzer.info
Re: Exporting Error in 4.10.1
Solr 4.10 is the very first release of the export feature. It does require that all fields being sorted and exported have docValues = true in the schema. This is likely to change in the future, but DocValues will likely always provide the best indexing option for sorting and exporting full result sets. This feature includes an entirely new sorting and exporting engine so there are some bugs lurking. I'll be opening a ticket to resolve these bugs shortly. Joel Bernstein Search Engineer at Heliosearch On Thu, Oct 30, 2014 at 9:41 AM, Joseph Obernberger joseph.obernber...@gmail.com wrote: Thank you Dmitry. Any ideas why the Solr /export is not working for me? I forgot to mention that this is Solr Cloud. I believe I've defined the field correctly, and I've also tried using another field (title), but I get the same error: Title must have DocValues to use this feature.. My goal is a high-speed method of getting a list of IDs out of Solr Cloud - perhaps faster than using cursormark. Thank you! On Thu, Oct 30, 2014 at 7:24 AM, Dmitry Kan solrexp...@gmail.com wrote: Hi, Luke has a feature of index exporting, given that output format suits your needs (xml). https://github.com/DmitryKey/luke/releases/tag/luke-4.10.1 http://dmitrykan.blogspot.fi/2014/09/exporting-lucene-index-to-xml-with-luke.html It does not have the option to export select fields only, though. Dmitry On Thu, Oct 30, 2014 at 12:39 AM, Joseph Obernberger joseph.obernber...@gmail.com wrote: Hi - I'm trying to use 4.10.1 with /export. I've defined a field as follows: field name=DocumentId type=string indexed=true stored=true required=true multiValued=false docValues=true/ I then call: http://server:port /solr/COLLECT1/export?q=Collection:COLLECT2000sort=DocumentId descfl=DocumentId The error I receive is: java.io.IOException: DocumentId must have DocValues to use this feature. at org.apache.solr.response.SortingResponseWriter.getFieldWriters(SortingResponseWriter.java:228) at org.apache.solr.response.SortingResponseWriter.write(SortingResponseWriter.java:119) at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:765) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:426) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) Any ideas what I'm doing wrong? Thank you! -Joe Obernberger -- Dmitry Kan Blog: http://dmitrykan.blogspot.com Twitter: http://twitter.com/dmitrykan
Exporting Error in 4.10.1
Hi - I'm trying to use 4.10.1 with /export. I've defined a field as follows: field name=DocumentId type=string indexed=true stored=true required=true multiValued=false docValues=true/ I then call: http://server:port/solr/COLLECT1/export?q=Collection:COLLECT2000sort=DocumentId descfl=DocumentId The error I receive is: java.io.IOException: DocumentId must have DocValues to use this feature. at org.apache.solr.response.SortingResponseWriter.getFieldWriters(SortingResponseWriter.java:228) at org.apache.solr.response.SortingResponseWriter.write(SortingResponseWriter.java:119) at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:765) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:426) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) Any ideas what I'm doing wrong? Thank you! -Joe Obernberger
