FWIW, I've run apps that have thrown large XML files around and XML
processing _was_ a significant part of the overall processing, on
order of 10-15% due to significant compression (i.e. less to send over
the pipe) and faster encoding/decoding because you aren't constantly
doing string manipulation. Switching to a binary format made for a
very nice bump in performance.
My take on the subject is: if you control both ends of the pipe (which
we do w/ SolrJ and other clients we produce) the only reason for XML
is in debugging, and even that is easy enough to handle via converters
to XML when needed. The nice thing with Solr, is this is all so
easily pluggable.
On Apr 15, 2008, at 1:21 AM, Ian Holsman (JIRA) wrote:
[ https://issues.apache.org/jira/browse/SOLR-486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12588904
#action_12588904 ]
Ian Holsman commented on SOLR-486:
----------------------------------
i'm a bit clueless here.
you mention that it is 9 times faster. how big a component is
encoding/decoding in the general scheme of things? (ie compared to
actually getting the results)
Support binary formats for QueryresponseWriter
----------------------------------------------
Key: SOLR-486
URL: https://issues.apache.org/jira/browse/SOLR-486
Project: Solr
Issue Type: Improvement
Components: clients - java, search
Reporter: Noble Paul
Assignee: Yonik Seeley
Fix For: 1.3
Attachments: SOLR-486.patch, SOLR-486.patch, SOLR-486.patch,
SOLR-486.patch, SOLR-486.patch, SOLR-486.patch, SOLR-486.patch
QueryResponse writer only allows text data to be written.
So it is not possible to implement a binary protocol . Create
another interface which has a method
write(OutputStream os, SolrQueryRequest request, SolrQueryResponse
response)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
--------------------------
Grant Ingersoll
Lucene Helpful Hints:
http://wiki.apache.org/lucene-java/BasicsOfPerformance
http://wiki.apache.org/lucene-java/LuceneFAQ
