[ 
https://issues.apache.org/jira/browse/SOLR-7925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14791768#comment-14791768
 ] 

Song Hyonwoo commented on SOLR-7925:
------------------------------------

For simplicity, maybe it is better that Clients handle this kind of 
functionality, but benefit of indexing with gzipped file is saving network 
resource for transferring data to remote Solr.

As our test, indexing with gzipped file is 25% faster than original file on 
limited network bandwidth.

> Implement indexing from gzip format file
> ----------------------------------------
>
>                 Key: SOLR-7925
>                 URL: https://issues.apache.org/jira/browse/SOLR-7925
>             Project: Solr
>          Issue Type: Improvement
>          Components: update
>    Affects Versions: 5.2.1
>            Reporter: Song Hyonwoo
>            Priority: Minor
>              Labels: patch
>         Attachments: SOLR-7925.patch
>
>
> This will support the update of gzipped format file of Json, Xml and CSV.
> The request path will use "update/compress/gzip" instead of "update" with 
> "update.contentType" parameter  and  "Content-Type: application/gzip" as 
> Header field.
> The following is sample request using curl command. (use not --data but 
> --data-binary)
> curl 
> "http://localhost:8080/solr/collection1/update/compress/gzip?update.contentType=application/json&commit=true";
>  -H 'Content-Type: application/gzip' --data-binary @data.json.gz
> To activate this function need to add following request handler information 
> to solrconfig.xml
>   <requestHandler name="/update/compress/gzip" 
> class="org.apache.solr.handler.CompressedUpdateRequestHandler">
>     <lst name="defaults">
>       <str name="stream.contentType">application/gzip</str>
>     </lst>
>   </requestHandler>



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to