I don't think web servers generally work like that :) It would be on solr to accept/depcompress/and read a gzipped stream.
If i had to guess you would make a updateRequestProcessorChain with a gunzip processor class, and then pass it off to the xml/json/csv processor. Maybe you could cheat and use tika (https://tika.apache.org/1.24/formats.html#Compression_and_packaging_formats) vs a custom plugin. On Fri, Jan 14, 2022 at 7:53 AM Danilo Tomasoni <[email protected]> wrote: > > I updated solr to the latest version (8.11.1) and checked the config as Shawn > said > > ( SOLR_GZIP_ENABLED was already set to true by default in > solr.in.sh<http://solr.in.sh/> ) > > but apparently it works only with > curl --compressed option (that adds the accept-encoding : gzip header) > but not with > curl -H "Content-Encoding: gzip" > > That's the option I care mostly about because I want to send to solr gzipped > content to ingest, not getting back gzipped content. > > Any clue why still doesn't work? > Thank you > Danilo > > Danilo Tomasoni > > Fondazione The Microsoft Research - University of Trento Centre for > Computational and Systems Biology (COSBI) > Piazza Manifattura 1, 38068 Rovereto (TN), Italy > [email protected]<https://webmail.cosbi.eu/owa/redir.aspx?C=VNXi3_8-qSZTBi-FPvMwmwSB3IhCOjY8nuCBIfcNIs_5SgD-zNPWCA..&URL=mailto%3acalabro%40cosbi.eu> > http://www.cosbi.eu<https://webmail.cosbi.eu/owa/redir.aspx?C=CkilyF54_imtLHzZqF1gCGvmYXjsnf4bzGynd8OXm__5SgD-zNPWCA..&URL=http%3a%2f%2fwww.cosbi.eu%2f> > > As for the European General Data Protection Regulation 2016/679 on the > protection of natural persons with regard to the processing of personal data, > we inform you that all the data we possess are object of treatment in the > respect of the normative provided for by the cited GDPR. > It is your right to be informed on which of your data are used and how; you > may ask for their correction, cancellation or you may oppose to their use by > written request sent by recorded delivery to The Microsoft Research – > University of Trento Centre for Computational and Systems Biology Scarl, > Piazza Manifattura 1, 38068 Rovereto (TN), Italy. > P Please don't print this e-mail unless you really need to > ________________________________ > Da: Danilo Tomasoni <[email protected]> > Inviato: venerdì 14 gennaio 2022 09:03 > A: [email protected] <[email protected]> > Oggetto: R: Solr > 8.4 and content-encoding: gzip > > Good morning, > thank you, for your answers. > I will update from 8.8.2 to the latest solr (8.11.1 currently) > > > Danilo Tomasoni > > Fondazione The Microsoft Research - University of Trento Centre for > Computational and Systems Biology (COSBI) > Piazza Manifattura 1, 38068 Rovereto (TN), Italy > [email protected]<https://webmail.cosbi.eu/owa/redir.aspx?C=VNXi3_8-qSZTBi-FPvMwmwSB3IhCOjY8nuCBIfcNIs_5SgD-zNPWCA..&URL=mailto%3acalabro%40cosbi.eu> > http://www.cosbi.eu<https://webmail.cosbi.eu/owa/redir.aspx?C=CkilyF54_imtLHzZqF1gCGvmYXjsnf4bzGynd8OXm__5SgD-zNPWCA..&URL=http%3a%2f%2fwww.cosbi.eu%2f> > > As for the European General Data Protection Regulation 2016/679 on the > protection of natural persons with regard to the processing of personal data, > we inform you that all the data we possess are object of treatment in the > respect of the normative provided for by the cited GDPR. > It is your right to be informed on which of your data are used and how; you > may ask for their correction, cancellation or you may oppose to their use by > written request sent by recorded delivery to The Microsoft Research – > University of Trento Centre for Computational and Systems Biology Scarl, > Piazza Manifattura 1, 38068 Rovereto (TN), Italy. > P Please don't print this e-mail unless you really need to > ________________________________ > Da: matthew sporleder <[email protected]> > Inviato: giovedì 13 gennaio 2022 19:40 > A: [email protected] <[email protected]> > Oggetto: Re: Solr > 8.4 and content-encoding: gzip > > [CAUTION: EXTERNAL SENDER] > [Please check correspondence between Sender Display Name and Sender Email > Address before clicking on any link or opening attachments] > > > I'm not sure if submitting compressed data is something that the gzip > change would handle but i'd love to know if it does! > > On Thu, Jan 13, 2022 at 11:25 AM Shawn Heisey <[email protected]> wrote: > > > > On 1/13/22 9:00 AM, Danilo Tomasoni wrote: > > > I tried searching a lot on the internet but I was unable to find an > > > answer to this question. > > > Is it possible to POST to solr gzipped data with the "content-encoding: > > > gzip" header? > > > Or it can accept only uncompressed data? > > > I'm also sending "content-type: application/json" on the /update/json > > > endpoint. > > > > Looks like support for gzip compression was added to Solr 8.10.0: > > > > https://issues.apache.org/jira/browse/SOLR-11752 > > > > To use it, you need to add a line setting SOLR_GZIP_ENABLEDto true in > > either solr.in.sh or solr.in.cmd. If you're running a version older > > than 8.10.0 you may be able to use the info in the pull request on that > > issue to change what you've got so it works like 8.10.0. It involves > > changes to the start script and downloading additional jetty components > > that were excluded prior to 8.10.0. > > > > Thanks, > > Shawn > > > >
