lewismc commented on issue #32: SDAP-120 Error trying to ingest logs
URL: 
https://github.com/apache/incubator-sdap-mudrod/pull/32#issuecomment-415087443
 
 
   The regression happened during the move to HTTPS, which was April of 2017 
(wow that was a long time ago). You can see from the logs available at 
ftp://podaac.jpl.nasa.gov/misc/outgoing/cjf/mudrod/2017/04/, that the WWW.* 
artifacts contain the combined log format, whereas the WWWssl logs do not! 
Example are below
    
   Combined Log Format (Pre HTTPS/SSL Migration < April 2017)
   ```
   198.118.243.84 - - [29/Apr/2017:00:00:49 +0000] "GET 
/announcements/2016-08-29_RapidScat_Data_Loss_from_Power_Outage HTTP/1.1" 302 
274 "-" "gsa-crawler-earthdata (Enterprise; T5-ACQ4X8DLW7SKC; 
[email protected],[email protected])"
   ```
   
   Common Log Format (Post HTTPS/SSL Migration > April 2017)
   ```
   131.161.10.197 - - [29/Apr/2017:00:00:20 +0000] "GET 
/datasetlist?ids=Sensor:DataFormat:Collections:Measurement&values=SMAP_RADIOMETER:HDF5:Aquarius-CAP:Salinity%252525252525252FDensity
 HTTP/1.1" 200 86612
   ```
   You can clearly see the absence of the Referrer and User Agent in the Common 
Log Format.
    
   Addressing this regression is a priority and it does not have an adverse 
impact on the Webserver performance as this information is already cached in 
the WebServer we simply do not log it anymore. I'm working to get this fixed.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to