#22983: add a descriptor interface and implementation for web-logs ---------------------------------+------------------------------ Reporter: iwakeh | Owner: metrics-team Type: enhancement | Status: new Priority: Medium | Milestone: Component: Metrics/metrics-lib | Version: Severity: Normal | Resolution: Keywords: | Actual Points: Parent ID: | Points: Reviewer: | Sponsor: ---------------------------------+------------------------------
Comment (by karsten): Random thought: these logs can be really huge and also quite repetitive. Maybe we can try to save a bit of memory by trying out a few things when parsing them. Ideas: 1. Store indexes into the raw descriptor string rather than copies of strings. 2. Alternatively, only store fields that have changed compared to the previous line. If a field has not changed, store a reference to the first line that contains the same field contents. This makes use of the fact that lines are sorted. 3. Maybe don't even store the raw descriptor string and instead throw an exception when it gets called. Only do this if 2 requires a lot less memory than 1 above. -- Ticket URL: <https://trac.torproject.org/projects/tor/ticket/22983#comment:1> Tor Bug Tracker & Wiki <https://trac.torproject.org/> The Tor Project: anonymity online _______________________________________________ tor-bugs mailing list tor-bugs@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs