I started an effort to automate HCL updating a few months ago and thought I'd pass on my notes in case anyone finds them useful.
First, you'll probably want a complete and incrementally-updateable local mailing list archive. The most reliable way I've found to dump google groups is with [1] (amusingly implemented in bash). To decode the mails to extract the HCL files, I tried to use ripmime [2], but hit cases in our archives that crashed it [3]. I got sidetracked trying to produce a minimal case reproducing the crash and determine if it was exploitable, but other priorities took over. The crashing cases in our archives included the following (which are not HCLs): - https://groups.google.com/forum/#!msg/qubes-users/8n9i1GiIl7s/jvIkXCiV0awJ - https://groups.google.com/forum/#!msg/qubes-users/h_5wX9IN-MI/XRlekv-GcU4J - https://groups.google.com/forum/#!msg/qubes-users/jr8BWxhmQq4/KteMXP5nxd8J - https://groups.google.com/forum/#!msg/qubes-users/v739hab0FDo/Yru2TDVAEX8J Reported upstream, but maybe you want to use a different mime-decoder regardless. [1]: https://github.com/icy/google-group-crawler [2]: http://www.pldaniels.com/ripmime/ [3]: https://gist.githubusercontent.com/anonymous/239a136df2479d36f085e075ddc52287/raw/d6a2fb64ce9e64a8fa1de2962f8bc447e395d14e/ripmime-crash.txt -- You received this message because you are subscribed to the Google Groups "qubes-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/qubes-users/CABQWM_D7EC-NsYB3j7iV4cYGJp7ZKJ4ewWb%3DbJLbnrd4L%2BxS2A%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
