[Bug-wget] Standards fix for metadata records in WARC files

2013-04-12 Thread Gijs van Tulder
This patch repairs two minor problems in the WARC metadata records. 1. Each record should have its own unique WARC-Record-ID, but currently the ID for the record holding the manifest is reused for the record holding the arguments. The patch generates a new ID for the arguments (and refers to t

Re: [Bug-wget] Syntax for RESTful scripting options

2013-04-12 Thread Darshit Shah
There we go. Attaching the next iteration of the patch to add more REStful scripting options. Changes included are: * Accept an option during invocation, called --method=MethodString. The MethodString will be converted to Uppercase and sent as the Method. * The old --post-data and --post-file comm

Re: [Bug-wget] wget ignores --mirror option on openWrt's Luci interface

2013-04-12 Thread Olivier Diotte
Hi Tim, You were right, it works with those supplemental options (I guess I should have read the man page more carefully ^-^). Thanks for your help. Sincerely, Olivier

Re: [Bug-wget] WARC File Creation - Scope Issues

2013-04-12 Thread Tim Ruehsen
Hello Mark, to capture a single document just execute e.g. wget --warc-file single_page 'https://webarchive.jira.com/wiki/display/wayback/Wayback+Installation+and+Configuration+Guide#WaybackInstallationandConfigurationGuide- URLsandWebApplications' To save a page + requisites (everything you nee

Re: [Bug-wget] wget ignores --mirror option on openWrt's Luci interface

2013-04-12 Thread Tim Ruehsen
Hi Olivier, I think I got it (I didn't test -m, but it should work like -r -N). Your first command is as you already did it: wget --save-cookies cookies.txt --keep-session-cookies --post-data 'username=root&password=' http://172.16.1.1/cgi-bin/luci/ This saves the 'index.html' generated after a