Take a look at the Mechanize modules in CPAN.
On Mon, Nov 25, 2013 at 2:08 PM, Rajeev Prasad <rp.ne...@yahoo.com> wrote: > i need to go to a website and input some data in a specific input field, > and run the query which opens a new page, i need to download and save it as > an html page on my unix box. there are several blockages i am not able to > figure out. > > 1. authentication is happening via another website, auth attempt is > redirected to another website, which authenticates and stores some cookies > on local PC, and loads back the page which called auth-site. > 2. website needs internet explorer to operate properly. > 3. this then presents menu from which i choose my choice and then that > opens a form. > 4. website uses javascript to build menus etc. > 5. i fill some fields in the form and run it. (ok button) > 6. returns result link on same page. > 7. clicking the link opens the details in new page in which i am > interested. > > websites of interest: > http://xyz.abc.com/xyz/ and few more sites within same domain=> > abc.com > authentication website: > > https://www.myauth.abc.com/login/?retURL=http%3A%2F%2Fxyz.abc.com%2Fxyz%2Faction.login > > pl advice out of sooo many modules which will help me best here? I want to > learn and use just one module for my all such "webpage-scraping/handling" . > > thanks in advance. > Rajeev >