Re: [Rd] Retrieving data from aspx pages

2012-11-01 Thread jose ramon mazaira
Yes, you're right, I was wrong. I've been trying to use the postForm method in RCurl but it doesn't work. I'll check the source code in this package to see if I can improve it. 2012/10/31, Paul Gilbert pgilbert...@gmail.com: I must be really dense, I know RCurl provides a POST capability, but I

Re: [Rd] Retrieving data from aspx pages

2012-11-01 Thread jose ramon mazaira
Thanks for your interest, Paul. I've checked the source code of TSjson and I've seen that what it does is to call a Python script to retrieve the data. In fact, I've already done this with Java using the URLConnection class and sending the requested values to fill the form. However, I think it

Re: [Rd] Retrieving data from aspx pages

2012-11-01 Thread jose ramon mazaira
I'd like to make you note that I've discovered that package RCurl already provides a utility that allows interaction via POST requests with servers. In fact, the FAQ for RCurl contains specifically an example with an aspx page: x = postForm(http://www.fas.usda.gov/psdonline/psdResult.aspx;,

Re: [Rd] Retrieving data from aspx pages

2012-10-31 Thread Paul Gilbert
I must be really dense, I know RCurl provides a POST capability, but I don't see how this allows interaction. Suppose the example actually worked, which it does not. (Unfortunately many of the examples in RCurl seem to be marked \dontrun{} or disabled with some if() condition.) When you post

[Rd] Retrieving data from aspx pages

2012-10-30 Thread jose ramon mazaira
Hi. I'm trying to write an application to retrieve financial data (specially bonds data) from FINRA. The web page is served dynamically from an asp.net application: http://cxa.gtm.idmanagedsolutions.com/finra/BondCenter/AdvancedScreener.aspx I'd like to know if it's possible to fill dynamically

Re: [Rd] Retrieving data from aspx pages

2012-10-30 Thread R. Michael Weylandt
Hi Jose, I think this is more of an r-help question so I'm going to forward your question there: R-devel is really for the development of R itself, not development with R. Cheers, Michael On Mon, Oct 29, 2012 at 8:11 PM, jose ramon mazaira jram...@gmail.com wrote: Hi. I'm trying to write an

Re: [Rd] Retrieving data from aspx pages

2012-10-30 Thread peter dalgaard
On Oct 30, 2012, at 10:44 , R. Michael Weylandt wrote: Hi Jose, I think this is more of an r-help question so I'm going to forward your question there: R-devel is really for the development of R itself, not development with R. Er, no! R help is (mainly) for helping beginners. We usually

Re: [Rd] Retrieving data from aspx pages

2012-10-30 Thread Paul Gilbert
I don't know of an easy way to do this in R. I've been doing something similar with python scripts called from R. If anyone knows how to do this with just R, I would appreciate hearing too. Paul On 12-10-29 04:11 PM, jose ramon mazaira wrote: Hi. I'm trying to write an application to

Re: [Rd] Retrieving data from aspx pages

2012-10-30 Thread Paul Gilbert
I think RHTMLForms works if you have a single form, but I have not been able to see how to use it when you need to go through a sequence of dynamically generated forms (like you can do with Python mechanize). Paul On 12-10-30 09:08 AM, Gabriel Becker wrote: I haven't used it extensively

Re: [Rd] Retrieving data from aspx pages

2012-10-30 Thread Paul Gilbert
Jose As far as getting to the data, I think the best way to do this sort of thing would be if the site supports a SOAP or REST interface. When they don't (yet) then one is faced with clicking through some pages. Python or Java is one way to automate the process of clicking through the pages.