Re: [R] How to download this data

2015-08-25 Thread John McKown
FWIW. This violates their terms of service, unless you have their permission: http://www.nseindia.com/global/content/termsofuse.htm You may not conduct any systematic or automated data collection activities (including scraping, data mining, data extraction and data harvesting) on or in relation

Re: [R] How to download this data

2015-08-25 Thread Jeff Newmiller
... but not programmatically. --- Jeff NewmillerThe . . Go Live... DCN:Basics: ##.#. ##.#. Live Go... Live: OO#.. Dead: OO#.. Pl

Re: [R] How to download this data

2015-08-25 Thread Rui Barradas
Hello, There might be a problem: > url <- "http://www.nseindia.com/live_market/dynaContent/live_watch/equities_stock_watch.htm"; > readLines(url) Error in file(con, "r") : cannot open the connection In addition: Warning message: In file(con, "r") : cannot open: HTTP status was '403 Forbidden'

Re: [R] How to download this data

2015-08-25 Thread Hasan Diwan
If there's no api available, I would use selenium to grab what I need and pipe it to R. Let me know if you need further assistance. Cheers! -- H On Aug 25, 2015 11:12 AM, "Christofer Bogaso" wrote: > Hi, > > I would like to download data from below page directly onto R. > > > http://www.nseindia.

Re: [R] How to download this data

2015-08-25 Thread Bert Gunter
Actually, in looking again, I noticed a "download in csv" link on the page, and this appears to provide a csv -formatted table that then can trivially be read into R by, e.g. read.csv() . So maybe all the html (or JSON) stuff can be ignored. -- Bert Bert Gunter "Data is not information. Informa

Re: [R] How to download this data

2015-08-25 Thread Jeff Newmiller
I agree that this is a tricky task... even more so than using a"scraping" package because the page is built dynamically. This will take someone with skills in multiple web technologies to decipher the web page scripts to figure out how to manipulate the server to give you the data, because it is

Re: [R] How to download this data

2015-08-25 Thread boB Rudis
Looks like you can get what you need from http://www.nseindia.com/homepage/Indices1.json on that page. On Tue, Aug 25, 2015 at 2:23 PM, Bert Gunter wrote: > This is not a simple question. The data are in an html-formatted web > page. You must "scrape" the html for the data and read it into an R >

Re: [R] How to download this data

2015-08-25 Thread Bert Gunter
This is not a simple question. The data are in an html-formatted web page. You must "scrape" the html for the data and read it into an R table (or other appropriate R data structure). Searching (the web) on "scrape data from html into R" listed several packages that claim to enable you to do this

[R] How to download this data

2015-08-25 Thread Christofer Bogaso
Hi, I would like to download data from below page directly onto R. http://www.nseindia.com/live_market/dynaContent/live_watch/equities_stock_watch.htm Could you please assist me how can I do that programmatically. Thanks for your time. __ R-help@r-pr

Re: [R] How to download this data?

2013-08-03 Thread Ron Michael
Hi Duncan, Thank you very much for your prompt help. Now all worked very smoothly. Thank you. - Original Message - From: Duncan Temple Lang To: Ron Michael Cc: "r-help@r-project.org" Sent: Saturday, 3 August 2013 7:43 PM Subject: Re: [R] How to download this data? Hi

Re: [R] How to download this data?

2013-08-03 Thread Duncan Temple Lang
Hi Ron Yes, you can use ssl.verifypeer = FALSE. Or alternatively, you can use also use getURLContent(, cainfo = system.file("CurlSSL", "cacert.pem", package = "RCurl")) to specify where libcurl can find the certificates to verify the SSL signature. The error you are encounte

Re: [R] How to download this data?

2013-08-03 Thread Ron Michael
u. - Original Message - From: Ron Michael To: Duncan Temple Lang ; "r-help@r-project.org" Cc: Sent: Saturday, 3 August 2013 12:58 PM Subject: Re: [R] How to download this data? Hello Duncan,   Thank you very much for your pointer.   However when I tried to run your

Re: [R] How to download this data?

2013-08-03 Thread Ron Michael
roject.org Cc: Sent: Saturday, 3 August 2013 4:33 AM Subject: Re: [R] How to download this data? That URL is an HTTPS (secure HTTP), not an HTTP. The XML parser cannot retrieve the file. Instead, use the RCurl package to get the file. However, it is more complicated than that. If you look at sourc

Re: [R] How to download this data?

2013-08-02 Thread Duncan Temple Lang
That URL is an HTTPS (secure HTTP), not an HTTP. The XML parser cannot retrieve the file. Instead, use the RCurl package to get the file. However, it is more complicated than that. If you look at source of the HTML page in a browser, you'll see a jsessionid and that is a session identifier. The

[R] How to download this data?

2013-08-02 Thread Ron Michael
Hi all,   I need to download the data from this web page:   https://www.theice.com/productguide/ProductSpec.shtml?specId=219#expiry   I used the function readHTMLTable() from package XML, however could not download that.   Can somebody help me how to get the data onto my R window?   Thank you. __