Re: [datameet] How to get data from e department sites

[Vartika Sinha]

Thank you for pointing these things out. I will be careful in setting the 
interval of calls. It should not do anything much. But I thought it is good 
to be aware of such things. Thanks again!!!

On Thursday, April 20, 2017 at 8:01:51 AM UTC+5:30, srinivas kodali wrote:
>
> There are no policies. You can do frequent calls depending on the server 
> response times. I look at that as an indicator whether the calls i make can 
> get the server down.
>
> Considering the response times from this server. I wouldn't think much 
> about it. You won't be doing a DDoS attack to download this data. 
>
> Regards,
> Srinivas Kodali
> www.lostprogrammer.com
>
> On Apr 20, 2017 7:19 AM, "Vartika Sinha"  > wrote:
>
>> There would be a huge amount of calls. I just wanted to know if it is 
>> allowed? Although I will set an interval of around 2 minutes. Is it ok if I 
>> use the same IP. I am just concerned about the policies.
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+u...@googlegroups.com .
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] How to get data from e department sites

[Vartika Sinha]

There would be a huge amount of calls. I just wanted to know if it is allowed? 
Although I will set an interval of around 2 minutes. Is it ok if I use the same 
IP. I am just concerned about the policies.

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] How to get data from e department sites

[srinivas kodali]

Make GET requests with changing parameters of districts, mandals and other
ids. You will find them when you inspect the requests.

http://45.114.143.92/CMRabiWebService/includes/areaSownDataObjects.php?page=GMapRepTest=2=53=1742

Regards,
Srinivas Kodali
www.lostprogrammer.com

On Wed, Apr 19, 2017 at 9:13 PM, Vartika Sinha 
wrote:

> http://45.114.143.92/CMRabiWebService/#/GMapReportTest
>
> I want to use data from this site. I can write JavaScript to get lat long
> points for all districts mandal and villages. But I don't know if this is
> allowed. Or how should I get about it.
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] How to get data from e department sites

[Vartika Sinha]

http://45.114.143.92/CMRabiWebService/#/GMapReportTest

I want to use data from this site. I can write JavaScript to get lat long 
points for all districts mandal and villages. But I don't know if this is 
allowed. Or how should I get about it.

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] How to get data from e department sites

[srinivas kodali]

Please post the website from which you need data. Each website design is
different and no one can tell you how without checking it.

Regards,
Srinivas Kodali
www.lostprogrammer.com

On Apr 19, 2017 2:03 PM, "Vartika Sinha"  wrote:

> Hello All,
>
> I need some data from an E-department portal. This data is fetched using
> selection options on the site. It is then displayed onto the maps.
>
> I need the points that are being display on the maps, for an academic
> project I am working on.
>
> Is it advisable to send out of site multiple (could be in thousands) XHR
> calls to the site to get the response. If not, then how can I access the
> data?
>
> Regards,
> Vartika
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.