subject:"\[datameet\] UDISE districts"

Re: [datameet] UDISE districts

2021-07-23 Thread Akshit Shah

Hi Rahul,

Since you have already scraped data from <
https://src.udiseplus.gov.in/locateSchool/schoolSearch;jsessionid=44DA6E7BC5EA403EAC38ECF43E93098F.app1Worker
>,
Can you provide the latest data available for AY 2019-20 to the group?

Also is it possible to get a few attributes from 'School Report Card'? (a
pop-up button is made available on the page which opens a PDF)

Kindly upload state wise csv files, so that it is consumable.

Warm Regards,

*Akshit Shah*



On Wed, Jun 30, 2021 at 11:12 AM Thejesh GN  wrote:

> I imported the CSV into SQLite. I can see 1450490 rows.
>
> Here is the quick screen-cast on how to do it ->
> https://www.youtube.com/watch?v=rodMh6wGnoA
> The tool I used for SQlite is called https://sqlitebrowser.org/
> Its free and open source. It's available for all three platforms.
>
>
> Thej
> --
> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
> http://thejeshgn.com
> GPG ID :  0xBFFC8DD3C06DD6B0
>
>
> On Wed, 30 Jun 2021 at 08:04, Apurva Dalwadi 
> wrote:
>
>> It has 10 lakh records
>>
>> On Thu, Jun 24, 2021 at 10:35 AM Thejesh GN  wrote:
>>
>>> I have converted it into a CSV
>>> https://github.com/datameet/udise_schools/tree/master/data
>>>
>>> It has about 14 Lakh + schools.
>>>
>>> I will do some initial analysis over the weekend. But I am happy to
>>> listen. I am guessing this data is at the least 2 years old.
>>>
>>> Thej
>>> --
>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>>> http://thejeshgn.com
>>> GPG ID :  0xBFFC8DD3C06DD6B0
>>>
>>>
>>> On Wed, 23 Jun 2021 at 04:03, Abhilash Chowdhary <
>>> abhilash.ch...@gmail.com> wrote:
>>>
 Thanks Thejesh. Super helpful!

 Abhilash

 On Wed, Jun 16, 2021 at 2:21 AM Thejesh GN  wrote:

> Sorry, its public now.
>
> I will add readme and other information.
>
> Thej
> --
> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
> http://thejeshgn.com
> GPG ID :  0xBFFC8DD3C06DD6B0
>
>
> On Wed, 16 Jun 2021 at 14:48, Abhilash Chowdhary <
> abhilash.ch...@gmail.com> wrote:
>
>> Hi Thejesh,
>>
>> Thanks for the efforts in collating all this in a GeoJSON file.
>> However, looks like the repository is private. The page returns a 404 for
>> me.
>>
>> Abhilash
>>
>> On Sun, Jun 13, 2021 at 10:03 PM Thejesh GN  wrote:
>>
>>> 1. Thanks Dev. I was able to get the school list of all of India.
>>> Currently raw GeoJSON is at
>>> https://github.com/datameet/udise_schools
>>> 2. I will try and flatten the data and do some initial analysis
>>> 3. Rahul Gupta - the excel looks good. The udise school code in
>>> excel is can be matched map files. Can you add this to a repo? Also for
>>> which year is this?  I see that they publish 2013 to 2018 data online.
>>>
>>>
>>> Thej
>>> --
>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>>> http://thejeshgn.com
>>> GPG ID :  0xBFFC8DD3C06DD6B0
>>>
>>>
>>> On Sat, 29 May 2021 at 06:53, Rahul Gupta 
>>> wrote:
>>>
 Hi Thej,

 Attaching a few sample files for districts in Andhra Pradesh. This
 is the data I was able to scrape. Let me know if this helps.

 Thanks & Regards

 On Thu, May 27, 2021 at 7:40 PM Thejesh GN  wrote:

> Devdatta,
> Do you have for more than one state. So we can see the extent of
> error? Even if the error rate is 10% it's not a bad idea to have that 
> data.
> Also do school info have meta data like district or taluk? Because
> they do collect that kind of data from schools in their form
> .
> or may be its part of school reports.
>
> Rahul,
> Thank you.
>
> Thej
> --
> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
> http://thejeshgn.com
> GPG ID :  0xBFFC8DD3C06DD6B0
>
>
> On Thu, 27 May 2021 at 19:33, Rahul Gupta <
> rahulgupta.w...@gmail.com> wrote:
>
>> Hi Tej,
>>
>> I had scraped district level information earlier. Will share a
>> sample for everyone to have a look at.
>>
>> On Thu, 27 May, 2021, 5:10 pm Thejesh GN, 
>> wrote:
>>
>>> I was planning to scrape the location  and school codes.
>>>
>>> Reports, may be later.
>>>
>>> On Thu, 27 May 2021, 03:33 Devdatta Tengshe, <
>>> devda...@tengshe.in> wrote:
>>>
 Hi Thej,

 What do you want to scrape from this site?

 I have scraped some of the school locations from this site, but
 have not tried scraping the school reports.

 I also found that the location of many schools is incorrect. (
 Schools tagged with Punjab appear in MP and so on)

 Regards,
 Devdatta

Re: [datameet] UDISE districts

2021-06-29 Thread Thejesh GN

I imported the CSV into SQLite. I can see 1450490 rows.

Here is the quick screen-cast on how to do it ->
https://www.youtube.com/watch?v=rodMh6wGnoA
The tool I used for SQlite is called https://sqlitebrowser.org/
Its free and open source. It's available for all three platforms.


Thej
--
Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


On Wed, 30 Jun 2021 at 08:04, Apurva Dalwadi  wrote:

> It has 10 lakh records
>
> On Thu, Jun 24, 2021 at 10:35 AM Thejesh GN  wrote:
>
>> I have converted it into a CSV
>> https://github.com/datameet/udise_schools/tree/master/data
>>
>> It has about 14 Lakh + schools.
>>
>> I will do some initial analysis over the weekend. But I am happy to
>> listen. I am guessing this data is at the least 2 years old.
>>
>> Thej
>> --
>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>> http://thejeshgn.com
>> GPG ID :  0xBFFC8DD3C06DD6B0
>>
>>
>> On Wed, 23 Jun 2021 at 04:03, Abhilash Chowdhary <
>> abhilash.ch...@gmail.com> wrote:
>>
>>> Thanks Thejesh. Super helpful!
>>>
>>> Abhilash
>>>
>>> On Wed, Jun 16, 2021 at 2:21 AM Thejesh GN  wrote:
>>>
 Sorry, its public now.

 I will add readme and other information.

 Thej
 --
 Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
 http://thejeshgn.com
 GPG ID :  0xBFFC8DD3C06DD6B0


 On Wed, 16 Jun 2021 at 14:48, Abhilash Chowdhary <
 abhilash.ch...@gmail.com> wrote:

> Hi Thejesh,
>
> Thanks for the efforts in collating all this in a GeoJSON file.
> However, looks like the repository is private. The page returns a 404 for
> me.
>
> Abhilash
>
> On Sun, Jun 13, 2021 at 10:03 PM Thejesh GN  wrote:
>
>> 1. Thanks Dev. I was able to get the school list of all of India.
>> Currently raw GeoJSON is at https://github.com/datameet/udise_schools
>> 2. I will try and flatten the data and do some initial analysis
>> 3. Rahul Gupta - the excel looks good. The udise school code in excel
>> is can be matched map files. Can you add this to a repo? Also for which
>> year is this?  I see that they publish 2013 to 2018 data online.
>>
>>
>> Thej
>> --
>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>> http://thejeshgn.com
>> GPG ID :  0xBFFC8DD3C06DD6B0
>>
>>
>> On Sat, 29 May 2021 at 06:53, Rahul Gupta 
>> wrote:
>>
>>> Hi Thej,
>>>
>>> Attaching a few sample files for districts in Andhra Pradesh. This
>>> is the data I was able to scrape. Let me know if this helps.
>>>
>>> Thanks & Regards
>>>
>>> On Thu, May 27, 2021 at 7:40 PM Thejesh GN  wrote:
>>>
 Devdatta,
 Do you have for more than one state. So we can see the extent of
 error? Even if the error rate is 10% it's not a bad idea to have that 
 data.
 Also do school info have meta data like district or taluk? Because
 they do collect that kind of data from schools in their form
 .
 or may be its part of school reports.

 Rahul,
 Thank you.

 Thej
 --
 Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
 http://thejeshgn.com
 GPG ID :  0xBFFC8DD3C06DD6B0


 On Thu, 27 May 2021 at 19:33, Rahul Gupta <
 rahulgupta.w...@gmail.com> wrote:

> Hi Tej,
>
> I had scraped district level information earlier. Will share a
> sample for everyone to have a look at.
>
> On Thu, 27 May, 2021, 5:10 pm Thejesh GN,  wrote:
>
>> I was planning to scrape the location  and school codes.
>>
>> Reports, may be later.
>>
>> On Thu, 27 May 2021, 03:33 Devdatta Tengshe, 
>> wrote:
>>
>>> Hi Thej,
>>>
>>> What do you want to scrape from this site?
>>>
>>> I have scraped some of the school locations from this site, but
>>> have not tried scraping the school reports.
>>>
>>> I also found that the location of many schools is incorrect. (
>>> Schools tagged with Punjab appear in MP and so on)
>>>
>>> Regards,
>>> Devdatta
>>>
>>>
>>> On Wed, 26 May 2021 at 15:53, Thejesh GN 
>>> wrote:
>>>
 Thanks Gautam and Emmerich.

 Here[1] is the summary of everything I know until now,
 including the list of current UDISE Districts and Blocks along 
 with codes.

 I am planning to scrape https://schoolgis.nic.in/. But it
 seems to be down most of the time. Has anyone here tried scraping 
 it before?

 I have not looked at data.gov.in for school list. May be I
 should check that too.

 - [1]

Re: [datameet] UDISE districts

2021-06-29 Thread Apurva Dalwadi

It has 10 lakh records

On Thu, Jun 24, 2021 at 10:35 AM Thejesh GN  wrote:

> I have converted it into a CSV
> https://github.com/datameet/udise_schools/tree/master/data
>
> It has about 14 Lakh + schools.
>
> I will do some initial analysis over the weekend. But I am happy to
> listen. I am guessing this data is at the least 2 years old.
>
> Thej
> --
> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
> http://thejeshgn.com
> GPG ID :  0xBFFC8DD3C06DD6B0
>
>
> On Wed, 23 Jun 2021 at 04:03, Abhilash Chowdhary 
> wrote:
>
>> Thanks Thejesh. Super helpful!
>>
>> Abhilash
>>
>> On Wed, Jun 16, 2021 at 2:21 AM Thejesh GN  wrote:
>>
>>> Sorry, its public now.
>>>
>>> I will add readme and other information.
>>>
>>> Thej
>>> --
>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>>> http://thejeshgn.com
>>> GPG ID :  0xBFFC8DD3C06DD6B0
>>>
>>>
>>> On Wed, 16 Jun 2021 at 14:48, Abhilash Chowdhary <
>>> abhilash.ch...@gmail.com> wrote:
>>>
 Hi Thejesh,

 Thanks for the efforts in collating all this in a GeoJSON file.
 However, looks like the repository is private. The page returns a 404 for
 me.

 Abhilash

 On Sun, Jun 13, 2021 at 10:03 PM Thejesh GN  wrote:

> 1. Thanks Dev. I was able to get the school list of all of India.
> Currently raw GeoJSON is at https://github.com/datameet/udise_schools
> 2. I will try and flatten the data and do some initial analysis
> 3. Rahul Gupta - the excel looks good. The udise school code in excel
> is can be matched map files. Can you add this to a repo? Also for which
> year is this?  I see that they publish 2013 to 2018 data online.
>
>
> Thej
> --
> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
> http://thejeshgn.com
> GPG ID :  0xBFFC8DD3C06DD6B0
>
>
> On Sat, 29 May 2021 at 06:53, Rahul Gupta 
> wrote:
>
>> Hi Thej,
>>
>> Attaching a few sample files for districts in Andhra Pradesh. This is
>> the data I was able to scrape. Let me know if this helps.
>>
>> Thanks & Regards
>>
>> On Thu, May 27, 2021 at 7:40 PM Thejesh GN  wrote:
>>
>>> Devdatta,
>>> Do you have for more than one state. So we can see the extent of
>>> error? Even if the error rate is 10% it's not a bad idea to have that 
>>> data.
>>> Also do school info have meta data like district or taluk? Because
>>> they do collect that kind of data from schools in their form
>>> .
>>> or may be its part of school reports.
>>>
>>> Rahul,
>>> Thank you.
>>>
>>> Thej
>>> --
>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>>> http://thejeshgn.com
>>> GPG ID :  0xBFFC8DD3C06DD6B0
>>>
>>>
>>> On Thu, 27 May 2021 at 19:33, Rahul Gupta 
>>> wrote:
>>>
 Hi Tej,

 I had scraped district level information earlier. Will share a
 sample for everyone to have a look at.

 On Thu, 27 May, 2021, 5:10 pm Thejesh GN,  wrote:

> I was planning to scrape the location  and school codes.
>
> Reports, may be later.
>
> On Thu, 27 May 2021, 03:33 Devdatta Tengshe, 
> wrote:
>
>> Hi Thej,
>>
>> What do you want to scrape from this site?
>>
>> I have scraped some of the school locations from this site, but
>> have not tried scraping the school reports.
>>
>> I also found that the location of many schools is incorrect. (
>> Schools tagged with Punjab appear in MP and so on)
>>
>> Regards,
>> Devdatta
>>
>>
>> On Wed, 26 May 2021 at 15:53, Thejesh GN  wrote:
>>
>>> Thanks Gautam and Emmerich.
>>>
>>> Here[1] is the summary of everything I know until now, including
>>> the list of current UDISE Districts and Blocks along with codes.
>>>
>>> I am planning to scrape https://schoolgis.nic.in/. But it seems
>>> to be down most of the time. Has anyone here tried scraping it 
>>> before?
>>>
>>> I have not looked at data.gov.in for school list. May be I
>>> should check that too.
>>>
>>> - [1]
>>> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/
>>>
>>> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30
>>> emmeric...@gmail.com wrote:
>>>
 Hi Thej and Gautam,

 From what I know, Gautam is exactly right.  For example, in
 Delhi, the Directorate of Education maintains 13 education 
 districts that
 do not correspond to the 10 administrative districts for Delhi. 
 They are
 for management and administrative purposes within the Directorate 
 of
 Education (see here:

Re: [datameet] UDISE districts

2021-06-23 Thread Thejesh GN

I have converted it into a CSV
https://github.com/datameet/udise_schools/tree/master/data

It has about 14 Lakh + schools.

I will do some initial analysis over the weekend. But I am happy to listen.
I am guessing this data is at the least 2 years old.

Thej
--
Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


On Wed, 23 Jun 2021 at 04:03, Abhilash Chowdhary 
wrote:

> Thanks Thejesh. Super helpful!
>
> Abhilash
>
> On Wed, Jun 16, 2021 at 2:21 AM Thejesh GN  wrote:
>
>> Sorry, its public now.
>>
>> I will add readme and other information.
>>
>> Thej
>> --
>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>> http://thejeshgn.com
>> GPG ID :  0xBFFC8DD3C06DD6B0
>>
>>
>> On Wed, 16 Jun 2021 at 14:48, Abhilash Chowdhary <
>> abhilash.ch...@gmail.com> wrote:
>>
>>> Hi Thejesh,
>>>
>>> Thanks for the efforts in collating all this in a GeoJSON file. However,
>>> looks like the repository is private. The page returns a 404 for me.
>>>
>>> Abhilash
>>>
>>> On Sun, Jun 13, 2021 at 10:03 PM Thejesh GN  wrote:
>>>
 1. Thanks Dev. I was able to get the school list of all of India.
 Currently raw GeoJSON is at https://github.com/datameet/udise_schools
 2. I will try and flatten the data and do some initial analysis
 3. Rahul Gupta - the excel looks good. The udise school code in excel
 is can be matched map files. Can you add this to a repo? Also for which
 year is this?  I see that they publish 2013 to 2018 data online.


 Thej
 --
 Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
 http://thejeshgn.com
 GPG ID :  0xBFFC8DD3C06DD6B0


 On Sat, 29 May 2021 at 06:53, Rahul Gupta 
 wrote:

> Hi Thej,
>
> Attaching a few sample files for districts in Andhra Pradesh. This is
> the data I was able to scrape. Let me know if this helps.
>
> Thanks & Regards
>
> On Thu, May 27, 2021 at 7:40 PM Thejesh GN  wrote:
>
>> Devdatta,
>> Do you have for more than one state. So we can see the extent of
>> error? Even if the error rate is 10% it's not a bad idea to have that 
>> data.
>> Also do school info have meta data like district or taluk? Because
>> they do collect that kind of data from schools in their form
>> .
>> or may be its part of school reports.
>>
>> Rahul,
>> Thank you.
>>
>> Thej
>> --
>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>> http://thejeshgn.com
>> GPG ID :  0xBFFC8DD3C06DD6B0
>>
>>
>> On Thu, 27 May 2021 at 19:33, Rahul Gupta 
>> wrote:
>>
>>> Hi Tej,
>>>
>>> I had scraped district level information earlier. Will share a
>>> sample for everyone to have a look at.
>>>
>>> On Thu, 27 May, 2021, 5:10 pm Thejesh GN,  wrote:
>>>
 I was planning to scrape the location  and school codes.

 Reports, may be later.

 On Thu, 27 May 2021, 03:33 Devdatta Tengshe, 
 wrote:

> Hi Thej,
>
> What do you want to scrape from this site?
>
> I have scraped some of the school locations from this site, but
> have not tried scraping the school reports.
>
> I also found that the location of many schools is incorrect. (
> Schools tagged with Punjab appear in MP and so on)
>
> Regards,
> Devdatta
>
>
> On Wed, 26 May 2021 at 15:53, Thejesh GN  wrote:
>
>> Thanks Gautam and Emmerich.
>>
>> Here[1] is the summary of everything I know until now, including
>> the list of current UDISE Districts and Blocks along with codes.
>>
>> I am planning to scrape https://schoolgis.nic.in/. But it seems
>> to be down most of the time. Has anyone here tried scraping it 
>> before?
>>
>> I have not looked at data.gov.in for school list. May be I
>> should check that too.
>>
>> - [1]
>> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/
>>
>> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30
>> emmeric...@gmail.com wrote:
>>
>>> Hi Thej and Gautam,
>>>
>>> From what I know, Gautam is exactly right.  For example, in
>>> Delhi, the Directorate of Education maintains 13 education 
>>> districts that
>>> do not correspond to the 10 administrative districts for Delhi. 
>>> They are
>>> for management and administrative purposes within the Directorate of
>>> Education (see here:
>>> http://www.edudel.nic.in/mis/schoolplant/school_information.htm
>>> and look at by district).  I'm not sure if they maintain maps of 
>>> these
>>> boundaries.
>>>
>>> I can't speak for any other states.
>>>
>>> Adding to Gautam and

Re: [datameet] UDISE districts

2021-06-22 Thread Abhilash Chowdhary

Thanks Thejesh. Super helpful!

Abhilash

On Wed, Jun 16, 2021 at 2:21 AM Thejesh GN  wrote:

> Sorry, its public now.
>
> I will add readme and other information.
>
> Thej
> --
> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
> http://thejeshgn.com
> GPG ID :  0xBFFC8DD3C06DD6B0
>
>
> On Wed, 16 Jun 2021 at 14:48, Abhilash Chowdhary 
> wrote:
>
>> Hi Thejesh,
>>
>> Thanks for the efforts in collating all this in a GeoJSON file. However,
>> looks like the repository is private. The page returns a 404 for me.
>>
>> Abhilash
>>
>> On Sun, Jun 13, 2021 at 10:03 PM Thejesh GN  wrote:
>>
>>> 1. Thanks Dev. I was able to get the school list of all of India.
>>> Currently raw GeoJSON is at https://github.com/datameet/udise_schools
>>> 2. I will try and flatten the data and do some initial analysis
>>> 3. Rahul Gupta - the excel looks good. The udise school code in excel is
>>> can be matched map files. Can you add this to a repo? Also for which year
>>> is this?  I see that they publish 2013 to 2018 data online.
>>>
>>>
>>> Thej
>>> --
>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>>> http://thejeshgn.com
>>> GPG ID :  0xBFFC8DD3C06DD6B0
>>>
>>>
>>> On Sat, 29 May 2021 at 06:53, Rahul Gupta 
>>> wrote:
>>>
 Hi Thej,

 Attaching a few sample files for districts in Andhra Pradesh. This is
 the data I was able to scrape. Let me know if this helps.

 Thanks & Regards

 On Thu, May 27, 2021 at 7:40 PM Thejesh GN  wrote:

> Devdatta,
> Do you have for more than one state. So we can see the extent of
> error? Even if the error rate is 10% it's not a bad idea to have that 
> data.
> Also do school info have meta data like district or taluk? Because
> they do collect that kind of data from schools in their form
> . or
> may be its part of school reports.
>
> Rahul,
> Thank you.
>
> Thej
> --
> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
> http://thejeshgn.com
> GPG ID :  0xBFFC8DD3C06DD6B0
>
>
> On Thu, 27 May 2021 at 19:33, Rahul Gupta 
> wrote:
>
>> Hi Tej,
>>
>> I had scraped district level information earlier. Will share a sample
>> for everyone to have a look at.
>>
>> On Thu, 27 May, 2021, 5:10 pm Thejesh GN,  wrote:
>>
>>> I was planning to scrape the location  and school codes.
>>>
>>> Reports, may be later.
>>>
>>> On Thu, 27 May 2021, 03:33 Devdatta Tengshe, 
>>> wrote:
>>>
 Hi Thej,

 What do you want to scrape from this site?

 I have scraped some of the school locations from this site, but
 have not tried scraping the school reports.

 I also found that the location of many schools is incorrect. (
 Schools tagged with Punjab appear in MP and so on)

 Regards,
 Devdatta


 On Wed, 26 May 2021 at 15:53, Thejesh GN  wrote:

> Thanks Gautam and Emmerich.
>
> Here[1] is the summary of everything I know until now, including
> the list of current UDISE Districts and Blocks along with codes.
>
> I am planning to scrape https://schoolgis.nic.in/. But it seems
> to be down most of the time. Has anyone here tried scraping it before?
>
> I have not looked at data.gov.in for school list. May be I should
> check that too.
>
> - [1]
> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/
>
> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30
> emmeric...@gmail.com wrote:
>
>> Hi Thej and Gautam,
>>
>> From what I know, Gautam is exactly right.  For example, in
>> Delhi, the Directorate of Education maintains 13 education districts 
>> that
>> do not correspond to the 10 administrative districts for Delhi. They 
>> are
>> for management and administrative purposes within the Directorate of
>> Education (see here:
>> http://www.edudel.nic.in/mis/schoolplant/school_information.htm
>> and look at by district).  I'm not sure if they maintain maps of 
>> these
>> boundaries.
>>
>> I can't speak for any other states.
>>
>> Adding to Gautam and others approach beyond KA, you can also get
>> lat/long for a lot of schools from here:
>> https://schoolgis.nic.in/. I believe many on here have also
>> pointed to that site. Scraping that data and matching to DISE data 
>> gets you
>> ~85% of the schools.  DISE school codes minus the last two digits 
>> gets you
>> villages, so you can then get another couple of percent by matching 
>> any
>> schools with missing lat/longs that are in the same village as 
>> schools with
>> lat/longs.

Re: [datameet] UDISE districts

2021-06-16 Thread Thejesh GN

Sorry, its public now.

I will add readme and other information.

Thej
--
Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


On Wed, 16 Jun 2021 at 14:48, Abhilash Chowdhary 
wrote:

> Hi Thejesh,
>
> Thanks for the efforts in collating all this in a GeoJSON file. However,
> looks like the repository is private. The page returns a 404 for me.
>
> Abhilash
>
> On Sun, Jun 13, 2021 at 10:03 PM Thejesh GN  wrote:
>
>> 1. Thanks Dev. I was able to get the school list of all of India.
>> Currently raw GeoJSON is at https://github.com/datameet/udise_schools
>> 2. I will try and flatten the data and do some initial analysis
>> 3. Rahul Gupta - the excel looks good. The udise school code in excel is
>> can be matched map files. Can you add this to a repo? Also for which year
>> is this?  I see that they publish 2013 to 2018 data online.
>>
>>
>> Thej
>> --
>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>> http://thejeshgn.com
>> GPG ID :  0xBFFC8DD3C06DD6B0
>>
>>
>> On Sat, 29 May 2021 at 06:53, Rahul Gupta 
>> wrote:
>>
>>> Hi Thej,
>>>
>>> Attaching a few sample files for districts in Andhra Pradesh. This is
>>> the data I was able to scrape. Let me know if this helps.
>>>
>>> Thanks & Regards
>>>
>>> On Thu, May 27, 2021 at 7:40 PM Thejesh GN  wrote:
>>>
 Devdatta,
 Do you have for more than one state. So we can see the extent of error?
 Even if the error rate is 10% it's not a bad idea to have that data.
 Also do school info have meta data like district or taluk? Because they
 do collect that kind of data from schools in their form
 . or
 may be its part of school reports.

 Rahul,
 Thank you.

 Thej
 --
 Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
 http://thejeshgn.com
 GPG ID :  0xBFFC8DD3C06DD6B0


 On Thu, 27 May 2021 at 19:33, Rahul Gupta 
 wrote:

> Hi Tej,
>
> I had scraped district level information earlier. Will share a sample
> for everyone to have a look at.
>
> On Thu, 27 May, 2021, 5:10 pm Thejesh GN,  wrote:
>
>> I was planning to scrape the location  and school codes.
>>
>> Reports, may be later.
>>
>> On Thu, 27 May 2021, 03:33 Devdatta Tengshe, 
>> wrote:
>>
>>> Hi Thej,
>>>
>>> What do you want to scrape from this site?
>>>
>>> I have scraped some of the school locations from this site, but have
>>> not tried scraping the school reports.
>>>
>>> I also found that the location of many schools is incorrect. (
>>> Schools tagged with Punjab appear in MP and so on)
>>>
>>> Regards,
>>> Devdatta
>>>
>>>
>>> On Wed, 26 May 2021 at 15:53, Thejesh GN  wrote:
>>>
 Thanks Gautam and Emmerich.

 Here[1] is the summary of everything I know until now, including
 the list of current UDISE Districts and Blocks along with codes.

 I am planning to scrape https://schoolgis.nic.in/. But it seems to
 be down most of the time. Has anyone here tried scraping it before?

 I have not looked at data.gov.in for school list. May be I should
 check that too.

 - [1]
 https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/

 On Saturday, 10 April 2021 at 20:38:03 UTC+5:30
 emmeric...@gmail.com wrote:

> Hi Thej and Gautam,
>
> From what I know, Gautam is exactly right.  For example, in Delhi,
> the Directorate of Education maintains 13 education districts that do 
> not
> correspond to the 10 administrative districts for Delhi. They are for
> management and administrative purposes within the Directorate of 
> Education
> (see here:
> http://www.edudel.nic.in/mis/schoolplant/school_information.htm
> and look at by district).  I'm not sure if they maintain maps of these
> boundaries.
>
> I can't speak for any other states.
>
> Adding to Gautam and others approach beyond KA, you can also get
> lat/long for a lot of schools from here: https://schoolgis.nic.in/.
> I believe many on here have also pointed to that site. Scraping that 
> data
> and matching to DISE data gets you ~85% of the schools.  DISE school 
> codes
> minus the last two digits gets you villages, so you can then get 
> another
> couple of percent by matching any schools with missing lat/longs that 
> are
> in the same village as schools with lat/longs.
>
> From there you could aggregate up to the administrative district.
>
> hth,
> Emmerich
>
> On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John wrote:
>
>> Hi Thej:
>>
>> > I am trying to

Re: [datameet] UDISE districts

2021-06-16 Thread Abhilash Chowdhary

Hi Thejesh,

Thanks for the efforts in collating all this in a GeoJSON file. However,
looks like the repository is private. The page returns a 404 for me.

Abhilash

On Sun, Jun 13, 2021 at 10:03 PM Thejesh GN  wrote:

> 1. Thanks Dev. I was able to get the school list of all of India.
> Currently raw GeoJSON is at https://github.com/datameet/udise_schools
> 2. I will try and flatten the data and do some initial analysis
> 3. Rahul Gupta - the excel looks good. The udise school code in excel is
> can be matched map files. Can you add this to a repo? Also for which year
> is this?  I see that they publish 2013 to 2018 data online.
>
>
> Thej
> --
> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
> http://thejeshgn.com
> GPG ID :  0xBFFC8DD3C06DD6B0
>
>
> On Sat, 29 May 2021 at 06:53, Rahul Gupta 
> wrote:
>
>> Hi Thej,
>>
>> Attaching a few sample files for districts in Andhra Pradesh. This is the
>> data I was able to scrape. Let me know if this helps.
>>
>> Thanks & Regards
>>
>> On Thu, May 27, 2021 at 7:40 PM Thejesh GN  wrote:
>>
>>> Devdatta,
>>> Do you have for more than one state. So we can see the extent of error?
>>> Even if the error rate is 10% it's not a bad idea to have that data.
>>> Also do school info have meta data like district or taluk? Because they
>>> do collect that kind of data from schools in their form
>>> . or
>>> may be its part of school reports.
>>>
>>> Rahul,
>>> Thank you.
>>>
>>> Thej
>>> --
>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>>> http://thejeshgn.com
>>> GPG ID :  0xBFFC8DD3C06DD6B0
>>>
>>>
>>> On Thu, 27 May 2021 at 19:33, Rahul Gupta 
>>> wrote:
>>>
 Hi Tej,

 I had scraped district level information earlier. Will share a sample
 for everyone to have a look at.

 On Thu, 27 May, 2021, 5:10 pm Thejesh GN,  wrote:

> I was planning to scrape the location  and school codes.
>
> Reports, may be later.
>
> On Thu, 27 May 2021, 03:33 Devdatta Tengshe, 
> wrote:
>
>> Hi Thej,
>>
>> What do you want to scrape from this site?
>>
>> I have scraped some of the school locations from this site, but have
>> not tried scraping the school reports.
>>
>> I also found that the location of many schools is incorrect. (
>> Schools tagged with Punjab appear in MP and so on)
>>
>> Regards,
>> Devdatta
>>
>>
>> On Wed, 26 May 2021 at 15:53, Thejesh GN  wrote:
>>
>>> Thanks Gautam and Emmerich.
>>>
>>> Here[1] is the summary of everything I know until now, including the
>>> list of current UDISE Districts and Blocks along with codes.
>>>
>>> I am planning to scrape https://schoolgis.nic.in/. But it seems to
>>> be down most of the time. Has anyone here tried scraping it before?
>>>
>>> I have not looked at data.gov.in for school list. May be I should
>>> check that too.
>>>
>>> - [1]
>>> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/
>>>
>>> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 emmeric...@gmail.com
>>> wrote:
>>>
 Hi Thej and Gautam,

 From what I know, Gautam is exactly right.  For example, in Delhi,
 the Directorate of Education maintains 13 education districts that do 
 not
 correspond to the 10 administrative districts for Delhi. They are for
 management and administrative purposes within the Directorate of 
 Education
 (see here:
 http://www.edudel.nic.in/mis/schoolplant/school_information.htm
 and look at by district).  I'm not sure if they maintain maps of these
 boundaries.

 I can't speak for any other states.

 Adding to Gautam and others approach beyond KA, you can also get
 lat/long for a lot of schools from here: https://schoolgis.nic.in/.
 I believe many on here have also pointed to that site. Scraping that 
 data
 and matching to DISE data gets you ~85% of the schools.  DISE school 
 codes
 minus the last two digits gets you villages, so you can then get 
 another
 couple of percent by matching any schools with missing lat/longs that 
 are
 in the same village as schools with lat/longs.

 From there you could aggregate up to the administrative district.

 hth,
 Emmerich

 On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John wrote:

> Hi Thej:
>
> > I am trying to make sense of UDISE wrt administrative
> boundaries.
>
> There isn't any linkage - they are completely independent at least
> when I last checked in 2016. What we did was to collect the
> lat/long
> for schools so we could plot them to administrative and electoral
> boundaries. And infer educational

Re: [datameet] UDISE districts

2021-06-16 Thread Rahul Gupta

Hi Thej,

I will try and find some time to work this out in a repo. The data was
collection from the following portal -
http://src.udiseplus.gov.in/locateSchool/schoolSearch;jsessionid=119CB599B756F0A04673A6F303998B4A.app1Worker

As far as I know, it was for AY 2018-2019. If there is any latest source
available, I will be happy to write a scraper and share it with everyone.

Thanks & Regards-
Rahul Gupta

On Mon, Jun 14, 2021 at 10:33 AM Thejesh GN  wrote:

> 1. Thanks Dev. I was able to get the school list of all of India.
> Currently raw GeoJSON is at https://github.com/datameet/udise_schools
> 2. I will try and flatten the data and do some initial analysis
> 3. Rahul Gupta - the excel looks good. The udise school code in excel is
> can be matched map files. Can you add this to a repo? Also for which year
> is this?  I see that they publish 2013 to 2018 data online.
>
>
> Thej
> --
> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
> http://thejeshgn.com
> GPG ID :  0xBFFC8DD3C06DD6B0
>
>
> On Sat, 29 May 2021 at 06:53, Rahul Gupta 
> wrote:
>
>> Hi Thej,
>>
>> Attaching a few sample files for districts in Andhra Pradesh. This is the
>> data I was able to scrape. Let me know if this helps.
>>
>> Thanks & Regards
>>
>> On Thu, May 27, 2021 at 7:40 PM Thejesh GN  wrote:
>>
>>> Devdatta,
>>> Do you have for more than one state. So we can see the extent of error?
>>> Even if the error rate is 10% it's not a bad idea to have that data.
>>> Also do school info have meta data like district or taluk? Because they
>>> do collect that kind of data from schools in their form
>>> . or
>>> may be its part of school reports.
>>>
>>> Rahul,
>>> Thank you.
>>>
>>> Thej
>>> --
>>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>>> http://thejeshgn.com
>>> GPG ID :  0xBFFC8DD3C06DD6B0
>>>
>>>
>>> On Thu, 27 May 2021 at 19:33, Rahul Gupta 
>>> wrote:
>>>
 Hi Tej,

 I had scraped district level information earlier. Will share a sample
 for everyone to have a look at.

 On Thu, 27 May, 2021, 5:10 pm Thejesh GN,  wrote:

> I was planning to scrape the location  and school codes.
>
> Reports, may be later.
>
> On Thu, 27 May 2021, 03:33 Devdatta Tengshe, 
> wrote:
>
>> Hi Thej,
>>
>> What do you want to scrape from this site?
>>
>> I have scraped some of the school locations from this site, but have
>> not tried scraping the school reports.
>>
>> I also found that the location of many schools is incorrect. (
>> Schools tagged with Punjab appear in MP and so on)
>>
>> Regards,
>> Devdatta
>>
>>
>> On Wed, 26 May 2021 at 15:53, Thejesh GN  wrote:
>>
>>> Thanks Gautam and Emmerich.
>>>
>>> Here[1] is the summary of everything I know until now, including the
>>> list of current UDISE Districts and Blocks along with codes.
>>>
>>> I am planning to scrape https://schoolgis.nic.in/. But it seems to
>>> be down most of the time. Has anyone here tried scraping it before?
>>>
>>> I have not looked at data.gov.in for school list. May be I should
>>> check that too.
>>>
>>> - [1]
>>> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/
>>>
>>> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 emmeric...@gmail.com
>>> wrote:
>>>
 Hi Thej and Gautam,

 From what I know, Gautam is exactly right.  For example, in Delhi,
 the Directorate of Education maintains 13 education districts that do 
 not
 correspond to the 10 administrative districts for Delhi. They are for
 management and administrative purposes within the Directorate of 
 Education
 (see here:
 http://www.edudel.nic.in/mis/schoolplant/school_information.htm
 and look at by district).  I'm not sure if they maintain maps of these
 boundaries.

 I can't speak for any other states.

 Adding to Gautam and others approach beyond KA, you can also get
 lat/long for a lot of schools from here: https://schoolgis.nic.in/.
 I believe many on here have also pointed to that site. Scraping that 
 data
 and matching to DISE data gets you ~85% of the schools.  DISE school 
 codes
 minus the last two digits gets you villages, so you can then get 
 another
 couple of percent by matching any schools with missing lat/longs that 
 are
 in the same village as schools with lat/longs.

 From there you could aggregate up to the administrative district.

 hth,
 Emmerich

 On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John wrote:

> Hi Thej:
>
> > I am trying to make sense of UDISE wrt administrative
> boundaries.
>
> There isn't any linkage - they are

Re: [datameet] UDISE districts

2021-06-13 Thread Thejesh GN

1. Thanks Dev. I was able to get the school list of all of India. Currently
raw GeoJSON is at https://github.com/datameet/udise_schools
2. I will try and flatten the data and do some initial analysis
3. Rahul Gupta - the excel looks good. The udise school code in excel is
can be matched map files. Can you add this to a repo? Also for which year
is this?  I see that they publish 2013 to 2018 data online.


Thej
--
Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


On Sat, 29 May 2021 at 06:53, Rahul Gupta  wrote:

> Hi Thej,
>
> Attaching a few sample files for districts in Andhra Pradesh. This is the
> data I was able to scrape. Let me know if this helps.
>
> Thanks & Regards
>
> On Thu, May 27, 2021 at 7:40 PM Thejesh GN  wrote:
>
>> Devdatta,
>> Do you have for more than one state. So we can see the extent of error?
>> Even if the error rate is 10% it's not a bad idea to have that data.
>> Also do school info have meta data like district or taluk? Because they
>> do collect that kind of data from schools in their form
>> . or
>> may be its part of school reports.
>>
>> Rahul,
>> Thank you.
>>
>> Thej
>> --
>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>> http://thejeshgn.com
>> GPG ID :  0xBFFC8DD3C06DD6B0
>>
>>
>> On Thu, 27 May 2021 at 19:33, Rahul Gupta 
>> wrote:
>>
>>> Hi Tej,
>>>
>>> I had scraped district level information earlier. Will share a sample
>>> for everyone to have a look at.
>>>
>>> On Thu, 27 May, 2021, 5:10 pm Thejesh GN,  wrote:
>>>
 I was planning to scrape the location  and school codes.

 Reports, may be later.

 On Thu, 27 May 2021, 03:33 Devdatta Tengshe, 
 wrote:

> Hi Thej,
>
> What do you want to scrape from this site?
>
> I have scraped some of the school locations from this site, but have
> not tried scraping the school reports.
>
> I also found that the location of many schools is incorrect. ( Schools
> tagged with Punjab appear in MP and so on)
>
> Regards,
> Devdatta
>
>
> On Wed, 26 May 2021 at 15:53, Thejesh GN  wrote:
>
>> Thanks Gautam and Emmerich.
>>
>> Here[1] is the summary of everything I know until now, including the
>> list of current UDISE Districts and Blocks along with codes.
>>
>> I am planning to scrape https://schoolgis.nic.in/. But it seems to
>> be down most of the time. Has anyone here tried scraping it before?
>>
>> I have not looked at data.gov.in for school list. May be I should
>> check that too.
>>
>> - [1]
>> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/
>>
>> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 emmeric...@gmail.com
>> wrote:
>>
>>> Hi Thej and Gautam,
>>>
>>> From what I know, Gautam is exactly right.  For example, in Delhi,
>>> the Directorate of Education maintains 13 education districts that do 
>>> not
>>> correspond to the 10 administrative districts for Delhi. They are for
>>> management and administrative purposes within the Directorate of 
>>> Education
>>> (see here:
>>> http://www.edudel.nic.in/mis/schoolplant/school_information.htm and
>>> look at by district).  I'm not sure if they maintain maps of these
>>> boundaries.
>>>
>>> I can't speak for any other states.
>>>
>>> Adding to Gautam and others approach beyond KA, you can also get
>>> lat/long for a lot of schools from here: https://schoolgis.nic.in/.
>>> I believe many on here have also pointed to that site. Scraping that 
>>> data
>>> and matching to DISE data gets you ~85% of the schools.  DISE school 
>>> codes
>>> minus the last two digits gets you villages, so you can then get another
>>> couple of percent by matching any schools with missing lat/longs that 
>>> are
>>> in the same village as schools with lat/longs.
>>>
>>> From there you could aggregate up to the administrative district.
>>>
>>> hth,
>>> Emmerich
>>>
>>> On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John wrote:
>>>
 Hi Thej:

 > I am trying to make sense of UDISE wrt administrative boundaries.

 There isn't any linkage - they are completely independent at least
 when I last checked in 2016. What we did was to collect the
 lat/long
 for schools so we could plot them to administrative and electoral
 boundaries. And infer educational boundaries from the school points
 we
 had and since we knew ed boundary each school belonged to.

 See: https://dise.klp.org.in/about/

 I wonder if Sajjad might have any of those scripts handy.

>>> --
>> Datameet is a community of Data Science enthusiasts in India. Know
>> more about us by visiting http://datameet.org

Re: [datameet] UDISE districts

2021-05-27 Thread Thejesh GN

Devdatta,
Do you have for more than one state. So we can see the extent of error?
Even if the error rate is 10% it's not a bad idea to have that data.
Also do school info have meta data like district or taluk? Because they do
collect that kind of data from schools in their form
. or may
be its part of school reports.

Rahul,
Thank you.

Thej
--
Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0


On Thu, 27 May 2021 at 19:33, Rahul Gupta  wrote:

> Hi Tej,
>
> I had scraped district level information earlier. Will share a sample for
> everyone to have a look at.
>
> On Thu, 27 May, 2021, 5:10 pm Thejesh GN,  wrote:
>
>> I was planning to scrape the location  and school codes.
>>
>> Reports, may be later.
>>
>> On Thu, 27 May 2021, 03:33 Devdatta Tengshe,  wrote:
>>
>>> Hi Thej,
>>>
>>> What do you want to scrape from this site?
>>>
>>> I have scraped some of the school locations from this site, but have not
>>> tried scraping the school reports.
>>>
>>> I also found that the location of many schools is incorrect. ( Schools
>>> tagged with Punjab appear in MP and so on)
>>>
>>> Regards,
>>> Devdatta
>>>
>>>
>>> On Wed, 26 May 2021 at 15:53, Thejesh GN  wrote:
>>>
 Thanks Gautam and Emmerich.

 Here[1] is the summary of everything I know until now, including the
 list of current UDISE Districts and Blocks along with codes.

 I am planning to scrape https://schoolgis.nic.in/. But it seems to be
 down most of the time. Has anyone here tried scraping it before?

 I have not looked at data.gov.in for school list. May be I should
 check that too.

 - [1]
 https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/

 On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 emmeric...@gmail.com
 wrote:

> Hi Thej and Gautam,
>
> From what I know, Gautam is exactly right.  For example, in Delhi, the
> Directorate of Education maintains 13 education districts that do not
> correspond to the 10 administrative districts for Delhi. They are for
> management and administrative purposes within the Directorate of Education
> (see here:
> http://www.edudel.nic.in/mis/schoolplant/school_information.htm and
> look at by district).  I'm not sure if they maintain maps of these
> boundaries.
>
> I can't speak for any other states.
>
> Adding to Gautam and others approach beyond KA, you can also get
> lat/long for a lot of schools from here: https://schoolgis.nic.in/. I
> believe many on here have also pointed to that site. Scraping that data 
> and
> matching to DISE data gets you ~85% of the schools.  DISE school codes
> minus the last two digits gets you villages, so you can then get another
> couple of percent by matching any schools with missing lat/longs that are
> in the same village as schools with lat/longs.
>
> From there you could aggregate up to the administrative district.
>
> hth,
> Emmerich
>
> On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John wrote:
>
>> Hi Thej:
>>
>> > I am trying to make sense of UDISE wrt administrative boundaries.
>>
>> There isn't any linkage - they are completely independent at least
>> when I last checked in 2016. What we did was to collect the lat/long
>> for schools so we could plot them to administrative and electoral
>> boundaries. And infer educational boundaries from the school points
>> we
>> had and since we knew ed boundary each school belonged to.
>>
>> See: https://dise.klp.org.in/about/
>>
>> I wonder if Sajjad might have any of those scripts handy.
>>
> --
 Datameet is a community of Data Science enthusiasts in India. Know more
 about us by visiting http://datameet.org
 ---
 You received this message because you are subscribed to the Google
 Groups "datameet" group.
 To unsubscribe from this group and stop receiving emails from it, send
 an email to datameet+unsubscr...@googlegroups.com.
 To view this discussion on the web visit
 https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com
 
 .

>>> --
>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>> about us by visiting http://datameet.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to datameet+unsubscr...@googlegroups.com.
>>> To view this discussion on the web visit
>>>

Re: [datameet] UDISE districts

2021-05-27 Thread Rahul Gupta

Hi Tej,

I had scraped district level information earlier. Will share a sample for
everyone to have a look at.

On Thu, 27 May, 2021, 5:10 pm Thejesh GN,  wrote:

> I was planning to scrape the location  and school codes.
>
> Reports, may be later.
>
> On Thu, 27 May 2021, 03:33 Devdatta Tengshe,  wrote:
>
>> Hi Thej,
>>
>> What do you want to scrape from this site?
>>
>> I have scraped some of the school locations from this site, but have not
>> tried scraping the school reports.
>>
>> I also found that the location of many schools is incorrect. ( Schools
>> tagged with Punjab appear in MP and so on)
>>
>> Regards,
>> Devdatta
>>
>>
>> On Wed, 26 May 2021 at 15:53, Thejesh GN  wrote:
>>
>>> Thanks Gautam and Emmerich.
>>>
>>> Here[1] is the summary of everything I know until now, including the
>>> list of current UDISE Districts and Blocks along with codes.
>>>
>>> I am planning to scrape https://schoolgis.nic.in/. But it seems to be
>>> down most of the time. Has anyone here tried scraping it before?
>>>
>>> I have not looked at data.gov.in for school list. May be I should check
>>> that too.
>>>
>>> - [1]
>>> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/
>>>
>>> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 emmeric...@gmail.com
>>> wrote:
>>>
 Hi Thej and Gautam,

 From what I know, Gautam is exactly right.  For example, in Delhi, the
 Directorate of Education maintains 13 education districts that do not
 correspond to the 10 administrative districts for Delhi. They are for
 management and administrative purposes within the Directorate of Education
 (see here:
 http://www.edudel.nic.in/mis/schoolplant/school_information.htm and
 look at by district).  I'm not sure if they maintain maps of these
 boundaries.

 I can't speak for any other states.

 Adding to Gautam and others approach beyond KA, you can also get
 lat/long for a lot of schools from here: https://schoolgis.nic.in/. I
 believe many on here have also pointed to that site. Scraping that data and
 matching to DISE data gets you ~85% of the schools.  DISE school codes
 minus the last two digits gets you villages, so you can then get another
 couple of percent by matching any schools with missing lat/longs that are
 in the same village as schools with lat/longs.

 From there you could aggregate up to the administrative district.

 hth,
 Emmerich

 On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John wrote:

> Hi Thej:
>
> > I am trying to make sense of UDISE wrt administrative boundaries.
>
> There isn't any linkage - they are completely independent at least
> when I last checked in 2016. What we did was to collect the lat/long
> for schools so we could plot them to administrative and electoral
> boundaries. And infer educational boundaries from the school points we
> had and since we knew ed boundary each school belonged to.
>
> See: https://dise.klp.org.in/about/
>
> I wonder if Sajjad might have any of those scripts handy.
>
 --
>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>> about us by visiting http://datameet.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to datameet+unsubscr...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com
>>> 
>>> .
>>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/CAOQOUMs8rVRWvZg%3D-GoxF9q1%2BNRpN-W8yC-kxCQayGbeQxveUg%40mail.gmail.com
>> 
>> .
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
>

Re: [datameet] UDISE districts

2021-05-27 Thread Thejesh GN

I was planning to scrape the location  and school codes.

Reports, may be later.

On Thu, 27 May 2021, 03:33 Devdatta Tengshe,  wrote:

> Hi Thej,
>
> What do you want to scrape from this site?
>
> I have scraped some of the school locations from this site, but have not
> tried scraping the school reports.
>
> I also found that the location of many schools is incorrect. ( Schools
> tagged with Punjab appear in MP and so on)
>
> Regards,
> Devdatta
>
>
> On Wed, 26 May 2021 at 15:53, Thejesh GN  wrote:
>
>> Thanks Gautam and Emmerich.
>>
>> Here[1] is the summary of everything I know until now, including the list
>> of current UDISE Districts and Blocks along with codes.
>>
>> I am planning to scrape https://schoolgis.nic.in/. But it seems to be
>> down most of the time. Has anyone here tried scraping it before?
>>
>> I have not looked at data.gov.in for school list. May be I should check
>> that too.
>>
>> - [1]
>> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/
>>
>> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 emmeric...@gmail.com
>> wrote:
>>
>>> Hi Thej and Gautam,
>>>
>>> From what I know, Gautam is exactly right.  For example, in Delhi, the
>>> Directorate of Education maintains 13 education districts that do not
>>> correspond to the 10 administrative districts for Delhi. They are for
>>> management and administrative purposes within the Directorate of Education
>>> (see here:
>>> http://www.edudel.nic.in/mis/schoolplant/school_information.htm and
>>> look at by district).  I'm not sure if they maintain maps of these
>>> boundaries.
>>>
>>> I can't speak for any other states.
>>>
>>> Adding to Gautam and others approach beyond KA, you can also get
>>> lat/long for a lot of schools from here: https://schoolgis.nic.in/. I
>>> believe many on here have also pointed to that site. Scraping that data and
>>> matching to DISE data gets you ~85% of the schools.  DISE school codes
>>> minus the last two digits gets you villages, so you can then get another
>>> couple of percent by matching any schools with missing lat/longs that are
>>> in the same village as schools with lat/longs.
>>>
>>> From there you could aggregate up to the administrative district.
>>>
>>> hth,
>>> Emmerich
>>>
>>> On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John wrote:
>>>
 Hi Thej:

 > I am trying to make sense of UDISE wrt administrative boundaries.

 There isn't any linkage - they are completely independent at least
 when I last checked in 2016. What we did was to collect the lat/long
 for schools so we could plot them to administrative and electoral
 boundaries. And infer educational boundaries from the school points we
 had and since we knew ed boundary each school belonged to.

 See: https://dise.klp.org.in/about/

 I wonder if Sajjad might have any of those scripts handy.

>>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com
>> 
>> .
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAOQOUMs8rVRWvZg%3D-GoxF9q1%2BNRpN-W8yC-kxCQayGbeQxveUg%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAABnYsVdHx83dk77%2BgubycV_ZHEfcuki8GZ7M2m2A4EJt9kiew%40mail.gmail.com.

Re: [datameet] UDISE districts

2021-05-26 Thread Devdatta Tengshe

Hi Thej,

What do you want to scrape from this site?

I have scraped some of the school locations from this site, but have not
tried scraping the school reports.

I also found that the location of many schools is incorrect. ( Schools
tagged with Punjab appear in MP and so on)

Regards,
Devdatta


On Wed, 26 May 2021 at 15:53, Thejesh GN  wrote:

> Thanks Gautam and Emmerich.
>
> Here[1] is the summary of everything I know until now, including the list
> of current UDISE Districts and Blocks along with codes.
>
> I am planning to scrape https://schoolgis.nic.in/. But it seems to be
> down most of the time. Has anyone here tried scraping it before?
>
> I have not looked at data.gov.in for school list. May be I should check
> that too.
>
> - [1]
> https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/
>
> On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 emmeric...@gmail.com
> wrote:
>
>> Hi Thej and Gautam,
>>
>> From what I know, Gautam is exactly right.  For example, in Delhi, the
>> Directorate of Education maintains 13 education districts that do not
>> correspond to the 10 administrative districts for Delhi. They are for
>> management and administrative purposes within the Directorate of Education
>> (see here:
>> http://www.edudel.nic.in/mis/schoolplant/school_information.htm and look
>> at by district).  I'm not sure if they maintain maps of these boundaries.
>>
>> I can't speak for any other states.
>>
>> Adding to Gautam and others approach beyond KA, you can also get lat/long
>> for a lot of schools from here: https://schoolgis.nic.in/. I believe
>> many on here have also pointed to that site. Scraping that data and
>> matching to DISE data gets you ~85% of the schools.  DISE school codes
>> minus the last two digits gets you villages, so you can then get another
>> couple of percent by matching any schools with missing lat/longs that are
>> in the same village as schools with lat/longs.
>>
>> From there you could aggregate up to the administrative district.
>>
>> hth,
>> Emmerich
>>
>> On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John wrote:
>>
>>> Hi Thej:
>>>
>>> > I am trying to make sense of UDISE wrt administrative boundaries.
>>>
>>> There isn't any linkage - they are completely independent at least
>>> when I last checked in 2016. What we did was to collect the lat/long
>>> for schools so we could plot them to administrative and electoral
>>> boundaries. And infer educational boundaries from the school points we
>>> had and since we knew ed boundary each school belonged to.
>>>
>>> See: https://dise.klp.org.in/about/
>>>
>>> I wonder if Sajjad might have any of those scripts handy.
>>>
>> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAOQOUMs8rVRWvZg%3D-GoxF9q1%2BNRpN-W8yC-kxCQayGbeQxveUg%40mail.gmail.com.

Re: [datameet] UDISE districts

2021-05-26 Thread Thejesh GN

Thanks Gautam and Emmerich.

Here[1] is the summary of everything I know until now, including the list 
of current UDISE Districts and Blocks along with codes.

I am planning to scrape https://schoolgis.nic.in/. But it seems to be down 
most of the time. Has anyone here tried scraping it before?

I have not looked at data.gov.in for school list. May be I should check 
that too.

- [1] 
https://thejeshgn.com/2021/05/26/india-udise-educational-districts-and-blocks/

On Saturday, 10 April 2021 at 20:38:03 UTC+5:30 emmeric...@gmail.com wrote:

> Hi Thej and Gautam,
>
> From what I know, Gautam is exactly right.  For example, in Delhi, the 
> Directorate of Education maintains 13 education districts that do not 
> correspond to the 10 administrative districts for Delhi. They are for 
> management and administrative purposes within the Directorate of Education 
> (see here: http://www.edudel.nic.in/mis/schoolplant/school_information.htm 
> and look at by district).  I'm not sure if they maintain maps of these 
> boundaries.
>
> I can't speak for any other states.
>
> Adding to Gautam and others approach beyond KA, you can also get lat/long 
> for a lot of schools from here: https://schoolgis.nic.in/. I believe many 
> on here have also pointed to that site. Scraping that data and matching to 
> DISE data gets you ~85% of the schools.  DISE school codes minus the last 
> two digits gets you villages, so you can then get another couple of percent 
> by matching any schools with missing lat/longs that are in the same village 
> as schools with lat/longs.
>
> From there you could aggregate up to the administrative district.
>
> hth,
> Emmerich
>
> On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John wrote:
>
>> Hi Thej: 
>>
>> > I am trying to make sense of UDISE wrt administrative boundaries. 
>>
>> There isn't any linkage - they are completely independent at least 
>> when I last checked in 2016. What we did was to collect the lat/long 
>> for schools so we could plot them to administrative and electoral 
>> boundaries. And infer educational boundaries from the school points we 
>> had and since we knew ed boundary each school belonged to. 
>>
>> See: https://dise.klp.org.in/about/ 
>>
>> I wonder if Sajjad might have any of those scripts handy. 
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/f658144f-9ea1-4c89-9a6a-06feb0e71b4cn%40googlegroups.com.

Re: [datameet] UDISE districts

2021-04-10 Thread Emmerich Davies

Hi Thej and Gautam,

>From what I know, Gautam is exactly right.  For example, in Delhi, the 
Directorate of Education maintains 13 education districts that do not 
correspond to the 10 administrative districts for Delhi. They are for 
management and administrative purposes within the Directorate of Education 
(see here: http://www.edudel.nic.in/mis/schoolplant/school_information.htm 
and look at by district).  I'm not sure if they maintain maps of these 
boundaries.

I can't speak for any other states.

Adding to Gautam and others approach beyond KA, you can also get lat/long 
for a lot of schools from here: https://schoolgis.nic.in/. I believe many 
on here have also pointed to that site. Scraping that data and matching to 
DISE data gets you ~85% of the schools.  DISE school codes minus the last 
two digits gets you villages, so you can then get another couple of percent 
by matching any schools with missing lat/longs that are in the same village 
as schools with lat/longs.

>From there you could aggregate up to the administrative district.

hth,
Emmerich

On Sunday, March 28, 2021 at 11:10:50 PM UTC-7 Gautam John wrote:

> Hi Thej:
>
> > I am trying to make sense of UDISE wrt administrative boundaries.
>
> There isn't any linkage - they are completely independent at least
> when I last checked in 2016. What we did was to collect the lat/long
> for schools so we could plot them to administrative and electoral
> boundaries. And infer educational boundaries from the school points we
> had and since we knew ed boundary each school belonged to.
>
> See: https://dise.klp.org.in/about/
>
> I wonder if Sajjad might have any of those scripts handy.
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/3af54aa3-f5cb-43c8-9adf-6f535b2b114en%40googlegroups.com.

Re: [datameet] UDISE districts

2021-03-29 Thread Gautam John

Hi Thej:

> I am trying to make sense of UDISE wrt administrative boundaries.

There isn't any linkage - they are completely independent at least
when I last checked in 2016. What we did was to collect the lat/long
for schools so we could plot them to administrative and electoral
boundaries. And infer educational boundaries from the school points we
had and since we knew ed boundary each school belonged to.

See: https://dise.klp.org.in/about/

I wonder if Sajjad might have any of those scripts handy.

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAA33FJeKLig%2BMOANF_0xvvO5Vk6B6jz5yhv%3Dc-95FgMyzGSSSQ%40mail.gmail.com.

[datameet] UDISE districts

2021-03-26 Thread Thejesh GN

Hi All,


I am trying to make sense of UDISE wrt administrative boundaries.


UDISE has data at the state level, districts and blocks.


Their state code matches the Local government state code. I think they
share the same boundary.


But their udise district and blocks are different.


In the case of udise districts (Educational districts), most of them match
the name of administrative districts ( I am not sure about the area or
boundary). But there are some differences, Like

   - BELAGAVI was bifurcated into BELAGAVI and BELAGAVI CHIKKODI
  - BELAGAVI CHIKKODI is not an admin district
  - I belive udise(BELAGAVI and BELAGAVI CHIKKODI) == admin(BELAGAVI)
   - UTTARA KANNADA was bifurcated into UTTARA KANNADA and UTTARA KANNADA
   SIRSI
   - TUMAKURU into TUMAKURU and TUMAKURU MADHUGIRI
   - SILIGURI  is an
   educational district but not an administrative district. In terms of
   administration, it has areas from two admin districts.

The educational districts don't cross the state administrative boundaries.


So here are my questions:

1. If I want to compare state-wise; its easy

2. If I want to compare district-wise, I should ideally map Admin Districts
to Educational Districts. Is that even possible? Is it worth the effort?

3. From what I have seen, educational blocks are entirely different from
statistical blocks. I don't have much info. Do you have any?

4. Is there any documentation about this?


Here is the list of educational districts of India. There are 734 of them.


https://india-local-government-directory.glitch.me/india-local-government-directory/udise_districts


Just refresh the above URL if it doesn't open the first time.


Thej
--
Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
http://thejeshgn.com
GPG ID :  0xBFFC8DD3C06DD6B0

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAABnYsVRwUhEyTiC6-FTWph1zOaYXgn0a649mouN9AXbXNhCcg%40mail.gmail.com.

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

Re: [datameet] UDISE districts

[datameet] UDISE districts

17 matches

Site Navigation

Mail list logo

Footer information