Re: [datameet] Karnataka Polling Station Boundaries scraped from KSRSAC

[Vivek Matthew]

Thanks for the suggestion Sreeram. I have created a GitHub release with the 
Karnataka data in PMTiles and FlatGeobuf 
formats: https://github.com/Vonter/india-polling-stations/releases/tag/karnataka

I don't have much experience with GIS so apologies if these files don't 
work as expected, but I was able to load the FlatGeobuf file into QGIS 
successfully. Not too sure how to test if the PMTiles file is valid, but I 
think it should be correct too.

Regards,
Vivek
On Saturday, 6 August 2022 at 01:17:16 UTC+5:30 Vivek Matthew wrote:

> Hi Nikhil,
>
> I've moved the large files out of Git LFS and stored them as compressed 
> .zip files instead. This was my first time using Git LFS and I didn't 
> realize that it doesn't work in a straightforward way, apparently GitHub 
> even charges for LFS bandwidth usage in excess of 1 GB [1]. So I have also 
> removed the LFS files from the Git history, if anyone has pulled those 
> files, you may need to re-clone the repo again. The README.md has been 
> updated with details regarding the compressed files.
>
> Also thanks for pointing this out! I would not have realized this problem 
> otherwise.
>
> Regards,
> Vivek
>
> [1] - 
> https://docs.github.com/en/repositories/working-with-files/managing-large-files/about-storage-and-bandwidth-usage#tracking-storage-and-bandwidth-use
>
> On Sunday, 31 July 2022 at 09:06:17 UTC+5:30 nikh...@gmail.com wrote:
>
>> Hi Vivek, 
>>
>> Great work!
>> it looks like the big files are all in Github LFS
>>
>> Example: content of Karnataka.shp : 
>> version https://git-lfs.github.com/spec/v1
>> oid 
>> sha256:e32b9cfaa855993cabba3de1f860b248cac98cb53b1a5bf50b8913dda33ad044
>> size 106013972
>>
>> Can you tell how to download that, and add the same in the repo's readme ?
>>
>> --
>> Cheers,
>> Nikhil VJ
>> https://nikhilvj.co.in
>>
>>
>> On Sun, Jul 31, 2022 at 5:44 AM Vivek Matthew  
>> wrote:
>>
>>> Hello folks,
>>>
>>> I had scraped the polling station boundaries for Karnataka from the 
>>> KSRSAC site (https://kgis.ksrsac.in/pollinginfo/). The data is up on 
>>> this GitHub repo: https://github.com/Vonter/india-polling-stations
>>>
>>> There are a total of 60366 polling stations. On the repo there is a 
>>> Karnataka.geojson with the boundaries for all the 60366 polling stations 
>>> but it is a huge 156MB file. So I have also divided it into separate 
>>> GeoJSONs for each of the 224 Assembly Constituencies (~1MB each) and each 
>>> of the 31 districts (~6MB each) in Karnataka.
>>>
>>> I'll soon be adding Parliamentary Constituency level GeoJSONs. 
>>> Converting the GeoJSONs into other formats is also in the pipeline. If 
>>> anyone knows of other states that have similar sites which could be scraped 
>>> to generate polling station boundary GeoJSONs, I would be happy to try and 
>>> do so.
>>>
>>> When I was searching for Karnataka polling station boundary geodata a 
>>> few days back (out of interest in more granular population density geodata) 
>>> I didn't find it anywhere online. So I hope that someone else out there 
>>> searching for it will find this data useful now that it has been scraped 
>>> from KSRSAC.
>>>
>>> Regards,
>>> Vivek
>>>
>>> -- 
>>> Datameet is a community of Data Science enthusiasts in India. Know more 
>>> about us by visiting http://datameet.org
>>> --- 
>>> You received this message because you are subscribed to the Google 
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send 
>>> an email to datameet+u...@googlegroups.com.
>>> To view this discussion on the web visit 
>>> https://groups.google.com/d/msgid/datameet/CAH8O8LdHebEeQcRWLjXf6t2UK9JHAZ10yR8O_MseD9ji5kygYw%40mail.gmail.com
>>>  
>>> 
>>> .
>>>
>>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/91ddc04f-6302-4136-a0f8-553750851705n%40googlegroups.com.

Re: [datameet] Re: NEW DISTRICTS OF INDIA SHAPEFILE

[sreeram kandimalla]

Been seeing his tweets.. I hope an Indian place name correction database
comes out as a by product of this.

On Sat, 6 Aug, 2022, 8:19 pm Deepak Sharda,  wrote:

> Thanks for connecting. I spoke with Justin and he has been mapping Indian
> villages with data available on LGD. Please check his GitHub profile you
> can help him over there. I already shared all the updated data I have with
> me
>
> On Sat, 6 Aug 2022 at 1:16 AM, sreeram kandimalla <
> kandimalla.sree...@gmail.com> wrote:
>
>> Hey Deepak,
>>
>> I am very much interested in this project.
>>
>> I haven't looked into your data yet.
>>
>> But, In general I am looking for an approach where the sources for all
>> the geometries are noted and so are the corrections made.. So that
>> everything is reproducible starting from the sources.
>>
>> This along with the LGD data archived daily at
>> https://ramseraph.github.io/opendata/lgd/ will be helpful in creating a
>> map of India as of a given date.
>>
>> Thanks,
>> Sreeram k
>>
>>
>>
>> On Wed, Jul 13, 2022 at 2:39 PM Deepak Sharda 
>> wrote:
>>
>>> Great Work  Dutta. You have always helping with your hard work on this
>>> platform. Is there a place where we can get updated villages shape files as
>>> well.
>>>
>>> I tried merging updated village data from multiple sources. Not sure how
>>> accurate it is. Sharing sith you if you could help improving it on open
>>> platform.
>>>
>>>
>>> https://drive.google.com/drive/folders/1R6XOwqKKQFgOkTEzIP14u36kaWdxCifs?usp=sharing
>>>
>>> On Tuesday, July 12, 2022 at 10:28:11 PM UTC+5:30 akula.g...@gmail.com
>>> wrote:
>>>
 Hi Sai Krishna,

 I made this myself by gathering various resources.
 Thanks for your info on new district Tamulpur was missing. I will add
 it soon.

 Regards,
 Akula Guru Datta
 akuladatta.github.io
 On Tue, Jul 12, 2022 at 6:35 PM Dammalapati Sai Krishna <
 saikrishna...@gmail.com> wrote:

> Hello Guru Datta, Thank you very much for this effort!
>
> Would you be able to share the source of this data? That would help us
> in using this data with proper quotes.
>
> Also, as per the Local Government Directory
>  there are 756 districts. Just want to
> bring it to your notice if you haven't come across this yet.
>
> Thanks again!
> Sai Krishna
>
> On Tuesday, July 12, 2022 at 12:01:11 AM UTC+5:30 akula.g...@gmail.com
> wrote:
>
>> Hi all,
>>
>> I have updated  INDIAN-DISTRICTS shapefile with all new districts
>> even including newly formed Andhra Pradesh districts counting  a total of
>> 755 districts.
>>
>>
>> https://github.com/datta07/INDIAN-SHAPEFILES/blob/master/INDIA/INDIA_DISTRICTS.geojson
>>
>> Regards,
>> Akula Guru Datta
>> akuladatta.github.io
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know
> more about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to a topic in the
> Google Groups "datameet" group.
> To unsubscribe from this topic, visit
> https://groups.google.com/d/topic/datameet/4kuQecxfEv8/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> datameet+u...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/4dcde696-df5a-4868-8ae4-3fd5e389ba3dn%40googlegroups.com
> 
> .


> --
>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>> about us by visiting http://datameet.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to datameet+unsubscr...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/datameet/2571c93c-96f0-4e03-90d2-a7d31b997900n%40googlegroups.com
>>> 
>>> .
>>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/CAMgvHC6zDJPSF-LJE9EBov2j_Le4DMafP4FzfvHyeLmRc%3Dp3-g%40mail.gmail.com
>> 
>> .
>>
> 

Re: [datameet] Are all public funded datasets open by default under GODL license?

[sreeram kandimalla]

To go even further.. Would NDSAP/GODL apply to cases where the data is
clearly eligible for it, but the source website terms and conditions say
otherwise.. Example: https://censusindia.gov.in/census.website/node/288

On Sun, Aug 7, 2022 at 10:05 AM Arun Ganesh  wrote:

> This question has arisen more than a few times among the OpenStreetMap
> India community while looking at sources like Bharatmaps
>  (NIC), Bhuvan
>  (ISRO) or
> Survey of India have published valuable authoritative maps but without any
> clear licensing terms which makes it unclear if it can be reused.
>
> *Per Section 3 of the Government Open Data License - India (GODL)
> :*
>
>> Following the mandate of the National Data Sharing and Accessibility
>> Policy (NDSAP) of Government of India that applies to all shareable
>> non-sensitive data available either in digital or analog forms but
>> generated using public funds by various agencies of the Government of
>> India, and subject to the conditions listed under section 4 and 7 of this
>> document, all users are provided a worldwide, royalty-free, non-exclusive
>> license to use, adapt, publish (either in original, or in adapted and/or
>> derivative forms), translate, display, add value, and create derivative
>> works (including products and services), for all lawful commercial and
>> non-commercial purposes, and for the duration of existence of such rights
>> over the data or information.
>
>
> Does this mean that it applies to all non sensitive published datasets
> from Central Government sources by default even without explicit mention on
> the website?
>
> Some clarity on how the NDSAP/GODL License applies to published data will
> be really useful.
>
> Arun
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CA%2BGKQr3fu_OucTTOk_eTsi26hsauV0UZr1_E4vxygWeVG96FXw%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAMgvHC56gRUWGKHi16Q52ZyBS5Q2GFqrDeGe-wOwdN1JPP591Q%40mail.gmail.com.

Re: [datameet] Karnataka Polling Station Boundaries scraped from KSRSAC

[Anil kumar]

HI, Vivek
Can u make a video or share the details of how to scrape the boundaries (
https://kgis.ksrsac.in/pollinginfo/) form web.

On Sun, Jul 31, 2022 at 5:45 AM Vivek Matthew 
wrote:

> Hello folks,
>
> I had scraped the polling station boundaries for Karnataka from the KSRSAC
> site (https://kgis.ksrsac.in/pollinginfo/). The data is up on this GitHub
> repo: https://github.com/Vonter/india-polling-stations
>
> There are a total of 60366 polling stations. On the repo there is a
> Karnataka.geojson with the boundaries for all the 60366 polling stations
> but it is a huge 156MB file. So I have also divided it into separate
> GeoJSONs for each of the 224 Assembly Constituencies (~1MB each) and each
> of the 31 districts (~6MB each) in Karnataka.
>
> I'll soon be adding Parliamentary Constituency level GeoJSONs. Converting
> the GeoJSONs into other formats is also in the pipeline. If anyone knows of
> other states that have similar sites which could be scraped to generate
> polling station boundary GeoJSONs, I would be happy to try and do so.
>
> When I was searching for Karnataka polling station boundary geodata a
> few days back (out of interest in more granular population density geodata)
> I didn't find it anywhere online. So I hope that someone else out there
> searching for it will find this data useful now that it has been scraped
> from KSRSAC.
>
> Regards,
> Vivek
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAH8O8LdHebEeQcRWLjXf6t2UK9JHAZ10yR8O_MseD9ji5kygYw%40mail.gmail.com
> 
> .
>


-- 
With regards,
Anilkumar y.s
"Be happy only happy"

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CADPXCz3Eub_6tWADA86V1OC3bxV%2BSqAOMaBY3R_-59Ha9kPFmw%40mail.gmail.com.

Re: [datameet] Are all public funded datasets open by default under GODL license?

[sreeram kandimalla]

The question is whether for the current version of GODL is already good
enough.

Do we have any legal experts around who can chime in? Or can people suggest
any legal experts we can talk to about this?

On Sun, 7 Aug, 2022, 6:01 pm Abhishek,  wrote:

> Good point. One of the documents on Digital India 2.0 talks about "Open by
> default". It talk about an open approach for technologies, tools and data.
> Hopefully this will pave the way for a second version of GoDL.
>
> How about filing an RTI to enquire about this point?
>
> On Sun, 7 Aug 2022, 10:05 am Arun Ganesh,  wrote:
>
>> This question has arisen more than a few times among the OpenStreetMap
>> India community while looking at sources like Bharatmaps
>>  (NIC), Bhuvan
>>  (ISRO) or
>> Survey of India have published valuable authoritative maps but without any
>> clear licensing terms which makes it unclear if it can be reused.
>>
>> *Per Section 3 of the Government Open Data License - India (GODL)
>> :*
>>
>>> Following the mandate of the National Data Sharing and Accessibility
>>> Policy (NDSAP) of Government of India that applies to all shareable
>>> non-sensitive data available either in digital or analog forms but
>>> generated using public funds by various agencies of the Government of
>>> India, and subject to the conditions listed under section 4 and 7 of this
>>> document, all users are provided a worldwide, royalty-free, non-exclusive
>>> license to use, adapt, publish (either in original, or in adapted and/or
>>> derivative forms), translate, display, add value, and create derivative
>>> works (including products and services), for all lawful commercial and
>>> non-commercial purposes, and for the duration of existence of such rights
>>> over the data or information.
>>
>>
>> Does this mean that it applies to all non sensitive published datasets
>> from Central Government sources by default even without explicit mention on
>> the website?
>>
>> Some clarity on how the NDSAP/GODL License applies to published data will
>> be really useful.
>>
>> Arun
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/CA%2BGKQr3fu_OucTTOk_eTsi26hsauV0UZr1_E4vxygWeVG96FXw%40mail.gmail.com
>> 
>> .
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CAL2m2mA8f4orij-j3rpxPC8-q9bQ9N0Knn0fciC-vaATFOdr4w%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAMgvHC7VS483VHnELVS%2B8zBnTkOMe_qgSNnokrdfFLBsLAjMkw%40mail.gmail.com.

Re: [datameet] Are all public funded datasets open by default under GODL license?

[Abhishek]

Good point. One of the documents on Digital India 2.0 talks about "Open by
default". It talk about an open approach for technologies, tools and data.
Hopefully this will pave the way for a second version of GoDL.

How about filing an RTI to enquire about this point?

On Sun, 7 Aug 2022, 10:05 am Arun Ganesh,  wrote:

> This question has arisen more than a few times among the OpenStreetMap
> India community while looking at sources like Bharatmaps
>  (NIC), Bhuvan
>  (ISRO) or
> Survey of India have published valuable authoritative maps but without any
> clear licensing terms which makes it unclear if it can be reused.
>
> *Per Section 3 of the Government Open Data License - India (GODL)
> :*
>
>> Following the mandate of the National Data Sharing and Accessibility
>> Policy (NDSAP) of Government of India that applies to all shareable
>> non-sensitive data available either in digital or analog forms but
>> generated using public funds by various agencies of the Government of
>> India, and subject to the conditions listed under section 4 and 7 of this
>> document, all users are provided a worldwide, royalty-free, non-exclusive
>> license to use, adapt, publish (either in original, or in adapted and/or
>> derivative forms), translate, display, add value, and create derivative
>> works (including products and services), for all lawful commercial and
>> non-commercial purposes, and for the duration of existence of such rights
>> over the data or information.
>
>
> Does this mean that it applies to all non sensitive published datasets
> from Central Government sources by default even without explicit mention on
> the website?
>
> Some clarity on how the NDSAP/GODL License applies to published data will
> be really useful.
>
> Arun
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CA%2BGKQr3fu_OucTTOk_eTsi26hsauV0UZr1_E4vxygWeVG96FXw%40mail.gmail.com
> 
> .
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAL2m2mA8f4orij-j3rpxPC8-q9bQ9N0Knn0fciC-vaATFOdr4w%40mail.gmail.com.