Re: [datameet] TEXT TO ASCII

2020-09-06 Thread Dilawar Singh
> I have a set of files with X, Y, Z Values (Lidar Data) in .txt files. I
need to convert it to ASCII format,

This line is very confusing. `.txt` extensions usually means ASCII (or
unicode). It is usually a good idea to attach a sample of the file to
reduce the guesswork.

You may also want to explore https://stackoverflow.com/ .

best,
Dilawar

On Sun, Sep 6, 2020 at 1:04 PM blessing isaiah 
wrote:

> Hi all,
>
> I have a set of files with X, Y, Z Values (Lidar Data) in .txt files. I
> need to convert it to ASCII format, Kindly help me to go about it. R/Python
> scripting or any other method - model builders in QGIS/ ArcMAP or even FME
> will help.
>
> Any idea or leads is appreciated. Thank you in advance.
>
> Regards,
> Blessing
>
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CABxwALbB11NgD3kv-NG1J5ZasSjKCTzvAYUjWCbrLEF1qPOkmg%40mail.gmail.com
> 
> .
>


-- 
Dilawar
NCBS Bangalore

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAM72-Zsj4oc%2BX7gAL3%2BZiFcmSmxCz46iKfPFpw%2By003DA1%2BxVw%40mail.gmail.com.


Re: [datameet] Help with R logic - near similar name

2020-08-25 Thread Dilawar Singh
Not sure what is the equivalent of python difflib (SequenceMatcher) in R. If 
you have one, it will work.

Sent from a handheld device. Pardon the brevity and typos.
On Aug 25, 2020, 20:09 +0530, rammano...@gmail.com , 
wrote:
> Hi,
>
> I have collected hospital data from multiple sources. However, each source 
> have different name. Trying to clean list with no duplicates. I am using R 
> and couldn't resolve with stringdist_join . Appreciate you suggesting some 
> approach.
>
> For example, Guntur (A.P) is listed with following names. Can we mark (or 
> eliminate) duplicate?
>
> Example 1
> SANKARA EYE HOSPITAL(GUNTUR)
> SANKARA EYE HOSPITAL
> SANKARA EYE HOSPITAL ( A UNIT OF SRI KANCHI KAMA KOTI MEDICAL TRUST)
>
>
> Example 2
> ASHIRWAD HEART HOSPITAL ( GHATKOPAR )
> Ashirwad Heart Hospital
> ASHIRWAD HEART HOSPITAL ( GHATKOPAR )
> Ashirwad Heart Hospita-Ghatkopar
>
> Thanks
> Ram
> --
> Datameet is a community of Data Science enthusiasts in India. Know more about 
> us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups 
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/datameet/19ee8101-84ec-42b0-974a-43035b5902f1n%40googlegroups.com.

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/f69e252d-a5fb-4a34-afc3-67958614c8f3%40Spark.


[datameet] textricator | Generate structured data from PDFs

2020-07-19 Thread Dilawar Singh
Found this tool today. Can help you getting data from PDFs.

*Textricator* is a tool to extract text from documents and generate 
structured data.

If you have a bunch of PDFs with the same format (or one big, consistently 
formatted PDF) and you want to extract the data to CSV or JSON, 
*Textricator* can help! It can even work on OCR'ed documents!
https://github.com/measuresforjustice/textricator

best,
   Dilawar

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/cf8a3071-700f-4197-a86b-db698c910f80n%40googlegroups.com.


Re: [datameet] Get Smart Route to Avoid Containment Zone

2020-07-07 Thread Dilawar Singh
Thanks for the pointers Abhishek. The token can be obtained using a GET
request: "
https://covid19.quantela.com/qpa/1.0.0/public/token/bbmp.com/6a4d20c0-87dd-556b-9319-ab7147e388d9
";

I've created an automated pipeline for our institute App. Here is a
PHP+CURL solution to fetch the zone information:
https://github.com/dilawar/hippo/blob/master/system/extra/covid19.php

best,
Dilawar

On Sat, Jul 4, 2020 at 10:24 PM Abhishek  wrote:

> Hey Mohit,
> You can get the updated data from BBMP's dashboard
>
> curl --location --request POST '
> https://covid19.quantela.com/qpa/1.0.0/public/dashboard/getData/bbmp.com/7WGKgnEBHZrt-aeeDTHg/TmpE-XEBiNslxwBhF2EA
> ' \
> --header 'Authorization: Bearer 3a9d616a-5db2-3f0d-a2b6-5e2dd06a4037' \
> --header 'Content-Type: application/json' \
> --data-raw '{}'
>
> If this auth token expires you can obtain one from
> https://analysis.bbmpgov.in/#/dashboards/7WGKgnEBHZrt-aeeDTHg?embedd=1=0=bbmp.com
>
> Cheers
> -Abhishek
>
> On Sat, Jul 4, 2020 at 7:50 PM mohit K  wrote:
>
>> Hi Guys,
>>
>> Is there a place I can get Bangalore containment zones data?
>>
>> Appreciate your help.
>>
>> Mohit
>>
>> On Sun, May 17, 2020 at 8:35 PM Souvik Sankar Mitra <
>> souviksankar2...@gmail.com> wrote:
>>
>>> Thank you very much for your advice sir. I will try to implement of
>>> getting location by clicking. Actually sir I use Google's Direction API
>>> here. But I can try to implement it using open source routing.
>>> Thank you for the Stack Overflow link sir. It will help me..
>>>
>>> With regards ,
>>> Souvik Sankar Mitra
>>> M.Tech(Geoinformatics) , Indian Institute of Remote Sensing
>>>
>>> On Sunday, May 17, 2020 at 11:26:42 AM UTC+5:30, Nikhil VJ wrote:

 Hi Souvik,

 Good work!

 Suggestion on UI end: can you find a way to capture clicks or
 right-clicks on the map and let the user add to/from addresses that way,
 other than typing?
 That might also save on place api usage.

 I've made custom context menus / click-to-pin feature in Leaflet maps,
 not sure how its done in google maps but I've seen such implementations
 elsewhere.
 Here's a link from a quick search:
 https://stackoverflow.com/questions/7168394/google-map-v3-context-menu#10957262

 Another for-later suggestion: Is your routing running on google's api
 or other? If other, then it might be a good bet to change the ui to leaflet
 and avoid google's usage costs that hit when visitor count increases.

 --
 Cheers,
 Nikhil VJ
 https://nikhilvj.co.in


 On Wed, May 13, 2020 at 12:29 PM Souvik Sankar Mitra <
 souviksa...@gmail.com> wrote:

> I have developed a smart navigation application to avoid containment
> zone. It gives a safe route between source and destination which does not
> go through any containment zone. Till now it only available for Kolkata 
> and
> Howrah but it can be implemented for other cities also.
>
> You can check it here - http://shampa.covidrespons.in/
> For more information you can check out this video -
> https://www.youtube.com/watch?v=UtUaCDmJV_M
>
> Hope you like it.
> Thank you.
>
> Souvik Sankar Mitra
> M.Tech (Geoinformatics) , Indian Institute of Remote Sensing
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know
> more about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google
> Groups "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to data...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/41afc5f7-aafe-4451-9d94-1d09ab15feb3%40googlegroups.com
> 
> .
>
 --
>>> Datameet is a community of Data Science enthusiasts in India. Know more
>>> about us by visiting http://datameet.org
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "datameet" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to datameet+unsubscr...@googlegroups.com.
>>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/datameet/fb9b81da-98d0-4b05-9561-0084f6ce7a4f%40googlegroups.com
>>> 
>>> .
>>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to 

Re: [datameet] Bangalore zone wise data on COVID19 in machine readable format

2020-06-24 Thread Dilawar Singh
BBMP has its own portal 
https://bbmp.maps.arcgis.com/apps/opsdashboard/index.html#/4f4f20e852744b96b493528aab76777d

But I see no change in it for last few days. May be they are updating the 
location once in a while? Reaching out to them over email so far as been 
fruitless. 

If anyone knows more up to date database/portal/API, that would be greatly 
helpful. 

I have setup an alert system in my institute based on this data but it is 
only effective if coordinates of the new cases are in public domain and 
updated frequently.

best,
Dilawar

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/111f8512-0b1f-41f0-a43b-bb3faf23d482o%40googlegroups.com.


Re: [datameet] Bangalore zone wise data on COVID19 in machine readable format

2020-06-19 Thread Dilawar Singh
Thanks Souvik. 
Great. I was looking for the coordinates. But seems like they have private info 
of patients as well!

Thanks again. This portal will do.

Best,
    Dilawat

⁣Get BlueMail for Android ​

On 19 Jun 2020, 3:02 AM, at 3:02 AM, Souvik Sankar Mitra 
 wrote:
>I scraped  https://kgis.ksrsac.in/covid/ and got list of all patients
>in
>Karnataka.
>
>On Thu, Jun 18, 2020 at 5:35 PM Dilawar Singh
>
>wrote:
>
>> Hi DataMeet,
>>
>> On page 8 of this document
>> http://covid.bbmpgov.in/reports/report20200617.pdf there is a map
>which
>> shows location of active cases in Bangalore. Is this data available
>in
>> machine readable format?
>>
>> --
>> Dilawar
>> NCBS Bangalore
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know
>more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google
>Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it,
>send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>>
>https://groups.google.com/d/msgid/datameet/CAM72-Zv8paf6PY0Lge6pT-HtUsMnAFwtMwSkrs19QVh7bedVYA%40mail.gmail.com
>>
><https://groups.google.com/d/msgid/datameet/CAM72-Zv8paf6PY0Lge6pT-HtUsMnAFwtMwSkrs19QVh7bedVYA%40mail.gmail.com?utm_medium=email_source=footer>
>> .
>>
>
>
>-- 
>With Regards ,
>Souvik Sankar Mitra,
>*M.Tech Remote Sensing & GIS (Specialisation in Geoinformatics),*
>*Indian Institute of Remote Sensing , Indian Space Research
>Organisation
>(ISRO),*
>*Dehradun - 248001*
>
>-- 
>Datameet is a community of Data Science enthusiasts in India. Know more
>about us by visiting http://datameet.org
>--- 
>You received this message because you are subscribed to the Google
>Groups "datameet" group.
>To unsubscribe from this group and stop receiving emails from it, send
>an email to datameet+unsubscr...@googlegroups.com.
>To view this discussion on the web visit
>https://groups.google.com/d/msgid/datameet/CAM88csWLQuiLHCm%3Drj8HyBRTZ8%2BEO0Kg%2BnXO2-Byi3XNqwrJRw%40mail.gmail.com.

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/8f3a27c8-f80d-4d4e-a9d9-2111fe8fb806%40gmail.com.


[datameet] Bangalore zone wise data on COVID19 in machine readable format

2020-06-18 Thread Dilawar Singh
Hi DataMeet,

On page 8 of this document
http://covid.bbmpgov.in/reports/report20200617.pdf there is a map which
shows location of active cases in Bangalore. Is this data available in
machine readable format?

-- 
Dilawar
NCBS Bangalore

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAM72-Zv8paf6PY0Lge6pT-HtUsMnAFwtMwSkrs19QVh7bedVYA%40mail.gmail.com.


Re: [datameet] Re: Water level data extraction

2020-06-16 Thread Dilawar Singh
Web-scraping requires knowledge of some programming language. In essence,
it is an art of transforming HTML to a format you like. For common tasks,
you can find some tools easily on the net e.g., extract all tables from
this URL and save them as csv.

For example, you can get the html from the above link using `curl` and pass
it to `pandoc` (or html2text) to convert to plain text.

[dilawars@localhost Downloads]$ curl
https://vmc.gov.in/WaterLevel.aspx | pandoc -f html -t plain
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
100 14330  100 143300 0  33325  0 --:--:-- --:--:-- --:--:-- 33325
Water Level Statistics

Ajwa

Vishwamitri

  Date  TimeLevel (Feet)
   --- --
   17/06/2020   06:00  207.65
   17/06/2020   03:00  207.55
   17/06/2020   00:00  207.55

  Date  TimeLevel (Feet)
   --- --
   17/06/2020   06:00   4.00
   16/06/2020   21:00   4.00
   16/06/2020   18:00   4.00


Copy paste this in a Libreoffice-Calc or MS OFFICE spreadsheet and see if
it gets converted to a spreadsheet.

Anyway, this webpage does accept a POST request but only in encrypted
format. So it is essentially useless. Contact the author of
https://craigdsouza.github.io/data/IMD-Hourly-Precipitation-Data, he
scraped rainfall data from IMD website (2018). This data is probably of no
use to you but he might know a better source to get this data. I couldn't
locate time series data for a city on IMD website.

best,
   Dilawar



On Tue, Jun 16, 2020 at 10:42 PM Vikas Rana  wrote:

> I don't know how to scrape the data... Any guidance would be helpful.
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/a5f65448-059b-4132-828c-ff36ccc60310o%40googlegroups.com
> .
>


-- 
Dilawar
NCBS Bangalore

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAM72-Zv6EybsrbjvLq9-%2BpuQK3L-Ypf0dD92JZGEBGBD0Xdr9Q%40mail.gmail.com.


[datameet] Re: Officially Approved India Map Borders?

2020-06-16 Thread Dilawar Singh
http://www.surveyofindia.gov.in/pages/display/122-outline-maps-of-india

Example PDF (it is a scan copy): 
http://www.surveyofindia.gov.in/files/36m_india.pdf . Most maps on this 
site are not machine readable. 

best,
   Dilawar 



On Tuesday, June 16, 2020 at 10:49:46 PM UTC+5:30, Curran Kelleher wrote:
>
> Greetings,
>
> I'm working on some mapping projects where the goal is to be able to 
> publish the map legally within India. To do this, we need to use the "Gov't 
> of India - Approved" borders for India (particularly disputed borders). The 
> closest we've come is to use GADM India Border 
> , but this is not officially approved by 
> Gov't of India, and makes some comprimises around disputed borders. We have 
> also used Natural Earth Disputed Borders 
> 
>  
> as an overlay, but this is also not the ideal solution.
>
> So, does anyone know how to find an officially approved map of India's 
> borders? Ideally machine readable (Shapefile, GeoJSON), but alternatively 
> as an image? A PDF? Even can you get any printed physical maps that are 
> officially approved? I have not been able to find these maps anywhere. Many 
> thanks in advance.  
> 
>
> Best regards,
> Curran
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/b8f797b8-0ab0-4bb4-9466-0389b51b4b0eo%40googlegroups.com.


Re: [datameet] Re: Open Data in India: In a Restrictive Copyright Regime, Voluntary Organisations Pitch in to Make Data Accessible

2020-06-16 Thread Dilawar Singh
Hi Thej, Datameet

After reading this, I went to SOI site and tried downloading few maps. I
could only find PDFs. And data.gov.in also love PDFs.

I wrote a couple of scripts which I used to figure out boundaries  and
extract data from curves in old PDF paper. It's a tricky business but I had
decent success (One python3 app is here
https://github.com/dilawar/PlotDigitizer). These scripts can also be
tweaked to fetch boundaries from PDF maps (no deep-learning business yet).
If datameet still struggling to find the boundaries from such maps, please
send a few samples to me. I can probably setup a web-service to upload the
map and get the GeoJSON if results are OK.

best,
Dilawar

On Tue, Jun 16, 2020 at 8:49 AM Naveen Francis  wrote:

> Nice writeup Thej,
>
> SOI point of view is completely different
> https://youtu.be/o1qMZZOia3c?t=3174
>
> 'Don't take data, but starting using SOI services.'
>
>
> On Monday, 15 June 2020 11:11:43 UTC+5:30, Thejesh GN wrote:
>>
>> Team,
>>
>> I wrote a piece for EPW about the status of Open Data and How communities
>> like ours. Thank you for being an awesome community. The article is open to
>> all.
>>
>> Open Data in India: In a Restrictive Copyright Regime, Voluntary
>> Organisations Pitch in to Make Data Accessible
>>
>> 
>>
>> https://www.epw.in/engage/article/voluntary-organisations-india-counteract-states-copyright-regime-open-data
>> 
>>
>> - This was pre covid-19, so a lot of things related to that are missing.
>> - Comments are welcome here on this thread or  on this blog post
>> 
>>
>>
>> Thej
>> --
>> Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್
>> http://thejeshgn.com
>> GPG ID :  0xBFFC8DD3C06DD6B0
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/a5569aa9-6842-4a90-9127-33c9f603af50o%40googlegroups.com
> 
> .
>


-- 
Dilawar
NCBS Bangalore

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAM72-ZuRcATxrShC8zBtGVofQ4Ku37o0E5qbVBAZUdZtXLV2%2Bg%40mail.gmail.com.


Re: [datameet] PoK elevation data | India's center of mass

2020-06-11 Thread Dilawar Singh
Dear Arun

Thanks. [1] is exactly what I need. I didn't even know what to search for.

The code was unnecessary convolutied to post directly. It compares various
sampling methods; I'll post a simplified version along with the results
soon.

Thanks again,
   Dilawar

On Fri, Jun 12, 2020 at 3:02 AM Arun Ganesh  wrote:

> If you share your code it would be easier to understand what exactly you
> need.
>
> My approach for this exercise would be to grab the SRTM dem data[1] and
> clip it to the India borders[2] using GDAL/QGIS.
>
> What you then have is a gridded raster with each pixel representing the
> elevation at that point. It seems like that is all the data you would need
> for your computation right?
>
> [1] http://srtm.csi.cgiar.org/srtmdata/
> [2] https://github.com/datameet/maps/tree/master/Country
>
> On Thu, Jun 11, 2020 at 3:33 PM Dilawar Singh 
> wrote:
>
>> Hi datameet,
>>
>> I was browsing through my old repositories. I once computed the center of
>> mass of the country using available elevation data (data is from here
>> http://www.geonames.org/data-sources.html, this data does not have PoK).
>> The image is attached. The center of mass lies very near to Jhansi without
>> PoK. It is likely to shift to the north after adding PoK since the
>> Himalayas are heavy!
>>
>> I am keen on finishing this exercise with PoK elevation data. Do we have
>> the elevation data of India in datameet repositories? If not, I can prepare
>> such data by appending data from PK elevation data and send it via a PR or
>> hand over the repository itself.
>>
>> cheers,
>> --
>> Dilawar
>> NCBS Bangalore
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/datameet/CAM72-ZvCeZSC5yAZKxvjjpZcGT%3DuYWPFMdyMasoH8uN2Mks-jg%40mail.gmail.com
>> <https://groups.google.com/d/msgid/datameet/CAM72-ZvCeZSC5yAZKxvjjpZcGT%3DuYWPFMdyMasoH8uN2Mks-jg%40mail.gmail.com?utm_medium=email_source=footer>
>> .
>>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/datameet/CA%2BGKQr2u_ryFFaks7efEZ8yYKALnFTMYEa8qGaP_J4yQY8%2BpyQ%40mail.gmail.com
> <https://groups.google.com/d/msgid/datameet/CA%2BGKQr2u_ryFFaks7efEZ8yYKALnFTMYEa8qGaP_J4yQY8%2BpyQ%40mail.gmail.com?utm_medium=email_source=footer>
> .
>


-- 
Dilawar
NCBS Bangalore

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/CAM72-Zu5XwsZEBPu%2BjopDg9L7R13i_rbyBLuy1dv5mQ9HL9J1w%40mail.gmail.com.


Re: [datameet] Re: BhuNaksha: source of cadastral maps

2020-05-31 Thread Dilawar Singh
The updated script is available publicly on Gitlab 
https://gitlab.com/snippets/1982028 . It has to be tweaked for different 
states. 

best,
   Dilawar 


On Monday, April 27, 2020 at 12:16:25 AM UTC+5:30, Dilawar Singh wrote:
>
> Hello Sharad
>
> Here you go: https://gitlab.com/dilawar/bhunaksha/-/tree/master 
>
> [image: canvas.png]
>
> [image: canvas.png]
> Currently only district images of MP are downloaded and added to 
> repository above. You can browse them (link above) or download as a zip 
> file from here: 
> https://gitlab.com/dilawar/bhunaksha/-/archive/v2020.04.26/bhunaksha-v2020.04.26.zip
>  
> .
>
> Couple of samples are attached with this email. I am not sure what exactly 
> is needed. If you can send couple of screenshots of what exactly is needed, 
> I can tweak this script a bit over next weekend.
>
> Note that canvas size is small since I was using a laptop. 
>
> PS: The script is released under GNU GPLv3.  
>
> best,
>Dilawar
>
> On Sunday, April 26, 2020 at 6:37:49 PM UTC+5:30, Sharad Lele (शरच्चंद्र 
> लेले) wrote:
>>
>> Dear Dilawar:
>>
>> Many thanks for sharing this. Unfortunately, I am a complete ignoramus 
>> when it comes to Python, selenium or even accessing stuff from GitHub :-[
>>
>> Is there any way that you (or anyone else) can help? (Sorry, probably 
>> asking too much here!)
>>
>> The site is http://bhunaksha.cg.nic.in/
>>
>> (It appears to have gone down today, should be up tomorrow or so).
>> Sharad
>>
>> On 26-04-2020 13:48, Dilawar Singh wrote:
>>
>> Its quite possible. I've used python+selenium to automate browser for a 
>> horribly designed website. You can tweak it for your usage: 
>> https://github.com/dilawar/GreenWatchData 
>>
>> best,
>> Dilawar 
>>
>>
>>
>> On Saturday, April 25, 2020 at 1:26:28 PM UTC+5:30, Sharad Lele wrote: 
>>>
>>> Dear All, 
>>> A followup question addressed to everyone on the DATAMEET group:
>>>
>>> Can someone write code to help download a large number of cadastral maps 
>>> from a Bhunaksha website (in our case Chhattisgarh)? As you know, the 
>>> website /portal is awkwardly organized: not only are the maps in png format 
>>> (which is okay) but they don't have individual file names, and one has to 
>>> access each village separately by choosing it from a list within a taluka 
>>> (and within that some Revenue Inspector category).
>>>
>>> Can someone write code to download and tag a bunch of maps 
>>> automatically? Say for one whole taluka?
>>>
>>> Sharad
>>>
>>> On Friday, 13 December 2019 19:09:02 UTC+5:30, Sharad Lele wrote: 
>>>>
>>>> Dear All,
>>>> I have discovered a source of cadastral maps for several states. This 
>>>> is mostly under the BhuNaksha initiative of NIC. They seem to have created 
>>>> separate websites for each state. Don't know for how many. I have found:
>>>>
>>>> Maharashtra: 
>>>> https://mahabhunakasha.mahabhumi.gov.in/bhunaksha/27/index.jsp
>>>> Madhya Pradesh: http://www.mpbhuabhilekh.nic.in/
>>>> Chhattisgarh: https://bhunaksha.cg.nic.in/#home-pane  (DOES NOT WORK 
>>>> RIGHT NOW)
>>>> Odisha: http://bhunakshaodisha.nic.in/bhunaksha/
>>>>
>>>> The BhuNaksha websites have a common format: you can choose district, 
>>>> taluka and village, and then the village cadastral map shows up (its in 
>>>> png 
>>>> format). You can click on a plot/parcel, and it will show the details of 
>>>> that plot: area, owner name, etc. You can generate  pdf report for that 
>>>> parcel. 
>>>>
>>>> Maharashtra version had added ability to show you the cadastral map in 
>>>> geo-rectified mode on top of a google-earth-like satellite image--quite 
>>>> useful.
>>>>
>>>> CATCH: a) the names of district, taluka, village etc are IN THE STATE 
>>>> SCRIPT: so devanagari for MP & Maha & CG, but Odiya for Odisha. So if you 
>>>> don't read that script--you are sunk
>>>> b) in most states (except Maharashtra!), it is not enough to know the 
>>>> district, taluka and village name. Within a taluka, you have know Revenue 
>>>> Inspector and then something called 'halka', and then choose from the 
>>>> villages within that halka. If you don't know this (RI and halka), you 
>>>> have 
>>>> to do brute force: search in each halka in each R

Re: [datameet] Re: BhuNaksha: source of cadastral maps

2020-04-26 Thread Dilawar Singh
Hello Sharad

Here you go: https://gitlab.com/dilawar/bhunaksha/-/tree/master 

[image: canvas.png]

[image: canvas.png]
Currently only district images of MP are downloaded and added to repository 
above. You can browse them (link above) or download as a zip file from 
here: 
https://gitlab.com/dilawar/bhunaksha/-/archive/v2020.04.26/bhunaksha-v2020.04.26.zip
 
.

Couple of samples are attached with this email. I am not sure what exactly 
is needed. If you can send couple of screenshots of what exactly is needed, 
I can tweak this script a bit over next weekend.

Note that canvas size is small since I was using a laptop. 

PS: The script is released under GNU GPLv3.  

best,
   Dilawar

On Sunday, April 26, 2020 at 6:37:49 PM UTC+5:30, Sharad Lele (शरच्चंद्र 
लेले) wrote:
>
> Dear Dilawar:
>
> Many thanks for sharing this. Unfortunately, I am a complete ignoramus 
> when it comes to Python, selenium or even accessing stuff from GitHub :-[
>
> Is there any way that you (or anyone else) can help? (Sorry, probably 
> asking too much here!)
>
> The site is http://bhunaksha.cg.nic.in/
>
> (It appears to have gone down today, should be up tomorrow or so).
> Sharad
>
> On 26-04-2020 13:48, Dilawar Singh wrote:
>
> Its quite possible. I've used python+selenium to automate browser for a 
> horribly designed website. You can tweak it for your usage: 
> https://github.com/dilawar/GreenWatchData 
>
> best,
> Dilawar 
>
>
>
> On Saturday, April 25, 2020 at 1:26:28 PM UTC+5:30, Sharad Lele wrote: 
>>
>> Dear All, 
>> A followup question addressed to everyone on the DATAMEET group:
>>
>> Can someone write code to help download a large number of cadastral maps 
>> from a Bhunaksha website (in our case Chhattisgarh)? As you know, the 
>> website /portal is awkwardly organized: not only are the maps in png format 
>> (which is okay) but they don't have individual file names, and one has to 
>> access each village separately by choosing it from a list within a taluka 
>> (and within that some Revenue Inspector category).
>>
>> Can someone write code to download and tag a bunch of maps automatically? 
>> Say for one whole taluka?
>>
>> Sharad
>>
>> On Friday, 13 December 2019 19:09:02 UTC+5:30, Sharad Lele wrote: 
>>>
>>> Dear All,
>>> I have discovered a source of cadastral maps for several states. This is 
>>> mostly under the BhuNaksha initiative of NIC. They seem to have created 
>>> separate websites for each state. Don't know for how many. I have found:
>>>
>>> Maharashtra: 
>>> https://mahabhunakasha.mahabhumi.gov.in/bhunaksha/27/index.jsp
>>> Madhya Pradesh: http://www.mpbhuabhilekh.nic.in/
>>> Chhattisgarh: https://bhunaksha.cg.nic.in/#home-pane  (DOES NOT WORK 
>>> RIGHT NOW)
>>> Odisha: http://bhunakshaodisha.nic.in/bhunaksha/
>>>
>>> The BhuNaksha websites have a common format: you can choose district, 
>>> taluka and village, and then the village cadastral map shows up (its in png 
>>> format). You can click on a plot/parcel, and it will show the details of 
>>> that plot: area, owner name, etc. You can generate  pdf report for that 
>>> parcel. 
>>>
>>> Maharashtra version had added ability to show you the cadastral map in 
>>> geo-rectified mode on top of a google-earth-like satellite image--quite 
>>> useful.
>>>
>>> CATCH: a) the names of district, taluka, village etc are IN THE STATE 
>>> SCRIPT: so devanagari for MP & Maha & CG, but Odiya for Odisha. So if you 
>>> don't read that script--you are sunk
>>> b) in most states (except Maharashtra!), it is not enough to know the 
>>> district, taluka and village name. Within a taluka, you have know Revenue 
>>> Inspector and then something called 'halka', and then choose from the 
>>> villages within that halka. If you don't know this (RI and halka), you have 
>>> to do brute force: search in each halka in each RI! (typical sarkari 
>>> rubbish: not wanting common people to actually use the website!).
>>>
>>> Karnataka seems to have its own initiative: 
>>> https://www.landrecords.karnataka.gov.in/service3/
>>> Here, you can actually download pdfs of each cadastral map, and in some 
>>> cases, even the KML! And searching for the village is district, taluka and 
>>> then village.
>>>
>>> Hope this helps.
>>>
>>> I am sure there are more such websites for other states. Please look up 
>>> and share.
>>>
>>> Sharad
>>>
>> -- 
> Datameet is a community o

[datameet] Re: BhuNaksha: source of cadastral maps

2020-04-26 Thread Dilawar Singh
Its quite possible. I've used python+selenium to automate browser for a 
horribly designed website. You can tweak it for your usage: 
https://github.com/dilawar/GreenWatchData 

best,
Dilawar 



On Saturday, April 25, 2020 at 1:26:28 PM UTC+5:30, Sharad Lele wrote:
>
> Dear All,
> A followup question addressed to everyone on the DATAMEET group:
>
> Can someone write code to help download a large number of cadastral maps 
> from a Bhunaksha website (in our case Chhattisgarh)? As you know, the 
> website /portal is awkwardly organized: not only are the maps in png format 
> (which is okay) but they don't have individual file names, and one has to 
> access each village separately by choosing it from a list within a taluka 
> (and within that some Revenue Inspector category).
>
> Can someone write code to download and tag a bunch of maps automatically? 
> Say for one whole taluka?
>
> Sharad
>
> On Friday, 13 December 2019 19:09:02 UTC+5:30, Sharad Lele wrote:
>>
>> Dear All,
>> I have discovered a source of cadastral maps for several states. This is 
>> mostly under the BhuNaksha initiative of NIC. They seem to have created 
>> separate websites for each state. Don't know for how many. I have found:
>>
>> Maharashtra: 
>> https://mahabhunakasha.mahabhumi.gov.in/bhunaksha/27/index.jsp
>> Madhya Pradesh: http://www.mpbhuabhilekh.nic.in/
>> Chhattisgarh: https://bhunaksha.cg.nic.in/#home-pane  (DOES NOT WORK 
>> RIGHT NOW)
>> Odisha: http://bhunakshaodisha.nic.in/bhunaksha/
>>
>> The BhuNaksha websites have a common format: you can choose district, 
>> taluka and village, and then the village cadastral map shows up (its in png 
>> format). You can click on a plot/parcel, and it will show the details of 
>> that plot: area, owner name, etc. You can generate  pdf report for that 
>> parcel. 
>>
>> Maharashtra version had added ability to show you the cadastral map in 
>> geo-rectified mode on top of a google-earth-like satellite image--quite 
>> useful.
>>
>> CATCH: a) the names of district, taluka, village etc are IN THE STATE 
>> SCRIPT: so devanagari for MP & Maha & CG, but Odiya for Odisha. So if you 
>> don't read that script--you are sunk
>> b) in most states (except Maharashtra!), it is not enough to know the 
>> district, taluka and village name. Within a taluka, you have know Revenue 
>> Inspector and then something called 'halka', and then choose from the 
>> villages within that halka. If you don't know this (RI and halka), you have 
>> to do brute force: search in each halka in each RI! (typical sarkari 
>> rubbish: not wanting common people to actually use the website!).
>>
>> Karnataka seems to have its own initiative: 
>> https://www.landrecords.karnataka.gov.in/service3/
>> Here, you can actually download pdfs of each cadastral map, and in some 
>> cases, even the KML! And searching for the village is district, taluka and 
>> then village.
>>
>> Hope this helps.
>>
>> I am sure there are more such websites for other states. Please look up 
>> and share.
>>
>> Sharad
>>
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/8ba4688b-25fd-4d01-a4da-5adc31da1459%40googlegroups.com.