Re: [datameet] Is data behind non-monetary paywalls really open?

2013-02-18 Thread Avinash Celestine
there was some movement towards the making of govt funded work, or hopefully just govt work, copyright-free. there were many proposals before the govt when the last amendment to the copyright act came up for revision. However such proposals were rejected and they didnt go through. It is worth

Re: [datameet] Provocative topic for the group's feedback! :You Can't Just Hack Your Way to Social Change

2013-04-30 Thread Avinash Celestine
paper. this is quite naive. in many such cases the political decision has already been taken. the data part of it is just an input. And its not at all clear that had the data showed something else, a different decision would have been taken Avinash On Apr 30, 2013 9:32 PM, Avinash Celestine

[datameet] an idea of how difficult it is to do detailed mapping in India

2013-05-15 Thread Avinash Celestine
this is an interesting paper on an attempt to do detailed sub-district level mapping in South India. http://www.demographie.net/sifp/Output/methodology.pdf -- For more details about this list http://datameet.org/discussions/ --- You received this message because you are subscribed to the

Re: [datameet] Postal book of information

2013-06-11 Thread Avinash Celestine
interesting. incidentally I understand that with the networking of post offices, there is a substantial amount of data that the postal department has sitting on its servers (unfortunately not public as far as I know), relating to domestic remittances through money orders. Such information would be

[datameet] Two easy-to-use online mapping tools

2013-09-03 Thread Avinash Celestine
Hi All Thought i would share a couple of (free!) tools available online which facilitate mapping. I came across these tools while doing maps for my blog ( datastories.in). indiemapper.com if you have a shapefile, its a great tool. upload the shapefile, and attribute data and it generates the

Re: [datameet] Map of Lok Sabha Constituencies?

2013-10-11 Thread Avinash Celestine
if you are not looking for georeferenced maps then the pdfs on this site might help. you can clean the pdfs in inkscape or adobe illustrator... http://ecimaps.gisserver1.nic.in/ these are the only maps that i known of, in the public domain, which have post delimitation parliamentary and assembly

Re: [datameet] Power Tariff Data

2013-11-28 Thread Avinash Celestine
the CEA collects tariffs and duties of power across states in one place so you might want to look at this source first... http://cea.nic.in/eandc_wing.html last two links on page Avinash On Thu, Nov 28, 2013 at 9:08 PM, Naveen Gattu naveen.ga...@gramener.comwrote: Thanks Venkat , this was

Re: [datameet] Parliamentary Constituency to Assembly Constituency to Ward linkages

2014-03-12 Thread Avinash Celestine
well i checked out the unicode table and it only confirms what we knew anyway... that there's duplication of unicode hex values for different characters... So i guess its back to the drawing board. On Thu, Mar 13, 2014 at 9:43 AM, Avinash Celestine avinash.celest...@gmail.com wrote: Hi

Re: [datameet] Parliamentary Constituency to Assembly Constituency to Ward linkages

2014-03-13 Thread Avinash Celestine
a list of states where this problem occurs - I have seen it in Gujarat and UP for sure, but don't know whether it happens everywhere, Best, Raphael On 13.03.2014 05:35, Avinash Celestine wrote: well i checked out the unicode table and it only confirms what we knew anyway... that there's

Re: [datameet] Parliamentary Constituency to Assembly Constituency to Ward linkages

2014-03-15 Thread Avinash Celestine
would proliferate if you aggregate to PC, Hope it helps, Raphael On 15.03.2014 06:57, Avinash Celestine wrote: hi attached an excel with AC-PC-district -states matching along with codes for AC-PC. I can add census district codes if you like...give me a day or two some states

Re: [datameet] Parliamentary Constituency to Assembly Constituency to Ward linkages

2014-03-15 Thread Avinash Celestine
, the powers of a MLA administratively is much too nebulous as compared to district officials across the bureaucracy and the third tier of democracy. On Sat, Mar 15, 2014 at 1:49 PM, Avinash Celestine avinash.celest...@gmail.com wrote: unfortunately you may be right... so thats another layer

Re: [datameet] NSSO Rural Price/Wage Data

2014-03-22 Thread Avinash Celestine
Hi Fenella, Check each of the links below. You may be able to find what you want http://mospi.nic.in/Mospi_New/upload/concepts_golden.pdf (older doc, so not sure how relevant) http://mospi.nic.in/mospi_new/upload/nsso/nss_regions.pdf

Re: [datameet] Good data from ECI - possible to extract?

2014-03-27 Thread Avinash Celestine
you could scrape it... or you could just export it to excel :-) the icon on the top left of the screen just below the 'Home' link . just select AC wise all states in the options A On Thu, Mar 27, 2014 at 12:43 PM, Thejesh GN i...@thejeshgn.com wrote: Very True, I have added it to my

[datameet] format for release of candidates assets/ criminal records data

2014-04-05 Thread Avinash Celestine
Hi all I recall there being a letter circulated about data requests to eci a few days ago. I had a suggestion about the format in which the ECI releases (or enables the release of), data contained in the affidavits of candidates. I wasnt sure whether this suggestion fit into that, so i broke it

Re: [datameet] Mapping elections: open GIS shapefile drafts

2014-04-09 Thread Avinash Celestine
this is great, Raphael. thanks very much.. Avinash On Thu, Apr 10, 2014 at 12:18 AM, Thejesh GN i...@thejeshgn.com wrote: This is super awesome. As of now I am going through Delhi files, I will let you know if I find any interesting stuff. Thej Thej -- Thejesh GN *⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್

Re: [datameet] Security Issues with the Voter List

2014-04-11 Thread Avinash Celestine
Hi Gautam I dont think the issue is with having the electoral roll available publicly per se. personally, i think its better that the rolls are available in the open, as compared with the alternative, where it is confidential, thus leaving it open to other types of abuses. But i do think that

Re: [datameet] Cleaning MCD ward shepfile data

2014-04-24 Thread Avinash Celestine
,EuwZL8r On Thursday, April 24, 2014 3:20:46 PM UTC+5:30, Avinash Celestine wrote: Hi Here's the source from which I adapted the point data http://app.mapmyindia.com/mcdApp/ this should enable you to check the veracity of the areas. as a plus point its an official source. Avinash On Thu

Re: [datameet] Cleaning MCD ward shepfile data

2014-04-24 Thread Avinash Celestine
, Padmanabh prabhas.padman...@gmail.com wrote: I ran a script to check if it contained any duplicates and it doesn't. Thanks a lot, once again. Btw, what license should I consider this data to be under? On Thursday, April 24, 2014 5:22:59 PM UTC+5:30, Avinash Celestine wrote: Hi Can you

[datameet] transliteration tools?

2014-04-24 Thread Avinash Celestine
Hi Are there any good tools/code etc out there which enable you to do bulk transliteration (not translation) across languages - specifically names in Hindi(or any other Indian language) to names in English? thanks Avinash -- For more details about this list http://datameet.org/discussions/

Re: [datameet] transliteration tools?

2014-04-24 Thread Avinash Celestine
to Kannada, you can probably try other way. -- Thejesh GN ⏚ ತೇಜೇಶ್ ಜಿ.ಎನ್ http://thejeshgn.com GPG ID : 0xBFFC8DD3C06DD6B0 On Apr 25, 2014 10:04 AM, Avinash Celestine avinash.celest...@gmail.com wrote: Hi Are there any good tools/code etc out there which enable you to do bulk

Re: [datameet] Q on retrieving DUSIB data from G maps engine

2014-05-05 Thread Avinash Celestine
*⏚* ತೇಜೇಶ್ ಜಿ.ಎನ್ http://thejeshgn.com GPG ID : 0xBFFC8DD3C06DD6B0 On Mon, May 5, 2014 at 3:48 PM, Avinash Celestine avinash.celest...@gmail.com wrote: Hi all Needed some help I just wanted to know if it was at all possible to retrieve the data (geometries etc) underlying the map linked

[datameet] Re: some shapefiles for delhi

2014-05-13 Thread Avinash Celestine
I should add that the delhi colonies shapefile only covers areas under MCD, not NDMC or delhi cantt Avinash On Tue, May 13, 2014 at 3:52 PM, Avinash Celestine avinash.celest...@gmail.com wrote: Hi Couple of shapefiles for delhi 1. police stations jurisdiction (source : http

Re: [datameet] Re: Security Issues with the Voter List

2014-05-21 Thread Avinash Celestine
One more data point to our discussion on data privacy in indian elections, though from a slightly different perspective. EC has told supreme court that it is against making polling station level voting data public

Re: [datameet] the datameet districts shapefile with 2011 census district codes added

2014-05-21 Thread Avinash Celestine
, Is there a list of these 640 districts along with their codes on the Census Website? While creating the data, I had not found it, and instead had to use the statewise codes that are available in the Administrative atlas. Regards, Devdatta Tengshe On Thu, May 22, 2014 at 9:41 AM, Avinash

Re: [datameet] Realtime data of Delhi air pollution - Ban on linking, scraping!

2014-05-21 Thread Avinash Celestine
yes that is a little extreme :-) Has anyone explored the CPCB's environmental data bank? http://cpcbedb.nic.in/default.htm (best viewed on IE) On Wed, May 21, 2014 at 5:50 PM, Thejesh GN i...@thejeshgn.com wrote: Realtime data of Delhi air pollution

[datameet] fuzzy matching text in Excel

2014-05-22 Thread Avinash Celestine
Thought i would share this link. It gives the code for a fuzzy match version of Excel's vlookup function. I've used it for a couple of years actually, and it works quite well. Extremely useful when trying to match names, places etc.

Re: [datameet] Booth-wise elector count (male/female/other/total)

2014-06-07 Thread Avinash Celestine
great. thanks Have the form 20s for UP been put out? I know Bihar and Bengal are out... Avinash On Sat, Jun 7, 2014 at 11:56 AM, Raphael Susewind li...@raphael-susewind.de wrote: Dear all, now that Form20 results start to come out, some of you might be interested in booth-wise elector

[datameet] temperature data for cities - historical

2014-06-19 Thread Avinash Celestine
Does anyone know of a source of daily temperature data (max,min) for cities which goes back a few years? Most of the daily data only goes back a couple of months, and those which are a couple of years old are monthly averages. regards Avinash -- Datameet is a community of Data Science

Re: [datameet] Re: temperature data for cities - historical

2014-06-19 Thread Avinash Celestine
rainfall of important stations for the period 1901-2000 On Thursday, June 19, 2014 3:13:10 PM UTC+5:30, Avinash Celestine wrote: Does anyone know of a source of daily temperature data (max,min) for cities which goes back a few years? Most of the daily data only goes back a couple of months

Re: [datameet] Re: temperature data for cities - historical

2014-06-19 Thread Avinash Celestine
Minimum temperature and monthly total rainfall of important stations for the period 1901-2000 On Thursday, June 19, 2014 3:13:10 PM UTC+5:30, Avinash Celestine wrote: Does anyone know of a source of daily temperature data (max,min) for cities which goes back a few years? Most of the daily

Re: [datameet] Security in Indian Railways Websites

2014-08-14 Thread Avinash Celestine
lol. and an earlier email to this group had pointed out that another part of the railway site had the captcha code hardcoded into the html source... On Fri, Aug 15, 2014 at 5:18 AM, srinivas kodali iota.kod...@gmail.com wrote: Somebody needs to help the IT team at Centre for Railway

[datameet] fyi ...EC GIS maps for assembly constituencies

2014-10-15 Thread Avinash Celestine
Apologies if this has already come up in the past on this group, but the EC's polling station locator site (psleci.nic.in), now has kml files for ACs for a number of states. the links are in the source of main page (zip files). however, not all states are there. states such as Tamil Nadu, JK,

Re: [datameet] Form 20 for Mumbai

2014-11-06 Thread Avinash Celestine
Hi Raphael, some of those links are dead, but not all. seems not all form 20s for each constituency have been uploaded yet. I have the ones for which it is (downloaded sometime back) ...attached. as far as mumbai is concerned, I think the south mumbai data is not there yet...ignore the pdf files

Re: [datameet] Form 20 for Mumbai

2014-11-07 Thread Avinash Celestine
and/or whether assembly form 20 will be available? Best, Raphael On 07.11.2014 08:52, Avinash Celestine wrote: I should mention that these are for the parliamentary elections of May 2014, not the recent assembly elections. A On Fri, Nov 7, 2014 at 1:20 PM, Avinash Celestine

Re: [datameet] Pincode Boundaries of India

2016-03-27 Thread Avinash Celestine
perhaps one way is to avoid using postal data altogether. All header pages in electoral rolls(the first page) contain the name of the polling station related to that roll, the PS number, and importantly the pin code. A site like psleci.nic.in has geog coordinates of polling stations (though

Re: [datameet] Pincode Boundaries of India

2016-04-04 Thread Avinash Celestine
incode A quite frequently. The heatmap stuff >>> > takes care of this). >>> > >>> > Since I am not familiar with postal boundaries: can anyone here confirm >>> > whether pincode areas are contiguous, and whether each pincode has only >>>

Re: [datameet] Pincode Boundaries of India

2016-04-01 Thread Avinash Celestine
th other pincodes? (In which case voronoi would > > perhaps be the better solution at last) > > > > In any case, I hope to give you the pincode for each polling booth by > > end of the week or so (based on all-India 2014 electoral rolls), > > > > Best, > > Raphae

[datameet] update to pincodes data

2016-04-30 Thread Avinash Celestine
Hi Came across this site a week or so ago : http://pmjdy.gov.in/g-i-s.aspx. This site, which is part of the PMJDY (jan dhan yojana), has geolocations for post offices among others. There are 1.42 lakh post office locations given in this map. I have tried to match these locations to actual

Re: [datameet] Re: What do you people think about the new proposed Bill about Maps and Geospatial data

2016-05-09 Thread Avinash Celestine
Also, i guess its worthwhile pointing out that if the primary aim is to prevent inaccurate depiction of India's borders and impose penalties on those who do, there is already existing legislation which does that. https://indiankanoon.org/doc/496978/ Plus, the IT act too penalises wrong depiction

Re: [datameet] Pincode Boundaries of India

2017-03-01 Thread Avinash Celestine
in codes, you have also been able to get gram > panchayat names. How have you managed that? Could you please tell me. > > regards, > Veena > > On 4 April 2016 at 12:44, Avinash Celestine <avinash.celest...@gmail.com> > wrote: > >> Adding some relevant data. >> &g

Re: [datameet] Re: India GIS Data Update/ Questions

2017-08-28 Thread Avinash Celestine
ward to ward mapping across 2001-2011 the zip file is at https://github.com/avinashcelestine/village_town_mapping_2001_2011 On Mon, Aug 28, 2017 at 1:00 PM, Avinash Celestine < avinash.celest...@gmail.com> wrote: > enclosing a mapping of 2001-2011 village / town codes. these f

Re: [datameet] Parliamentary constituency boundaries 2019

2019-03-18 Thread Avinash Celestine
Constituency boundaries were last delimited in 2008, and have not changed since. On Sat, Mar 16, 2019 at 12:06 AM Arun Ganesh wrote: > With the upcoming elections, this would be a hot dataset that everyone > will be looking for. The best available dataset on the web right now is on > the

[datameet] [old school?] random sampling vs big data - which is better?

2019-11-05 Thread Avinash Celestine
v. interesting paper which asks the question: What should I trust more: a 1% survey with 60% response rate or a *self-reported* administrative dataset covering 80% of the population? https://statistics.fas.harvard.edu/files/statistics-2/files/statistical_paradises_and_paradoxes.pdf -- Datameet