Re: [datameet] Twitter data

[Srinivas Karuturi]

I am waiting for approval after I sent them the entire business case and what 
we are trying to do with the data.

> On 26 May 2020, at 3:32 PM, Craig Dsouza  wrote:
> 
> It got approved! didn't get an email update though,
> realized only when I visited dev.twitter.com <http://dev.twitter.com/>
> On Fri, May 22, 2020 at 6:39 PM Sidharth  <mailto:sidsu...@gmail.com>> wrote:
> Hi,
> 
> I could be due to Corona, the offices are in low capacity.
> 
> For me it was approved within hours.
> 
> Do let us know what happens.
> 
> Regards,
> Sid
> 
> On Fri, 22 May 2020, 11:40 Craig Dsouza,  <mailto:craigds...@gmail.com>> wrote:
> Hey all,
> if i can piggyback on this question
> how long does it typically take for the Twitter developer account to be 
> approved?
> I applied for one about 6 days ago , received one follow up mail and nothing 
> after that
> 
> Best
> Craig
> 
> On Fri, May 22, 2020 at 12:05 AM Srinivas Karuturi  <mailto:srini.karut...@gmail.com>> wrote:
> Thank you guys for all the feedback..
> 
> Regards,
> 
> Srinivas
> 
>> On 21 May 2020, at 10:00 AM, Rahul Gupta > <mailto:rahulgupta.w...@gmail.com>> wrote:
>> 
>> Hey Srini,
>> 
>> Best way to go about it is to register for a Twitter developer account and 
>> use the Twitter Data API.
>> 
>> Thanks & Regards-
>> Rahul Gupta
>> 
>> On Thu, 21 May, 2020, 11:28 am Srinivas Karuturi, > <mailto:srini.karut...@gmail.com>> wrote:
>> Ladies and Gentlemen,
>> 
>> I am working on building a sentiment analysis dashboard and would like to 
>> check if anyone is aware of good scraping tools that can gather tweets with 
>> the following information based on user input of keywords and location
>> 
>> 1. Original tweet, number of replies, number of likes, number of retweets, 
>> location, twitterHandle, link to the tweet
>> 2. Retweet, number of replies, number of likes, number of retweets, 
>> location, twitterHandle, link to the tweet
>> 3. Replies, number of replies, number of likes, number of retweets, 
>> location, twitterHandle, link to the tweet
>> 
>> Any information would be helpful
>> 
>> Regards,
>> 
>> Srinivas
>> 
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org <http://datameet.org/>
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+unsubscr...@googlegroups.com 
>> <mailto:datameet%2bunsubscr...@googlegroups.com>.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/BD1EA256-5761-4511-A4AD-30642160095D%40gmail.com
>>  
>> <https://groups.google.com/d/msgid/datameet/BD1EA256-5761-4511-A4AD-30642160095D%40gmail.com>.
>> 
>> -- 
>> Datameet is a community of Data Science enthusiasts in India. Know more 
>> about us by visiting http://datameet.org <http://datameet.org/>
>> --- 
>> You received this message because you are subscribed to the Google Groups 
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to datameet+unsubscr...@googlegroups.com 
>> <mailto:datameet+unsubscr...@googlegroups.com>.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/datameet/CAKxLuZfYv5Vv-i2Em2WXX9BVR_bVaHT-omE2tSzkR%2BDqbbaVqg%40mail.gmail.com
>>  
>> <https://groups.google.com/d/msgid/datameet/CAKxLuZfYv5Vv-i2Em2WXX9BVR_bVaHT-omE2tSzkR%2BDqbbaVqg%40mail.gmail.com?utm_medium=email_source=footer>.
> 
> 
> -- 
> Datameet is a community of Data Science enthusiasts in India. Know more about 
> us by visiting http://datameet.org <http://datameet.org/>
> --- 
> You received this message because you are subscribed to the Google Groups 
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to datameet+unsubscr...@googlegroups.com 
> <mailto:datameet+unsubscr...@googlegroups.com>.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/datameet/AB99FEBD-C3F7-4154-95A6-29040A862F6D%40gmail.com
>  
> <https://groups.google.com/d/msgid/datameet/AB99FEBD-C3F7-4154-95A6-29040A862F6D%40gmail.com?utm_medium=email_source=footer>.
> 
> 
> -- 
> Independent Researcher - Water Resources Management
> Open Water Data Project
> W

Re: [datameet] Twitter data

[Srinivas Karuturi]

Thank you guys for all the feedback..

Regards,

Srinivas

> On 21 May 2020, at 10:00 AM, Rahul Gupta  wrote:
> 
> Hey Srini,
> 
> Best way to go about it is to register for a Twitter developer account and 
> use the Twitter Data API.
> 
> Thanks & Regards-
> Rahul Gupta
> 
> On Thu, 21 May, 2020, 11:28 am Srinivas Karuturi,  <mailto:srini.karut...@gmail.com>> wrote:
> Ladies and Gentlemen,
> 
> I am working on building a sentiment analysis dashboard and would like to 
> check if anyone is aware of good scraping tools that can gather tweets with 
> the following information based on user input of keywords and location
> 
> 1. Original tweet, number of replies, number of likes, number of retweets, 
> location, twitterHandle, link to the tweet
> 2. Retweet, number of replies, number of likes, number of retweets, location, 
> twitterHandle, link to the tweet
> 3. Replies, number of replies, number of likes, number of retweets, location, 
> twitterHandle, link to the tweet
> 
> Any information would be helpful
> 
> Regards,
> 
> Srinivas
> 
> -- 
> Datameet is a community of Data Science enthusiasts in India. Know more about 
> us by visiting http://datameet.org <http://datameet.org/>
> --- 
> You received this message because you are subscribed to the Google Groups 
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to datameet+unsubscr...@googlegroups.com 
> <mailto:datameet%2bunsubscr...@googlegroups.com>.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/datameet/BD1EA256-5761-4511-A4AD-30642160095D%40gmail.com
>  
> <https://groups.google.com/d/msgid/datameet/BD1EA256-5761-4511-A4AD-30642160095D%40gmail.com>.
> 
> -- 
> Datameet is a community of Data Science enthusiasts in India. Know more about 
> us by visiting http://datameet.org <http://datameet.org/>
> --- 
> You received this message because you are subscribed to the Google Groups 
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to datameet+unsubscr...@googlegroups.com 
> <mailto:datameet+unsubscr...@googlegroups.com>.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/datameet/CAKxLuZfYv5Vv-i2Em2WXX9BVR_bVaHT-omE2tSzkR%2BDqbbaVqg%40mail.gmail.com
>  
> <https://groups.google.com/d/msgid/datameet/CAKxLuZfYv5Vv-i2Em2WXX9BVR_bVaHT-omE2tSzkR%2BDqbbaVqg%40mail.gmail.com?utm_medium=email_source=footer>.

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/AB99FEBD-C3F7-4154-95A6-29040A862F6D%40gmail.com.

[datameet] Twitter data

[Srinivas Karuturi]

Ladies and Gentlemen,

I am working on building a sentiment analysis dashboard and would like to check 
if anyone is aware of good scraping tools that can gather tweets with the 
following information based on user input of keywords and location

1. Original tweet, number of replies, number of likes, number of retweets, 
location, twitterHandle, link to the tweet
2. Retweet, number of replies, number of likes, number of retweets, location, 
twitterHandle, link to the tweet
3. Replies, number of replies, number of likes, number of retweets, location, 
twitterHandle, link to the tweet

Any information would be helpful

Regards,

Srinivas

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/BD1EA256-5761-4511-A4AD-30642160095D%40gmail.com.

Re: [datameet] Open Data Portal for smart cities

[Srinivas Karuturi]

The open data portal looks neat and the datasets are valuable.
The one challenge I see with the datasets is the lack of metadata and a 
standard glossary for the data to be used effectively.

In addition the Data Maturity Assessment Framework is weak as majority of the 
assessment is based on binary responses of a Yes/No

Not sure if the Maturity assessment framework is  open to feedback.. Can 
someone point me in the direction of who can we reach out to for fixing the 
Maturity assessment framework.

Regards,

Srinivas

Regards, Srinivas
On May 13, 2019, 4:58 PM +0400, Arun Ganesh , wrote:
> > This /looks/ really neat. Was going through some of the datasets and most 
> > seem to have city ward or zone level granularity.
> >
> > This will make the datameet municipal shapefiles much more relevant to use 
> > with all this data https://github.com/datameet/Municipal_Spatial_Data . 
> > Theres still over 70 cities for which ward shapes are not known, wish they 
> > would release that on the smartcities platform as well.
> --
> Datameet is a community of Data Science enthusiasts in India. Know more about 
> us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups 
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to datameet+unsubscr...@googlegroups.com.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/datameet/CA%2BGKQr3Ad8TtTnt6j-ybay_xiTd_-FY4JfbbGbO-cLr%2BueXuVA%40mail.gmail.com.
> For more options, visit https://groups.google.com/d/optout.

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/datameet/1aae65ef-da37-44a6-920d-962f9b00986b%40Spark.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] Policy alert - NDAP National Data & Analytics Platform

[Srinivas Karuturi]

Naveen,

I had attended the pre-bid meeting and this has been something that NITI Aayog 
has been trying to do for a long time and the RFP has gone through multiple 
extensions and cancellations.

The problem is no one is looking at it as a data gathering exercise with 
policies and procedures. What Niti Aayog wants to do is a little tricky from a 
data collection perspective.

I have been trying to get to the right people for expanding the Data Policy to 
give guidelines to ministries and help put them data oon data.gov 
<http://data.gov/>.in and NITI Aayog can then use the data to conduct different 
analyses and even bring in AI and ML.

If the policy and guidelines can be established it will be a lot easier for 
data.gov <http://data.gov/>.in or NITI Aayog to build analysis and develop use 
cases.

Do we know who this was awarded to? As this is a managed service they are 
trying to build.

Regards,

Srinivas

> On Feb 14, 2019, at 10:29 AM, Naveen Francis  wrote:
> 
> Hello,
> 
> 
> 
> When there already is a data.gov.in <http://data.gov.in/> initiative, why has 
> NITI Aayog decided to embark on the NDAP project? How exactly will NDAP be 
> different?
> 
> Data.gov.in is a very good initiative but when it comes to datasets, there 
> are a lot of ministries that put the data there (data.gov.in) and it is done 
> by choice. But they also put a lot more information on their (minstry’s) own 
> websites. Some of them have put the data there (data.gov.in) but there is no 
> compulsion to put data there. Some of the datasets have been put there for 
> two or three years and discontinued now. We are picking data directly from 
> the ministry’s website — that will be our primary source — and convert them 
> and standardise the format. Also, there are a lot of data on state government 
> websites that are not captured at all, and we will be having data from there 
> also.
> 
> https://factordaily.com/niti-aayogs-avik-sarkar-aims-for-democratized-data-led-discussion-and-analytics-in-india/
> 
> 
> 
> 
> 
> 
> On Friday, 12 October 2018 12:33:26 UTC+5:30, satyaakam wrote:
> On Fri, Oct 12, 2018 at 12:23 PM Srinivas Karuturi > 
> wrote:
> Satya,
> 
> The RFP is available at this link NDAP 
> <http://niti.gov.in/writereaddata/files/tenders/AMENDED-RFP-ndap.pdf>
> thanks i will go through it
>  
> The RFP says you can attend the meeting for clarifications and there is no 
> need to register for it. I will drop an email to see if we need a special 
> invite.
> 
> it would be good for those of you who are interested can collate some 
> questions after reading the document and we would be happy to raise them in 
> the meeting from our side as DataMeet 
> 
> thanks,
> -Satya
> Satyaakam.net <http://satyaakam.net/> | afrost.org <http://afrost.org/> | 
> fossevents.in <http://www.fossevents.in/>
> ** For all official purposes use my name as Satyakam Goswami **
> 
> -- 
> Datameet is a community of Data Science enthusiasts in India. Know more about 
> us by visiting http://datameet.org <http://datameet.org/>
> --- 
> You received this message because you are subscribed to the Google Groups 
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to datameet+unsubscr...@googlegroups.com 
> <mailto:datameet+unsubscr...@googlegroups.com>.
> For more options, visit https://groups.google.com/d/optout 
> <https://groups.google.com/d/optout>.

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] Telangana Open Data Portal using DKAN, scope for querying data

[Srinivas Karuturi]

Nihkil,

I beg to differ with you on the geospatial aspect and the value of the 
datasets. They have only been publishing aggregated numbers for data that could 
be a little more granular. Like for example MeeSeva Transactions/Electricity 
connections to households etc.. The best example is the Police Stations dataset 
which is an aggregate number of police stations in a district which is of zero 
value in my opinion. The baseman of the state along with new district 
boundaries is not yet publicly available in machine readable formats.

I have been pushing them to publish granular data with little luck.  

Regards,

Srinivas

> On Oct 18, 2018, at 8:47 AM, Nikhil VJ  wrote:
> 
> Hi Folks,
> 
> Friends at Telangana Open Data Portal recently showed me recently how the 
> data posted there can be queried via API. This throws up good opportunities 
> to build pages/portals that combine multiple datasets together. (The portal 
> natively has great visualization tools but that is inside a dataset's page) 
> They will even be putting up datasets having lat-longs so there's good 
> mapping opportunities there.
> 
> I've shared details here: 
> https://github.com/datameet-pune/datameet-pune.github.io/issues/17 
> 
> 
> One example:
> Monthly maximum temperature data: Query for district = Adilabad, and limit to 
> 2 results:
> 
> https://www.data.telangana.gov.in/api/action/datastore/search.json?resource_id=cc9950ce-89aa-455b-847b-d87756db8f91=adilabad=2
>  
> 
> 
> You can play around with the last part of the URL to get different results.
> The data can be pulled in with a simple GET fetch, can be done from simple 
> Javascript.
> 
> If you're interested in building something on this together, please let me 
> know.
> 
> -
> GeoSpatial:
> If you know how to implement geospatial stuff on a DKAN platform and have 
> some prior experience in that, please share.
> 
> Example: Suppose there is a CSV dataset of public toilets with lat-longs. We 
> want to query to get all toilets withing 10km radius of a given lat-long. We 
> could pull in all the data and perform the geospatial filtering at our end 
> using libraries like turf.js, but it would be cool to have the data portal 
> itself also have such capabilities, plus if the dataset is huge it's better 
> to filter at server end. Then one could even run a generic search like "give 
> me all the data you have in these 50 datasets that's located within 10 km of 
> this lat-long point".
> 
> --
> Cheers,
> Nikhil VJ
> +91-966-583-1250
> Pune, India
> http://nikhilvj.co.in 
> 
> -- 
> Datameet is a community of Data Science enthusiasts in India. Know more about 
> us by visiting http://datameet.org 
> --- 
> You received this message because you are subscribed to the Google Groups 
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to datameet+unsubscr...@googlegroups.com 
> .
> For more options, visit https://groups.google.com/d/optout 
> .

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] Policy alert - NDAP National Data & Analytics Platform

[Srinivas Karuturi]

Satya,

The RFP is available at this link NDAP 

The RFP says you can attend the meeting for clarifications and there is no need 
to register for it. I will drop an email to see if we need a special invite.

Regards,

Srinivas


> On Oct 12, 2018, at 10:48 AM, satyakam goswami  wrote:
> 
> Anyone in Delhi who is willing to join me for the meeting and possibly 
> working on the project to develop Open Data Standards for India’s.
> 
> Hi,
> 
> I should be available do you have any formal invite about the meeting place 
> and time? also if you have the RFP with you can you share it with us so that 
> we can come prepared.
> 
> thanks
> 
> -Satya
> Satyaakam.net  | afrost.org  | 
> fossevents.in 
> ** For all official purposes use my name as Satyakam Goswami **
> 
> 
> -- 
> Datameet is a community of Data Science enthusiasts in India. Know more about 
> us by visiting http://datameet.org 
> --- 
> You received this message because you are subscribed to the Google Groups 
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to datameet+unsubscr...@googlegroups.com 
> .
> For more options, visit https://groups.google.com/d/optout 
> .

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[datameet] Granularity of Open Data (Telangana State)

[Srinivas Karuturi]

Dear Data Meet,

I have been looking at and tracking the Open Data Portal of Telangana and fail 
to understand why only aggregated data is published and not granular data. I 
have written a note to the Telangana Open Data team and would like to enquire 
if anyone has the following datasets.

1. Banks (with GeoLocation)
2. Post Office (with geo Location)
3. Police Station (with geoLocation)
4. meeSeva centers (with geoLocation)
5. Electrical Sub Stations (with GeoLocation)

I am looking to gather this data to conduct an analysis on the proximity of 
services for people of Telangana.
Attached is a quick and dirty analysis done on the data published on the Open 
Data Portal which shows that certain districts have more domestic electricity 
connections than households.

Attached is the excel file and if you have the data hit me up

Regards,

Srinivas

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


TS_OpenDataAnalysis.xlsx
Description: MS-Excel 2007 spreadsheet


-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] 12th January Data Protection Committee Public Consultation in Hyderabad

[Srinivas Karuturi]

Is there a way we can push them to do an online consultation as well versus 
traveling to various places? 
I would like to participate in the feedback and possibly present the whole 
thing on Data Protection/ Privacy/ Classification of data and how it should be 
managed within Government entities. 

I am not residing in India and hence the challenge. If we can get the full 
schedule then I can make plans to travel for one of the meeting.

Regards,

Srinivas

> On Jan 11, 2018, at 1:14 PM, srinivas kodali  wrote:
> 
> Hi All,
> 
> The Justice SriKrishna committee on Data Protection will be in Hyderabad for 
> Public consultation on 12th January. 
> 
> The white paper released by the committee can be accessed here 
> https://innovate.mygov.in/data-protection-in-india/ 
> 
> 
> The committee report doesn't yet cover classification of public data/ open 
> data, apart from a wide range of issues like data ownership, encryption and 
> other such important issues around data. 
> 
> If you are in Hyderabad, please do attend it and raise these issues. The 
> location of the consultation and registration link is shared below
> 
> The Auditorium, Dr. MCR HRD Institute, 
> Road No. 25, Jubillee Hills, Hyderabad – 500 033.
> 
> people can register here https://innovate.mygov.in/dpipc_location/hyderabad/ 
> 
> 
> 
> Regards,
> Srinivas Kodali
> www.lostprogrammer.com 
> 
> -- 
> Datameet is a community of Data Science enthusiasts in India. Know more about 
> us by visiting http://datameet.org 
> --- 
> You received this message because you are subscribed to the Google Groups 
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to datameet+unsubscr...@googlegroups.com 
> .
> For more options, visit https://groups.google.com/d/optout 
> .

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[datameet] Delhi Open Data

[Srinivas Karuturi]

Ladies & Gentlemen,

Does anyone know if the following datasets are published by Delhi Government in 
an Open Format
1. Delhi Metro Locations and routes
2. Delhi Bus routes and bus stops
2. Basemap of Delhi
3. Sensor information on Pollution
4. Traffic counts data

In watching the news on Pollution in Delhi and the discussions/debates on 
firecrackers, vehicles etc I would like to do a in depth analysis and plot it 
on a map and see where challenges exist. This analysis could throw some 
interesting perspective on tackling the pollution problem.

I have done similar analysis in Dubai around solving the traffic challenges and 
possible reasons for traffic on the main arteries in Dubai.

Regards,

Srinivas

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] Open Data: Choking India’s Innovation Pipe

[Srinivas Karuturi]

Srini & members

The need is for a strong review mechanism of datasets classification as
open. It needs to be critically reviewed and the opening of data and
bringing transparency might hurt certain businesses if their practices are
not fair.

I strongly feel that there needs to be a federal level standards and
policies which can then be take. And states cities and muncipalities can
adopt and enhance.

Driving standards that are consistent across is very important

Regards

Srinivas

I
On Thu, Jun 22, 2017 at 7:56 PM srinivas kodali 
wrote:

> Dear Anchal,
>
> Thank you for sharing this within the group. I read this on the day it
> appeared in Ken and shared with the group. I largely agree with your
> article, but have to say you might be unaware of the existence of certain
> databases. There is lot of data out there and is actually not really that
> bad. For example:
>
> 1. EXIM data was being published by customs authorities until Nov 26th,
> 2016. https://factordaily.com/customs-stops-trade-data/ They shut it down
> because of few businesses complaining to the PMO and commerce ministry
> along with customs dept.
> https://www.documentcloud.org/documents/3701588-Customs-Data-RTI-Response.html
> There are business which were effected by this move, but they still have
> the old data.
>
> 2. The example of real-time data of buses and trains not available is a
> bit of a myth. Within datameet there were multiple API's and datasets
> shared related to this data. Few apps like ixigo, travel yatri actually use
> real-time railway data published by railways. But accessing them might not
> be straight forward. ixigo for example used break encrypted railway data to
> profit from it, they don't it anymore.
> https://www.youtube.com/watch?v=0kaUz_F3Eo0
>
> 3. You can buy information from MCA on companies data. This data exists in
> an open standard called XBRL. Open Corporates a startup actually lists
> worlds company data including that of India
> https://opencorporates.com/companies/in
>
> While you stress that it is important data which can be used by businesses
> to improve efficiency in trade and other sectors. I would like to highlight
> that govt. is not obligated to release this information for private parties
> to profit but rather to increase transparency and accountability of
> everyone. As much as I want this data too, we cannot demand it with wrong
> reasons. Indian Railways and BMTC are planning to sell real-time data,
> which I think is their right to do so. They want to do it earn revenue,
> every department has different incentives to open or close data.
>
> It is not really that straight forward to ask them to open all the data.
> But we can ask them what all can they open and how can they implement NDSAP
> in the right way. Stating this, I request you to write more on open data in
> the future.
>
> Regards,
> Srinivas Kodali
> www.lostprogrammer.com
>
> On Thu, Jun 22, 2017 at 2:23 PM, Anchal Agarwal <
> anc...@thirdwavesolutions.in> wrote:
>
>> Hello Group, I have written an article in 'the Ken' on the state of Open
>> data in the country and how government is restricting access to the most
>> important datasets of the country. Please give your feedback on this
>> article - also are there other datasets which are very important for the
>> economy but are behind restricted access. Please let me know of such
>> datasets.. we will try to highlight them in media and to the government.
>>
>> Here is the link of my article :
>> https://the-ken.com/choking-innovation-pipe/
>>
>> Know Your Defaulter, or KYD, launched in mid-2016. The startup’s software
>> spiders crawled through dozens and hundreds of data sources each day –
>> court cases, company filings, credit ratings and defaulter lists put out by
>> banks and financial institutions. It allowed anyone to instantly conduct an
>> online due diligence on a company before entering into any sort of
>> agreement with it. In less than a year, KYD had saved tens, possibly
>> hundreds of millions of dollars for its users by helping them spot
>> companies that were unscrupulous.
>>
>>
>> Best Trip, a trip planning app that showed real-time road traffic
>> conditions in the top six Indian metro cities was credited with saving
>> millions of commuter hours, vehicle fuel and generating hundreds of
>> millions of dollars in productivity and healthcare costs savings in just
>> the 17 months since its launch in late 2015.
>>
>> There’s also the story of Compliance Scanner which started in 2014 as
>> Data Watch. After the first year of meandering, trying to find its business
>> purpose, it pivoted into a useful tool that allowed anyone to instantly
>> identify the statutory compliance status of Indian firms on various laws.
>> Regulators, lawyers, consultants, civic-minded citizens and NGOs; all
>> relied on it to spot variances between what a company claimed in public,
>> and what it practiced in private. It was single handedly responsible 

Re: [datameet] Telegana Open Data Policy and portal

[Srinivas Karuturi]

It's nice to have portal up and running on CKAN.

The datasets up there are purely information on counts and not the full
list that is geo coded.

Not sure of the value these datasets have and the innovation these datasets
can generate for the state of Telangana.

Also the license says not specified

Regards

Srinivas

On Sat, May 20, 2017 at 8:34 AM srinivas kodali 
wrote:

> Yeiy, We have a portal.
>
> Regards,
> Srinivas Kodali
> www.lostprogrammer.com
>
> On Fri, May 19, 2017 at 1:37 PM, Nisha Thompson 
> wrote:
>
>>
>> http://www.livemint.com/Companies/iZKdgU1KkQh4azdSKCZ31O/Telanganas-open-data-policy-to-help-startups-address-pub.html
>>
>> http://www.it.telangana.gov.in/telangana-open-data-policy-2016/
>>
>> http://www.data.telangana.gov.in/
>>
>> --
>> Nisha Thompson
>> DataMeet.org
>> ni...@datameet.org
>> skype: nishaqt
>> mobile: 962-061-2245
>>
>>
>> --
>> Datameet is a community of Data Science enthusiasts in India. Know more
>> about us by visiting http://datameet.org
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "datameet" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to datameet+unsubscr...@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
> --
> Datameet is a community of Data Science enthusiasts in India. Know more
> about us by visiting http://datameet.org
> ---
> You received this message because you are subscribed to the Google Groups
> "datameet" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to datameet+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] India - Number of companies by employee size

[Srinivas Karuturi]

Hi Balaji,

You have the list of company master data on data.gov.in until March 
2015. The data has paid up capital and authorised capital in the 
dataset. I have written to the chief data officer asking to see if they 
can publish a consolidated india wide company master data.


I know you are looking for number of employees which does not exist on 
the master data.


If I may ask what is that you are trying to answer with the number of 
employees? A better way to determine the company size could possibly be 
the paid up capital or authorized capital.


Regards,

srinivas

On 3/22/17 3:56 PM, Sutirtha Roy wrote:
Hi Balaji: This is available in the 6th Economic Census (covers formal 
+ informal). The MOSPI report has different bins than those you 
mentioned in the email. If you want to create your bins you will need 
to buy the unit level data from MOSPI.


http://mail.mospi.gov.in/index.php/catalog/167/related_materials > 
EC6_ALL_INDIA_REPORT_PUBLISHED_BY_ESD_CSO.pdf > pages 170-175


Best,
Sutirtha

On Wed, Mar 22, 2017 at 5:09 PM, Balaji Subbaraman > wrote:


Friend,

I am looking for a data like number of companies in India by
Employee Size.  Something like

1000+ employees – 3000 companies

2000+ employees – 1000 companies

5000+ employees – 200 companies

Any pointer would be a great help to me!!!

Thanks

Regards

Balaji

http://knoema.com

-- 
Datameet is a community of Data Science enthusiasts in India. Know

more about us by visiting http://datameet.org
---
You received this message because you are subscribed to the Google
Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to datameet+unsubscr...@googlegroups.com
.
For more options, visit https://groups.google.com/d/optout
.


--
Datameet is a community of Data Science enthusiasts in India. Know 
more about us by visiting http://datameet.org

---
You received this message because you are subscribed to the Google 
Groups "datameet" group.
To unsubscribe from this group and stop receiving emails from it, send 
an email to datameet+unsubscr...@googlegroups.com 
.

For more options, visit https://groups.google.com/d/optout.


--
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups "datameet" group.

To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[datameet] Re: State Election data

[Srinivas Karuturi]

I was curious about the data and looked at the number of people with voters 
at electoralsearch.in and it gives you the count of people with their names 
and father/husband name along with polling station.

The total records in electoral search and the total electorals on 
eci.nic.in has a difference. The difference is small but there seems to be 
a discrepancy

Is there a way we can pull the number of electors per constituency?

Regards,

Srinivas

On Sunday, March 12, 2017 at 8:09:52 AM UTC+4, Shabda Raaj wrote:
>
> We pulled the state election results which came out today from the ECI 
> site.
>
> https://github.com/Vizbi/state-elections
>
> There is a python script in the repo which was used to pull this data 
> (requests+beautiful soup).
>

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[datameet] Introduction and Interests

[Srinivas Karuturi]

Dear Datameet group,

I am Data Management specialist and have been in the data space for over 12 
years in my 20 year career as a technologist. I am not a coder anymore and 
over the past year have been developing data policies and guidelines for 
the Dubai Data Establishment which is responsible for the Open Data program 
of Dubai.

I have been exploring India's open data portal and have been keenly 
following the developments on data in India.

I would like to see how we together as a group can push publication of open 
data on data.gov.in 
I have explored the datasets there specially from DOF and there is no 
granularity or geocoding of the spend on various schemes of the government.

Would like to see if we can start exploring means of pushing the data 
movement

Regards,

Srinivas Karuturi

 

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.