[datameet] Smart Mobility for Bengaluru

[srinivas kodali]

There is workshop on smart mobility for Bengaluru on 10th, Friday.  Where
they are gonna talk about most of the IT related projects for Bengaluru.
http://www.thescif.in/#!smart-mobility-event/jwyfd

I wish I could be there, but if anyone who is interested and gonna attend.
Please share some notes.

Regards,
Srinivas Kodali
www.lostprogrammer.com
*"Not everyone who wanders is lost, I am probably a bit"*

-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [datameet] BMTC ITS Inauguration | ITC Windsor Hotel | 07.30pm | Today

[H. S. Sudhira]

@Srinivas Kodali, See what Xerox has pulled out:
https://play.google.com/store/apps/details?id=com.xrce.gobengaluru=en

I am informed that they are having a formal launch next week.

Sudhira.

On 8 June 2016 at 14:10, srinivas kodali  wrote:

> Here is a dump of the some GPS data, I was mining. There are several
> issues with bmtc, buses with same numbers in different routes at same time.
> Zero fares for few airport routes. Overall it will need at-least 2 more
> months for things to get fixed.
>
> https://drive.google.com/open?id=0B1RcWLku0ZOWejg2Ql96UlMxRVE
>
> Anyone interested to do your own analysis, visualization are welcome to
> share the results to be forwarded to BMTC.
>
> I am waiting to get all the buses come online, to make a GTFS, GTFS-RT
> based on dynamic schedules based on traffic patterns through the GPS data.
> Right now the schedules are real bad.
>
> Regards,
> Srinivas Kodali
> www.lostprogrammer.com
> *"Not everyone who wanders is lost, I am probably a bit"*
>
> On Thu, Jun 2, 2016 at 9:16 PM, srinivas kodali 
> wrote:
>
>> From what they are saying in the newspapers. They have improved the app
>> and now 70% of the buses should be online. The issues with ETA are a
>> different game altogether. I will write more crawler's to look into further
>> details.
>>
>> If more people want to work towards something, we can host a hangout over
>> the weekend. But if there is not much interest, I will keep posting updates.
>>
>> Regards,
>> Srinivas Kodali
>> www.lostprogrammer.com
>> *"Not everyone who wanders is lost, I am probably a bit"*
>>
>> On Thu, Jun 2, 2016 at 3:15 PM, Suvajit Sengupta <
>> suvajit.sengu...@gmail.com> wrote:
>>
>>> Great Srinivas.
>>> Its a real tipping point as we could make BMTC talk of open data policy.
>>>
>>>
>>> Lets engage to chalk out our next steps.
>>>
>>> Regards,
>>> Suvajit
>>>
>>> Regards,
>>> Suvajit
>>>
>>> My galleria @ http://www.flickr.com/photos/jeet_sen
>>>
>>> On Thu, Jun 2, 2016 at 2:23 PM, srinivas kodali 
>>> wrote:
>>>
 So I received a reply from the IT Director, they said they will look
 into these issues we highlighted and at the same time I awaiting a reply on
 questions related to the system. Their plans of a data policy is being
 covered in the press. This is a important factor for other transport
 agencies in India and open data policies for Bangalore through BBMP &
 Karnataka.


 http://tech.economictimes.indiatimes.com/news/internet/bmtc-plans-an-open-data-policy-to-boost-its-intelligent-transport-system/52547930

 Regards,
 Srinivas Kodali
 www.lostprogrammer.com
 *"Not everyone who wanders is lost, I am probably a bit"*

 On Tue, May 31, 2016 at 5:08 PM, srinivas kodali  wrote:

> they already have plans to open the data up. I am just trying to get a
> dialogue to make sure most of the data is made public.
>
> Regards,
> Srinivas Kodali
> www.lostprogrammer.com
> *"Not everyone who wanders is lost, I am probably a bit"*
>
> On Sun, May 29, 2016 at 11:46 PM, Suvajit Sengupta <
> suvajit.sengu...@gmail.com> wrote:
>
>> Great job Srinivas !!
>> You worked liked a true but responsible hacker to bring out in Open
>> the gaps in the system.
>>
>> I reviewed the Hackpad on this subject. You and Vivek and put out
>> very much the a list of actionable items for BMTC now.
>>
>> Whats plan for tomorrow ? Are these points to be pushed to BMTC
>> review meeting scheduled tomorrow ? Who is taking the lead ?
>>
>> Regards,
>> Suvajit
>>
>>
>> Regards,
>> Suvajit
>>
>> My galleria @ http://www.flickr.com/photos/jeet_sen
>>
>> On Sun, May 29, 2016 at 11:54 AM, srinivas kodali <
>> iota.kod...@gmail.com> wrote:
>>
>>> The server seems to be slow & is not responding well to the parallel
>>> requests. I don't think it is designed to be scalable. The app has 
>>> 5k-10k
>>> downloads & hardly anyone was using it.
>>>
>>> I am going make a final draft of the document by 1 p.m & comments
>>> are welcome until 2 p.m
>>>
>>> Regards,
>>> Srinivas Kodali
>>> www.lostprogrammer.com
>>> *"Not everyone who wanders is lost, I am probably a bit"*
>>>
>>> On Sat, May 28, 2016 at 4:45 PM, srinivas kodali <
>>> iota.kod...@gmail.com> wrote:
>>>
 Here is a crawler & bus-stops data in multiple formats. Not all the
 bus routes have GPS devices. After checking out all the routes, the 
 ones
 which were giving responses, i included that in the routes file. Still
 working on things. If you suggestions, post it in the hackpad before
 tomorrow noon.

 https://github.com/iotakodali/bmtc-realtime-api

 Regards,
 Srinivas Kodali

Re: [datameet] BMTC ITS Inauguration | ITC Windsor Hotel | 07.30pm | Today

[srinivas kodali]

Here is a dump of the some GPS data, I was mining. There are several issues
with bmtc, buses with same numbers in different routes at same time. Zero
fares for few airport routes. Overall it will need at-least 2 more months
for things to get fixed.

https://drive.google.com/open?id=0B1RcWLku0ZOWejg2Ql96UlMxRVE

Anyone interested to do your own analysis, visualization are welcome to
share the results to be forwarded to BMTC.

I am waiting to get all the buses come online, to make a GTFS, GTFS-RT
based on dynamic schedules based on traffic patterns through the GPS data.
Right now the schedules are real bad.

Regards,
Srinivas Kodali
www.lostprogrammer.com
*"Not everyone who wanders is lost, I am probably a bit"*

On Thu, Jun 2, 2016 at 9:16 PM, srinivas kodali 
wrote:

> From what they are saying in the newspapers. They have improved the app
> and now 70% of the buses should be online. The issues with ETA are a
> different game altogether. I will write more crawler's to look into further
> details.
>
> If more people want to work towards something, we can host a hangout over
> the weekend. But if there is not much interest, I will keep posting updates.
>
> Regards,
> Srinivas Kodali
> www.lostprogrammer.com
> *"Not everyone who wanders is lost, I am probably a bit"*
>
> On Thu, Jun 2, 2016 at 3:15 PM, Suvajit Sengupta <
> suvajit.sengu...@gmail.com> wrote:
>
>> Great Srinivas.
>> Its a real tipping point as we could make BMTC talk of open data policy.
>>
>> Lets engage to chalk out our next steps.
>>
>> Regards,
>> Suvajit
>>
>> Regards,
>> Suvajit
>>
>> My galleria @ http://www.flickr.com/photos/jeet_sen
>>
>> On Thu, Jun 2, 2016 at 2:23 PM, srinivas kodali 
>> wrote:
>>
>>> So I received a reply from the IT Director, they said they will look
>>> into these issues we highlighted and at the same time I awaiting a reply on
>>> questions related to the system. Their plans of a data policy is being
>>> covered in the press. This is a important factor for other transport
>>> agencies in India and open data policies for Bangalore through BBMP &
>>> Karnataka.
>>>
>>>
>>> http://tech.economictimes.indiatimes.com/news/internet/bmtc-plans-an-open-data-policy-to-boost-its-intelligent-transport-system/52547930
>>>
>>> Regards,
>>> Srinivas Kodali
>>> www.lostprogrammer.com
>>> *"Not everyone who wanders is lost, I am probably a bit"*
>>>
>>> On Tue, May 31, 2016 at 5:08 PM, srinivas kodali 
>>> wrote:
>>>
 they already have plans to open the data up. I am just trying to get a
 dialogue to make sure most of the data is made public.

 Regards,
 Srinivas Kodali
 www.lostprogrammer.com
 *"Not everyone who wanders is lost, I am probably a bit"*

 On Sun, May 29, 2016 at 11:46 PM, Suvajit Sengupta <
 suvajit.sengu...@gmail.com> wrote:

> Great job Srinivas !!
> You worked liked a true but responsible hacker to bring out in Open
> the gaps in the system.
>
> I reviewed the Hackpad on this subject. You and Vivek and put out very
> much the a list of actionable items for BMTC now.
>
> Whats plan for tomorrow ? Are these points to be pushed to BMTC review
> meeting scheduled tomorrow ? Who is taking the lead ?
>
> Regards,
> Suvajit
>
>
> Regards,
> Suvajit
>
> My galleria @ http://www.flickr.com/photos/jeet_sen
>
> On Sun, May 29, 2016 at 11:54 AM, srinivas kodali <
> iota.kod...@gmail.com> wrote:
>
>> The server seems to be slow & is not responding well to the parallel
>> requests. I don't think it is designed to be scalable. The app has 5k-10k
>> downloads & hardly anyone was using it.
>>
>> I am going make a final draft of the document by 1 p.m & comments are
>> welcome until 2 p.m
>>
>> Regards,
>> Srinivas Kodali
>> www.lostprogrammer.com
>> *"Not everyone who wanders is lost, I am probably a bit"*
>>
>> On Sat, May 28, 2016 at 4:45 PM, srinivas kodali <
>> iota.kod...@gmail.com> wrote:
>>
>>> Here is a crawler & bus-stops data in multiple formats. Not all the
>>> bus routes have GPS devices. After checking out all the routes, the ones
>>> which were giving responses, i included that in the routes file. Still
>>> working on things. If you suggestions, post it in the hackpad before
>>> tomorrow noon.
>>>
>>> https://github.com/iotakodali/bmtc-realtime-api
>>>
>>> Regards,
>>> Srinivas Kodali
>>> www.lostprogrammer.com
>>> *"Not everyone who wanders is lost, I am probably a bit"*
>>>
>>> On Fri, May 27, 2016 at 9:11 PM, srinivas kodali <
>>> iota.kod...@gmail.com> wrote:
>>>
 Here is a hackpad with suggestions & current set of issues with the
 implementation. BMTC is having an internal meeting on Monday, 30th May.
 Please add in your set of suggestions issues.

 

Re: [datameet] BMTC ITS Inauguration | ITC Windsor Hotel | 07.30pm | Today

[srinivas kodali]

it's no different from Google Maps, There are at-least 10 other apps which
do this already for bangalore or waiting to enter the market. Moovit,
Zophop, Riddlr, Raft, Trafi,CityMapper all have trip planners already. But
the main issue is real-time data. When the raw data itself is wrong and not
being maintained the right way, all this apps will be useless.

Anyway, My interest is more in understanding the dynamics of cities than
these apps.

Regards,
Srinivas Kodali
www.lostprogrammer.com
*"Not everyone who wanders is lost, I am probably a bit"*

On Wed, Jun 8, 2016 at 2:32 PM, H. S. Sudhira  wrote:

> @Srinivas Kodali, See what Xerox has pulled out:
> https://play.google.com/store/apps/details?id=com.xrce.gobengaluru=en
>
> I am informed that they are having a formal launch next week.
>
> Sudhira.
>
> On 8 June 2016 at 14:10, srinivas kodali  wrote:
>
>> Here is a dump of the some GPS data, I was mining. There are several
>> issues with bmtc, buses with same numbers in different routes at same time.
>> Zero fares for few airport routes. Overall it will need at-least 2 more
>> months for things to get fixed.
>>
>> https://drive.google.com/open?id=0B1RcWLku0ZOWejg2Ql96UlMxRVE
>>
>> Anyone interested to do your own analysis, visualization are welcome to
>> share the results to be forwarded to BMTC.
>>
>> I am waiting to get all the buses come online, to make a GTFS, GTFS-RT
>> based on dynamic schedules based on traffic patterns through the GPS data.
>> Right now the schedules are real bad.
>>
>> Regards,
>> Srinivas Kodali
>> www.lostprogrammer.com
>> *"Not everyone who wanders is lost, I am probably a bit"*
>>
>> On Thu, Jun 2, 2016 at 9:16 PM, srinivas kodali 
>> wrote:
>>
>>> From what they are saying in the newspapers. They have improved the app
>>> and now 70% of the buses should be online. The issues with ETA are a
>>> different game altogether. I will write more crawler's to look into further
>>> details.
>>>
>>> If more people want to work towards something, we can host a hangout
>>> over the weekend. But if there is not much interest, I will keep posting
>>> updates.
>>>
>>> Regards,
>>> Srinivas Kodali
>>> www.lostprogrammer.com
>>> *"Not everyone who wanders is lost, I am probably a bit"*
>>>
>>> On Thu, Jun 2, 2016 at 3:15 PM, Suvajit Sengupta <
>>> suvajit.sengu...@gmail.com> wrote:
>>>
 Great Srinivas.
 Its a real tipping point as we could make BMTC talk of open data
 policy.

 Lets engage to chalk out our next steps.

 Regards,
 Suvajit

 Regards,
 Suvajit

 My galleria @ http://www.flickr.com/photos/jeet_sen

 On Thu, Jun 2, 2016 at 2:23 PM, srinivas kodali 
 wrote:

> So I received a reply from the IT Director, they said they will look
> into these issues we highlighted and at the same time I awaiting a reply 
> on
> questions related to the system. Their plans of a data policy is being
> covered in the press. This is a important factor for other transport
> agencies in India and open data policies for Bangalore through BBMP &
> Karnataka.
>
>
> http://tech.economictimes.indiatimes.com/news/internet/bmtc-plans-an-open-data-policy-to-boost-its-intelligent-transport-system/52547930
>
> Regards,
> Srinivas Kodali
> www.lostprogrammer.com
> *"Not everyone who wanders is lost, I am probably a bit"*
>
> On Tue, May 31, 2016 at 5:08 PM, srinivas kodali <
> iota.kod...@gmail.com> wrote:
>
>> they already have plans to open the data up. I am just trying to get
>> a dialogue to make sure most of the data is made public.
>>
>> Regards,
>> Srinivas Kodali
>> www.lostprogrammer.com
>> *"Not everyone who wanders is lost, I am probably a bit"*
>>
>> On Sun, May 29, 2016 at 11:46 PM, Suvajit Sengupta <
>> suvajit.sengu...@gmail.com> wrote:
>>
>>> Great job Srinivas !!
>>> You worked liked a true but responsible hacker to bring out in Open
>>> the gaps in the system.
>>>
>>> I reviewed the Hackpad on this subject. You and Vivek and put out
>>> very much the a list of actionable items for BMTC now.
>>>
>>> Whats plan for tomorrow ? Are these points to be pushed to BMTC
>>> review meeting scheduled tomorrow ? Who is taking the lead ?
>>>
>>> Regards,
>>> Suvajit
>>>
>>>
>>> Regards,
>>> Suvajit
>>>
>>> My galleria @ http://www.flickr.com/photos/jeet_sen
>>>
>>> On Sun, May 29, 2016 at 11:54 AM, srinivas kodali <
>>> iota.kod...@gmail.com> wrote:
>>>
 The server seems to be slow & is not responding well to the
 parallel requests. I don't think it is designed to be scalable. The 
 app has
 5k-10k downloads & hardly anyone was using it.

 I am going make a final draft of the document by 1 p.m & comments

Re: [datameet] BMTC ITS Inauguration | ITC Windsor Hotel | 07.30pm | Today

[srinivas kodali]

I don't know if BMTC shared data with xerox at all. Either way if you want
the data, it is already public on their github account
https://github.com/xerox-urbanhack/gtfs-data They released it for  a
hackathon last year with some API's. The best part is they licensed it open
already. It is not perfect, but feel free to use it.

https://s3-ap-southeast-1.amazonaws.com/he-public-data/Xerox-BMTC-UrbanHack%20-%20Data%20and%20API88c873e.pdf

The data is not perfect. But it should be helpful to check it out. I will
look into this app and see if they are using any official API's from BMTC.

Regards,
Srinivas Kodali
www.lostprogrammer.com
*"Not everyone who wanders is lost, I am probably a bit"*

On Wed, Jun 8, 2016 at 5:29 PM, H. S. Sudhira  wrote:

> I agree. My concern is also that private players are able access these and
> the data is not made 'public'. If BMTC is allowing api access to Xerox,
> what prohibits them to make it public?
>
> I am sure if they make it open, there will be more players and it will
> lead to more innovation and offer a better playing field than a few select
> organisations having access.
>
> I did ask Xerox folks to share the data and it was negative. They want to
> hold it and do some analytics on them.
>
> I am sure most of us are interested in understanding the dynamics :)
>
> Cheers, Sudhira.
>
> On 8 June 2016 at 14:44, srinivas kodali  wrote:
>
>> it's no different from Google Maps, There are at-least 10 other apps
>> which do this already for bangalore or waiting to enter the market. Moovit,
>> Zophop, Riddlr, Raft, Trafi,CityMapper all have trip planners already. But
>> the main issue is real-time data. When the raw data itself is wrong and not
>> being maintained the right way, all this apps will be useless.
>>
>> Anyway, My interest is more in understanding the dynamics of cities than
>> these apps.
>>
>> Regards,
>> Srinivas Kodali
>> www.lostprogrammer.com
>> *"Not everyone who wanders is lost, I am probably a bit"*
>>
>> On Wed, Jun 8, 2016 at 2:32 PM, H. S. Sudhira 
>> wrote:
>>
>>> @Srinivas Kodali, See what Xerox has pulled out:
>>> https://play.google.com/store/apps/details?id=com.xrce.gobengaluru=en
>>>
>>> I am informed that they are having a formal launch next week.
>>>
>>> Sudhira.
>>>
>>> On 8 June 2016 at 14:10, srinivas kodali  wrote:
>>>
 Here is a dump of the some GPS data, I was mining. There are several
 issues with bmtc, buses with same numbers in different routes at same time.
 Zero fares for few airport routes. Overall it will need at-least 2 more
 months for things to get fixed.

 https://drive.google.com/open?id=0B1RcWLku0ZOWejg2Ql96UlMxRVE

 Anyone interested to do your own analysis, visualization are welcome to
 share the results to be forwarded to BMTC.

 I am waiting to get all the buses come online, to make a GTFS, GTFS-RT
 based on dynamic schedules based on traffic patterns through the GPS data.
 Right now the schedules are real bad.

 Regards,
 Srinivas Kodali
 www.lostprogrammer.com
 *"Not everyone who wanders is lost, I am probably a bit"*

 On Thu, Jun 2, 2016 at 9:16 PM, srinivas kodali 
 wrote:

> From what they are saying in the newspapers. They have improved the
> app and now 70% of the buses should be online. The issues with ETA are a
> different game altogether. I will write more crawler's to look into 
> further
> details.
>
> If more people want to work towards something, we can host a hangout
> over the weekend. But if there is not much interest, I will keep posting
> updates.
>
> Regards,
> Srinivas Kodali
> www.lostprogrammer.com
> *"Not everyone who wanders is lost, I am probably a bit"*
>
> On Thu, Jun 2, 2016 at 3:15 PM, Suvajit Sengupta <
> suvajit.sengu...@gmail.com> wrote:
>
>> Great Srinivas.
>> Its a real tipping point as we could make BMTC talk of open data
>> policy.
>>
>> Lets engage to chalk out our next steps.
>>
>> Regards,
>> Suvajit
>>
>> Regards,
>> Suvajit
>>
>> My galleria @ http://www.flickr.com/photos/jeet_sen
>>
>> On Thu, Jun 2, 2016 at 2:23 PM, srinivas kodali <
>> iota.kod...@gmail.com> wrote:
>>
>>> So I received a reply from the IT Director, they said they will look
>>> into these issues we highlighted and at the same time I awaiting a 
>>> reply on
>>> questions related to the system. Their plans of a data policy is being
>>> covered in the press. This is a important factor for other transport
>>> agencies in India and open data policies for Bangalore through BBMP &
>>> Karnataka.
>>>
>>>
>>> http://tech.economictimes.indiatimes.com/news/internet/bmtc-plans-an-open-data-policy-to-boost-its-intelligent-transport-system/52547930

[datameet] Plug: Story On Euro 2016 Referees

[Shijith Kunhitty]

Just thought I'd share a story I did on the referees of Euro 2016. It's a 
look at the 18 referees going to the football tournament and what their 
records are when it comes to booking players - how much, how often, how 
early etc. 

Analysed around 5,000 football matches over the past 14 years to come up 
with the data. The story's called 'Is Carlos Carballo The Most Ruthless 
Referee At Euro 2016? 
' 
and my noob-ish Python code can be seen here 
.
 
:)

-Shijith

PS: If you or anyone you know is hiring data journalists, get in touch 
!



-- 
Datameet is a community of Data Science enthusiasts in India. Know more about 
us by visiting http://datameet.org
--- 
You received this message because you are subscribed to the Google Groups 
"datameet" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to datameet+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.