On 05.12.16 17:45, Rich Bowen wrote:
> 
> 
> On 12/05/2016 07:41 AM, Ulrich Stärk wrote:
>>> Or, at the very least, can we make a commitment to track this data going
>>>> forward?
>> Let me play the devil's advocate here: What for?
>>
>> GSoC is completely free for the ASF (on the contrary, we even get a small 
>> amount for every accepted
>> student that we can than put towards fulfilling our goals) and as long as we 
>> have volunteers willing
>> to organize it and mentor students we can assume that at least those 
>> volunteers are seeing value in
>> it. Why the stats other than for satisfying our curiosity?
> 
> Because part of Community Development is measuring what you do, so that
> you know if it's effective. This isn't a big request. I'm perplexed at
> your resistance to it.
> 

I have seen way too many metrics being misused to justify the wrong actions 
because metrics are
extremely poor when it comes to more complex questions such as what we are 
currently trying to
answer. IMO the only viable approach would be what you call anecdotal but which 
is in social
scienses known as qualitative research which provides extremely deep insights 
but is also extremely
hard (speak effort) to get right.

How would you measure the impact on communities by students asking questions 
regarding a GSoC
proposal but not being accepted? But using the knowledge they gained to promote 
the project at
$dayjob later in their career, simply because they once had a short touchpoint. 
What does it say
about a community if somebody becomes a committer and sticks with the project 
after GSoC? Is one
more important than the other long-term? By which factor?

And I'd again argue that we don't have to care too much how effective something 
like GSoC is as long
as people are having fun mentoring students. Your experience might not have 
been fun but then again
we are telling mentors to fail students early on when they don't think that 
anything useful will
come out of it.

Cheers,

Uli

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@community.apache.org
For additional commands, e-mail: dev-h...@community.apache.org

Reply via email to