Hey Ross, You've asked a very important question. Let me take it on, a little bit in the style of a balanced score-card. To measure impact, we first have to be in agreement about which impact we want to achieve. Going all the way back to first principles to justify this:
What is the mission of the foundation? "To produce open source software for the public good." What is the mission of D&I? "To welcome people from diverse backgrounds, and bring them into the process of producing open source software for the public good." What is the purpose of this initiative? * "To explicitly express our welcome to people from diverse backgrounds via an organization that has good relationships in these communities." (Welcoming) * "To better understand the obstacles and bright spots in our communities, and to document and share that information." (Understanding) So how do we measure impact for these two items? * For Welcoming, we'll find it difficult to narrow down cause and effect (as is always the case in marketing efforts). But we can still measure trends. To do this we will be working on and administering a survey at regular intervals. But that is a separate effort with its own, already approved budget. While formulating that survey, we should keep in mind how our goals connect to the mission of our Foundation. * For Understanding, we will be producing documentation. One measure is: "does the documentation exist, was it read by the projects, and were they able to derive value from it?" We can also ask that projects give us feedback about whether or not they found the process helpful. This information will help us when it comes time to decide if we want to go more rounds with Outreachy in the future. Best Regards, Myrle On Wed, Jul 3, 2019 at 8:39 PM Ross Gardler <[email protected]> wrote: > +1 for measuring impact, given that the goal is to learn I had assumed it > was there by default. Wouldn't hurt to make it explicit. > > That said. This is about people funding ASF interns through Outreachy NOT > through ASF. There is no "I" for the ASF, in this proposal, other than > volunteer energy which is not under the boards control. > > If a future request asks for an ASF "I" having data would indeed be useful. > > Roas > > > > Get Outlook for Android<https://aka.ms/ghei36> > > ________________________________ > From: Roman Shaposhnik <[email protected]> > Sent: Wednesday, July 3, 2019 11:33:50 AM > To: [email protected] > Subject: Re: [DISCUSS] Notify the board that D&I intends to coordinate an > Outreachy intern program > > On Tue, Jul 2, 2019 at 11:59 PM Myrle Krantz <[email protected]> wrote: > > > > Based on the preceding discussion, I'm stripping the first sentence out > of > > the background section. The notice is confusing though if I strip every > > mention of funding, so I've left some bits in there. The latest version > is > > below. > > > > I believe the discussion is petering out. I'm going to give it another > day > > and, if nothing happens, I'll move on to the next step. > > > > Best, > > Myrle > > > > ----------------- > > Subject: [NOTICE] D&I intends to coordinate an Outreachy intern program. > > > > Background: D&I wishes to perform UX research on the experience of > members > > of underrepresented groups as they get started with our communities. > > Internships via Outreachy provide us with an excellent opportunity to do > so. > > > > A sponsor has offered to provide stipends via Outreachy which will cover > 3 > > interns. D&I plans to provide the following support: > > > > * Advertise this opportunity to projects and seek mentors & proposals. > > * Manage the project submission process to Outreachy, including filtering > > out unsuitable project proposals, and, if necessary, making a final > > selection of intern-project pairs. > > * Ask interns for feedback on their experiences at various times > throughout > > the internship. > > * Provide appropriate and useful feedback to the Foundation and to the > > projects about opportunities to improve how welcoming we are, and what we > > can improve on. > > * Use this as an opportunity to increase awareness and acceptance of the > > ASF in communities which we are currently not reaching as well as we > would > > like. > > > > If Outreachy receives funding for more than 3 interns for the ASF, we > will > > facilitate the placement of such additional interns with Apache projects, > > but we plan to keep the initial rounds of this project relatively small > for > > learning purposes. > > > > ----------------- > > The road ahead on this proposal is as follows (** indicates where we are > > now): > > * Start a [DISCUSS] thread. > > ** Allow the discussion to run as long as *new* points are being made. > > * Start a [VOTE] thread to run for 72 hours. > > * Submit a [NOTICE] to the board. > > * Wait 72 hours for potential board objections. > > * Get to work. > > This is a really good draft, but I have to ask: is this committee > planning to put > some kind of reasonable metrics in place to evaluate the ROI of this > effort? > > This is very similar to tough questions that Myrle was asking around ROI on > spending money for anniversary promotions. In both cases we all know in our > gut that these are probably good investments and yet unless you can measure > it you can't improve it also applies. > > Can something tangible be added to the draft so that we don't have to go > through > the same set of discussions we went through with anniversary > promotions expenditure? > > Thanks, > Roman. >
