Re: [GKD-DOTCOM] How Do We Evaluate ICT-Enhanced Professional Development?
Here's a tool for evaluating the quality of e-learning resources -- E-Learning for Educators: Implementing the National Staff Development Standards, co-published by the National Staff Development Council and the National Institute for Community Innovations and available in hard copy from NSDC's bookstore or for free as a PDF at: http://www.teacherednet.org/e-learning.pdf -- Bob Mclaughlin Robert T. McLaughlin, Ph.D. Executive Director National Institute for Community Innovations 2905 North Street Montpelier, VT 05602 Tel. (802) 229-1742 Fax (802) 229-2056 Cell (802) 249-1159 www.nici-mc2.org www.edreform.net www.nationalinstitutes.org This DOT-COM Discussion is funded by the dot-ORG USAID Cooperative Agreement, and hosted by GKD. http://www.dot-com-alliance.org provides more information. To post a message, send it to: [EMAIL PROTECTED] To subscribe or unsubscribe, send a message to: [EMAIL PROTECTED]. In the 1st line of the message type: subscribe gkd OR type: unsubscribe gkd For the GKD database, with past messages: http://www.GKDknowledge.org
Re: [GKD-DOTCOM] How Do We Evaluate ICT-Enhanced Professional Development?
I think we can use DEA (Data Envelopment Anaysis) to calculate the efficiency of a Professional Development Program. Software for DEA can be found at: http://www.wiso.uni-dortmund.de/lsfg/or/scheel/ems/ __ Femi Oyesanya All reification is a forgetting This DOT-COM Discussion is funded by the dot-ORG USAID Cooperative Agreement, and hosted by GKD. http://www.dot-com-alliance.org provides more information. To post a message, send it to: [EMAIL PROTECTED] To subscribe or unsubscribe, send a message to: [EMAIL PROTECTED]. In the 1st line of the message type: subscribe gkd OR type: unsubscribe gkd For the GKD database, with past messages: http://www.GKDknowledge.org
Re: [GKD-DOTCOM] How Do We Evaluate ICT-Enhanced Professional Development?
On Mon, June 14, 2004, GKD Moderator asked: 1. Can we effectively measure the costs, benefits, and educational impact of ICT-enhanced professional development initiatives? If so, what is the best approach -- are there concrete examples? Below in an example of a K-12 project's assessments. The program will be subject to annual audit by the sponsor. Specific areas to be audited will be agreed to in the contract. However, we propose the following areas for audit. 1. Pupil growth rate and performance as measured on the ISTEP, other state and federal designated assessment instruments, and the NWEA exams, 2. Pupil attendance rate, 3. Parental satisfaction survey, 4. Staff satisfaction surveys, 5. Percentage of students promoted, 6. Graduation rates, 7. Budget projections vs. actual spending, and 8. Retention Rates These are all standard measurements for a standard education program, and as such give a baseline for comparison in key areas of performance. Common areas to most programs would be a budget comparison, participation rates and satisfaction survey, and standardized testing on a subject area to compare methods. There is no one best approach because there are many ways to measure the success of a program. There might also be more short-term goals like these, or more long-term goals such as in this instance, students who entered college, or who entered a career of their choosing and were able to hold that job for two years. Maybe we look at the retention rate of professionals in their mother country just like we look at the rate we keep students in school. This DOT-COM Discussion is funded by the dot-ORG USAID Cooperative Agreement, and hosted by GKD. http://www.dot-com-alliance.org provides more information. To post a message, send it to: [EMAIL PROTECTED] To subscribe or unsubscribe, send a message to: [EMAIL PROTECTED]. In the 1st line of the message type: subscribe gkd OR type: unsubscribe gkd For the GKD database, with past messages: http://www.GKDknowledge.org
Re: [GKD-DOTCOM] How Do We Evaluate ICT-Enhanced Professional Development?
It might be difficult to evaluate ROI of ICT-Enhanced Professional Development, most of the benefits may not be quantitative. However, I think if you have performance baselines, the Data Envelopment Analysis (DEA) is one Econometric model that can be used to evaluate efficiency. An article on DEA can be found at http://www.emp.pdx.edu/dea/homedea.html#Applications But the issue with DEA, might be how you define performace baselines. On 6/14/2004, Global Knowledge Dev. Moderator asked: 1. Can we effectively measure the costs, benefits, and educational impact of ICT-enhanced professional development initiatives? If so, what is the best approach -- are there concrete examples? 2. Can we measure return on investment (ROI) for these initiatives? If so, how? 3. Are there methodologies for evaluating the soft side of training activities, e.g., the cultural, technological, or social appropriateness of different approaches? 4. Are there methodologies for measuring the cost of effectively bringing particular models to scale? 5. What is the best way to disseminate and promote the use of lessons learned? __ Femi Oyesanya All reification is a forgetting This DOT-COM Discussion is funded by the dot-ORG USAID Cooperative Agreement, and hosted by GKD. http://www.dot-com-alliance.org provides more information. To post a message, send it to: [EMAIL PROTECTED] To subscribe or unsubscribe, send a message to: [EMAIL PROTECTED]. In the 1st line of the message type: subscribe gkd OR type: unsubscribe gkd For the GKD database, with past messages: http://www.GKDknowledge.org
