National Post School Outcome Data Community of Practice ------------------------------------------------------
Hi Donna I apologize for the delay in responding to your email. I have been in and out of the office this month and wanted to devote time to give you a comprehensive reply. I would be interested in learning how the panel/focus/work group of stakeholders is designed, designated and brought together. The Texas Effectiveness Study has a long history of collecting post-school outcome data which allows for a history of surveys to utilize. Other states and the NPSO have valid survey protocols that afford the opportunity to utilize as well (www.psocenter.org <http://www.psocenter.org>). Aside from this tidbit about sources for PSO survey items, the current Texas Effectiveness Study (TES) work group met the end of May for the purpose of reviewing the current survey protocols used by the TES. Each survey item and response categories were scrutinized against a set of priority and clarity factors. Recommendations were made for revision, addition, and/or deletion of survey items and/or response categories. The group looked at the federal data requirements as well as supplemental data needs of the state and LEAs for continuous improvement efforts. Other discussion topics included survey accommodation, ways to increase response rate, and program improvements to the TES Mini-Grant program. The work group members were specifically invited by the TES decentralized technical assistance project to represent a diversified yet experienced group of individuals to accomplish the tasks at hand. Who are the individuals or the agencies represented on your panel? The TES work group include representatives from business that support individuals with disabilities, parent/advocate of individual with disability, university instructor , independent researcher, district administrators/coordinators, district transition specialist, Education Service Center regional transition specialists, What criteria do you use to determined who is considered a stakeholder in developing the needed, appropriate, and beneficial PSO information--especially if you plan to move beyond the minimal federal requirements. The Texas Effectiveness Study has been collecting post-school outcome data for the past 16 years in the areas of employment, post-secondary education and training, independent living, and recreation/leisure/social engagement. In 2004 the current system of collecting PSO data was implemented to further address state data needs and to provide a continuous source of reliable data. Previous attempts at collecting data through a longitudinal follow-along design resulted in high attrition rates. The current system is designed to sample every exiting class and follow each sample for two consecutive years. Through experience we found that at the two year mark the attrition rate increased dramatically. The survey protocols used are developed based on an analysis of prior surveys as well as current data needs of the state. Revisions are reviewed by the Statewide High School Transition Network, the TES "Action Committee" which is a program evaluation committee for the TES Mini-Grant program, and the Post-School Results Improvement Group which is connected with the Texas Continuous Improvement Process. Recommendations from these various groups is incorporated into a final draft of the survey. The TES work group participants were chosen based on their ability to provide a critical eye to the survey from a fresh point of view. Especially in light of the federal perspective. District participants were familiar with the TES and the survey protocols and had experience administering the surveys. This provided valuable input regarding LEA needs, survey clarity from the student's perspective, survey response issues, etc. The independent researcher has work with the project over the past few years assisting with the qualitative and quantitative analysis of data. This individual provided analytical perspective of survey items and response categories. Business and postsecondary school participation provided valuable perspectives on exit needs. The parent/advocate provided an additional perspective on post-school linkages, follow-up, and creating opportunities for employment. What is the process in announcing the panel, inviting their participation? An initial invitation to participate in the TES work group was made by email followed up by a phone conversation. All correspondence was forwarded to my contact at the state education agency as well as my director here at the Regional Education Service Center. Of course I went through all the appropriate paperwork to make arrangements for the work group meeting. How open is this process for public participation and if it is not an open process, in what way to you elicit public input? The TES survey protocols are sent to committees that have representatives from public agencies, parent/advocacy organizations, district personnel, state education agency representative, etc. for review. The survey protocols are also available on a public website at Grade-12 Exit Survey (scroll to bottom of page for PDF and word document) <https://www.texaseffectiveness.net/LocalStudy/StudentSurveys/ExitSurvey.asp> Post-school Survey (scroll to bottom of page for PDF and word document) <https://www.texaseffectiveness.net/LocalStudy/StudentSurveys/PSOSurvey.asp> Debby ~~~~~~~~~~~~~~~~~~~~~~~~~~ Deborah Norris Project Coordinator Texas Effectiveness Study Education Service Center Region XI 3001 North Freeway Fort Worth, TX 76106 817.740.7582 [EMAIL PROTECTED] >>> [EMAIL PROTECTED] 07/26/06 08:19PM >>> Thank you to those of you who answered in depth and described just how you are moving beyond the minimum requirements for your surveys. It was suggested I repost my questions from earlier (see below) with the hope our community of practice will develop a discussion thread/exchange of hints and ideas. So... with regard to how you all determine what you will add to the basic survey questions, especially using a focus group for that mission..... In a message dated 7/19/2006 11:41:04 A.M. Pacific Daylight Time, [EMAIL PROTECTED] writes: Study is working with a group of individuals from across the state to revise the current surveys. I would be interested in learning how the panel/focus/work group of stakeholders is designed, designated and brought together. Who are the individuals or the agencies represented on your panel? What criteria do you use to determined who is considered a stakeholder in developing the needed, appropriate, and beneficial PSO information--especially if you plan to move beyond the minimal federal requirements. What is the process in announcing the panel, inviting their participation? How open is this process for public participation and if it is not an open process in what way to you elicit public input? Donna Martinez Donna Martinez
