RE: [NPSO]: re: focus group development for survey development

2006-07-27 Thread Test, David



At this point, NC has not 
finalized our PS survey. 

David W. Test
Professor
Department of Special Education and 
Child Development
Co-Principal Investigator
National Secondary Transition Technical 
Assistance Center
UNC Charlotte
9201 University City Blvd.
Charlotte, NC 28223-0001
704.687.8853 (office)
704.687.2916 (fax)



From: [EMAIL PROTECTED] 
[mailto:[EMAIL PROTECTED] On Behalf Of 
[EMAIL PROTECTED]Sent: Wednesday, July 26, 2006 9:20 
PMTo: npsoserv@lists.uoregon.eduSubject: [NPSO]: re: focus 
group development for survey development 

Thank you to those of you who answered in depth and described justhow 
you are moving beyond the minimum requirements for your surveys.

It was suggested I repost my questions from earlier (see below) with the 
hope ourcommunity of practice will develop a discussion thread/exchange of 
hints and ideas.

So... with regard to how you all determine what you will add to the basic 
survey questions, especially using a focus group for that mission.



In a message dated 7/19/2006 11:41:04 A.M. Pacific Daylight Time, [EMAIL 
PROTECTED] writes:
Study is working with 
  a group of individuals from across the state to revise the current 
  surveys.

I would be interested in learning how the panel/focus/work group of 
stakeholders is designed, designated and brought together.

Who are the individuals or the agencies represented on your panel?

What criteria do you use todetermined who is considered a stakeholder 
in developing the needed, appropriate, and beneficialPSO 
information--especially if you plan to move beyond the minimal federal 
requirements.

What is the process in announcing the panel, inviting their participation? 


How open is this process for public participation and if it is not an open 
process in what way to you elicit public input?


Donna 
Martinez





Donna 
Martinez


[NPSO]: re: focus group development for survey development

2006-07-27 Thread DEBBY NORRIS
National Post School Outcome Data Community of Practice
--

Hi Donna

I apologize for the delay in responding to your email.  I have been in and out 
of the office this month and wanted to devote time to give you a comprehensive 
reply.

I would be interested in learning how the panel/focus/work group of  
stakeholders is designed, designated and brought together.

The Texas Effectiveness Study has a long history of collecting post-school 
outcome data which allows for a history of surveys to utilize.  Other states 
and the NPSO have valid survey protocols that afford the opportunity to utilize 
as well (www.psocenter.org http://www.psocenter.org).

Aside from this tidbit about sources for PSO survey items, the current Texas 
Effectiveness Study (TES) work group met the end of May for the purpose of 
reviewing the current survey protocols used by the TES.  Each survey item and 
response categories were scrutinized against a set of priority and clarity 
factors.  Recommendations were made for revision, addition, and/or deletion of 
survey items and/or response categories. The group looked at the federal data 
requirements as well as supplemental data needs of the state and LEAs for 
continuous improvement efforts.  Other discussion topics included survey 
accommodation, ways to increase response rate, and program improvements to the 
TES Mini-Grant program.  The work group members were specifically invited by 
the TES decentralized technical assistance project to represent a diversified 
yet experienced group of individuals to accomplish the tasks at hand.  
 
Who are the individuals or the agencies represented on your panel?

The TES work group include representatives from business that support 
individuals with disabilities, parent/advocate of individual with disability, 
university instructor , independent researcher, district 
administrators/coordinators, district transition specialist, Education Service 
Center regional transition specialists, 
 
What criteria do you use to determined who is considered a stakeholder in 
developing the needed, appropriate, and beneficial PSO information--especially 
if you plan to move beyond the minimal federal requirements.

The Texas Effectiveness Study has been collecting post-school outcome data for 
the past 16 years in the areas of employment, post-secondary education and 
training, independent living, and recreation/leisure/social engagement.  In 
2004 the current system of collecting PSO data was implemented to further 
address state data needs and to provide a continuous source of reliable data.  
Previous attempts at collecting data through a longitudinal follow-along design 
resulted in high attrition rates.  The current system is designed to sample 
every exiting class and follow each sample for two consecutive years.  Through 
experience we found that at the two year mark the attrition rate increased 
dramatically.  

The survey protocols used are developed based on an analysis of prior surveys 
as well as current data needs of the state.  Revisions are reviewed by the 
Statewide High School Transition Network, the TES Action Committee which is a 
program evaluation committee for the TES Mini-Grant program, and the 
Post-School Results Improvement Group which is connected with the Texas 
Continuous Improvement Process.  Recommendations from these various groups is 
incorporated into a final draft of the survey.  

The TES work group participants were chosen based on their ability to provide a 
critical eye to the survey from a fresh point of view.  Especially in light of 
the federal perspective.  District participants were familiar with the TES and 
the survey protocols and had experience administering the surveys.  This 
provided valuable input regarding LEA needs, survey clarity from the student's 
perspective, survey response issues, etc.  The independent researcher has work 
with the project over the past few years assisting with the qualitative and 
quantitative analysis of data.  This individual provided analytical perspective 
of survey items and response categories.  Business and postsecondary school 
participation provided valuable perspectives on exit needs.  The 
parent/advocate provided an additional perspective on post-school linkages, 
follow-up, and creating opportunities for employment.
 
What is the process in announcing the panel, inviting their participation? 

An initial invitation to participate in the TES work group was made by email 
followed up by a phone conversation.  All correspondence was forwarded to my 
contact at the state education agency as well as my director here at the 
Regional Education Service Center.  Of course I went through all the 
appropriate paperwork to make arrangements for the work group meeting.

How open is this process for public participation and if it is not an open  
process, in what way to you elicit public input?

The TES survey protocols are sent