Grubb, W. N., Badway, N., Bell, D., Chi, B., King, C., Herr, J., Prince, H., Kazis, R., Hicks, L., & Taylor, J. C. (1999). Toward order from chaos: State efforts to reform workforce development systems (MDS-1249). Berkeley: National Center for Research in Vocational Education, University of California.

APPENDIX A

Local and State Protocols

Local-Level Protocol

Individuals To Interview

• Director of special programs or contract education for the community college
  
  
• Director of adult education
  
  
• Staff director of the Service Delivery Area
  
  
• Coordinator for welfare-to-work of the local welfare board
  
  
• Local director for one-stops??
  
  
• Local Employment Service??
  
  
• Local or regional coordination board

Basic Questions about Local Developments
Introduction: purpose of the study; confidentiality

1.	What has this state done during the past five years to coordinate, consolidate, or otherwise improve its "system" of education and job training?
	Probe:	Why was this approach chosen over others? What political issues determined these changes? What programmatic concerns determined these changes? What are the overall goals and intended effects? Had there been previous such efforts at the state level?
2.	Were these changes desirable from your local perspective?
	Probe:	What were the intended changes? Was there a real problem at the local level?
3.	What power does the innovation (e.g., a SHRIC or an advisory committee) have? Advisory only? To whom? Decisionmaking authority? With what limits? Operating authority? Does the state effort have enough power or influence over local programs to cause changes? If not, what does drive local efforts?
4.	What has happened during the first few years (first few months)? Distinguish errors and bureaucratic problems from programmatic problems and policy disagreements.
	Probe:	What differences in perspective are there within the state? What differences among local communities in reactions to state policy have there been? Have any evaluation mechanisms been established? Collect if possible.
5.	What effects on yourlocal programs have there been so far? What changes are anticipated in the near future? If there are changes, do these improve the way you operate?
6.	What students/clients from other programs do you serve? In regular offerings? In special offerings? Do you send your students to other programs? If so, which ones? How are they selected?
7.	What changes are being contemplated in the states' welfare program and in welfare-to-work? How will this influence your local program? Do the changes in the state education and training "system" facilitate or impede changes in welfare-to-work? (Too early to tell?)
8.	What other changes does this state anticipate over the coming decade? Do the changes in the state education and training "system" facilitate or impede responding to these changes? (Too early to tell?) How will they affect your local program?
9.	Are there some exemplary local programs that are widely known in your community? Throughout the state? (Get specifics: why considered exemplary; whom to contact) What role has state policy played in these exemplary efforts? (Or are they locally developed?)
10.	If you could change one thing in the state's administration of education and job training programs, what would it be? What would you change in your local program?

State-Level Protocol

Individuals To Interview

• State agency responsible for community colleges
  
  
• State coordinating board for higher education (if different)
  
  
• State director of adult education
  
  
• State Human Resource Investment Council (if it exists) or State Job Training Coordinating Council
  
  
• State director for one-stops
  
  
• Employment Service
  
  
• Head of welfare-to-work programs
  
  
• State coordinating council (if it exists)
  
  
• Staff members responsible for education and training in legislative research offices--for example, a house or senate (or legislative) office of research
  
  
• Other knowledgeable individuals

Basic Questions about State Changes
Introduction: purpose of the study; confidentiality

1.	What has this state done during the past five years to coordinate, consolidate, or otherwise improve its "system" of education and job training?
	Probe:	Why was this approach chosen over others? What political issues determined these changes? What programmatic concerns determined these changes? What are the overall goals and intended effects? Collect any available reports. Had there been previous such efforts at the state level?
2.	What programs have been included in any changes? Which have been left out?
	Probe:	Why were some programs included and excluded? Political and programmatic issues?
3.	What power does the innovation (e.g., a SHRIC or an advisory committee) have? Advisory only? To whom? Decisionmaking authority? With what limits? Operating authority?
4.	What has happened during the first few years (first few months)? Distinguish errors and bureaucratic problems from programmatic problems and policy disagreements.
	Probe:	What differences in perspective are there within the state? Have any evaluation mechanisms been established? Collect if possible.
5.	What effects on local programs have there been so far? What changes are anticipated in the near future?
6.	What changes are being contemplated in the state welfare program and in welfare-to-work? How will this influence education and job training? Do the changes in the state education and training "system" facilitate or impede changes in welfare-to-work? (Too early to tell?)
7.	What other changes does this state anticipate over the coming decade? Do the changes in the state education and training "system" facilitate or impede responding to these changes? (Too early to tell?)
8.	Are there some local communities that are more advanced than others in implementing changes? Probe for which two local communities would be most useful to visit.
9.	Are there some exemplary local programs that are widely known throughout the state? (Get specifics: why considered exemplary; whom to contact) What role has state policy played in these exemplary efforts? (Or are they locally developed?)
10.	If you could change one thing in the state's administration of education and job training programs, what would it be?

Grubb, W. N., Badway, N., Bell, D., Chi, B., King, C., Herr, J., Prince, H., Kazis, R., Hicks, L., & Taylor, J. C. (1999). Toward order from chaos: State efforts to reform workforce development systems (MDS-1249). Berkeley: National Center for Research in Vocational Education, University of California.