Grubb, W. N., Kalman, J., Castellano, M., Brown, C., & Bradby, D. (1991). Readin', writin' and 'rithmetic one more time: The role of remediation in vocational education and job training (MDS-309). Berkeley: National Center for Research in Vocational Education, University of California.

APPENDIX C

INTERVIEW PROTOCOL

1.	Does your program provide any basic education or remedial education (through contractors, formal referral agreements, or directly: where client support or service is funded by JTPA)?
_____	NO a. Have you provided remedial education previously? Under CETA? _____ NO _____ YES: Why do you no longer offer remedial or basic education? (Probe for the role of performance-based funding and funding reductions.) b. Do you make any provisions for clients to get remedial education elsewhere that is not funded by JTPA? _____ NO _____ YES: Do you know how many of these clients actually enroll in remedial programs you refer them to? ___________________________________ and About how many return to your programs after completing remedial education? __________________ (GO TO Question 15 if not providing any remedial education)
_____	YES (continue survey)
2.	What fraction of JTPA clients (all titles) receive remedial education? __________ How many individuals per year? ___________________ What different types of programs are offered, and how many clients per year are enrolled in each?
	Program/Subject	Annual Enrollment
	___________________________________________________________________ (If many programs, ask if they will mail information about programs and enrollment)
3.	Who identifies clients in need of remedial education, the SDA or subcontractors?
_____	Centrally, by the SDA What test or assessment mechanism is used to select clients into remedial education? ___________________________________________________________________ What score or cutoff is used to identify those in need of remedial education? ___________________________________________________________________
_____	By subcontractors Are there SDA guidelines about the test or assessment mechanisms used to select clients into remedial education, or is this left to the discretion of subcontractors? What tests are used (if the SDA knows)? ___________________________________________________________________ ___________________________________________________________________
4.	Is remedial education provided by
_____	the SDA itself? Remedial education program director's name/phone: ________________________________________________ (SKIP to 5.)
_____	one contractor for all JTPA clients in the SDA?
_____	or individual subcontractors? 4a. What organization(s) is the (are the) main provider(s)? (list) ___________________________________________________________________ ___________________________________________________________________ ___________________________________________________________________ 4b. Who could I contact at this (these) program(s) to get further information? (add to above list) 4c. Are there SDA guidelines for subcontractors about the nature and duration of remedial education? ____ NO ____ YES: Would you send us a copy? _____ yes _____ no
5.	In general, what kind of remedial education is provided by subcontractors or the SDA? ___________________________________________________________________
6.	What is the relationship between remedial education and job skills training? Does remedial education
_____	precede job skills training?
_____	or is it concurrent? (Ask 6a)
_____	or is it integrated into skills training? 6a. If concurrent, how many hours do individuals spend in remedial education and in job training--total, over the course of their enrollment? ______ hours in remedial education ______ hours in skills training Is scheduling a problem? _____ yes _____ no
7.	Is remedial education ever tailored to the specific occupational area of skills training?
_____	NO
_____	YES: How ___________________________________________________
8.	How does the SDA define completion of a remedial program?
_____	hours completed or other length of education
_____	mastery of a set of competencies
_____	score increased by a certain amount
_____	minimum test score achieved
_____	Other ____________________________________________________________
9.	Does the SDA collect any data on the rates of completion of JTPA clients in remedial programs?
_____	NO: Is there any evidence about whether completion rates are a problem? Describe: ____________________________________________________________
_____	YES: Can we get a copy of your data on this? _____ yes _____ no
10.	Does the SDA collect any information about the effects of its remedial programs?
_____	NO: Does it require any of its subcontractors to collect such information? _____ yes _____ no
_____	YES: check: ______ pre- and posttest scores ______ placement rates of those who have and have not completed remedial programs ______ Other _________________________________________________
11.	Does your state have any policies about remedial or basic education in JTPA, the types of programs offered, or the assessment instruments used?
_____	NO
_____	YES: Describe 11a. Have any resources--such as 8-percent funds or the Governor's 6-percent incentive funds--been earmarked specifically for remedial education?
_____	NO
_____	YES: which?______________________________________________________
12.	If the SDA does not contract with a community college or adult school to provide remedial education, have you ever considered working with a community college or adult school to provide remedial education?
_____	NO
_____	YES: Why was the decision made to offer remedial education independently of these institutions? _____________________________________________
13.	If the SDA does subcontract with an educational institution: Why was the decision made to offer remedial education through this program? _________________________________________________________________ Have any special problems arisen because of this relationship? _________________________________________________________________
14.	Do any of your classroom skills training programs or OJT programs limit enrollment to those with specified scores on standard tests?
_____	NO
_____	YES: Which are these, and what are the test score cut-offs:
	Program	Test or subject & score or grade level
	_________________________________________________________________
15.	Does the SDA have any occupational skills training programs offered in conjunction with the local community colleges, technical institutes, area vocational schools, or adult schools?
_____	NO
_____	YES: What are these programs? _________________________________________________________________
	Can we get a list of all SDA subcontracts, including numbers enrolled and type of training available from each? _____ yes _____ no
16.	Does the SDA provide any services for welfare recipients participating in the state's JOBS program under a contract or any other formal arrangement--that is, in some institutionalized arrangement, as distinct from a system where welfare recipients enroll individually?
_____	NO (go to 16a.)
_____	YES: What are these services? __________________________________________________________________ Is the basic/remedial education provided to welfare recipients different from that provided to other JTPA clients? In what ways? (Some welfare clients may come in having already had remedial education.) __________________________________________________________________ 16a. Who should we contact in the local welfare-to-work program to find out what kinds of remedial education programs they offer? Name and phone: _________________________________________________________________
17.	What do you think the future of remedial education in JTPA is likely to be? What policies do you anticipate your SDA developing in this area? __________________________________________________________________
18.	References for subsequent contacts: a. What are the community colleges, technical institutes, and area vocational schools in your area (whether or not they work with JTPA)? __________________________________________________________________ b. Are there other important providers of remedial education, like adult schools or skill centers? __________________________________________________________________ c. Who else should we talk to about remedial education in your local area or your state, from any welfare, employment, or educational programs? __________________________________________________________________ Go back and remind respondent what he said he would send you and give him your name and address.

II. Questionnaire for Postsecondary Institutions

Contact Name _______________________________________________________
Agency _____________________________________________________________
Phone Number _______________________________ Date __________________

This questionnaire is intended for community colleges, technical institutes, area vocational schools serving adults, and adult schools. It should be asked of an administrator with some responsibility for the overall program of the institution, rather than the individual who directs the remedial education center or program itself; this might be a dean of instruction or the director of the counseling center or the matriculation center. Remember throughout that lots of remedial education will be offered in courses that sound like regular academic courses--that is, "developmental" English and math courses.

1.	Does your institution provide basic education or remedial education?
_____	NO: Do you make any provisions for students to get remedial education elsewhere? _____ NO _____ YES: Do you know how many of these clients actually enroll in remedial programs you refer them to? _______________________ About how many return to your programs after completing remedial education? _____________________________________ Name of a contact person _________________________________ Phone_________________________________________________ (GO TO Question 15 if not providing any remedial education)
_____	YES (continue)
2.	Who assesses students' remedial needs?___________________________________
_____	the campus centrally What test or assessment mechanism is used to assign students to remedial classes? ________________________________________________________________ What score or cutoff is used to identify those in need of remedial education? ________________________________________________________________
_____	decentralized (departments, instructors, contractors) Are there college-wide guidelines about the test or assessment mechanism used to assign students to remedial education? What tests are recommended? ________________________________________________________________ Name of contact person(s) in charge of assessment (whether central or not): ________________________________________________________________
3.	What fraction of your students receive remedial education? _____________________ 3a. How many individuals per year? ___________________ 3b. How is remedial education defined in this count? (only students in special remedial programs, all students taking any basic skills courses, or?) ___________________________________________________________________ Can you provide us with data about the enrollments in each of your remedial programs and in remedial courses? _____ yes _____ no
4.	How is remedial education delivered on your campus: __________________________________________________________________ __________________________________________________________________
_____	offered in special remedial education programs, learning labs, and so on: Name/phone program director ___________________________________ _________________________________________________________________
_____	offered through remedial classes in regular academic departments: Name/phone department chairpersons ___________________________________ _________________________________________________________________
5.	Are there campus policies about the nature and duration of remedial education? _________________________________________________________________ Can you send us a copy of your policy? _____ yes _____ no
6.	What is the funding for these remedial efforts? _________________________________________________________________
_____	state funded: _____ from a special appropriation for remedial education _____ from general-purpose funds
_____	from federal funds _____ Perkins funds for the disadvantaged _____ federal ABE funds
_____	local funds
Probe to see whether the funding sources are multiple or not, whether they are categorical or general, or whether there is any support for remedial education out of purely local funds or funds which could be used in other ways. _________________________________________________________________
7.	For vocational students, what is the relationship between remedial education and vocational education? Does remedial education
_____	precede voc ed?
_____	or is it concurrent? (Ask 7a.)
_____	or is it integrated into voc ed? 7a. If concurrent: How many hours does an individual spend in each component (remedial education and vocational skills training)? _____ hours in remedial education _____ hours in skills training Is scheduling a problem? _____ yes _____ no
(This question may not make sense in a community college where students are typically all enrolled in several courses, so that much enrollment will be concurrent.)
8.	Is remedial education ever tailored to the specific occupational area of voc ed?
_____	NO
_____	YES: How? _____________________________________________________
9.	How does the institution define completion of a remedial program?
_____	hours completed or other length of education
_____	mastery of a set of competencies
_____	score increased by a certain amount
_____	minimum test score achieved
_____	Other _____________________________________________________________
10.	Does the institution collect any data about the rates at which students complete their remedial education?
_____	NO: Is there any evidence about whether completion rates are a problem? Describe:______________________________________________________
_____	YES: What is the approximate completion rate? _________________ Can we get a copy of your data on this? _____ yes _____ no
11.	Does the institution collect any information about the effects of its remedial programs?
_____	NO: Do departments or other campus units have such information? Who: _________________________________________________________
_____	YES: check: _____ pre- and posttests _____ academic success of those who have and have not completed remedial programs _____ Other _____________________________
12.	Does the institution provide any remedial services to students from other educational institutions, to JTPA clients, or to welfare recipients in welfare-to-work programs?
_____	YES: How did this kind of collaboration come about? Were there any special problems in establishing this collaboration? __________________________________________________________________
_____	NO: Have you ever considered working with JTPA or welfare programs? If so, why don't you work with them now? __________________________________________________________________
13.	Does your state have any specific policy about the remedial education you offer or about assessment tests used?
_____	NO
_____	YES: Describe 13a. Does the state provide any funds specifically earmarked for remedial education in your institution? (Funds might include Perkins funds for the disadvantaged and 8-percent funds in addition to state-appropriated funds.) _____ NO _____ YES: which funds?
14.	Do any vocational programs in your institution limit enrollment to students with specified scores on standardized tests?
_____	NO
_____	YES: Which programs are these, and what scores do they require?
	Program	Test or subject & score or grade level
	__________________________________________________________________
15.	Does the institution have any skills training programs for JTPA or for welfare-to-work clients?
_____	NO (go to 16.)
_____	YES: a. What are these programs? ____________________________________________________________ b. Do welfare or JTPA clients have special remedial education needs? What are their needs? c. What has the institution done to meet their needs? Has it been difficult in any way?____________________________________________________ d. Names of contacts in JTPA and welfare-to-work programs: _____________________________________________________________ _____________________________________________________________ _____________________________________________________________
16.	What do you think the future of remedial education in your institution is likely to be? What policies do you anticipate your institution developing in this area? __________________________________________________________________

III. Questionnaire for Welfare-to-Work Programs

Contact Name _______________________________________________________
Agency _____________________________________________________________
Phone Number _______________________________ Date __________________

1.	Does your program provide basic education or remedial education for its clients (through contracts, referral, or directly)?
_____	NO: Why not? Probe for evidence of insufficient funding, concentration on job search assistance, start-up problems____________________________ _________________________________________________________________ Do you refer individuals to other programs, to pursue remedial education on their own? _____ NO _____ YES: Do you know how many of these clients actually enroll in remedial programs you refer them to? ____________________________and About how many return to your programs after completing remedial education?______________________________________________
_____	YES (continue)
2.	Is there any state policy about the role of remedial education in welfare-to-work programs, for example about the sequencing of remedial education?
_____	NO
_____	YES: What is the policy and what was the rationale for this policy? _________________________________________________________________
(If not providing remediation, GO TO Question 13, skip 14, then continue)
3.	What proportion of welfare-to-work clients receive remedial education? _______ How many individuals is that? _______ How does this compare to the proportion of clients in job search and placement? ___________________________________________________________________ In skills training? ______________________________________________ Can you send us data on the numbers of clients in each type of service (vocational skills training, job search, remedial education, ESL, etc.)? _____ yes _____ no
4.	Who identifies clients in need of remedial education?________________________ _________________________________________________________________
_____	the welfare agency, centrally What test or assessment mechanism is used to select clients into remedial education? _______________________________________________________ What score or cut-off is used to identify those in need of remedial education? _________________________________________________________________
_____	another agency or subcontractors Are there welfare department guidelines about the tests or assessment mechanisms used to select clients into remediation, or is this left to the discretion of the other agencies/subcontractors? What tests are used? _________________________________________________________________
5.	Is remedial education provided by
_____	one provider for all welfare-to-work clients in the program?
_____	a series of subcontractors? 5a. What organization(s) is the (are the) main provider(s): (list) ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ 5b. Who could I contact at this (these) program(s) to get further information? (record on above list)
6.	Are there department guidelines about the nature and duration of remedial education?
_____	NO
_____	YES: Could you send us a copy of these guidelines? _____ yes _____ no
7.	In general, what kind of remedial education is provided to your clients? ___________________________________________________________________
8.	How is remedial education for your clients funded?
_____	from the welfare department's budget for the welfare-to-work program?
_____	by other institutions or other sources of public funding (e.g., by community colleges or adult schools from their state ADA funds)? Specify:___________________________________________________________________
9.	What is the relationship between remedial education and job skills training? ___________________________________________________________________ 9a. Do most of those who receive remedial education also receive job skills training or vocational education? _____ yes _____ no 9b. Does remedial education
_____	precede job skills training?
_____	or is it concurrent? (go to 9c.)
_____	or is it integrated into skills training? 9c. If concurrent, what amount of time is spent in each component? remedial education __________________________________________________ job skills training __________________________________________________ Is scheduling a problem? _____ yes _____ no 9d. Is remedial education ever tailored to the specific area of skills training? _____ yes _____ no
10.	How does the program define completion of a remedial program?
_____	hours completed or other length of education
_____	mastery of a set of competencies
_____	score increased by a certain amount
_____	minimum test score achieved
_____	Other _____________________________________________________________
11.	Does the department collect any data on the rates at which welfare clients complete their remedial programs?
_____	NO: Is there any evidence about whether completion rates are a problem? Describe:_____________________________________________________________
_____	YES: What is the approximate rate? Can we get a copy of your data on this? _____ yes _____ no
12.	Does the department collect any information about the effects of its remedial programs?
_____	NO: Does it require any of its subcontractors to collect such information? _____ yes _____ no
_____	YES: Check: _____ pre- and posttests _____ placement rates of those who have and have not completed remedial programs _____ success in subsequent coursework _____ Other____________________________________________________
13.	If the welfare office does not contract with an educational institution or JTPA program to provide remedial education, have you ever considered working with the community college, adult school, or JTPA program to provide remedial education?
_____	NO
_____	YES: Why was the decision made to offer remedial education independently of these institutions?___________________________________________________ __________________________________________________________________
14.	If the SDA does subcontract with an educational institution or JTPA program to provide remedial education, Why was the decision made to offer remedial education through this program? __________________________________________________________________
15.	Does the welfare-to-work program have any skills training programs offered in conjunction with the local community colleges, technical institutes, area vocational schools, adult schools, or SDAs?
_____	NO
_____	YES: What are some of these programs? Could you send me information on all such programs, including the number of your clients enrolled in each and the kind of training offered, as well as names of contacts at these institutions? _____ yes _____ no (If no, get contacts now, on phone)
16.	What do you think the future of remedial education in welfare-to-work is likely to be? ___________________________________________________________________ What policies do you anticipate your state and/or local program developing in this area? ______________________________________________________________ ___________________________________________________________________

IV. Questionnaire for Providers of Remedial Education

Contact Name _______________________________________________________
Agency _____________________________________________________________
Phone Number _______________________________ Date __________________

The subjects for these interview will vary: they will include the directors of programs operated by SDAs (i.e., from question I.5); the directors of remedial education centers operated by community colleges and other educational institutions (from question II.4); the heads of English, math, and other academic departments (from question II.4), in community colleges which handle remedial education in this way; the directors of remedial programs for welfare clients (from question III.6 and III.7), the individuals in community-based organizations (CBOs) responsible for remedial education (from question I.6)--anyone who has direct responsibility for the operation of remedial education.

1.	How are individuals selected for this program? __________________________________________________________________ What tests or assessment mechanisms are used, and what scores or cut-off points are used to select individuals? __________________________________________________________________ Why do individuals referred to your program need remedial education? How will it benefit them? (This question is intended to find out their general attitudes toward their clients and what remedial education is all about.) __________________________________________________________________
2.	Does this program include individuals from several different programs or referral mechanisms (e.g., from JTPA and welfare programs and adult literacy programs) or just from one source?
_____	One source
_____	Several sources: How do the individuals from different programs differ? __________________________________________________________________ Could you send us enrollment information, including information on the characteristics of participants and how many are funded by JTPA, welfare, or other job training programs? _____ yes _____ no
3.	What are the sources of funding for this program?
_____	JTPA	_____ ABE
_____	Perkins	_____ Other __________________________________
_____	Welfare	_______________________________________
_____	State education	_______________________________________
	(If the answer to this question is inconsistent with the information from the previous question, probe. For example, if there are JTPA clients enrolled but no JTPA funding, ask how their participation is supported.)
4.	When individuals are referred to you, do you perform any additional assessment or appraisal?
_____	NO
_____	YES: What is the nature of this appraisal, and what are the results used for?
5.	What method of instruction does this program use?
_____	Established curriculum: ________________________________________ Name and address of publisher: _____________________________________
_____	Locally developed curriculum. Name: __________________________________________________________________ If it is locally developed, get as much information about the philosophy and methods of instruction as possible. 5a. Subjects and grade/difficulty level: __________________________________ __________________________________________________________________ Why were these subjects chosen? __________________________________ 5b. Is the instruction ______ one-on-one or ______ group instruction? 5c. Is it computer-based instruction? __________________________________________________________________ 5d. Is it _____ individualized (based on information from the initial assessment) or _____ is it standard for all who enroll? Can the curriculum be changed for individuals who are having trouble? _____ yes _____ no 5e. Is the program _____ self-paced or _____ group-paced? How much of the program is teacher-directed, versus student-directed (i.e., by student choices of topics or exercises, by discussion rather than lecture) __________________________________________________________________ 5f. Is the program _____ open-entry/open-exit, or _____ do individuals have to enter at fixed times? 5g. Does the program of instruction have a particular philosophy? (e.g., phonics versus whole-word; mastery learning; competency-based; whole language; integrated oral and written language; eclectic) __________________________________ 5h. Is the duration of remedial education _____ adjusted to each individual, or is it _____ fixed in length? If fixed, what is the duration/intensity? __________ If variable, what is the range of duration/intensity?_________________________ 5i. What special problems have you encountered in using this curriculum? How could the curriculum be improved? __________________________________
6.	What kind of education and training specific to remedial education do instructors in the program have?___________________________________________________ What kind of staff development or in-service training do you provide? __________________ __________________________________________________________________ What other characteristics do you look for in instructors? (Some programs may hire bilingual instructors, or those from the community, or those of the same race/ethnicity as students.)__________________________________________________________________
7.	What is the relationship between remedial education and job skills training? 7a. Do most of those who receive remedial education also receive job skills training or vocational education? _____ yes _____ no 7b. Does remedial education: _____ precede job skills training? _____ or is it concurrent? (go to 7c.) _____ or is it integrated into skills training? 7c. If concurrent, what amount of time is spent in each component? remedial education ____________________________________________________ job skills training _____________________________________________________ Is scheduling a problem? _____ yes _____ no 7d. Is remedial education ever tailored to the specific area of skills training?
_____	NO
_____	YES: How? _____________________________________________________
8.	How does the program define completion of a remedial program?
_____	hours completed or other length of education
_____	mastery of a set of competencies
_____	score increased by a certain amount
_____	minimum test score achieved
_____	Other ____________________________________________________
9.	How do you define success for individuals in your program, that is, what is the goal of your program, what do you want your clients to learn? (passing a test, reading newspapers, vs. workplace literacy?) __________________________________________________________________
10.	Does the program collect any data on the rates at which students complete the remedial programs?
_____	NO: Is there any evidence about whether completion rates are a problem? Describe: ____________________________________________________
_____	YES: What is the approximate rate? ____________________________________________ Can we get a copy of your data on this? _____ yes _____ no
11.	Does the program collect any information about the effects of its remedial programs?
_____	NO: If not, how does it judge the program's success? ___________________________ __________________________________________________________________
_____	YES: What outcomes are measured? (pre- and posttests; placement rates of those who have and have not completed remedial programs; success in subsequent coursework; other?) ____________________________________________________ Is there any long-term follow-up? What kind? ________________________________________
12.	What do you think the future of remedial education in your program is likely to be? __________________________________________________________________ What policies do you anticipate your institution developing in this area?__________ __________________________________________________________________

Grubb, W. N., Kalman, J., Castellano, M., Brown, C., & Bradby, D. (1991). Readin', writin' and 'rithmetic one more time: The role of remediation in vocational education and job training (MDS-309). Berkeley: National Center for Research in Vocational Education, University of California.