Field Staff Training for the 2000 State Assessment

Field Manager Training

Formal training was not needed for the six returning field managers assigned to the state NAEP program. Thus, training specific to the 2000 program was accomplished through telephone contact and mailings. The field managers received copies of all materials already provided to state coordinators, developed a preliminary assessment schedule for all schools in each of their states, and became thoroughly familiar with the School Control System (SCS). They then visited each state to train state staff in the use of the SCS. Later in the project schedule, they presented some of the training material at the training session for the supervisors and quality control monitors (QCMs).

State Supervisor Training

State supervisors received training pertaining to their responsibilities:

• sampling students;

• conducting assessment administrator (AA) training sessions; and

• recruiting QCMs.

In addition, each supervisor was given time to meet with his/her field manager to discuss the activities to date in his/her assigned state.

Quality Control Monitor Training

Training for QCMs was held in early 2000. In the training supervisors practiced presenting the AA training to the QCMs. They also familiarized themselves with the role of the AAs whom they would be monitoring and learned of their specific monitoring responsibilities. Supervisors then met with their QCMs to discuss assignments.

Assessment Administrator Training

During January 2000, approximately 11,000 AAs were scheduled to be trained by state supervisors before assessments began on January 31, 2000. A total of 574 training sessions were scheduled. Due to winter weather, flooding, and other emergencies, 93 sessions were either rescheduled or supplemented with additional training sessions. Training sessions were completed by the end of January 2000. The state supervisor for a typical state conducted an average of 12 training sessions during which approximately 230 AAs were trained.

Each training session was completed in one school day. Training sessions were held on various days and in various locations within a state to accommodate the schedules and geographic locations of the AAs.

Each state assessment QCM assisted the supervisors in at least two AA training sessions and each QCM attends at least two AA training sessions. The field manager or a home office staff member observed each newly hired state supervisor conducting a training session. The training package used included:

• a video;

• a verbatim training script;

• overhead transparencies;

• a demonstration poster;

• a manual;

• a training example (exercise workbook); and

• the teacher module (optional: used for school in-service credit).

The verbatim training script was a key part of the training package. It ensured that trainees across the country received the same information. The script cued the trainer to use overhead transparencies that displayed the forms that the AAs would be working with. A one-hour videotape demonstrated current configurations of the NAEP data collection forms.

AAs received their manuals prior to the training to give them a chance to read about the procedures beforehand. The majority of the AAs used this opportunity to familiarize themselves with the manual. Training stresses that answers to all questions about procedures and forms can be found in the manual or on the NAEP website. This website, designed and administered by NCES, provides access to general information about the current assessment as well as archived reports from previous assessments. In addition, the AAs were provided with a toll-free number to reach NAEP staff for procedural questions or request additional materials. This phone number was used extensively during the assessment period.

Supervisors prepared individualized instructions for sampling from the new enrollee listing form specific to each school and distributed them at training. The supervisor filled out these instructions by recording the first 10 line numbers generated by the computer for their original sample. Thus, the AAs were to continue sampling at the same rate with any new students who enrolled. Typically in state NAEP, providing schools with 10 additional line numbers per assessment session was sufficient to cover newly enrolled students. The AAs were instructed to contact their state coordinator if the 10 additional line numbers were not sufficient.

In addition, each supervisor made extra copies of the supplemental student listing form available at the training in case the AAs had not received the copies sent by the state coordinator.

Last updated 08 May 2008 (MH)

Printer-friendly Version