Field Test

OVERVIEW OF FIELD TEST 2010/2011 FIELD TEST PARTICIPATION REQUIREMENTSParticipation in the Field Test is open to all ASES grantees in the State. Grantees can determine which program sites they want to have participate in the Field Test. Brief online surveys about students’ skill development and positive behavior change are completed at participating program sites in Fall 2010 and Spring 2011 (2 times for comparison of data). Measures available for ASES programs include the following three options (programs may choose to administer one, two, or all three surveys):

  • 1. STUDENT SELF-REPORTS
    • -Student surveys are completed by students in grades 3 through 8.
    • -Surveys are completed online at the ASES program.
    • -Spanish versions of the measures are available.
    • -Student surveys can be administered in groups of 2 to 20 students. Sessions must be supervised by a staff member.
    • -Survey administration instructions are provided on the project website. Special instructions for ELL students and students with limited reading skills are also provided.
    • -Based on extensive testing, the online student survey takes an elementary or middle school student 5 to 10 minutes and is easy to complete.
  • 2. AFTERSCHOOL STAFF REPORTS ON STUDENT PERFORMANCE
    • -Afterschool staff surveys on student outcomes are completed online at the ASES programs.
    • -Program staff will complete surveys about each student assigned to them.
    • -Completing one survey takes less than 5 minutes. Staff can complete sets of one or more student surveys in multiple sessions on any computer with online access.
  • 3. CLASSROOM TEACHER REPORTS ON STUDENT PERFORMANCE
    • -Classroom teacher reports on student outcomes are for elementary school programs only.
    • -Classroom teachers will complete a report about each student in their class that attends the ASES program.
    • -Each report takes less than 5 minutes. Teachers can complete sets of one or more student surveys in multiple sessions from any computer with Internet access.

Online instructions are provided for students, staff, and teachers that are easy to read and follow. Instructions for Site Directors are provided on how to facilitate the survey administration process at their site, as well as instructions for staff on how to facilitate the student survey administration. We are available via phone and email for questions, technical problems, and any other concerns about the Field Test. BENEFIT FOR PARTICIPATING PROGRAMS At the end of the school year, ASES programs participating in the field test will receive summary findings for the students at their program on the measures of positive behavior change and skill development. Average performance and the range of scores in Fall and in the Spring at your program will be reported. For comparison purposes, average performance of students in other programs across the State will be included in the year-end report. All reports of findings will be confidential. The CALIFORNIA AFTERSCHOOL OUTCOME MEASURES PROJECT is a project of the UC Irvine in collaboration with UC Davis with support from the David and Lucile Packard Foundation and the California Department of Education.
Pilot TestIn 2009/10, UC Irvine and UC Davis pilot tested and refined the skill development and behavior change accountability tools. Pilot testing began in Fall 2009. The research staff were on site to work with program staff in this initial test phase. Participation was voluntary – not required by the state. In our pilot phase we were able to determine:

  • 1. The feasibility of online administration of student outcome measures in the areas of skill development and positive behavior change at diverse ASES-funded afterschool program sites throughout the State
  • 2. The surveys are easy to complete: 5 to 10 minutes for 3rd through 8th grade students; less than 5 minutes for each student report by a teacher or program staff.
  • 3. The measures have excellent reliability and validity.

Field Test Overview (DOC) Field Test Flyer (DOC) Field Test Sign-Up Form(DOC)

 

Locations of the 2009 Program Administration Survey Respondents.