Alternative High School Initiative
Accountability Data System
(Link to PDF Version of this page)
AHSI wishes to assist organizations in the network in assembling and
disseminating information about their individual and collective performance with
respect to a common core of significant outcomes. To that end, AHSI
proposes that AHSI organizations reach a consensus on common core outcomes,
indicators, and measures. This system will address performance outcomes,
not enabling objectives that typically are unique to each organization’s service
design.
Major Tasks
1.
Develop a common core of outcomes and indicators addressed to significant
outcomes for which all AHSI organizations will collect and report data (Figure
1).
2.
Assist each organization in identifying outcomes and indicators not
included in the common core but addressed to its significant outcomes and
enabling objectives.
3.
Assist each AHSI organization in sharing its outcomes, indicators, and
measures throughout the network.
Figure 1
AHSI Common Core of Data
As Figure 1 illustrates,
each organization has specific outcomes and enabling objectives for which it
collects performance data. For example, EDVisions collects performance
data using its Hope Index, and YouthBuild is particularly interested in
vocational certifications. The common core data system will not address these
organization-specific outcomes and indicators.
Common Core of Data
The common core of data
will include basic demographic and risk factor data on the populations served by
each organization as well as selected performance outcomes that operationally
define program success. Table 1 provides suggested categories and indicators for
each. Operational definitions will need to be established for each indicator.
Developing outcomes and
indicators for the population served by AHSI organizations poses different
challenges than those for typical high school student populations. Because
students enter AHSI programs with many substantial risk factors, it is important
to understand student background in establishing definitions of what constitutes
success. Many of these students do not follow traditional pathways to
developing themselves or their careers.
Table 1
Suggested Common Core of Data
|
Data Category |
Potential Common Core Indicators |
|
Demographic
Information |
Age, gender, ethnicity,
parental status, grades completed, high school attendance, high school
diploma, eligibility for free and reduced lunch |
|
Risk Factors |
Court involved, foster
care, special needs, substance abuse |
|
Dropout Diversion /
Recovery |
#/% eligible students
graduating |
|
College Ready
|
#/% of graduates
enrolled in college; #/% of graduates enrolled in college with
requirement for enrolling in one or fewer remedial courses |
|
Career Ready
|
#/% of graduates ready
to work and ready to learn job-specific technical skills |
|
|
#/% of graduates placed
in full-time employment with benefits and growth opportunities |
|
|
#/% graduating with
vocational certification(s) |
|
Improved agency and
civic responsibility |
#/% 18yrs or older
registered to vote |
|
|
#/% demonstrating
community leadership while in program, hours of community service
performed |
Data Collection Considerations
Retrospective data will be
collected where possible. In most cases, historical data are not available on
these indicators across all organizations. Therefore, it is likely that
2005-06 may constitute a baseline year for most or all of these proposed common
core indicators. AHSI will develop common data collection forms for recording
these data, including the demographic information on the student population.
AHSI will also align data collection with that conducted by AIR and Parthenon
for Gates Foundation reporting.
Data Analysis
Performance outcome data
will be analyzed by demographic and risk-factor variables. Comparisons will be
made to national and regional data on similar student populations in order to
judge the significance of changes in performance outcome measures over time.
Reporting
Identify major audiences,
such as policy makers, potential adopters, students and parents, program staff,
and the public. It is likely that the common core of data, which is addressed
primarily to program outcomes rather than to enabling objectives, will be used
primarily for communicating with policymakers and the public. Program staff,
potential adopters, and students and parents are likely to be interested in
performance information regarding key enabling objectives which are not part of
the common core of data.
Suggested Action Steps
1.
Achieve consensus on establishing a common core of data.
2.
Select common core outcomes and indicators (with operational
definitions).
3.
Align data collection with Gates reporting requirements conducted by AIR
and Parthenon.
4.
Develop data collection forms for all demographic, risk factor, and
outcome indicators.
5.
Identify non-common core outcomes and indicators unique to each
organization.
6.
Develop processes and structures for data collection, analysis, and
reporting of common core data.
7.
Assist each organization in developing
processes and structures for data collection, analysis, and reporting of
performance data on organization-specific outcomes.
[1]
Definition used in Equipped for the Future
(EFF). EFF is a Work Readiness Credential supported by state and National
partners including NY, NJ, FL, WA, and The National Governors’ Association.