2003 State Special Education Outcomes: Marching On


Published by the National Center on Educational Outcomes

December 2003

Prepared by Sandra Thompson and Martha Thurlow


Any or all portions of this document may be reproduced and distributed without prior permission, provided the source is cited as:

Thompson, S., & Thurlow, M. (2003). 2003 State special education outcomes: Marching on. Minneapolis, MN: University of Minnesota, National Center on Educational Outcomes. Retrieved [today's date], from the World Wide Web: http://education.umn.edu/NCEO/OnlinePubs/2003StateReport.htm./


Table of Contents

The Mission of the National Center on Educational Outcomes
Acknowledgments
State Directors of Special Education
Executive Summary
Overview of 2003 Survey
Consequences
Participation and Performance
Accommodations
Alternate Assessments
Accountability
Emerging Practices
Current and Emerging Issues
Preferred Forms of Technical Assistance


The Mission of the National Center on Educational Outcomes

NCEO is a collaborative effort of the University of Minnesota, the National Association of State Directors of Special Education (NASDSE), and the Council of Chief State School Officers (CCSSO). NCEO provides national leadership in assisting state and local education agencies in their development of policies and practices that encourage and support the participation of students with disabilities in accountability systems and data collection efforts.

NCEO focuses its efforts in the following areas:

  • Research on the participation and performance of students with disabilities in state and national assessments and other educational reform efforts.

  • Dissemination and Technical Assistance through publications, presentations, technical assistance, and other networking activities.

  • Collaboration and Leadership to build on the expertise of others and to develop leaders who can conduct needed research and provide additional technical assistance.

The Center is supported primarily through a Cooperative Agreement (#H326G000001) with the Research to Practice Division, Office of Special Education Programs, U.S. Department of Education. Additional support for targeted projects, including those on limited English proficient students, is provided by other federal and state agencies. The Center is affiliated with the Institute on Community Integration in the College of Education and Human Development, University of Minnesota. Opinions or points of view expressed within this document do not necessarily represent those of the Department of Education or the Offices within it.

National Center on Educational Outcomes
350 Elliott Hall
75 E. River Road
Minneapolis, MN 55455
612/626-1530 • Fax: 612/624-0879 • http://education.umn.edu/NCEO

The University of Minnesota is an equal opportunity educator and employer.

NCEO Staff
Deb Albus
Mike Anderson
Ann Clapper
Jane Krentz
Kristi Liu
Jane Minnema
Ross Moen
Michael Moore
Rachel Quenemoen
Dorene Scott
Sandra Thompson
Martha Thurlow, Director


Acknowledgments

Once again, with the collective efforts of state directors of special education, we are able to report on the activities of all 50 states and nine of eleven federally funded entities (unique states). Because of the thoughtful and knowledgeable responses of the directors and their designees who completed this survey, we are able to share new initiatives, trends, accomplishments, and emerging issues during this important period of education reform. The purpose of this report is not to check for compliance with federal mandates nor to judge the progress of any state; it is simply to provide a snapshot of critical information that allows states to move forward. We appreciate the time taken by respondents to gather information from people outside of special education, and we hope that this collaborative effort provided an opportunity to increase awareness within and across state programs and departments.

For their support, special thanks go to:

  • David Malouf and Lou Danielson, of the Office of Special Education Programs in the U.S. Department of Education;

  • Eileen Ahearn, of the National Association of State Directors of Special Education;

  • Michael Moore, online survey designer and communications director for the National Center on Educational Outcomes; and

  • Jaclyn Roverud and Jason Altman, graduate students who carefully collected and compiled a mountain of survey data.

2003 State Special Education Outcomes was prepared by Sandra Thompson and Martha Thurlow.


State Directors of Special Education

ALABAMA
Mabrey Whetstone

ALASKA
Art Arnold

ARIZONA
Joanne Phillips

ARKANSAS
Marcia Harding

CALIFORNIA
Alice Parker

COLORADO
Lorrie Harkness

CONNECTICUT
George Dowaliby

DELAWARE
Martha Brooks

FLORIDA
Shan Goff

GEORGIA
Philip Pickens

HAWAII
Paul Ban

IDAHO
Jana Jones

ILLINOIS
Chris Koch

INDIANA
Robert Marra

IOWA
Lana Michelson

KANSAS
Zoeann Torrey

 

KENTUCKY
Judy Mallory

LOUISIANA
Virginia Beridon

MAINE
David Stockford

MARYLAND
Carol Ann Baglin

MASSACHUSETTS
Marcia Mittnacht

MICHIGAN
Jacquelyn Thompson

MINNESOTA
Norena Hale

MISSISSIPPI
Melody Bounds

MISSOURI
Melodie Friedebach

MONTANA
Robert Runkel

NEBRASKA
Gary Sherman,
Don Anderson

NEVADA
Gloria Dopf

NEW HAMPSHIRE
Mary J. Ford

NEW JERSEY
Barbara Gantwerk

NEW MEXICO
Sam Howarth

NEW YORK
Lawrence Gloeckler

 

NORTH CAROLINA
Mary Watson

NORTH DAKOTA
Robert Rutten

OHIO
Mike Armstrong

OKLAHOMA
Patricia Sholar

OREGON
Bob Siewert

PENNSYLVANIA
Fran Warkomski

RHODE ISLAND
Thomas DiPaola

SOUTH CAROLINA
Susan DuRant

SOUTH DAKOTA
Michelle Powers

TENNESSEE
Joseph Fisher

TEXAS
Eugene Lenz

UTAH
Karl Wilson

VERMONT
Dennis Kane

VIRGINIA
Doug Cox

WASHINGTON
Doug Gill

WEST VIRGINIA
Dee Braley

 

WISCONSIN
Stephanie Petska

WYOMING
Tammy Cox


AMERICAN SAMOA
Moeolo Vaatausili

BUREAU OF INDIAN AFFAIRS
Sherry Allison

DEPARTMENT OF DEFENSE
Lorie Sebestyen

DISTRICT OF COLUMBIA
Anne Gay

GUAM
Vince Leon Guerrero

MARIANA ISLANDS
Joanne Nicholls

MARSHALL ISLANDS
Kanchi Hosia

MICRONESIA
Makir Keller

PALAU
Evans Imetengel

PUERTO RICO
Sonia Rosario

U.S. VIRGIN ISLANDS
Belinda West-O’Neal

These were the state directors of special education in August 2003 when the survey was verified.


Executive Summary

This report summarizes the ninth survey of state directors of special educa-tion by the National Center on Educational Outcomes (NCEO) at the University of Minnesota. Results include all 50 states and nine of the eleven federally funded entities (unique states). The purpose of this report is to provide a snapshot of the new initiatives, trends, accomplishments, and emerging issues during this important period of education reform as states document the academic achievement of students with disabilities.

Most state directors reported that more students with disabilities are accessing state/district academic content standards with increased academic expectations, and more students with disabilities are participating in statewide assessments and included in accountability systems. The majority of directors also reported improved performance by students with disabilities on state assessments. In addition, nearly all state directors reported increased participation of special educators in training on standards and assessment, and nearly three quarters reported increased networking between general and special educators.

Among the major findings of the 2003 survey are the following:

  • States identify more positive than negative consequences of the participation of students with disabilities in standards, assessments, and accountability.

  • Most regular states are studying trends in the achievement of students with disabilities, and some states are studying the results of assessments by item.

  • More than three-quarters of regular and unique states collect data on accommodations used on state assessments.

  • Three-quarters of the states have one alternate assessment option that addresses the needs of students with significant cognitive disabilities; other states have several alternate assessment options to address the perceived needs of a range of students in addition to those with significant cognitive disabilities.

  • The most common approach to alternate assessment involves a portfolio assessment focused on grade level or expanded standards with the same achievement level descriptors as the general assessment; the portfolios are scored by teachers who use scoring rubrics to assign scores.

  • Over 80% of special education directors were involved in their state’s development of the definition of Adequate Yearly Progress (AYP) required for the No Child Left Behind Act.

  • States are paying increased attention to access to assessments through the use of elements of universal design and accessible computer-based tests.

Though the progress of students with disabilities in this era of standards-based accountability has been noteworthy, states continue to face many challenges in their efforts to increase student achievement and administer assessments that provide valid documentation of this achievement.


Overview of 2003 Survey

This report marks the ninth time over the past twelve years that the

National Center on Educational Outcomes (NCEO) has collected information from state directors of special education about the participation and achievement of students with disabilities during standards-based reform. With the passage of the No Child Left Behind Act of 2001, reform efforts continue to evolve as states become accountable for reaching the goal of academic proficiency for every student.

The 2003 Special Education Outcomes Survey focuses on the implications of educational reform since the 2001 passage of the No Child Left Behind Act and anticipation of the reauthorization of the Individuals with Disabilities Education Act (IDEA). Results are presented in eight sections:

  • Consequences

  • Participation and Performance

  • Accommodations

  • Alternate Assessments

  • Accountability

  • Emerging Practices

  • Current and Emerging Issues

  • Preferred Forms of Technical Assistance

Participants in the 2003 survey included state directors of special education from all 50 states and 11 federal jurisdictions that abide by the provisions of IDEA. These jurisdictions are referred to in this report as "unique states." Responses to the survey were gathered online and via fax during the winter and spring of 2003 (February–May). To view the survey instrument, go to http://education.umn.edu/nceo/NCEOSurveys/2003NCEOsurvey.pdf. Surveys were completed by state directors with the assistance of other state officials representing special education, standards, assessment, and accountability.

Once compiled, drafts of tables were sent to state directors for verification in July and August. Overall, responses were obtained from all 50 regular states and from nine unique states.

As you will read throughout this report, although the progress of students with disabilities in this era of standards-based accountability has been noteworthy, states continue to face many challenges in their efforts to increase student achievement and administer assessments that provide valid documentation of this achievement for accountability purposes.

Eleven Unique States
American Samoa
Bureau of Indian Affairs
(BIA)
Department of Defense
District of Columbia
Guam
Mariana Islands
Marshall Islands
Micronesia
Palau
Puerto Rico
U.S. Virgin Islands

Consequences

The "bottom line"—the consequences of inclusive assessment and

accountability—continues to be an important topic for states. In the 2003 survey, states were asked to identify the positive and negative consequences of the participation of students with disabilities in state standards, assessment, and accountability systems that they had observed since 2001 when NCEO last asked them this question. In 2003, the states started from a list based on their 2001 responses. Figure 1 lists the percentages of regular and unique states indicating each of the consequences.

The most often selected positive consequences among the regular states were increased inclusion in the accountability system (96%) and increased participation in state assessments (90%). The most often selected positive consequences among the unique states were increased participation in state assessments (78%) and increased participation of special educators in training on standards and assessment (78%). The least often selected positive consequence was improved performance for both regular states (64%) and unique states (22%). Still, more than half of the regular states selected this as a positive consequence.

In addition to the positive consequences listed in Figure 1, state directors made these comments:

"Perhaps the biggest benefit for children with disabilities has been the focus of general education on improving the quality of education for children with disabilities. As schools make their plans for school improvement, they focus efforts on children with disabilities for the purpose of increasing the number of students scoring at the proficiency level. Because students with disabilities comprise a disproportionate share of students who are not at the proficiency level, they are the direct beneficiaries of district wide efforts to improve student performance."

"Districts and schools are starting to use disaggregated student achievement data to focus on the learning outcomes of students with disabilities."

"Quality of IEPs has improved."

"Improved data based instruction and higher expectations for students with significant cognitive disabilities."

"NCLB has at least made district and school administrators make sure they know every student that is enrolled in their district or building is accounted for so they get credit for every student in the NCLB participation rate and AYP calculations."

Far fewer state directors selected negative outcomes than positive. The negative outcomes identified are shown in Figure 2. The greatest fear is that students with disabilities will not be able to achieve proficiency on state assessments.

In addition to the negative consequences listed in Figure 2, state directors made these comments:

"Use of accommodations and alternate methods of assistance is labor intensive and more costly."

"Small schools and those that house center-based programs with scores reported to the school of instruction can be negatively impacted by the scores of students with IEPs."

"Immediate referrals to special education when assessment scores are low with the expectation that they are automatically eligible, causing conflicts between general education and special education."

"Resistance to placement of students with disabilities in school buildings when perception is that they will bring down the school’s scores."

"Many teachers of students participating in the alternate assessment don’t like the idea of being held accountable for their students’ performance. They have had a pass on this for too many years and are now very nervous about it."


Participation and Performance

States are required by IDEA to report the number of students with
disabilities who participate in state assessments. NCLB requires the reporting of participation rates by subgroup, including students with disabilities. States report students who do not participate in state assessments (e.g., absent on test day, parent refusal, hospitalized) in a variety of ways. As in 2001, eight regular states gave these students a score of zero or the lowest score in 2003 (see Figure 3); one unique state also used this approach in 2003. There was an increase from 2001 to 2003 of 7 to 16 regular states that counted students (e.g., count as participating) even though they received no score. Two unique states counted these students in 2003.

Most of the states in the "other" category reported that the way students are reported depends on the reason for non-participation. For example, Delaware’s state director wrote, "It depends on the reason why. For example, if a student does not participate because of truancy that student is counted with the lowest score. If there is an acceptable reason, for example hospitalization, the student is granted a special exemption and there is no accountability consequence." Connecticut commented, "Present but no responses counts as participated for NCLB and in calculations of performance as not proficient. Absent students count as non-participants, but do not count in calculations for performance."

States were beginning to be able to document trends across years in the state assessment performance of students with disabilities (see Figure 4). In 2003, 40 of 50 regular states’ directors of special education (80%) responded that they were able to document trends. Two unique states also reported the ability to document trends across years.

Many states commented on the trends question. Table 1 includes a few examples of states that commented on changes in assessment performance, and states that noted difficulties in reporting trends.

Figure 3. Ways States Count Students Who are Not Assessed

 

Figure 4. States Able to Document Trends in Assessment Performance of Students with Disabilities

Table 1. Examples of Sates’ Comments on Trends

Trends show improved state assessment performance of students with disabilities

“Trend data from 1998 to 2001 show that students on IEPs made progress each year on the reading and writing tests, and to a lesser extent, math.”

“The percentage of students with disabilities scoring at Level 3 and above on the Grade 4 English Language Arts (ELA) examination increased 6.6 percentage points since 1999, from 19.0 percent to 25.6 percent. Greater numbers of students with disabilities are tested on each examination compared to the previous year. The number of students with disabilities tested has tripled and quadrupled since 1997. Increasing numbers of students with disabilities have also achieved passing scores each year.”

“Over a three year period there has been improvement in the assessment scores of students in grades 3, 4, 5, 7, and 8. Reading scores have improved significantly for grades K-3.”

“We are seeing small but steady increases in participation rates and performance.”

Trends show unchanged or lower state assessment performance of students with disabilities

“Results from the 2002 assessment administration indicated that progress of students on IEPs in different grade levels and content areas either remained unchanged or slightly declined. These findings were comparable to overall state results.”

“Over a three year period the scores are flat in grades 6 and 9. Scores are slightly down in grades 10 and 11.”

Changes in state assessments have made trends difficult to report

“The state changed its standards based assessment this year so this will be the first year of reportable data.” 

“Our state assessment system has changed so a trend is not possible until 3 years have passed. The year 2003 is the first year our new statewide assessment system will be able to produce data for analysis.”

 “Spring 2002 administration was the first year in which all data on special education students was integrated (both regular and alternate assessment data).

“We will be changing assessments next year.”


Accommodations

Eighty-four percent of the regular states and 78% of the unique states reported that they collected data on the accommodations that students use on state assessments (see Figure 5). The specific information that is coded by states appears in Table 2. Increasing numbers of states code accommodations information from students’ IEPs onto test forms and then verify that information at testing. Three unique states have also initiated this process.

Figure 5. States Reporting Data on Assessment Accommodations Use

Note: None of the unique states reported collecting data on accommodations use.

Table 2. State Documentation of Assessment Accommodations Use

 State

Test form codes “standard” or “nonstandard” accommodations

 Test form codes some or all accommodations

IEP information coded on test form and verified during testing

No accommodations data collected at state level

Alabama

 

 

 

Alaska

 

 

 

Arkansas

 

 

Arizona

 

 

 

California

 

 

 

Colorado

 

 

 

Connecticut

 

 

 

Delaware

 

 

 

Florida

 

 

 

Georgia

 

 

 

Hawaii

 

 

 

Idaho

 

 

 

Illinois

 

 

 

Iowa

 

 

 

Indiana

 

 

 

Kansas

 

 

Kentucky

 

 

Louisiana

 

 

Maine

 

 

Maryland

 

 

 

Massachusetts

 

 

Michigan

 

 

 

Minnesota

 

 

 

Mississippi

 

 

 

Missouri

 

 

 

Montana

 

 

 

Nebraska

 

 

 

Nevada

 

 

 

New Hampshire

 

 

 

New Jersey

 

 

 

New Mexico

 

 

 

New York

 

 

 

North Carolina

 

 

 

North Dakota

 

 

Ohio

 

 

 

Oklahoma

 

 

 

Oregon

 

 

 

Pennsylvania

 

 

 

Rhode Island

 

 

 

South Carolina