Sunday, May 20, 2001

Right Answer, Wrong Score: Test Flaws Take Toll One day last May, a few weeks before commencement, Jake Plumley was pulled out of the classroom at Harding High School in St. Paul and told to report to his guidance counselor. The counselor closed the door and asked him to sit down. The news was grim. Jake, a senior, had failed a standardized test required for graduation. To try to salvage his diploma, he had to give up a promising job and go to summer school. "It changed my whole life, that test," Jake recalled. In fact, Jake should have been elated. He actually had passed the test. But the company that scored it had made an error, giving Jake and 47,000 other Minnesota students lower scores than they deserved. But it was not an isolated incident. The testing industry is coming off its three most problem-plagued years. Its missteps have affected millions of students who took standardized proficiency tests in at least 20 states. An examination of recent mistakes and interviews with more than 120 people involved in the testing process suggest that the industry cannot guarantee the kind of error-free, high-speed testing that parents, educators and politicians seem to take for granted. In recent years, the four testing companies that dominate the market have experienced serious breakdowns in quality control. Problems at NCS, for example, extend beyond Minnesota. In the last three years, the company produced a flawed answer key that incorrectly lowered multiple-choice scores for 12,000 Arizona students, erred in adding up scores of essay tests for students in Michigan and was forced with another company to rescore 204,000 essay tests in Washington because the state found the scores too generous. NCS also missed important deadlines for delivering test results in Florida and California. http://www.nytimes.com/2001/05/20/business/20EXAM.html?pagewanted=all