A standardized test is a test administered and scored in a consistent manner. The tests are designed in such a way that the "questions, conditions for administering, scoring procedures, and interpretations are consistent" Sylvan Learning glossary, retrieved online, source no longer available and are "administered and scored in a predetermined, standard manner."Popham, J. (1999). Why standardized tests don’t measure educational quality. Educational Leadership, 56(6), 8-15.
Contents |
| This article does not cite any references or sources. (July 2006) Please help improve this article by adding citations to reliable sources. Unverifiable material may be challenged and removed. |
The earliest evidence of standardized testing based on merit comes from China during the Han dynasty. The concept of a state ruled by men of ability and virtue was an outgrowth of Confucian philosophy. The imperial examinations covered the Six Arts which included music, archery and horsemanship, arithmetic, writing, and knowledge of the rituals and ceremonies of both public and private parts. Later, the five studies (military strategies, civil law, revenue and taxation, agriculture and geography) were added to the testing.[citation needed]
The first large-scale use of the IQ test in the US was during the World War I (circa 1914-18). The Educational Testing Service (ETS) established in 1948 is the world\'s largest private educational testing and measurement organization, operating on an annual budget of approximately $900 million.
The Elementary and Secondary Education Act of 1965 requires standardized testing in public schools. US Public Law 107-110, known as the No Child Left Behind Act of 2001 further ties public school funding to standardized testing.
In practice, standardized tests can be composed of multiple-choice and true-false questions. Such items can be tested inexpensively and quickly by scoring special answer sheets by computer or via computer-adaptive testing. Some tests also have short-answer or essay writing components that are assigned a score by independent evaluators who use rubrics (rules or guidelines) and anchor papers (examples of papers for each possible score) to determine the grade to be given to a response. Most assessments, however, are not scored by people; people are used to score items that are not able to be scored easily by computer (i.e., essays). For example, the Graduate Record Exam is a computer-adaptive assessment that requires no scoring by people (except for the writing portion).ETS webage about scoring the GRE.
There can be issues with human scoring, which is a reason for the preference given to computer scoring. For example, the Seattle Times reported that for Washington State\'s WASL, temporary employees that were paid $10 an hour spent as little as 20 seconds on each math problem and 2.5 minutes on essay items which might determine if a student graduates from high school, which some believe is a matter of concern given the high stakes nature of such tests. Pearson scores many other state tests similarly.[1] Sunday, August 27, 2000 "Temps spend just minutes to score state test A WASL math problem may take 20 seconds; an essay, 2 1/2 minutes" Jolayne Houtz Seattle Times "In a matter of minutes, a $10-an-hour temp assigns a score to your child\'s test" Agreement between scorers can vary between 60 to 85 percent depending on the test and the scoring session. Sometimes states pay to have two or more scorers read each paper to improve reliability, though this does not eliminate test responses getting different scores.Why the WASL is AwfulNote, however, that open-ended components of test are often only a small proportion of the test.
There are two types of standardized test score interpretations: a norm-referenced score interpretation or a criterion-referenced score interpretation. Norm-referenced score interpretations compare test-takers to a sample of peers. Criterion-referenced score interpretations compare test-takers to a criterion (a formal definition of content), regardless of the scores of other examinees. These may also be described as standards-based assessments as they are aligned with the standards-based education reform movement.Where We Stand: Standards-Based Assessment and Accountability (American Federation of Teachers) [2] Norm-referenced test score interpretations are associated with traditional education, which measures success by rank ordering students, while standards-based assessments are based on the egalitarian belief that all students can succeed if they are assessed against high standards which are required of all students regardless of ability or economic background.[citation needed]
The considerations of validity and reliability typically are viewed as essential elements for determining the quality of any standardized test. However, professional and practitioner associations frequently have placed these concerns within broader contexts when developing standards and making overall judgments about the quality of any standardized test as a whole within a given context.
In the field of evaluation, and in particular educational evaluation, the Joint Committee on Standards for Educational EvaluationJoint Committee on Standards for Educational Evaluation has published three sets of standards for evaluations. The Personnel Evaluation StandardsJoint Committee on Standards for Educational Evaluation. (1988). The Personnel Evaluation Standards: How to Assess Systems for Evaluating Educators. Newbury Park, CA: Sage Publications. was published in 1988, The Program Evaluation Standards (2nd edition)Joint Committee on Standards for Educational Evaluation. (1994). The Program Evaluation Standards, 2nd Edition. Newbury Park, CA: Sage Publications. was published in 1994, and The Student Evaluation StandardsCommittee on Standards for Educational Evaluation. (2003). The Student Evaluation Standards: How to Improve Evaluations of Students. Newbury Park, CA: Corwin Press. was published in 2003.
Each publication presents and elaborates a set of standards for use in a variety of educational settings. The standards provide guidelines for designing, implementing, assessing and improving the identified form of evaluation. Each of the standards has been placed in one of four fundamental categories to promote educational evaluations that are proper, useful, feasible, and accurate. In these sets of standards, validity and reliability considerations are covered under the accuracy topic. For example, the student accuracy standards help ensure that student evaluations will provide sound, accurate, and credible information about student learning and performance.
In the field of psychometrics, the Standards for Educational and Psychological TestingThe Standards for Educational and Psychological Testing place standards about validity and reliability, along with errors of measurement and relatndividuals with disabilities. The third and final major topic covers standards related to testing applications, ind credentialing, plus testing in program evaluation and public policy.
One of the main advantages of standardized testing is that the results can be empirically documented, therefore the test scores can be shown to have a relative degree of validity and reliability, as well as results which are generalizable and replicable.Kuncel, N. R., & Hezlett, S. A. (2007). Science, 315, 1080-81.. This is often contrasted with grades on a school transcript, which are assigned by individual teachers. It may be difficult to account for differences in educational culture across schools, difficulty of a given teacher\'s curriculum, differences in teaching style, and techniques and biases that affect grading. This makes standardized tests useful for admissions purposes in higher education, where a school is trying to compare students from across the nation or across the world.
Another advantage is aggregation. A well designed standardized test provides an assessment of an individual\'s mastery of a domain of knowledge or skill which at some level of aggregation will provide useful information. That is, while individual assessments may not be accurate enough for practical purposes, the mean scores of classes, schools, branches of a company, or other groups may well provide useful information because of the reduction of error accomplished by increasing the sample size.
Though educators recognize that standardized tests have a place in the arsenal of tools used to assess student achievement, many feel that overuse and misuse of these tests is having serious negative consequences on teaching and learning. According to FairTest,FairTest (National Center for Fair & Open Testing) when standardized tests are the primary factor in accountability, the temptation is to use the tests to define curriculum and focus instruction. What is not tested is not taught, and how the subject is tested becomes a model for how to teach the subject. Critics say this disfavors higher-order learning.[citation needed] Moreover, PophamPopham, W.J. (1999). Why Standardized Test Scores Don\'t Measure Educational Quality. Educational Leadership, 56(6) 8-15. points out that standardized test score should not be a measure of school accountability because the examinee scores are influenced by three things: what kids learn in school, what kids learn outside of school, and innate intelligence.
It is of course possible to use a standardized test and not let its limits control curriculum and instruction. However, this can result in a school putting itself at risk for producing lower test scores. For example, under the federal No Child Left Behind law in the United States, low test scores mean schools and districts can be labeled "in need of improvement" and punished. It also means parents and the community are less likely to know how well children are learning in untested areas.
Supporters of standardized testing respond that these are not reasons to abandon testing, but rather criticisms of poorly designed testing regimes. They argue that testing focuses educational resources on the most important aspects of education - imparting a pre-defined set of knowledge and skills - and that other aspects are either less important, or should be added to the testing scheme.
Some critics say[attribution needed] that some children do not do well on standardized tests, despite mastery of the material, due to testing anxiety or lack of time management or test-taking skills.
The growing influence of test preparation is also a concern for some. As the importance of standardized testing rises, many students and attempt to prepare themselves for a test, either through free sample tests and programs, purchasing books designed to prepare the student for a test, or private tutoring sessions. Some parents are willing to pay thousands of dollars to prepare their children for tests,Associated Press (August 4 1998). "Tackling the SAT? Test-prep help abounds". Christian Science Monitor 90 (175): B3. ISSN 0882-7729. Retrieved on 2007-07-09. “Some parents spend thousands of dollars for private sessions...” a financial barrier that may give children of more wealthy parents an advantage compared to less affluent families. However this criticism would probably apply even more to testing alternatives such as portfolios or essays. Many studies also show that test coaching has little effect on scores on well-built tests.
Testing bias occurs when a test systematically favors one group over another, even though both groups are equal on the trait the test measures. Critics allege that test makers and facilitators are connected to government committees[citation needed], and these groups and test makers tend to represent a middle class, white background. Critics claim that standardized testing match the values, habits, and language of the test makers[citation needed]. However, being that most tests come from a white, middle-class background, it is important to note that the highest test scores are not by people of that background.Race and intelligence (test_data)#IQ test score gap in the US It is also important to note that virtually modern standardized tests follow extensive guidelines with regard to test bias and ensure diverse representation of ethnic groups and backgrounds during test development. Students from minority backgrounds have a hard time identifying with the subject matter of questions and readings because they do not correlate with their previous experiences. For students who speak English as a second language or another form of English, such as Ebonics, they have a hard time reading and comprehending the tests because they are written in Standard English. Note that these criticisms apply primarily to verbal tests. It is hard to imagine how a test which primarily contains abstract problems (such as a math or IQ test) could unfairly favor any particular group. Questions on these tests contain only the symbols and concepts inherent to the subject, thus any disparate group impact is simply legitimate measurement of ability.
Not all tests are well-written, for example, containing multiple-choice questions with ambiguous answers, or poor coverage of the desired curriculum. Some standardized tests include essay questions, and some have criticized the effectiveness of the grading methods. Recently, partial computerized grading of essays has been introduced for some tests, which is even more controversial.Weighing In On the Elements of Essay by Jay Mathews. Washington Post, 1 Aug 2004, p. A01.
Test scores are in some cases used as a sole, mandatory, or primary criterion for admissions or certification. For example, some U.S. states require high school graduation examinations. Adequate scores on these exit exams are required for high school graduation. The General Educational Development test is often used as an alternative to a high school diploma.
Other applications include tracking (deciding whether a student should be enrolled in the "fast" or "slow" version of a course) and awarding scholarships. In the United States, many colleges and universities automatically translate scores on Advanced Placement tests into college credit, satisfaction of graduation requirements, or placement in more advanced courses. Generalized tests such as the SAT are more often used as one measure among several, when making admissions decisions. Some public institutions have cutoff scores for the SAT, GPA, or class rank, for creating classes of applicants to automatically accept or reject.
Heavy reliance on standardized tests for decision-making is often controversial, for the reasons noted above. Critics often propose emphasizing cumulative or even non-numerical measures, such as classroom grades or brief individual assessments (written in prose) from teachers.
The National Academy of Sciences recommends that major educational decisions not be based solely on a test score."High Stakes: Testing for Tracking, Promotion, and Graduation"
This article is licensed under the GNU Free Documentation License. It uses material from Wikipedia