EdSpeak08.JPG

Events Calendar

May 2012
S M T W T F S
29 30 1 2 3 4 5
6 7 8 9 10 11 12
13 14 15 16 17 18 19
20 21 22 23 24 25 26
27 28 29 30 31 1 2
Survey of Teacher Opinion on Assessment PDF Print E-mail
Written by Robert A. Southworth Jr.   
Tuesday, 31 January 2006 03:34
EVIDENCE OF STUDENT LEARNING
AND IMPLICATIONS FOR ALTERNATIVE POLICIES
THAT SUPPORT INSTRUCTIONAL USE OF assessment:
A SURVEY OF TEACHER OPINION AND REPORTED
PRACTICE CONCERNING THE USE OF STUDENT
ASSESSMENT

1999  

By

Robert A. Southworth, Jr., Ed.D.
Adjunct Assistant Professor
Curriculum and Teaching Department
Teachers College, Columbia University
525 West 120th Street, New York, NY 10025
212-678-3958 / 310 Main Hall

American Educational research Association Conference
Session 23.06 on Thursday, April 12, 2001

Frequency


Elementary:  Elementary teachers are more likely to use these assessments on a monthly basis or greater in descending order of frequency: observation (92.2%), group work (82.7%), short answer (72.6%), exhibitions of student work (67.2%), journals (66.9%), portfolios of student work (62.2%), and teacher created multiple-choice tests (58.1%).  Secondary teachers are more likely to use these assessments, in descending order of frequency: observation (82.9%), short answer (80.9%), group work (80.5%), longer answer (65.6%), and teacher-created multiple-choice tests (57.2%). Analysis was also performed by core subjects. 

Helpfulness in Assessing Learning

Elementary:  When the analysis turned to how teachers perceived the helpfulness of various types of assessment, elementary teachers in the sample are more likely to say that the following teacher-created performance assessments are very helpful in assessing student learning: observation (82.7%**), portfolios of student work (60.3%**), short answer (49.3%), group work (48.2%), student journals (40.7%**), individual projects (38.5%), and longer answer (37.8%). Elementary teachers acknowledged the increased work and also noted the payoffs in student progress and learning:

  • Performance assessments are harder to generate, administer, and keep track of, but they do a lot for the teaching plan and student progress...more comprehensive (Grade 6, math teacher/Respondent # 242).
  • These types of assessments [performance assessments] are the only kind that really reveal reality relative to what students know, and what they can do (Grade 3, writing teacher/Respondent # 11).

Secondary teachers: Secondary teachers in the sample, on the other hand, are most likely to say that the following teacher created performance assessments are very helpful in assessing student learning: observation (64.0%**), longer answer (54.0%), short answer (44.4%), individual projects (39.4%), papers (39.0%**), group work (37.4%), and portfolios of student work (23.2%**).

Core Subjects

ELA Teachers: Particularly interesting was ELA teacher opinion that the most helpful teacher-created performance assessments are, in order: Observation (78.8%), portfolios of student work (69.6%**), longer answer (56.4%), student journals (53.2%**), and short answer (50.6%*).  ELA teachers expressed a sense of the helpfulness that portfolios: “Show student’s true ability (Grade 11-12, ELA teacher / Respondent #2).  ELA teachers also understood the professional responsibility inherent in teacher judgment:

  • Authentic Assessment is truly the best way to see a student’s growth in all subject areas.  It is not an ambiguous guessing game, nor is it based on numbers and percentages.  A teacher can get a better idea of the student’s feelings, opinions, strengths and weaknesses (Grade K-2, reading teacher/Respondent # 36).

Math teachers: math teachers think the most helpful teacher-created performance assessments are, in order of helpfulness: observation (64.8%), portfolios of student work (35.8%**), group work (35.2%), longer answer (35.6%), and short answer (34.0%*).

  • Social Studies teachers: For example, social studies teachers think the most helpful teacher-created performance assessments are, in order of helpfulness: observation (70.8%), short answer (66.7%*), group work (60.9%), longer answer (58.3%), and individual project (56.5%).
  • Science Teachers: science teachers think the most helpful performance assessments are, in order of helpfulness: observation (68.0%), short answer (60.0%*), individual project (56.0%), group work (52. %), and longer answer (48.0%).    

Benefits and Costs

Traditional standardized tests: Although the sample agreed with the benefits and costs of traditional standardized multiple-choice tests, teachers agreed more with the benefits of performance assessments and disagreed more with the costs. For example, teachers agree with the utilitarian benefits of standardized tests that use traditional multiple-choice questions from the benefit of using standardized procedures for scoring (77.4%) and using multiple-choice questions that are easy to score (74.8%) to the benefit of using scores to facilitate comparison of students (71.9%).  Teachers understand this usefulness for what these tests can and cannot do, as this comment by one respondent reflects:  

  • These tests provide objective/comparison data but don’t really show an individual’s abilities.  They are definitely easier to understand how to do than performance assessments (Grade 10, sequential math teacher / Respondent # 37).

Teachers in this sample are in strong disagreement with earlier research literature that says traditional multiple-choice tests are valid and reliable.  For example, only 33.8% of teachers in this sample agree that standardized tests are valid whereas 49.0% disagree

  • They [traditional multiple-choice tests] just do not show an accurate assessment of student’s abilities (Grade 3, ELA teachers / Respondent # 42).
  • I do not believe that tests like the SAT in any way reflect a student’s ability to be successful in college.  Regents exams are better in that they reflect specific curriculum knowledge (Grade 9, music teacher / Respondent # 55).

For example, 53.3% of teachers agree that standardized tests emphasize lower-order thinking skills.  In addition to the cost of memorizing, 63.7% of the sample agree that standardized tests reward guessing correctly, 56.8% agree that these tests may be culturally biased, and 60.4% agree that standardized tests limit or narrow the curriculum.

Performance Assessments: Elementary and secondary teachers agree that performance assessments increase student responsibility for learning (92.8%) and improve student understanding (89.7%).  It is interesting to note that not only is the agreement about Performance Assessment’s benefits to students greater than any of the perceived benefits of multiple-choice tests, but it is also the strongest agreement between all teachers in the sample over any survey question.

  • Performance-based assessments make students more accountable for their learning and engender the learning more by application rather than just rote spitting back short-term memory information (Grade 4, science teacher / Respondent # 21).

    Teachers are quite strong in opinion when 78.9% agree that performance assessments get students to undertake challenging work and 77.6% agree that these types of assessments increase student ability for self-assessment. Teachers in the sample are fairly strong in their endorsement of how performance assessment helps teachers assess student strength and weakness (90.6%) and makes student learning visible to the teacher (89.2%).  Performance assessments may also yield other benefits; for example, when 85.6% agree that performance assessments sample diverse student cognitive skills and abilities and 80.8% of all teachers agree that performance assessments are an ongoing process that chronicles development.  Also, 74.2% of the sample agree that performance assessments are collaborative between student and teacher and 65.3% of the sample agree that performance assessments are anchored in authenticity.  
 
    Most interestingly, the potential costs of performance assessments were not a major concern for teachers in this sample.  For example, 56.1% disagreed that performance assessments were too time consuming to evaluate/grade, 71.2% of teachers disagreed that performance assessments make it hard to explain student learning, and 60.3% of teachers disagreed that performance assessments make it hard to compare student achievement. Performance assessments were also the preferred assessment method for communicating to parents, outsiders, and policymakers.

Implications for Further Research

    The results suggest that the New York State Education Department should create new policies that establish a relationship of importance with teachers in order to more fully understand the exact professional knowledge held by teachers and to re-align the state’s assessment system to reflect Capacity-building policies and strategies that highlight and support teacher thinking about student performance.  The majority of the sample reports that performance assessments were the most helpful method of assessment currently available to them and many think multiple-choice tests are not valid and reliable.  Research and Policy should begin with understanding the learning advantage performance assessments convey to both teachers and students:

  • Need for Assistance: Characterizing teacher opinion in this sample as a change in teacher emphasis from traditional to performance assessment has its roots in a history of assessment knowledge need identified by researchers from Tyler (1942), Goslin (1967), and Lortie (1975) to Salmon-Cox (1981), Stiggins and Conklin (1992), and Darling-Hammond and Falk (1997).  Perhaps what keeps getting lost by a society that favors basic skills is “particular assistance in assessing [and teaching] higher level skills” (Dorr-Bremme & Herman, 1986, p. 32).  The change in emphasis defined by this sample and alluded to as a need in other samples of teachers, is driven by teachers who need and want to create assessments that more closely mirror higher-order thinking skills that teachers value and want to see in student learning.  Research and policy that develop understanding of how to support teachers as they construct quality assessments is most important.
  • Observation: Observation leads teachers to create performance assessments that ask students to more clearly show their learning.  Teacher observation needs to continue to be unpacked and studied by researchers who can find the multiple-ways that diverse minds evaluate other diverse minds.  The learning advantage gained by using portfolios of student work helps teachers to see student learning more clearly and this window of insight helps teachers provide increased support for the process of student learning and ultimately student achievement.  
  • Benefits of Performance Assessments: Performance assessments increase student responsibility for learning (92.8%) and improve student understanding (89.7%).  Performance assessments also get students to undertake challenging work (78.9%) and increase student ability for self-assessment (77.6%).  These four characteristic benefits of performance assessments need to be researched to find out how all teachers could employ them to everyone’s benefit.
  • New Teachers: Research is needed into how we conduct the process of inducting new teachers with an eye toward professional assessment knowledge.  Assessment is so important to understanding new teachers.  Further research is needed to identify and recruit people who will be good at assessing students while supporting the progress of the students they teach—a difficult balance to maintain.
  • State: Research is also needed into how the state’s system of assessment can support its interactive parts and become more aligned, rather than the current system where disparate parts are unaligned and incoherent at times.
  • Students: Finally, research is needed in order to understand assessment’s role in how to support every student who goes through the system so that what we test is what we get and assessment can move toward better serving teachers.