Every complex skill requires sensory feedback. A simple task like cooking an omelet requires measuring ingredients; riding a bike requires a sense of balance, sight, and a host of fine motor skills. Effective teaching similarly requires a steady stream of information about students’ learning and engagement.

Assessment can be one of the biggest challenges for language teachers. Though it may have the stigma of being time-consuming for teachers or stressful for students, it can also be a valuable tool for helping both teachers and students reach their learning goals. The purpose of this post is to demystify language assessment and give language teachers tools to improve their teaching practice.

Assessing Language Learning

When I was training to be a second language English teacher, I was mainly interested in learning new teaching methods. Assessment seemed like an icky word that only needed to be uttered at the end of a semester so that I could give my students a grade. As I began teaching, however, I came to find that assessment is far more than benchmark skill tests or summative exams; it is the feedback mechanism that helps me as a teacher adjust my practice in realtime.

At its core, assessment in language instruction is about taking a snapshot of students’ minds.  What does the language look like inside their heads?  How does it flow? How does it light up?  This information is indispensable when making decisions in the classroom.

The Qualities of a Perfect Assessment System

Rick Stiggin (2017) asserts that the perfect assessment system differs greatly from the high stakes tests—TOEFL, ILETS—that come to mind when the term assessment is utter. High-quality assessment helps students make meaningful improvements in their work and gives teachers the information needed to reach students where they are, not where the pacing guide says they should be. This type of assessment system has the following traits:

  1. A clear purpose for each assessment,
  2. Clear learning objectives,
  3. Quality assessments that measure what they aim to measure,
  4. Effective communication of assessment results to students and stakeholders, and
  5. Assessment practices that enhance students’ motivation.

Improvements in any of these five areas can be instrumental for helping language learners meet their learning goals.

Determining the Purpose of Assessment

While there are a wealth of assessment products out there to assist with language teaching; many of them are quite general in nature and may not provide useful feedback to teachers or students.

Ultimately, the purpose of classroom assessments henges on students language learning goals or the realities of the language acquisition process.

For instance, this week I started teaching a new group of students in an ESL reading and writing course. I needed to see how students felt about writing and also give them a sense of their abilities from the start of the course so that they could recognize their growth later on.

On the first day of class, I had everyone write for ten minutes about their recent vacation.  I could have used this timed writing sample for several different purposes.  I could have checked their writing fluency or looked for gaps in their language. Instead, I had students assess themselves along three criteria based on standards we have used in previous classes: confidence, accuracy, and no hesitation.

Other purposes could include measuring proficiency, tracking improvement on a specific skill, or identifying areas for improvement.

The key takeaway is that any assessment we give should have a purpose. As second language writing assessment specialist Deborah Crusan (personal communication, 2014) would put it, “We don’t give a test just because it’s Friday.”

Different Kinds of Assessment

The types of assessment students are expected to engage with often have a strong influencing effect on the curriculum (Stiggins, 2017; Abdulhamid & Fox, 2020). As such, it’s always important to consider the ways assessment can enhance or degrade the learning process.

At its core, language is about communication.  When assessment involves real communication, the downstream effects can greatly support students’ language acquisition.

Here’s an extreme example of when the opposite is true. About ten years ago, I taught a cohort of ESL students who had transferred from a school in East Asia. All of them had extremely weak speaking skills despite years of formal English instruction, yet several knew about grammatical concepts most American high schoolers wouldn’t even recognize. By chance, I got to meet one of their former English teachers while traveling abroad.  I thought it was a good chance to figure out why these students’ speaking skills were so weak.

The teacher expressed that she wanted to incorporate more communicative activities into her classes, but felt tied to the nation’s standardized test.  Indeed, all high school students in that country had to take an English test at the end of their studies, and their test results would largely determine whether or not they could be accepted into one of the nation’s competitive universities.  Since the test primarily focused on grammatical knowledge and vocabulary, that’s what teachers in that country felt compelled to teach.

I can’t help but consider that this focus on grammar and vocabulary, as opposed to real communication, may be due to the fact that these linguistic elements are easily tested through select-response questions. Authentic language use, such as having a conversation with someone or writing for a meaningful purpose, is much more complex and thus more time-consuming to assess.

Simply put, the format of assessment can greatly influence the way we teach.  If we want students to be confident and clear communicators, then language testing needs to look for signs of clear and confident communication.

Finding ways to incorporate authentic assessment into high-stakes language tests would likely have immensely positive downstream effects.

Grading Effort

Whatever you subsidize, you have more of; whatever you tax, you have less of.

This common refrain from economics rings true when considering a classroom grading scheme.

Acquiring a language to an advanced level is a long and difficult journey, one that requires persistent efforts over the course of several years (VanPatten et al., 2020). While  the time it takes to reach advanced proficiency can vary significantly from language to language, the grit, effort, and drive needed to learn any language well can be immense.

As a language teacher, there are times when it may be worthwhile to consider ways to subsidize these qualities through grading.

Consider reading comprehension. Consistent with logic, reading more tends to correspond with better reading comprehension (Hsu & Chen, 2021). While the weakest readers in an English class may not do as well as others on a reading test, finding ways to help them develop a consistent reading habit can help to ensure their continued success. Rewarding students for reading more may dilute aptitude-based grades, but ultimately reinforce behaviors that result in greater aptitude. Put in economic terms, subsidizing effort may take away from the aptitude grading budget or impact, but the resulting work may lead to more aptitude overall.

Speaking practice can benefit similarly. With limited class time, it may be worthwhile to reward additional efforts outside of class.

When I was about 13, I attended a Spanish immersion summer camp in Northern Minnesota. As an absolute beginner, it was literally impossible to communicate in Spanish all the time (or even 25% of the time). The camp councilors had a system for encouraging total immersion, though.  For each day that a student communicated only in Spanish, they were awarded a little colorful bead to string onto their name tag.  Seeing all my peers earn this coveted bead, I committed to use nothing but Spanish for an entire day. Almost a quarter of a century later, I still remember garbling my way through the language to tell a camp counselor that one of the boys in my cabin was bullying a younger camper. I wanted to say that he was calling the younger boy the names, and distinctly remember struggling to conjugate the word “dog” into the feminine form to describe the bullying. Sticking up for the younger camper was important to me, but I wouldn’t have tried to do it in Spanish if it wasn’t for that silly little bead.

If our goal as language teachers is to get students to use language in real and meaningful contexts, effort grading can work wonders to move students in the right direction.

As with any assessment scheme we as teachers dream up, Rick Stiggin’s (2017) five criteria for a perfect assessment system hold true when considering how to handle effort grades:

  1. Is there a clear purpose in grading effort?
  2. Are there clear standards for students’ efforts?
  3. Do we have a valid, reliable, and fair means to measure effort?
  4. Can we communicate information about students’ efforts in order to support learning?
  5. Does effort grading support students’ motivation in language learning?

If these criteria can be met, it may be worth considering the role effort plays in a course grading scheme.

Self-Assessment

Motivation plays an immense role in language acquisition (Hiver et al., 2021).  Considering the time needed to reach an advanced level in a target language, finding ways to increase motivation and involvement in the language learning journey is critical.

Self-assessment is one way to increase learner motivation and create a meaningful feedback loop to support students learning.

The keys to effective self assessment are the same as any other assessment we use; it needs to have a purpose, clear standards, a high-quality format, ways of communicating results to stakeholders (including the teacher), and a positive impact on students motivation.

Over the past several years, the concept of gamification—turning learning into a game—has become a hot topic in second language teaching literature (Zhang & Hasim, 2023). Self-assessment is one way to incorporate gaming principles into the learning process to stimulate motivation.

Take speaking as an example. For a daily self-assessment, students can reflect on the conversations they had outside of class. A simple-tracker for people they spoke with each day can be used. Special awards can be given for specific accomplishments or mini-missions such as using English to purchase something, having a conversation with a stranger, talking to more than 10 people, or spending the entire day using English.  A Bingo-esque scorecard can be used to gamify this reflective process.

When students are familiar with the self-assessment process, they can also play a role in creating new goals like the mini-missions mentioned above.

Portfolio-Based Assessments

The journey of language acquisition is both ordered and piecemeal (VanPatten et al., 2020). With so much to learn on the road to becoming an advanced user of a language, it’s sometimes hard to recognize one’s progress. Portfolio assessment can help with monitoring learners’ language acquisition process.  That said portfolio assessment can become a blessing or a curse depending on how it is implemented.

A case study by Abdulhamid and Fox (2020) provides a great example of times when portfolio assessment can be used inappropriately. For the past several years, language learning centers funded by the Canadian government have been using portfolio-based language assessment in their government-funded language teaching courses, with the stated goals of improving program efficiency, monitoring course effectiveness, and encouraging task-based teaching. In portfolio-based assessment, portfolios are meant to serve as collections of students’ exemplary works. While portfolios are typically thought of as a living collection of documents and artifacts that students curate, reflect on, and engage with to improve as language learners, the way portfolios were used at these government-funded language schools was primarily as a summative assessment or showcase of students work.

Because of the high-stakes nature of these portfolios to assess program effectiveness, some teachers in Abdulhamid and Fox’s (2020) study reported feeling torn between the seemingly conflicting goals of using the portfolios to guide students’ learning or using the portfolios to demonstrate program effectiveness to the government. In essence, the portfolio system took on the properties of just another standardized test. Similarly, students reported experiencing high levels of assessment anxiety when building their portfolios. Several teachers even reported that the high-stakes portfolio assessment system led to a proliferation of cheating among students, as the focus shifted attention from improving in the language to performing well on this high-stakes assessment.

In this instance, several of Stiggins’ (2017) criteria for a perfect assessment system were violated. While there was a stated purpose for the assessment system, that purpose had less to do with supporting students’ reflective language learning and more to do with evaluating the effectiveness of the language centers. As a result, this assessment scheme had a negative impact on students motivation. By considering what went wrong with this assessment system, it’s possible to envision how portfolio-based assessment can be used appropriately.

Simply by changing the purpose of the assessment, the subsequent results could be drastically different.  If the intent of the portfolio assessment was to collect evidence of students’ continued engagement in the language learning process and to ensure the quality of teachers’ supporting feedback, the experience with the portfolio assessment system might be entirely different.

When used as an assessment for learning, portfolios can encourage reflective writing and constructive feedback practices.  When used as an assessment of learning, they can become just another high-stakes test.

Using Statistical Analysis to Support Assessment Communication

Earlier this year I took a course in applied statistics and it had an unexpected impact on my teaching practice.

For years, I suspected that text complexity had a major impact on my students’ comprehension scores. Based on Stephen Krashen’s (1982) input hypothesis—commonly referred to as i+1—I hypothesized that reading more comprehensible texts would result in improved reading comprehension compared to reading more challenging texts. Until recently, however, I lacked the tools to test this hypotheses.

Learning how to use the Data Analysis Toolpak—a free add-on for Microsoft Excel—revolutionized the way I look at my students assessment data.

For instance, using the Toolpak, I was able to run a t-test to compare learning outcomes among groups of students or correlation regressions to identify trends within the class.

With my reading class, I used Excel to compare the learning gains of students who strictly read at an independent reading level—texts with an estimated 90% text comprehensibility—to those who read more challenging texts.  The results of this t-test (see Table 1) gave me useful evidence to support my hypothesis that text comprehensibility had a major impact on changes in my students’ reading comprehension. With this evidence, I came to feel more confident about requiring students to read texts at an independent reading level.

Table 1

Changes in Students’ Lexile Scores Based on Reading Choices

 nMean Change in Lexile ScoreSDtp
Exclusively read books with >90% text comp.2246.8646.101.63.14*
Read some books with <90% text comp.83.9050.16  

Data analysis tools are also excellent for helping educators communicate assessment results to stakeholders so that they can make informed decisions. This past week, I started teaching a new group of reading students.  On the first day of class, I drew a regression analysis on the whiteboard to show them what had been learned the previous year about reading choices and subsequent changes in reading comprehension (see Figure 1).

Figure 1

Whiteboard Regression Analysis of Percentage of Text Read at an Independent Reading Level and Changes in Students’ Lexile Reading Scores

Though the image wasn’t very precise, it helped me communicate Krashen’s (1982) i+1 principle to my students in a meaningful way.  After talking about the principle of text comprehensibility and how laying a solid foundation in their reading would support their improvement, I told them that they would get a participation grade for reading books within an assigned independent reading range, something I was hesitant to do previously without strong evidence to support this decision.

In the past, when I told students that they would be required to read books within a certain range, I inevitably got some pushback. This time, students had an easier time conceptualizing how their reading choices could affect their learning gains and responded positively. This experience helped me better understand why Stiggins (2017) lists effective communication of assessment data as one of the five core elements of a perfect assessment system.

Closing Thoughts

Though assessment can sometimes seem like an esoteric art best left to trained experts, these principles of assessment literacy can benefit any language teacher, even those starting out.  Being purposeful—as opposed to arbitrary—in assessing students it is more likely that the effects of assessment will align with students’ learning goals. Clear and timely communication of assessment data can then be used to help students make conscientious improvements in their language journey.  This feedback can then motivate students to keep making diligent efforts and thoughtful efforts in their language learning.

References:

Abdulhamid, N., & Fox, J. (2020). Portfolio based language assessment (PBLA) in language instruction for Newcomers to Canada (LINC) Programs: Taking stock of teachers' experience. Canadian Journal of Applied Linguistics, 23(2), 168-192. https://doi.org/10.37213/cjal.2020.31121

Hiver, P., Al-Hoorie, A. H., Vitta, J. P., & Wu, J. (2021). Engagement in language learning: A systematic review of 20 years of research methods and definitions. Language Teaching Research, 28(1), 201-230. https://doi.org/10.1177/13621688211001289 (Original work published 2024)

Hsu, H. L., & Chen, C. C. (2021). An Investigation on the Effect of Extensive Reading on Reading Proficiency Using the Lexile Framework. Hwa Kang English Journal, 26, 1-27. https://doi.org/10.3966/221880882021072601001

Krashen, S.D. (1982). Principles and practice in second language acquisition. Pergamon.

Stiggins, R. J. (2017). The Perfect Assessment System. ASCD.

VanPatten, B., Smith, M., & Benati, A. G. (2020). Key questions in Second language acquisition: An introduction. Cambridge University Press.

Zhang, S., & Hasim, Z. (2023). Gamification in EFL/ESL instruction: A systematic review of empirical research. Frontiers in psychology, 13, 1030790. https://doi.org/10.3389/fpsyg.2022.1030790