Assessment with Storytelling Part 1

A college language student studying for a big test or trying to find Pepe Silvia or something.

Course Content and Outcomes

Everything starts with the outcomes we want for our students. What do we want students to get out of the course? What do we want them to be able to do by the end of the term? If you can answer this question, you can begin to plan accordingly.

Here is the excerpt from my syllabus that outlines content and outcomes for Spanish 101 (Note: I don’t know who wrote these. They’ve been the outcomes in my department since before I started teaching at this college in summer 2013):

 

Course Content

A. greetings and farewell expression
B. weather descriptions
C. direct object nouns & pronouns
D. daily routines (present tense & present progressive)
E. vocabulary related to academic life, family & pastimes
F. numbers, time, and date expressions

 

 

Student Outcomes

1. Comprehend speech samples providing information pertaining to course content
2. Comprehend written language samples providing information pertaining to course content.
3. Construct basic sentences and paragraphs appropriately.
4. Vary basic information appropriately with modifiers (adjectival and adverbial).
5. Request and provide information pertaining to course content in writing.
6. Request and provide information pertaining to course content orally.
7. Distinguish and demonstrate appropriate forms of address.
8. Apply and comprehend case, person, number, gender, and tense appropriately within the scope of the content of this course as indicated in other outcomes.

I’m not going to say these are the perfect outcomes or that they are inherently flawed. That’s irrelevant for this discussion. These are the outcomes that my department defined and, therefore, they are the target I’m going to aim for.

What to Assess

My goal for assessment is to evaluate students on the course outcomes. In this way they will be prepared for the next course in the sequence regardless of whether or not their next professor uses storytelling.

Your course outcomes will depend on the context in which you find yourself, and you should adjust your assessment accordingly. Perhaps you have a common grammar test students need to pass at the end of the course. On the other hand, maybe you have some flexibility in terms of what you teach and where you want your students to end up.

Storytelling can get you to your course outcomes, regardless of what they are, due to its inherent flexibility. That is, you can make stories use whatever grammar, vocabulary, syntax, etc. you need to present to students.

In my ideal situation, I wouldn’t assess students on grammar in any introductory course. That may sound controversial, but it shouldn’t be. I don’t test my son on whether or not he uses each irregular verb properly (He doesn’t, by the way. But that doesn’t stop him from getting better at English and Spanish every single day).

However, some of us (myself included) are in a context that doesn’t allow us to shun grammar entirely. That’s okay, though. The storyteller doesn’t relegate grammar to the textbook. Instead we help learners build a functional “mental representation” of the language through comprehensible input and ample opportunities for students to negotiate meaning through communicative acts.

One of my course outcomes is for students to be able to understand and use the present tense in class. That means that in Spanish I we will be using almost exclusively present tense, and students will only be expected to produce in the present tense. That means I will select stories and other activities that focus primarily on the present tense.

Knowing where I’m going (i.e. knowing the outcomes I want for students) lets me make a roadmap to get there.

Backwards Planning

Backwards planning is the key to making assessment of storytelling-taught-classes work properly.

When we plan an assessment in advance, we know what’s on it. We know that students must complete certain tasks on the assessment by a certain date. This isn’t a surprise—we put it on the calendar. Backwards planning begs the question “What tools do our students need to complete the tasks on the assessment successfully?”

For instance, let’s say that students must complete a grammar test by the end of the quarter. Now that we know what the goal is, we can start to plan how arm students with the necessary tools to complete the task at hand. What are the tools they need in this scenario?

  1. They need to acquire the vocabulary that will appear on the test.
  2. They need to acquire the forms that appear on the test.
  3. They need to be able to read and comprehend the questions asked of them.
  4. They need to be able to respond to those questions appropriately.
  5. They need to be able to connect their ideas in fluidly.
  6. Maybe some other things I haven’t thought of yet.

How does the storyteller make this knowledge accessible to students? We plan it out, way in advance. Each story I select builds on the previous one so that we recycle all the elements on the test in different communicative contexts.

We’ve seen the vocabulary and the grammar, we’ve discussed the questions, and we’ve heard numerous people express their ideas in a logical, coherent way in the language.

By encapsulating vocabulary, grammar, etc. in a story, students hear and see the language in a natural context that we humans have been using for thousands of years. In my experience, this leads most students to perform better on both formal and informal assessments.

My Assessments for Fall 2018

The first thing I do when designing my courses is to write out a list of all the assignments and assessments that my students will complete. Instead of a percentage-based grade, I tend to favor an overall point system. It’s still broken down by percentage, but I find points easier for students to understand and I field fewer questions about grades as a result. Below is a list of the assignments and assessments for my Spanish I courses:

Interpersonal Communication – 250pts

Online Homework (VHL Central) – 100pts

Listening Quizzes – 8 quizzes x 6pts each – lowest score = 42pts

Timed Writes – 8 timed writes x 25pts – lowest score = 175pts

Pretests – 4 pretests x 25pts = 100 pts

Final Grammar Test – 100pts

Final Vocabulary Test – 50pts

Written Story/Essay Assignment – 100pts

Oral Story Test – 100pts

Total Points: 1017

The first three items on the list (Interpersonal Communication, Online Homework, and Listening Quizzes) are what I consider to be “formative assessments”, and they make up roughly 40% of the total points in the course.

The rest of the assignments on the list (timed writes, pretests, final grammar test, final vocabulary test, written story/essay assignment, oral story test) are what I consider to be “summative assessments”, and they make up roughly 60% of the total points available in the course.

I have a lot to talk about here, so I have decided to break each one of these down in greater detail in separate posts.

When do we need students to demonstrate results?

It would be great for students to show me that they’ve mastered all the vocabulary and grammar from chapter 2 at the time of the test, but we humans acquire languages asynchronously. That is, different people pick up languages at different rates.

Furthermore, some people acquire a certain vocabulary and structures while other people acquire different vocabulary and structures. Yes, we all follow the general order of acquisition, but every learner does so at a pace unique to the individual.

What does this mean for the purpose of assessment? Personally, this means that I care most about what students can produce at the end of the quarter. The mid-term results are a nice barometer for me, but they are useless if the student can’t demonstrate the expected degree of fluency at the end of the quarter.

Backloading Assessments

Putting a Consider the last four assessments in my Spanish I course:

 

Final Grammar Test – 100pts

Final Vocabulary Test – 50pts

Written Story/Essay Assignment – 100pts

Oral Story Test – 100pts

These four assessments take place during the last five days of my course, and they constitute roughly one-third of all the points. After a quarter of delivering high-quality CI via highly personalized and engaging stories, it’s time for the students to show me that they’ve reached the expected level of fluency.

To me, this is the perfect level of balance. Two-thirds of the total points are spread out over the rest of the quarter, which allows me to reward the daily effort required to learn a new language. That leaves one third of the total points at the backend of the course. This allows me to assess proficiency when it matters most: at the end of the course.

Spreading 350 points over four assessments takes the pressure off students and, hopefully, lowers their affective filter.

Q: What if I bomb the Oral Story test?
A: Well that wouldn’t exactly be good for your grade, but it also wouldn’t be the end of the world.

Students always perform better when their affective filter is lowered.

What Do My Assessments Look Like?

In the coming days and weeks I will be delineating all the assignments and assessments in my syllabus. I will make a post about each, the rationale behind them, and how they fit in with storytelling.

 

Leave a Reply

Your email address will not be published. Required fields are marked *