Tag Archives: assessment

Boxes Made to Fit

Leave a reply

William (Bill) Ferriter shared a post on LinkedIn about the struggles his daughter is having at school. While I will share a key quote from his post, I encourage you to read the full post here. Bill said,

Should we be failing students who pass unit tests and quizzes but don’t turn in practice tasks? Were those practice tasks essential as a vehicle for preparing students or assessing learning if a student can demonstrate mastery on the unit test without them? How many assignments do we really need to determine if a student is working at or above grade level? Could we use something other than zeros — think codes like INC or placeholder grades like 50s — to report on missing work? Does every student have to do every assignment?

On a more philosophical level, are we cheapening our professional credibility when we report that a student who passes most/all of our quizzes and tests has failed our class? Are grading policies with rigid consequences for missing work effective for encouraging learning? For changing behavior? Is the purpose of grades to report on student mastery of essential outcomes or to report on the ability (or lack thereof) to keep up with schoolwork?

I left Bill the following comment:

In my first year teaching a colleague (also in his first year) was experimenting with grading and asked a simple question that has stuck with me:
“Are we counting marks or marking what counts.”
(See the first half of this old post – if you go past the first half, sorry that the image links seem to be broken.)

My daughter was training 24-26 hours a week in Synchronized Swimming and missed some gym classes going to Provincials and Nationals. Despite consistently being the second fastest girl doing their weekly runs (behind a Provincial level soccer player), she was told at the end of the year she would only get a ‘B’ unless she made up a run and did a volleyball rules quiz she missed.

I share this because it exemplifies the idea of just counting marks.

To me this undermines the professionalism of teaching. It says, ‘We only care about the numbers’, and that my friend is exactly what AI can do better than us. I hope to see educators around the world thinking more deeply about what really matters to students in school. We need to stop building schools and courses like boxes students need to fit into and more like boxes made to fit students!

A message to high school teachers

If you are in a semestered high school, you are about to finish semester 1 and start semester 2. That means it’s time to give students final marks in half of their courses. How do you work out their marks? Is it a matter of just looking at your mark book and averaging or tallying up marks from September to now?

Consider this little analogy I’ve shared before… and ask yourself if there’s a kid or two who might deserve a better mark considering how they are doing now compared to 4 months ago:

__________

The Parachute Packing Analogy

I love the simplicity of this example! There are 3 students who are in a parachute packing class:

Students take 3 tests during the course.

Student A starts off strong and gets an A on the first test, gets a B on the second test, is over-confident, flounders and gets a C on their final test.

Student B is a solid B student and gets B’s on all 3 tests.

Student C struggles on the first test and gets a C, starts understanding the concepts and gets a B on the second test, then totally understands all the concepts and finishes with an A on the final test.

All 3 students have a ‘B’ average in the course.

Which student do you want to pack your parachute?

__________

You don’t ‘need’ to mark the way you used to. You don’t ‘need’ to mark the kid getting 46% just by the numbers, especially if their mark was 36% at the start of the year and they are much more successful now. You can bump the one kid up 2% for the ‘A’ because they did poorly on one test the whole semester… And totally justify not giving another kid that 2% because they are short of getting an ‘A’ from consistently getting the harder questions wrong, and have not demonstrated that they are a ‘A’ student.

Equal ≠ Fair

Equal is not equal to fair. You can be fair without treating everyone equal… with assessments, with support, and even with how much homework you give them.

Assessment isn’t just about averaging and tallying marks, and fairness isn’t determined by equal treatment.

Unexpectedly clever

There is no such thing as a perfect worksheet, and students will often read a question and figure out an unintended way to answer it. Here are two clever responses… the difference being the teacher’s assessment.

I look at the first one and I can hear the Madagascar movie version of it in my head. The teacher states the obvious, “Not the answer I was looking for” and gives it a big red X.

It’s obvious in the second one that the answer also wasn’t what the teacher was looking for, but that teacher gave it a big red check mark and a star.

“Not what I was looking for” does not mean wrong.

A clever response may be unexpected, however whether it was an intentional circumvention of the intended outcome or just insightful and clever it deserves to be appreciated rather than marked incorrectly. In my books, both these kids deserve a star.

Satisfactory Work Habits

When report cards go out, they include Work Habits. The usual standard is either that you got a ‘G’ for good, or you haven’t done a good enough job. Admittedly, as a parent, I wanted to see ‘G’s more than ‘A’s, because I wanted to know that my kids were trying their best.

At Inquiry Hub we look at it differently. We think the scale is skewed to the negative with ‘Satisfactory’ being something bad, when in fact in means you are doing a ‘good enough’ job. This was part of my message home to parents that went out on report card day:

—

Work Habits – The work habits provided are ‘G’ – Good, ‘S’ – Satisfactory, and ‘N’ Needs Improvement. 

Many middle and high schools break this up as ‘G’ = anything above average. ‘S’ = There are some issues. ‘N’ = Not good. Some schools even give awards for students that get “All G’s”. That is NOT what we do here. The word ‘Satisfactory’ is not a bad word. Satisfactory means doing what needs to be done. That’s not a bad thing… could it be better? Yes, it is possible that a student can step up and do more than they need to… that’s ‘Good’. And for us an ‘N’ means that work habits need improvement, like most other schools. 

We like to have a positive distinction between ‘Satisfactory’ and ‘Good’ rather than ‘Good’ being the only measure of doing good work. It’s more important to us to separate 2 kinds of ‘Good’, than 2 kinds of ‘Needs Improvement’. In fact, we have many over-achievers in our school, and one thing we stress is that sometimes it’s perfectly OK to do ‘enough’ work in one area so that you can focus more attention in another area. Can you still talk to your child about moving from ‘S’ to ‘G’? Sure, but please don’t put a lot of emphasis on this! ‘Satisfactory’ can often mean, “I did what I needed to do to get the job done.” If everything you do is always good, that’s a heck of a lot of stress to deal with when you have a lot on your plate. 

—

This approach seems even more apt now that we are having students do SCRUM projects, because part of working on a scrum team is defining what ‘Done’ looks like. For some parts of a project ‘done’ doesn’t mean ‘excellent’, it means good enough to move on. This is an important skill to learn. The interesting thing is, when you are working on a team, the collective definition of done is usually more than just ‘satisfactory’, and is already better than ‘good enough’. This isn’t about putting the least amount of effort it, it’s more about not extending the team so much that they can’t finish a project on time.

Sometimes satisfactory work really is the goal, so that you have the time, energy, and enthusiasm to do other work at an excellent level. A satisfactory work habit means that you’ve done what you needed to do.

More like real life

I enjoy seeing teachers talk about assessment like this:

The best part of the clip is when Mrs. Lemon says, “I wrote better tests that focus less on recall and more on application.”

Although, I love the ending too… “At the end of the day, this is more like real life. There are very few circumstances where are you don’t know the answer to something and can’t look it up.”

What future are we preparing students for? How is our assessment demonstrating this? Are we showing what we value by what we measure, or are we just measuring what’s easy to measure?

That BS kid

I was one of those kids. You know the type, every report card my marks were somewhere between average and good, with comments about me not meeting my potential… The ‘BS’ grade of ‘B’ but only a ‘S’atisfactory for effort, rather than ‘G’ood. With a few exceptions the marks could have been ‘A’s. It got worse in university where my marks became further divergent, with me getting ‘A’s in the courses I liked and ‘C’s in the ones I didn’t.

It took my Teacher Ed degree at 29 years old before my marks started to actually represent my abilities, and even then it was partially because I surrounded myself with people who pushed me. I can still hear Anna-Christana’s voice, “Dave, look at our calendar, we have 3 big things due, one on Thursday, two on Friday next week, so you need to start at least one of them this weekend, ok?”

It took me almost two decades of schooling to figure it out on my own before starting my Masters. And now, despite knowing these kind of students, despite being one of these students, I still don’t know a magic formula to move a ‘BS’ to a ‘BG’ or an ‘AG’. As a side note, it’s not as much about the ‘A’ mark as the ‘G’ for effort, that I’m really interested in seeing… change the effort, grades will eventually follow.

In high school, favourite teachers of mine could get me to put more effort into things, but they didn’t decide to be a favourite teacher, I decided. That speaks a lot to the importance of relationships in teaching, but kids don’t always meet you there. Yes, we can excite these students about a project that are in their areas of interest. Yes, we can give them more choice in assignments and ways to demonstrate learning, but at some point they need to step up too.

I wish there was a secret I could reveal. I wish I could look back in time and say, ‘If only I had done this‘, or i’If only someone had provided me with that‘, well then things would have been different. Maybe there is something, but for me it was my age and my willingness to put the effort in. Until then, learning on someone else’s agenda was pretty much BS to me.

Averages and Parachute Packing

This is Part 2 of:

Average tells us nothing.

Here are some very well rounded marks of a hypothetical student in a course:

The student starts out very average with 60% on the first 3 tests:

On the next test, the student shows much greater comprehension:

Then on the final test, the student shows mastery of the PLO’s, the prescribed learning outcomes:

Now if these were tests on completely different units, unrelated to each other, you could argue that the student deserves a 70% final. However if the student was learning information that was cumulative and knowledge at the end of the course required understanding of previous work, then wouldn’t the student deserve a higher mark?

For example, if the student was learning to code, and the simple(r) concepts learned at the start of the course (that the first 3 tests were on) were required understanding to do well in the second part of the course: Shouldn’t the student’s final mark represent greater understanding of the course than the 70% final mark from the average of all 5 tests?

The Parachute Packing Analogy

I love the simplicity of this example! There are 3 students who are in a parachute packing class:

Students take 3 tests during the course.

Student A starts off strong and gets an A on the first test, gets a B on the second test, is over-confident, flounders and gets a C on their final test.

Student B is a solid B student and gets B’s on all 3 tests.

Student C struggles on the first test and gets a C, starts understanding the concepts and gets a B on the second test, then totally understands all the concepts and finishes with an A on the final test.

All 3 students have a ‘B’ average in the course.

Which student do you want to pack your parachute?

Average tells us nothing.

Part 1

It might be an exaggeration to say that it tells us nothing, but averages don’t usually give us enough information to be useful.

Individual student level: In Math class, kid gets an ‘A’ on his test on positive and negative integers. Then he gets a ‘C’ on fractions. Score averages to a ‘B’… but when the kid moves on to algebra, and most of the algebra includes solving problems with fractions, it’s unlikely the kid will do better than a ‘C’. The important information is the ‘C’ in fractions, not the ‘B’ average.

On a team level: When some team members have done amazing things and other tram members have done nothing new, measuring the average means absolutely nothing. You can’t look at averages when some team members will move and some won’t. The reality is that everybody has to be moving in the right direction, and when some are standing still, it doesn’t matter where the average is, it doesn’t matter if the average is moving slightly up.

The fact is that we are failing or we have failed if we don’t figure out where we are weakest and improve where we need it most. Athletes get this. They know that the weakest part of their performance is the area where there is the most room for improvement… this is a mindset we need on our teams to move forward.

Part 2: The Parachute Packing analogy and school grades.

Whose problem is it?

A couple thoughts about assessment:

1. I taught Grade 9 Math for a year then after a year of only Humanities I went back to teaching Math, but for Grade 8’s. After about 5 years of teaching Math 8 I caught myself saying something as I started my unit on Exponents. I said to the class, “Every year this is the hardest unit and the hardest test that I give you.” I had to say it out loud to realize what I was really saying.

What I was really saying was one of two things, either I wasn’t doing a good enough job teaching this unit, or I was giving students much too hard of a test. Looking carefully at the test, I realized it was a bit of both. Because I had taught Grade 9 and new what was coming, when I looked at the test I realized that I was expecting students to know the content at a Grade 9 level… I was ‘preparing them’ for what’s to come. In every section of the test I had questions that started out with basic Grade 8 outcomes, but questions got gradually harder and always ended up with a couple (or more) questions that expected them to exceed what was required in the curriculum.

It was my problem, not theirs, that they struggled. I was pushing them to learn hard concepts at a very high level and testing them so that they all had to be competent at a higher grade level just to get a decent mark. My intentions were good. The outcome and experience for students who were not strong in math were not so good. I reworked my test that year, and some of my teaching as well.

___

2. This isn’t one I’ve done, but my daughter has faced this. Last year in her university French course, the professor said, “Nobody gets an ‘A’ unless they are native speakers”. He then proceeded to give my daughter ‘B’s in every assignment, no matter what she did, and what feedback she used to improver her next assignment… that is, until her final exam. In her final exam, the marking was blind (the teaching only saw a number, and not the students’ names). On that exam, my daughter got an ‘A’.

If our job is to teach students, and improve their work, then what are we telling them if our message is, “You aren’t good enough to get an ‘A’.” … Is this not also saying, “I’m not a good enough teacher to help you improve.”? What message does this give to a student who is always striving to do her best and is a high achiever? What message does this give to a student who is struggling? Whose problem is it when every student that comes to your class isn’t good enough for an ‘A’ both before they arrive in class, and also after you have been their teacher for a semester?

___

Assessment isn’t just measuring progress, it’s also measuring teacher expectations, and it’s up to us to make sure those expectations are realistic and fair.

What’s on the test?

With students across the world doing schooling from home, teachers are finding it challenging to get authentic assessment. One of the more difficult issues is trying to administer formal testing.

Have a look at this TikTok by @tamarciment:

If you can Google the answer, students will find a way.

If you can Google the answer, is that a question we need to ask questions on a test?

Is a test the best form of assessment over a Zoom call? What are some better options?

It’s tough to navigate this new environment, and we aren’t going to do it perfectly, but these are questions that we should be asking… and our answers won’t just aid us during this pandemic, our answers will also help us when we have all students back in school too!