I got the idea for Multiple Answer Tests originally because I wanted to prepare my kids for Common Core Tests. (I’d rather people not use that post as the primary link, as I have done a lot more work since then.)

About six months later (a little over a year ago), I gave an update, which goes extensively into the grading of these tests, if you’re curious. At that time, I was teaching Pre-Calc and Algebra 2/Trig. This past year, I’ve been teaching Trigonometry and Algebra II. I’d never taught trig before, so all my work was new. In contrast, I have a lot of Algebra 2 tests, so I often rework a multiple choice question into a multiple answer.

I thought I’d go into the work of designing a multiple answer test, as well as give some examples of my newer work.

I design my questions almost in an ad hoc basis. Some questions I really like and keep practically intact; others get tweaked each time. I build tests from a mental question database, pulling them in from tests. So when I start a new test, I take the previous unit test, evaluate it, see if I’ve covered the same information, create new questions as needed, pull in questions I didn’t use on an earlier test, whatever. I don’t know how teachers can use the same test time and again. I’d get bored.

I recently realized my questions have a typology. Realizing this has helped me construct questions more clearly, sometimes adding a free response activity just to get the students started down the right path.

The first type of question requires modeling and/or solving one equation completely. The answer choices all involve that one process.

Trigonometry:

I’m very proud of this question. My kids had learned how to graph the functions, but we hadn’t yet turned to modeling applications. So they got this cold, and did really well with it. (In the first class, anyway. We’ll see how the next group does in a month or so.) I had to design it in such a way to really telegraph the question’s simplicity, to convince the students to give it a shot.

The rational expression question is incredibly flexible. I’m probably teaching pre-calc again next year and am really looking forward to beefing this question up with analysis.

Other questions are a situation or graph that can be addressed from multiple aspects. The student ends up working 2 or 3 actual calculations per question. I realized the questions *look* the same as the previous type, but they represent much more work and I need to start making that clear.

Trigonometry:

I love the Pythagorean Ruler question, which could be used purely for plane geometry questions, or right triangle trig. Or both. The furniture question is an early draft; I needed an inverse question and wanted some linear modeling review, so I threw together something that gave me both.

I can also use this format to test fluency on basic functions very efficiently. Instead of wasting one whole question on a trig identity, I can test four or five identities at once.

Or this one, also trig, where I toss in some simplification (re-expression) coupled with an understanding of the actual ratios (cosine and secant), even though they haven’t yet done any graphing. So even if they have graphing calculators (most don’t), they wouldn’t know what to look for.

I’m not much for “math can be used in the real world” lectures, but trigonometry is the one class where I can be all, “in your FACE!” when kids complain that they’d never see this in real life.

I stole the above concept from a trig book and converted to multiple answer, but the one below I came up with all by myself, and there’s all sorts of ways to take it. (and yes, as Mark Roulo points out, it should be “the B29’s **circumference** is blah blah blah.” Fixed in the source.)

Some other questions for Algebra II, although they can easily be beefed up for pre-calc.

One of the last things I do in creating a test is consider the weight I give each question. Sometimes I realize that I’ve created a really tough question with only five answer choices (my minimum). So I’ll add some easier answer choices to give kids credit for knowledge, even if they aren’t up to the toughest concepts yet.

That’s something I’ve really liked about the format. I can push the kids at different levels with the same question, and create more answer choices to give more weight to important concepts.

The kids mostly hate the tests, but readily admit that the hatred is for all the right reasons. Many kids used to As in math are flummoxed by the format, which forces them to realize they don’t really know the math as well as they think they do. They’ve really trained their brains to spot the correct answer in a multiple choice format–or identify the wrong ones. (These are the same kids who have memorized certain freeform response questions, but are flattened by unusual situations that don’t fit directly into the algorithms.)

Other strong students do exceptionally well, often spotting question interpretations I didn’t think of, or asking excellent clarifications that I incorporate into later tests. This tells me that I’m on the right track, exposing and differentiating ability levels.

At the lower ability levels, students actually do pretty well, once I convince them not to randomly circle answers. So, for example, on a rational expression question, they might screw up the final answer, but they can identify factors in common. Or they might make a mistake in calculating linear velocity, but they correctly calculate the circumference, and can answer questions about it.

I’ve already written about the frustrations, as when the kids have correctly worked problems but didn’t identify the verbal description of their process. But that, too, is useful, as they can plainly see the evidence. It forces them to (ahem) attend to precision.

Of course, I’m less than precise myself, and one thing I really love about these tests is my ability to hide this personality flaw. But if you spot any ambiguities, please let me know.

April 9th, 2015 at 9:06 pm

As I recall this is how one section of the Stuyvesant admissions test works.

April 10th, 2015 at 3:58 pm

“But if you spot any ambiguities, please let me know.”

You asked 🙂

Question 3, answer (a): “The DC3’s circumference is 68% of the B29’s.” Since we only have size information for the propellers, this statement can’t be classified as true of false from the given information. (e) and (f) have similar issues, though (b) – (d) do not.

NOTE: I program computers for a living. Yes, I notice these sorts of things. I don’t know if kids are bothered by this.

April 10th, 2015 at 11:05 pm

Actually, I meant to fix that. I clarified that it meant “propeller’s”. Geek.

April 10th, 2015 at 4:01 pm

Also, this sentence appears garbled: “I recently realized my questions have a typology, which has helped me to educate have a typology of questions.”

And I can’t puzzle out quite what you were driving at. Please to fix and then delete this comment?

April 11th, 2015 at 11:40 am

In the chair question you never specify that the function is linear.

April 11th, 2015 at 1:36 pm

The title of the test is Linear Functions unit. Friggin’ mathies. (thanks.)

November 25th, 2015 at 1:34 pm

[…] and wasteful. Many math teachers reward words, not valid explanations; that’s why I use multiple answer math tests to assess conceptual knowledge. I also would love–yea, love–to see my kids willing to […]

December 28th, 2015 at 4:35 am

[…] task became much easier once I turned to multiple answer assessments. I can design questions that test algorithm knowledge, including interim steps, while also […]

February 8th, 2016 at 3:16 am

[…] give a test or quiz every five or seven days to have grades for progress reports. Since I’m designing a new test system, I was spending much more time building and grading assessments […]

March 5th, 2016 at 6:23 pm

[…] tests, but even back then I wasn’t an exact match for typical. Once I started down the multiple answer path, it became even easier to wander miles off the reservation. But without question, multiple answer […]

April 29th, 2016 at 3:31 pm

[…] to grades to make them be more mathematically creative. I think I can do the same by using some multiple answer assessments throughout the year. It would force the students to become more accustomed to mathematical accuracy […]

August 3rd, 2016 at 3:25 pm

[…] first post on the topic, but I’ve revisited it often. They allow flexibility way beyond the usual multiple choice–I can mix and match between freeform and formatted […]