Comments on: Answering The Wrong Question

By: Aaron

Aaron — Mon, 08 Oct 2012 16:35:24 +0000

Side note: an interesting study on risk aversion in young students could be done by looking at their answers to matching problems. If 10 items in column 1 are to be matched with 10 in column 2, and a student gets down to 2 unmatched pairs, do they play it safe and ensure exactly 1 out of 2 points, or do they gamble between 0 and 2? However we don’t observe their prior, nor do we observe whether a student faced a decision and made the risky choice but got the matches right.

By: Aaron

Aaron — Mon, 08 Oct 2012 16:26:32 +0000

A related exam grading issue: carry-over errors. We would like to only penalize students once for arithmetic errors at the beginning of a multi-step problem if the remaining logic is consistent. However, sometimes a problem involves a fork: if your answer is A (say, some expression exceeds 0) go here and do more calculations, but if B (say < 0), you are done. If a student mistakenly gets B, they don't attempt the rest of the problem that would follow A. Rewarding points for the rest of the problem, therefore, is too generous AND creates an incentive compatibility problem. On the other hand, 0 credit for the rest of the problem seems too harsh, as their mistake may have been genuine and they may have eagerly and easily answered the Reston the question had they obtained A. What is a fair amount of partial credit? Or should these types of forks be strongly avoided?

By: David

David — Mon, 08 Oct 2012 15:37:08 +0000

Isn’t this basically what politicians do? — answer the question they want to answer instead of the question they are asked.

I agree with the first comment. I find students often will give an answer to demonstrate that they know something, even if (especially if) they don’t know the answer to the actual question.

By: rjd100

rjd100 — Mon, 08 Oct 2012 14:40:15 +0000

The simple solution is to have the professor in the exam room and announce that if you don’t understand the question, please ask for clarification. Then the problem is eliminated.

If several students don’t understand the same question, then it should be struck from the test, as the professor was clearly not “on his game” that day. An incompetently written question deserves no answer.

By: DS

DS — Mon, 08 Oct 2012 14:38:57 +0000

My experience in high school was that we were sometimes given examples of stock answers to study with, and inevitably some of my friends would essentially memorise those answers. This would sometimes results in them deliberately ‘misinterpreting’ the question – or at the very least, attempting to twist it slightly – so that they could get some impressive content down. I think there should be a significant penalty (I agree, not zero) for an extremely egregious interpretation of the question.

By: Dan Hirschman

Dan Hirschman — Mon, 08 Oct 2012 14:22:22 +0000

Also, it’s not clear to me what you are maximizing. If every student made up and answered their own question, grading would take substantially more time and effort. Rewarding that behavior would increase the instructor’s expenditure of effort. To what end? If grading time is costless, sure, then ask students to make up a laborious question and answer it to prove their worth. But grading time is not costless, and it substitutes for time in office hours, time spent preparing lectures, etc.

By: michael costello (@mcmc)

michael costello (@mcmc) — Mon, 08 Oct 2012 10:33:16 +0000

I think you are underweighting the strategic elements here. On a five question test, why would the student not prepare five stellar answers, rather than prepare for an infinitude of possible answers? Better to have an open book exam with truly inspired questions.