I was in a discussion with my friend Avinandan Bose once. He had just returned from the mid-semester examination of an MTH course. The subject of our concern was the format of the examination - a rather unusual one for such a consequential test. The test had 5 True/False questions, with a +3 for a correct answer, a -2 for an incorrect answer, and a 0 for an unattempted question.
The curious marking scheme of this exam made one thing intuitively clear to both of us - if you don’t know the answer, making a guess should be better than not attempting the question. And so Bose exclaimed, “LMAO some students left the entire paper blank. They could have marked all the answers ‘True’ and still have a fair chance of a positive score!”
“But why all ‘True’? You could just mark all the answers according to your intuition and that should effectively be at least as good as random guessing”, I argued. Bose then asserted that random guessing may get you all your answers wrong, and the “all True / all False” method should be preferred. While Bose may have stated that impetuously, it did get both of us thinking.
My roommate Daljit gatecrashed the discussion and sided with Bose. However, after fiddling with pen and paper for some time, Bose yielded that “mathematically both the methods appear to have the same effect”. Obviously, the probability of getting all 5 answers incorrect in both the cases remains \( (0.5)^5 \).
Now consider this: If you had to answer all the questions in a set of 5 True/False type questions, there are 32 possible ways you could do this. While calculating our probability of \( (0.5)^5 = 0.03125\), we have assumed that all of these ways are equally likely to be the answer set that has all incorrect answers. Instinctively, this seems unrealistic.
If I were to set a question paper, I would try to maintain a balance between the number of True statements and the number of False statements. This idea is easier to visualize when there are more number of questions and more alternatives. Consider the JEE Main question paper : 90 questions, one correct option out of 4 alternatives (a), (b), (c) and (d). There is absolutely no way (realistically) that the answer to all the questions be (a). In fact, it is expected that the number of questions with (a) as the correct answer would be roughly a quarter of the total number of questions.
So when it comes to 5 True/False questions, it is not expected that all the answers be the same. And hence, marking all True / all False should have a better chance at not getting all the answers wrong, than randomly marking the answers. This needs a better mathematical analysis, but Bose got AIR 104 in JEE Advanced and so his advice regarding examinations should not be taken lightly.
Nevertheless, the marking scheme of the examination was such that would promote guessing. And this can be proven with some quick mathematics. Consider any examination where you have to select one out of \(N\) options. You get \(x\) points when you correctly answer a question, \(-y\) points when you incorrectly answer a question, and zero for not attempting the the question. Thus, if you randonly guess an answer, the probabilty that you get it correct is \(\frac{1}{N}\). If you’re making a random guess for \(Q\) questions, then the total expected score due guessing would be : $$ \begin{array}{r l} & Q[\frac{1}{N}x + (1-\frac{1}{N})(-y)] \\\\ = & \frac{Q}{N}[x - (N-1)y] \end{array} $$ For an examination where random guessing should not make any difference, the expected score due to guessing should be equal to zero. With this condition, we can solve for \(y\).
$$ \begin{array}{r c l} \frac{Q}{N}[x - (N-1)y] & = & 0 \\\\ x - (N-1)y & = & 0 \\\\ \frac{x}{N-1} & = & y \end{array} $$ Therefore, in an ideal 1-out-of-N examination, the penalty for an incorrect answer should be \(-\frac{x}{N-1}\).
To compare, Bose’s examination had a penatly of -2 instead of the ideal -3 (\(x=3, N=2\)), which implies that random guessing could leave one better off. JEE Main has a penalty of -1, but ideally it should have a penalty of -\(\frac{4}{3}\) (\(x=4, N=4\)). This is why I have always promoted guessing in JEE Main. I myself did that, and got a +7 in my score due to it.
I’ve always been a proponent of guessing, wherever the situation promotes it. And this comes in handy during quizzes. Almost all the time, you don’t know the exact answer for a question. It is all about working over the hints that the quizmaster subtly drops and making an educated guess.
I remember when we went to participate in the Farida Abraham Memorial National Quiz in the La Martiniere Girls’ College, I didn’t know the answer to any of the questions in the preliminary round. We still qualified for the finals just by making educated guesses. Ask any quizzer and they would recall a similar story.
Guesswork lies at the heart of quizzing. And it is the job of a good quizmaster to drop enough hints, and smart hints, such that the teams try to guess reasonable answers. Even if the answer is incorrect, a “good guess” from the quizmaster is a satisfactory consolation prize.
Oh, and we have made such progress on guessing that we have an entirely new field where computers are trained to guess “values”. Yes I’m talking about Machine Learning. This reminds me that I have to brush up my ML. Goodbye!