Best vs. Correct Answer

These are some of the articles I found about the Correct versus Best Answer in creating multiple choice tests:

1. Title: Sometimes the Correct Answer is the Best Answer

from:  http://borntolearn.mslearn.net/btl/b/weblog/archive/2011/01/28/sometimes-the-correct-answer-is-the-best-answer.aspx

Within my organization (certification development), our focus this year is innovation in item types. Although we are exploring new item types (more on that in a future blog), we are also exploring how we can leverage our current item types in innovative ways. Take the old standby--the multiple choice (MC) item. This item type has been unfairly criticized--after all, it's used on the vast majority of exams for a reason, but I understand the perceptions that are driving this criticism. Complaints include: it's too easy to guess the correct answer; MC questions are not rigorous measures of skills; and they don't reflect real world experiences. So, the question is "how can we make MC questions more difficult to guess, increase their rigor, and make them a better reflection of real world experience?" One solution is to change the focus from selecting the "correct" answer to selecting the "best" answer. What's the difference? In a "correct" answer item, only one answer is correct; in a "best" answer item, more than one answer might solve the problem but there is one best solution.
Because we believe that truly qualified candidates, especially at the professional level, should know what the best solution is in situations where multiple good solutions exist or are possible, we have decided to incorporte "best answer" items into some of our exams. After all, how often do you encounter a situation where there is one and only one correct solution to the problem? Problems rarely have clear cut solutions. As a result, these items should be more real world than a correct answer question because they require the candidate to carefully consider the situation presented in the question, just as they would carefully consider their organizational environment and constraints when making decisions in their jobs, and determine the best solution given those circumstances. These questions require more critical thinking than correct answer items, which makes them more rigorous measures of skills and more difficult to guess.
So, let's cut to this chase. What does this mean to you?
We will be slowly adding best answer items to our exams over time, and I want to let you know what to expect:

• Best answer items will only appear on PRO level exams where being able to identify the best solution given a set of specific environmental characteristics or constraints is critical to planning, designing, and managing Microsoft technologies in organizations.
• The best answer will be the solution that takes the least effort, requires the fewest steps, and/or is least costly AND solves the problem. Remember with a best answer choice item, more than one answer will likely solve the problem (others might not), but one answer will be the best solution from a resource (budget, time, people) perspective in that particular situation.
• The best answer will be the best answer GIVEN THE SITUATION DESCRIBED IN THE QUESTION. It may not be how you would do it in your organization, but it's how it should be solved given the situation.
• At this time, only a small proportion of items on any exam will be best answer choice items; although this proportion is likely to increase over time, we are not to the point where every question on a particular exam will be a "best answer" question. Not all PRO exams have best answer questions yet, but we're working on it.
• You will know these items when you see them. The question statement will include words such as "best" or "most" (depending what is being asked) that make it clear that the question requires a deeper evaluation to determine the best answer. In addition, the following statement appears following the question: "(More than one answer choice may achieve the goal. Select the BEST answer.)"
• Most important, the best answer has been vetted by many SMEs who agreed on what the best answer is. The best answer isn't what Microsoft thinks is the best answer; the best answer is what many SMEs have agreed is the best answer.

I have to admit best answer questions are not innovative in and of themselves; you can find them on most certification and licensure exams, but they are new to Microsoft Learning. I know some of you won't like this change, but I believe that best answer questions have a place in our certification program and will ultimately increase the value of your certifications because of the higher level thinking required to answer these items correctly.

2. Subtitle: Misconceptions about Multiple-Choice Questions
from: http://www.maryvillecityschools.k12.tn.us/education/components/scrapbook/default.php?sectiondetailid=15540

• Multiple choice questions require you to choose the best answer, not the correct one.  All answers may be correct, or all may be incorrect; you are required to choose the best of these options.  Therefore, you should always read every answer before giving a response.

  Many students have heard that you should choose a constant response when guessing on multiple-choice questions and that the best response to guess is C.  This advice is misleading.  When you are forced to guess, always make a knowledge based guess.  If you know anything at all about the subject, use that knowledge to narrow down the possibilities or at least to arrive at a direct hunch.  Hunches are somewhat knowledge based, and they will beat the odds of giving a direct response.  However, if you have used all you know to narrow down the possibilities, and you still cannot decide between two or more choices, you should use your knowledge of probability.  On teacher made tests, choices toward the end of the list are generally more likely to be correct than the ones toward the beginning.  Therefore, if you absolutely cannot decide between A and C on your teacher's test, it's better to go with C.