1. Drew S. Student perceptions of what helps them learn and develop in higher education. Teaching Higher Educ. 2001;6(3):309–331.
2. Scouller K. The influence of assessment method on students’ learning approaches: multiple-choice question examination versus assignment essay. Higher Educ. 1998;35:453–472.
3. Struyven K, Dochy F, Janssens S. Students’ perceptions about evaluation and assessment in higher education: a review. Assess Evaluation Higher Educ. 2005;30(4):325–341.
4. Trigwell K, Prosser M. Improving the quality of student learning: the influence of learning context and student approaches to learning on learning outcomes. Higher Educ. 1991;22:251–266.
5. Biggs J. Teaching for Quality Learning at University. Philadelphia: The Society for Research into Higher Education & Open University Press; 2003.
6. Reid WA, Duvall E, Evans P. Relationship between assessment results and approaches to learning and studying in Year Two medical students. Med Educ. 2007;41:754–762.[PubMed]
7. Abdel-Hameed AA, Al-Faris EA, Alorainy IA. The criteria and analysis of good multiple choice questions in a health professional setting. Saudi Med J. 2005;26(10):1505–1510.[PubMed]
8. Case S, Swanson D. Constructing written test questions for the basic and clinical sciences. Philadelphia: National Board of Medical Examiners; 2003.
9. Tarrant M, Ware JA. Framework for improving the quality of multiple-choice Assessments. Nurse Educator. 2012;37(3):98–104. doi: 10.1097/NNE.0b013e31825041d0. [PubMed]
10. Pepple DJ, Laurine YE, Carroll RG. A comparison of student performance in multiple-choice and long essay questions in the MBBS stage I physiology examination at the University of the West Indies (Mona Campus) Adv Physiol Educ. 2010;34(2):86–89. doi: 10.1152/advan.00087.2009. [PubMed]
11. Oyebola DO, Adewoye OE, Iyaniwura J O, Alada RA, Fasanmade AA, Raji YA. Comparative study of students’ performance in preclinical physiology assessed by multiple choice and short essay questions. Afr J Med Sci. 2000;29:201–205.[PubMed]
12. Epstein MR. Assessment in Medical Education. N Engl J Med. 2007;356:387–396.[PubMed]
13. Buckwalter JA, Schumacher R, Albright JP. Use of an educational taxonomy for evaluation of cognitive performance. J Med Educ. 1981;56:115–121.[PubMed]
14. Bloom B, Englehart M, Furst E. Taxonomy of educational objectives: The classification of educational goals. Handbook I: Cognitive domain. New York, Toronto: Longmans; 1956.
15. Haladyna TM, Downing SM, Rodriguez MC. A review of multiple-choice item writing guidelines. Applied Meas Educ. 2002;15:309–333.
16. Tarrant M, Ware J. Impact of item-writing flaws in multiple choice questions on student achievement in high-stakes nursing assessments. Med Educ. 2008;42:198–206. doi: 10.1111/j.1365-2923.2007.02957. [PubMed]
17. Khan MZ, Aljarallah BM. MEQs and MCQ as a tool for assessing the cognitive skills of undergraduate medical students. Int J Heal Sci. 2011;5(1):45–50.[PMC free article][PubMed]
18. Jozefowicz RF, Koeppen BM, Case S. The quality of in-house medical school examinations. Acad Med. 2002;77(2):156–161.[PubMed]
19. Mukhopadhyay M, Bhowmick M, Chakraborty S. Evaluation of MCQs for judgment of higher levels of cognitive learning. Gomal J Med Sci. 2010;8(2):112–116.
20. Palmer EJ, Devitt PG. Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions? BMC Med Educ. 2007;7:49.[PMC free article][PubMed]
21. Downing SM. The effects of violating standard item writing principles on tests and students: the consequences of using flawed test items on achievement examinations in medical education. Adv Health Sci Educ. 2005;10(2):133–143.[PubMed]
22. Downing SM. Construct-irrelevant variance and flawed test questions: do multiple-choice item-writing principles make any difference? . Acad Med. 2002;77(Supll):103–104.[PubMed]
23. Al Muhaidib NS. Types of Item-Writing Flaws in Multiple Choice Question Pattern- A comparative study. J Educ Psychol Sci. 2010;2(2):9–45.
24. Downing SM. Twelve steps for effective test development. In: Downing SM, Haladyna TM, editors. Handbook of test development. Mahwah NJ. Lawrence Erlbaum Associates Publishers; 2006. pp. 3–25.
25. Tarrant M, Knierim A, Hayes SK. The frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments. Nurse Educ Pract. 2006;6:354–363.[PubMed]
Charles Champlin (2006), a journalist for Time and Life magazines, describes his experience of taking essay tests as a student at Harvard:
“The worst were the essay questions (which seemed only distantly related to whatever you’d read or heard in lectures). They made a statement and then simply said, ‘Discuss.’ O terrifying word, ‘Discuss.’ Nothing so simple as tossing in a few facts retained from all-night cramming. It was meaning that was sought – which was, as I’d already begun to appreciate, the way it should be. But it was a strained step up from the exams I’d known before, when memory, regurgitated, would get you around almost any corner.”
Champlin’s reminiscence reveals some of the strengths and dangers associated with essay questions. They are a wonderful way to test higher-level learning, but they require careful construction to maximize their assessment effectiveness.
I. Strengths Associated with Essay Examinations
Among the strengths of essay examinations, faculty who use them find they are a valuable means to measure higher-order learning and a wonderful way, when scored properly, to further student learning. Given these strengths, essay tests require careful preparation and scoring.
1. Essay Questions Test Higher-Level Learning Objectives
Unlike objective test items that are ideally suited for testing students’ broad knowledge of course content in a relatively short amount of time, essay questions are best suited for testing higher-level learning. By nature, they require longer time for students to think, organize and compose their answers.
In the table below, appropriate testing strategies are associated with Bloom’s hierarchy of learning. The action verbs under each domain illustrate the kinds of activities that a test item might assess. Use the verbs when constructing your essay questions so that students know what you expect as they write. While essay questions can assess all the cognitive domains, most educators suggest that due to the time required to answer them, essay questions should not be used if the same material can be assessed through a multiple-choice or objective item. Reserve your use of essay questions for testing higher-level learning that requires students to synthesize or evaluate information.
2. Essay Questions When Scored Properly Can Further Learning
Teachers score essay exams by either the holistic approach or the analytic approach.
The holistic approach involves the teacher reading all the responses to a given essay question and assigning a grade based on the overall quality of the response. Some teachers use a holistic approach by ranking students’ answers into groups of best answers, average answers and poor answers and subdividing the groups to assign grades.
Holistic scoring works best for essay questions that are open-ended and can produce a variety of acceptable answers.
Analytic scoring involves reading the essays for the essential parts of an ideal answer. In this case, you will need to make a list of the major elements that students should include in an answer. You will grade the essays based on how well students’ answers match the components of the model answer.
Whichever method, holistic or analytic, that you use to score the exam, you should write comments on the students’ papers to enhance their learning. Your comments will help students write better essays for future classes and reinforce what students know and need to learn. Your comments are also a good reminder for yourself if students come to you with questions about their grades.
II. Dangers to Consider When Giving and Grading Essay Examinations
1. Establish limits within the essay question
The example of Charles Champlin’s experience at Harvard where his teachers gave a statement and then simply said, ‘Discuss,’ shows a danger in using essay questions. Instructors should build limits into questions in order to save needless writing due to vague questions: “With some essay questions, students can feel like they have an infinite supply of lead to write a response on an indefinite number of pages about whatever they feel happy to write about. This can happen when the essay question is vague or open to numerous interpretations. Remember that effective essay questions provide students with an indication of the types of thinking and content to use in responding to the essay question” (Reiner, 2002).
Another good way to prevent students from spending excessive time on essays is to give them testing instructions on how long they should spend on test items. McKeachie (2002) gives the following advice: “As a rule of thumb I allow about 1 minute per item for multiple-choice or fill-in-the-blank items, 2 minutes per short-answer question requiring more than a sentence answer, 10 to 15 minutes for a limited essay question, and half-hour to an hour for a broader question requiring more than a page or two to answer.”
2. Remember that essays require more time to score
While essay exams are quicker to prepare than multiple-choice exams, essay exams take much longer to score. You should plan sufficient time for scoring the essays to prevent finding yourself crunched to report final grades.
3. Avoid scoring prejudices
Essay exams are subject to scoring prejudices. Reading all of an individual’s essays at the same time can cause either a positive or a negative bias on the part of the reader. If a student’s first essay is strong, the examiner might read the student’s remaining essays with a predisposition that they are also going to be strong. The reverse is also true. To prevent this scoring prejudice, educators suggest reading all the answers to a single essay question at one time.
Champlin, C. (2006). A life in writing: the story of an American journalist. Syracuse: Syracuse University.
McKeachie, W. (2002). McKeachie’s teaching tips (11th. ed.) New York: Houghton Mifflin.
Reiner, C., Bothell, T., Sudweeks, R., & Wood, B. (2002). Preparing effective essay questions. (http://testing.byu.edu/info/handbooks/WritingEffectiveEssayQuestions.pdf).