Exams: Adding Questions
ADDING EXAM QUESTIONS
There are three types of questions you can add to an Exam. You can put as many as you like, of any kind, in any order.
If you set this exam as ‘Manually Scored’ in the Exam Settings (gear icon), you can add the Written Answer type questions.
You can create questions directly in the exam, or you can add existing questions from your Question Bank.
MULTIPLE CHOICE QUESTIONS
Minimum 2 possible answers (i.e.: True, False). No maximum possible answers. Question is blank web page and can contain any web content. Answers must be text only.
Answers will be randomized for Students. So, instead of “All of the above” use “All of these”. Or instead of “Both B and D” use the actual answers like “Both Temperature and Pressure”.
Click on the X for the correct answer to change that one to a check mark and set it as the correct answer.
MOST IMPORANTLY OUR SYSTEM DOES RANDOMIZE ANSWERS WITH MULTIPLE CHOICE QUESTIONS ON ALL EXAMS
- It prevents the students from cheating
- It promotes making the students understand the material by forcing them to review content (Via reference pages)
- It reduces liability and complacency on your end if you are ever get audited by Transport Canada
HOTSPOT IMAGE QUESTIONS
Student clicks on a specific part of an image to answer the question. Multiple choice - min 2 possible answers, no max.
Example "Q: Point to and click on the instrument which indicates battery voltage”. There is a photo of an instrument panel with 4 instruments on it. Student must click on the correct instrument to get question correct).
When you create new Hotspot question, it will ask for you to select an image.
For each answer, click inside the answer box and give the answer a name (i.e.: “Volt Meter”), then you will see a hotspot selection area on the image. Drag it to the correct area and drag edges or corners to fit it to the proper area.
You can also give a ‘hint’ which will pop up if Student hovers over a hotspot for couple seconds.
RANDOM QUESTIONS
WRITTEN ANSWER QUESTIONS
SETUP:
1. You must assign an Instructor to the module.
1.a. Make sure you have at least one Staff level user with the Instructor role (token) assigned to them. In Registrar, click People tab, then Staff. At top right, click on the ‘Filter by Role’ menu and select Instructor to see a list of who has that role. To assign the role to someone, in that Staff list, click on the person’s Actions menu and select Manage Roles.
1.b. In the Module Settings, assign one or more instructor(s) to the module. (If you do not see any Instructors available in the place where you assign them to the module it is because you do not have the Instructor role (token) assigned to anyone, so see 1.a. above).
2. In Training Developer, with the module open in Edit mode, create a new Exam page, then go into the Exam Settings (gear icon) and turn ON “Manually Scored”. READ the info bubble (i) for the IMPORTANT notice. Note that this change is permanent for this exam.
3. When adding questions, in addition to the regular Multiple Choice and HotSpot type questions, you will now have the option of adding ‘Written Response’ type question. Just enter the question, same as you do for other types of questions. You can insert images, video, etc. into the question. BUT, you do not enter any answers. When done authoring the question, just Save the question. OR use the Auto Marking feature.
4. Auto Marking: If you turn this ON in a question, you will then see a setting for Minimum Required Phrases.
MANUALLY SCORED WRITTEN ANSWER QUESTIONS (WAQ)
In the Exam Editor, click the “+” Add Question button and select “Written Answer” from the menu.
In the content editor, enter your question. Just like elsewhere in this system, the question is a blank web page and contain anything you like including images, video, sound, tables, etc.
Once your question is written, you can then click the Save button to save this question and you are done.
Example:
Q: What is important to remember when approaching an unmarked intersection?
A: [Student can write whatever they want. Instructor will read the response and decide if it is good enough to warrant being marked as correct].
AUTOMATICALLY MARKED WRITTEN ANSWER QUESTIONS (AutoWAQ)
Enter certain “Target Phrase(s)” the system will look for in the student’s written answer. A ‘Target Phrase’ can consist of one or more words (numbers OK too).
Target Phrase WAQ:
- The system looks for specific word(s) or phrase(s) in the students’ written answer. Technically, a single word is considered a ‘phrase’ in this case.
Example:
Q: What is important to remember when approaching an unmarked intersection?
Target Phrases:
slow
reduce speed
brake
shoulder check
signal
right of way
yield
pedestrian
ongoing vehicle on right
If you entered a value of “3” in the ‘Minimum Required Phrases’, then as long as at least ANY 3 out of this list are in the student’s written answer, the system will mark the answer as Correct.
Example (target phrases are shown here underlined):
When approaching intersection you must slow down and check traffic for oncoming vehicles.
Required Phrase(s): (ReqWAQ)
There is a checkbox beside each Target Phrase. Every phrase you check here MUST be included in the student’s written phrase for the system to mark the answer as correct.
Example:
Q: What should you do when approaching an uncontrolled intersection?
Target Phrases:
[ ] slow
[ ] reduce speed
[x] brake
[ ] shoulder check
[ ] signal
[ ] right of way
[x]yield
[ ] pedestrian
[ ] ongoing
Min Required: 4
For this question to be correct, the student’s answer must contain ‘brake’ AND ‘yield’ AND two or more of the rest of the Target Phrases.
A: I should slow down and check for pedestrians. Also I need to yield to oncoming cars and shoulder check for cars on my right. (Target Phrases are underlined, Required Phrases are bold)
Note that if your exam contains only Automatically Marked questions, the instructor still must sign in, review the answers, and manually assign the exam mark. This is because of the possibility of student’s answers meeting the Target Phrase criteria but the answer still being incorrect.
Example:
I do not have to yield to pedestrians or oncoming cars if I am driving slow or have my signal on.
In this case, the auto marking would mark this as correct even though the answer is clearly incorrect when read by the instructor.
OPTIONAL WAYS OF MAKING WAQ QUESTIONS:
Fill in the blanks:
Q: Before putting the car in Drive, the driver must check that passengers are wearing their ________ and their ________ is closed.
Target Phrases:
seatbelt
door
Min. Number of Target Phrases: 5
Written List:
Q: Name the Continents. You must get 5 or more correct.
Target Phrases:
Africa
Antarctica
Asia
Australia
Africa
Europe
North America
South America
Min. Number of Target Phrases: 5
Video:
Q: Watch this video clip and then write what would be an acceptable response to the angry customer:
[insert video clip of employee talking to angry customer]
Target Phrases:
sorry
apologize
manager
improve
understand
you are correct
contact customer service
warranty void
voided warranty
Min. Number of Target Phrases: 3
Exact Match
Q: What is required to start a fire?
Target Phrases:
[x] Oxygen
[x] Fuel
[x] Ignition
([x] = Required Phrase)
OTHER QUESTION TYPES IN SAME EXAM:
You may enter as many other question types (Multiple Choice, HotSpot) as you like in any order you wish. When the Instructor views the exam for marking, the Multiple Choice and HotSpot questions will already be scored as correct or incorrect.
ADDING QUESTIONS TO QUESTION BANK
You can add both multiple choice and hotspot questions to the Question Bank when adding questions to an exam. At the bottom of the question editor, you need to toggle the "Add to Question Bank" toggle to ON, and then this question will be Automatically copied into the Question Bank. This works when editing questions as well. If you'd like to make sure the question goes into a category within the Question Bank, you can use the category dropdown to select an existing category. You may also add any keywords that you may want to search this question by, by adding them to the appropriate input field.
EXAM QUESTIONS MANAGER
Training Developer role, Module opened in Edit mode, Exam page
In Training Developer, in the Exam editor there is now a new button for “Manage Questions”. Here you can drag-and-drop questions around easily, even on exams with hundreds of questions in them, and not lose your place. You can also delete multiple (or all) questions at one time. This could save you a lot of time if you are working on building larger exams.
