Order Exercises

Minimum version

In this type of exercise, the candidate has to bring a list of items in the correct order. A template is automatically created when you initiate an rqti project through RStudio. Alternatively, it can be added by clicking on New file -> R Markdown -> From Template. The rqti templates start with rqti: Here we look at the templates rqti: order (simple) and rqti: order (complex).

The minimum you need to provide is the type: order in the yaml-section and a list with at least two elements in a section called #question:

---
type: order
knit: rqti::render_qtijs
---

# question

What is the structure of an exam in QTI terms, starting from the top (the exam) to the bottom (individual questions).

- test
- section
- item
- interaction

# feedback

For order exercises it is usually clear why the given order is correct, but you might still want to provide a detailed feedback.

Knitting via the Knit-Button to qtijs, this exercise renders as:

Alternatively, change the knit parameter to knit: render_opal (see API Opal) to upload to Opal directly, producing:

The order of the items in the Rmd-list is considered to be the correct one.

Note that in this example, a feedback section was provided. The feedback is optional, but usually it is a good idea to give some explanation for students.

More control

If you want to have more fine-grained control, consider the Rmd template rqti: order (complex), which uses more yaml attributes.

---
type: order
knit: rqti::render_qtijs
identifier: order001 # think twice about this id for later data analysis!
title: A meaningful title that can be displayed in the LMS
# defines the scoring method, `false` means the correct order must be restored 
# completely by the candidate in order to get points
points_per_answer: false 
points: 2
---

# question

What is the structure of an exam in QTI terms, starting from the top (the exam) to the bottom (individual questions).

- test
- section
- item
- interaction

# feedback

For order exercises it is usually clear why the given order is correct, but you might still want to provide a detailed feedback.

<!-- If you prefer specific feedback for correct and incorrect solution, delete the general feedback section and uncomment everything starting from this line:

# feedback+

Nice. (Only displayed when the solution is correct.)

# feedback-

Try again. (Only displayed if the solution is not correct.)
-->

Which on Opal renders as:

yaml attributes

type

Has to be order.

identifier

This is the ID of the exercise, useful for later data analysis of results. The default is the file name. If you are doing extensive data analysis later on it makes sense to specify a meaningful identifier. In all other cases, the file name should be fine.

title

Title of the exercise. Can be displayed to students depending on the learning management system settings. Default is the file name.

points

How many points are given for the whole exercise. Default is \(0.25n\), where \(n\) is the length of the list.

points_per_answer

Defines the scoring method. If true each selected answer will be scored individually (according to absolute position of the element in the list), if false the whole task will be scored and a single mistake leads to 0 points. Default is true.

Feedback

Feedback can be provided with the section

# feedback (general feedback, displayed every time, without conditions)
# feedback+ (only provided if student reaches all points)
# feedback- (only provided if student does not reach all points)

helpers

For more complex exercises the list of answers is sometimes available as a variable. In this case you can use the helper function mdlist to convert the vector into a markdown list:

order_list <- mdlist(c("Test", "Section", "Item", "Interaction"))
cat(order_list)
- Test
- Section
- Item
- Interaction

Some advice on order exercises

Typically, order exercises tend to emphasize memorization of procedural steps, a facet of knowledge that may not always be critically important. In practice, even professionals often rely on checklists or cheatsheets for such scenarios. Additionally, grading order exercises can be intricate since the absolute position of an item is often less crucial than its relative placement within a sequence. We advise to use order exercises with caution.

2024-05-08