Electronic Exam-system: Teacher´s instructions

Automatic evaluation can be used in general and personal exams where every question is a multiple choice, statement questions or fill-in questions (for more information, see the instructions for different question types).

To turn on the automatic evaluation process, go to the page titled Publish. See the instructions on the publication settings for exams that are to be evaluated automatically.

N.B.! Use Firefox or Chrome as your browser

With an automatically evaluated exam, all student submissions can be found under the  “ Waiting for final assessment” section on your dashboard:

and on the “Assessed submissions” list in the Submissions view:

• Students will be notified about the assessment automatically by email if you have selected this option in the exam’s settings (see the publication settings for exams that are to be evaluated automatically), and the students will be able to view the preliminary assessment on their dashboard. The information about the automatically evaluated exam includes the notice “Your submission has been evaluated automatically”.
• You can change how exams are to be automatically evaluated and what type of feedback is provided to students. Students can be provided with feedback only on a per-exam basis, and not e.g. jointly with every student who completed the exam.
• With automatically evaluated exams, select “Lock and inform the student” to lock their submission and move it to the “Locked exam submissions” list. The student will be sent another message in the same way as they would be with manually-evaluated exams. The student will be able to see the exam’s assessment, total score and the teacher's feedback.

If a specific number of submission attempts has been set for an exam before assessment and the student has maxed out their submission attempts, a new opportunity to take the exam will be opened only after the submission has been locked, i.e. after the “Lock the selected assignments and inform students” button has been pressed.

Transferring the study attainment to the register: The whole course grade will be transferred from Exam to the register after locking the assessment. The assessments of partial course grades always need to be delivered to the register manually. See more 4.1.1. Generally about assessing exams.

To generate an Excel file containing the list of locked results, select the "Create an Excel file from the selected results” option below the list  "Create report (.xlsx)".

You can quickly grade a large number of exams by using just one view. The option for speed grading is only available to the examiner (the responsible teacher for the exam).

Speed grading can only be used to award the final grade to submissions in the “Submissions in the assessment process” list, and it cannot be used to score individual questions. Speed grading is not limited to just exams that contain questions that are assessed automatically, and the teacher is responsible for reading each individual answer.

Suitable for e.g.

• exams that are assessed individually, if you want to give the final grade by using one view
• multiple choice exams that do not use automatic evaluation
• submissions that have been assessed outside the EXAM system

N.B.! Use Firefox or Chrome as your browser

1. To access the speed grading function, select “Speed grading” in the “Submissions in the assessment process” view.

The total score displays the scores for every question that has been assessed so far.  Please note! Remember to check whether your exam includes any essay questions. Essays must be assessed in the exam, after which their scores will be displayed in the speed grading view.

2. Select the grade and write your feedback by clicking on “Edit”.

3. After you have given your grade, the submission will be moved to the “Assessed submissions” list. Here, you can still edit your assessment by clicking on the student’s name.

4. Finally, lock the assessed submissions in the list and inform the students. 

• The students will receive a message on the completion of the assessment and will be able to register for a retake if they wish to do so.
• Transferring the study attainment to the register:  Study attainments transfer to the register and the whole course grade will be transferred from Exam to the register after locking the assessment. See more 4.1.1. Generally about assessing exams.
• The assessments of partial course grades always need to be delivered to the register manually.

Speed grading using a CSV file:

1.  Open the speed grading view

2. After the list of persons, click on the “Create a CSV template for importing the grades” link. While the file includes student information to assist you with the grading process, only the grades and feedback will be imported

3. Open the file in Excel and select the first column. The data is separated by commas.

4. Arrange the data into columns by selecting Data > Text to Columns in Excel.

5. In the window that opens, select Delimited and continue by clicking on Next.

6. Select that the data is separated by commas and continue by clicking on Next.

7. Confirm by clicking on Finish.

8. Add your grades to the “grade” column and feedback to the “feedback” column.

9. Save your file as a CSV file

Continue

You do not need to make every assessment in one session. Save the file to continue your work at a later date.

Importing a CSV file into the EXAM system:

1.  Open the speed grading view
2. After the list of persons, click on the “Import grades from CSV file” link.
3. Select the CSV file containing the grades and/or assessments from your computer.
4. Save your assessments.

N.B.! Use Firefox or Chrome as your browser

In the assessment by questions view, you can assess essay answers by question instead of using the exam view. Examiners and evaluators have different privileges when assessing individual questions.

To access the assessment by questions view, go to the “Study attainments by questions” page. The list displays every essay question in the exam (including any questions that may have been removed from the exam during the exam's lifespan).  The number above the question tells how many answers there are to this question and how many of those answers have been assessed.

For example, means that 4 out of 7 answers in total have been assessed. If there is a green check mark in front of the question, every question has already been assessed.

This view allows you to select the questions that you want to assess. After selecting the questions, click on the “Assess the chosen questions” button.

The assessment status of a question can be Assessed, Unassessed or Locked.

In the assessment by questions view, the answers to the questions you have chosen are divided into the following tabs: Unassessed exams, Assessed exams and Locked (which means that the answer is in an exam that has been locked).

• Questions that are marked as Unassessed can be assessed by Examiners and Evaluators.
• The assessments of questions that have been marked as Assessed can be modified by both Examiners and Evaluators if the exam has not been given a grade. When an exam has been given a grade (status is Assessed), the assessments of any individual questions can only be changed by the Examiner.
• The assessments of questions that are located in the Locked tab cannot be modified, since the questions belong to exams that have been locked.

After assessing the question (entering the number of points), you can move the question to the list of assessed questions, and this information is also added to the overall status displayed in the Question flow panel. When you have assessed every answer to a specific question, the question is moved to the Assessed section of the Question flow panel.

Please note! If the basic question has been changed after a student has answered it, a notice is shown about this in connection with the answer (i.e. that the question is not exactly the same as the question displayed in the top part of the page).

The Question flow panel on the right side of the page displays every question that has been selected for assessment as well as their assessment status, e.g. 3/7 means that 5 tasks have not been assessed. The list can be used to select the questions for the assessment view.

As an examiner, you can award grades and lock exams only in the exam-specific view (see “assessing a general exam”):

- Mark the exam's grade and save your changes. You can still change your assessment of the exam after this. If an exam has been graded but not locked, it is moved to the “Assessed submissions” list.

- When you are done assessing an exam, lock your assessment by selecting “Lock the assessment”. The EXAM system will remind you that “After marking the grade you will not be able to change the assessment”. To accept, select the Yes button.

• After the exam has been locked, the student in question will be sent an automatic email informing them that the assessment has been completed and that they will now be able to retake the exam. The student will be able to check their assessment in the system, but they will not be able to view their exam questions or the answers they submitted.
• Transferring the study attainment to the register:  Study attainments transfer to the register and the whole course grade will be transferred from Exam to the register after locking the assessment. See more 4.1.1. Generally about assessing exams.
• The assessments of partial course grades always need to be delivered to the register manually. To generate an Excel file containing the list of locked results, select the "Create an Excel file from the selected results” option below the list.

The examiner (responsible teacher for the exam) can add other teachers to an exam:

• Examiners are given the same rights as the responsible teacher who created the exam (editing and assessing the exam)
• Evaluators can assess questions, but cannot determine the total grade of an exam

You can see a list of examiners (in bold) and evaluators in the Examiners column on your dashboard.

Teachers that have been assigned as evaluators can see the exam after you have made it available for registration to students (publications). The exam is displayed in the “Active exams” list, where evaluators can see how many people have registered for the exam as well as any unassessed exams

You can check whether your evaluators are done with their assessments by looking at the “Assessment status” section on your dashboard: If an evaluator’s name is in green, they are done with their assessment, and if their name is in red, they have not yet finished their assessment.

You can save task-specific assessments and feedback to the submissions. If you save the grade of a submission before your evaluators have saved their assessments, they will not be able to continue making their assessments (the assessment will be locked). The system will remind you of this when you save a grade:

The EXAM system evaluates multiple choice questions automatically.

1. Open the submissions that you wish to assess by selecting the corresponding number on the Unassessed or Waiting for final assessment column:

• Open the student’s answer by selecting the student's name
• The beginning of the answer contains basic information on the exam, e.g. the exam’s period, duration and the student's other possible assessed submissions (date) for the exam in question
• If you want to print a student's answer, click on the Print button located at the top of the page.

2. The answers to fill-in questions are displayed below the question. Correct answers are marked with a green background and incorrect answers with a red background. The points received from the question are displayed below the answer.

• To hide an answer, click on the arrow that is displayed alongside the question

If you want to change points in Fill-in exercise, you can edit points under the answer:

   When you change points, points will be change to the answers points and to the exam total score.

If you use automatic evaluation in exam, you have to change also change total grade (only total score change automatically)

3. Give feedback on the exam in the Give feedback to the student window

• Your feedback will be visible to every evaluator included in the exam and the student

4. If your exam is not set to be evaluated automatically (for more information, see automatically evaluated exams), select the exam’s grade from the menu. Check that the exam type, language and number of study points are correct. Save your assessment as incomplete to continue your assessment at a later date. All assessments that have been saved as incomplete can be found in the “Assessed submissions” list.

5. When you have finished your assessment, lock the assessment by selecting the Lock the assessment and inform the student button. After you have locked your assessment, the student will be emailed about the assessment.

• You can also lock several assessments that have been saved as incomplete in one go in the “Assessed submissions” list. Tick the boxes next to the exams that you want to select and then click on the Lock the selected assignments and inform students button:

If the exam is a whole course grade, the grade will be transferred from Exam to the Study Register. See more 4.1.1. Generally about assessing exams. The assessments of partial course grades need to be delivered to the register manually.

The EXAM system evaluates multiple choice questions automatically.

In the exam assessment view

1. Open the submissions that you wish to assess by selecting the corresponding number on the Unassessed or Waiting for final assessment column:

• Open the student’s answer by selecting the student's name
• The beginning of the answer contains basic information on the exam, e.g. the exam’s period, duration and the student's other possible assessed submissions (date) for the exam in question
• If you want to print a student's answer, click on the Print button located at the top of the page.

2. . You will see the question (correct answer marked with a green check mark), the student's answers and on the right the points that the student has received for their answer

• the student's correct answer is marked with a green border and incorrect answer with a red border
• to hide an answer, click on the arrow that is displayed alongside the question

Example 1. The student has selected the correct answer and received 1/1 points.

Example 2. The student has selected an incorrect answer and received 0/1 points.

If you want to change points in multiple choice questions, you can edit points under the answer:

   When you change points, points will be change to the answers points and to the exam total score.

If you use automatic evaluation in exam, you have to change also change total grade (only total score change automatically).

3. Give feedback on the exam in the Give feedback to the student window

• Your feedback will be visible to every evaluator included in the exam and the student

4. If your exam is not set to be evaluated automatically (for more information, see the automatically evaluated exams tab), select the exam’s grade from the menu. Check that the exam type, language and number of study points are correct.

• Save your assessment as incomplete to continue your assessment at a later date. All assessments that have been saved as incomplete can be found in the “Assessed submissions” list.

5. When you have finished your assessment, lock the assessment by selecting the Lock the selected assignments and inform students button. After you have locked your assessment, the student will be emailed about the assessment.

• You can also lock several assessments that have been saved as incomplete in one go in the “Assessed submissions” list. Tick the boxes next to the exams that you want to select and then click on the Lock the assignment and inform the student button:

If the exam is a whole course grade, the grade will be transferred from Exam to the Study Register. See more 4.1.1. Generally about assessing exams. The assessments of partial course grades need to be delivered to the register manually.

The EXAM system evaluates multiple choice questions automatically.

In the exam assessment view:

1. Open the submissions that you wish to assess by selecting the corresponding number on the Unassessed or Waiting for final assessment column:

• Open the student’s answer by selecting the student's name
• The beginning of the answer contains basic information on the exam, e.g. the exam’s period, duration and the student's other possible assessed submissions (date) for the exam in question
• If you want to print a student's answer, click on the Print- button located at the top of the page

2. You will see the question (correct choices marked with a green check mark), the student's answers and on the right the points that the student has received for their answer

• The student's correct answers are marked with a green border and incorrect answers with a red border. Next to each option is the number of points that the student received from their answer.
• If you have set a negative score for an answer, these points are displayed in red
• If the total number of points in a student's answer is negative, the EXAM system will count their total score as 0, i.e. the student cannot receive negative points from a question.
• To hide an answer, click on the arrow that is displayed alongside the question

Example 1. The question contains three correct options, and one incorrect choice will “negate” one correct choice. The student has selected the three highlighted options: two correct (1 point for each) and one incorrect (-1 point). The student thus receives 1/3 points for this answer:

Example 2.  Two correct options, one incorrect choice negates the correct choices. The student has selected the highlighted options: one correct (1 point) and one incorrect (-2 points). Since the one incorrect choice negates the correct ones, the student receives 0/2 points, as the total score for an answer cannot go below zero.

Example 3. Two correct options, one incorrect choice “negates” one correct choice. The student has selected 1 correct answer (marked with a green border) and receives 1 point. In addition to this, the student has also selected 2 incorrect answers (marked with red borders), each worth -1 point. The student receives 0/2 points, as the total score for an answer cannot go below zero.

If you want to change points in multiple choice questions, you can edit points under the answer:

        When you change points, points will be change to the answers points and to the exam total score.

If you use automatic evaluation in exam, you have to change also change total grade (only total score change automatically)

3. Give feedback on the exam in the Give feedback to the student window

• Your feedback will be visible to every evaluator included in the exam and the student

4.  If your exam is not set to be evaluated automatically (for more information, see the automatically evaluated exams tab), select the exam’s grade from the menu. Check that the exam type, language and number of study points are correct. Save your assessment as incomplete to continue your assessment at a later date. All assessments that have been saved as incomplete can be found in the “Assessed submissions” list.

5. When you have finished your assessment, lock the assessment by selecting the Lock the selected assignments and inform students button. After you have locked your assessment, the student will be emailed about the assessment.

• You can also lock several assessments that have been saved as incomplete in one go in the “Assessed submissions” list. Tick the boxes next to the exams that you want to select and then click on the Lock the assignment and inform the student button:

If the exam is a whole course grade, the grade will be transferred from Exam to the Study Register. See more 4.1.1. Generally about assessing exams. The assessments of partial course grades need to be delivered to the register manually.