Hybrid Examination with automated Grading by Moodle Question Type STACK

Close Icon
These competencies are explicitly fostered and described in Competence View.
These competencies are fostered in this course but are not explicitly described in Competence View. Please contact the responsible person for further information. Competencies in grey are fostered in this course but are generally not the focus of Competence View, which focusses on cross-disciplinary competencies.

During the summer session, more than 200 engineering students sit their final four-hour examination for the courses Analysis I and II. To support their preparation, students complete short weekly exercises ‘quick exercises’ throughout the autumn and spring semesters, along with a midterm at the beginning of the spring semester.

The Moodle question type STACK is the central feature of the assessment methodology in these courses. STACK is a powerful tool integrated into Moodle that allows for the creation and automated grading of mathematical questions. It uses a computer algebra system to evaluate students’ answers, enabling dynamic question generation and immediate, tailored feedback to the students.

All Course Assessments over two Semesters

Overview of the Course

What is the subject context of the course?

The courses Analysis I and Analysis II for engineers are set in the context of one-dimensional and multi-dimensional differential calculus, including vector analysis and ordinary differential equations.

What should students learn and be able to do at the end of the course? 

By the end of the course, students should have developed analytical and mathematical reasoning skills, along with effective problem-solving strategies. They are expected to master core mathematical techniques and think conceptually within a mathematical framework — for example, using spatial visualization. A strong emphasis is placed on real-world applications as the course is designed for future engineers rather than mathematicians.

Why was the specific assessment format chosen? 

The decision to introduce this assessment methodology was prompted by the abolition of certificates of attendance. This change created the need for an alternative way to keep students actively engaged throughout the semester. Initially, a multiple-choice midterm was introduced; however, since it was offered only once per year, it did not provide sufficient support or continuity. With weekly ‘quick exercises’, the midterm and, above all, thanks to the Moodle question type STACK with its automated feedback, we can now offer this.

How are students prepared for the assessment? 

The preparations for the final examination include a midterm and ‘quick exercises’ with detailed feedback and bonus functions:

  • The midterm takes place in the second week of the spring semester.
  • The short weekly ‘quick exercises’ are carried out on site and are supervised.
  • Moodle quizzes with STACK questions are always available to students and can be repeated as often as they like.
  • Students receive open-ended tasks to be completed on paper, submitted via Moodle and corrected by student teaching assistants. However, very few students take advantage of this option. We assume that worked solutions are circulating among the students.

Course Description

Fact Sheet

Resources

Grading and Feedback

Staff Workload (200 Candidates)

Time Staff Investment
Creating STACK Questions 6 - 8 h per Question Professor
Support STACK 30 % Administrative-technical Employee
Administration and Coordination 1 - 2 d per Week Doctoral Student (Administrator)
Midterm: Exam 2.5 h (Exam: 90 min) Professor
4 - 5 Student Teaching Assistants
Midterm: Grading 1 d Professor
2 d Administrative-technical Employee
Session Examination: Exam 5 - 6 h (Exam: 4 h) Professor
5 Doctoral and Master Students
Session Examination: Grading for Paper-Based Part 100 h (30 min per Attempt) Doctoral and Master Students
1 d Professor
Session Examination: Grading for Moodle Part 1 d Professor
2 d Administrative-technical Employee

Extra Information

  • Creating STACK Questions
    You will probably need 6 – 8 h per question at the beginning. With time, you will become significantly faster, and it also depends greatly on whether it is a large or small STACK question.
    This is a year-round task that involves continuously collecting ideas and reusing existing questions. Questions are drawn from past examinations and exercises, revised as needed, and then reintegrated into new assessments — forming a continuous cycle.
    In addition, questions are sometimes exchanged between universities, allowing for collaboration and the sharing of high-quality content across institutions.
  • Support STACK and Administration and Coordination
    The administrative-technical employee (responsible for the technical part of STACK questions) and the doctoral student with administrative functions (responsible for the Moodle course and quizzes and the exam coordination) are involved in all steps of the process and grading of the assessments. They are not listed separately in the detailed steps.
    For the bonus system, they organize the short weekly ‘quick exercises’ together, with each exercise requiring approximately 4 hours of work for both of them.

Shared Experience

How many times has the assessment been conducted in this format?

So far, three midterms and four session examinations have been conducted using STACK.

What contributed to the success?

The success is based on several factors:

  • In the first week of the semester, students complete a syntax quiz with STACK so that they can familiarize themselves with how STACK works.
  • The integration of Moodle and the STACK question type enables the digitization of a large portion of the course’s learning activities, especially the exercises.
  • A key advantage of this system is that students can receive immediate feedback at any time, which is essential for effective formative assessment.
  • The ‘quick exercises’ are essential for students to keep up with the course content and encourage continuous engagement.
  • Clear logistics and communication are crucial. It is important to avoid overwhelming students with too much information, while still providing all necessary details clearly and on time.
  • Equally important is getting the entire teaching team on board and ensuring that everyone supports the approach being taken.

What were the challenges and how were they overcome?

Several challenges had to be addressed, including the creation of well-functioning tasks, dealing with frequent Moodle updates, and managing the parallel use of different platforms — specifically Course Moodle and Exam Moodle.

A committed team, combined with strong backing from the Rectorate, EduIT, and UTL, played a significant role in the successful implementation.

What further developments are planned?

The planned developments include the integration of generative AI into question formats, although this initiative is still in its early stages.

Another key objective is to expand the use of STACK to additional departments across the institution.

What tips would you give lecturers who are planning a similar assessment?

Take it step by step. Start by using STACK for individual questions and formative exercises in the Course Moodle rather than jumping straight into a full examination with complex STACK tasks. This allows both lecturers and students to gradually become familiar with the tool and its possibilities.

It’s also crucial to ensure alignment between the exercises the students work on during the semester and the final examination. Students should know what to expect — the exam format should reflect the types of questions and difficulty levels they have encountered in the course.

We regularly organize beginners’ workshops on STACK. You can sign up individually or as a group at stack@math.ethz.ch.

Ten or twenty years ago, assessing large cohorts of students was only possible with multiple-choice questions. Now, with tools like STACK, we can ensure better question quality and provide valuable feedback opportunities. - It takes time to get familiar with STACK, but it is worth it!
Prof. Dr. Meike Akveld

ETH Competence Framework

Subject-specific Competencies

  • Concepts and Theories
  • Techniques and Technologies

Method-specific Competencies

  • Problem-solving

Personal Competencies

  • Self-awareness and Self-reflection

Overview of the ETH Competence Framework

loading