Evaluate and develop study programs - Education quality processes
For employees
Evaluate and develop study programs
Information about the process
The study programs at NTNU are planned, implemented, evaluated, and revised annually. On this page you will find information about the process used to evaluate and develop a study program.
The leader of the study programme has the main responsibility to ensure that the programme is evaluated and developed in accordance with NTNU’s joint provisions concerning this task. In addition, associated academic milieus have a collective responsibility to contribute to the work.
The students’ learning must be at the centre of the development, so feedback and voiced opinions from the students are essential during this process.
In addition to the annual programme evaluation, all study programmes are required to undergo a periodic evaluation at least every five years. You will find more information about this in the menu to the right.
The planning is based on the study plan as well as on evaluation reports and follow-up plans from previous implementations. These documents are available in KASPER or in the Study Quality Portal.
As a study program leader, you are during this phase required to:
- Plan meetings and matters for discussion in the Study Program Council, in collaboration with the secretary of the council.
- Propose potential members of the study program council, including external members
- Assess the possibilities for contacting relevant actors on the labor market.
- Establish contact with representatives from the student union for the study program in question.
- Plan for the implementation of measures and tasks that have resulted from periodical or annual evaluations.
- Carefully consider any meetings and discussions that will be necessary to ensure good collaboration at study program level, and plan how to execute these actions.
- Plan activities to develop the learning environment of the study program in collaboration with the study advisor, student union representatives etc.
See also NTNU’s wiki-page on how to manage study programs. On this site you will also find links to the mandate for the study program leader and council.
During the planning of the quality work for this implementation, relevant aspects to consider are:
- What are the goals for the implementation, and what would be a sensible level of ambition? As a starting point, you should use the evaluation from the previous evaluation, where development areas and measures have been identified.
- What kind of comprehension base do we need to assess the impact of the measures taken, and to evaluate the program in general? How do we reach this level of comprehension?
- How should we obtain evaluations from the students?
Key data for all the study programs are available in KASPER. Information about admission, implementation, exchange etc. are available in BEVISST.
You can find links to data and knowledge resources on the wiki Tools and resources.
During the academic year, the study program leader is required to:
- Prepare and carry out meetings in the study program council (in collaboration with the secretary of the council) and make sure that the meetings are summed up in writing.
- Discuss with student union representatives and teachers from the study program their experiences in terms of learning and learning environment.
- Gather necessary information or statistics if there are any areas that require closer examination during the evaluation of the program.
- Ensure that the leader, the academic community and the administrative support units all receive the information they need to establish a good organization and communication with the students.
- Ensure that planned improvement measures are implemented according to plan and that any changes are clearly communicated to the students.
The study program leader is responsible for evaluating the study program. The evaluation shall result in a development plan. Students, the academic community, and the study program council must all be involved in the evaluation process.
Study program evaluation is carried out n two cycles:
- Annual review
- Periodical review (at least every five years)
Annual program review
The annual evaluation is mainly concerned with the internal quality of the study program: Is the program adequately constructed for the students to achieve desired learning outcome?
Based on data and experience from the previous academic year, an assessment is conducted to discover any needs for improvements and to determine which aspects of the program should be kept. The faculties may also have their own focus areas that must be taken into consideration as basis for the evaluation. Through the evaluation, a foundation is laid for the further development of the program.
During the annual review, you as study program leader should:
- Assess previously implemented improvement measures and consider whether they have had the desired effect.
- Consider the obtained numbers and statistics for the study program (How has the program developed? What do the developments imply for the program?)
- Assess the academic surroundings of the study program courses. Relevant topics to consider are the size of the academic community in relation both to number of students and the nature of the subject, stability in terms of long-term competence, composition in light of course content (i.e. educational proficiency, senior competency, relevant research activities).
- Establish a follow-up plan for further development of the study program and document the evaluation by means of a report.
NTNU’s toolkit for education quality- KASPER should be used for the evaluation of study programs.
We are currently working on developing guidelines for reviews and for the development of study programs and courses. In the meantime, the “Guidelines for the design of study programs and courses at NTNU (the Study Plan Manager)” will be a useful support system.
The annual evaluation report of the study program forms the basis for the annual revision of the study plan. (See the phase “Change”). The report is also included in the knowledge base for periodical study program evaluation and for the faculties’ quality reports to the rector (Norwegian only).
The faculties will set a deadline for the program report.
Periodical program review
The periodical review aims to evaluate the study program in a strategic and more external perspective compared to the annual reviews. Is the description of the learning outcome relevant and updated?
More on periodical reviews of study programs is available in the right hand menu.
As study program leader, you are (in collaboration with the administration) required to review the study plan based on the changes that have been proposed through the evaluation and the follow-up plan for the program.
NTNU’s toolkit for education quality – KASPER should be used for this task. In KASPER you will be able to document any changes in the study plan as well as the background for the changes.
About revision of study plans:
- The guidelines for the design of study programs and courses at NTNU (the Study Plan Manager) shall be used in the annual review and revision of the study program.
- The faculties, administrative committees and rector may in addition have other focus areas and give their own directions for revision of the study plans.
- Deadlines for study plan revisions may be found on the wiki “annual cycle and deadlines for educational quality” (Norwegian only).
- Note that the faculties have the opportunity to set their own deadlines, which may be earlier than the centrally given deadlines.
The follow-up work may also have consequences that are handled through other management processes, such as HR, economics, and infrastructure.
Major changes
If the study program’s profile, content or learning outcome are changed to the extent that it appears as a different study offer, new accreditation will be required. This process is described on the page that contains information about the development of the study portfolio.
The study program leader will
- Exercise professional and pedagogical leadership for the study programme.
- Contribute to the development of the learning environment as well as to the academic and pedagogical quality of the study programme.
- Carry out his/her tasks in close collaboration with the Dean, the Head of Department, course coordinators, teachers, and students.
- Write and publish the annual study program report that is part of the quality reporting process.
- Follow up on any action plans after evaluation processes (annually and periodically).
- Ensure that the study plan is revised in accordance with the follow-up plan after evaluation as well as with applicable laws, regulations, framework plans and guidelines, in collaboration with the administration
The responsibility of the study program leader is laid out in the Mandate for Study Program Leaders at NTNU.
All study programs must be evaluated every ear (annual evaluation).
This evaluation will
- Include students and external stakeholders.
- Assess the robustness of the professional environment(re-accreditation).
- Administer the holistic learning environment of the students.
- Provide documentation by means of a report with a proposal for a follow-up plan.
All study programs must undergo a major review at least every five years (periodical evaluation).
All study programs must undergo a thorough evaluation at least every five years. The faculties are required to have a plan for recurring periodical reviews.
The evaluation process includes an assessment of whether the study program is adapted to meet current and future needs in society and working life. The purpose of this assessment is to provide the education management with a basis for considering whether the program should be continued as it is, changed or discontinued.
Periodic evaluation is thus a tool for managing and developing course offers. The evaluation is intended to ensure that the course portfolio adheres to current regulations, and that it is developed in line with societal needs.
Many faculties will carry out periodic evaluations of similar courses as a joint effort, to be better able to evaluate the offers and create action plans within a contextual framework.
See also: NTNU’s guidelines or periodic evaluation of study programs (pdf, Norwegian only).
What is meant by quality in a study program?
The goal is to secure:
- that the description of the learning outcome of the study program is updated and relevant
- that the subjects included in the study program contribute to the students’ achievement of the learning outcome in the program
Roles
The following roles are central for the development and evaluation of a study program:
See also: All roles in Education Quality system
Tools and resources
There are several tools and resources available as support for the development of study programs.
Learning environment
The students’ learning environment have several components:
- Physical learning environment
- Psychosocial learning environment
- Organizational learning environment
- Digital learning environment
- Pedagogical learning environment
How to work with psychosocial learning environment (Norw. only)
The Learning environment Committee (Norw. only)