Critical incident 22/09/21
Berwick campus is closed under current Victorian Government lockdown restrictions. Click here for more information.

Student Evaluation of Learning and Teaching

Student Evaluation of Learning and Teaching Procedure (Higher Education)

Policy Code: CG1703

Purpose

This procedure supports and mandates the implementation of the Student Evaluation of Learning and Teaching (SELT) Policy, particularly the key principles associated with the collection, reporting, distribution and actions relevant to student feedback. The purpose of this procedure is to affirm the institutional commitment of obtaining student feedback as a legitimate mechanism in ongoing institutional quality assurance regarding learning and teaching. This procedure details processes that relate to the following: collection of student feedback; the analyses process; the report framework structure; the reporting distributed pattern; closure of the student feedback loop and evidence of action relevant to the student feedback.

Scope

This procedure applies to students enrolled in Higher Education (HE) by coursework programs and their teachers.

Legislative Context

Definitions

Term Definition
Annual SELT Survey Schedule A pre-determined schedule formalising the evaluation process within the institution.
Associate Dean, (Teaching Quality)(ADTQ) The ADTQ is a key leadership position located within each School and is an important part of the School Executive Group. The ADTQ is a university staff member who plays an integral role in learning and teaching quality assurance, peer review and professional development of all staff within their School. The ADTQ works closely with the senior School staff across the School and the institution  
Course Subsidiary element of a higher education (HE) program
Course Coordinator (CC) A university staff member responsible for the delivery, assessment and structure of a course. This staff member may also teach the course or delegate this responsibility to another university staff member
Course evaluation The evaluation process primarily concerned with the course structure and its associated components
Course Survey Action Plan (CSAP) An action plan that needs completing if a course records over 60% response rate with a star rating of 1, 2, 3 stars or a combination of these
Evaluation The collection of student feedback, analysis process, reporting and interpretation of data to relevant  staff and students of the institution regarding the quality of learning and teaching
Program A program of study/research leading to the granting of an official award or qualification of the University contained in University Schedule 5.1 and the Scope of Registration.  A program contains subsidiary elements variously referred to as courses (higher education) or units of competency (VET)
Program Coordinator (PC) A university staff member responsible for the oversight of a program
School Survey Action Plan A compilation of the recommended actions of the individual Course Survey Action Plans.
SELT Course survey This survey asks students to reflect and provide feedback relevant to the course structure including meeting learning outcomes, assessment, course structure and design
SELT Teaching survey This survey asks students to reflect and provide feedback on individual teachers involved with the delivery of a course
SELT Tool The online feedback tool for collating, analysing and reporting student feedback on their learning and teaching experiences at the institution and its associated providers.
Teacher A university staff member responsible for the actual delivery of a course (HE). A course can also be delivered by more than one teacher (i.e. team teaching)
Teacher evaluation The evaluation process is primarily concerned with the teacher delivering the course in the (HE) sector

Actions

Step 1 Review and confirmation of SELT Survey Tool questions/content

  Activity Responsibility Steps
A Review and confirm SELT Survey tool questions Chair of Learning & Teaching Committee (LTC)
  1. Questions will be reviewed in line with policy review dates.
  2. Where feedback is received or statistical data analysis indicates that changes to the questions may be beneficial prior to the next scheduled review date, further stakeholder consultation will be undertaken and recommended changes developed and presented to the LTC for endorsement prior to implementation.

Step 2 Preparing for a SELT Tool Campaign

The SELT tool provides students with the opportunity to provide both quantitative and qualitative feedback on their satisfaction with their course delivery and their teacher’s effectiveness in supporting and motivating them to achieve the course learning outcomes.

The survey questions can be accessed through the Supporting Documents section of this procedure.

  Activity Responsibility Steps
A Confirm course delivery and preliminary academic staff planning/delivery alignment Manager (Program Support and Technical Services) or nominee
  1. Before commencement of the semester/delivery period ensure that program coordinators, course coordinators, lecturers and/or teachers and tutors and associated workloads have been assigned to adequately cover program/qualification requirements.
  2. Identify any course codes to be excluded from the data set. Examples of excluded courses include some placement or exchange placeholder unit/course codes.
B Confirm SELT Survey Campaign Schedule Coordinator, Student Engagement and Experience Surveys
  1. Confirm campaign delivery locations and semesters.
  2. Liaise with ITS to identify any technical support needs, upcoming upgrades or scheduled outages that might impact the conduct of the survey campaign.
  3. Prepare and communicate the SELT Survey Campaign Schedule for the specified campaign period.
C Configure academic staff delivery information in the Student Management System Manager (Program Support and Technical Services) or nominee
  1. Ensure that all teacher and tutor details are updated in appropriate fields within the Student Management System platform by the deadline specified in the SELT Survey Campaign Schedule.
D Request to combine courses (ADTQ)
  1. Where a course combination is required the ADTQ should complete a Combined Course Request Form (see supporting documents) and send to Manager (Program Support and Technical Services), Coordinator, Surveys or nominee and timetabling staff by the deadline specified in the SELT Survey Campaign Schedule to communicate this change. ADTQ will receive an email confirming this has been actioned.
E Validate academic delivery assignment Manager (Program Support and Technical Services) or nominee 
  1. Validate the data extracts for correctness so that individual teacher reports can be accurately produced for all relevant teaching activities within the campaign period.
  2. Make corrections directly in the data set and return to Surveys by the deadline specified in the SELT Survey Campaign Schedule.
F Validate student data Manager (Program Support and Technical Services) or nominee 
  1. Review and confirm students that are to be excluded from the survey instrument distribution. Exceptions include, but are not limited to, students who are excluded, deceased or on approved leave of absence.
G Develop SELT Survey Campaign Communication Plan Coordinator, Student Engagement and Experience Surveys
  1. Work with Student Communication to develop and execute a direct student communication plan to promote the survey at appropriate milestones in the lead up to the campaign opening, during the campaign and as the close approaches designed to optimise student response rates.
  2. Work with ADTQ and Manager (Program Support and Technical Services) or nominee to develop and execute an academic staff communication plan to promote the survey at appropriate milestones in the lead up to the campaign opening, during the campaign and as the close approaches designed to optimise student response rate.
H Test and release SELT Survey Campaign Coordinator, Student Engagement and Experience Surveys
  1. Compile, test and load campaigns into the survey system.
I Activate the student and staff communication plan to promote the SELT Survey Campaign Coordinator, Student Engagement and Experience Surveys, Student Communications Officer, ADTQ,  Manager (Program Support and Technical Services) or nominee
  1. Advise Student Communications of go live and activate the student communication plan
  2. Advise the ADTQ  and Manager (Program Support and Technical Services) of Survey Go Live and activate the academic staff communication plan.
J Provide weekly campaign updates Coordinator, Student Engagement and Experience Surveys
  1. Provide response rate updates on a weekly basis to ADTQ
K Review weekly campaign response rates and identify and initiate further targeted promotional activity where required ADTQ
  1. Where response rates are low, work with the Coordinator, Student Engagement and Experience Surveys and Student Communications to review the survey communication plan and identify and initiative further targeted promotional activity designed to increase participation.
L Close Campaign Coordinator, Student Engagement and Experience Surveys
  1. Turns off campaign in survey platform and consolidates data ready for reporting.

Step 3 Generation and distribution of SELT Survey Tool reports

  Activity Responsibility Steps
A Provide dashboard reports and/or Course Heat Maps Coordinator, Student Engagement and Experience Surveys
  1. Provide dashboard reports and/or Course Heat Maps that identify the level of Student Response and Student Agreement. These Course Heat Maps are developed into School Course Heat Maps for wider distribution. The heat maps align with one of the following sub-categories for Metric One:
    1. Outstanding category (Green traffic light) indicates that 80% or more of responses ‘Agree or Strongly Agree’ with all the quantitative statements for course-related questions and ‘Most of the time’ and ‘Always’ for teacher-related questions.
    2. Noteworthy category (Orange traffic light) indicates that between 60 -79% of responses ‘Agree or Strongly Agree’ with all the quantitative statements for course-related questions and ‘Most of the time’ and ‘Always’ for teacher-related questions.
    3. Further Action Required category (Red traffic light) indicates less than 60% of responses ‘Agree or Strongly Agree’ with all the quantitative statements for course-related questions and ‘Most of the time’ and ‘Always’ for teacher-related questions.
  2. Metric Two: The target student response rate is greater than 60% (i.e. more than 60% of students in an enrolled single course or equivalent actively respond to the course and/or teacher survey).
B Provide Full Course and Teacher Evaluations including qualitative comments Coordinator, Student Engagement and Experience Surveys
  1. Course Evaluations: Once students' final course grades have been published and where there are at least five responses, generate and distribute Course Evaluations. Partners use their evaluations for management meetings before semester closes. Reports should be delivered in Partner Provider Week 12 with an embargo until after results have been published. All qualitative comments should be shared regardless of response rates with prior review for appropriate language use.
  2. Teacher Evaluations: Once students' final course grades have been published and where there are at least five students enrolled and two students responded, Teacher Evaluations will be generated and distributed. Partners use their evaluations for management meetings before semester closes. Evaluations should be delivered in Partner Provider Week 12 with an embargo until after results have been published. All qualitative comments should be shared regardless of response rates with prior review for appropriate language use.
  3. Course Evaluations: quantitative and qualitative) are to be provided to the Course Coordinator (for all campuses where the course has been taught), Program Coordinator and Discipline Leader.
  4. Teacher Evaluations: (quantitative and qualitative) are to be provided to the teacher, Program Coordinator, Discipline Leader, Deans, ADTQs and relevant primary Partner Provider Business Partner as provided by Centre of University Partnerships (CUP) and/or relevant Pro Vice Chancellor (PVC).
  5. School Course Heat Maps: are disseminated to the following stakeholders: Tabled at LTC through the Chair, all LTC members, Deans, Deputy Deans, ADTQs, Discipline Leader, Program Coordinators and primary Partner Provider Business Partners (as provided by CUP/PVC). Partners use their reports for management meetings before semester closes. Reports should be delivered in Partner Provider Week 12 with an embargo until after results have been published.
  6. For the purpose of Academic Promotions, the Executive Officer of the committee can request Teacher Evaluations (quantitative and qualitative) and Course Evaluations (quantitative and qualitative) from the Coordinator, Student Engagement and Experience Surveys based on information provided by the applicant (ie course code, title, mode of delivery and semester offering). Where Course Evaluations are requested, an appropriate time period should be specified.
C Sharing student feedback contained in reports All staff
  1. Course Coordinators and teachers receiving student feedback have the responsibility to ensure the information is utilised in an effective, ethical manner and should conform to the University's Staff Code of Conduct Policy and Information Privacy Policy. Misuse of data from SELT Survey Tool reports will be dealt with in accordance with official University Policies and Procedures which may include disciplinary action.
  2. Staff suspecting that data from SELT Survey Tool reports has been shared inappropriately, should report the matter directly to their supervisor in the first instance, or if this is not appropriate, their Deputy Dean.
  3. Comments which are general in nature (that is, in which staff are not identifiable) may be shared with all staff teaching in the course.
  4. Comments that identify, or could identify, staff can be shared only with the identifiable staff member and those detailed in Activity B, Step 4 above.
  5. While it is expected that in the qualitative items, students will only comment on the teaching of the nominated teacher, a student could feasibly name and comment on a different teacher. In this case, the recipients of this report are under obligation to treat comments about other staff as confidential. As students were not invited to comment on teachers other than the participating teacher, any comments about nonparticipating teachers should not be passed on to anyone.
  6. Where comments refer directly to another teacher engaged in the course delivery but who was not specifically identified within the co-teaching team and will not therefore receive the report, the comments will be forwarded to the Discipline Leader for sharing with the teacher as appropriate.
  7. Every effort will be made to remove student feedback which is considered offensive or defamatory (e.g. racist, sexist, personal or abusive, or allegations of criminal activity. This feedback should NOT be passed on to any staff member or any student.
  8. Under no circumstances will a comment be tracked to identify any student.
D Recognition and reward of exemplar performance Chair of Learning & Teaching Committee
  1. Identify exemplary performance in Course and Teacher response and reward this outcome. Where Course and Teacher Overall responses meet the Outstanding Category (Metric One) and 60% response rate (Metric Two) and have more than ten students enrolled, letters of commendation are generated and achievements are recognised at the School and Institutional level.
  2. Identify and send letters to individual staff and/or teaching teams and programs with copies to the Deans and Directors. Staff associated with exemplary practice will be encouraged to nominate for School and/or institutional (ie Vice Chancellor Learning and Teaching Awards) and/or national learning and teaching awards.
E Quality assurance improvement strategies ADTQs
  1. Ensure that courses where Course Survey Action Plans are required are identified and that plans are developed in line with Step 4 below.

Step 4 Actioning Student Feedback

  ACTIVITY RESPONSIBILITY STEPS
A. Developing Course Survey Action Plans (CSAP). Note: A Course Survey Action Plan is to be developed for each course categorised as Further Action Required with a Red traffic light indicator  Course Coordinators/Program Coordinators/ADTQs
  1. The Course Coordinator creates a CSAP using these four key prompts:
    1. Acknowledgement of key issues identified through such feedback.
    2. Summary of improvements or course modifications as a result of the student feedback, peer review and/or course review.
    3. Summary of how key issues will be addressed in the future delivery of the course.
    4. An estimated time when any resulting changes will be included in the course.
  2. The Course Coordinator may choose to meet with their line manager, ADTQ or another colleague to discuss student feedback and reflect on suggestions moving forward.
  3. Note: If the student response rate is less than 20% of the total cohort, the Course Survey Action Plan response can be determined by the School in consultation with the ADTQ.
  4. The Course Coordinator submits the CSAP to the relevant School Board.
  5. Where courses have been identified that require further action however have not required a CSAP, a statement and acknowledgement of this must be noted at School Board This statement must briefly describe any issues and proposed improvements
B. Developing School Course Action Summary (SCAS) ADTQs
  1. The ADTQ is responsible for summarising the CSAP reports provided to School Board into a School Course Action Summary (SCAS).
  2. The ADTQ submits the SCAS to the University Learning and Teaching Committee as evidence of quality assurance
C Addressing student feedback by completing the “Closing the Loop” section of the Course Description. This is to be completed for each course. Course Coordinators and teachers
  1. At the end of each teaching semester/delivery, it is the responsibility of Course Coordinators to review the feedback received from students through a variety of mechanisms, including SELT Survey Tool.
  2. All Course Coordinators/Teachers need to ensure future students have access to comments relevant to the ongoing improvement of a course. For all HE courses, the Course Description template section specific to addressing student feedback and “Closing the Loop” must be appropriately completed prior to the next delivery of the course.
  3. Course Coordinators and teachers should look for trends rather than focusing on isolated comments and reflect on what can be done to maintain the strengths and improve learning for students.
  4. Course Coordinators should use the four key prompts listed above. An estimated time when any resulting changes should also be included.
D. Planning improvements to a course Course Coordinators, Program Coordinators, ADTQs
  1. Course Coordinators and Program Coordinators are expected to reflect on the findings and use the data to plan improvements to a program. ADTQs and other learning and teaching support staff can also guide improvements relative to feedback.
  2. Program Coordinators and the ADTQs can also utilise data to identify Course Coordinators or teachers who require added support in a variety of areas and also celebrate exemplar learning and teaching. Where support is required, the ADTQ and their supervisor may need to be involved to identify what support best suits the situation (i.e. peer review, mentoring etc).
E. Documenting areas for course improvement via Performance Review and Development Program (PRDP) Supervisors/Coordinators
  1. Course Coordinators/lecturers and/or teachers must provide evidence of course and teacher feedback as part of annual PRDP discussions.
  2. Supervisors are expected to discuss SELT Survey Tool feedback with supervisees during the PRDP process.  This discussion needs to be documented at the annual PRDP process including a focus on corrective action (if required).This process should allow for setting appropriate goals related to learning and teaching performance and quality assurance.
F. Addressing teacher feedback where necessary Teacher/Line Manager
  1. If student feedback regarding a teacher's performance needs addressing, a teacher must meet with their line manager to discuss the feedback.
  2. The teacher develops improvement strategies within an acceptable time frame (within and no later than eight weeks after the feedback has been received) and actions any improvement deemed necessary by their line manager.
  3. The teacher is responsible for identifying key area(s) of improvement and providing a strategy to improve performance. This is documented within their PRDP cycle and if appropriate in the Course Description section relevant to student feedback. This is also discussed with the Course Coordinator and/or teaching team (where appropriate).
  4. The strategies need to be approved by the line manager and may include peer review by the School ADTQ or others as deemed appropriate.
G. Reviewing and continuously improving  
  1. The impact of the new strategies is reviewed in a timely manner as part of the continuous quality assurance cycle.

Responsibility

  • Academic Board is responsible for monitoring the implementation, outcomes and scheduled review of this procedure.
  • Chair, Learning and Teaching Committee is responsible for maintaining the content of this procedure as delegated by Academic Board.

Promulgation

The Student Evaluation of Learning and Teaching Procedure will be communicated throughout the University via:

  • Specific advice to Partner Providers and Schools;
  • General advice on the University Website;
  • Inclusion on the university's Policy Central; and
  • Specialised marketing and information materials.

Implementation

The Student Evaluation of Learning and Teaching Procedure will be implemented throughout the University via:

  • Administration and reporting of the survey via the Survey Team, Data Analysis and Reporting.
  • Implementation of the communication plan to engage students.
  • Continuous improvement of courses and programs through the application of feedback and reflective practice.
  • Discussions at school and institutional level meetings and with key school stakeholders.

Records Management

Owning organisation units and recipients of survey reports are responsible for the secure storage of survey reports

Title Location Responsible Officer Minimum retention period
Survey data Central drive Coordinator, Student Engagement and Experience Surveys Destroy 7 years after action completed
Course Survey Action Plan

School Drive

Submitted to School Learning and Teaching Committee or equivalent on a cyclic basis

ADTQ Destroy two years after organisational use has concluded
School Course Action Summary

School Drive

Submitted to FedUni Learning and Teaching Committee on a cyclic basis

ADTQ Destroy two years after organisational use has concluded