Associate Professor Leon Straker, Beatrice Tucker, Sue Jones and Professor Joan Cole
Institution:
Curtin University of Technology
Teaching and Learning Strategy:
Good quality feedback on courses that inform educators about student perceptions of their teaching is often difficult to obtain. This lack of student feedback may leave the educator relying on their own perceptions of teaching successes and difficulties. The School of Physiotherapy at Curtin University of Technology has developed and now routinely uses a web based evaluation system called CEW (Course Evaluation on the Web) to encourage staff and students to work together to continually improve the quality of programs.
Using CEW, students in all undergraduate and postgraduate programs are encouraged to reflect on all aspects of their learning experience and provide anonymous feedback via the Web on subjects studied and on their experiences of the overall course. Teachers undergo a process of reflection on all aspects of their teaching using the student feedback. Teachers summarise student feedback to identify key themes and then discuss their feedback and proposed improvements with an experienced academic colleague who is a year or course coordinator prior to preparing a report on proposed changes to the unit. Discussions include assistance with strategies to improve teaching skills, evaluation strategies, development of appropriate resources or guidance on appropriate teaching skill seminars within the university or the opportunity for 'buddying' with more experienced educators. The process is viewed as a peer mentoring/developmental process to improve teaching skills rather than a formal staff review, and staff value the opportunity to discuss the outcomes of their teaching and further ways to improve their performance to deliver a high quality program.
A mechanism for open dialogue and reporting back to students on the changes to be made as a result of their feedback completes the feedback loop and is unique to CEW.
The course evaluation is modeled on the Course Experience Questionnaire (CEQ). Managers determine how students rated each semester using the CEQ subscales. Using CEW, CEQ data can be predicted well in advance of its collection and publication allowing for early feedback and timely responses or changes. Course managers are able to not only compare subjects at one point in time, but also see how particular subjects change over time. Likewise, students and academics are able to review how the course changes from one year to the next. The trend in subject and year feedback/performance can be plotted over time to determine whether changes implemented have resulted in improvements in student satisfaction with their program and across the CEQ subscales.
Hence, student evaluation of teaching can be used as a measure of performance of academic programs, as well as a continuous quality improvement mechanism. University programs are audited by external bodies such as the Australian Universities Quality Agency and are required to demonstrate quality improvement processes to monitor effectiveness of their programs. It is essential to have a mechanism that demonstrates accountability, is sensitive to program changes and responsive to student feedback.
Course Name:
All subjects within all units in all years of all programs at the School of Physiotherapy are evaluated using CEW. In addition, all years of the programs are evaluated at the end of each semester.
Year Level:
First Year
Expected Outcomes:
Year Level : (All subjects within all units in all years of all programs at the School of Physiotherapy are evaluated using CEW. In addition, all years of the programs are evaluated at the end of each semester.)
CEW is an effective tool in enhancing reflective practice on teaching and learning; it provides continuous monitoring of teaching and learning in individual units, across streams within programs, and across whole programs. CEW actively addresses student satisfaction and is a mechanism to enhance course management, improve student satisfaction and to provide evidence of a quality improvement process in the delivery of physiotherapy education programs.
Effective Aspects:
Some of the important aspects of CEW that make it effective
The ongoing involvement and commitment of all staff and students to CEW. The response rate is nearly 100% because the practice of providing feedback has been made mandatory (this commitment was made by the students).
The open and transparent process of CEW.
All comments and the outcomes of student feedback, staff reflection and outcomes are fed back to all students and staff in the School of Physiotherapy Community.
Change occurs quickly as a result of the immediate online feedback process.
CEW provides a mechanism for identifying good teaching and learning practices and is useful for individuals undergoing promotion (rewarding good teaching and learning).
Evaluation:
The following is an example of how CEW is used to demonstrate changes in teaching and learning
Figure 1 shows improvements in teaching and learning for the 4th year of the BSc Physiotherapy program 2000-2002. These improvements stemmed from feedback given through CEW in 2000.
In addition to changes in student satisfaction, the effect of CEW on workplace culture was assessed via a survey of staff in 2002.
Evaluation Outcomes:
There has been a gradual improvement in GCEQ scores for the School of Physiotherapy, in particular for appropriate assessment and workload since the introduction of CEW in 2000.
A markedly positive improvement in workplace culture was reported through the staff survey in 2002 though the impact of other concurrent positive changes was acknowledged.
Plans for Changes/Developments in Future:
The University is currently developing an evaluation instrument that mimics the processes and practices in CEW. The questions using in the new instrument will not be based on the GCEQ, but rather will be aligned with the principles of outcomes-focused education.