Course evaluation on the Web: A mechanism for online student feedback
Developed by: Associate Professor Leon Straker, Beatrice Tucker, Sue Jones and Professor Joan Cole
University: Curtin University of Technology
Teaching and learning strategy:
University: Curtin University of Technology
Teaching and learning strategy:
Good quality feedback on courses that inform educators about student perceptions of their teaching is often difficult to obtain. This lack of student feedback may leave the educator relying on their own perceptions of teaching successes and difficulties. The School of Physiotherapy at Curtin University of Technology has developed and now routinely uses a web based evaluation system called CEW (Course Evaluation on the Web) to encourage staff and students to work together to continually improve the quality of programs.
Using CEW, students in all undergraduate and postgraduate programs are encouraged to reflect on all aspects of their learning experience and provide anonymous feedback via the Web on subjects studied and on their experiences of the overall course. Teachers undergo a process of reflection on all aspects of their teaching using the student feedback. Teachers summarise student feedback to identify key themes and then discuss their feedback and proposed improvements with an experienced academic colleague who is a year or course coordinator prior to preparing a report on proposed changes to the unit. Discussions include assistance with strategies to improve teaching skills, evaluation strategies, development of appropriate resources or guidance on appropriate teaching skill seminars within the university or the opportunity for 'buddying' with more experienced educators. The process is viewed as a peer mentoring/developmental process to improve teaching skills rather than a formal staff review, and staff value the opportunity to discuss the outcomes of their teaching and further ways to improve their performance to deliver a high quality program.
A mechanism for open dialogue and reporting back to students on the changes to be made as a result of their feedback completes the feedback loop and is unique to CEW.
The course evaluation is modeled on the Course Experience Questionnaire (CEQ). Managers determine how students rated each semester using the CEQ subscales. Using CEW, CEQ data can be predicted well in advance of its collection and publication allowing for early feedback and timely responses or changes. Course managers are able to not only compare subjects at one point in time, but also see how particular subjects change over time. Likewise, students and academics are able to review how the course changes from one year to the next. The trend in subject and year feedback/performance can be plotted over time to determine whether changes implemented have resulted in improvements in student satisfaction with their program and across the CEQ subscales.
Hence, student evaluation of teaching can be used as a measure of performance of academic programs, as well as a continuous quality improvement mechanism. University programs are audited by external bodies such as the Australian Universities Quality Agency and are required to demonstrate quality improvement processes to monitor effectiveness of their programs. It is essential to have a mechanism that demonstrates accountability, is sensitive to program changes and responsive to student feedback.
Hence, student evaluation of teaching can be used as a measure of performance of academic programs, as well as a continuous quality improvement mechanism. University programs are audited by external bodies such as the Australian Universities Quality Agency and are required to demonstrate quality improvement processes to monitor effectiveness of their programs. It is essential to have a mechanism that demonstrates accountability, is sensitive to program changes and responsive to student feedback.
In what course/ subject/ unit/ module/ program is the teaching and learning practice used?
All subjects within all units in all years of all programs at the School of Physiotherapy are evaluated using CEW. In addition, all years of the programs are evaluated at the end of each semester.
In what year level are the students who participate in the teaching/ learning practice?
All subjects within all units in all years of all programs at the School of Physiotherapy are evaluated using CEW. In addition, all years of the programs are evaluated at the end of each semester.
Expected learning outcomes from the teaching and learning practice.
CEW is an effective tool in enhancing reflective practice on teaching and learning; it provides continuous monitoring of teaching and learning in individual units, across streams within programs, and across whole programs. CEW actively addresses student satisfaction and is a mechanism to enhance course management, improve student satisfaction and to provide evidence of a quality improvement process in the delivery of physiotherapy education programs.
Aspects of the teaching and learning practice which make it particularly effective.
Some of the important aspects of CEW that make it effective
- The ongoing involvement and commitment of all staff and students to CEW. The response rate is nearly 100% because the practice of providing feedback has been made mandatory (this commitment was made by the students).
- The open and transparent process of CEW.
- All comments and the outcomes of student feedback, staff reflection and outcomes are fed back to all students and staff in the School of Physiotherapy Community.
- Change occurs quickly as a result of the immediate online feedback process.
- CEW provides a mechanism for identifying good teaching and learning practices and is useful for individuals undergoing promotion (rewarding good teaching and learning).
The following is an example of how CEW is used to demonstrate changes in teaching and learning
Figure 1 shows improvements in teaching and learning for the 4th year of the BSc Physiotherapy program 2000-2002. These improvements stemmed from feedback given through CEW in 2000.
In addition to changes in student satisfaction, the effect of CEW on workplace culture was assessed via a survey of staff in 2002.
What were the outcomes of the evaluation?
There has been a gradual improvement in GCEQ scores for the School of Physiotherapy, in particular for appropriate assessment and workload since the introduction of CEW in 2000.
A markedly positive improvement in workplace culture was reported through the staff survey in 2002 though the impact of other concurrent positive changes was acknowledged.
A markedly positive improvement in workplace culture was reported through the staff survey in 2002 though the impact of other concurrent positive changes was acknowledged.
Do you have any plans to make changes to the teaching and learning practice?
Changes occur continuously as a result of student feedback and teacher reflection.
Changes planned
The University is currently developing an evaluation instrument that mimics the processes and practices in CEW. The questions using in the new instrument will not be based on the GCEQ, but rather will be aligned with the principles of outcomes-focused education.
Contact details
Name: Beatrice Tucker
Address: Learning Support Network, Curtin University of Technology
GPO Box U1987, Perth WA 6845
URL: http://lsn.curtin.edu.au/
References:
Tucker B, Jones S, Straker L and Cole J (2003): Course evaluation on the Web: Facilitating student and teacher reflection to improve learning. New Directions for Teaching and Learning. 96(Winter); 81-94.
Tucker B, Jones S and Straker L (2003): Quality improvement using reflective practice on teaching and learning - A report on the impact on CEQ data. Evaluations and Assessment: A Commitment to Quality. November 24-25, Adelaide.
Jones S, Tucker B, Straker L and Cole J (2002): Educational program evaluation on the web: A quality improvement mechanism. Effective Teaching and Learning Conference 2002: Evaluations and Assessment. November 14-15, Brisbane.
Tucker B, Jones S, Straker L and Cole J (2002): Use of online course evaluation for mentoring teachers. Effective Teaching and Learning Conference 2002: Valuing Students. Valuing Staff. November 14-15, Brisbane.
Jones S, Tucker B, Straker L and Cole J (2002): Course Evaluation on the Web - Quality improvement in physiotherapy education. Australian Physiotherapy Association 7th International Physiotherapy Congress, Sydney p130.
Tucker B, Straker L, Jones S, Cole J and Ots J (2001): Course Evaluation on the Web (CEW): A method of enhancing reflective practice on teaching and learning in physiotherapy. 7th National Cardiothoracic Special Group Conference, Adelaide, South Australia, October 18-20th.
Tucker B, Straker L, Jones S, Cole J and Ots J (2001): Enhancing teaching and learning using course evaluation on the web (CEW). Expanding Horizons in Teaching and Learning. Proceedings of the 10th Annual Teaching and Learning Forum, 7-9 February 2001, Perth, Curtin University of Technology. http:cea.curtin.edu.au/tlf2001/
Address: Learning Support Network, Curtin University of Technology
GPO Box U1987, Perth WA 6845
URL: http://lsn.curtin.edu.au/
References:
Tucker B, Jones S, Straker L and Cole J (2003): Course evaluation on the Web: Facilitating student and teacher reflection to improve learning. New Directions for Teaching and Learning. 96(Winter); 81-94.
Tucker B, Jones S and Straker L (2003): Quality improvement using reflective practice on teaching and learning - A report on the impact on CEQ data. Evaluations and Assessment: A Commitment to Quality. November 24-25, Adelaide.
Jones S, Tucker B, Straker L and Cole J (2002): Educational program evaluation on the web: A quality improvement mechanism. Effective Teaching and Learning Conference 2002: Evaluations and Assessment. November 14-15, Brisbane.
Tucker B, Jones S, Straker L and Cole J (2002): Use of online course evaluation for mentoring teachers. Effective Teaching and Learning Conference 2002: Valuing Students. Valuing Staff. November 14-15, Brisbane.
Jones S, Tucker B, Straker L and Cole J (2002): Course Evaluation on the Web - Quality improvement in physiotherapy education. Australian Physiotherapy Association 7th International Physiotherapy Congress, Sydney p130.
Tucker B, Straker L, Jones S, Cole J and Ots J (2001): Course Evaluation on the Web (CEW): A method of enhancing reflective practice on teaching and learning in physiotherapy. 7th National Cardiothoracic Special Group Conference, Adelaide, South Australia, October 18-20th.
Tucker B, Straker L, Jones S, Cole J and Ots J (2001): Enhancing teaching and learning using course evaluation on the web (CEW). Expanding Horizons in Teaching and Learning. Proceedings of the 10th Annual Teaching and Learning Forum, 7-9 February 2001, Perth, Curtin University of Technology. http:cea.curtin.edu.au/tlf2001/