Feedback

A handheld computer device for physiotherapy practical examinations

Developed by: 
Dr Trevor Russell
Institution: 
The University of Queensland
Teaching and Learning Strategy: 

A handheld computer device has been developed to streamline the process of the practical examination of students and to provide a mechanism for providing students with timely feedback on their performance in a practical examination
The device will be used by staff during practical examination to grade students according to an assessment template entered into the system by the examiner. This template will consist of the various cognitive and psychomotor attributes which form the assessment criteria of the examination along with relevant grading systems and descriptive text feedback fields.
 
It is anticipated that this system will streamline the practical examination process by automatically tallying results and outputting these to the university's mySI-net examination result collation system. In addition, the system will enable written comments of a student's performance in each cognitive and psychomotor attribute, to be emailed to them in a timely manner thus facilitating a reflective learning process.

Course Name: 
This system has been trialed successfully in 2004 in two physiotherapy courses (PHTY1200 and PHTY2110). It is planned for rollout across the entire undergraduate and GEM programs commencing in 2005.
Year Level: 
First Year
Expected Outcomes: 

Year Level : (Undergraduate 1-4 year, GEMS 1-2 Years)
 
Early feedback on performance will facilitate reflective learning by students.
 

Effective Aspects: 

The timely provision of feedback to students on their performance in practical examinations is the main aspect of this program which will influence student learning

Evaluation: 

Informal evaluation of the system was conducted in 2004.

Evaluation Outcomes: 

The overwhelming feeling of the staff using the system was that it saved large amounts of time traditionally associated with the collation and posting of practical examination marks. Students appreciated the timely provision of feedback on their performance.

Plans for Changes/Developments in Future: 

No

For Further Details
Contact Name: 
Trevor Russell
Contact Faculty/School: 
Division of Physiotherapy, School Health and Rehabilitation Sciences
Contact Institution: 
The University of Queensland

Integrated Clinical and Academic Learning

Developed by: 
Libby Gass, Norman Morris and Megan Dalton
Institution: 
Griffith University
Teaching and Learning Strategy: 

Clinical Units are integrated into an academic course (subject) throughout the physiotherapy program. Prior to and following each clinical placement students discuss their clinical experiences with the supervisor of clinical education, the course convenor (following clinical unit) and a psychologist (following clinical unit).

Course Name: 
Clinical Units are embedded in academic courses. Students need to satisfactorily complete both the academic and the clinical components of the course.
Year Level: 
First Year
Expected Outcomes: 

Year Level : (Clinical units are undertaken across all semesters of the 2 year graduate entry Master of Physiotherapy Program and in the final 3 years of 5 year Bachelor of Physiotherapy/Bachelor of Exercise Science Program.)
 
Prior to undertaking clinical placements, students complete coursework relevant to the upcoming clinical placement. Typically, students complete a viva/practical exam prior to undertaking the clinical placement. Moreover students meet with the Clinical Education Coordinator to discuss the expected experiential learning outcomes of the clinical placement. The expected outcomes of this teaching and learning practice are a better overall preparation and 'theoretical' preparation of the student for clinical placement.
 
At the completion of the clinical placement block (either one four-week or one eight-week block) students meet again for a debriefing session. Students are able to comment about similarities /differences of individual clinical experiences and discuss and relevant issues that may have arisen during the clinical placement thereby creating a shared learning environment.

Effective Aspects: 

n/a

Evaluation: 

Surveys of clinical educators.
 

Evaluation Outcomes: 

Qualitative and quantitative analysis suggests that clinical educators are happy with level of preparation of the students for clinical practice.

Plans for Changes/Developments in Future: 

No changes are expected.

For Further Details
Contact Name: 
Norm Morris
Contact Faculty/School: 
School of Physiotherapy and Exercise Science
Contact Institution: 
Griffith University

Course evaluation on the Web: A mechanism for online student feedback

Developed by: 
Associate Professor Leon Straker, Beatrice Tucker, Sue Jones and Professor Joan Cole
Institution: 
Curtin University of Technology
Teaching and Learning Strategy: 

Good quality feedback on courses that inform educators about student perceptions of their teaching is often difficult to obtain. This lack of student feedback may leave the educator relying on their own perceptions of teaching successes and difficulties. The School of Physiotherapy at Curtin University of Technology has developed and now routinely uses a web based evaluation system called CEW (Course Evaluation on the Web) to encourage staff and students to work together to continually improve the quality of programs.
Using CEW, students in all undergraduate and postgraduate programs are encouraged to reflect on all aspects of their learning experience and provide anonymous feedback via the Web on subjects studied and on their experiences of the overall course. Teachers undergo a process of reflection on all aspects of their teaching using the student feedback. Teachers summarise student feedback to identify key themes and then discuss their feedback and proposed improvements with an experienced academic colleague who is a year or course coordinator prior to preparing a report on proposed changes to the unit. Discussions include assistance with strategies to improve teaching skills, evaluation strategies, development of appropriate resources or guidance on appropriate teaching skill seminars within the university or the opportunity for 'buddying' with more experienced educators. The process is viewed as a peer mentoring/developmental process to improve teaching skills rather than a formal staff review, and staff value the opportunity to discuss the outcomes of their teaching and further ways to improve their performance to deliver a high quality program.
 
A mechanism for open dialogue and reporting back to students on the changes to be made as a result of their feedback completes the feedback loop and is unique to CEW.
The course evaluation is modeled on the Course Experience Questionnaire (CEQ). Managers determine how students rated each semester using the CEQ subscales. Using CEW, CEQ data can be predicted well in advance of its collection and publication allowing for early feedback and timely responses or changes. Course managers are able to not only compare subjects at one point in time, but also see how particular subjects change over time. Likewise, students and academics are able to review how the course changes from one year to the next. The trend in subject and year feedback/performance can be plotted over time to determine whether changes implemented have resulted in improvements in student satisfaction with their program and across the CEQ subscales.
Hence, student evaluation of teaching can be used as a measure of performance of academic programs, as well as a continuous quality improvement mechanism. University programs are audited by external bodies such as the Australian Universities Quality Agency and are required to demonstrate quality improvement processes to monitor effectiveness of their programs. It is essential to have a mechanism that demonstrates accountability, is sensitive to program changes and responsive to student feedback.
 

Course Name: 
All subjects within all units in all years of all programs at the School of Physiotherapy are evaluated using CEW. In addition, all years of the programs are evaluated at the end of each semester.
Year Level: 
First Year
Expected Outcomes: 

Year Level : (All subjects within all units in all years of all programs at the School of Physiotherapy are evaluated using CEW. In addition, all years of the programs are evaluated at the end of each semester.)
 
CEW is an effective tool in enhancing reflective practice on teaching and learning; it provides continuous monitoring of teaching and learning in individual units, across streams within programs, and across whole programs. CEW actively addresses student satisfaction and is a mechanism to enhance course management, improve student satisfaction and to provide evidence of a quality improvement process in the delivery of physiotherapy education programs.
 

Effective Aspects: 

Some of the important aspects of CEW that make it effective
 

  • The ongoing involvement and commitment of all staff and students to CEW. The response rate is nearly 100% because the practice of providing feedback has been made mandatory (this commitment was made by the students).
  • The open and transparent process of CEW.
  • All comments and the outcomes of student feedback, staff reflection and outcomes are fed back to all students and staff in the School of Physiotherapy Community.
  • Change occurs quickly as a result of the immediate online feedback process.
  • CEW provides a mechanism for identifying good teaching and learning practices and is useful for individuals undergoing promotion (rewarding good teaching and learning).
Evaluation: 

The following is an example of how CEW is used to demonstrate changes in teaching and learning

Figure 1 shows improvements in teaching and learning for the 4th year of the BSc Physiotherapy program 2000-2002. These improvements stemmed from feedback given through CEW in 2000.
In addition to changes in student satisfaction, the effect of CEW on workplace culture was assessed via a survey of staff in 2002.

Evaluation Outcomes: 

There has been a gradual improvement in GCEQ scores for the School of Physiotherapy, in particular for appropriate assessment and workload since the introduction of CEW in 2000.
A markedly positive improvement in workplace culture was reported through the staff survey in 2002 though the impact of other concurrent positive changes was acknowledged.
 

Plans for Changes/Developments in Future: 

The University is currently developing an evaluation instrument that mimics the processes and practices in CEW. The questions using in the new instrument will not be based on the GCEQ, but rather will be aligned with the principles of outcomes-focused education.

For Further Details
Contact Name: 
Beatrice Tucker
Contact Faculty/School: 
Learning Support Network
Contact Institution: 
Curtin University of Technology

Additional development assessment form used to enhance physiotherapy student feedback and clinical performance

Developed by: 
Sue Jones and Kerry Saunders
Institution: 
Curtin University of Technology
Teaching and Learning Strategy: 

Final year students in the School of Physiotherapy at Curtin University of Technology spend most of their year in clinical placements and are required to demonstrate that they meet the Australian professional competencies. Students receive both formative and summative feedback throughout the placement. Students who do not meet the competencies fail. A handful of students may meet most of the competencies, but have areas of weakness (usually in generic attributes) which are likely to impact on their performance in subsequent placements.
An Additional Development Form is completed by the Clinical educators for these students who then meet with the Clinical Program Coordinator to discuss the issues impacting on their performance. A management plan is designed to support their development of deficient competencies. Support may range from accessing specific counseling by the University services, provision of additional teaching support, strategies to overcome learning difficulties, accessing appropriate mentoring, reviewing lifestyle factors or identifying cross-cultural barriers to communication and performance.
 
A detailed plan of action outlining the issues, strategies used and additional suggestions to support learning are provided for both the student and the supervisors in the student's next clinical placement. Discussions with all parties ensure that students and supervisors are working together to assist the student to develop the required professional behaviours and competencies. Additional monitoring of student performance and supervisor support occurs during subsequent placements to ensure both parties' needs are met.
Provision of support facilitates students who are expected to take responsibility for their personal and professional development, and ensures that these students receive the appropriate assistance to achieve successful completion of the program.
 

Course Name: 
The clinical units in the final year of the Bachelor of Science and Master of Physiotherapy (Graduate Entry) programs
Year Level: 
Third Year
Expected Outcomes: 

(Final year of the programs)
 
Students will be able to critically evaluate their own performance in clinical practice.
Students will be able to develop professionally and personally, with appropriate assistance, as determined by the plan of action they develop.

Effective Aspects: 

Students must take responsibility for their own learning and for their personal and professional development, working together with clinical teachers.

This additional development form is used to identify issues that affect student's clinical performance that may otherwise not be suitably assessed in formal assessment procedures.
 

Evaluation: 

Formally through the Clinical Education Committee and Curriculum committees.

Evaluation Outcomes: 

Very positive feedback has been received from clinicians, academics, employers and the students themselves.
 

Plans for Changes/Developments in Future: 

n/a

For Further Details
Contact Name: 
Sue Jones
Contact Faculty/School: 
School of Physiotherapy