Margaret Green, Marie Williams and Gisela van Kessel
Institution:
University of South Australia
Teaching and Learning Strategy:
The incidence of plagiarism seems to be on the increase in our programs. The proposed explanations of this phenomenon are varied including the increased access to digital information, increased pressure on student time as they struggle to manage work and study, cultural differences, the pressure to get good grades and pure laziness. It may just be that students do not have the understanding of educational integrity that academics suppose they have, or cannot effectively and efficiently apply the rules.
In order to ensure that students were aware of what constitutes plagiarism and collusion a proactive teaching project was designed which would teach the students understanding of these concepts.
An assignment was written using three sources. No attribution was made in the assignment despite quotes, tables, figures and summarizing from all three sources being used. The students were then given the assignment and the three sources. Their task was to identify the plagiarism and to correctly attribute it.
Prior to the students undertaking the assignment instructions were given in a lecture format, as was the advice to complete a number of on-line workshops on plagiarism. As it was an individual assignment students were also warned that they should not share their work with other students. All assignments were electronically submitted with student changes having been done using track changes. This had the extra bonus of being able to compare when changes were made and who made them. Ironically, some collusion was identified this way.
The results of the assignment were concerning, in that 30% of undergraduate and of 35% of postgraduate students failed. Further educative sessions for these students followed, and they were then asked to resubmit the assignment. Of the resubmissions 60% of postgraduate students still failed while only 3% of undergraduate students failed. The teaching team hypothesized that this was because the undergraduate assignment carried a mark of 20% and was an essential component to pass the course whereas the postgraduate students had only a pass/fail assignment and there was not penalty for failing. The results also highlighted the types of plagiarism that students had the most trouble identifying, namely embedded quotes, data and summarising of text. The teaching team also reflected on the teaching process and decided it did not have enough depth.
Changes made the following year included the introduction of a formal lecture on plagiairsm and collusion followed by a two hour interactive workshop where students worked on tasks related to plagiarism and collusion. The "assignment" had a greater focus on those areas that student had previously demonstrated difficulties, ie embedded quotes, data and summarising of text.
It is hoped that after completion of the assignment that students will have a better understanding of what plagiarism is, and therefore what needs to be attributed in their work. If they have a better understanding then it is hoped that we will see less examples of plagiarism.
Course Name:
Physiotherapy Clinical Studies 100 (Bachelor of Physiotherapy
Year Level:
First Year
Expected Outcomes:
Year Level : (All students entering a coursework degree do this assignment as part of a first semester course.)
It is expected that students will have a better understanding of what plagiairsm and collusion are, and that this knowledge will help them avoid these practices in the future. It is also hoped that as students understand what needs to be attributed they will become more careful in their note taking and that this should them speed up the process of attribution.
Effective Aspects:
The introduction of the lecture and the interactive workshops has improved the quality of the results. Since the introduction of the assignment there has been marked (anecdotal) evidence of a reduction in plagiairsm, especially among the postgraduate students. There has also been an exponential increase in the number of students who now seek advice about attribution in their work.
Evaluation:
The marks for all students completing the assignment have now been collected over a three year period. Data is entered against all students, identifying the examples of plagiarism correctly and incorrectly recognized and hence whether they passed or failed. From this data we have identified the plagiarism concepts that the students have the most difficulty recognizing. By looking at the changes in the results we have also been able to evaluate the changes we have made over the three years of the project.
Students are also asked open ended questions about the assignment in the end of semester course evaluation questionnaires
Evaluation Outcomes:
Changes have been made to the teaching methodology, and the assignment is now more heavily biased to the plagiarism concepts that the students have the most problem identifying.
Students also felt that 20% was too much to allocate to one assignment (considering the other assessment tasks in the course) so the value of the assignment is now 10%, but it is still an essential component.
Plans for Changes/Developments in Future:
As we gain more knowledge and information about plagiarism we will continue to develop the lecture and workshops so as to best help the students understand and thus avoid the perils of plagiarism and collusion.
As we better understand the aspects of plagiarism that students have the most problems with we can direct our teaching and the focus of the assignment to address these.
A handheld computer device has been developed to streamline the process of the practical examination of students and to provide a mechanism for providing students with timely feedback on their performance in a practical examination
The device will be used by staff during practical examination to grade students according to an assessment template entered into the system by the examiner. This template will consist of the various cognitive and psychomotor attributes which form the assessment criteria of the examination along with relevant grading systems and descriptive text feedback fields.
It is anticipated that this system will streamline the practical examination process by automatically tallying results and outputting these to the university's mySI-net examination result collation system. In addition, the system will enable written comments of a student's performance in each cognitive and psychomotor attribute, to be emailed to them in a timely manner thus facilitating a reflective learning process.
Course Name:
This system has been trialed successfully in 2004 in two physiotherapy courses (PHTY1200 and PHTY2110). It is planned for rollout across the entire undergraduate and GEM programs commencing in 2005.
Year Level:
First Year
Expected Outcomes:
Year Level : (Undergraduate 1-4 year, GEMS 1-2 Years)
Early feedback on performance will facilitate reflective learning by students.
Effective Aspects:
The timely provision of feedback to students on their performance in practical examinations is the main aspect of this program which will influence student learning
Evaluation:
Informal evaluation of the system was conducted in 2004.
Evaluation Outcomes:
The overwhelming feeling of the staff using the system was that it saved large amounts of time traditionally associated with the collation and posting of practical examination marks. Students appreciated the timely provision of feedback on their performance.
Each student is required to work with two other students and make a video of themselves performing three physiotherapy assessment and treatment techniques taught in the first semester. One student acts as the patient, while the other student controls the video camera and also critiques the "student therapist" using the assessment sheet utilized during practical examinations of this subject.
Once the video is complete the "student therapist" is required to watch the video and complete a self-evaluation of their performance using the assessment sheets.
At least one week later the video process is repeated. The same or different techniques are chosen to be performed. The student therapist self-evaluates the performance on the second video and receives a written evaluation from the observing student.
The student is then required to compile a report based on the observing students critique and their self-evaluation of both video sessions. The report briefly summarises each technique, provides an in-depth critical appraisal of their performance, discusses what was done well and what needs improvement, compares the observation between the student observer and their own self-evaluation and includes a section about changes over time (from video one to video two).
Course Name:
The practice is used in a subject called Physiotherapy Skills A (PTY11PSA).
Year Level:
First Year
Expected Outcomes:
To develop an appreciation of current level of skill when performing various physiotherapy assessment and treatment technique
To be able to accurately reflect on their performance of techniques and understand the potential implications of their performance on the patient
To be able to identify deficits in performance and prompt improvements in performance during the second video
To become familiar with the marking criteria used for assessment in the subject
Effective Aspects:
The use of a video camera to tape the performance ensures that the student experiences the pressure associated with appearing on camera, prior to experiencing the pressures associated with practical exams.
The need to perform a variety of techniques in their entirety, with no assistance from notes and in front of two peers and a video camera makes students realise any potential deficits in their learning.
Critical analysis of performance included in the report ensures that the student must understand the implications of their performance (good or bad) for the patient. The theory of assessment and treatment techniques needs to be understood.
Evaluation:
All assignments are handed in and marked, contributing 10% of the mark for this subject.
The practice is also evaluated on Quality Assessment forms filled out by students regarding this subject.
Evaluation Outcomes:
The practice continually receives positive feedback from students regarding the usefulness of the assignment in showing them deficits in their knowledge and practical skills. Students comment on the pressure of performing the technique under such conditions with no assistance from peers or notes. They comment that it makes them realise how much they have to know and how much more they have to practice to be independent with techniques.
Theoretical framework - of essential content material pertaining to Physiotherapy in Women's Health and the principles of adult learning and student-centered teaching: lectures and practical classes that modeled adult-learning interactive principles and practices, and a detailed resource manual.
Experience in the principles and practices of self-directed learning, interactive teaching and peer and self-assessment:
Formulation of a criteria list for evaluation of the presentations. This is complied from their responses to the question - " Think back on your past learning experiences. What factors made some of them particularly effective, meaningful and long-lasting?"
Research in pairs of an allocated topic and formulation of interactive teaching strategies for their content area. They also have free access to a resource room equipped with a range of reference material - books, articles, tapes, videos - and teaching aids for use in classes.
Class outline - written assignment of class objectives, content, teaching methods and ideas for evaluation of effectiveness. This is handed in for assessment and feedback, and any necessary adjustments can then be made before they give their class.
Presentation of their class material - role-playing as a childbirth educator, presenting their topic area to their tutorial group who in turn were role-playing as expectant parents.
Peer evaluation via provision of anonymous feedback - using the previously student established criteria list, students give anonymous written feedback to each other regarding which factors s/he managed well in their class segment and what needed to be improved.
Self-evaluation of their own teaching.
Course Name:
Introduction to Physiotherapy in Women's Health
Year Level:
Fourth Year
Expected Outcomes:
At the completion of this unit students should be able to:
State the essential elements of physiotherapy content, skills and attitudes relevant to Women's health.
Describe and apply processes of active self-directed group learning and interactive teaching that are appropriate for childbirth education classes.
List and apply principles of peer and self-evaluation of group teaching
Value the use of active group teaching processes and self and peer evaluation in facilitating learning.
Aspects of the teaching and learning practice which make it particularly effective.
minimal lectures
identification and formulation of their own criteria
particular emphasis being given to valuing students' contributions and accepting different ideas
students being both participants and presenters
student experience with identifying aspects of effective teaching practice that they can apply to any group process
Effective Aspects:
n/a
Evaluation:
Students filled in a detailed Likert-style evaluation form based on the unit objectives. They also filled in open questions for free comments.
Evaluation Outcomes:
Consistently positive. Results from both sources indicate strong student support for student-centered teaching and learning methodology.
Clinical Conference is a 10CP capstone course undertaken by students in the last/final semester of studies prior to the final 8 weeks of clinical placements. The course aims to fully integrate the student's prior learning in exercise science with evidence-based physiotherapy knowledge and skills using complex clinical cases. These cases are complicated by 'real-life' moral, ethical and medico-legal issues. The students study four separate cases in detail and in a holistic manner, examining the progress of patients through a continuum of care (eg, early diagnosis, acute care, sub-acute needs, rehabilitation and through to re-integration back in to the community). Sessions are led by various members of different disciplines from the healthcare team that might be involved with such cases. The cases are updated and modified each year depending on medical advances or social change.
Course Name:
5005PES - Clinical Conference
Year Level:
First Year
Expected Outcomes:
Year Level : (Year 5 - final year)
At the end of the course the student should be able to:
present, discuss and justify management strategies for a variety of complex clinical case presentations with the emphasis on evidence based practice;
justify diagnostic decisions and management strategies on the basis of clinical assessment findings, and clinical, including propositional and non-propositional knowledge and scientific knowledge;
demonstrate an ability to evaluate research literature and apply results to pertinent clinical situations;
discuss advanced diagnostic and therapeutic concepts in physiotherapy practice;
identify medico-legal and ethical issues arising from clinical situations discussed.
Aspects of the teaching and learning practice which make it particularly effective.
Use of complex 'real-life' cases that incorporate specific medico-legal and ethical issues that may not have arisen in course work or clinical placements previously.
Use of clinical experts to lead 'in-class' discussions.
Incorporation of assessment items designed to lead students to identify case-specific issues and to bring together the students' entire prior learning in physiotherapy AND exercise science.
Effective Aspects:
n/a
Evaluation:
Course evaluations and individual teaching evaluations. Feedback from speakers.
Evaluation Outcomes:
The course has been offered twice (in 2003 and 2004). The following refers to the most recent offering in 2004. Further feedback from 2003 is available on request.
2004 - Teaching evaluation
In 2004, the following questions were posed to students in evaluating each speaker in 5005PES - Clinical Conference:
Relevant topic content to the case study
Applicable content for future clinical needs
Good speaker would like to hear more from them in future
Overall Mean for all speakers (out of total of 5) = 4.2
2004 - Course Evaluation:
Excellent feedback has been obtained in both offerings of the course thus far, eg, in 2004:
"I thoroughly enjoyed this course, the chance to integrate both degrees is great and I think more of this should be done. A good mix of cases was used."
"Great structure to the subject; good idea with the cases and continuing process of management."
"Very good administration, course structured well; Good to have experts from different fields talk."
Sample of specific questions and responses from course evaluation (Likert scale as above, 1-5):
The various aspects of this course worked well together to help me to learn: Mean - 4.1
The level of the course was appropriate to my background. Mean - 4.2
This course was relevant to my vocational/professional needs. Mean - 4.2
The course content helped me to develop skills relevant to my professional needs. Mean 4.2
The overall workload in this course was reasonable. Mean - 4.1
In this course the convenor encouraged students to reflect about what they had learnt. Mean - 4.2
In this course I felt that the teachers respected me as an individual and as a learner. Mean - 4.2
This course helped me to further develop problem-solving skills. Mean - 4.1
The content of this course was clearly related to the objectives stated in the course outline. Mean - 4.0
Plans for Changes/Developments in Future:
Based on 2004 student and speaker feedback for Clinical Conference, a new case will be developed in 2005 to address an identified gap in knowledge.
Based on reflections by the Course Convenor, and student feedback, the final medico-legal written assignment will be replaced by an in-class debate with specific topics related to medico-legal and ethical issues.