RHEP Evaluation Sub-Committee Minutes May 17, 1999 Members Present: Cecil Pollard, Kelly Blake, Trisha Petitte, Helen Baker, Jo Ann Raines, Annie McIntosh, Robert Blake, Steve Thomas, Penny Rose Others present: Elizabeth Richmond, Jacquelynn Copenhaver, April Vestal, Malinda Turner, Mike McCarthy, Kathryn Greenlief, Georgianna Tillis Members absent: Tom Whittier, Ron Fleshman, David Martin, Randy Lowe Survey of Rural Field Experience: Trisha Petitte distributed the results from the Student Survey of Rural Filed Experience to each of the consortia and to the representatives from the various schools/disciplines present at the meeting. The reports were based on data from calendar 1998 were presented in chart form. Malinda Turner asked to have the data for just the second half of 1998 since they had already received data from January through May 1998 and wanted to determine if there were any changes in responses from the first to second half of the year. Kelly Blake agreed address this issue at the site coordinators meeting the following day and notify them that if they want the data broken down for the second half of 1998 and/or would like the open-ended responses for their consortium, they should let Trisha know. Helen Baker suggested that the on-site Directors of Clinical Education receive copies of these Rural Field Experience results. Site coordinators need to forward the name(s) of the Director of Clinical Education to Trisha Petitte. Chair for the Evaluation Committee: Cecil Pollard announced that as of the July WVRHEP meetings he will no longer be serving as the chair of the Evaluation Committee. Funding for his role in the WVRHEP project will cease after June 30, 1999 and although he will still be involved in WVRHEP on overlapping projects, he will no longer direct the evaluation efforts. Jodie Jackson will become a member of the Evaluation Committee in July when she assumes her now role as Director of Research within the WVU Office of Rural Health. Cecil asked the site coordinators to discuss and recommend a nominee(s) to serve as chair and vote will be taken at the July 19th Evaluation Committee meeting. IDS Evaluations: Kelly Blake discussed the Faculty Evaluation of Student's Participation in the Interdisciplinary Session survey instrument. She raised the issue of whether the results of this survey were being used at the schools for grading or other purposes. Helen Baker suggested that if such an assessment is done that it should be used locally by the rural field faculty in determining the grades for student's rural rotations. Cecil Pollard stated that program evaluation and grading or assessment of student's performance have always been separated. The Evaluation Committee is responsible for program evaluation. Elizabeth Richmond suggested developing an IDS form to help field faculty assess student's participation in the IDS sessions solely for grading purposes. Annie McIntosh made a motion to stop using the Faculty Evaluation of Student's Participation in the Interdisciplinary Session survey instrument. Trisha asked that if the motion passed the sites continue using this survey instrument through May 31, 1999 so that an entire year's worth of data would be collected for comparative purposes to previous years' data. A vote was taken and the motion was unanimously passed. It was suggested that the committee write a letter asking field faculty how they are assessing a students' grade for the 20% requirement of IDS and Community Service. Cecil agreed to ask Hilda and or the Schools Committee for input on how this grading is determined. On-line Evaluations: Trisha reported that Mark Allen, of the WVU Office of Rural Health, is working to computerize the IDS Student Evaluation Form for Interdisciplinary Teaching Sessions. The computerized form will be available through TRACKER and should be available for data entry by the end of July. If possible, Mark Allen will provide training on the new data entry screen at the July WVRHEP meetings. Mike McCarthy demonstrated the on-line Survey of Rural Field Experience. The survey can be completed any time from a few days before the rotation ends to anytime after the rotation has been completed. The site coordinators are still going to have to complete some of the information on the survey, such as the "type of rotation" field since the students may not know how to correctly classify their rotation. Another issue is how the narrative comments will be handled. Sites cannot have direct access to these comments before they are properly edited for confidentiality purposes. It was decided that the Office of Health Services Research would compile the open-ended responses prior to making them available on the website. Robert Blake stressed the importance of having a quick turn-around time on getting feedback from these surveys. Mike McCarthy agreed to contact Hilda Heady about having the on-line survey reviewed by the Student Advisory Panel. Meeting Schedule: The meeting schedule will be discussed at the next meeting on July 19th to determine if the committee should meet on a quarterly basis or more frequently. April L. Vestal Associate Director/Site Liaison West Virginia Rural Health Education Partnerships (304) 293-1444 (304) 293-8764 Fax (304) 647-7652 Rainelle Office From <@WVNVM.WVNET.EDU:avestal@wvrhep.org> Tue Sep 7 09:47:21 1999 Return-Path: <<@WVNVM.WVNET.EDU:avestal@wvrhep.org>> Received: from WVNVM.WVNET.EDU (wvnvm.wvnet.edu [129.71.2.4]) by medix.marshall.edu (8.9.3/8.9.3) with SMTP id JAA12245 for ; Tue, 7 Sep 1999 09:47:18 -0400 Received: from 990565 [129.71.227.121] by WVNVM.WVNET.EDU (IBM VM SMTP V2R4a) via TCP with SMTP ; Tue, 07 Sep 1999 09:50:53 EDT Message-Id: <4.2.0.58.19990907095230.00945410@mail.marshall.edu> X-Sender: avestal@mail.marshall.edu X-Mailer: QUALCOMM Windows Eudora Pro Version 4.2.0.58 Date: Tue, 07 Sep 1999 09:52:59 -0400 To: eval@medix.marshall.edu From: April Vestal Subject: 1999-05.txt Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed RHEP Evaluation Sub-Committee Minutes May 17, 1999 Members Present: Cecil Pollard, Kelly Blake, Trisha Petitte, Helen Baker, Jo Ann Raines, Annie McIntosh, Robert Blake, Steve Thomas, Penny Rose Others present: Elizabeth Richmond, Jacquelynn Copenhaver, April Vestal, Malinda Turner, Mike McCarthy, Kathryn Greenlief, Georgianna Tillis Members absent: Tom Whittier, Ron Fleshman, David Martin, Randy Lowe Survey of Rural Field Experience: Trisha Petitte distributed the results from the Student Survey of Rural Filed Experience to each of the consortia and to the representatives from the various schools/disciplines present at the meeting. The reports were based on data from calendar 1998 were presented in chart form. Malinda Turner asked to have the data for just the second half of 1998 since they had already received data from January through May 1998 and wanted to determine if there were any changes in responses from the first to second half of the year. Kelly Blake agreed address this issue at the site coordinators meeting the following day and notify them that if they want the data broken down for the second half of 1998 and/or would like the open-ended responses for their consortium, they should let Trisha know. Helen Baker suggested that the on-site Directors of Clinical Education receive copies of these Rural Field Experience results. Site coordinators need to forward the name(s) of the Director of Clinical Education to Trisha Petitte. Chair for the Evaluation Committee: Cecil Pollard announced that as of the July WVRHEP meetings he will no longer be serving as the chair of the Evaluation Committee. Funding for his role in the WVRHEP project will cease after June 30, 1999 and although he will still be involved in WVRHEP on overlapping projects, he will no longer direct the evaluation efforts. Jodie Jackson will become a member of the Evaluation Committee in July when she assumes her now role as Director of Research within the WVU Office of Rural Health. Cecil asked the site coordinators to discuss and recommend a nominee(s) to serve as chair and vote will be taken at the July 19th Evaluation Committee meeting. IDS Evaluations: Kelly Blake discussed the Faculty Evaluation of Student's Participation in the Interdisciplinary Session survey instrument. She raised the issue of whether the results of this survey were being used at the schools for grading or other purposes. Helen Baker suggested that if such an assessment is done that it should be used locally by the rural field faculty in determining the grades for student's rural rotations. Cecil Pollard stated that program evaluation and grading or assessment of student's performance have always been separated. The Evaluation Committee is responsible for program evaluation. Elizabeth Richmond suggested developing an IDS form to help field faculty assess student's participation in the IDS sessions solely for grading purposes. Annie McIntosh made a motion to stop using the Faculty Evaluation of Student's Participation in the Interdisciplinary Session survey instrument. Trisha asked that if the motion passed the sites continue using this survey instrument through May 31, 1999 so that an entire year's worth of data would be collected for comparative purposes to previous years' data. A vote was taken and the motion was unanimously passed. It was suggested that the committee write a letter asking field faculty how they are assessing a students' grade for the 20% requirement of IDS and Community Service. Cecil agreed to ask Hilda and or the Schools Committee for input on how this grading is determined. On-line Evaluations: Trisha reported that Mark Allen, of the WVU Office of Rural Health, is working to computerize the IDS Student Evaluation Form for Interdisciplinary Teaching Sessions. The computerized form will be available through TRACKER and should be available for data entry by the end of July. If possible, Mark Allen will provide training on the new data entry screen at the July WVRHEP meetings. Mike McCarthy demonstrated the on-line Survey of Rural Field Experience. The survey can be completed any time from a few days before the rotation ends to anytime after the rotation has been completed. The site coordinators are still going to have to complete some of the information on the survey, such as the "type of rotation" field since the students may not know how to correctly classify their rotation. Another issue is how the narrative comments will be handled. Sites cannot have direct access to these comments before they are properly edited for confidentiality purposes. It was decided that the Office of Health Services Research would compile the open-ended responses prior to making them available on the website. Robert Blake stressed the importance of having a quick turn-around time on getting feedback from these surveys. Mike McCarthy agreed to contact Hilda Heady about having the on-line survey reviewed by the Student Advisory Panel. Meeting Schedule: The meeting schedule will be discussed at the next meeting on July 19th to determine if the committee should meet on a quarterly basis or more frequently.