This report informs policy makers and employers about the way Vermont workplaces are affected by domestic violence. It provides important information to help employers make decisions about policy and procedural responses to employees involved in domestic violence.
The pervasiveness and severity of domestic violence perpetrated through workplace resources and work time and the impact of these actions on the workplace is not well known in Vermont or in the U.S. This study offers Vermonters valuable information on domestic violence and the workplace and adds to this growing body of knowledge. The study findings come from a representative sample of men enrolled in batterer intervention programs in Vermont who have abused their intimate partners (95%, +/-4.5%). We focused on domestic violence perpetrated by men against their female intimate partners because the Vermont Criminal Information Center (2009) reported that women are the victim of men in 80% of domestic violence cases. The Vermont Council on Domestic Violence partnered with the Center for Rural Studies at the University of Vermont and Spectrum Youth and Family Services’ Violence Intervention and Prevention Programs to combine our topical and research expertise to design and implement this study. This study examined the impact of domestic violence on the perpetrator and victim’s workplace, including abusive contact at the workplace, paid and unpaid time taken off from work, and productivity and safety. We also examined the workplace response to domestic violence from supervisors, co-workers, and policies and procedures. In addition, offenders’ gave their perspective on useful measures employers can implement to improve the workplace response to domestic violence.
For more information about this study or to request additional copies of this report, please contact Michele Cranwell Schmidt, Evaluation Coordinator, at mschmidt@uvm.edu, call (802) 656-0256 or visit www.uvm.edu/crs/.
Showing posts with label process evaluation. Show all posts
Showing posts with label process evaluation. Show all posts
Wednesday, November 30, 2011
Thursday, December 16, 2010
Local Agriculture Community Exchange (LACE) Final Evaluation Report: 2007-2010
The evaluation of the LACE project focused on both process and outcome strategies; evaluating the effectiveness and efficiency of the program's development and interventions, such as improvements to the LACE space and the presence of CVCAC staff on-site at the LACE location to provide services for entrepreneurs. The evaluation also examines strategies to recruit and retain vendors, the quality of technical assistance provided, and client outcomes such as increased sales, earned income, and job creation. These outcomes were anticipated to result from connecting local producers and entrepreneurs to a viable market. The outcome evaluation provides an assessment of project results as measured by collected data that define the net effects of the interventions applied in the project. The outcome evaluation produces and interprets findings related to whether the interventions produced desirable changes and their potential for being replicated, answering the question of whether or not the program worked. The process evaluation component is an ongoing examination of the implementation of the LACE investment and project, including collaboration among project partners. The results of the process component were provided as a management tool to facilitate continuous project improvement. In documenting project development, the process evaluation also served to help staff identify challenges or barriers, strategies to resolve them, and provided recommendations for future implementation. The process and outcome evaluations utilize both qualitative and quantitative methods, such as telephone and intercept surveys, focus groups, in-depth interviews, and review of database information.
For more information about this study or to request additional copies of this report, please contact Michele Cranwell Schmidt, Evaluation Coordinator, at mschmidt@uvm.edu, call (802) 656-0256 or visit www.uvm.edu/crs/.
For more information about this study or to request additional copies of this report, please contact Michele Cranwell Schmidt, Evaluation Coordinator, at mschmidt@uvm.edu, call (802) 656-0256 or visit www.uvm.edu/crs/.
Wednesday, September 30, 2009
Income to Assets Project: Tax Preparation and Assets Formation in Vermont
The Income to Assets grant serves to increase the capacity of Volunteer Income Tax Assistance (VITA) sites and related services, which is a statewide program of the Vermont Community Action Agencies (CAA). This grant is managed by Central Vermont Community Action Council (CVCAC) with funding from the Office of Community Services, Department of Health and Human Services. Income to Assets serves the multifold purpose of promoting and expanding the use of the Earned Income Tax Credit (EITC), financial literacy programming, asset development and free tax preparation assistance for low-income Vermonters that is carried out by the CAA network in Vermont. Through this project, CVCAC worked with its sister CAAs and other partners to conduct the following three activities:
Data collected by CVCAC during the 2008/2009 tax season demonstrates the impact of VITA services in the central Vermont area. CVCAC assisted 725 households in recovering a total of $1,124,363 which included $405,364 in Earned Income Credits and $191,069 in other credits. They also saved these families an additional $126,825 in tax preparation fees.
The Center for Rural Studies (CRS) at the University of Vermont is the third party evaluator for the Income to Assets grant. This project funding period is from October 2007 through 2010 and consistent data has been collected by CRS in the first and second fiscal years of this grant. This evaluation report informs the goals of the grant through data collected during the 2006/07 (from a previous Income to Assets grant), 2007/08, and 2008/09 tax seasons: 1) Vermonter Poll 2009 statewide data collected on tax preparation practices and asset formation, 2) a survey of VITA clients on their tax practices and use of refunds from 2007-2009, and 3) a focus group with staff to discuss strengths and challenges of the 2008 tax year.
For more information about this study or to request additional copies of this report, please contact Michele Cranwell Schmidt, Evaluation Coordinator, at mschmidt@uvm.edu, call (802) 656-0256 or visit www.uvm.edu/crs/.
- Replication and establishment of additional VITA sites, combined with drop-off filing services, to other regions of the state that are underserved by this program by collaborating with sister CAAs, the Internal Revenue Service, and the Vermont Department of Taxes.
- Exploration of strategies to encourage families to deposit a portion of their refunds and/or credits in an asset building account, such as their Individual Development Account (IDA).
- Evaluation of the Income to Assets grant to determine the impact of VITA services on clients’ use of their refunds and credits; how Vermonters overall prepare their taxes and use their refunds and credits; and best practices for improving VITA services and increasing low-income Vermonters' utilization of these services as well as savings strategies through programs like the IDA.
Data collected by CVCAC during the 2008/2009 tax season demonstrates the impact of VITA services in the central Vermont area. CVCAC assisted 725 households in recovering a total of $1,124,363 which included $405,364 in Earned Income Credits and $191,069 in other credits. They also saved these families an additional $126,825 in tax preparation fees.
The Center for Rural Studies (CRS) at the University of Vermont is the third party evaluator for the Income to Assets grant. This project funding period is from October 2007 through 2010 and consistent data has been collected by CRS in the first and second fiscal years of this grant. This evaluation report informs the goals of the grant through data collected during the 2006/07 (from a previous Income to Assets grant), 2007/08, and 2008/09 tax seasons: 1) Vermonter Poll 2009 statewide data collected on tax preparation practices and asset formation, 2) a survey of VITA clients on their tax practices and use of refunds from 2007-2009, and 3) a focus group with staff to discuss strengths and challenges of the 2008 tax year.
For more information about this study or to request additional copies of this report, please contact Michele Cranwell Schmidt, Evaluation Coordinator, at mschmidt@uvm.edu, call (802) 656-0256 or visit www.uvm.edu/crs/.
Thursday, July 30, 2009
Self-Employment Tax Initiative: Tax Preparation and Assets Formation Practices of Self-Employed Vermonters.
This evaluation report examines the tax preparation practices and use of refunds and credits through a statewide survey and a survey of self-employed clients served by the VITA program offered by the five Vermont Community Action Agencies. This information is important to collect and analyze because tax refund dollars and credits, such as the EITC, provide an injection of cash flow to the average American family and are effective anti-poverty measures for low income families and individuals.
Monday, November 3, 2008
LACE: Local Agricultural Community Exchange
I am currently conducting a 3-year evaluation of process and outcome measures to determine best practices, the impact of services, and the development of a replicable model. Evaluation methods include surveys and focus groups with stakeholders.
The evaluation of the LACE project focuses on both process and outcome methods. The overall evaluation focuses on the effectiveness and efficiency of the program's development and interventions, such as improvements to the LACE space and the presence of CVCAC staff on-site at the LACE location to provide services for entrepreneurs. The evaluation also examines strategies to recruit, assess, and retain vendors, quality of services provided including training and technical assistance, and client outcomes such as increased sales, earned income and job creation. These outcomes are anticipated to result from connecting local producers and entrepreneurs to a viable market. The outcome evaluation provides an assessment of project results as measured by collected data that define the net effects of the interventions applied in the project. The outcome evaluation will produce and interpret findings related to whether the interventions produced desirable changes and their potential for being replicated, answering the question of whether or not the program worked.
The process evaluation component is an ongoing examination of the implementation of the LACE investment and project, including collaboration among project partners. The results of the process component are intended to be a management tool to facilitate continuous project improvement. In documenting project development, the process evaluation also serves to help staff identify challenges or barriers, strategies to resolve them and provide recommendations for future implementation. The process and outcome evaluations will utilize both qualitative and quantitative methods, such as telephone and intercept surveys, focus groups, in-depth interviews, and review of database information.
The evaluation of the LACE project focuses on both process and outcome methods. The overall evaluation focuses on the effectiveness and efficiency of the program's development and interventions, such as improvements to the LACE space and the presence of CVCAC staff on-site at the LACE location to provide services for entrepreneurs. The evaluation also examines strategies to recruit, assess, and retain vendors, quality of services provided including training and technical assistance, and client outcomes such as increased sales, earned income and job creation. These outcomes are anticipated to result from connecting local producers and entrepreneurs to a viable market. The outcome evaluation provides an assessment of project results as measured by collected data that define the net effects of the interventions applied in the project. The outcome evaluation will produce and interpret findings related to whether the interventions produced desirable changes and their potential for being replicated, answering the question of whether or not the program worked.
The process evaluation component is an ongoing examination of the implementation of the LACE investment and project, including collaboration among project partners. The results of the process component are intended to be a management tool to facilitate continuous project improvement. In documenting project development, the process evaluation also serves to help staff identify challenges or barriers, strategies to resolve them and provide recommendations for future implementation. The process and outcome evaluations will utilize both qualitative and quantitative methods, such as telephone and intercept surveys, focus groups, in-depth interviews, and review of database information.
Friday, April 15, 2005
A model food entrepreneur assistance and education program: The Northeast Center for Food Entrepreneurship.
The Northeast Center for Food Entrepreneurship (NECFE) is a collaborative effort between Cornell University and the University of Vermont. NECFE uses a multi-institutional and regional collaboration approach, with specific expertise and necessary facilities and resources, to provide technical assistance and education for businesses in the food industry. The overall goals of NECFE are to support and sustain rural businesses and promote sustainable economic development of rural communities.
Through process evaluation techniques, the evaluators of NECFE identified 5 essential components of a model food entrepreneurship assistance and education center, based on NECFE’s experience: (1) multi-institutional and regional collaboration, (2) expertise, (3) facilities and resources, (4) services, and (5) evaluation of the center. These components build on each other and enable NECFE to provide clients with access to current food processing technology, technical information, and education that are directly applicable to a real business.
Through replication of this model, other organizations and academic institutions may establish a regional food entrepreneurship assistance and education center.
Cranwell, M., J. Kolodinsky, C. Donnelly, D.L. Downing, and O. Padilla Zakour. (2005). A model food entrepreneur assistance and education program: The Northeast Center for Food Entrepreneurship.. Journal of Food Science Education, 4(4): 56-65.
Through process evaluation techniques, the evaluators of NECFE identified 5 essential components of a model food entrepreneurship assistance and education center, based on NECFE’s experience: (1) multi-institutional and regional collaboration, (2) expertise, (3) facilities and resources, (4) services, and (5) evaluation of the center. These components build on each other and enable NECFE to provide clients with access to current food processing technology, technical information, and education that are directly applicable to a real business.
Through replication of this model, other organizations and academic institutions may establish a regional food entrepreneurship assistance and education center.
Cranwell, M., J. Kolodinsky, C. Donnelly, D.L. Downing, and O. Padilla Zakour. (2005). A model food entrepreneur assistance and education program: The Northeast Center for Food Entrepreneurship.. Journal of Food Science Education, 4(4): 56-65.
Friday, December 10, 2004
Evaluating a domestic violence task force: Methods to strengthen a community collaboration.
A domestic violence collaborative was surveyed to evaluate and make recommendations for strengthening membership, structure, and cohesiveness.
This article presents the evaluation methods, key findings, recommendations, and the outcome of their implementation. Areas identified for improvement include: membership diversification, membership-driven agenda, improved sub-committees, and increased community involvement through outreach. A revised meeting format, agenda setting strategy, sub-committee parameters, and the addition of quarterly meetings were recommended and implemented. This model received positive feedback as a method to strengthen collaboratives.
The case study demonstrates how evaluation research can be linked to practice to make real improvements to a community collaborative.
Cranwell, M., J. Kolodinsky, K. Anderson, and F. Schmidt. (2004). Evaluating a domestic violence task force: Methods to strengthen a community collaboration." Journal of Extension, 42(6).
This article presents the evaluation methods, key findings, recommendations, and the outcome of their implementation. Areas identified for improvement include: membership diversification, membership-driven agenda, improved sub-committees, and increased community involvement through outreach. A revised meeting format, agenda setting strategy, sub-committee parameters, and the addition of quarterly meetings were recommended and implemented. This model received positive feedback as a method to strengthen collaboratives.
The case study demonstrates how evaluation research can be linked to practice to make real improvements to a community collaborative.
Cranwell, M., J. Kolodinsky, K. Anderson, and F. Schmidt. (2004). Evaluating a domestic violence task force: Methods to strengthen a community collaboration." Journal of Extension, 42(6).
Tuesday, September 30, 2003
Vermont Kitchens Project, 2000-2003
The Vermont Kitchens Project is operated out of Central Vermont Community Action Council, Inc., located in Barre, Vermont, with grant funding provided by the JOLI program from the Department of Health and Human Services, Office of Community Service. The Vermont Kitchens Project focuses on self-employment strategies of micro-business development and expansion for income qualified individuals. Through JOLI funding, the project offers core business training with industry-specific training; links participants with marketing resources; and provides intensive case management that continues beyond start-up for the duration of the project. A major anticipated outcome of the Vermont Kitchens project is that participants who complete the program will earn decent incomes, have access to benefits such as health care and child care, and experience growth in their businesses.
Two main evaluation activities were conducted during the third fiscal year of the Vermont Kitchens Project from September 1, 2002 to August 31, 2003. These include a client follow up survey and four client focus groups.
For more information about this study or to request additional copies of this report, please contact Michele Cranwell Schmidt, Evaluation Coordinator, at mschmidt@uvm.edu, call (802) 656-0256 or visit www.uvm.edu/crs/.
Two main evaluation activities were conducted during the third fiscal year of the Vermont Kitchens Project from September 1, 2002 to August 31, 2003. These include a client follow up survey and four client focus groups.
For more information about this study or to request additional copies of this report, please contact Michele Cranwell Schmidt, Evaluation Coordinator, at mschmidt@uvm.edu, call (802) 656-0256 or visit www.uvm.edu/crs/.
Monday, December 31, 2001
The Vermont Millennium Arts Partnership Evaluation, 1998-2001
The Vermont Millennium Arts Partnership (VT-MAP) is an Internet-based arts education program, providing an online forum to facilitate student learning through an exchange among students, teachers, artists, musicians, and other professionals. Several initiatives are involved in this project. The Vermont Musical Instrument Digital Interface Project (MIDI) was established in 1995 and Art Responding Through Technology (ARTT) was established in 1997 based on the model of the MIDI Project. The MIDI and ARTT projects were part of the predecessor initiative on which VT-MAP is based, the WEB Project. More recently, the Vermont Young Playwrights Online (VYP Online), a part of the Vermont Stage Company, joined this project in 2000. An offshoot of the MIDI project is the Digital Audio Initiative, which also joined the project in 2000. VT-MAP is a program of the Vermont Arts Council, operating in conjunction with MIDI, ARTT, VYP Online, the Vermont Alliance for Arts Education, and the Vermont Department of Education. Funding is provided through a grant from the U.S. Department of Commerce's Technology Opportunities Program, with other funding coming from the Jesse B. Cox Charitable Trust, Josephine Bay and C. Michael Paul Foundation, the State of Vermont, IBM, and Verizon.
In the last fiscal year of grant funding, from July 1, 2000 to June 30, 2001, VT-MAP awarded competitively funded grants to twenty-four schools (39 classroom teachers) in twelve counties throughout Vermont to participate in either the Vermont MIDI Project or ARTT. An additional ten schools participated in VYP Online, receiving funding to purchase software and attend teacher professional development training, and two additional schools received equipment to participate in MIDI's Digital Audio Initiative. Including the past two fiscal years, a total of 54 teachers in 34 schools have received grants and assistance through VT-MAP.
Classroom involvement in VT-MAP exposes students to the art, musical, and written creations of their peers, the language of critique in the Arts, the critique of their work by professional artists, and the creative possibilities to learn and share through the integration of technology into the classroom and class instruction. Students, teachers, administrators, and online mentors subscribe to a common protocol for sharing work online using a password protected website, which is based on the experience of online sharing undertaken by the Vermont MIDI Project in 1995.
The three projects focus their work and student learning on several Vermont and National Standards of Education, specifically the Vital Results of the Vermont Framework of Standards and Learning Opportunities. In classroom learning and the online network also address standards that focus on Reflection and Critique and Skill Development of young composers.
The Center for Rural Studies (CRS) at the University of Vermont is the evaluator of VT-MAP for the three-year grant period from July 1, 1998 to June 30, 2001. This evaluation is primarily based upon qualitative data collected through online and paper surveys, with supplemental quantitative data from surveys and website activity. The model of evaluation documents the project‟s implementation or process and resulting outcome of the project. Project process refers to the experience that takes place in the classroom and outcomes refer to the outcomes of teacher and student participation in the online forum and related in-classroom activities, specifically student performance and achievement based on Vermont and National Standards.
For more information about this study or to request additional copies of this report, please contact Michele Cranwell Schmidt, Evaluation Coordinator, at mschmidt@uvm.edu, call (802) 656-0256 or visit www.uvm.edu/crs/.
In the last fiscal year of grant funding, from July 1, 2000 to June 30, 2001, VT-MAP awarded competitively funded grants to twenty-four schools (39 classroom teachers) in twelve counties throughout Vermont to participate in either the Vermont MIDI Project or ARTT. An additional ten schools participated in VYP Online, receiving funding to purchase software and attend teacher professional development training, and two additional schools received equipment to participate in MIDI's Digital Audio Initiative. Including the past two fiscal years, a total of 54 teachers in 34 schools have received grants and assistance through VT-MAP.
Classroom involvement in VT-MAP exposes students to the art, musical, and written creations of their peers, the language of critique in the Arts, the critique of their work by professional artists, and the creative possibilities to learn and share through the integration of technology into the classroom and class instruction. Students, teachers, administrators, and online mentors subscribe to a common protocol for sharing work online using a password protected website, which is based on the experience of online sharing undertaken by the Vermont MIDI Project in 1995.
The three projects focus their work and student learning on several Vermont and National Standards of Education, specifically the Vital Results of the Vermont Framework of Standards and Learning Opportunities. In classroom learning and the online network also address standards that focus on Reflection and Critique and Skill Development of young composers.
The Center for Rural Studies (CRS) at the University of Vermont is the evaluator of VT-MAP for the three-year grant period from July 1, 1998 to June 30, 2001. This evaluation is primarily based upon qualitative data collected through online and paper surveys, with supplemental quantitative data from surveys and website activity. The model of evaluation documents the project‟s implementation or process and resulting outcome of the project. Project process refers to the experience that takes place in the classroom and outcomes refer to the outcomes of teacher and student participation in the online forum and related in-classroom activities, specifically student performance and achievement based on Vermont and National Standards.
For more information about this study or to request additional copies of this report, please contact Michele Cranwell Schmidt, Evaluation Coordinator, at mschmidt@uvm.edu, call (802) 656-0256 or visit www.uvm.edu/crs/.
Labels:
process evaluation,
program evaluation
Thursday, May 31, 2001
The Teens Teaching Internet Skills Project
The Teens Teaching Internet Skills (TTIS) Project is a national initiative involving youth and adults from the 4-H Technology Teams in six states, including: Connecticut, Florida, Iowa, Maryland, Virginia, and Washington. This is a pilot project for a future, larger, national effort to engage youth in training individuals to navigate and obtain the needed information from the Medicare web site. The Center for Rural Studies (CRS) at the University of Vermont is the evaluator of the TTIS project. This evaluation report focuses on two distinct areas, including "best practice" of the process of the project and “learning outcomes” of the workshop participants, specifically whether or not the learner acquired computer and Internet skills to navigate and benefit from information on the Medicare website.
Based on qualitative data collected during the teen focus groups held at the National Training in Maryland in August 1999, the evaluators identified several initial expectations of the teens as well as ways to improve the training in the future. From the onset of their involvement, the teens felt there was a need for this program, as they felt that this project would serve to introduce or improve upon the computer and Internet skills of Seniors, allowing them to use and benefit from the information on the Internet. Initially, many of the teens did not have a definitive game plan, however, it was helpful for the teens to confer with one another, as they were able to gain a idea of how to initiate the project in their home state through this discussion. Many of the teens mentioned that it would be helpful in the future, to inform the teens prior to the training of the purpose of their involvement in the project and the focus of teaching Seniors Internet skills to search the Medicare website. The evaluators note that during future trainings, the participating Tech Teams should be informed of the importance of the workshop intake and evaluation forms, the need to use them, and how to use them correctly so representative data may be collected on the project’s impact on the learner.
Following the training in August 1999, from September 1999 to April 2000, the Technology Teams held a total of fourteen TTIS workshops, training one hundred and nineteen participants, most of whom were Senior Citizens and a few Care Givers. Based on qualitative data from the teens and adults, via a focus group questionnaire and periodic team updates, as posted on the TTIS listserves, the evaluators have identified several successful techniques that the teams have implemented for workshop preparation. These include identifying appropriate teens and training them to hold a workshop for Senior Citizens; developing and modifying an agenda depending on skill level, special interests, and size of the group; methods to advertise workshops based on the characteristics of the community; and finding suitable locations for conducting workshops, such as local schools, Senior Centers, and libraries.
The evaluation also reports on successful techniques used by the teams for handling a variety of learning situations. The teams reported that having a one to one ratio of participants to learners, use of small groups at workshops, being flexible to modify the agenda, and advertising for an audience with basic computer skills, are successful techniques for dealing with differing technological skill levels among learners. The teams also identified the use of ice-breaker techniques, such as playing solitaire and other computer games, as a helpful method to increase the comfort and confidence level of the participants in using the technology. They also noted that it is important to review with Seniors "next steps" at the end of the workshop, so the learners may continue to practice and benefit from their skills.
This report also includes a section on “lessons learned” from the pilot project for improvement of future workshops. The teams stressed the necessity of collaboration with local Senior Centers and schools for recruiting, advertising, and use of facilities for workshops. Further, it is important for teams to know the abilities and interests of their learners either before or at the beginning of workshops, in order to modify the agenda to meet the needs of the participants. The teams also mentioned that time commitment from both the adults and teens is a crucial element to the success of this project. This evaluation also reviews common problems encountered in conducting workshops and remedies for various situations, such as low attendance at workshops, technical problems, and other constraints such as time, travel, and the size of the technology team.
Further, this evaluation includes an analysis of the intake and evaluation forms that the learners completed before and immediately after the workshop, respectively. Although the use of the intake and evaluations were low among the teams, the results suggest that the target audience are primarily Senior Citizens who are eligible for Medicare (average age was 67), however Care Givers have expressed interest and attended a few workshops. Half of the respondents to the intake questionnaire have computer and Internet access in their homes, however few respondents reported using facilities that are open to the public. Further, approximately half report using computers on a daily basis and a third use the Internet daily. On the other hand, about a quarter of the respondents do not have access to a computer or the Internet, and the majority reported seldom or never using computers and the Internet. The respondents reported having minimal skills in using the computer, the Internet, and the Medicare website, however most people showed a desire to improve their skills, specifically searching on the Internet and using E-mail. About two-thirds of respondents were not aware of the tool “searching the Medicare website”. The major goals of the respondents for attending the workshop were to increase their comfort and skill level in working with computers and using the Internet in general. Almost a third of the respondents indicated learning how to use and search the Medicare website and to better inform themselves about Medicare, was a goal for attending the workshop.
A positive response was received from the learners, as over 80% of respondents indicated their skills with using computers and the Internet have improved after the workshop, compared to before the workshop where almost three-quarters of respondents doubted their skills at using the computer and the Internet. After the workshop, sixty-five percent indicated they were comfortable searching the Medicare website and half indicated a desire to search the Medicare website for information in the future. The learners were also pleased with the teaching ability of the teens and adults. Over 80% of persons said they would recommend this workshop to their friends and family.
The six month follow up with seven of the Seniors who agreed to be contacted and were able to be reached, indicate that their perceived comfort and skill level with computers has remained high following a longer period of time after the workshop. However, the results were not as positive for the Internet. This suggests that the TTIS workshops had an immediate and positive effect on Seniors perceived comfort and skill level towards technology. However, after a longer period of time following the workshop, the comfort and skill level decreased for some of the seniors in using the Internet.
Results from the post test of the project administered to the teen trainers indicate that the teens perceive a positive change in all skill areas, specifically working with Senior Citizens, skills related to project management and teaching, public speaking, leadership, and knowledge and understanding of the Medicare website. Further, this intergenerational experience led to a positive change in attitude of the teens towards working with Senior Citizens and teaching them skills in technology. This change in attitude included an increased comfort level and belief that Seniors are willing, able, and open to learning new technology.
This intergenerational experience fostered a positive attitude among the Seniors, with regards to their comfort in working with teens and the teens’ respect for, ability to teach, and patience with Senior Citizens. Overall, results suggest that intergenerational learning experiences benefit both parties in learning and skill development and led to a positive change in attitude towards the other generation.
For more information about this study or to request additional copies of this report, please contact Michele Cranwell Schmidt, Evaluation Coordinator, at mschmidt@uvm.edu, call (802) 656-0256 or visit www.uvm.edu/crs/.
Based on qualitative data collected during the teen focus groups held at the National Training in Maryland in August 1999, the evaluators identified several initial expectations of the teens as well as ways to improve the training in the future. From the onset of their involvement, the teens felt there was a need for this program, as they felt that this project would serve to introduce or improve upon the computer and Internet skills of Seniors, allowing them to use and benefit from the information on the Internet. Initially, many of the teens did not have a definitive game plan, however, it was helpful for the teens to confer with one another, as they were able to gain a idea of how to initiate the project in their home state through this discussion. Many of the teens mentioned that it would be helpful in the future, to inform the teens prior to the training of the purpose of their involvement in the project and the focus of teaching Seniors Internet skills to search the Medicare website. The evaluators note that during future trainings, the participating Tech Teams should be informed of the importance of the workshop intake and evaluation forms, the need to use them, and how to use them correctly so representative data may be collected on the project’s impact on the learner.
Following the training in August 1999, from September 1999 to April 2000, the Technology Teams held a total of fourteen TTIS workshops, training one hundred and nineteen participants, most of whom were Senior Citizens and a few Care Givers. Based on qualitative data from the teens and adults, via a focus group questionnaire and periodic team updates, as posted on the TTIS listserves, the evaluators have identified several successful techniques that the teams have implemented for workshop preparation. These include identifying appropriate teens and training them to hold a workshop for Senior Citizens; developing and modifying an agenda depending on skill level, special interests, and size of the group; methods to advertise workshops based on the characteristics of the community; and finding suitable locations for conducting workshops, such as local schools, Senior Centers, and libraries.
The evaluation also reports on successful techniques used by the teams for handling a variety of learning situations. The teams reported that having a one to one ratio of participants to learners, use of small groups at workshops, being flexible to modify the agenda, and advertising for an audience with basic computer skills, are successful techniques for dealing with differing technological skill levels among learners. The teams also identified the use of ice-breaker techniques, such as playing solitaire and other computer games, as a helpful method to increase the comfort and confidence level of the participants in using the technology. They also noted that it is important to review with Seniors "next steps" at the end of the workshop, so the learners may continue to practice and benefit from their skills.
This report also includes a section on “lessons learned” from the pilot project for improvement of future workshops. The teams stressed the necessity of collaboration with local Senior Centers and schools for recruiting, advertising, and use of facilities for workshops. Further, it is important for teams to know the abilities and interests of their learners either before or at the beginning of workshops, in order to modify the agenda to meet the needs of the participants. The teams also mentioned that time commitment from both the adults and teens is a crucial element to the success of this project. This evaluation also reviews common problems encountered in conducting workshops and remedies for various situations, such as low attendance at workshops, technical problems, and other constraints such as time, travel, and the size of the technology team.
Further, this evaluation includes an analysis of the intake and evaluation forms that the learners completed before and immediately after the workshop, respectively. Although the use of the intake and evaluations were low among the teams, the results suggest that the target audience are primarily Senior Citizens who are eligible for Medicare (average age was 67), however Care Givers have expressed interest and attended a few workshops. Half of the respondents to the intake questionnaire have computer and Internet access in their homes, however few respondents reported using facilities that are open to the public. Further, approximately half report using computers on a daily basis and a third use the Internet daily. On the other hand, about a quarter of the respondents do not have access to a computer or the Internet, and the majority reported seldom or never using computers and the Internet. The respondents reported having minimal skills in using the computer, the Internet, and the Medicare website, however most people showed a desire to improve their skills, specifically searching on the Internet and using E-mail. About two-thirds of respondents were not aware of the tool “searching the Medicare website”. The major goals of the respondents for attending the workshop were to increase their comfort and skill level in working with computers and using the Internet in general. Almost a third of the respondents indicated learning how to use and search the Medicare website and to better inform themselves about Medicare, was a goal for attending the workshop.
A positive response was received from the learners, as over 80% of respondents indicated their skills with using computers and the Internet have improved after the workshop, compared to before the workshop where almost three-quarters of respondents doubted their skills at using the computer and the Internet. After the workshop, sixty-five percent indicated they were comfortable searching the Medicare website and half indicated a desire to search the Medicare website for information in the future. The learners were also pleased with the teaching ability of the teens and adults. Over 80% of persons said they would recommend this workshop to their friends and family.
The six month follow up with seven of the Seniors who agreed to be contacted and were able to be reached, indicate that their perceived comfort and skill level with computers has remained high following a longer period of time after the workshop. However, the results were not as positive for the Internet. This suggests that the TTIS workshops had an immediate and positive effect on Seniors perceived comfort and skill level towards technology. However, after a longer period of time following the workshop, the comfort and skill level decreased for some of the seniors in using the Internet.
Results from the post test of the project administered to the teen trainers indicate that the teens perceive a positive change in all skill areas, specifically working with Senior Citizens, skills related to project management and teaching, public speaking, leadership, and knowledge and understanding of the Medicare website. Further, this intergenerational experience led to a positive change in attitude of the teens towards working with Senior Citizens and teaching them skills in technology. This change in attitude included an increased comfort level and belief that Seniors are willing, able, and open to learning new technology.
This intergenerational experience fostered a positive attitude among the Seniors, with regards to their comfort in working with teens and the teens’ respect for, ability to teach, and patience with Senior Citizens. Overall, results suggest that intergenerational learning experiences benefit both parties in learning and skill development and led to a positive change in attitude towards the other generation.
For more information about this study or to request additional copies of this report, please contact Michele Cranwell Schmidt, Evaluation Coordinator, at mschmidt@uvm.edu, call (802) 656-0256 or visit www.uvm.edu/crs/.
Labels:
process evaluation,
program evaluation
Subscribe to:
Posts (Atom)