Assignments
Recent and Current Assignments
Evaluation of Farm Family Counselling project, 2006-present
This project is being implemented by Haldimand-Norfolk Resource Education And Counselling Help (R.E.A.C.H.), in association with counselling servcies throughout rural Ontario . It is funded by Trillium Foundation and Harry and colleagues designed and are managing the implementaion of the evaluation. The work includees participatory workshops, focus groups, and surveys and the development of a counselling program for farm families.
Institutional Assessment and Policy Analysis of the Rural Integrated Water, Sanitation and Hygiene Project (RIWASH), World Vision Canada, 2006
HCA was contracted by World Vision Canada to conduct an Institutional Assessment and Policy Analysis of the tsunami affected areas of the North Eastern region of Sri Lanka . The government of Sri Lanka has been implementing the National Rural Water Supply and Sanitation (RWSS) Policy in Sri Lanka . World Vision Canada 's RIWASH project hopes to build on that policy by enhancing capacity of the Provincial Council, Pradeshiya Sabhas, community based organizations, and other Partner Organizations. A team of Canadian and International HCA Associates will be developing a performance framework and conducting a stakeholder analysis in order to provide World Vision with a clear understanding of the role, relative power, influence and interest in the RIWASH project. HCA will also gather information from stakeholders to provide information on the RWSS policy and the relationship between the different stakeholders. A gender analysis will be conducted.
Private Career College Student Survey, Ministry of Education, Government of Nova Scotia, Current
HCA is conducting a survey of 1,200 private career college students on behalf of the Nova Scotia Department of Education. The main objective of the student survey is to determine employment outcomes of private career college graduates one year after program completion, as well as to collect information about their college and employment experiences and how it relates to their program of study. A further objective of the survey is to collect information from students who did not complete their program of study, identify their college experiences, and determine what they suggest can be done in the future to encourage more students to succeed in their program and graduate. The survey results will serve to address the information gap associated with the increasing number of private colleges and graduates from these institutions. The survey information will provide a basis upon which evolving labour market needs may be identified, leading to the development of new training programs and to modifications of the existing ones.
Supply-side Survey of Microfinance Services in Urban and Rural Tanzania, MEDA , 2006
HCA is assisting Mennonite Economic Development Associates (MEDA) in developing and reviewing a technical proposal for a supply-side survey of over 1,800 microfinance services in urban and rural Tanzania . The proposal is being prepared at the request of the Financial Sector Deepening Trust of Tanzania (FSDT), which is a pool of donor funds earmarked for microfinance activities in the country (CIDA, DFID, Dutch and World Bank). Microfinance services include transaction needs, savings, credit and insurance (life, burial, health and short-term insurance).
Skills for Healthcare Attraction and Retention Pilot (SHARP), Huron Business Centre, Huron, ON, Current
In this project HCA is assisting the Huron Business Centre their endeavour to attract and retain of health care providers to rural areas by providing evaluation support for the SHARP programme. As part of that support, an evaluation workshop is planned together with drafting an evaluation plan including a project logic model and evaluation matrix. Survey questionnaires are to be developed and assistance will be given with their distribution. HCA's team will also provide assistance in the data analysis and in report writing.
East Wellington Family Health Team (FHT) Health Needs and Service Research project, East Wellington Health Team, Erin, ON, February- March 2006
The main objective of this survey research project was to determine current usage patterns of doctors and other health care professionals by East Wellington residents and to explore variations in these patterns by different demographic variables (e.g. place of residence, gender, age, income, etc.). This assignment contributed to the development of a comprehensive business plan for the East Wellington Family Health Team. The information collected through the survey represents important baseline data that can serve as a benchmark for tracking the progress of the FHT initiative. A telephone survey of 375 residents was conducted in order to provide a confidence level of 95%. The final report was presented to the Steering Committee three weeks after the initiation of the survey.
Participatory Evaluation of the Rural Philanthropy Resource Network, The Foundation for Rural Living (FRL), Current
HCA is facilitating a participatory process and carrying out evaluation activities for the Rural Philanthropy Resource Network. The ongoing monitoring and evaluation of the project will continue through to 2008. In the first phase of the evaluation HCA has conducted a series of workshops with project stakeholders in order to gather input into a draft evaluation plan. HCA will then work with stakeholders to implement the plan. In the first phase of the evaluation it is proposed that key informant interviews will be used to collect data on project outcomes. In the second and third phase of the evaluation photo novella and key informant interviews will be used to examine success stories and challenges of being involved with the Network. This information will help inform and shape the model as it is tested in Ontario and expanded to Manitoba and Nova Scotia .
Performance Evaluation of The Ontario Rural Council, April – May 2006
As part of their contract for funding received from Agriculture and Agri-Food Canada , The Ontario Rural Council (TORC) was required to conduct a performance evaluation of the Networking Initiative that has been taking place since January 2004. HCA were retained to assess the efficiency of the initiative and how successful it has been at reaching the desired networking and capacity building outcomes. The HCA team facilitated a participatory evaluation planning process with the evaluation Steering Committee, drafted an Evaluation Plan, carried out 25 key informant interviews, held a focus group with TORC members and drafted a performance evaluation report.
Evaluation of the Ontario College of Pharmacists Self Assessment Survey , Ontario College of Pharmacists , April 2006- Current
HCA is working with the Ontario College of Pharmacists (OCP) to complete a formative evaluation on the function of the OCP Self Assessment Survey (SAS). The SAS was last revised 7 years ago. It is undergoing revision to ensure it addresses current issues for pharmacists and supports their efforts with continuing education and quality assurance in practice. HCA will be conducting focus groups with key stakeholders to identify the needs of pharmacists throughout Ontario after meeting with representatives from the OCP. Harry and Alain Cummings have developed a focus group guide and questionnaire to support these focus groups. A report will be created, outlining the current perceived function of the SAS, and suggestions for revisions in the near future.
Strategic Plan for the Northern Producer Animal Health Network, Current
HCA prepared a Strategic Plan for the Northern Producer Animal Health Network (NPAHN) in 2006. NPAHN was established in 1945 to promote the viability of the livestock industry by ensuring sufficient access to large animal veterinary care in under serviced areas. The 2006 Strategic Plan was prepared in response to emerging opportunities and challenges facing animal producers in northern Ontario . As a first step in this process HCA conducted a document review of NPAHN files including a recent evaluation (2001) of the Veterinarian Assistance Program (VAP). HCA then facilitated a planning session with the NPAHN Board of Directors which included a SWOT analysis. The final draft of the strategic plan identified the strengths, weaknesses and opportunities associated with the NPAHN. It also identified realistic and measurable goals and objectives.
Evaluation of Two Video-Conferencing Pilot Projects Providing Enhanced Access to Specialized Clinical Services for Individuals with a Developmental Disability, the Ministry of Community and Social Services – Developmental Services Branch January –March 2006
HCA used a participatory and capacity building approach to develop an Evaluation Plan with input from a large project Steering Committee. A one-day workshop was held with stakeholders from across Ontario who joined both in person and via video and teleconferencing. An Evaluation Plan was developed that incorporated a variety of viewpoints to meet the needs of all of the stakeholders. The plan was finalized using a participatory half-day workshop. HCA carried out the evaluation with a wide range of stakeholders across rural and remote regions of Southwestern and Northwestern Ontario . Activities included analysis of data that is currently being collected, site visits, focus groups and key informant interviews. A final report was prepared with input from the Steering Committee.
Region of Waterloo Food Flow Analysis, Region of Waterloo , Health Determinates and Evaluation Branch, Waterloo , ON 2005
The Region initiated several studies to gain a better understanding of the local food system which included assessments of the agricultural economy, access to food, rural health, and consumer attitudes in relation to buying locally grown and processed food. With the completion of this foundation research, Public Health initiated the Farms that Sell Locally Viability Plan in the Fall of 2004 to identify supports and barriers for farmers selling food locally (Region of Waterloo) in order to develop a plan for increasing local food production, processing, and consumption. The plan consists of five interrelated studies including: Food Flow Study; Optimal Nutrition Environment Scenario (ONE); Food Miles Study; The Marketing of Buy Local! Buy Fresh!; Redundant Trade Study (RT). HCA was contracted to complete the report on the Food Flow study in which a variety of methodologies were used. An annotated bibliography was developed and Waterloo Region “Food Basket” was created. HCA also identified the type and quantity of agricultural production and the type and quantity of locally produced agricultural products were processed in the region. In addition HCA identified the type of locally produced food items sold in Waterloo region. To aid in the identification process significant survey work was carried out with telephone interviews of producers and processors along with in store surveys.
Christian Children Fund Canada 2005 Conference, June 2005
HCA was engaged by Christian Children Fund Canada (CCFC) to assist them in the development of a Results Based Evaluation and Monitoring system for their international operations. HCA helped design the system, including major questionnaire survey initiatives, and link it to the new Strategic Planning cycle developed by CCFC. The evaluation and monitoring plan was presented to the CCFC international conference in June 2005.
Evaluation Training and Consultative Process for the College of Respiratory Therapists of Ontario, 2005- Current
HCA has designed and carried out a consultative process with Respiratory Therapy managers and College membership regarding a Baccalaureate Degree level entry-to practice for respiratory therapy in Ontario . A capacity building workshop regarding results based management and evaluation was first held with the CRTO Board. The consultation was a participatory approach and included key informant interviews and focus groups at hospitals in Ottawa , Toronto , London , Hamilton and Sudbury where participants also joined the group via web and teleconferencing. A second, member survey phase of this study is currently being developed in partnership with the CRTO.
Action Plan Refinement and Pilot Phase Evaluation Plan Development “Tap Into Employability”, Coalition for Persons with Disabilities, Current
HCA have been involved in capacity building with stakeholders of the Tap Into Employability Project. Our Consultants acted in an advisory role and conducted stakeholder focus groups with persons with a variety of disabilities. HCA also delivered a two-day Program Logic Model and Evaluation Matrix workshop to the Project Advisory Group and developed an Evaluation Plan based on that workshop. This included the design of data collection tools, including surveys and a report card, and developing an information management system. The Project Coordinator was trained by HCA to use the information management system and deliver the surveys. They also worked together to conduct pre-tests of the tools. HCA will continue to act in an advisory role as the Pilot Phase Evaluation is being conducted.
Evaluation Training Sessions & Manual Development for Guelph Community Health Centre (GCHC) and Partner CHCs, Current
HCA were contracted to deliver four capacity building training sessions to GCHC and five partner CHCs. Two of the sessions have been carried out to date. Staff are being trained in developing program logic models, designing and interpreting client satisfaction surveys, designing and implementing evaluation research and analyzing and disseminating evaluation data. Self-directed learning guides are being developed as a supplement to each session and for future staff orientation and education. Interactive, group work techniques are being used.
Evaluation of the In-Market Trade Development Consultants and In-Market Business Development Consultants Programs for the Ministry of Economic Development and Trade, 2005
HCA measured the level of client satisfaction with the ITDC and IBDC programs, as well as the economic impact of the program over a three-year period by conducting telephone surveys with key informants and business clients. Recommendations were made regarding program changes to enhance delivery and expected outcomes, as well as appropriate performance metrics to gauge the effectiveness and success of the programs.
Assessment of effects of Bell and Nortel High Speed Internet Services on the businesses of Chapleau, ON Bell and Nortel 2005 - on-going
Chapleau is an isolated northern Ontario community that has been greatly affected by dramatic job loss due to plant closures. The Chapleau Regional Development Corporation (CRDC) initiated the installation of high speed Internet services in order to assist in raising quality of life and promote the creation of jobs. Bell and Nortel provided free wireless high-speed access for the core town and wired access for the balance of the town and three neighbouring First Nations Communities. Dr. Cummings and his colleagues at the University of Guelph were asked to assess the impact of new high speed systems on businesses in Chapleau. They used focus groups, or survey and key informant interviews. The three objectives were assessment of the presence of key material, mental, social and cultural resources for the adoption of the broadband and to determination of the level of ownership of the project and its related interventions by businesses; and finally determination of the degree of change in businesses' daily operations since the implantation of the high speed Internet service. Phase I has been completed. Phase II will be completed in early 2007.
Results Based Management and Evaluation Workshop for Health Professionals, April 2005
This workshop was designed to help regulators and management of healthcare systems increase their understanding of systematic approaches to evaluation and gain transferable skills. An active and participatory learning process was used for the examination of Results Chain and Program Logic Model approaches.
The Bruce-Grey Skills Inventory - Past and Future, Bruce-Grey-Huron-Perth-Georgian Triangle and Human Resources Skills Development, Bruce Grey Huron Perth Training Board. 2004-2005
Harry Cummings as Principal Investigator of this project administered through the University of Guelph led his team of graduate students in gathering information that contributed to an understanding of the present and future state of the labour market in Bruce and Grey Counties . With this information an appreciation of the potential gaps between the needs of employers and the skill base of the labour pool in the region was identified and addressed. In order to gather this information three surveys were conducted. One involved the population of Bruce and Grey Counties at large with the purpose being to identify the skills of the existing labour pool. The second called upon employers in the region to identify training and skills that will be necessary to capitalize on employment opportunities in the future. The final survey was administered to high school students in Bruce and Grey with the objective being to investigate the skills and aspirations of the region's potential labour pool.
Assessment of Future Training Demands, Huron and Perth Community Mapping Report, Avon Maitland District School Board, Fanshawe College, the Bruce Grey Huron Perth Georgian Triangle Training Board and Human Resources and Skills Development Canada in addition Office of Learning Technologies, the Community Learning Networks divisions of Human Resources Skills Development Canada. 2005-2006
The study area was in the counties of Huron and Perth containing a mostly non-urban population of less than 150,000. The main goal of the project was to assess the labour market, map the community assets related to training and to assess the demand for distance learning courses as a tool for labour market development. Two objectives were to assess the viability of an on-line learning network for employment training and to develop an outline of the overall employment skills present and needed in the area. The study unfolded in two phases, in the initial phase a survey was administered in all grade 12 English classes in Huron and Perth . The survey assessed the work and computer skills of students. In addition a telephone survey was conducted of training organizations in order to gather information on all forms of training available. In the second phase of the project, a telephone survey was utilized to determine the skills of employees. Four focus groups were held with employers in which they were asked to indicate the types of skills they desire for their employees.
Patient Relations Review – Health Professions Regulatory Advisory Council (HPRAC), January - June, 2005
HCA conducted a comprehensive literature review and developed a conceptual framework for HPRAC. Issues covered include current challenges to patient relations faced by the 21 Ontario Colleges of Health; program goals, objectives and expected outcomes; scope and components of a model PR program; and guidelines for conduct. A number of jurisdictions were examined for best practices. A consultative process to gather input from Colleges on the development of a model PR program was also designed.
Analysis of National Sport Policy, The Federal-Provincial and Territorial Sport Committee (FPTSC), 2004-2005
Analysed sport policy that was national in scope and involved all federal, provincial and territorial governments. The policy was created with a joint federal-provincial sport secretariat and thus the analysis involved input from government and community stakeholders across Canada .
Workshop on Building Evaluation into Funding Proposals and On-going Programming for Guelph Wellington Volunteer Centre, 2005
HCA carried out this workshop with member organizations of the Guelph Wellington Volunteer Centre. Participants learned about evaluation plans and worked through Program Logic Model development exercises. The importance of an evaluation plan to funding applications for organizations such as the United Way and Trillium was discussed. Evaluation planning skills were applied to these funding applications.
Review of the Quality Assurance Program – College of Veterinarians of Ontario, 2004-2006
HCA reviewed the College's quality assurance policies with specific emphasis on continuing education. Harry Cummings and team developed and are implementing a review of their policies through document and literature reviews, focus groups, survey questionnaires and interviews with membership.
Pilot Project Evaluation: Community EFFORT Evaluation Advisory Group, 2005-2006
HCA is currently assessing the effectiveness and determining the replicability of Community EFFORT - a 30 month pilot project that is introducing the concept of Enterprise Facilitation to Ontario . Enterprise Facilitation is a person centred approach to community economic development that was developed and trademarked by Ernesto Sirolli. It is a management coaching and civic networking approach to supporting entrepreneurs within their own community. HCA designed the evaluation with input from stakeholders and clients through focus groups and is now using questionnaires and interviews to gather some background data. The evaluation is being conducted in two phases and includes the use of a comparison group.
Evaluation of Newfoundland and Labrador Primary Health Care Network Initiative – Government of Newfoundland and Labrador, Current
This evaluation is providing the base line evaluation for this program, developing Primary Health Care Networks in Newfoundland and Labrador communities. Logic models, evaluation plans and community consultations are being completed in six pilot sites across the province as part of the evaluation. This assignment is being completed jointly with Med Emerg International Inc.
Evaluation of the Ontario College of Pharmacists (OCP) Quality Assurance Programs, Current
HCA completed an Evaluation Plan of the College's Quality Assurance Program in 2001. Subsequently, HCA has been actively involved in the evaluation of the various components the College's Quality Assurance Program using qualitative, quantitative and participatory research. Initially HCA was involved in an ongoing assessment of the impact of the Practice Review (a quality assessment tool of the OCP) on the practice of pharmacy. Focus groups together with telephone and written surveys were utilized during this assessment. Recently, HCA completed a review of the College's Learning Portfolio. Methodologies used were focus groups, questionnaires, and key informant interviews. Currently HCA is assisting in the revision of the Self Assessment Survey.
Socio-Economic Impact Study of Agriculture in Ontario – Sustainable Rural Communities Program - University of Guelph/Ontario Ministry of Agriculture Research Program/Agriculture and Agri-food Canada, 2002-2005
HCA prepared a composite report that focused on the challenges and opportunities facing agriculture from the perspective of industry and community stakeholders. The report also coordinated and prioritized economic development activity. Between 1998-2000 numerous agri-economic studies were conducted throughout Ontario ; these studies raised many issues (socio economic/human resource/environmental) that had not yet been formally assessed. This study used these findings as baseline data and coupled it with new findings from multi-stakeholder focus groups to provide a comprehensive report.
Implementation Review, Ontario Early Years Centres Program, Ministry of Children and Youth Services, Summer 2004
The Ontario Early Years Centres Program enabled the creation of, and provides for the operation of, a network of 103 Ontario Early Years Centres in communities across the province. Each Centre is to provide parents, caregivers and children access to early learning and parenting programs and services and supports. HCA was engaged to undertake an implementation review of the program. The review entailed a review of relevant background documents, the development of a program logic model and evaluation matrix, a combination of key informant interviews and focus groups, the completion of a Centre profile and 18 two day site visits to selected Centres. Particular attention was given to the program's effectiveness, efficiency and equity.
Evaluation Planning for Small and Medium Enterprise in Eastern Indonesia (PENSA), 2004
HCA was engaged by the International Finance Corporation /World Bank Group to prepare a monitoring and evaluation plan and implement the initial phase for the small and medium enterprise facility (PENSA) in Eastern Indonesia . Harry Cummings conducted a capacity building monitoring and evaluation workshop in Denpasar , Indonesia with the organization and provided guidance for the creation and implementation of PENSA's planning and evaluation program and policies. The monitoring and evaluation planning process also consisted of designing program logic models (PLMs) and evaluation matrices ( EMs ) for each of their five programs and providing narrative summaries to guide the work plan.
“Reaching the Poor” Micronutrient and Health Project - World Bank, 2002-2004
HCA assessed the impact of World Vision's Micronutrient and Health Program (MICAH) in Ethiopia and Malawi . HCA assessed the benefits of the MICAH Project among the poor in Malawi and Ethiopia , focusing on mother, infant and child health and nutrition. Using the MICAH Project baseline and final survey data and the Malawi and Ethiopia DHS data, HCA compared the incidence of benefits of MICAH interventions among the poor and better off. Using a participatory research approach and multivariate analysis, HCA determined how well the MICAH programs have reached the most disadvantaged groups in Ethiopia and Malawi and the reasons for their success or failure.
Evaluation of Cancer Care Ontario 's Vegetable and Fruit Behavioral Intervention - Cancer Care Ontario, 2002 - 2004
HCA conducted an evaluation of a community based, multi-component, skill and knowledge based intervention program which was intended to inform, educate and support behavior change related to fruit and vegetable acquisition, preparation, storage and consumption among Ontario women aged 25-45 and their families. The evaluation project assessed the pilot phase of the program in 12 test sites across Ontario , and reflected different community profiles (i.e. urban, rural, multicultural, Aboriginal, north, south, etc.). The evaluation used key informant interviews and focus groups with program instructors/facilitators and pre and post-behavior questionnaires with program participants. The evaluation questionnaire included a food frequency tool, self-efficacy scales, and self-reported health scales.
Operational Review, Resource Jump Teams, Ministry of Municipal Affairs and Housing, 2004
The Resource Jump Team initiative was launched as a provincial pilot project. Developed by the Rural Development Division of MMAH, Resource Jump Teams are designed with the broad provincial objectives of: resolving economic development challenges or barriers that the community has identified; promoting regional/ sectoral growth; developing capacity and partnership; building awareness and support for economic development; and, sharing and communicating results. HCA was contracted to assess the effectiveness of the six Jump Team pilot projects; evaluate the complete program administrative process for effectiveness and efficiency; and, to develop a performance measurement system for on-going monitoring.
Evaluation of Child Workers' Opportunities Project (CWOP) Save the Children Canada 2003-2004
Save the Children Canada initiated the Child Worker's Opportunities Project (CWOP) in response to the United Nations Conventions on the Rights of the Child. The CWOP goal was to reduce the number of child workers in exploitative or hazardous conditions and create opportunities for education and training. HCA was contracted to review project documents, prepare an evaluation plan and carry out the end of program evaluation. The findings of this evaluation were presented an international conference.
Program Review: World Vision Canada , Canadian Programs -World Vision Canadian, 2003-2004
HCA coordinated and conducted a review of the Canadian Programs in World Vision Canada . This included Neighbourlink, Aboriginal Program, Refugee Sponsorship Program and the Refugee Reception Centre. The review included a combination of key informant interviews and focus groups with WVC senior management, WVC staff, program staff, program beneficiaries and partner agencies.
Workshop on Results Based Management and Evaluation (RBM&E)– UNICEF Canada, 2003
HCA designed and delivered a one-day workshop on results-based management and evaluation. This workshop was designed to help UNICEF staff increase their understanding of a results based approach to evaluation in anticipation of using it in a national development education program. Participants applied RBM&E principles using case studies.
“Growing Food and Economy”, Economic Impact Study of the Agriculture and Food Related Sectors in Waterloo Region –Region of Waterloo Public Health - 2003.
The purpose of this report was to take a fresh look at the role played by the agri-food industry in the economy of Waterloo Region. It was intended to inform program and policy development within the Region of Waterloo Public Health Department. The report was also intended to help the broader community better understand the nature and economic significance of the local agricultural economy and food system; it profiled agriculture and food related activities in the primary, secondary and tertiary sectors and presented a model of the local food economy.
Evaluation of Ontario 's Living Legacy Program – Ontario Ministry of Natural Resources, 2003
The Ontario Living Legacy (OLL) Program evaluation, conducted by HCA, fulfilled the MNR obligation to ensure that its' priorities and commitments were met and its business was being delivered within a framework based on fiscal responsibility, accountability, and value for money. HCA assessed all of the OLL initiatives using consultations and reviews of existing program reports. HCA also provided consultation services to MNR on evaluation methods and practices.
Evaluation Plan for Christian Children's Fund of Canada , 2003
HCA developed an evaluation plan for the following CCFC programs: Water and Sanitation, Primary Health Care, Education, Nutrition, Training and Capacity Building , and Micro-enterprise Development. The evaluation plan serves as a review of their program requirements. The evaluation plan for CCFC included: project logic model, results chain, evaluation framework, proposed research design for the evaluation, recommendations on research strategies and tools. The evaluation plan has been utilized in twelve countries.
Evaluation Plan for the Kwanlin Dun First Nation Health Department, White Horse, Yukon Territory, 2003
The evaluation plan for the Kwanlin Dun First Nation Health Programmes provided a practical and realistic evaluation design. A key sub-set of indicators was developed which could be realistically measured and effectively used. The evaluation plan was designed to develop baseline data to facilitate the outcome assessment, inform and guide the planning of future prevention/intervention actions, and give an account of the highlights and challenges of the programmes.
Strategic Review- Agricultural Component for the Town of Markham , Policy and Research Division, 2003
As part of the Eastern Markham Strategic Review, HCA conducted a study of the Agriculture sector in relation to environmental, land-use, heritage and transportation issues. The study provided the Strategic Review with a profile of existing agricultural land uses in Eastern Markham, an overview of land use issues and general constraints and implications for farm viability, and a potential agricultural land use strategy for Eastern Markham . Throughout the process HCA was involved in numerous committee meetings with Members of Council and Town of Markham staff. Results from the study were presented at a public meeting and were incorporated in the principles and actions related to land use in the Strategic Review Final Report.
Evaluation for the Ontario Ministry of Natural Resources – Lands and Water Program – 2003
HCA assisted the Lands and Water Program in their evaluation process helping them focus on various report requirements including relevance, effectiveness, efficiency and sustainability of the program in accordance with the core business of the MNR and other factors that impact the program. Five separate evaluations were conducted to reflect sub-program components.
Evaluation of Shared Services Bureau's (SSB) Special Employment Programs for Shared Services Bureau (MBS), 2003
After successfully completing the evaluation plan of SSB's Special Employment Programs, HCA was retained to carry out the evaluation. Using a multi-stakeholder approach, including focus groups, key informant interviews and surveys, information was generated on the process, relevance, efficiencies and sustainability of the programs.
Evaluation Plan of the Special Employment Programs for Shared Services Bureau (MBS) , 2003
HCA prepared an evaluation framework and design for the four Special Employment Programs (Ontario Student Exchange Program, Quebec Student Exchange Program, Employment Accommodation Fund, and Employment Transition Services Fund) for SSB (MBS). The evaluation design provided one overall project plan, a communication plan and an evaluation framework. The design also provided four sub-project plans, sub-communications plans, sub-evaluation plans and four program logic models for each of the Special Employment Program to be evaluated.
Economic Impact Study of the Agriculture Sector in Timiskaming District and Updating of the Blue Sky Region and Algoma Manitoulin Agricultural Economic Impact Studies, 2002 - 2003
HCA conducted an Agricultural Economic Impact Study for the Temiskaming Federation of Agriculture. The Timiskaming study methodology was consistent with the agri-economic impact projects completed by HCA in other counties, municipalities and districts across Ontario . The study reported on the direct, indirect and induced economic impact that the agricultural industry has on the study area. The study also identified agricultural issues, challenges opportunities, and possible future directions for the industry. Steering Committee and industry stakeholder involvement was incorporated into the study strategy to enhance local capacity for further research and development.
A second aspect of this project involved updating the agri-economic impact studies that HCA completed for the Blue Sky Region (2001) and Algoma Manitoulin (2002). At the time these two projects were conducted, data from the 2001 Census of Agriculture was unavailable. The 2001 Census data was incorporated throughout both of the reports.
Upon the completion of the Timiskaming study, HCA successfully conducted agri-economic impact studies covering all of the Districts in northeastern Ontario .
Agri-Food Strategy for Nova Scotia - Nova Scotia Federation of Agriculture, 2002
HCA assisted the NSFA in developing an agri-food strategy for the province of Nova Scotia . This strategy included the preparation of a discussion document and a province wide consultation process (public forums) with industry stakeholders.
Land Use Planning - Town of Amherst and County of Cumberland , Nova Scotia , 2002
HCA developed a policy for agriculture and rural land use planning in urban fringe areas. Best practice models were researched and used to develop the policy.
Using Graphics in Development Evaluations - International Program for Development Evaluation and Training, World Bank, 2002 & 2003
A workshop on using graphics in development evaluations was developed for an international audience. Participants identified opportunities for the use of graphics in evaluation reports and gained an understanding of the design and communication principles and concepts associated with translating data into computer-generated graphics. Some demonstration exercises and a practical exercise, including a critique of graphics in reports, was part of the workshop.
Evaluation of the Implementation of HIGH FIVE at Colleges in Ontario - Parks and Recreation Ontario , 2002
HCA evaluated the implementation of the HIGH FIVE program in eight colleges in Ontario . HIGH FIVE is a quality assurance program in recreation that ensures programming is conducted using healthy child development principles. Through several interviews and a focus group, HCA gained insight into the critical issues, provided recommendations and developed a critical path for the future implementation of HIGH FIVE in Ontario Colleges.
Workshop on Results Based Management and Indicator Development (support workshop II) - Canadian Baptists Ministries - The Sharing Way , 2002, 2003
HCA conducted a 2-day workshop on logic models, results-based management and indicator development for a working group of The Sharing Way. Several regional representatives from the partner countries, the board of directors and the management committee were present. The models used by The Sharing Way were assessed and the principles of logic models and results-based management were applied. This workshop used an applied format where specific international projects were assessed and protocols for reporting were developed.
Results Based Management and Evaluation – Harry Cummings and Associates, 2002
HCA designed and delivered a two-day workshop on results-based management and evaluation. This workshop was designed to help development practitioners, and management staffs increase their understanding of a systematic approach to evaluation (Results Based Approach). The workshop presented opportunities for the participants to apply the principles learned in both an international and a local case study. This workshop has been offered twice a year from 2001 to 2004.
Impact and Innovation in Nutrition - World Vision Canada , 2002
Dr. Harry Cummings provided a lecture on the methods of data collection to evaluate the impact of nutrition and health programs. He provided examples from experience and previous work conducted in Ethiopia and Indonesia .
A Kinder, Gentler, Simpler Economic Impact Assessment Process - Economic Evaluation for Non-Economists - Annual General Meeting Canadian Evaluation Society, 2002
HCA presented their approach to Economic Impact Assessment illustrated with examples from tourism and agriculture. HCA introduced and reviewed definitions related to Economic Impact Assessments using examples from the field.
Strategic Plan - Volunteer Centre of Guelph and Wellington , 2002
HCA assisted the VCGW to develop their strategic plan. HCA provided the VCGW with advice and support in developing planning tools and put together the various components of their document. The document would serve to secure funding and provide direction for the organization over the next three years. It included a logical framework analysis, an evaluation matrix and an evaluation plan.
Participation - Smart Guelph Initiative , 2002
HCA participated in focus group discussions regarding economic development, tourism, housing and multicultural issues aimed at developing future planning for the City of Guelph . HCA also advised city staff on ways of promoting greater involvement from ethno-cultural groups.
Essential Skills Series - Canadian Evaluation Society, 2002
HCA delivered modules in a four day series on the basics of evaluation. Participants come from government, consultancy practices, non-governmental organizations and the private sector. The Canadian Evaluation Society, Ontario Chapter, sponsors this workshop. This presentation is part of the basic evaluation package recommended by the Canadian Evaluation Society.
Evaluation of the Ontario Agri-Food Education (OAFE) Program , 2002
HCA advised the OAFE in the development of an evaluation plan to assess its activities in the education program. The evaluation assessed the OAFE's impact on teachers and children in respect to agriculture related food and education. A results chain and evaluation matrix was developed as part of the evaluation strategy and the key methodologies included focus group discussions, key informant interviews and questionnaires.
Land Use Planning on the Rural Urban Fringe, 2001-2005
HCA was engaged by an independent farmer in the development of a strategy for the creation of an agricultural lot designed to facilitate estate planning. The proposed change allowed a full time dairy farmer in Halton Region to take over the family operation and continue to run it as a commercial dairy farm in the region. The strategy reflected changes and trends, inland ownership and farm size in the GTA in relation to urban land development pressures.
Economic Impact Study for the Agricultural Sector in the Algoma, Manitoulin and North Shore Districts – Algoma, Manitoulin Federations of Agriculture , 2002
This study examined the economic importance of agriculture in the Algoma, Manitoulin and North Shore Districts. A social and economic profile of the area was completed in conjunction with interviews of agricultural related businesses and organizations. Particular attention was given to economic leakage out of the area, the value of agriculture and related multipliers.
Economics of Clay Brick Production in the GTA, with a Focus on Brampton – City of Brampton , Planning and Development , 2002
The objective of the study was to determine the best usage of the Shale Resource Area in light of demand for housing and industrial facilities. HCA provided an analysis of the locational economies of Brick manufacturing in Ontario and Brampton . The following factors were included in the analysis: economic impact of alternative brick production locations considering, supply of shale, demand for brick, location of demand, cost of transport (shale input, brick output), price of bricks, cost of production.
Urban Population Projections – World Vision Canada , 2002
An analysis on urban populations was conducted for World Vision. UN data, global population statistics and projections between 1975 and 2030 were assessed. The required data was tabulated and graphs were prepared to highlight the extent of urban population growth.
Urban Poverty in Developing Countries: An Overview and Approaches to Alleviation – World Vision Canada , 2001
A literature review on urban poverty and its alleviation was conducted for World Vision. The study used four comprehensive case studies to emphasize poverty alleviation strategies: The Orangi Pilot Project in Karachi , Pakistan ; the Million Houses Program in Sri Lanka ; Participatory Municipal Budgeting in Porto Alegre , Brazil ; and the Saamstaan Housing Cooperative in Namibia . Recommendations were provided regarding an approach to urban poverty.
Economic Impact Study for the Agricultural Sector of the Blue Sky Economic Partnership- Blue Sky Economic Partnership, 2001
This study examined the economic importance of agriculture in the Blue Sky Region. The region comprises two of the Northern Ontario districts of the Ontario Federation of Agriculture. The districts under study were the East Nipissing Parry Sound Federation of Agriculture and the West Nipissing Sudbury East Federation of Agriculture, incorporating North Bay and Sudbury . A social and economic profile of the area was completed in conjunction with interviews of agricultural related businesses and organizations. Particular attention was given to economic leakage and the value of agriculture and related multipliers. French and English reports were prepared.
Health Service and Outcome Indicators: Planning Tools - Saskatchewan Health, 2001
The objectives of this satellite workshop were to identify strategies for integrating health indicators into the strategic planning process. Harry Cummings addressed a panel via satellite to 31 sites based throughout Saskatchewan discussing and facilitating an exercise in developing an Outcome-Focused Strategic Plan.
Assessment of the Brantford Public Market , 2001
Based on an Ontario wide study through the University of Guelph , HCA was contracted by the Farmers' Markets of Ontario to provide an updated opinion on the changes in operational characteristics including vendor profiles, customer purchases, and total sales at the Brantford Farmer's Market. HCA provided recommendations to improve the existing socio-economic conditions of the market.
OMAFRA Economic/ Fiscal Needs Assessment Study - Ministry of Agriculture, Food And Rural Affairs, 2001
In acknowledging the importance of conducting economic impact analysis and identifying the limitations of rural municipalities to undertake this type of assessment, OMAFRA initiated a study to examine the capacity of rural communities across Ontario to conduct economic/fiscal impact assessments. Specifically, OMAFRA was interested in examining the skills and resources (financial, human, technical support, etc.) that are currently in place in rural communities. A further objective was to identify where additional support is needed to allow communities to make the most of economic impact analysis tools. A parallel study was undertaken by Hemson Consulting Ltd. to examine the utility, relevance and effectiveness of existing economic impact software programs and training.
Assessment of Settlement Services for Newcomers in Isolated Rural Areas and Small Towns in Ontario , 2001
Citizenship and Immigration Canada, Ontario Administration of Settlement and Integration Services (CIC, OASIS) were interested in exploring methods of settlement program delivery and the experience of newcomers in communities/regions of Northern and Eastern Ontario . This research project was directed at newcomers residing in rural areas and small towns in Northern and Eastern Ontario that receive less than 50 newcomers a year and who have been in Canada for less than five years. The report represented an assessment of the types of settlement services currently available in remote Ontario communities and identified models of delivering services to rural and remote areas. The report also profiled the types of services being accessed and the manner in which newcomers access services. Information was derived from interviews and focus groups with service providers and newcomers and through a review of available documents.
Evaluation of the 2nd Chance Program, York Region – Justice Canada , Ontario Social Development Council, 2001
This report was prepared in response to Justice Canada 's request for evaluation of the "Second Chance" alternative school program operating in York Region. This evaluation included elements of the whole program but focused on questions raised by Justice Canada in relation to: cost and sustainability, staff and volunteer training, selection process of participants, partnerships, objectives and reintegration support and supervision.
Transportation Study – Linamar , 2001
Based on the work of the Guelph Transportation Study, HCA was retained by Linamar Corporation to analyze a survey of their employees to ascertain how they traveled to work. With this data, the city was able to determine how the transit system could best assist in the mobilization of Linamar's work force.
Evaluation of Patient Relations Programs – Health Professions Regulatory Advisory Council, 2001
Using a results-based evaluation framework, HCA conducted an evaluation to determine whether Ontario Health Colleges Patient Relations Programs were likely to be effective in fulfilling the requirements and intent of the Regulated Health Profession's Act in protecting the public from harm and treating individuals with sensitivity and respect. Also HCA assisted in determining the likelihood of the desired impact of each College's Patient Relations Program.
Economic Impacts of Agriculture on the Economy of Lanark and Renfrew Counties -Lanark County Federation of Agriculture and Renfrew County Federation of Agriculture, 2000
The basic focus of this research was on sales and jobs related to agriculture, directly or indirectly. The study involved a combination of ‘economic base' and ‘input-output-like' methods and relied on data collected from Statistics Canada, the Ontario Ministry of Agriculture, Food & Rural Affairs, previous impact studies and a survey of agriculture-related businesses located in Lanark and Renfrew.
The Economic Impacts of Agriculture on the Economy of the New City of Ottawa – Ottawa-Carleton Region Federation of Agriculture, 2000
With the completion of this Agricultural Impact Study and a concurrent study in Lanark and Renfrew Counties , all of Eastern Ontario has been assessed using the same methodology. As in the other studies that have been completed, the basic focus of this research was on direct and indirect sales and jobs related to agriculture. The study involved a combination of ‘economic base' and ‘input-output like' methods and used data collected from Statistics Canada, the Ontario Ministry of Agriculture, Food & Rural Affairs, previous impact studies and a survey of agriculture-related businesses located in the new City of Ottawa. Following the evaluation of the food security programs, HCA was asked to prepare guidelines for grant recipients receiving Trillium Funding in Ontario . These were subsequently adopted and are now used by Trillium.
Evaluating Food Security in Ontario - Trillium Foundation, 2001
HCA has completed an evaluation of food security projects funded by the Trillium Foundation. The assignment included developing a framework for assessing food security, using indicators of food security derived from pertinent literature and recent project experience. The evaluation process involved a review of the literature on food security, key informant and group interviews, site visits, participant observation and project document review. Two reports were prepared.
The City of Guelph Transportation Strategy Update Public Attitude Survey , 2000
HCA conducted the survey of public attitudes and opinions towards various transportation policies and measures. Focus group workshops involving a broad cross-section of community interests were held and telephone surveys were also conducted. Presentations were made to Council and committees.
Change in the Agricultural Sectors: Associated Human Resources Implications (2000) Eastern Ontario Training Board (Stormont, Dundas , Glengarry, Prescott and Russell Counties ), 2000
This study was designed to assess the labour requirements of farmers in Eastern Ontario and the training being provided by selected training providers. Focus groups with farmers and trainees were completed. Key informant interviews were also conducted with training providers from various institutions/organizations. The study identified trends and gaps in training delivery and recommended courses of action for employers, employees and training providers to enhance the development of training programs.
Elgin, Middlesex and Oxford County Area Agricultural Sector Assessment Study - Federations of Agriculture, Planning Departments, Training Boards, Human Resources Development Canada, OMAFRA, 2000
The objectives for this study were: to identify human resource development issues related to training and the labour market in the agricultural sector; to measure the economic impact of agriculture in the three-county region through an analysis of the direct, indirect and induced economic impacts of agriculture; to describe the current situation in agriculture; and to indicate future challenges and trends in agriculture for the three county areas (e.g. genetically modified organisms, food safety, environmental concerns, agri-business, agri-tourism, etc.). Methods used included: Media presentations, focus groups, mapping, agricultural business survey, census analysis, review of municipal data, power-point presentations and GIS analysis. Four separate reports were generated under this project. Each of the participating Federations received a report focused specifically on their County plus a report that provided an overall view of the combined areas.
Evaluation of Food For Work Projects - CIDA and World Food Programme in Indonesia , 2000
HCA performed the End of Project Evaluation of "Social Safety Net" projects implemented by CARE and World Vision in East Indonesia , Kalimantan & Jakarta in 2000. The emergency relief projects involved rice & food supplement distribution link to public works projects. Program logic and results-based approaches were used. A local consultant assisted HCA with this assignment. Field visits to North Jakarta, Sulawesi and Kalimantan were completed. The evaluation was designed to help CIDA improve aid effectiveness.
Advise on the Design and Analysis of a Survey for Micro-nutrient Program (MICAH) in Africa - CIDA and World Vision, March 2000
HCA provided design guidelines for the post impact survey carried out by MICAH in Malawi , Ethiopia , Tanzania , Ghana and Senegal . The project was a CIDA funded micronutrient program for women and children under the age of 5. Advice was provided on the design, assistance was provided on the analysis, and the reports were reviewed. The evaluation of strategy and results on key nutrition and health status indicators was conducted.
Evaluation of the Quality Assurance Programs for all Ontario Health Colleges, 2000
Working with the Health Professions Regulatory Advisory Council of Ontario and using a results based evaluation framework (prepared by HCA in 1997), HCA completed an evaluation of the suitability of the Colleges of Health, Quality Assurance Programs. This included file reviews, program descriptions, development of results frameworks and assessment of date. Colleges of Doctors, Nurses, Midwives, Massage Therapists, Medical Laboratory Technologists and Dentists (23 such professions) were evaluated.
Evaluation Workshop for Simcoe Community Care Access Centre, 2000
HCA designed and carried out an evaluation training and design workshop for the CCAC. The workshop, delivered in modified form to many organizations over the last 2-3 years, includes common approaches to evaluation, development of evaluation focus questions and indicators and the development of a common framework for evaluation. Similar workshops for health care clients were carried out for Westpark Hospital and the Canadian Evaluation Society.
Presentation at Veterans Affairs Health Services Research and Development Annual Conference, Washington D.C. , 2000
Harry Cummings presented the keynote address at this conference. The conference focused on Quality Assurance and his keynote was entitled: "Evaluating Quality Assurance programs in the Health Care Professions in Ontario ." He also presented on this topic at the Canadian Evaluation Society Annual Conference in Montreal in May 2000.
Evaluating Poverty Alleviation in Waterloo Region, 1999
HCA was involved in a participatory evaluation of a four-year poverty alleviation project in Waterloo Region. Evaluation activities included training in results based management, facilitating self-assessment workshops, developing and implementing household surveys, regular monitoring of project activities, participant focus groups, and mid-term and final evaluations.
Evaluation of Huron Business Development Corporation, 1999
HCA developed an evaluation model for the Huron Employment Resource Centres and a logic model for the Huron Business Development Corporation (HBDC). This was followed up with a complete impact assessment of the various activities of HBDC. HCA examined over 40 community economic development projects across Huron County as part of the evaluation process. The evaluation undertaken by HCA helped HBDC earn the 1999 Award for Rural Excellence for Contributions to Economic Growth.
Evaluation of World Vision Micah (micronutrient and health) program, Ethiopia , 1999
HCA in cooperation with project partners evaluated the MICAH program for World Vision in Ethiopia and reported on the progress, achievements with regards to targets, and the strengths and weaknesses of the program. The MICAH program is a CIDA funded project, which aims at improving the nutrition and health stats of the less fortunate in several countries in Africa . Recommendations were provided with respect to changes in the structure, elements and activities of the program.
Interim Evaluation of the Community Abuse prevention for Rural Ontario (CAPRO) Project, 1989
This Trillium funded project was assisting communities across Ontario develop abuse prevention strategies focusing on farm families. Harry Cummings and Colleagues used focus groups and surveys as a part of the strategy as well as an analysis of secondary data. A Logic Model for the program was developed.
Other Related Assignments
Impacts of Agriculture on the Economy of Perth County , 2000
Impact Of Agriculture On The Economy Of Lambton County - Lambton County Federation of Agriculture, 1999
Impact of Agriculture on the Economy of Simcoe Country- Simcoe Country Board of Education, 1998
Economic Impact of Farmer's Markets in Ontario - Farmers Markets Ontario (FMO) and Agriculture Adaptation Committee (AAC), 1998
Economic Impact of Agricultural Exports on Huron County – Huron Country Federation of Agriculture, 1998
Economic Impact of Agriculture in the Five Counties of Prescott, Russell, Stormont, Dundas, and Glengarry, 1998 - Federations of Agriculture for Prescott, Russell, Stormont, Dundas and Glengarry, United Counties of Prescott-Russell, Economic Development, United Counties of Stormont, Dundas and Glengarry, Economic Development, City of Cornwall, School of Rural Planning and Development, University of Guelph, Ontario Ministry of Agriculture, Food and Rural Affairs, Human Resources Development Canada, 1998
Economic Impact of Tourism in Huron County – Huron County Federation of Agriculture, 1998
Results-Based Log Frames and Questionnaire for Kenya Flood Relief – World Vision Canada , 1998
Development Planning Assistance Project in Indonesia - 1998 The World Food Summit Task Force on Food Security, 1998
Results-Based Management Training and Advisement for Conservation Management in China and Vietnam , 1998
Guelph Water Study - City of Guelph , 1998
Baseline Survey in Indonesia – Indonesian Livestock Services Directorate, 1998
Methodologies and Modules for Evaluating Community Economic Development Projects and Programs - The Municipality of New Tecumseth, 1999
Economic Impact Study of retail spending in the Six Nations Reserve, Six Nations Economic Development Commission, 1997
Evaluation of a CIDA-funded Entrepreneurial Training Project for the Unemployed in Poland , 1998
Evaluating an Integrated Community Development Program in Ethiopia - Oxfam Canada , 1997
Economic Impact Analysis: A policy and Survival Tool, Ontario Ministry of Agriculture, Food and Rural Affairs, Economic Development Council of Ontario (EDCO), University of Guelph, 1996
Community Futures Training Project - HRDC, Ottawa , 1994
|