Keeping people safe & well

 

NCLB Implementation guide

Phase - 6: Evaluation

 

Overview
This Part discusses the design, development and use of an evaluation component for the No Community Left Behind strategy. It reviews how a well-designed evaluation provides a thorough description of the structure and operation of the NCLB activities and whether those activities were successful or need adjustment.

This part also examines the elements necessary to conduct an effective evaluation, looking not only at the desired outcomes but also at the resources used and the effectiveness of the program design.

Vision
Evaluation is the best way for the Steering Committee to determine whether the selected activities and programs are effective. Evaluation reports of the process influences decisions about funding allocations and program selection. These policy decisions are central to whether the long-term goals of reducing crime and promoting a safe and secure environment are achieved.

Implementation Process

Step 1:         Identifying a Coordinator and the Other Members of the Evaluation Team

An evaluation coordinator is selected during the organizational phase of the NCLB process. To ensure the objectivity and credibility of the evaluation, the coordinator is ideally selected from an organization not participating directly in the No Community Left Behind process.

Many organizations can help with the evaluation process at little or no cost. Organizations that may be able to assist include the following:

•  Colleges and universities have students who can work on an evaluation process. The department to approach varies from one institution to another; among the possibilities are political science, sociology, business and urban affairs.
•  The planning section of local government ministries/departments can help develop an evaluation component. The city’s economic development agency may also be able to assist.
•  Some nonprofit organizations can help nonprofit groups develop an evaluation process.

 
Step 2:         Reviewing the Priorities to Be Measured

A close relationship between site development and evaluation exists. Clearly defined goals are the key to both a successful site operation and an informative and useful evaluation. Each strategy component has measurable goals from which the evaluation framework is constructed.

When operational plans are developed, a desired outcome is identified and tied to the goals. The following support pieces were also developed in the earlier phases of the process.

•  The tasks to be performed in moving toward the goal;
•  The organization or individual responsible for the tasks;
•  The timeframe for accomplishing these tasks.

These measures are quantifiable. These are the program outputs. Important as they are, the quantitative measures are not to be used in isolation. When assessing program performance, schedule checkpoints at regular intervals to ensure that the course is leading towards the desired objectives. If all measures are being achieved, there is no need to make any changes. If some measures, however, fall short of the expectations, some of the following questions are considered to determine if midcourse corrections are needed:

•  Were the numbers/goals realistic?
•  Was outreach adequate?
•  Were the schedule and program adequate to the task?
•  Were interim adjustments made as needed?
•  Were resources adequate for program needs?

• Was cooperation from other community resources sufficient for program needs?

Assess qualitative measures using evaluation process results. Talk with the students, evaluator, stakeholders, community members, etc. about their perception of the success of the program. What suggestions do they have to improve future programs?

Step 3: Collecting and Analyzing Information

Evaluation reports are not confined to only numbers and percentages. The Steering Committee has access to both quantitative and qualitative information to help assess progress. Numbers relating to crime statistics show a precise picture of the results of activities in the target neighbourhood and can be used to allocate resources for law enforcement and community policing activities. Statistics can also reveal the number of people served by programs related to preventive activities; however, do not overlook the qualitative aspect of evaluation.

Community members’ perceptions are an important part of evaluating progress. For instance answers to question: “Do community members feel safer and more comfortable in their neighbourhood?” help a lot.

Analyzing evaluation reports yields valuable information about what was successful and what needs to be adjusted. If the evaluation is properly designed, it is not  used to place blame on agencies or individuals. Success is always the desired outcome; however, much can be learned from mistakes. An important role of an evaluation process is to know where improvement is needed.

Critical assumptions

Deciding what to evaluate as the first issue
Priorities are the most important elements to evaluate. It is not easy to get everyone to agree on priorities, however, using the strategy as the guide addresses this problem.

Methodology can be an issue
As discussed earlier, some people believe statistics are the most important measure of program success. Quantitative measures can be an accurate method, but efforts are made not to ignore qualitative results. Both qualitative and quantitative measures are important.

Back to contents

 

 

 

 

© 2005-15 South - East Ottawa Community Health Centre
Centre de Sante Communautaire du Sud Est D'Ottawa

Contact: Abid Jan Tel./ Tél: (613) 737-5115 Ext. 2403  Fax/Télé: (613) 739-8199

NCLB matters because neighbourhoods matter