Impact assessment is a continuous process of evaluation that monitors and justifies the impact of project operations and how much difference it has made to the community.
Impact Assessment helps us
- To assess the degree to which project objectives were achieved.
- To document the lessons learned.
- To provide recommendations for project development and improvement.
- To examine the changes that resulted from doing the project.
- To provide input to guide decision-making for the upcoming renewal and extension of project funding.
Evaluation Types
To evaluate the impact DTP conducts three types of assessments.
- Process evaluation: (Activity) Taking regular follow up with the stakeholders (members) and conducting evaluations after every activity (workshop, training, masterclass & Boot camp)
- Formative evaluation: (Quarterly, Process, Outcome, Output and Impact) After every 4 months DTP submits its quarterly progress report to the department and going through the report helps them decide the next course of action. This is the most effective way to evaluate the impact. It determines in which sector DTP needs to focus more to add value to its stakeholders’ lives.
- Summative evaluation: (Yearly, Outcome, Output and Impact) By the end of the academic year, DTP calls a meeting with its core team and goes through the whole work process. This open-end discussion helps them to find out their strengths, limitations, and areas of improvement.
Examples of Evaluation Questions
To bring out the proper result of the impact assessment, DTP generates four sets of outlined questions. First, the sole purpose of evaluation questions is to figure out the outcomes and impacts to project operations. It does this by introducing a counterfactual concept- what would have happened in the absence of the project. The counterfactual is what separates impact assessment from general project evaluation.
DTP’s evaluation questions related to process:
- Are the activities being performed as planned?
- Is the project reaching the intended target population?
- How satisfied are the participants with their involvement in this project?
- How should the planned activities be modified to work better?
- What lessons can we learn from the way in which the project is unfolding?
DTP’s evaluation questions related to outputs:
- Is the project reaching the intended number of participants?
- Is the project providing the planned services?
- Are the activities leading to the expected result?
- Are there any unexpected results?
DTP’s evaluation questions related to outcomes/impacts:
- Did the participants experience any changes in their skills, knowledge, attitudes, or behaviours?
- What changes were expected?
- What are the effects of the project on my organization (e.g., organizational pride, enhanced networking, and partnerships)?
- Did the project meet the needs that led to this project? Do those needs still exist?
- Are there any other related needs that have arisen that the project did not address?
- Did we experience any changes as a result of the project? Are the changes positive?
- What could be the long-term impacts of this work?
DTP’s evaluation questions related to alternatives and lessons learned:
- What could have been done differently to complete the project more effectively?
- What key changes should be made to the project to enhance the achievement of objectives?
- What are the lessons learned for the future?
- What outcomes should be considered if an organization wants to repeat this or conduct a similar project?