More

    Impact Measurement

    Impact

    (Image Credit – Rachel Walker on Unsplash)

    "Impact" refers to the effect or influence that a particular action, event, or phenomenon has on a system, environment, society, or individual. It is often used in various contexts to assess the consequences of actions or changes, whether positive or negative.

    (Image Credit – Patricia Serna on Unsplash) Measuring impact can be a complex process, and it depends on the specific context and goals. Here are some common ways to measure impact in different domains (non-exhaustive list):

    • Social Impact can include:
        1. Surveys and Interviews: Gathering feedback and data from individuals or communities affected by a programme or initiative to assess changes in their lives.
        2. Indicators and Metrics: Defining specific metrics like employment rates, literacy rates, or poverty levels to track progress and impact.
        3. Case Studies: In-depth analysis of specific cases to understand the real-world impact of an intervention.
    • Environmental Impact can include:
        1. Carbon Footprint: Measuring the greenhouse gas emissions associated with a product, service, or organisation.
        2. Biodiversity Assessment: Evaluating the impact of development or activities on local ecosystems and species.
        3. Resource Consumption: Analysing the use of resources like water, energy, and raw materials.
        1. Health Outcomes: Assessing the health improvements or changes in patients' conditions due to medical treatments or interventions.
        2. Mortality Rates: Tracking changes in mortality rates for specific diseases or health conditions.
        3. Quality of Life: Measuring the impact of healthcare interventions on a patient's overall quality of life.
    • Educational Impact can include:
        1. Test Scores: Measuring changes in standardised test scores to evaluate the effectiveness of educational programmes.
        2. Graduation Rates: Assessing the percentage of students who successfully complete their educational goals.
        3. Employability: Evaluating how education impacts students' future job prospects.
        1. Gender and diversity representation in an organisation and/or in the beneficiaries’ base
        2. Quality of Life:  Assessing and measuring how women’s lives have been improved 
        3. Gender wage equity
        1. Legislative Changes: Evaluating the impact of new laws or policies on society, the economy, or specific populations.
        2. Public Opinion: Measuring changes in public attitudes and opinions regarding policy issues.
    Measuring impact often involves a combination of quantitative and qualitative methods. It is essential to define clear objectives and indicators beforehand and to collect relevant data before and after the intervention or action to assess its impact accurately. The choice of measurement methods depends on the specific goals and context of the impact assessment.

    What is Impact Measurement

    (Image Credit – Alexander Grey on Unsplash)

    Impact measurement is the process of systematically assessing and evaluating the effects, outcomes, or consequences of a particular action, programme, project, policy, or initiative (source: IRIS - GIIN). It involves the systematic collection and analysis of data to understand and quantify the changes, both intended and unintended, that result from the intervention. The primary purpose of impact measurement is to determine whether the intended goals and objectives have been achieved and to provide valuable insights for decision-making and improvement.

    Here are some key aspects of impact measurement:

    1. Defining Objectives and Indicators: Before measuring impact, it's crucial to clearly define the objectives and outcomes that you want to achieve. These objectives should be Specific, Measurable, Achievable, Relevant, and Time-bound (SMART). Indicators are then selected to measure progress toward these objectives.

    2. Stakeholder mapping: mapping the stakeholders is an essential component of impact measurement and management as it allows to better understand who can be impacted by an intervention.

    3. Data Collection: Gathering data is a fundamental step in impact measurement. Data can be collected through various methods, including surveys, interviews, observations, document reviews, and the analysis of existing data sources. Data collection should be systematic and reliable.

    4. Baseline Data: To assess the impact accurately, it's essential to collect baseline data before the intervention begins. This serves as a reference point for measuring changes over time.

    5. Quantitative and Qualitative Data: Impact measurement often involves both quantitative data (numbers, statistics) and qualitative data (descriptive information, narratives). Quantitative data provide numerical insights, while qualitative data offer context and deeper understanding.

    6. Comparison Groups: In some cases, comparison groups or control groups are used to evaluate the impact of an intervention. These groups are similar to the target group but do not receive the intervention, allowing for a comparison of outcomes.

    7. Analysis and Interpretation: The collected data is analysed to assess the impact against the defined objectives and indicators. Statistical analysis and other evaluation techniques may be used to determine causality and correlations.

    8. Reporting and Communication: The results of the impact measurement are typically documented in a report or presentation. Clear and transparent reporting is essential for sharing findings with stakeholders and decision-makers.

    9. Continuous Improvement: Impact measurement is not a one-time process. It often involves iterative assessments to track progress over time and make necessary adjustments to improve the intervention's effectiveness.

    10. Use for Decision-Making: The insights gained from impact measurement should inform decision-making. Whether in the context of nonprofit organisations, businesses, governments, or other sectors, the data and findings can guide future strategies and resource allocation.

    Impact measurement is particularly important in fields such as social and environmental impact investing, philanthropy, international development, and public policy, where organisations and stakeholders aim to make a positive difference in the world. Effective impact measurement helps ensure accountability, transparency, and the efficient allocation of resources to achieve desired outcomes.

    Impact Measurement and Impact Assessment

    Impact measurement and impact assessment are related concepts, but they are not the same. They share a common goal of understanding the effects and consequences of actions or interventions, but they differ in terms of scope, purpose, and methodology. Here's a breakdown of the differences between impact measurement and impact assessment:

    • Scope:
      1. Impact Measurement: This process focuses on quantifying and evaluating the outcomes and effects of a specific programme, project, policy, or intervention. It typically involves collecting data to measure changes in specific indicators related to the intervention's goals and objectives.
      2. Impact Assessment: Impact assessment is a broader process that includes impact measurement as one of its components. It encompasses a comprehensive evaluation of the potential social, economic, environmental, and other effects of a proposed project, policy, or action before it is implemented. Impact assessment may involve environmental impact assessments (EIAs), social impact assessments (SIAs), and other types of assessments to inform decision-making.
    • Purpose:
      1. Impact Measurement: The primary purpose of impact measurement is to assess whether the intended goals and outcomes of a specific intervention have been achieved. It is often used to gauge the effectiveness and success of existing programmes and initiatives.
      2. Impact Assessment: Impact assessment serves a broader purpose of predicting and evaluating the potential impacts of a proposed action or policy before it is implemented. It helps decision-makers make informed choices about whether to proceed with a project and how to mitigate potential negative consequences.
    • Timing:
      1. Impact Measurement: This typically occurs after an intervention has been implemented and is ongoing or completed. It assesses the actual outcomes and effects that have occurred.
      2. Impact Assessment: Impact assessment takes place before an intervention is implemented. It is a forward-looking process that aims to predict and plan for potential impacts.
    • Methodology:
      1. Impact Measurement: It involves collecting data on specific indicators related to the intervention's goals, often using both quantitative and qualitative methods. The focus is on assessing the actual changes that have occurred.
      2. Impact Assessment: Impact assessment involves a broader range of methods, including predictive modelling, stakeholder engagement, scenario analysis, and risk assessment. It aims to identify potential impacts, both positive and negative, and assess their significance.
    • Regulatory Requirements:
      1. Impact Measurement: While impact measurement is often used for accountability and decision-making purposes, it may not be subject to the same regulatory requirements as formal impact assessments.
      2. Impact Assessment: Depending on the jurisdiction and the nature of the project or policy, impact assessments may be legally mandated for certain types of actions, such as large infrastructure projects or environmental regulations.
    In summary, impact measurement focuses on evaluating the outcomes of existing interventions, while impact assessment is a broader process used to predict and assess potential impacts before an action is taken. Both processes play important roles in decision-making, accountability, and understanding the consequences of actions and interventions.

    Impact Measurement Frameworks and Tools

    (Image Credit – Maria Teneva on Unsplash)

    There are several frameworks and methodologies available for measuring impact, and the choice of framework often depends on the specific context, goals, and sector in which impact measurement is applied. Here are some commonly used frameworks for measuring impact:

    1. Logical Framework (LogFrame) Analysis: This framework is often used in project management and international development. It involves creating a logical framework that outlines the project's objectives, activities, outputs, outcomes, and impacts. LogFrame analysis helps in defining indicators for each level and tracking progress.

    2. Theory of Change (ToC): A Theory of Change is a visual representation that outlines the sequence of activities and outcomes expected to lead to desired long-term impacts. It is useful for planning and evaluating complex initiatives and understanding the underlying assumptions.

    3. Social Return on Investment (SROI): SROI is a methodology used to measure the social and environmental value generated by an organisation or project. It involves quantifying both financial and non-financial outcomes and assigning a monetary value to them.

    4. Impact Reporting and Investment Standards (IRIS): Developed by the Global Impact Investing Network (GIIN), IRIS is a catalogue of standardised metrics that impact investors and organisations can use to measure and report on social, environmental, and financial performance.

    5. Environmental, Social, and Governance (ESG) Frameworks: ESG frameworks provide a set of criteria and metrics for assessing the environmental, social, and governance practices of organisations. Examples include the Global Reporting Initiative (GRI) and the Sustainability Accounting Standards Board (SASB).

    6. United Nations Sustainable Development Goals (SDGs): The SDGs provide a global framework for addressing social and environmental challenges. Many organisations use the SDGs as a reference point to align their impact measurement efforts with broader global goals.

    7. Benefit-Cost Analysis (BCA): BCA is a quantitative framework used to assess the economic and social benefits of a project or policy in relation to its costs. It is commonly used in public policy and economics.

    8. Randomised Controlled Trials (RCTs): RCTs are a research design often used in impact evaluation, especially in healthcare and social sciences. They involve randomly assigning participants to treatment and control groups to measure the causal impact of an intervention.

    9. Global Impact Investing Rating System (GIIRS): GIIRS is a ratings system that evaluates the social and environmental impact of impact investments. It provides a standardised assessment of impact performance.

    10. B Impact Assessment: Developed by B Lab, the B Impact Assessment is used by Certified B Corporations to measure their social and environmental performance. It assesses a company's impact across various dimensions.

    11. Outcome Harvesting: This qualitative approach focuses on capturing and documenting outcomes and impacts as they emerge, rather than using predefined indicators. It is useful for initiatives with complex and unpredictable outcomes.

    12. Counterfactual Analysis: This approach involves comparing the actual outcomes of an intervention to what would have happened in the absence of the intervention. It helps establish causality and measure the intervention's impact.

    13. The Impact Management Project (IMP) Framework: The IMP provides a comprehensive framework for designing, measuring, and managing impact. It emphasises the importance of defining impact dimensions, setting targets, and assessing performance. IMP is now called ‘Impact Frontiers’.

    14. Moody’s ESG is a global provider of ESG data and provides ratings of more than 5,000 large cap companies.  

    15. ISS Governance provides data, insights and tools for investors, institutions and companies to make more informed decisions and integrate more and more responsible business practices, providing a broad range of ESG rating coverage of companies, funds and other issuers of financial products. 

    16. Sustainalytics is a recognised player in ESG and Corporate Governance research and ratings. They assess companies on their ESG and Corporate Governance performance - ratings can be used both by companies and investors.

    17. MSCI ESG Research rates companies according to their exposure to industry-significant ESG risks and their ability to manage those risks relative to industry peers.

    18. The Dow Jones Sustainability Index family tracks the stock performance of the world's leading companies in terms of economic, environmental and social criteria.

    When selecting a framework, it's important to consider the specific objectives, resources, and data available for impact measurement. In some cases, a combination of frameworks and methodologies may be used to provide a more comprehensive understanding of impact. Additionally, ensuring that the chosen framework aligns with your mission and values is crucial for meaningful impact measurement.

    Also, worth noting is that inconsistency of rating agencies have been pointed out.

    Reporting

    (Image Credit – Jess Bailey on Unsplash)

    Reporting standards for impact are essential for ensuring transparency, comparability, and accountability in impact measurement and reporting. Various organisations and initiatives have developed reporting standards and frameworks to guide organisations, businesses, and investors in disclosing their social, environmental, and governance performance. 

    The choice of reporting standard may depend on the nature of the organisation, industry, and the specific ESG or impact factors that are most relevant. Many organisations also choose to align their reporting with multiple standards to provide a more comprehensive view of their impact and sustainability performance.

    Where possible, it is recommended that an organisation use external assurance i.e., the review of its reports by an independent actor such as a consultant or an auditor. External verification increases recognition and credibility of reports both internally and externally. In addition, the accuracy of reports is improved, enabling better decision making.

    Here are some prominent reporting standards for impact:

    1. Global Reporting Initiative (GRI): GRI is one of the most widely used frameworks for sustainability reporting. It provides a comprehensive set of guidelines and indicators for reporting on economic, environmental, social, and governance (ESG) performance. GRI Standards help organisations measure and disclose their impacts and progress toward sustainability goals.

    2. Sustainability Accounting Standards Board (SASB): SASB provides industry-specific standards for reporting on material ESG issues in various sectors. These standards are designed to help companies communicate their ESG performance in a consistent and relevant manner to investors.

    3. Carbon Disclosure Project (CDP): CDP focuses on environmental reporting, specifically related to climate change. It collects data from thousands of companies worldwide on their carbon emissions, water usage, and deforestation risks and encourages transparency in environmental impact reporting.

    4. Integrated Reporting Framework (IR Framework): The International Integrated Reporting Council (IIRC) developed the Integrated Reporting Framework, which encourages organisations to provide a holistic view of their performance by integrating financial and non-financial information, including social and environmental impacts.

    5. Task Force on Climate-Related Financial Disclosures (TCFD): TCFD, established by the Financial Stability Board (FSB), provided recommendations for companies to disclose information on climate-related risks and opportunities in their financial filings. It aimed to help investors and stakeholders assess the financial implications of climate change. Although the TCFD website still exists as a resource, the IRFS Foundation has now taken over its work

    6. Impact Reporting and Investment Standards (IRIS): IRIS, managed by the Global Impact Investing Network (GIIN), offers a standardised set of metrics for impact investors and organisations to measure and report on their social, environmental, and financial performance.

    7. Sustainable Development Goals (SDGs) Reporting: Organisations aligning their impact reporting with the United Nations' Sustainable Development Goals (SDGs) may use specific SDG reporting frameworks and guidelines to demonstrate their contributions to global sustainability goals.

    8. Benefit Corporation Reporting: Benefit Corporations (B Corps) are required to meet certain reporting standards to maintain their B Corp status. B Lab provides guidelines and tools for B Corps to assess and report their social and environmental performance.

    9. Bloomberg Gender-Equality Index (GEI): This index measures gender equality within organisations. It assesses disclosure and performance in areas like gender pay equity, diversity, and inclusive policies.

    10. Human Rights Reporting: Various organisations, such as the United Nations Guiding Principles Reporting Framework, provide guidance on reporting on human rights due diligence, impact assessments, and actions to address human rights issues.

    11. Corporate Sustainability Reporting (CSR): Many companies produce annual CSR reports, which typically include information on environmental, social, and governance impacts, initiatives, and progress toward sustainability goals.

    12. Stakeholder Engagement and Materiality Assessments: Reporting standards often emphasise the importance of engaging stakeholders and conducting materiality assessments to identify and prioritise the most significant impacts and issues for reporting.

    13. SDG Compass: Developed by GRI, the UN Global Compact and the World Business Council for Sustainable Development (WBCSD), the SDG Compass provides guidance for companies on how they can align their strategies as well as measure and manage their contribution to the realisation of the SDGs. 

    14. Label R: A risk assessment and due diligence outfit that covers environmental, social and corporate governance (ESG) practices coupled with business ethics, including anti-money laundering, anti-corruption and ethical financial practices.

    15. Global compact: The UN Global Compact supports companies to do business responsibly by aligning with Ten Principles on human rights, labour, environment and anti-corruption; and take strategic actions to advance broader societal goals, such as the SDGs, with an emphasis on collaboration and innovation.

    16. The SFDR: This is a set of sustainability disclosure requirements that cover various ESG metrics at both the entity and product level. It became effective on March 10, 2021, but a more specific disclosure standard has yet to be adopted by the European Commission. The SFDR is a crucial part of the EU's Sustainable Finance agenda and was introduced by the European Commission in 2018 as part of its Sustainable Finance Action Plan, along with the Taxonomy Regulation and the Low Carbon Benchmarks Regulation.

    17. ISO 26000 Social Responsibility: provides guidance on how businesses and organisations can operate in a socially responsible way. This means acting in an ethical and transparent way that contributes to the health and welfare of society.

    18. The ISO 14000 family of standards Environmental Management: This provides practical tools for companies and organisations of all kinds looking to manage their environmental responsibilities.

    19.  ISO 20121: This is a voluntary standard that specifies requirements for an event sustainability management system for any type of event or event-related activity, and provides guidance on conforming to those requirements.

    There are two important pieces of legislation relating to standards in Europe which came into force from 2023. These are the European Taxonomy and the European Sustainability Reporting Standards.

    Submit Content or a Suggestion

    i
    *please share a few sentence or two on why you recommend adding this content?
    We recommend an image width of at least 1600px
    8+1=

    If you would like to become a regular contributor to the Impact Garden, we would warmly welcome you to the team!
    Please reach out to: hello@impactgarden.org